On assessing neurofeedback effects: should double-blind replace neurophysiological mechanisms?

HAL Id: hal-01658935

https://hal.inria.fr/hal-01658935

Submitted on 8 Dec 2017

HAL is a multi-disciplinary open access archive for the deposit and dissemination of

sci-L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents

Thomas Fovet, Jean-Arthur Micoulaud-Franchi, François-Benoît Vialatte,

Fabien Lotte, Christophe Daudet, Jean-Marie Batail, Jeremie Mattout,

Guilherme Wood, Renaud Jardri, Stefanie Enriquez-Geppert, et al.

To cite this version:

For Peer Review

2QDVVHVVLQJQHXURIHHGEDFNHIIHFWV

VKRXOGGRXEOHEOLQGUHSODFHQHXURSK\VLRORJLFDOPHFKDQLVPV" 

7KRPDV)29(7 -HDQ$UWKXU0,&28/$8')5$1&+,)UDQoRLV%HQRvW9,$/$77( )DELHQ /277( &KULVWRSKH '$8'(7 -HDQ0DULH %$7$,/ -pUpPLH 0$77287 *XLOKHUPH:22'5HQDXG-$5'5,6WHIDQLH(15,48(=*(33(577RPDV526 

  8QLY /LOOH &156 805  /DERUDWRLUH GH 6FLHQFHV &RJQLWLYHV HW 6FLHQFHV $IIHFWLYHV 6&$/DE3V\&+,&)/LOOH)UDQFH &+8/LOOH3{OHGH3V\FKLDWULH8QLWp&85() /LOOH)UDQFH

  6HUYLFHV GH[SORUDWLRQV IRQFWLRQQHOOHV GX V\VWqPH QHUYHX[ &OLQLTXH GX VRPPHLO &+8 GH %RUGHDX[3ODFH$PpOLH5DED/HRQ%RUGHDX[)UDQFH 865&1566$136<&+8 3HOOHJULQ8QLYHUVLWpGH%RUGHDX[)UDQFH &156805%UDLQ3ODVWLFLW\8QLW%UDLQ&RPSXWHU,QWHUIDFHWHDPUXH9DXTXHOLQ 3DULV&HGH[)UDQFH (63&,3DULV36/5HVHDUFK8QLYHUVLW\UXH9DXTXHOLQ3DULV&HGH[)UDQFH ,QULD%RUGHDX[6XG2XHVW/D%5,8QLY%RUGHDX[&156,3%±DYHQXHGHODYLHLOOHWRXU 7DOHQFH&HGH[)UDQFH 8QLYHUVLWpGH%RUGHDX[%RUGHDX[)UDQFH

  $FDGHPLF 3V\FKLDWU\ 'HSDUWPHQW &HQWUH +RVSLWDOLHU *XLOODXPH 5pJQLHU 5HQQHV )UDQFH ,QVHUP9LVDJHV8,5,6$&DPSXVGH%HDXOLHX)5HQQHV)UDQFH³%HKDYLRUDQG%DVDO *DQJOLD´UHVHDUFKXQLW($8QLYHUVLW\RI5HQQHV5HQQHV)UDQFH

  %UDLQ '\QDPLFV DQG &RJQLWLRQ 7HDP /\RQ 1HXURVFLHQFH 5HVHDUFK &HQWHU ,16(50 8 &1568058QLYHUVLW\/\RQ/\RQ))UDQFH

  'HSDUWPHQW RI 3V\FKRORJ\ .DUO)UDQ]HQV8QLYHUVLW\ *UD] *UD] $XVWULD %LR7HFK0HG *UD] $XVWULD

  'HSDUWPHQW RI &OLQLFDO DQG 'HYHORSPHQWDO 1HXURSV\FKRORJ\ 8QLYHUVLW\ RI *URQLQJHQ *URQLQJHQWKH1HWKHUODQGV

  /DERUDWRU\ %HKDYLRUDO 1HXURORJ\ DQG ,PDJLQJ RI &RJQLWLRQ 'HSDUWPHQW RI 1HXURVFLHQFH 8QLYHUVLW\0HGLFDO&HQWHUDQG&DPSXV%LRWHFK*HQHYD6ZLW]HUODQG



&RUUHVSRQGLQJDXWKRU 'U7KRPDV)29(7

For Peer Review

$%%5(9,$7,216

1)%QHXURIHHGEDFN 605VHQVRULPRWRUUK\WKP

For Peer Review

0DGDP6LU 



:H UHDG ZLWK JUHDW LQWHUHVW WKH UHFHQW DUWLFOH RI 6FKDEXV HW DO HQWLWOHG%HWWHU WKDQ VKDP" $ GRXEOHEOLQG SODFHERFRQWUROOHG QHXURIHHGEDFN VWXG\ LQ SULPDU\ LQVRPQLD SXEOLVKHG LQ %UDLQ 6FKDEXV HW DO  DQG LWV FRPPHQWDU\ ³1HXURIHHGEDFN RU QHXURSODFHER"´ 7KLEDXOW HW DO  ,Q UHFHQW \HDUV ((*QHXURIHHGEDFN 1)% KDV EHQHILWHGIURPDUHYLYDORILQWHUHVWDOWKRXJKLWVFOLQLFDOHIILFDF\UHPDLQVDFRQWURYHUVLDODQG GHOLFDWHLVVXH0LFRXODXG)UDQFKLDQG)RYHW7KLEDXOWDQG5D]6LWDUDPHWDO ,QWKHFRQWH[WRIDJHQHUDOUHSURGXFLELOLW\FULVLVLQVFLHQFH%DNHUZHFDQRQO\ EHGHOLJKWHGWKDWQHJDWLYHUHVXOWVDUHEHLQJUHFRJQLVHGLQOHDGLQJQHXURORJ\MRXUQDOVVXFKDV

%UDLQ 7KH ILQGLQJV RI 6FKDEXV HW DO DUH RI JUHDW VFLHQWLILF LQWHUHVW FRQWULEXWLQJ WR D

VWLPXODWLQJGHEDWHLQWKHGRPDLQRI((*1)%+RZHYHUZHEHOLHYHWKDWFDXWLRQLVQHHGHG EHIRUHJHQHUDOL]LQJWKHVHUHVXOWVWR605IUHTXHQF\WUDLQLQJDVZHOODVWKHHQWLUHILHOG7KLVLV EHFDXVH LUUHVSHFWLYH RI ZKHWKHU UHVXOWV IURP D VLQJOH VWXG\ DUH SRVLWLYH RU QHJDWLYH ³RQH VZDOORZ GRHV QRW D VXPPHU PDNH´ 0RUHRYHU GHVSLWH WKH VWXG\¶V GRXEOHEOLQG GHVLJQ LQFRQVLVWHQFLHV H[LVW EHWZHHQ HDUOLHU DQG FXUUHQW UHVXOWV SXEOLVKHG E\ WKH VDPH UHVHDUFK JURXS

,WPD\DWILUVWDSSHDUVXUSULVLQJWKDW6FKDEXVHWDOZHUHQRWDEOHWRUHSOLFDWHVRPHNH\ QHXURSK\VLRORJLFDO UHODWLRQVKLSV WKDW KDYH FRQVLVWHQWO\ HPHUJHG LQ WKHLU SUHYLRXV ZRUN ,Q  ZLWK D VDPSOH RI  KHDOWK\ VXEMHFWV WKH VDPH WHDP GHPRQVWUDWHG WKDW  1)% VHVVLRQV RI VHQVRULPRWRU UK\WKP 605  +] XSUHJXODWLRQ ZDV VXFFHVVIXO LQ FRQGLWLRQLQJDQLQFUHDVHLQUHODWLYH605DPSOLWXGHHOLFLWLQJSRVLWLYHFKDQJHVLQVOHHS SDUDPHWHUV VOHHS VSLQGOH QXPEHU DQG VOHHS RQVHW ODWHQF\  HOLFLWLQJ FKDQJHV LQ GHFODUDWLYH PHPRU\ SHUIRUPDQFH HQKDQFHPHQW LQ UHWULHYDO VFRUH FRPSXWHG DW LPPHGLDWH FXHGUHSRUW+RHGOPRVHUHWDO,QWKHVDPHYHLQLQ6FKDEXVHWDOUHSRUWHGLQ  SDWLHQWV ZLWK LQVRPQLD GLVRUGHU  D SRVLWLYH FRUUHODWLRQ EHWZHHQ 6051)% WUDLQLQJ HQKDQFHPHQW RYHUQLJKW PHPRU\ FRQVROLGDWLRQ DQG VOHHS VSLQGOH FKDQJHV  D VLJQLILFDQW HIIHFW RI 6051)% RQ REMHFWLYHVOHHS TXDOLW\ D GHFUHDVH LQWKH QXPEHU RI DZDNHQLQJV D WUHQGWRZDUGVGHFUHDVHGVOHHSRQVHWODWHQF\DQGDQLQFUHDVHLQVORZZDYHVOHHS6FKDEXVHW

For Peer Review

3DUDGR[LFDOO\ LQ WKHLU GRXEOHEOLQG VWXG\ LQYROYLQJ  SDWLHQWV ZLWK LQVRPQLD GLVRUGHU DQG  SDWLHQWV ZLWK PLVSHUFHSWLRQ LQVRPQLD WKH\ GLG QRW UHSURGXFH D VLJQLILFDQW HIIHFW RI 6051)% RQ REMHFWLYH PHDVXUHV RI VOHHS TXDOLW\ QHLWKHU LQ WKH DFWLYH QRU LQ WKH SODFHER JURXS 6FKDEXV HW DO  +RZHYHU LQ D ZHOOFRQWUROOHG GRXEOHEOLQG VWXG\ XQUHODWHGWR LQVRPQLD .REHU HW DO UHSOLFDWHGILQGLQJ  DQG H[WHQGHG IURP LPPHGLDWH UHFDOOWRKRXUVGHOD\HGUHVSRQVH.REHUHWDOD7KHUHIRUHWKHXVHRIGRXEOHEOLQG FRQWURODORQHFDQQRWH[SODLQDOOWKHQXOOUHVXOWVRI6FKDEXVHWDO'HILQLWHFRQFOXVLRQV FDQRQO\EHGUDZQRQWKHEDVLVRIPRUHVROLGGDWD

,Q SDUWLFXODU ZH WKLQNDQ\ GLVFXVVLRQ RI 1)% LV LQFRPSOHWH ZLWKRXWFRQVLGHULQJ LWV EDVLV IURP WKH SRLQW RI YLHZ RI QHXURSK\VLRORJLFDO PHFKDQLVPV ,QGHHG WKH SUHYLRXVO\ HVWDEOLVKHGFRUUHODWLRQVEHWZHHQSRVW1)%VOHHSVSLQGOHJHQHUDWLRQDQGZLWKLQVHVVLRQ1)% FRQWURO KLJKOLJKW NH\ QHXURSK\VLRORJLFDO PHFKDQLVPV WKDW DUH GLIILFXOW WR EH UHGXFHG WR VLPSOHSODFHERSURFHVVHVDQGRUDVLQJOHEOLQGGHVLJQ+RHGOPRVHUHWDO6FKDEXVHW

DO  )URP D KLVWRULFDO SHUVSHFWLYH VHPLQDO H[SHULPHQWV E\ 6WHUPDQ DQG FROOHDJXHV

6WHUPDQHW DO  ZHUH WKH ILUVW WR VKRZ WKDW ZDNLQJ 605 DFWLYLW\ PD\ EH RSHUDQWO\ FRQGLWLRQHGWREHPRUHVWURQJO\H[SUHVVHGGXULQJVXEVHTXHQWVOHHS6LQFHORQJWHUPHIIHFWV PDQLIHVW LQ WKH VDPH GLUHFWLRQ GLFWDWHG E\ WKH WUDLQLQJ D FDQGLGDWH PHFKDQLVP PD\ EH +HEELDQSODVWLFLW\VHH5RVHWDOIRUDUHYLHZ,QIDFWDKRVWRIRWKHU1)%VWXGLHV LQGLFDWHDVLPLODU+HEELDQUHODWLRQVKLSEHWZHHQZLWKLQVHVVLRQDQGSRVWVHVVLRQ((*FKDQJHV HJ &KR HW DO  =RHIHO HW DO  (QJHOEUHJW HW DO  ,PSRUWDQWO\ RQOLQH FRQWURORIVSHFWUDOSRZHULVQHFHVVDU\EXWLQVXIILFLHQWDVDGHPRQVWUDWLRQRIEUDLQSODVWLFLW\ LQGXFWLRQLHDODVWLQJFKDQJHRXWVLGHRIWKHWUDLQLQJVHVVLRQ+HQFHDFUXFLDOTXHVWLRQRI PHFKDQLVWLF LPSRUWDQFH LV ZK\ WKHUH ZDV QR DVVRFLDWLRQ EHWZHHQ WKH 1)% WUDLQLQJ LQ WKH FXUUHQW VWXG\ ZLWK DQ\ FKDQJH LQ RIIOLQH VSLQGOH DFWLYLW\ DQG RIIOLQH 605 DFWLYLW\ DV REVHUYHGWZLFHLQWKHWHDP¶VSUHYLRXVZRUN+RHGOPRVHUHWDO6FKDEXVHWDO"

For Peer Review

OHVV FKDOOHQJLQJ LW PD\ KDYH OHG WR D GHFUHDVH LQ WKH 605 DFWLYLW\ GXULQJ WKH VHFRQG EDVHOLQH SHULRGV SUHFHGLQJ HDFK WULDO DQG XVHG DV UHIHUHQFHV IRU HDFK WULDO ZKHQ FRPSDUHG ZLWKWKHVSRQWDQHRXVUHVWLQJVWDWH605DFWLYLW\RIHDFKVXEMHFWSULRUWR1)%+HQFHJLYHQ WKDW)LJXUHRQO\GLVSOD\VSHUFHQWHYRNHGSRZHUIURPWKLVUHVSHFWLYHVHFRQGEDVHOLQHLWLV KDUGWRYHULI\ZKHWKHUDEVROXWH605SRZHUGXULQJ1)%DFWXDOO\H[FHHGHGWKHYDOXHVRIWKH UHVWLQJVWDWH DFWLYLW\ UHFRUGHG EHIRUH WKH VWDUW RI 1)% WUDLQLQJ )URP D PHFKDQLVWLF VWDQGSRLQWDOWHULQJ ((* DFWLYLW\ VLJQLILFDQWO\ IURPLWV VSRQWDQHRXV YDOXH PD\ EHD FULWLFDO GHWHUPLQDQW RI SODVWLFLW\ LQGXFWLRQ 5RVHW DO :H WKHUHIRUHLQYLWH 6FKDEXV HW DO WR FODULI\WKLVLVVXHE\VXEPLWWLQJVXSSOHPHQWDU\GDWDSURYLGLQJDEVROXWH605FKDQJHVGXULQJ 1)%UHODWLYHWRWKHLQLWLDOPLQXWHUHVWLQJVWDWHXQUHIHUHQFHGWRWKHSRWHQWLDOO\YDULDEOH VHFRQGEDVHOLQHVEHIRUHHDFKWULDO,QWHUHVWLQJO\ZKLOHFKDQJHVIURPEDVHOLQHURXJKO\VFRUH EHWZHHQDQGLQLQWKHFXUUHQWVWXG\WKH\OLHRQO\EHWZHHQDQG 6XFKGLIIHUHQFHVPD\DULVHE\VLPSO\XVLQJGLIIHUHQWOHDUQLQJLQGLFHVDQGRUWKHLQIOXHQFHRI WKHH[SHULPHQWHU¶V NQRZOHGJHXQEOLQGQHVV KRZHYHU WKH\ PLJKWDOVR UHIOHFW GLIIHUHQFHV LQ 1)%OHDUQLQJDQGXOWLPDWHO\FRQWULEXWHWRDUHGXFHGLPSDFWRQEUDLQSODVWLFLW\

)LQDOO\DQGUHJDUGOHVVRIZKHWKHUEUDLQSODVWLFLW\ZDVDFWXDOO\LQGXFHGE\6FKDEXVHW DO¶V  SDUDGLJP ORJLFDO UHDVRQLQJ VKRXOG KDYH UHVWULFWHG 7KLEDXOW HW DO WR D VLPSOHU FODLP WKDW WKLV VSHFLILF 1)% WUDLQLQJ IRU WKLV VSHFLILF DSSOLFDWLRQ ZDV QRW EHWWHU WKDQ SODFHER,QVWHDGWKH\DSSHDUWRRYHUJHQHUDOL]HWKHQXOOILQGLQJVLQWKHWUHDWPHQWRILQVRPQLD WRWKHJUHDWHUILHOGRI((*1)%6XFKDSRVLWLRQDSSHDUVWRXVWREHPRUHLGHRORJLFDOWKDQ VFLHQWLILF DQG FRQWUDGLFWV WKH RYHUDOO VSLULW QHFHVVDU\ IRU DGYDQFLQJ PHGLFDO UHVHDUFK %\ MXPSLQJWRFRQFOXVLRQV7KLEDXOWHWDOIRUJHWWKDWFDXWLRQQHHGVWREHDSSOLHGWRERWKSRVLWLYH DQG QHJDWLYH ILQGLQJV 1)% VKRXOG EH FRQVLGHUHG DV D XQLTXH WRRO IRU WDUJHWLQJ VSHFLILF QHXUDO DFWLYLWLHV UDWKHU WKDQ DV D SDQDFHD IRU DOO EUDLQ GLVRUGHUV 6XFFHVVIXO GHSOR\PHQW RI 1)%FULWLFDOO\GHSHQGVRQRXUNQRZOHGJHRIWKHEUDLQ¶VLQQHUZRUNLQJVZKLFKVWLOOUHPDLQV LQFRPSOHWH +HQFH WR SURSHUO\ H[SORLW WKLV DSSURDFK WKHUH LV DQ XUJHQW QHHG IRU PRUH UHVHDUFK LQ RUGHU WR ERWK RSWLPL]H 1)% OHDUQLQJ HJ QXPEHU RI WULDOV LQ D 1)% EORFN WKUHVKROG UXOHV QXPEHU RI WUDLQLQJ VHVVLRQV 0LFRXODXG)UDQFKL HW DO  (QULTXH] *HSSHUW HW DO DQG WR VHOHFW WKH PRVW DSSURSULDWH WUDLQLQJ SURWRFRO IRUHDFK GLVRUGHU .REHUHWDOE

For Peer Review

,Q FRQFOXVLRQ WKH QHJDWLYH ILQGLQJV SXEOLVKHG E\ 6FKDEXV HW DO H[FLWLQJO\ JHQHUDWH PRUH TXHVWLRQV WKDQ DQVZHUV IRU WKH ILHOG 0RUHRYHU WKH ODVW ILIW\ \HDUV VLQFH 1)%¶V GLVFRYHU\ FDQQRW EH FRQVLGHUHG D KRPRJHQRXV UHFRUG JLYHQ VHYHUDO GHFDGHV RI UHODWLYH GRUPDQF\LQWHUPVRIUHVHDUFKRXWSXWEHIRUHDUHVXUJHQFHLQWKHHDUO\V+HQFHWKHVH UHVXOWV FDOO IRU PRUH UHVHDUFK UDWKHU WKDQ OHVV LQFOXGLQJ D GHHSHU H[SORUDWLRQ RI WKH QHXUDO PHFKDQLVPV DQG PHWKRGRORJLFDO QXDQFHV HPHUJLQJ IURP WKLV HPEU\RQLF ILHOG  SUHIHUDEO\ EHIRUH SUHPDWXUH ODXQFKHV RI GRXEOHEOLQG FOLQLFDO VWXGLHV ,W LV PRUH FRQFHLYDEOH WKDW WKH VWRU\RI1)%LVDVLPSOHUHIOHFWLRQRIWKHJHQHUDOVFLHQWLILFSURFHVVZKLFKWKURXJKLWVWZLVWV DQGWXUQVUHPDLQVLQWKHVDIHUMXGJHPHQWRISRVWHULW\       '(&/$5$7,212),17(5(676

)%9 UHFHLYHG IXQGLQJ IURP WKH FRPSDQ\ 8UJRWHFK )UDQFH WR LQYHVWLJDWH QHXURIHHGEDFN KRZHYHUWKLVVSRQVRUKDGQRLQYROYHPHQWLQWKHSUHSDUDWLRQRIWKLVOHWWHU

7)-$0))/&'-0%-0*:5-6(*DQG75GHFODUHQRFRQIOLFWRILQWHUHVW