• Aucun résultat trouvé

Dependable multi-touch interactions in safety critical industrial contexts: Application to aeronautics

N/A
N/A
Protected

Academic year: 2021

Partager "Dependable multi-touch interactions in safety critical industrial contexts: Application to aeronautics"

Copied!
9
0
0

Texte intégral

(1)Dependable multi-touch interactions in safety critical industrial contexts: Application to aeronautics Arnaud Hamon, Philippe Palanque, Martin Cronel. To cite this version: Arnaud Hamon, Philippe Palanque, Martin Cronel. Dependable multi-touch interactions in safety critical industrial contexts: Application to aeronautics. IEEE 13th International Conference on Industrial Informatics (INDIN 2015), IEEE, Jul 2015, Cambridge, United Kingdom. pp.980–987, �10.1109/INDIN.2015.7281868�. �hal-03209328�. HAL Id: hal-03209328 https://hal.archives-ouvertes.fr/hal-03209328 Submitted on 29 Apr 2021. HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés..

(2) 'HSHQGDEOH0XOWL7RXFK,QWHUDFWLRQVLQ6DIHW\ &ULWLFDO,QGXVWULDO&RQWH[WV$SSOLFDWLRQWR $HURQDXWLFV $UQDXG+DPRQ3KLOLSSH3DODQTXH 0DUWLQ&URQHO. ,QWHUDFWLYH&ULWLFDO6\VWHPV*URXS8QLYHUVLWpGH7RXORXVH 7RXORXVH)UDQFH KDPRQ#LULWIUSDODQTXH#LULWIUFURQHO#LULWIU  Abstract²2YHUWKHODVWIHZ\HDUVPXOWLWRXFKLQWHUIDFHVKDYH FRQVXPHU HOHFWURQLFV « 6XFK LQWHUIDFHV KDYH GHPRQVWUDWHG PDGH WKHLU ZD\V LQ PRVW HQYLURQPHQWV LQFOXGLQJ PRELOH EHQHILWV UHODWHG WR WKH IDFW WKDW WKH RXWSXW GHYLFH LQWHJUDWHV WHFKQRORJLHV IOLJKW HQWHUWDLQPHQW V\VWHPV FRQVXPHU HOHFWURQLFV LQSXWPDQDJHPHQWWKXVEULGJLQJWKH XVXDO

(3) JDSEHWZHHQLQSXW « 6XFK LQWHUIDFHV DQG DVVRFLDWHG LQWHUDFWLRQ WHFKQLTXHV KDYH DQG RXWSXW LQ XVHU LQWHUIDFHV 7KH\ KDYH DOVR GHPRQVWUDWHG GHPRQVWUDWHG EHQHILWV SDUWO\ GXH WR WKH IDFW WKDW WKH RXWSXW EHQHILWVLQWHUPVRISHUIRUPDQFHIRUWULJJHULQJFRPPDQGVE\ GHYLFHLQWHJUDWHVLQSXWPDQDJHPHQWWKXVEULGJLQJWKH FODVVLFDO

(4)  H[SORLWLQJPXOWLILQJHUVLQWHUDFWLRQVWKXVUHGXFLQJWKHQXPEHU JDSEHWZHHQLQSXWDQGRXWSXWLQXVHULQWHUIDFHV7KH\KDYHDOVR RIXQQHFHVVDU\PRGHV GHPRQVWUDWHG EHQHILWV LQ WHUPV RI SHUIRUPDQFH IRU WULJJHULQJ 3URYLGLQJ PXOWLWRXFK LQWHUDFWLRQV IRU WKH FRPPDQG DQG FRPPDQGVE\H[SORLWLQJPXOWLILQJHUVLQWHUDFWLRQVWKXVUHGXFLQJ FRQWURO RI FLYLO DLUFUDIW ZRXOG FRQVLVWV LQ DQRWKHU VLJQLILFDQW WKHQXPEHURIXQQHFHVVDU\ PRGHV7RJHWKHUZLWKWKHVHEHQHILWV PXOWLWRXFK LQWHUIDFHV EULQJ D VHW RI LVVXHV WKDW DUH VWLOO WR EH HYROXWLRQDU\ VWHS DV IDU DV WKH HYROXWLRQ RI FRFNSLWV LV VROYHG SULRU WR PDNH WKHP ³DFFHSWDEOH´ IRU FRPPDQG DQG FRQFHUQHG +RZHYHU WRJHWKHU ZLWK WKH EHQHILWV SUHVHQWHG FRQWURORI VDIHW\

(5) FULWLFDOLQWHUDFWLYHV\VWHPV6XFKLVVXHVLQFOXGH DERYHPXOWLWRXFKLQWHUIDFHVEULQJDVHWRILVVXHVWKDWDUHVWLOO XVDELOLW\DQGUHOLDELOLW\LQDZD\WKDWLVHYHQPRUHVDOLHQWWKDQLQ WR EH VROYHG SULRU PDNLQJ WKHP ³DFFHSWDEOH´ IRU FRPPDQG ³FODVVLFDO´ :LQGRZV ,FRQV 0HQXV 3RLQWLQJ GHYLFH :,03

(6)  DQG FRQWURO RI VDIHW\

(7)  FULWLFDO LQWHUDFWLYH V\VWHPV 7KHVH LQWHUIDFHV WKDW KDYH EHHQ DURXQG IRU PRUH WKDQ  \HDUV 7KLV LVVXHV WRXFK PDQ\ SURSHUWLHV VXFK DV UHOLDELOLW\ DQG PRUH SDSHUSURSRVHVDQRWDWLRQDQGLWVDVVRFLDWHGWRROIRUGHVFULELQJLQ JOREDOO\UHVLOLHQFH D FRPSOHWH DQG XQDPELJXRXV ZD\ PXOWLWRXFK LQWHUDFWLRQV WKXV 7KHVH VHWV RI LVVXHV DUH QRW QHZ DQG DSSHDUHG DOUHDG\ ZKHQ PDLQO\ WDUJHWLQJDWUHOLDELOLW\:HSUHVHQWIURP DFDVHVWXG\ LQ LQWHUDFWLRQV LQ WKH FRFNSLW HYROYHG IURP ³SK\VLFDO WKH DSSOLFDWLRQ GRPDLQ RI LQWHUDFWLYH FRFNSLWV RI DLUFUDIWV

(8)  KRZ WKHQRWDWLRQPDNHVLWSRVVLEOHWRGHVFULEHVXFKLQWHUDFWLRQVIURP LQWHUDFWLRQV´ E\ PDQLSXODWLQJ SK\VLFDO NQREV DQG UHDGLQJ WKH KDUGZDUHOHYHO DQG KRZWKLVQRWDWLRQFDQ EHLQWHJUDWHGLQWR LQIRUPDWLRQRQGLDOV

(9) WRVRIWZDUHFRQWUROVPDLQO\EDVHGRQWKH DQLQGXVWULDOGHYHORSPHQWSURFHVV $5,1&VSHFLILFDWLRQ >@2IWHQFRQVLGHUHGPRUHUHOLDEOH PHDQV WR WULJJHU FRPPDQGV IURP WKH FRFNSLW HTXLSPHQW¶V Keywords—multi-touch interaction, cockpits, aeronautics SXVKEXWWRQV URWDWRUV DQG VDIHJXDUGHG SK\VLFDO EXWWRQV KDYH SRSXODWHG WKH IOLJKW GHFNV¶ VSDFH +RZHYHU WKHVH GHYLFHV , ,1752'8&7,21 JHQHUDWH VLJQLILFDQW ZHLJKW ORDG DQG EULQJ PRGLILDELOLW\ XSJUDGDELOLW\

(10)  LVVXHV ,QGHHG WKHVH SK\VLFDO FRPSRQHQWV DUH 2YHUWKH\HDUVWKHHYROXWLRQRIFRFNSLWVLQODUJHFLYLODLUFUDIWV GLUHFWO\ OLQNHG WR WKH V\VWHPV WKH\ FRPPDQG UHVXOWLQJ LQ WKH KDVWDNHQSODFHIROORZLQJWZRGLIIHUHQWSDWKV IDFW WKDW HYROXWLRQV PDGH WR WKH DIRUHPHQWLRQHG V\VWHPV DUH x 6PDOO LQFUHPHQWVHYROXWLRQV WDUJHWLQJ DW VROYLQJ OLNHO\ WR UHTXLUH PRGLILFDWLRQV WR WKH FRPSRQHQWV 7KLV LGHQWLILHGSUREOHPVRULQWHJUDWLQJQHZHTXLSPHQWLQWRDQ UHTXLUHVDGDSWDWLRQRIWKHFRFNSLWLWVHOI ZKLFKLVDGLVWULEXWHG H[LVWLQJFRFNSLW FRJQLWLYH V\VWHP >@

(11)  DQG XOWLPDWHO\ WKH DGDSWDWLRQ RI x 6LJQLILFDQWVWHSVHYROXWLRQVHQGLQJXSZLWKDFRPSOHWHUH SURFHGXUHVDQGWUDLQLQJ)LQDOO\GXH WRWKHLUSK\VLFDO QDWXUH GHVLJQ RI WKH FRFNSLWV LQFOXGLQJ FRQWUROV DQG GLVSOD\V WKH PRUH FRPSOH[ WKH DLUFUDIW V\VWHPV WKH PRUH QXPHURXV ([DPSOHVRIVXFKHYROXWLRQVLQFOXGHJODVVFRFNSLW ZKHUH SK\VLFDO FRPSRQHQWV ZLOO DSSHDU LQ WKH FRFNSLWV 7KH ODUJH GLVSOD\ XQLWV ZHUH LQFOXGHG LQ WKH IOLJKW GHFN

(12)  DQG GHYHORSPHQWRIWKH$5,1&VSHFLILFDWLRQ>@GHVFULEHGLQ PRUH UHFHQWO\ LQWHUDFWLYH FRFNSLWV FRPSOLDQW ZLWK WKHUHODWHGZRUNSDUDJUDSKZDVPDLQO\GULYHQE\WKHVHLVVXHV $HURQDXWLFDO 5DGLR ,QFRUSRUDWHG $5,1&

(13)   LHUHGXFLQJFRFNSLWVL]HDQGLQFUHDVLQJLWVPRGLILDELOLW\ VSHFLILFDWLRQV >@ ZKHUH LQWHUDFWLRQ WDNHV SODFH WKURXJK 7KH UHPDLQGHU RI WKLV SDSHU LV RUJDQL]HG DV IROORZV ILUVW LW PRXVHOLNHLQSXWGHYLFHVDQGNH\ERDUGV DGGUHVVHVWKHUDWLRQDOHIRUWKHXVHRIPXOWLWRXFKDSSOLFDWLRQV ,Q SDUDOOHO RI WKHVH HYROXWLRQV LQ WKH FRFNSLW PXOWLWRXFK LQ DYLRQLF DSSOLFDWLRQV DV ZHOO DV WKH UHODWHG LVVXHV IURP D LQWHUIDFHV KDYH PDGH WKHLU ZD\V LQ PRVW HQYLURQPHQWV VSHFLILFDWLRQ SHUVSHFWLYH ,W WKHQ SUHVHQWV ZK\ PXOWLWRXFK LQFOXGLQJ PRELOH WHFKQRORJLHV IOLJKW HQWHUWDLQPHQW V\VWHPV LQWHUDFWLRQVKDYHWKHSRWHQWLDOIRUJRLQJEH\RQGWKHQXPHURXV.

(14) EHQHILWV EURXJKW E\ LQWHUDFWLYH FRFNSLWV FRPSOLDQW ZLWK $5,1&VSHFLILFDWLRQEXWDOVRWKHQHZSUREOHPVWKH\UDLVH LQ WHUPV RI HQJLQHHULQJ 7KH SDSHU WKHQ SURSRVHV D FRQWULEXWLRQWDUJHWLQJDWWKHVHLVVXHVDQGILQDOO\GHPRQVWUDWHV RQDFDVHVWXG\KRZWKHDSSURDFKFDQEHDSSOLHGLQWHJUDWHGLQ DQ LQGXVWULDO GHYHORSPHQW SURFHVV DQG KRZ LW VROYHV WKH LGHQWLILHGLVVXHV ,, 5$7,21$/()25,19(67,*$7,1*08/7,728&+ ,17(5$&7,216,1&2&.3,76 7KH HYROXWLRQV EURXJKW E\ XVHU LQWHUIDFHV FRPSOLDQW ZLWK $5,1&VSHFLILFDWLRQ>@KDYHQRWEHHQDEOHWRVROYHDOOWKH LVVXHVUDLVHGE\LQWHUDFWLRQVLQWKHFRFNSLW ‡ 'HVSLWH WKH SRWHQWLDO XVH RI 'LVSOD\ 8QLWV '8V LH FRPSXWHU VFUHHQV

(15)  FRPELQHG ZLWK .H\ERDUG DQG &XUVRU &RQWURO 8QLWV .&&8V

(16)  WKH FRFNSLW VSDFH UHPDLQV FRQILQHG DQGDERWWOHQHFNIRUWKHHYHUJURZLQJFRPSOH[LW\RIDLUFUDIWV ‡ ,QSXW DQGRXWSXWDUH VWLOOGLVMRLQWV HJ .&&8VDQG '8V

(17)  ZKLFK LQWURGXFHV DUWLFXODWRU\ GLVWDQFH IRU SLORWV WR FRQWUROWKHDYLRQLFV\VWHPV ‡ (YHQ WKRXJK VRPH FRFNSLWV RIIHU WRXFK LQWHUDFWLRQV WKH\ UHPDLQ OLPLWHG WR PRQRWRXFK WHFKQLTXHV RYHU :,03 LQWHUIDFHV 6LQFH WKH REVHUYDWLRQV PDGH LQ >@ VHYHUDO VWXGLHV DQG UHVHDUFK SURMHFW KDYH VWXGLHG WKH SRWHQWLDO EHQHILWV RI PXOWL WRXFK LQWHUDFWLRQV LQ FRFNSLWV )RU LQVWDQFH WKH )HGHUDO $YLDWLRQ $GPLQLVWUDWLRQ )$$

(18)  KDV DSSRLQWHG +RQH\ZHOO WR VWXG\WKHKXPDQIDFWRUVDVSHFWVRISLORWV¶DFWLYLW\VXSSRUWHGE\ WRXFKVFUHHQV>@)URPDPDQXIDFWXUHUSRLQWWKH$LUEXV5 7 FRFNSLW GLYLVLRQ >@ VWXGLHG WKH LQWURGXFWLRQ RI PXOWLWRXFK GLVSOD\V LQ FRFNSLWV IROORZLQJ D KXPDQ FHQWUHG DSSURDFK ZKHUH D FODVVLILFDWLRQ RI PXOWLWRXFK WDVNV DFFRUGLQJ WR WKHLU HUJRQRPLF FULWHULD LV SURSRVHG 7KDW VWXG\ GHPRQVWUDWHV WKH EHQHILWV RI XVLQJ PXOWLWRXFK LQWHUIDFHV LQ FRFNSLWV DQG WKH ODUJHLPSDFWWKHFRQWH[WRIXVHKDVRQWKHLQWHUDFWLRQ 0XOWLXVHU LQWHUDFWLRQV H[WHQG WKH LQWHUDFWLRQ VSDFH FRPSDUHG WR PRQRXVHU RQHV +DYLQJ WZR XVHUV LPSOLHV IRU LQVWDQFHWKDWWKHUHDUHQRZIRXUKDQGVZKLFKFDQLQWHUDFWZLWK WKH V\VWHP DW WKH VDPH WLPH DQGRU ORFDWLRQ )ROORZLQJ WKLV SROLF\LWLVSRVVLEOHWRGHVLJQVSHFLILFLQWHUDFWLRQVIRUDFULWLFDO RSHUDWLRQZKLFKZRXOGUHTXLUHDFWLRQVWREHSHUIRUPHGE\WZR RSHUDWRUV VLPXOWDQHRXVO\ )RU LQVWDQFH D GRXEOH FKHFN DFWLRQ ZLWK IRXU KDQGV LQD GHOLPLWHGUDQJH RI WLPH >@ ZKHUH ERWK PHPEHUV RI WKH FUHZ KDYH WR WRXFK WKH VFUHHQ ZLWK WKHLU WKXPEV7KH LQWHUDFWLRQWHFKQLTXHVFRXOGDOVREHGLIIHUHQWIRU WKH WZR XVHUV HJ WKH FDSWDLQ KDV WR WRXFK ZLWK ERWK WKXPEV ZKLOH WKH ILUVW RIILFHU KDV WR PDNH WZR FLUFOHV DW WKH VDPH PRPHQWWRDYRLGVSXULRXVDQGKXPDQHUURU ,,, (1*,1((5,1*,668(6)2508/7,728&+ ,17(5$&7,216 7KLVVHFWLRQLQWURGXFHVWKHPDLQLVVXHVIRUDGGLQJPXOWLWRXFK LQWHUDFWLRQV LQ FRFNSLWV IURP DQ HQJLQHHULQJ SRLQW RI YLHZ 6LQFH PXOWLWRXFK LQWHUDFWLRQV DUH PXOWLPRGDO QH[W SDUDJUDSKDGGUHVVHVWKH JHQHULFLVVXHV IRUHQJLQHHULQJ PXOWL PRGDOLQWHUDFWLRQVZKLOHWKHVHFRQGRQHGHWDLOVVSHFLILFPXOWL. WRXFK LVVXHV 7KH VHFRQG SDUDJUDSK DGGUHVVHV WKH LVVXHV UHODWHG WR HQJLQHHULQJ VXFK LQWHUDFWLRQ WHFKQLTXHV LQ WKH VSHFLILFFRQWH[WRILQWHUDFWLYHFRFNSLWV A. Multi-modal interactions $VWKHHQJLQHHULQJRIPXOWLPRGDOLQWHUIDFHVKDVEHHQVWXGLHG IRU PDQ\ \HDUV ZH IRFXV KHUH RQ LVVXHV UHODWHG WR KDYLQJ PRUH WKDQ RQH XVHU LQYROYHG LQ WKH LQWHUDFWLRQ :H KDYH LGHQWLILHG WZR PDLQ LVVXHV UHODWHG WR PXOWLXVHUV LQWHUDFWLRQV )LUVWIRUWKHVDPHLQSXWGHYLFHDQGWKHVDPHLQSXWDFWLRQWZR XVHUV FDQ KDYH GLIIHUHQW LQWHUDFWLRQ WHFKQLTXHV HJ VZLSH YHUVXVVLPSOHSUHVVRQDWRXFKVFUHHQ 6HFRQG WKH GHYLFHV XVHG E\ WKH YDULRXV XVHUV PD\ EH RI GLIIHUHQW W\SHV QRW FRORFDWHG DQG LQVWDOOHG RQ GLIIHUHQW SDUWLWLRQV UXQQLQJ RQ DQ ,0$ ,QWHJUDWHG 0RGXODU $YLRQLFV

(19)  ZLWKGLIIHUHQW ZLQGRZ PDQDJHPHQWV $OOWKHVHLVVXHVUHTXLUH WKH FDUHIXO GHILQLWLRQ RI PXOWLPRGDO PXOWLXVHU LQWHUDFWLRQV PDNLQJ H[SOLFLW WKH XVHU WKH LQSXW GHYLFH DQG WKH LQWHUDFWLRQ WHFKQLTXHXVHG &XUUHQWO\ RXU ZRUN IRFXVHV RQ LGHQWLFDO LQWHUDFWLRQ WHFKQLTXHVSHUW\SHRIGHYLFHHDFKSHUVRQRIWKHFUHZKDYLQJ KLVKHURZQWRXFKVFUHHQDQGDVKDUHGRQH DVWKLVSURSRVHVD JRRGFRPELQDWLRQRIWKHLVVXHVDERYH

(20)  B. Multi-touch interactions 0XOWLWRXFK LQWHUDFWLRQ WHFKQLTXHV DUH E\ GHILQLWLRQ PXOWL PRGDOV DQG WKHUHIRUH LQKHULW WKH LVVXHV ZH SUHVHQWHG LQ WKH SUHYLRXV SDUDJUDSKV +RZHYHU WKH\ SUHVHQW DGGLWLRQDO VSHFLILF LVVXHV DQG WKH IROORZLQJ SDUDJUDSK GHVFULEHV WKHP ZLWK DQ HPSKDVLV RQ PXOWLWRXFK LQWHUDFWLRQ VSHFLILFDWLRQ LQWHUDFWLYLW\ FRQWLQXLW\ G\QDPLF LQVWDQWLDWLRQ FRPSOH[ WLPH UHODWLRQVKLSV DQG ILQJHU FOXVWHULQJ 0RVW RI WKHP ZHUH PHQWLRQHG LQ >@ EXW LQWHUDFWLRQ FRQWLQXLW\ DQG DQWKURSRPRUSKLFFKDUDFWHULVWLFVKDYHEHHQUHFHQWO\LGHQWLILHG 1) Interaction continuity (issue 1) 2QH PDMRU HYROXWLRQ IURP WKH XVH RI $5,1&  :,03 LQWHUDFWLRQV FRQVLVWV LQ GHVFULELQJ FRQWLQXRXV LQWHUDFWLRQV DV LGHQWLILHG LQ GLUHFW PDQLSXODWLRQ >@ RU SRVW:,03 LQWHUDFWLRQV >@

(21)  WKH XVHUV¶ LQWHUDFWLRQV ZLWK WKH V\VWHP DUH QR ORQJHU GLVFUHWH RQH HYHQW WULJJHUV RQH FRPPDQG

(22)  DQG EHFRPH FRQWLQXRXV D IORZ RI HYHQW LV SURGXFHG EHIRUH WULJJHULQJ D FRPPDQG

(23)  DQG FRQWLQXRXV IHHGEDFN KDV WR EH SURGXFHG &RQVHTXHQWO\ WKH QRWDWLRQV WR GHVFULEH WKHVH WHFKQLTXHV VKDOO VXSSRUW WKH GHVFULSWLRQ RI HYHQW VWUHDPV DV ZHOO DV WKH GHVFULSWLRQ RI WKH UHODWHG LPPHGLDWH IHHGEDFNV &RPPDQGVVXFKDVSLQFKWR]RRPEHORQJWRWKLVFDWHJRU\ 2) Dynamic instantiation of input devices (issue 2) :KHQDOOLQSXWGHYLFHVDUHQRWNQRZQZKHQWKHXVHULQWHUIDFH LVLQLWLDOL]HGWKHLQSXWGHYLFHVGHWHFWHGGXULQJWKHLQWHUDFWLRQ QHHG WR EH G\QDPLFDOO\ LQVWDQWLDWHG LQ RUGHU WR EH UHJLVWHUHG DQG OLVWHQHG WR LH WKHLU HYHQWV DUH SRVVLEO\ XVHG IRU WULJJHULQJ FRPPDQGV

(24)  7KLV LV W\SLFDOO\ WKH FDVH ZKLOH DGGUHVVLQJ PXOWLWRXFK LQWHUDFWLRQ WHFKQLTXHV VLQFH XVHUV¶ ILQJHUV DUH RQO\ GHWHFWHG DV WKH\ WRXFK RU DSSURDFK

(25)  WKH WDFWLOH VXUIDFHV 7KLV LV YHU\ GLIIHUHQW IURP :,03 LQWHUIDFHV ZKHUHWKHVHWRIPLFHDQGNH\ERDUGLVGHILQHGLQDVWDWLFZD\ 3) Temporal representations and fine tuning (issues 3, 4).

(26) $V LOOXVWUDWHG LQ >@ VSHFLI\LQJ PXOWLWRXFK LQWHUDFWLRQ WHFKQLTXHV UHTXLUH ERWK TXDOLWDWLYH DQG TXDQWLWDWLYH WLPH GHVFULSWLRQV 6XFK WLPLQJ DVSHFWV ZKLFK KDYH WR EH ILQHO\ WXQHG

(27) DUHUHTXLUHGWREHH[SOLFLWO\DQGWKRURXJKO\GHILQHGIRU GHVFULELQJ PXOWLWRXFK DQG PXOWLPRGDO LQWHUDFWLRQV DV SUHVHQWHG LQ >@ )RU H[DPSOH WR VSHFLI\ D GRXEOH WDS GHVLJQHUV QHHG D ILQH WXQLQJ RQ WZR QRQFRQVHFXWLYH HYHQWV ILUVWILQJHU¶VWRXFKDQGODVWILQJHU¶VUHOHDVH 4) Finger clustering and anthropomorphic characteristics (issues 5, 6) ,Q RUGHU WR IXOO\ LQFRUSRUDWH WKH H[SUHVVLYH SRZHU RI PXOWL WRXFK LQWHUDFWLRQV WKHUH LV D QHHG WR EH DEOH WR GHWHFW DW LQWHUDFWLRQWLPH

(28) JURXSRIILQJHUVHYROYLQJMRLQWO\7KLVPLJKW EH WKH FDVH IRU ILQJHUV EHORQJLQJ WR WKH VDPH KDQG RIWHQ FDOOHG ILQJHU FOXVWHULQJ

(29)  EXW WKLV XVXDOO\ UHTXLUH VSHFLILF DOJRULWKPVDVSURSRVHGLQ>@WKDWPXVWEHLQFRUSRUDEOHLQWKH XVHU LQWHUIDFH GHVFULSWLRQ ODQJXDJH 0RUH ILQH JUDLQ LQWHUDFWLRQV PLJKW QHHG WR DQDO\VH WKH ILQJHUWLS VKDSHV WR GHWHUPLQH RULHQWDWLRQ RI WKH ILQJHU RQ WKH WRXFK GHYLFH DV SURSRVHGLQ>@/DVWO\LWLVLPSRUWDQWWREHDEOHWRGHVFULEH LQWHUDFWLRQ WHFKQLTXHV WDNLQJ LQWR DFFRXQW WKH DQWKURSRPRUSKLF FKDUDFWHULVWLFV RI WKH KDQG >@ )RU LQVWDQFH DQ LQWHUDFWLRQ IHDWXULQJ WZR ILQJHUV IURP WKH VDPH KDQGZLOOQRWKDYHWKHVDPHVSDWLDODQGEHKDYLRXUDOSURSHUWLHV DVDQLQWHUDFWLRQZLWKILQJHUVEHORQJLQJGLIIHUHQWKDQGV C. Multi-touch interactions in cockpits 7KHDYLRQLFVRIWZDUHHQYLURQPHQWLQFRFNSLWVRIFLYLODLUFUDIWV UHTXLUHV DSSO\LQJ GHGLFDWHG GHVLJQ SURFHVVHV WR HQVXUH WKH UHOLDELOLW\ VDIHW\ DQG XVDELOLW\ RI WKHVH FULWLFDO HPEHGGHG DSSOLFDWLRQV 7KHUHIRUH VSHFLI\LQJ PXOWLWRXFK LQWHUDFWLRQ WHFKQLTXHVIRUFRFNSLWVLQDFRPSOHWHDQGXQDPELJXRXVZD\LV DPDQGDWRU\UHTXLUHPHQW 1) Interaction accuracy versus usability (issue 7) 'XHWRWKHLQVWDELOLW\RIWKHHQYLURQPHQWLWLVLPSRUWDQWWREH DEOH WR DYRLG VSXULRXV LQWHUDFWLRQV LH D SLORW WULJJHULQJ LQDGYHUWHQWO\ D FRPPDQG WKURXJK D QRQGHVLUHG WRXFK VHTXHQFH

(30)  7KLV FDQ EH DFKLHYHG E\ FKDQJLQJ WKH GHVLJQ RI WRXFKLQWHUDFWLRQVE\XVLQJPRUHSUHVVXUHJHVWXUHVIURPSLORWV ZKLFKPLJKWKDYHDVDUHVXOWDUHGXFWLRQRIWKHXVDELOLW\2WKHU HQJLQHHULQJ VROXWLRQV PLJKW LQYROYH FRQWH[W LQIRUPDWLRQ GHWHFWLRQDQGIXVLQJWKLVLQIRUPDWLRQZLWKRSHUDWRUV¶DFWLRQV 2) Interaction reliability and dependability (issue 8) )LQDOO\ DV IRU RWKHU DYLRQLF DSSOLFDWLRQV WKHUH LV D QHHG WR DSSO\ YHULILFDWLRQ DQG YDOLGDWLRQ 9 9

(31)  WHFKQLTXHV WR WKH HQWLUH FRFNSLW GLVSOD\ V\VWHP IURP WKH LQSXW GHYLFHV WR WKH LQWHUDFWLYH PXOWLWRXFK DSSOLFDWLRQV

(32)  7KLV UHTXLUHV WKH HQJLQHHULQJ WHFKQLTXHV XVHG IRU WKH LQWHUDFWLYH PXOWLWRXFK FRFNSLWVWREHDPHQDEOHWRIRUPDOYHULILFDWLRQ ,9 5(/$7(':25. A. Cockpits’ interactivity &XUUHQW RU VRRQ WR EH UHOHDVHG

(33)  LQWHUDFWLYH FRFNSLWV HVVHQWLDOO\ IHDWXUH ERWK SK\VLFDO DQG :,03 LQWHUDFWLRQV IRU WULJJHULQJ DYLRQLF IXQFWLRQV ,QGHHG ZKHQ FULWLFDO FRPPDQGV DUH FRQVLGHUHG GHSHQGDEOH LQWHUDFWLRQV XVLQJ SK\VLFDO LQWHUDFWRUV DUH SUHIHUUHG WR VRIWZDUH RQHV 0XOWLWRXFK. DSSOLFDWLRQV RQ ()%V (OHFWURQLF )OLJKW %DJV

(34)  DUH DOUHDG\ DYDLODEOH DV GHPRQVWUDWHG E\ WKH $LUEXV DSSOLFDWLRQ RQ WKH DSS6WRUH >@ )LQDOO\ PRQRWRXFK LQWHUDFWLRQV KDYH DOUHDG\ DSSHDUHGLQOLJKWDLUFUDIWV¶FRFNSLWVDQGILJKWHUV>@EXWPXOWL WRXFK DSSOLFDWLRQV IRU DYLRQLF DSSOLFDWLRQ VWLOO UHPDLQV DW WKH OHYHORILQGXVWULDOUHVHDUFKSURMHFWVVXFKDV>@ B. Notations for engineering multi-touch interactions 0DQ\UHVHDUFKZRUNVKDYHFRQWULEXWHGWRDOORZGHYHORSHUV KDQGOLQJ PXOWLPRGDO LQWHUIDFH GHVLJQ PRUH HDVLO\ LQFOXGLQJ >@ 7KH GRPDLQ VSHFLILF ODQJXDJH SUHVHQWHG LQ >@ IRU LQVWDQFH DGGUHVVHV VRPH GLPHQVLRQV GHVFULEHG LQ >@ DV G\QDPLF LQVWDQWLDWLRQ RI LQSXW GHYLFHV EXW ODFNV SDUDOOHO EHKDYLRXU GHVFULSWLRQ DQG LQWHUDFWLRQ DQDO\VLV :H REVHUYHG WKDW PRVW QRWDWLRQV LGHQWLILHG LQ >@

(35)  ODFN WKH H[SUHVVLYH SRZHU WR HQFRPSDVV DOO WKH GLPHQVLRQV IRU PXOWLWRXFK LQWHUDFWLRQVDQGDUHQRWDEOHWRVSHFLI\LQDFRPSOHWHDQGQRQ DPELJXRXVZD\PXOWLWRXFK DQGPRUHJHQHUDOO\PXOWLPRGDO

(36)  LQWHUDFWLRQV 3URWRQ >@ GRHV QRW H[SODLQ KRZ WR VXSSRUW PXOWLXVHUV WRXFK LQWHUDFWLRQV ZLWK VHYHUDO ILQJHUV ,Q FRQFOXVLRQ H[FHSW WKH ,&2 QRWDWLRQ WKDW LV IXUWKHU GHVFULEHG LQ QH[W VHFWLRQ

(37)  FXUUHQWO\ DYDLODEOH QRWDWLRQV IRU HQJLQHHULQJ PXOWLPRGDO LQWHUDFWLRQV DUH QRW DEOH WR DGGUHVV DOO WKH HQJLQHHULQJLVVXHVSUHVHQWHGDERYH C. Development processes for interactive critical systems 7KH '2& >@ GHILQHV WKH GHYHORSPHQW SURFHVV UHTXLUHPHQWVIRUWKHGHYHORSPHQWSURFHVVRIDYLRQLFVRIWZDUH EXW GRHV QRW GHWDLO KRZ WR DGGUHVV WKH VSHFLILF LVVXHV RI LQWHUDFWLYHVRIWZDUH>@2QO\D IHZSURFHVVHVKDYHWDUJHWHG WKH GHYHORSPHQW RI LQWHUDFWLYH FULWLFDO V\VWHPV $PRQJ VXFK SURFHVVHV>@KDYHGHILQHGWKHKLJKOHYHODFWLYLWLHVQHHGHGWR WDNH LQWR DFFRXQW WKH V\VWHP XVDELOLW\ ZLWKRXW VDFULILFLQJ LWV UHOLDELOLW\ $GGLWLRQDOO\ >@ SURSRVHG D UHILQHPHQW RI WKH DFWLYLWLHV OHDGLQJ WR WKH PXOWLWRXFK LQWHUDFWLRQ VSHFLILFDWLRQ EXWODFNVGHVFULELQJKRZWR XVH WKHSURGXFHGDUWHIDFWV LQ WKH UHPDLQGHURIWKHGHYHORSPHQWSURFHVV 9 $1$5&+,7(&785( 7KLVVHFWLRQSURSRVHVDOD\HUHGDUFKLWHFWXUH SUHVHQWHG)LJ. 

(38) WKDWHQVXUHVWKHDYDLODELOLW\RI³JRRG´SURSHUWLHVRIVRIWZDUH. V\VWHPVPHQWLRQHGLQ>@ IOH[LELOLW\VHSDUDWLRQRIFRQFHUQV H[WHQVLELOLW\ DQG KDUGZDUH LQGHSHQGHQFH

(39)  DQG VXSSRUWV KDQGOLQJLQWHUDFWLRQV ZLWK PXOWLSOH ILQJHUV ZKLFK FRUUHVSRQGV WRWKHG\QDPLFLQVWDQWLDWLRQRILQSXWGHYLFHV LVVXH

(40) . )LJ  GHVFULEHV DQ H[DPSOH RI WKLV DUFKLWHFWXUH ZKHUH WKH V\VWHP LV FRPSRVHG RI WZR PXOWLWRXFK VXEV\VWHPV RQH IRU HDFK SLORW 7KH SK\VLFDO LQWHUDFWLRQ OD\HUV DUH GHVLJQHG WR SURYLGH WKH V\VWHP DFFHVV WR WKH XVHUV¶ HYHQWV ILQJHUV¶ WRXFK RQWKHGLVSOD\7KHVHHYHQWVDUHVHQWWRKDUGZDUHLQGHSHQGHQW ILQJHU PRGHOV ZKLFK DUH UHJLVWHUHG WR WKH LQWHUDFWLRQ PRGHOV 7KH IXVLRQ HQJLQH HQVXUHV WKH FUHDWLRQ DQG IRUZDUGLQJ RI FRKHUHQWLQWHUDFWLRQV¶HYHQWVWRZDUGVWKHDSSOLFDWLRQV XVHGE\ WKHSLORWV

(41) DVZHOODVWKHFRPPXQLFDWLRQEHWZHHQWKHWZRVXE V\VWHPV7RGHWHUPLQH WKHFRKHUHQFH RI WKH LQWHUDFWLYH HYHQWV VHQG WR WKH DSSOLFDWLRQV WKH IXVLRQ HQJLQH QHHGV WR NQRZ WKH FKDUDFWHULVWLFV RI WKH ZLGJHW RQ ZKLFK WKH LQWHUDFWLRQ WDNHV SODFH.

(42) 7KLVDUFKLWHFWXUHLVEDVHGRQWKHZRUNSUHYLRXVO\SXEOLVKHG LQ >@ ZKLFK ZDV DQ H[WHQVLRQ RI DQRWKHU OD\HUHG DSSURDFK SURSRVHGLQ>@EXWRQO\GHDOLQJZLWKPXOWLPRGDOLQWHUDFWLRQV :H LPSURYHG WKDW DUFKLWHFWXUH E\ LQWURGXFLQJDQLQWHUPHGLDWH OHYHO EHWZHHQ WKH ORZOHYHO WUDQVGXFHU DQG WKH LQWHUDFWLRQ PRGHOV D PRGHO WR GHVFULEH HDFK ILQJHU EHKDYLRXU 7KHVH G\QDPLFDOO\ LQVWDQWLDWHG PRGHOV DUH LQGHSHQGHQW IURP WKH ORZHU OD\HUV DQG WKHUHIRUH HQVXUH D KLJKHU IOH[LELOLW\ DQG LQGHSHQGHQFH IURP WKH XSSHU OD\HUV ,Q DGGLWLRQ ZH HQULFKHG WKH IXVLRQ HQJLQH ZLWK WKH FDSDELOLW\ WR FRPPXQLFDWH ZLWK RWKHU V\VWHPV7KLV FRPPXQLFDWLRQFDSDELOLW\ YLD WKH ,Y\ EXV >@ZLOOEHGHVFULEHGPRUHSUHFLVHO\LQWKHFDVHVWXG\VHFWLRQ 7KH FRPSOHWH GHVFULSWLRQ RI WKH RWKHU OD\HUV SURSHUWLHV DQG FRPPXQLFDWLRQV KDYH EHHQ LQWURGXFHG LQ >@ DQG DUH QRW UHSHDWHG KHUH GXH WR VSDFH FRQVWUDLQWV )LQDOO\ WKH -DYD)[ OD\HUFDQEHVXEVWLWXWHGWRDQ\RWKHUPXOWLWRXFKSURJUDPPLQJ ODQJXDJHDQGWKHXSSHUOD\HUVDUHQRWDWLRQLQGHSHQGHQW. )LJ3URSRVHGOD\HUHGDUFKLWHFWXUHIRUPXOWLPRGDOLQWHUDFWLRQ. 9, $127$7,21)25(1*,1((5,1*08/7,728&+ ,17(5$&7,216 A. ICO: Informal definition 7KH ,&2 QRWDWLRQ ,QWHUDFWLYH &RRSHUDWLYH 2EMHFWV

(43)  LV D IRUPDO GHVFULSWLRQ WHFKQLTXH GHYRWHG WR VSHFLI\ LQWHUDFWLYH V\VWHPV 8VLQJ KLJKOHYHO 3HWUL QHWV >@ IRU G\QDPLF EHKDYLRXU GHVFULSWLRQ WKH QRWDWLRQ DOVR UHOLHV RQ REMHFW RULHQWHG DSSURDFK G\QDPLF LQVWDQWLDWLRQ FODVVLILFDWLRQ HQFDSVXODWLRQ LQKHULWDQFH DQG FOLHQWVHUYHU UHODWLRQVKLSV

(44)  WR GHVFULEHWKHVWUXFWXUDORUVWDWLFDVSHFWVRIV\VWHPV ,&2 QRWDWLRQ REMHFWV DUH FRPSRVHG RI IRXU FRPSRQHQWV D FRRSHUDWLYH REMHFW IRU WKH EHKDYLRXU GHVFULSWLRQ D SUHVHQWDWLRQSDUW LH*UDSKLFDO,QWHUIDFH

(45) DQGWZRIXQFWLRQV DFWLYDWLRQ DQG UHQGHULQJ

(46)  GHVFULELQJ WKH OLQNV EHWZHHQ WKH FRRSHUDWLYHREMHFWDQGWKHSUHVHQWDWLRQSDUW ,&2DGGUHVVHVDOOWKHLVVXHVSUHVHQWHGLQWKHSUHYLRXVVHFWLRQV LQFOXGLQJG\QDPLFLQVWDQWLDWLRQRILQSXWGHYLFHV ZKLFKLV QRW DGGUHVVHG HOVHZKHUH LQ D PRGHOOLQJ WHFKQLTXH ,&2 XVHV WKH FDSDELOLWLHV RI 3HWUL QHWV WR GHVFULEH WRNHQV¶ FUHDWLRQV ZKLFK DUH XVHGLQ PRGHOVWRUHSUHVHQWLQSXWGHYLFHVVXFKDV ILQJHUV RQDWRXFKVFUHHQ /DVWO\ LW LV LPSRUWDQW WR QRWH WKDW ,&2V KDYH EHHQ XVHG IRU YDULRXVW\SHVRI PXOWLPRGDOLQWHUIDFHV >@DQGLQSDUWLFXODU. IRUPXOWLWRXFK>@7KLVQRWDWLRQLVDOVRFXUUHQWO\DSSOLHGWR IRUPDOO\VSHFLI\LQWHUDFWLYHV\VWHPVLQWKHILHOGVRI$LU7UDIILF 0DQDJHPHQW >@ VDWHOOLWH JURXQG V\VWHPV >@ DQG FRFNSLWV RIPLOLWDU\>@DQGFLYLO>@DLUFUDIWV B. Generalization of ICO event handling capabilities 7KH PRGHOV ZH SUHVHQW LQ WKLV SDSHU IHDWXUH DQ H[WHQVLRQ RI ,&2 WKDW ZDV UHTXLUHG WR DGGUHVV WKH LVVXHV RI PXOWLWRXFK LQWHUDFWLRQV ,Q RUGHU WR GR VR ZH SURSRVHG D QHZ WUDQVLWLRQ DOORZLQJ RQH FRRSHUDWLYH REMHFW WR UHFHLYH HYHQWV ,Q PRGHOV GHVFULELQJ PXOWLWRXFK LQWHUDFWLRQ WHFKQLTXHV WRNHQV PD\ UHSUHVHQW SLORWV¶ ILQJHUV ³FXUUHQWO\´ RQ WKH GHYLFH 7KHVH WUDQVLWLRQV FDQ EH XVHG WR VSHFLILFDOO\ UHWULHYH WKH LQSXW WKDW HPLWWHGWKHHYHQWDQGWRVSHFLI\WKHHYHQWOLVWHQHGWRDVZHOODV LWV VRXUFH ,W DOVR H[SRVHV WKH SURSHUWLHV RI WKH HYHQW DQG DOORZVVSHFLI\LQJDFRQGLWLRQRQWKHHYHQWUHFHLYHGLQRUGHUWR ILUH WKH WUDQVLWLRQ $V WKLV H[WHQVLRQ VXSHUVHGHV WKH SUHYLRXV HYHQWKDQGOHUWUDQVLWLRQVLQ,&2VWKHIRUPHUWUDQVLWLRQVDUHQR ORQJHUXVHG )LJ  UHSUHVHQWV D XVH RI WKLV QHZ PHFKDQLVP WKH PRGHO¶V H[WUDFW SUHVHQWHG LV FRPSRVHG RI D SODFH 2SHUDWLRQDO,QSXW'HYLFHVWKDWFRQWDLQVWKHLQSXWGHYLFHVRIWKH V\VWHP DQG WKHLU DFWLYDWLRQ VWDWXV 6XFK WUDQVLWLRQ ZRXOG EHORQJ WR WKH /RZOHYHO WUDQVGXFHU OD\HU RI )LJ  7KH GLVDEOH,QSXW'HYLFHWUDQVLWLRQOLVWHQVWR³HUURU´HYHQWVHPLWWHG E\WKHLQSXWGHYLFHV:KHQWKHSODFH2SHUDWLRQDO,QSXW'HYLFHV FRQWDLQV DW OHDVW RQH DFWLYH GHYLFH GLVDEOH,QSXW'HYLFH LV HQDEOHG ,I VR ZKHQ LW UHFHLYHV DQ ³HUURU´ HYHQW GLVDEOH,QSXW'HYLFHLVILUHGLIWKHFULWLFDOLW\ILHOGRIWKH³HUURU´ HYHQW LV KLJK WKLV LV GHILQHG E\ WKH HYHQWFRQGLWLRQ OHYHO /HYHO+LJKW

(47)  :KHQ GLVDEOH,QSXW'HYLFH LV ILUHG WKH  DFWLRQ LQ)LJ³GHYLFHLGOH

(48) ´

(49) LVH[HFXWHG VHWWLQJWKHGHYLFH LQ LWV LGOH PRGH

(50)  DQG WKH VRXUFH GHYLFH LV PRYHG WR SODFH 1RQ2SHUDWLRQDO,QSXW'HYLFHV ZLWK WKH PHVVDJH UHFHLYHG ZLWKLQWKHHUURUHYHQW. )LJ1HZ,&2HYHQWWUDQVLWLRQ¶VH[DPSOH. . 7KLV ,&2 IRUPDOLVP H[WHQVLRQ HQKDQFHV PXOWLPRGDO LQWHUDFWLRQV VSHFLILFDWLRQ E\ RIIHULQJ WKH SRVVLELOLW\ WR H[SOLFLWO\GHVFULEHWKHHYHQWVSURSHUWLHVDQGWKHLUUHODWLRQVKLSV ZLWKG\QDPLFDOO\LQVWDQWLDWHGLQSXWGHYLFHV C. A tool to support the notation ,Q RUGHU WR HGLW DQG H[HFXWH ,&2 PRGHOV WKH QRWDWLRQ LV VXSSRUWHGE\WKH&$6(WRRO3HW6KRS>@>@7KH3HW6KRS IUDPHZRUNDOVRSURYLGHVWRROVWRVXSSRUWXVHUHYDOXDWLRQV>@ DQGIRUPDODQDO\VLVRIPRGHOV>@WKXVDGGUHVVLQJLVVXH.

(51) 7$%/(,. ,Q DGGLWLRQ 3HW6KRS GHVFULEHV DQG VLPXODWHV 26 LQGHSHQGHQW PXOWLWRXFK LQWHUIDFHV E\ FRQQHFWLQJ GHGLFDWHG $3,V WR LWV NHUQHO

(52)  ZKLFK LV QRW WKH FDVH RI PRVW RI WKH IUDPHZRUNV SUHVHQWHGLQ>@ 9,,&$6(678'< 7KH FDVH VWXG\ SUHVHQWHG LQ WKLV VHFWLRQ IRFXVHV RQ GHPRQVWUDWLQJWKHH[SUHVVLYHSRZHURIWKH,&2QRWDWLRQIRUWKH HQJLQHHULQJ RI PXOWLPRGDO DQG PXOWLWRXFK DSSOLFDWLRQV ,W DOVRLOOXVWUDWHKRZWKHSUHVHQWHGDSSURDFKFDQEHHPEHGGHGLQ DQLQGXVWULDOGHYHORSPHQWSURFHVV A. Presentation 7KLVFDVHVWXG\FRUUHVSRQGVWRDVXEVHWRIDZHDWKHUUDGDU V\VWHP IURP D FLYLO DLUFUDIW FRFNSLW ZKLFK SURYLGHV DWPRVSKHULF GDWD WR WKH FRFNSLW FUHZ DQG LV FRQWUROOHG E\ GLIIHUHQWV\VWHPV ‡ 7KHLQSXWV\VWHPLVFRPSRVHGRIDSXVKEXWWRQRQWKH JODUH VKLHOG SDQHORQHRQWKH &DSWDLQ¶V &37

(53)  )OLJKW &RQWURO 8QLW )&8

(54)  DQG RQH RQ WKH )LUVW 2IILFHU¶V )2

(55)  )&8 DQG LQWHUDFWRUVRQWKHS\ORQ GXSOLFDWHGIRUHDFKSLORW

(56)  ‡ 7KHRXWSXWVRIWKHZHDWKHUUDGDUDUHSURYLGHGWKURXJK WKH1DYLJDWLRQ'LVSOD\V 1'V

(57)  ‡ 7KH EDFNXS V\VWHP VXSSRUWHG E\ WKH )&8EDFNXS DSSOLFDWLRQLVQRWSDUWRIWKHVWXG\,WSURYLGHVSLORWVDGGLWLRQDO DFFHVVWRWKHZHDWKHUUDGDUFRQWUROVEDVHGRQWKLV$5,1& 8VHU$SSOLFDWLRQ 8$

(58) . . 3,/276¶7$6.6$1'7+(,5',0(16,216. 7DVNV %DVLFZHDWKHUUDGDUPDQLSXODWLRQV DFWLYDWHFKDQJHOD\HURSDFLW\ &ORXGHYDVLYHURXWH 0RGLILFDWLRQRID³XQLTXH´ZHDWKHU SDUDPHWHUE\ERWKSLORWVMRLQWO\. 'LPHQVLRQV 6LQJOHXVHUPXOWLWRXFK 0XOWLXVHUVV\QHUJLVWLF 0XOWLWRXFKPXOWLXVHU ([FOXVLYH. 7R VXSSRUW WKHVH WKUHH WDVNV ZH KDYH VHW XS D SODWIRUP FRPSRVHGRI WKUHH3&VUXQQLQJ3HW6KRS DQGOLQNHG XVLQJWKH ,Y\%XV>@RQH1'DSSOLFDWLRQRQHDFKSLORW¶VFRPSXWHUDQGD YDOLGDWLRQ DSSOLFDWLRQ IRU ERWK RI WKHP WR LQWHUDFW RQ 6XFK DUFKLWHFWXUH LV FRPSOLDQW ZLWK WKH ZRUN GRQH LQ >@ ZKHUH HDFK3HW6KRSLVUXQQLQJRYHUDQ$5,1&RSHUDWLQJV\VWHP WRDGGUHVVGHSHQGDELOLW\LVVXHV QRWDGGUHVVHGKHUH

(59)  )LJ SUHVHQWVWKHPXOWLWRXFKLQWHUIDFHGLVSOD\HGRQHDFK SLORW¶V 1' 7KH LQWHUIDFH LQ FRPSRVHG RI D PXOWLWRXFK PDS DQG YDULRXV FXVWRP ZLGJHWV HPXODWLQJ SK\VLFDO EXWWRQV DQG LQWHUDFWRUV WKDW FRPPDQG WKH GLVSOD\ PRGHV DQG WKH ZHDWKHU UDGDUFRQWUROV 1) Task 1: Advanced multi-touch manipulation )RU WKLV WDVN D SLORW HLWKHU WKH &37 RU WKH )2

(60)  LQWHUDFWV ZLWK WKH ZHDWKHU UDGDU WKURXJK WKH PXOWLWRXFK 1DYLJDWLRQ 'LVSOD\WR GH

(61) DFWLYDWHLWVYLVXDOL]DWLRQRUPRGLI\LWVLQWHQVLW\ RSDFLW\RIWKHOD\HUGLVSOD\LQJWKHZHDWKHULQIRUPDWLRQRQWRS RIWKH1'¶VPDS

(62) ,QDGGLWLRQWKHSLORWLVDEOHWRLQWHUDFWZLWK WKHPDSLWVHOIPRGLI\LQJWKHUDQJH ]RRP

(63) OHYHODQGWUDQVODWH WKHPDS. 7KHVFHQDULRVZHSUHVHQWDUHUHSUHVHQWDWLYHRIWKHSRWHQWLDO XVH RI PXOWLWRXFK PRGDOLWLHV XVHUV¶ LQWHUDFWLRQV«

(64)  IRU VXFK DQ DSSOLFDWLRQ +RZHYHU ZH GR QRW LQWHQG WR DGGUHVV GHVLJQ DVSHFWVQRUWRGHPRQVWUDWHWKHLURSHUDWLRQDOYDOLGLW\DVLWLVRXW RI VFRSH 1HYHUWKHOHVV ZH LQWHQG WR GHPRQVWUDWH WKDW RXU QRWDWLRQ SURYLGHV D GHWDLOHG DQG H[KDXVWLYH PHDQ WR VSHFLI\ PXOWLWRXFK FULWLFDO V\VWHPV DQG WR FRYHU DOO WKH LVVXHV SUHVHQWHGDERYH.  )LJ$FRFNSLWRYHUYLHZ. )RU WKH SXUSRVH RI WKLV VWXG\ ZH FRQVLGHU D FRFNSLW FRQILJXUDWLRQLQ³7VKDSH´DVRIWKH$LUEXV$ )LJ 

(65) )RU WKHFDVHVWXG\ZHFRQVLGHUDVHWRIWKUHHGLVSOD\VRQHVFUHHQLQ IURQWRIHDFKSLORWDQGRQHRQWKHS\ORQEHWZHHQWKHP7KHVH GLVSOD\V VXSSRUW PXOWLWRXFK LQSXWV DW OHDVW  WRXFK LQSXWV UHFRJQL]DEOHDWWKHVDPHWLPH

(66) 7KHRWKHUWHFKQLFDOIHDWXUHVRI WKHKDUGZDUHDUHQRWFRQVLGHUHGKHUH UHVROXWLRQODWHQF\«

(67)  7RLOOXVWUDWHWKHPDLQGLPHQVLRQVRIPXOWLPRGDOLW\PXOWL WRXFKDQGPXOWLXVHULQWHUDFWLRQVZHSURSRVHWKUHHSLORWWDVNV EHORQJLQJWRGLIIHUHQWGLPHQVLRQV VHH7$%/(,

(68)  .  )LJ1DYLJDWLRQ'LVSOD\ VLQWHUIDFHIRUWKLVFDVHVWXG\. 7KHVH LQWHUDFWLRQV KDYH EHHQ GHVLJQHG DQG SURSRVHG LQ YDULRXV UHVHDUFK SDSHUV DV ZHOO DV SXEOLF 6'.V 6RIWZDUH 'HYHORSPHQW NLWV

(69)  RI PXOWLWRXFK SODWIRUPV 7$%/( ,, VXPPDUL]HV WKHVHV LQWHUDFWLRQV DQG WKHLU UHIHUHQFHV 7KH\ FRYHULVVXHVDQGGHVFULEHGDERYHDQGDUHFRYHUHGE\ PRGHOVEHORQJLQJWRWKHORJLFDOLQWHUDFWLRQOD\HURI)LJ.

(70) 7$%/(,,. $6$03/(2)08/7,728&+,17(5$&7,216)25:($7+(5 5$'$50$1,38/$7,21. ,QWHUDFWLRQ WHFKQLTXH ILQJHU GUDJ ILQJHU ODVVR. &RPPDQG GHVFULSWLRQ &KDQJH +HDGLQJ 6HOHFWREMHFW RQPDS. ILQJHUV¶ IOLFN. 7ULJJHU ZHDWKHUOD\HU YLVLELOLW\. 3UHFLVH 7LOW= WUDQVLWLRQ ILQJHUV¶ URWDWH ILQJHUV¶ VFDOH. . 7XQHZHDWKHU OD\HU LQWHQVLW\ 0DSURWDWLRQ 0DSUDQJH. ,QWHUDFWLRQ SURSHUWLHVWDUJHWHG. 5HIHUHQFH. 'LUHFW0DQLSXODWLRQ. 0RVW6'.V. 6HOHFWLRQ. >@. 7ZRILQJHUVZLWKVDPH XQLWDU\LQWHUDFWLRQ YHORFLW\DQG DFFHOHUDWLRQ. 0RVW6'.V. 7LPLQJDVSHFWVPXOWL ILQJHUV !

(71) . >@>@. 'LUHFW0DQLSXODWLRQ FRQWLQXRXV

(72)  'LUHFW0DQLSXODWLRQ FRQWLQXRXV

(73) . PHFKDQLVPV LQ ,&2 FDQ GHVFULEH WKDW IHDWXUH ZLWK D UDWKHU VLPSOHDQGORFDOL]HGPRGLILFDWLRQRIWKHRULJLQDOPRGHO 2) Task 2: Cooperative cloud-avoiding manoeuvers 7KLV SDUDJUDSK GHWDLOV D V\QHUJLVWLF WDVN EHWZHHQ ERWK SLORWV FRQVLVWLQJ LQ DYRLGLQJ FORXGV GXULQJ IOLJKW :KLOH WKH FDSWDLQLVUHVSRQVLEOHIRUIO\LQJWKH DLUFUDIWIURPD VKRUWWHUP SHUVSHFWLYH XVLQJ WKH ZHDWKHU UDGDU DW FORVH UDQJH WKH ILUVW RIILFHU LV VWXG\LQJ WKH ZHDWKHU IXUWKHU DZD\ DORQJ WKH SUHGHWHUPLQHG IOLJKW SDWK WR DYRLG SRWHQWLDOO\ XQFRPIRUWDEOH ]RQHVIRUWKHSDVVHQJHUV7KHILUVWRIILFHUWKHQSURSRVHVDQHZ URXWHYLDKLV1'%RWKSLORWVPXVWWKHQYDOLGDWHWKHIOLJKWSODQ PRGLILFDWLRQ RQ WKH FRQILUPDWLRQ GLVSOD\ HDFK RQH KDYLQJ WR SUHVVKLVYDOLGDWLRQEXWWRQDWWKHVDPHWLPH. 0RVW6'.V 0RVW6'.V. :H PRGHOOHG HDFK LQWHUDFWLRQ WHFKQLTXH LQ 7$%/( ,, XVLQJ WKH ,&2 QRWDWLRQ DQG LPSOHPHQWHG WKHP LQ RXU DSSOLFDWLRQ DFFRUGLQJ WR WKH DUFKLWHFWXUH SUHVHQWHG )LJ  ,Q WKLV SDUDJUDSK ZH HPSKDVL]H ,&2¶V H[SUHVVLYH SRZHU E\ GHVFULELQJ DQ H[FHUSW RI WKH SUHFLVH WLOW LQWHUDFWLRQ WHFKQLTXH DOVR UHIHUUHG DV ³=7UDQVODWLRQ´ LQ >@

(74)  DQG PRUH SUHFLVHO\ WKH EHKDYLRXU SDUW UHJDUGLQJ ILQJHUV PRYHPHQWV RQ WKH WRXFKVFUHHQ >@ GHVFULEHV WKLV LQWHUDFWLRQ WHFKQLTXH DV IROORZV ³] WUDQVODWLRQ ± D FRQMRLQHG WRXFK RQ WKH REMHFW WRJHWKHUZLWKDRQHWRXFKGUDJXSDQGGRZQ´. )LJ GHVFULEHVWKHEHKDYLRXURIWKHYDOLGDWLRQDSSOLFDWLRQ ZKLFKLVV\PPHWULFDOIRUERWKSLORWV:KHQWKH)2SURSRVHGD QHZ IOLJKW SODQ WKH QHZ)OLJKW3ODQ)URP)2 WUDQVLWLRQ LV ILUHG DQG D WRNHQ FRQWDLQLQJ D UHIHUHQFH WRZDUGV WKH )2¶V 1' DQG WKH SURSRVHG IOLJKW SODQ LV SXW LQ SODFH 1HHG2I9DOLGDWLRQ :KHQ WKH )2 UHVS &37

(75)  SUHVVHV KLV YDOLGDWLRQ EXWWRQ WKH WUDQVLWLRQ )29DOLGDWH UHVS &379DOLGDWH

(76)  LV ILUHG DQG D QHZ WRNHQ LV SXW LQ )2BLQWHUDFWV UHVS &37BLQWHUDFWV

(77)  7KH &37 UHVS)2

(78) KDVWRYDOLGDWHZLWKLQVRWKHUZLVHWKHYDOLGDWLRQ LVQRWDOORZHG,IWKH)2 UHVS&37

(79) UHOHDVHGWKHEXWWRQEHIRUH WKH&37 UHVS)2

(80) YDOLGDWHVKHKDVWRVWDUWRYHUWKHYDOLGDWLRQ ,I WKH SURSRVDO LV QRW YDOLGDWHG ZLWKLQ WHQ VHFRQGV LW LV GLVFDUGHGGLVFDUG9DOLGDWLRQ5HTXHVWBLVILUHGDQGWKH)2¶V1' LVQRWLILHGDFFRUGLQJO\. 7KLVGHVLJQHUOLNHGHVFULSWLRQUHPDLQVDWD YHU\KLJKOHYHO DQGZKHQGHYHORSHUVKDYHZLVKWRLPSOHPHQWVXFKLQWHUDFWLRQ WHFKQLTXHV VHYHUDO FDVHV QHHG IXUWKHU GHWDLOV DV IRU LQVWDQFH WKH GHVFULSWLRQ RI WKH LPSDFWRIHDFK ILQJHU PRYHPHQW RQ WKH VFUHHQ .  )LJ)OLJKW3ODQFRRSHUDWLYHYDOLGDWLRQPRGHO. )LJ([FHUSWRIWKHPRGHORIWKHEHKDYLRXURI³WLOW´. . )LJ  GHVFULEHV D VLPSOH FDVH ZKHUH WKH WKLUG ILQJHU FRQWUROOLQJ WKH WLOW YDOXH

(81)  LV PRYLQJ :KHQ LV GRHV VR WKH WUDQVLWLRQPRYH7LOWBLVILUHGDQGH[HFXWHVLWVFRGHWULJJHULQJD ³SUHFLVH7LOW´ HYHQW 7KH WLOW YDOXH RQO\ WDNHV LQWR DFFRXQW WKH GLVWDQFH EHWZHHQ WKH LQLWLDO WRXFK RI WKH WLOW ILQJHU DQG LWV FXUUHQW SRVLWLRQ $V D UHILQHPHQW GHVLJQHUV PD\ QHHG WR PRGLI\WKLVEHKDYLRXUE\ZHLJKWLQJWKLVYDOXHZLWKWKHGLVWDQFH EHWZHHQ WKH WZR ILQJHUV VHUYLQJ DV DQFKRUV 7KH PRGHO SUHVHQWHG LQ )LJ  LOOXVWUDWHV KRZ HYHQWV¶ KDQGOLQJ. 3) Task 3: Concurrent edition of a singleton parameter 7KLVWKLUGWDVNLOOXVWUDWHVWKHLQWHUDFWLRQFRQIOLFWVWKDWPD\ RFFXU DV ERWK SLORWV PRGLI\ VLPXOWDQHRXVO\ WKH VDPH V\VWHP SDUDPHWHU)RUWKLVWDVNERWKSLORWVWU\WRPRGLI\WKHWLOWDQJOH RIWKHZHDWKHUUDGDUVLPXOWDQHRXVO\ 6XFK FRQIOLFWV DUH OLNHO\ WR DSSHDU DV PRUH DQG PRUH V\VWHP SDUDPHWHUV DUH FRQWUROOHG E\ 8VHU $SSOLFDWLRQV ZKLFK DUH HDVLO\ UHSOLFDWHGRQ PXOWLSOHGLVSOD\V,Q WKH ODWHVW $LUEXV FRFNSLWV ZKHQ D SLORW LV PRYLQJ KLV .&&8¶V FXUVRU RYHU D V\VWHPSDJHFRQIOLFWVDUHDYRLGHGE\GHQ\LQJWKHRWKHUSLORW¶V FXUVRUDFFHVVWRWKDW'8DUHD7KLVDSSURDFKLVIXQGDPHQWDOO\ RSSRVHGWRWKHRQHSURSRVHGLQ>@ZKHUHFRQIOLFWVDUHOLNHO\.

(82) WR EH VROYHG E\ KXPDQ UDWKHU WKDQ ORFNLQJ PHFKDQLVPV 7KHUHIRUH WKH\ SURSRVH DQ RSWLPLVWLF DOJRULWKP IRU FRQIOLFW UHVROXWLRQ IDYRXULQJ LQWHUDFWLRQV DV PXFK DV SRVVLEOH DQG SURYLGLQJXQGRPHFKDQLVPVZKHQDVHOGRPFRQIOLFWRFFXUV 2XUDSSURDFKLPSOHPHQWVWKHPDLQSULQFLSOHVXSSRUWHGE\ >@ ³8VHU FRPPDQGV PXVW EH KDQGOHG LPPHGLDWHO\ ZLWKRXW ZDLWLQJIRUHLWKHUDXWKRUL]DWLRQVRUDFNQRZOHGJPHQWV´ /HWXVFRQVLGHUWKHLQWHUDFWRUFRPPDQGLQJWKHWLOWDQJOHRI WKH ZHDWKHU UDGDU RQ WKH FDSWDLQ VLGH %HFDXVH GHQ\LQJ ERWK SLORWVLQWHUDFWLQJRYHUWKHVDPHV\VWHPSDJHLVYHU\UHVWULFWLYH RQH PLJKW ZDQW WR RQO\ SUHYHQW WKHP IURP LQWHUDFWLQJ RQ WKH VDPH ZLGJHW )LJ  SUHVHQWV DQ H[FHUSW RI WKH EHKDYLRXUDO PRGHO RI VXFK DQ LQWHUIDFH 7KLV PRGHO LV LGHQWLFDO IRU ERWK SLORWV 6LQFH DOO '8V DQG WKHLU 8$V DUH FRQQHFWHG WKH SODFH 3HHUFRQWDLQVDUHIHUHQFHRIWKH)2¶V1'DSSOLFDWLRQV:KHQD SLORW VWDUWV LQWHUDFWLQJ RQ WKH ZLGJHW FRQWUROOLQJ WKH ZHDWKHU UDGDU¶VWLOWDQJOHWKLVZLGJHWZ RIZKLFKDUHIHUHQFHLVVWRUHG LQSODFH7LOW:LGJHW

(83)  WULJJHUVDQ ³LQWHUDFWLRQ6WDUWLQJ´ HYHQW,I WKHWLOWLVQRWORFNHGIRUWKLVSLORWWKHHYHQWLVUHFHLYHGYLDWKH FDQ5HVHUYHWUDQVLWLRQ7KLVWUDQVLWLRQORFNVWKHWLOWRQWKHRWKHU SLORW¶V DSSOLFDWLRQ XVLQJ WKH VHUYLFH ORFN7LOW

(84)  SUHYHQWLQJ WKH RWKHUSLORWWRLQWHUDFWZLWKKLVRZQWLOWZLGJHW$WWKHHQGRIWKH LQWHUDFWLRQWKH PRGHOXSGDWHVWKHWLOWRQWKHRWKHUDSSOLFDWLRQ DQGDOORZVWKHRWKHUSLORWWRLQWHUDFWZLWKLW. 7KHSDUWLFXODULW\RIWKLVSURFHVVOLHVLQWKHXVHRIWKHDUWHIDFWV SURGXFHG GXULQJ WKH LQWHUDFWLRQ GHVLJQ DQG PRGHOOLQJ SKDVH 7KHIRUPDOVSHFLILFDWLRQ ,&2PRGHOV

(85) WKDWKDYHEHHQFUHDWHG IRU SURWRW\SLQJ DQG RSHUDWLRQDO FRQFHSWV YDOLGDWLRQ FDQ EH UHXVHGDOODORQJWKHSDWKGRZQWRWKHVXSSOLHUV7KH VXSSOLHUV FDQWKHQEDVHWKHLULPSOHPHQWDWLRQRQWKH,&2PRGHOVVHUYLQJ DV VSHFLILFDWLRQ DUWHIDFWV 7KHVH PRGHOV ZLOO WKHQ EH XVHG GXULQJ WKH YDOLGDWLRQ SKDVH RI WKH SURGXFHG VRIWZDUH ZKLFK HQVXUH WKH LPSOHPHQWDWLRQ EHKDYH DV VSHFLILHG %\ UHGXFLQJ WKHQXPEHUVRIDUWHIDFWVLQWKHGHYHORSPHQWSURFHVVZHUHGXFH WKH GHYHORSLQJ FRVWV DQG SRVVLEOH ORVV RI VSHFLILFDWLRQ LWHPV GXULQJWKHGHYHORSPHQW.  )LJ([DPSOHRIDHURQDXWLFDOGHYHORSPHQWSURFHVV. &21&/86,21.  )LJ([FHUSWRIWKH1'DSSOLFDWLRQPRGHO. 7KH GDVKHG DUFV UHSUHVHQW H[FHSWLRQ DUFV IRUPDOO\ GHVFULEHGLQ>@6XFKDQH[FHSWLRQFDQEHWKURZQE\WKH)2¶V 1'DSSOLFDWLRQLIWKH)2LVLQWHUDFWLQJZLWKWKHWLOWZLGJHW7KH &DSWDLQ PRGHO UHSUHVHQWV KRZ WKLV H[FHSWLRQ FDQ EH FDXJKW PDNLQJ LW SRVVLEOH WR VSHFLI\ ZKDW EHKDYLRXU IROORZV LWV RFFXUUHQFH WKLV FRXOG EH GHQ\LQJ FDSWDLQ¶V LQWHUDFWLYLW\ RU QRWLI\LQJWKHFRQIOLFWWRKLP B. A notation embedded in an development process ,QWKLVVHFWLRQZHLOOXVWUDWHKRZWKHSURSRVHGQRWDWLRQFDQ EH XVHG ZLWKLQ DQ LQGXVWULDO GHYHORSPHQW SURFHVV IRU HPEHGGHGFULWLFDOV\VWHPV7KHGHYHORSPHQWSURFHVVGHVFULEHG LQ )LJ  LV GHULYHG IURP WKH VWDQGDUG9GHYHORSPHQW SURFHVV FXUUHQWO\DSSOLHGLQWKHDHURQDXWLFDQGFRPSOLDQWZLWKWKH'2 &>@UHTXLUHPHQWVDQGZLWKWKHSURFHVVSUHVHQWHGLQ>@. 7KLV SDSHU KDV SUHVHQWHG WKH H[WHQVLRQV DQG WKH XVH RI D IRUPDOGHVFULSWLRQWHFKQLTXH>@IRUWKHGHWDLOHGVSHFLILFDWLRQ RI PXOWLWRXFK DQG PXOWLXVHU LQWHUIDFHV ,W KDV EXLOW XSRQ SUHYLRXV ZRUN GRQH LQ WKH DUHD RI ORZOHYHO LQWHUDFWLRQ PRGHOOLQJ DV SURSRVHG LQ >@ DQG >@ ,W DOVR H[WHQGHG WKH OD\HUHG DUFKLWHFWXUH SURSRVHG LQ >@ WR DGGUHVV WKH VSHFLILF LVVXHV RI WRXFK LQWHUDFWLRQV 7KH SDSHU KDV SURYLGHG D FRPELQDWLRQ RI DQ DUFKLWHFWXUH DQG D QRWDWLRQ ZKLFK DOVR HQDEOHVDGGUHVVLQJWKHRXWSXWVRIDQLQWHUDFWLYHFULWLFDOV\VWHP LQDVLPLODUZD\DVZKDWZDVSUHVHQWHGZLWKLQSXW7KURXJKD VHW RI UHSUHVHQWDWLYH WDVNV ZH KDYH GHPRQVWUDWHG RQ D FDVH VWXG\KRZWKH,&2QRWDWLRQFDQWDFNOHPXOWLPRGDODQGPXOWL XVHUV LVVXHV SURYLGLQJ D GHWDLOHG DQG OHJLEOH QRWDWLRQ IRU LQWHUDFWLYH FULWLFDO V\VWHP VSHFLILFDWLRQ $OO WKH PRGHOV SUHVHQWHG LQ WKH SDSHU UXQ LQ 3HW6KRS HQYLURQPHQW DQG SURYLGHG WKH SDSHU LV DFFHSWHG

(86)  WKH SUHVHQWDWLRQ ZLOO GHPRQVWUDWHWKHLUH[HFXWLRQRQDPXOWLWRXFKSODWIRUP)LQDOO\ ZH LOOXVWUDWHG KRZ WKH QRWDWLRQ FDQ HQKDQFH DQ LQGXVWULDO GHYHORSPHQWSURFHVVIRULQWHUDFWLYHFULWLFDOV\VWHPV 7KLV ZRUN LV SDUW RI D PRUH DPELWLRXV ZRUN WU\LQJ WR LGHQWLI\ WKH PRGLILFDWLRQV WKDW ZRXOG KDYH WR EH DGGHG WR DFWXDO $ VSHFLILFDWLRQ VWDQGDUG WRDGGUHVV PXOWLWRXFK DQG PXOWLXVHUVLQWHUDFWLRQV 5()(5(1&(6 >@ $FFRW - &KDWW\ 6 3DODQTXH 3 $ IRUPDO GHVFULSWLRQ RI ORZ OHYHO LQWHUDFWLRQDQGLWVDSSOLFDWLRQWRPXOWLPRGDOLQWHUDFWLYHV\VWHPV'69,6 6SULQJHU9HUODJ 

(87)  >@ $FFRW - &KDWW\ 6 0DXU\ 6 3DODQTXH 3 )RUPDO 7UDQVGXFHUV 0RGHOVRI'HYLFHVDQG%XLOGLQJ%ULFNVIRU+LJKO\,QWHUDFWLYH6\VWHPV '69,66SULQJHU+HLGHOEHUJ 

(88) .

(89) >@ $5,1&3UHSDUHGE\$LUOLQHV(OHFWURQLF(QJLQHHULQJ&RPPLWWHH &RFNSLW 'LVSOD\ 6\VWHP ,QWHUIDFHV WR 8VHU 6\VWHPV $5,1& 6SHFLILFDWLRQ 

(90)  >@ %DUEp - :ROII 0  0ROODUG 5  +XPDQ FHQWHUHG GHVLJQ DSSURDFK WR LQWHJUDWH WRXFK VFUHHQ LQ IXWXUH DLUFUDIW FRFNSLWV ,Q 3URF WKLQWFRQI +&,,QW 

(91) 6SULQJHU9HUODJ >@ %DUERQL ( &RQYHUV\ 6 1DYDUUH '  3DODQTXH 3 0RGHO%DVHG (QJLQHHULQJRI:LGJHWV8VHU$SSOLFDWLRQVDQG6HUYHUV&RPSOLDQWZLWK $5,1&  6SHFLILFDWLRQ WK FRQI RQ 'HVLJQ 6SHFLILFDWLRQ DQG 9HULILFDWLRQ RI ,QWHUDFWLYH 6\VWHPV '69,6 

(92)  /1&6 6SULQJHU 9HUODJS >@ %DVWLGH 5 1DYDUUH ' 3DODQTXH 3 6FK\Q $  'UDJLFHYLF 3 $ 0RGHO%DVHG $SSURDFK IRU5HDO7LPH (PEHGGHG 0XOWLPRGDO 6\VWHPV LQ 0LOLWDU\ $LUFUDIWV 6L[WK ,QWHUQDWLRQDO &RQIHUHQFH RQ 0XOWLPRGDO ,QWHUIDFHV ,&0, 

(93) 2FWREHU86$$&03UHVV >@ %DVWLGH 5 6\ 2  3DODQTXH 3 $ IRUPDO QRWDWLRQ DQG WRRO IRU WKH HQJLQHHULQJRI&25%$V\VWHPV&RQFXUUHQF\3UDFWLFHDQG([SHULHQFH  

(94)  

(95)  >@ %RMDQ %OD]LFD ' 9  0ODGHQLF 9' +'&0' $ &OXVWHULQJ $OJRULWKP WR 6XSSRUW +DQG 'HWHFWLRQ RQ 0XOWLWRXFK 'LVSOD\V 6RXWK&+, >@ %XLVVRQ0%XVWLFR$&KDWW\6&ROLQ)5-HVWLQ<0DXU\60HUW] &  7UXLOOHW 3 ,Y\ XQ EXV ORJLFLHO DX VHUYLFH GX GpYHORSSHPHQW GH SURWRW\SHVGHV\VWqPHVLQWHUDFWLIV3URFRI&RQIpUHQFH)UDQFRSKRQHVXU O ,QWHUDFWLRQ+RPPH0DFKLQH ,+0 

(96) $&0'/ >@ &RXWD] - 1LJD\ / 6DOEHU ' %ODQGIRUG $0D\ -  <RXQJ 5  )RXU (DV\ 3LHFHV IRU $VVHVVLQJ WKH 8VDELOLW\ RI 0XOWLPRGDO LQ ,QWHUDFWLRQ WKH &$5( 3URSHUWLHV +XPDQ &RPSXWHU ,QWHUDFWLRQ ,QWHUDFW &KDSPDQ +DOO ,),3

(97) SS >@ 'DQJ &7 6WUDXE 0  $QGUp ( +DQG GLVWLQFWLRQ IRU PXOWLWRXFK WDEOHWRS LQWHUDFWLRQ 3URF RI WKH $&0 ,QWHUQDWLRQDO &RQIHUHQFH RQ ,QWHUDFWLYH7DEOHWRSVDQG6XUIDFHV ,76 

(98)  >@ '2&6RIWZDUH&RQVLGHUDWLRQVLQ$LUERUQH6\VWHPVDQG(TXLSPHQW &HUWLILFDWLRQ 5DGLR 7HFKQLFDO &RPPLVVLRQ IRU $HURQDXWLFV 57&$

(99)  (XURSHDQ2UJDQL]DWLRQIRU >@ (FKWOHU )  .OLQNHU *  $ PXOWLWRXFK VRIWZDUH DUFKLWHFWXUH ,Q 3URF RI WKH WK 1RUGLF &RQI RQ +XP&RPSXW ,QWHUDFW EXLOGLQJ EULGJHV 1RUGL&+, 

(100) $&0 >@ )D\ROODV & )DEUH -& 1DYDUUH ' 3DODQTXH 3  'HOHULV < )DXOW 7ROHUDQW ,QWHUDFWLYH &RFNSLWV IRU &ULWLFDO $SSOLFDWLRQV 2YHUDOO $SSURDFK6RIWZDUH(QJLQHHULQJIRU5HVLOLHQW6\VWHPV 6(5(1(

(101)  6SULQJHU9HUODJS >@ )O\6PDUWZLWK$LUEXV()%0DQDJHU5HWULHYHG$YDLODEOH DW KWWSVLWXQHVDSSOHFRPXVDSSIO\VPDUWDLUEXVHIE PDQDJHULG"PW  >@ *HQULFK + -  3UHGLFDWH7UDQVLWLRQV 1HWV ,Q +LJK/HYHOV 3HWUL 1HWV 7KHRU\ DQG $SSOLFDWLRQ . -HQVHQ DQG * 5R]HQEHUJ 6SULQJHU 9HUODJ 

(102) SS >@ *HVWXUH:RUNV ± WUXH 0XOWLWRXFK IRU )ODVK :HEVLWH 5HWULHYHG  $YDLODEOHDWKWWSJHVWXUHZRUNVFRP >@ +DPRQ$3DODQTXH3'HOHULV<1DYDUUH' %DUERQL($7RRO VXSSRUWHG 'HYHORSPHQW 3URFHVV IRU %ULQJLQJ 7RXFK ,QWHUDFWLRQV LQWR ,QWHUDFWLYH &RFNSLWV IRU &RQWUROOLQJ (PEHGGHG &ULWLFDO 6\VWHPV ,QW &RQI RQ +XP&RPSXW ,QWHUDFW LQ $HURQDXWLFV +&, $HUR 

(103)  $&0'/S >@ +DPRQ $ 3DODQTXH 3 6LOYD -/ 'HOHULV <  %DUERQL ( )RUPDO GHVFULSWLRQRIPXOWLWRXFKLQWHUDFWLRQV3URFWK$&0V\PSRVLXP RQ(QJLQHHULQJLQWHUDFWLYHFRPSXWLQJV\VWHPV (,&6 

(104) $&0  >@ +XWFKLQV (  /DXZVHQ 7 'LVWULEXWHG &RJQLWLRQLQDQ DLUOLQH FRFNSLW ,Q &RJQLWLRQ DQG &RPPXQLFDWLRQ DW ZRUN (QJHVWU|P  0LGGOHWRQ (GV

(105) &DPEULGJH8QLYHUVLW\3UHVV >@ .DPPHU ' .HFN 0 )UHLWDJ *  :DFNHU 0 7D[RQRP\ DQG 2YHUYLHZ RI 0XOWLWRXFK )UDPHZRUNV $UFKLWHFWXUH 6FRSH DQG )HDWXUHV,Q3URFRI:RUNVKRSRQ(QJLQHHULQJ3DWWHUQVIRU0XOWL7RXFK ,QWHUIDFHV%HUOLQ*HUPDQ\-XQH. . >@ .DUVHQW\ $ %HDXGRXLQ/DIRQ 0 $Q $OJRULWKP IRU 'LVWULEXWHG *URXSZDUH$SSOLFDWLRQV,&'&6 >@ .HQULFN . %M|UQ +DUWPDQQ 7RQ\ 'H5RVH DQG 0DQHHVK $JUDZDOD  3URWRQ D FXVWRPL]DEOH GHFODUDWLYH PXOWLWRXFK IUDPHZRUN ,Q 3URFHHGLQJV RI WKH WK DQQXDO $&0 V\PSRVLXP RQ 8VHU LQWHUIDFH VRIWZDUHDQGWHFKQRORJ\ 8,67 

(106) $&0 >@ .HQULFN . 0LOOHU 7 %ROOHQVGRUII % 'H5RVH 7 +DUWPDQQ %  $JUDZDOD 0 (GHQ D SURIHVVLRQDO PXOWLWRXFK WRRO IRU FRQVWUXFWLQJ YLUWXDO RUJDQLF HQYLURQPHQWV  3URF RI FRQI RQ +XPDQ IDFWRUVLQ FRPSXWLQJV\V &+, 

(107) $&0 >@ .KDQGNDU 6+  0DXUHU ) $ GRPDLQ VSHFLILF ODQJXDJH WR GHILQH JHVWXUHV IRU PXOWLWRXFK DSSOLFDWLRQV ,Q 3URFHHGLQJV RI WKH WK :RUNVKRSRQ'RPDLQ6SHFLILF0RGHOLQJ '60 

(108) $&0SDJHV >@ /DGU\ -) 1DYDUUH ' 3DODQTXH 3 )RUPDO GHVFULSWLRQ WHFKQLTXHV WR VXSSRUW WKH GHVLJQ FRQVWUXFWLRQ DQG HYDOXDWLRQ RI IXVLRQ HQJLQHV IRU VXUH VDIH XVDEOH UHOLDEOH DQG HYROYDEOH

(109)  PXOWLPRGDO LQWHUIDFHV ,&0,  >@ / +  /L < *HVWXUH VWXGLR DXWKRULQJ PXOWLWRXFK LQWHUDFWLRQV WKURXJKGHPRQVWUDWLRQDQGGHFODUDWLRQ3URFRI6,*&+,&RQIRQ +XPDQ)DFWRUVLQ&RPSXWLQJ6\V &+, 

(110)  >@ 0DUWLQLH& 3DODQTXH 3 1DYDUUH ' DQG %DUERQL (  $ GHYHORSPHQW SURFHVV IRU XVDEOH ODUJH VFDOH LQWHUDFWLYH FULWLFDO V\VWHPV DSSOLFDWLRQWRVDWHOOLWHJURXQGVHJPHQWV3URFWKLQWFRQIRQ+XPDQ &HQWHUHG6RIWZDUH(QJLQHHULQJ +&6( 

(111) 6SULQJHU9HUODJ >@ 0LFLUH0'HVDL0'UXU\-/0F&DQQ(1RUWRQ$7VXL.0  <DQFR +$ 'HVLJQ DQG YDOLGDWLRQ RI WZRKDQGHG PXOWLWRXFK WDEOHWRS FRQWUROOHUV IRU URERW WHOHRSHUDWLRQ 3URF RI WKH WK LQWHUQDWLRQDO FRQIHUHQFHRQ,QWHOOLJHQWXVHULQWHUIDFHV ,8, 

(112) $&0 >@ 1DYDUUH'3DODQTXH3/DGU\-) %DUERQL(,&2V$PRGHOEDVHG XVHU LQWHUIDFH GHVFULSWLRQ WHFKQLTXH GHGLFDWHG WR LQWHUDFWLYH V\VWHPV DGGUHVVLQJ XVDELOLW\ UHOLDELOLW\ DQG VFDODELOLW\ $&0 7UDQV &RPSXW +XP,QWHUDFWLRQ 

(113) ± >@ 1%$$7RXFKVFUHHQ&RFNSLW6\VWHPVDQG1H[W*HQHUDWLRQ %XVLQHVV$LUFUDIW2QOLQH$UWLFOHIURP$YLDWLRQ7RGD\5HWULHYHG $YDLODEOHDW KWWSZZZDYLDWLRQWRGD\FRPDYWRSVWRULHV1%$$7RXFKVFUHHQ &RFNSLW6\VWHPVDQG1H[W*HQHUDWLRQ%XVLQHVV$LUFUDIWBKWPO >@ 3DODQTXH 3 %DUERQL ( 0DUWLQLH & 1DYDUUH ' :LQFNOHU 0 $ PRGHOEDVHGDSSURDFKIRUVXSSRUWLQJHQJLQHHULQJXVDELOLW\HYDOXDWLRQRI LQWHUDFWLRQWHFKQLTXHV(,&6 >@ 3DODQTXH 3 %HUQKDXSW 5 1DYDUUH ' 2XOG 0  :LQFNOHU 0 6XSSRUWLQJ8VDELOLW\(YDOXDWLRQRI0XOWLPRGDO0DQ0DFKLQH,QWHUIDFHV IRU 6SDFH *URXQG 6HJPHQW $SSOLFDWLRQV 8VLQJ 3HWULQHW%DVHG )RUPDO 6SHFLILFDWLRQ1LQWK,QW&RQIHUHQFHRQ6SDFH2SHUDWLRQV >@ 3DODQTXH 3 /DGU\ -) 1DYDUUH '  %DUERQL ( +LJK)LGHOLW\ 3URWRW\SLQJRI,QWHUDFWLYH6\VWHPVFDQEH)RUPDOWRRWK,QW&RQIRQ +XP&RPSXW,QWHUDFW6SULQJHU9HUODJ/1&6 >@ 4XLQQ30DODFULD6 &RFNEXUQ$7RXFKVFUROOLQJWUDQVIHUIXQFWLRQV  3URF RI $&0 V\PSRVLXP RQ 8VHU LQWHUIDFH VRIWZDUH DQG WHFKQRORJ\ 8,67 

(114) $&0 >@ 6KQHLGHUPDQ % 

(115)  'LUHFW PDQLSXODWLRQ D VWHS EH\RQG SURJUDPPLQJODQJXDJHV,(((&RPSXWHU 

(116)  >@ 6LOYD -/ )D\ROODV & 3DODQTXH 3  %DUERQL ( $QDO\VLV RI :,03 DQG 3RVW :,03 ,QWHUDFWLYH 6\VWHPV EDVHG RQ )RUPDO 6SHFLILFDWLRQ 3URFHHGLQJV RI WKHWK ,QWHUQDWLRQDO:RUNVKRS RQ )RUPDO 0HWKRGV IRU ,QWHUDFWLYH6\VWHPV )0,6

(117)  >@ 7KH &RFNSLW RI   5HWULHYHG  $YDLODEOH DW KWWSRQERDUGWKDOHVJURXSFRPLQWXLWLYHLQQRYDWLYHLQWHUDFWLYH WKHFRFNSLWRI >@ 7RXFK6FUHHQV$UH7HVWHGIRU3LORWLQJ3DVVHQJHU-HWV5HWULHYHG $YDLODEOHDW KWWSZZZQ\WLPHVFRPWHFKQRORJ\SDVVHQJHUMHWVWHVWLQJ WRXFKVFUHHQWHFKQRORJ\KWPO"BU  >@ YDQ 'DP $  3RVW:,03 XVHU LQWHUIDFHV &RPPXQ $&0   )HEUXDU\

(118) .

(119)

Références

Documents relatifs

Quis autem vel eum iure reprehenderit qui in ea voluptate velit esse quam nihil molestiae consequatur, vel illum qui dolorem eum fugiat quo voluptas nulla pariatur?. Slide by

substrate surfaces has gained importance. The existence of organic and metallic contaminant particles and thin films on a wafer surface can drastically reduce line

Nonetheless, the care implemented at each critical stage of the operational sequence has to be stressed (Bostyn pieces grows exponentially to their size” (Pelegrin 2003, 142).

7KURXJKRXW WKLV VWXG\ WKH LPSDFW RI WKH OLQNHU UHJLRQ RQ WKH PROHFXODU UHFRJQLWLRQ RI 67$0 WRZDUG XELTXLWLQ DQG GLXELTXLWLQ FKDLQ KDV EHHQ FODULILHG %\ PRGLI\LQJ WKLV

It is presently used to improve the search of information in PRIMARISK but other applications are under development to provide a more general Safety Critical Knowledge management

It seems, in fact, that behind the façade of enhancing international collaborations and protecting internal public security, migration policies maintain (or

Zwischen den vier Fertigkeiten bestehen enge Zusammenhänge, die produktiven Fertigkeiten setzen die Rezeptiven (vgl. 1.1) voraus, mit anderen Worten, um mit