The NESPOLE! Speech to Speech Translation System

HAL Id: inria-00326408

https://hal.inria.fr/inria-00326408

Submitted on 2 Oct 2008

HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

The NESPOLE! Speech to Speech Translation System

Florian Metze, John Mcdonough, Hagen Soltau, Alex Waibel, Alon Lavie, Susanne Burger, Chad Langley, Lori Levin, Tanja Schultz, Fabio Pianesi, et al.

To cite this version:

Florian Metze, John Mcdonough, Hagen Soltau, Alex Waibel, Alon Lavie, et al.. The NESPOLE!

Speech to Speech Translation System. Human Language Technologies 2002, Mar 2002, San Diego -

California, Botswana. 6 p. �inria-00326408�

The NESPOLE! Speech-to-Speech Translation System

F. Metze, J. McDonough, H. Soltau, and A. Waibel

Interactive Systems Laboratories Universit ¨at Karlsruhe (TH)

Karlsruhe, Germany

!#"$!%!#"!

A. Lavie, S. Burger, C.

Langley, L. Levin, and T.

Schultz

Carnegie Mellon University Pittsburgh, PA, USA

!&'( ) *!+!) !(,-$!

(+!.!

#"* -"*(

F. Pianesi, R. Cattoni, G.

Lazzari, N. Mana, and E.

Pianta

ITC-irst Trento, Italy

/(+' !# ( +'#$! 01'(+

/(+!

0"(

1. INTRODUCTION

2-3!4658797:(;<!:5>=(;*41?:58@3!:BA;*5>@53!CD=(95>:ECF@3!:EGIHJ!KLIM0H-N6O

5>P 5>@>:(QSRTGIHJ!KLIM0H-N465U9V57::=3 W@>CW57::=3XQE9=3!41Y!:Z@;>9Y!5*W

[19@>46C Y\5>P 5>@>:(Q]<!:5>46^ Y!:(<\@>C_7;*C` 41<!:SFa![6[6PbFaY!=@>46C Y9[-57::=3 W

@>CW57::=3Z=(979?!46[646@>46:58D-46@3!41YZ;*:(9[WDC ;*[1<V5>:@>@>41Y!^5ICF=C QEQ8C Y

a!5>:(;*541Y `C[6`:(<U41YS:W=C QEQ8:(;*=(:c977![646=(9@>46C Y!5(R-2-3!:87;*Cd*:=@-465I9

=C[6[19?C ;>9@>46C YV?:@*D::(YU@3;*::BHa;*C 7:(9YS;*:5>:(9;*=3U[19?C ;>9@>C ;*46:5

e$f*g

J!2Z41Y820;*:(Y @>Ch

f

@9[6P'i

f

J!Mc9@#jIY!46`:(;*5>46@(k9@lB9;*[65;>a3!:

e

2-mIn'41Y

o :(;>QE9Y P'i 9Y<Ip-M

f

KJI9@#jIY!46`:(;*5>46@!q:-rC5>:(73Bs!C a;*46:(;041Y o ;*:(Y!CW

?![6:h0s;>9Y!=:(nhC Y!:EjBJU;*:5>:(9;*=3_^ ;*C a7 e$fJ!Mt9@Bp-9;>Y!:^46:SuU:[W

[6C Y_jIY!46`:(;*5>46@*PV41Y_K#46@>@>5?a;*^ 3h#KvBnI9Y<Z@*DCU41Y<a!5>@;*419[79;*@*W

Y!:(;*5

e

vBK2Ii'20;*:(Y @>Ch

f

@9[6PSwU@3!:E20;*:(Y @>41Y!CU7;*C` 41Y!=419[@>C a;*465Q

?C 9;><h9Y<ZvI:@3;>9!i'vBY!=C Y9!h

f

@9[6PUwZ9c@>:[6:W=C QEQEaY!46=(9@>41C Y!5

=C QE79Y P!nRU2-3!:S7;*Cd*:=@8465BFaY<!:(<Sd*C41Y @>[6Pt? PZ@3!:cHa;*C 7:(9Y

pC QEQ8465>5>46C Y_9Y<S@3!:BjBJ'x!GBJ!sR

2-3!:_QE941YX^C 9[ICFcGIHJ!KLIM0H-N465Z@>C\9<!`9Y!=:V@3!:V5>@9@>:WCFW

@3!:W*9;*@SCFE57::=3 W@>CW57::=3X@;>9Y!5>[19@>46C Yy41YX;*:(9[6465>@>46=t5>=:(Y9;W

46C5B9Y<U41Y `C[6` 41Y!^ZY946`:Ea!5>:(;*5(RI2-3!:IA;*5>@53!CD=(95>:E7;*:5>:(Y @>:(<

41Yz@3!465t<!:(Q8C Y!5>@;>9@>46C Yz41Y `C[6`:5\9YzHY!^[64653 w'hUs;*:(Y!=3 w'hcC ;

o :(;>QE9Y w 57:(9{41Y!^S=[646:(Y @I:(Y!|!a!41;*41Y!^S9?C a!@-D-41Y @>:(;W57C ;*@>5I7C5*W

5>41?!46[646@>41:5_41Yy@3!:_20;*:(Y @>41Y!C\;*:^46C YXCFE@3!:

f

@9[6419YXvI[17!5U` 419b9

G:@uU::@>41Y!^}~ =C YY!:=@>46C YRm465#C ;03!:(;|!a!:5>@>46C Y!59;*:9Y!5>D:(;*:(<

? Pc9Y

f

@9[6419Y W57:(9{41Y!^U9^:(Y @-9@vBK2Ih D3!46[6:8@3!:IGIHJ!KLIM0H-N

5>P 5>@>:(Q]7;*C` 41<!:5c57::=3 W@>CW57::=3\@;>9Y!5>[19@>46C Y\9Y<b9VQ8a![6@>4W

Q8C!<9[#y3!46@>:(?C 9;><h'D3!46=3Va!5>:(;*5I=(9YVa!5>:8@>CS7C41Y @I@>CS539;*:(<

D:(? W5>46@>:58C ;<;>9(DXC YZ539;*:(<ZQE97!5(h'@3!:(;*:F$C ;*:E:(Y39Y!=41Y!^c@3!:

C ;>9[=C QEQ8aY!46=(9@>46C YVD-46@3S:€ @;>9c=(979?!46[646@>46:5(R

2-3!465#797:(;4650C ;*^ 9Y!46:(<E95'F$C[6[6CD-5(‚#D:D-46[6[ A;*5>@07;*:5>:(Y @#9^:(Y W

:(;>9[5>P 5>@>:(Qƒ<!:5>=(;*417!@>46C YtD3!46=3_=C`:(;*5E@3!:E=(a;>;*:(Y @E39;><!D-9;*:

5>:@a7c95D:[6[095@3!:<!:5>46^ YU7;*41Y!=417![6:5CF0@3!:GIHJ!KLIM0H-N5>P 5*W

@>:(Qz41YS^:(Y!:(;>9[$RV:ID-46[6[0@3!:(YS7;*:5>:(Y @-@3!:Ia!5>:(;41Y @>:(;F9=:h'9Y<

OGIHJ!KLIM0H-N0wtGIH#^C@>419@>46C Yb@3;*C a!^ 3bJ!KLI{:(YbM09Y!^ a9^:S41Y

H0W=C QEQ8:(;*=: R

„

vI[65>CS9@p-9;>Y!:^46:EuU:[6[6C Y_jIY!46`:(;*5>46@*Ph'K#46@>@>5?a;*^ 3h'KvER

…-†1‡0ˆ‰(ŠŒ‹'Ž ˆŠ!‰]‘#ˆ‰†$’'‡Œ“•”U–B—˜8™cš–8›œ0†‘Š ž'Ÿ

 

ž0’'¡Š!‰(Š’

 

†$’'‡\Š!((†1ž0’#¢

@3!:U;*:5a![6@>5EF;*C Q£@*DCV5>P 5>@>:(Qƒ:`9[1a9@>46C Y!5(h-C Y!:SD-46@3b;*:57:=@

@>CV5>P 5>@>:(Q]7:(;F$C ;>QE9Y!=:VaY<!:(;8<!4¤:(;*:(Y @SY!:@*DC ;>{_=C Y<!46@>46C Y!5

9Y<U9YU:(Y< W@>CW:(Y<U:`9[1a9@>46C YRI2-3!:8;*:F$:(;*:(Y!=:589@@3!:B:(Y<SCF

@3!465797:(;05>:(;*`:957C41Y @>:(;*5@>CFa;*@3!:(;041Y F$C ;>QE9@>46C Yc9?C a!@#@3!:

GIHJ!KLIM0H-N!5>P 5>@>:(QSR

2. SYSTEM DESCRIPTION

2-3!:EGIHJ!KLIM0H-N'5>P 5>@>:(Q¥a!5>:589c=[646:(Y @*W5>:(;*`:(;E9;*=3!46@>:=@a;*:c@>C

9[6[6CD£9_=C QEQ8C YXa!5>:(;h-D3!Ct465Z?;*CD-5>41Y!^tD:(? W*79^:5SC Y\@3!:

f

Y @>:(;>Y!:@(h @>CE=C YY!:=@5>:(9Q8[6:5>5>[6PZ@>Cc9857::=3 W@>CW57::=3Z@;>9Y!5*W

[19@>46C Yb5>:(;*` 46=:Va!5>41Y!^ZF$C ;8:€!9QE7![6:VuU46=(;*C5>CF$@(x5SG:@uU::@>41Y!^}

~

5>CF$@*D-9;*:R

f

YU@3!:B=(a;>;*:(Y @53!CD=(95>:h09ca!5>:(;I?;*CD-5>:5I@3!:BD:(? W

79^:5CF0@3!:20;*:(Y @>41Y!Cc;*:^46C Yc41Y

f

@9[6P8F$C ;D-41Y @>:(;W57C ;*@>57C5>5>4W

?!46[646@>46:589Y<h!95-3!:B<!C :5Yx@AY<c9[6[0@3!:41Y F$C ;>QE9@>46C YZ3!:D-9Y @>5(h

=[646={5ZC Y\9t?a!@>@>C Yb7;*C` 41<!:(<bC Yb@3!:ZD:(? W*79^:Z@>C_:5>@9?![64653

9\` 41<!:CW=C Y F$:(;*:(Y!=41Y!^ ¦\=C YY!:=@>46C Y@>CX9\3!aQE9Y¨§9^:(Y @>©\CF

@3!:b20;*:(Y @>41Y!CX@>C a;*465>@t?C 9;><

e

5>::tA'^ a;*:yª(nR«m:b=(9YT@3!:(Y

95{cY9@a;>9[W[19Y!^ a9^:B|!a!:5>@>46C Y!5@>C8@3!:B9^:(Y @(h D3!46=3U@3!:IGIH0W

J!KLIM0H-N!5>:(;*`:(;D-46[6[0@;>9Y!5>[19@>:E9Y<c` 46=:W`:(;*59!RIp-a;>;*:(Y @>[6Ph@3!:

¦(2-3!:Sa!5>:cCF-@3!:c` 41<!:CW=C Y F$:(;*:(Y!=41Y!^_F$:(9@a;*:c4658C 7!@>46C Y9[9Y<

=(9Yt?:S<;*C 77:(<V@>CV;*:(<a!=:U?9Y<!D-41<!@3h0958@3!:c5>P 5>@>:(Q¥FaY!=W

 

¯(Š

 

¯ˆ‰(Š'¢

9^:(Y @B57:(9{5

f

@9[6419Yh0D3!46[6:U@3!:E=[646:(Y @E=(9YV57:(9{Z:46@3!:(;8HY W

^[64653hs;*:(Y!=3SC ;

o

:(;>QE9YR

2-3!:

f

Y @>:(;*[641Y!^ a9(W*?95>:(<Z@;>9Y!5>[19@>46C YV5>P 5>@>:(Q³=C`:(;*5I@3!:E9=@>46` 4W

@>46:5BCF7![19YY!41Y!^U9Y<S5>=3!:(<a![641Y!^SD-41Y @>:(;B3!C[641<9(P 5B9Y<S5>41Q846[19;

9=@>46` 46@>46:(5I41Yc@3!:I20;*:(Y @>41Y!Cc;*:^46C YR´Pca!5>41Y!^EGIHJ!KLIM0H-N1h =(a!5*W

@>C Q8:(;*5=(9YU?:B5>:(;*`:(<U41YS5>:`:(;>9[0[19Y!^ a9^:5D-46@3!C a!@-@3!:BY!::(<

@>CB:(QE7![6CPS9^:(Y @>5=(979?![6:CF057:(9{41Y!^c9[6['CF@3!:(QSR#vB<<!46@>46C Y W

9[6[6Ph@3!:SGIHJ!KLIM0H-N05>P 5>@>:(Qƒ41Y!=C ;>7C ;>9@>:5S9U57:=419[y3!46@>:W

?C 9;><ED-46@3SQ8a![6@>4W*Q8C!<9[=(979?!46[646@>46:5(h9[6[6CD-41Y!^E@3!:9^:(Y @9Y<

@3!:I=[646:(Y @B@>CE539;*:8QE97!5-C ;-D:(? W*79^:5(R

2.1 Hardware requirements

2-3!:-5>P 5>@>:(Q;*:|!a!41;*:5-Y!CI57:=419[39;><!D-9;*:C Y8@3!:=[646:(Y @(x55>41<!:h

:€ =:(7!@c9S5>@9Y<9;><VKpC ;B7C ;*@9?![6:S<!:` 46=:UD-46@3_Q846=(;*C 73!C Y!:

9Y<c[6C a<!57:(9{:(;*5C ;-3!:(9<!5>:@>5I95-D:[6[#959Y

f

Y @>:(;>Y!:@=C YY!:=W

@>46C Y8D-46@3E9?9Y<!D-41<!@3BCF9?C a!@0µ¶ { ?!46@·5(R#V:39(`:#F$C ;0:€!9QBW

7![6:8<!:(Q8C Y!5>@;>9@>:(<S@3!:I5>P 5>@>:(Q¨C YU98[197!@>C 7U;>aYY!41Y!^8\41Y<!CD-5

¸¹¹¹ h!=C YY!:=@>:(<U@>Cc@3!:

f

Y @>:(;>Y!:@-` 419c9ED-41;*:[6:5>58MvBGX[641Y{R

2-3!:c39;><!D-9;*:85>:@a7_a!5>:(<ZD-46@3!41Y_@3!:EGIHJ!KLIM0H-N'5>P 5>@>:(Q£465

53!CDYV41YZA'^ a;*: ¸ RS2-3!:c=[646:(Y @E=C YY!:=@>58@>CZ9S57:=419[-5>:(;*`:(;h

@3!:U5>CW=(9[6[6:(<º§uU:(<!419@>C ;*©bQE9=3!41Y!:h-D3!46=3b@3!:(Yb41Yb@a;>Y_:5*W

@9?![64653!:5I=C YY!:=@>46C Y!5@>CE@3!:I5>CW=(9[6[6:<\§mIM!2W5>:(;*`:(;*5>©h'D3!46=3

7;*C` 41<!:c@3!:cv8J

g

9Y<_uZ2=(979?!46[646@>46:5(Rt2-3!:SuU:(<!419@>C ;89[65>C

;>aY!5aY<!:(;0\41Y<!CD-5(hD3!46[6:I@3!:-mIM!2_5>:(;*`:(;*5-;>aY8C YE<!4¤:(;*:(Y @

»9(`C a;*5#CFM41Y!a!€BC Y fY @>:[Kp5C ;jIY!46€BDC ;>{5>@9@>46C Y!5(R2-3!: fK

=C YY!:=@>46C Y!58?:@*D::(YZ@3!:EuU:(<!419@>C ;=C QE7a!@>:(;I9Y<U@3!:E9^:(Y @

9Y<c=[646:(Y @Ia!5>:I@3!:BmI¼ ¸ ¼B` 41<!:CW=C Y F$:(;*:(Y!=4Y!^S5>@9Y<9;><h D3!46=3

465I?95>:(<SC YUjI½IKtF$C ;@3!:B9a<!46Cc5>@;*:(9QSR½I9@98465I@;>9Y!5Q846@>@>:(<

` 419B2-p-K0R 2-3!465Q8:(9Y!5@39@0@3!:(;*:-D-46[6[?:[646@>@>[6:I@>41Q8:I<!:[19(PE<a;W

41Y!^V@;>9Y!5Q8465>5>46C YhD3!46=3t465c41QE7C ;*@9Y @8F$C ;E3!aQE9Y W@>CW*3!aQE9Y

=C QEQ8aY!46=(9@>46C YhI?a!@E53!C ;*@E5>:^ Q8:(Y @>5SCFB57::=3\=(9Yb?:Z[6C5>@

<a;*41Y!^U@;>9Y!5Q8465>5>46C YR_2-3!:c[641Y{5c?:@*D::(Yt@3!:cuU:(<!419@>C ;E9Y<

@3!:cmIM!2T5>:(;*`:(;*5Ea!5>:c2-p-K0R#2-3!:E:¤:=@8CF79={:@*W[6C5>5EC YZ@3!:

<!:(Q8CID-46[6[?:-<!465>=(a!5>5>:(<841YB@3!:5>P 5>@>:(QT:`9[1a9@>46C YE5>:=@>46C YR2-3!:

[6C^46=(9[#5>P 5>@>:(Q³<!:5>46^ YU465I53!CDYc41YSA'^ a;*:B¼!R

…-†1‡0ˆ‰(ŠE¾0­E®'Š8¿1ž'‡†

 

“'¿œ0†1Š Àzž'¡'¯®'ŠE”U–B—˜8™cš–8›'±0¯(Š²t¢

=C QEQ8aY!46=(9@>:5ED-46@3V@3!:cuU:(<!419@>C ;B=C QE7a!@>:(;Rcp-a;>;*:(Y @>[6Ph0D:

a!5a9[6[6Pc;>aYB@3!:uU:(<!419@>C ;9@

f*g

J!2V41Yc20;*:(Y @>ChD3!46[6:@3!:9^:(Y @

465c?:41Y!^V=(9[6[6:(<y9@8vBK2Ih#9[65>CV41Yb20;*:(Y @>CRV2-3!:SmIM!25>:(;*`:(;*5(h

D3!46=3S7;*C` 41<!:-57::=3S;*:=C^ Y!46@>46C Yh!@;>9Y!5>[19@>46C YS9Y<E5>P!Y @3!:5>465(h

;>aYc9@@3!:-[6C =(9@>46C Y!5CF@3!:79;*@>46=4179@>41Y!^c79;*@Y!:(;*5(h 4$R:R9@@3!:

jIY!46`:(;*5>46@>46:541YS20;*:(Y @>Ch!K#46@>@>5?a;*^ 3h o ;*:(Y!C ?![6:B9Y<ElB9;*[65;>a3!:R

2-3!:_=3!C5>:(YX<!:5>46^ YT9[6[6CD-5ZF$C ;ZQE9€ 41Q8aQ]»':€ 41?!46[641@*P<a;*41Y!^

a!59^:‚buU:(<!419@>C ;*5V9Y<\mIM!2W5>:(;*`:(;*5Z=(9YX?:_;>aY\41Yy5>:`:(;>9[

[6C =(9@>46C Y!5(h5>CZ@39@B@3!:cC 7!@>41QE9[=C Y A'^ a;>9@>46C YV^46`:(Yt@3!:E=(a;W

;*:(Y @-a!5>:(;[6C =(9@>46C YV9Y<SY!:@*DC ;>{E@;>9(Ác=I=(9YU?:I=3!C5>:(YS9@;>aY W

@>41Q8:R2-3!:=C QE7a!@9@>46C Y9[6[6PS41Y @>:(Y!5>46`:B79;*@CF57::=3U;*:=C^ Y!4W

@>46C Y_9Y<Z@;>9Y!5>[19@>46C Y_465E<!C Y!:EC YV<!:(<!46=(9@>:(<_5>:(;*`:(;8QE9=3!41Y!:5(R

2-3!:Z=[646:(Y @ZQE9=3!41Y!:V=(9Y\@3!:(;*:F$C ;*:V?:Z`:(;*Pz§>@3!41Y!©h5>Ct@39@

@3!:E5>:(;*` 46=:S465E9(`946[19?![6:UY!:(9;*[6PV:`:(;*P D3!:(;*:U9Y<Z@>CU:`:(;*PC Y!:h

41Y!=[1a<!41Y!^UQ8C ?!46[6:E<!:` 46=:589Y<U7a?![646=B41Y F$C ;>QE9@>46C YZ{46C5{5(R

2.2 Software

v³=C QE7![6:@>:V=(9[6[@3;*C a!^ 3t@3!:S5>P 5>@>:(QÂ5>@9;*@>5S? Pt9Z=[646:(Y @Z;*:W

|!a!:5>@>41Y!^Z9SG:@uU::@>41Y!^U=C YY!:=@>46C YVD-46@3Z@3!:EuU:(<!419@>C ;RB2-3!:

uU:(<!419@>C ;S41<!:(Y @>4A':5S@3!:Z=[646:(Y @(x5ZY9@>46`:V[19Y!^ a9^:V? Pb9Yb:(Y W

@;*PV41Yt@3!:_§GI9Q8:©UA':[1<h#D3!46=3t465E@;>9Y!5Q846@>@>:(<b<a;*41Y!^U=(9[6[65

9Y<_D-46[6[I@3!:(Yt=C Y @9=@c@3!:UmIM!2z5>:(;*`:(;8F$C ;E@3!:S=[646:(Y @(x5S[19Y W

^ a9^:h@3!:SmIM!25>:(;*`:(;8F$C ;8@3!:S9^:(Y @(x5E[19Y!^ a9^:

e

=(a;>;*:(Y @>[6P

f

@9[6419Ynh!@>CE=3!:={E@3!:B9(`946[19?!46[641@*PZCF0@;>9Y!5>[19@>46C YU5>:(;*` 46=:5B9Y<

@;*Pt@>CV:5>@9?![64653y9_G:@uU::@>41Y!^t=C YY!:=@>46C Y\@>C_9Yb9^:(Y @(R f@

D-46[6[IC Y![6Pb9==:(7!@c@3!:S=(9[6[F;*C Q£@3!:S=[646:(Y @(h-C Y!=:U@3!:5>:U@3;*::

;*:|!a!41;*:(<y=C YY!:=@>46C Y!5Z39(`:Z?::(Y\:5>@9?![64653!:(<RºJ!7::=3bF;*C Q

@3!:-=[646:(Y @-D-46[6[?:;*:=:46`:(<U? P8@3!:uU:(<!419@>C ;hF$C ;*D-9;><!:(<E@>CB@3!:

;*:57:=@>46`:tmIM!2º5>:(;*`:(;h-D3!46=3\D-46[6[I41Y\@a;>Yb7:(;F$C ;>QÂ57::=3

;*:=C^ Y!46@>46C Yy9Y<t9Y9[6P 5>465U41Y @>C_9Z[19Y!^ a9^:W41Y<!:(7:(Y<!:(Y @_§

f

Y W

@>:(;*=39Y!^:Vs!C ;>QE9@>©

e$f

s#nZõ(Ä*hD3!46=3\465U@3!:(Yb@;>9Y!5Q846@>@>:(<y@>C

@3!:SmIM!25>:(;*`:(;E95>5>C =419@>:(<bD-46@3_@3!:S9^:(Y @(h#D3!:(;*:c@>:€ @ED-46[6[

?:I^:(Y!:(;>9@>:(<cF;*C Qz@3!:

f

sR!2-3!465-@>:€ @-5>@;*41Y!^ED-46[6[0@3!:(YS?:I5>P!Y W

@3!:5>46:(<Z9Y<c@3!:I;*:5a![6@>41Y!^S9a<!46CE465-@;>9Y!5Q846@>@>:(<U@>C8@3!:B9^:(Y @

` 419_@3!:UuU:(<!419@>C ;RyuZa![6@>4W*Q8C!<9[I^:5>@a;*:5(h-5a!=3b95c<;>9(D-41Y!^

C YU9cQE97SC ;` 41<!:CU<9@98465@;>9Y!5Q846@>@>:(<V<!41;*:=@>[6PV?:@*D::(YU@3!:

?::(Y<!:`:[6C 7:(<z? Py@3!:t79;*@>46=4179@>41Y!^T79;*@Y!:(;*5V<a;*41Y!^\@3!:

7;*Cd*:=@(R#sa;*@3!:(;041Y F$C ;>QE9@>46C Y8C Y8@3!:41QE7![6:(Q8:(Y @9@>46C YcCF'@3!:5>:

Q8C!<a![6:5c=(9Yt?:cF$C aY<V41Yt@3!:S;*:F$:(;*:(Y!=:5U9@8@3!:S:(Y<_CF@3!465

797:(;h05aQEQE9;*46:(<t41Y_5>:=@>46C YtÅ!R

f

Y_GIHJ!KLIM0H-ND:ca!5>:S9Y

f

Y @>:(;*[641Y!^ a9(W*?95>:(<Z@;>9Y!5>[19@>46C YV977;*C 9=3h?:=(9a!5>:E@3!465B9[6[6CD-5

a!5@>C8:(95>46[6PS:€!79Y<c@3!:-5>P 5>@>:(Qz@>C8C@3!:(;[19Y!^ a9^:5@39Y{5@>C

@3!:85>@9;W5397:(<V9;*=3!46@>:=@a;*:c:` 41<!:(Y @B41YZA'^ a;*:E¼!h9Y<U41Y!=C ;W

7C ;>9@>:I9Yca!5>:(;0F$::(< W*?9={E[6C C 7S? P8^:(Y!:(;>9@>41Y!^c9B79;>973;>95>:-41Y

@3!:Ba!5>:(;x5CDYS[19Y!^ a9^:

e

a!5>:Fa!['F$C ;-:(;>;*C ;=C ;>;*:=@>46C YnR

J P 5>@>:(Qƒ;*:57C Y!5>:U@>41Q8:U465c3!46^ 3![6Pt`9;*419?![6:V<a!:c@>CZ@3!:UaY!=:(;W

@941Yt9Y<_`9;*P 41Y!^_Y!:@*DC ;>{V=C Y<!46@>46C Y!5(RV2-3!:S57::=3b;*:=C^ Y!4W

@>46C YX=C QE7C Y!:(Y @>5Za!5>:t;>aY WC Yy;*:=C^ Y!46@>46C Yh84$R:R£;*:=C^ Y!46@>46C Y

5>@9;*@>5c95E5>C C Yb95E@3!:cA;*5>@E79={:@>5cCFB<9@9Z9;>;*46`:h-9Y<t;>aY

977;*C€ 41QE9@>:[6PS;*:(9[W@>41Q8:

eo

:(;>QE9YnC ;[6:5>5-@39YE¼B@>41Q8:5;*:(9[W

@>41Q8:

e

HY!^[64653n-C Yc5>@9Y<9;><Zª

o

mBK0:(Y @>41aQBW f>f>f

Kp5;>aYY!41Y!^

M41Y!a!€'RS½:(7:(Y<!41Y!^ZC Y_Y!:@*DC ;>{Z=C Y<!46@>46C Y!5(h#@>:€ @E;*:(7;*:5>:(Y @9(W

@>46C Y!5#CF'57::=3c;*:=C^ Y!46@>46C YEC ;0@;>9Y!5>[19@>46C Yh 95<!465>=(a!5>5>:(<E41Y8@3!:

F$C[6[6CD-41Y!^_5>:=@>46C YtC Y_@3!:ca!5>:(;B41Y @>:(;F9=:h=(9Yt?:S9(`946[19?![6:Z41Y

[6:5>5B@39YSC Y!:B5>:=C Y<Z9(F$@>:(;9E5a?!d*:=@5>@>C 77:(<U57:(9{41Y!^RjIY W

<!:(;I?9<VY!:@*DC ;>{U=C Y<!46@>46C Y!5(h@3!:E59Q8:c7;*C =:5>58=(9YV3!CD:`:(;

@9{:B5>:`:(;>9[05>:=C Y<!5(h@>C CR

3. USER INTERFACE

J 46^ Y!4A'=(9Y @B9@>@>:(Y @>46C YZD-95I@3!:(;*:F$C ;*:E<!:`C@>:(<Z@>CU<!:5>46^ Y!41Y!^Z9Y

977;*C 7;*419@>:VF;*C Y @*W:(Y<Ta!5>:(;U41Y @>:(;F9=:_F$C ;Z@3!:_5>P 5>@>:(QSh8@39@

9[6[6CD-5V?C@3b=[646:(Y @>5V9Y<\9^:(Y @>5U9Y\41Y @a!46@>46`:t9Y<\;*:[19@>46`:[6P

5>41QE7![6:c=C Y @;*C[0C`:(;@3!:41;=C QEQ8aY!46=(9@>46C Yt7;*C =:5>5(RB2-3!:Ea!5>:(;

41Y @>:(;F9=:_<!4657![19(Pb465c\41Y<!CD-50}

~

W*?95>:(<\9Y<t=C Y!5>465>@>5UCFIF$C a;

D-41Y<!CD-5(‚

Æ

@3!:BuU46=(;*C5>CF$@#}

~ f

Y @>:(;>Y!:@H#€!7![6C ;*:(;

Æ

@3!:BuU46=(;*C5>CF$@#}~ \41Y<!CD-5IG:@uU::@>41Y!^

Æ

@3!:IvI:y3!46@>:(?C 9;><

Æ

@3!:BG:57C[6:EuUC Y!46@>C ;

2-3!:5>:ED-41Y<!CD-5=(9YV?:85>::(YZ41YUA'^ a;*:B¶RIj5>41Y!^ f Y @>:(;>Y!:@H#€W

7![6C ;*:(;h0@3!:ca!5>:(;89=@>46`9@>:5E@3!:c9a<!46CV9Y<Z` 41<!:CZ=(9[6[D-46@3t9Y

9^:(Y @ID3!CS=(9YV3!:[17V3!41Q¥9Y<U^46`:c3!41Q³@3!:E9Y!5>D:(;*5B9Y<U@3!:

<!:@946[65E3!:8Y!::(<!5(‚I9[6[#@3!:Ea!5>:(;I395@>CU<!Cc465B@>CS=[646={V9S?a!@>@>C Y

C YU@3!:8?;*CD-5>:(;79^:89Y<U9a!@>C QE9@>46=(9[6[6P_uU46=(;*C5>CF$@B\41Y<!CD-5

G:@uU::@>41Y!^Z4658C 7:(Y!:(<_9Y<Z@3!:c9a<!46CZ9Y<Z` 41<!:CZ=C YY!:=@>46C Y

^C :5Ia7R

V:ZF$C aY<b46@U41QE7C ;*@9Y @S@>Ct` 465a9[6[6PT7;*:5>:(Y @U957:=@>5UCF8@3!:

57::=3 W@;>9Y!5>[19@>46C Yb7;*C =:5>58@>CU@3!:E:(Y<Va!5>:(;Rc2-3!4658465E9==C QBW

7![64653!:(<U` 4198@3!:BG:57C[6:8uUC Y!46@>C ;-<!4657![19(PR2-3;*::I@>:€ @a9[0;*:(7 W

;*:5>:(Y @9@>46C Y!5B9;*:E<!4657![19(P:(<U41YZ=[6:(9;*[6PV41<!:(Y @>4A':(<SA':[1<!5(h'53!CDY

41YSA'^ a;*:BÅ!‚

ªR-9E@;>9Y!5>=(;*417!@CF#@3!:B57C {:(YUa!@>@>:(;>9Y!=:

e

@3!:BC a!@7a!@F;*C Q

@3!:I57::=3V;*:=C^ Y!46:(;>ni

¸

R-9t79;>973;>95>:UCFB@3!:Va!@>@>:(;>9Y!=:Uwb@3!:Z;*:5a![6@UCFB@;>9Y!5*W

[19@>41Y!^U@3!:8;*:=C^ Y!46:(<_41Y7a!@I?9={c41Y @>CS@3!:8=[646:(Y @(x5BCDY

[19Y!^ a9^:i

¼!R@3!:I@>:€ @a9[@;>9Y!5>[19@>46C YUCF#@3!:Ba!@>@>:(;>9Y!=:I57C {:(YU? PE@3!:

…-†1‡0ˆ‰(ŠtǍB­E®'ŠV”U–B—˜8™cš–8›²Zž0’†1¯(ž‰EÀc†$’‘žÀU¢

2-3!:5>:@>:€ @a9[;*:(7;*:5>:(Y @9@>46C Y!5-7;*C` 41<!:@3!:a!5>:(;*5D-46@3E@3!:=(9(W

79?!46[646@*PE@>CB41<!:(Y @>4F$P8D;*C Y!^B@;>9Y!5>[19@>46C Y!59Y<841Y<!46=(9@>::(;>;*C ;*5@>C

@3!:EC@3!:(;B79;*@*PRcv¨?9<V79;>973;>95>:E4658CF$@>:(Y_9S^C C!<_41Y<!46=(9(W

@>C ;BCF9U5>46^ Y!4A'=(9Y @8:(;>;*C ;B41Y_@3!:E@;>9Y!5>[19@>46C Yb7;*C =:5>5(RUy3!:(Y

9YX41Y9==(a;>9@>:t@;>9Y!5>[19@>46C YT465V<!:@>:=@>:(<h8@3!:ta!5>:(;U=(9YT7;*:5>5

9Z<!:(<!46=(9@>:(<b?a!@>@>C YZ@39@841Y F$C ;>Q85E@3!:EC@3!:(;879;*@*PV@>CZ46^ Y!C ;*:

@3!:B@;>9Y!5>[19@>46C YV?:41Y!^U<!4657![19(P:(<h? PS3!46^ 3![646^ 3 @>41Y!^S@3!:B@>:€ @a9[

@;>9Y!5>[19@>46C YS41YS;*:(<cC Yc@3!:IQ8C Y!46@>C ;-<!4657![19(PcCF0@3!:C@3!:(;79;*@*PR

2-3!:_a!5>:(;S=(9Yy@3!:(Yy;*:(7:(9@U@3!:V@a;>YRz2-3!:V=(a;>;*:(Y @S5>P 5>@>:(Q

9[65>Cy9[6[6CD-5V@3!:V79;*@>46=4179Y @>5Z@>Cb=C ;>;*:=@Z57::=3T;*:=C^ Y!46@>46C Y

9Y<Z@;>9Y!5>[19@>46C Y_:(;>;*C ;*58` 419Z{:P!?C 9;><V41Y7a!@(h09cF$:(9@a;*:ED3!46=3

465Z`:(;*Py:¤:=@>46`:tD3!:(YX?9Y<!D-41<!@3\[641Q846@9@>41C Y!5_<!:^ ;>9<!:_@3!:

5>P 5>@>:(Q¥7:(;F$C ;>QE9Y!=:RB2-3!:U§uUC Y!46@>C ;*©SD-41Y<!CDBh'D3!46=3V9[6[6CD-5

5a!=3S41Y @>:(;>9=@>46C Yh'46553!CDYS41YU<!:@946[041YSA'^ a;*:BÅ!R

2-3!:8vI:y3!46@>:(?C 9;><V46587;*C` 41<!:(<V@>CS41QE7;*C`:E@3!:8|!a9[646@*PV9Y<

@3!:S=[19;*46@*PbCFI@3!:S=C Y `:(;*59@>46C Yt@3;*C a!^ 3tQ8a![6@>4W*Q8C!<9[I@>C C[65(‚

46@I^46`:5B@>CS@3!:8a!5>:(;@3!:87C5>5>41?!46[646@*P_@>Cc539;*:8D-46@3V3!465B;*:(Q8C@>:

41Y @>:(;*[6C =(a!@>C ;B9YU41QE9^:cC ;9Sa!5>:(;x5F;*::W*39Y<V<;>9(D-41Y!^i'@3!465I465

;*:(9[646:(<c41Yc9-`:(;*P85>41QE7![6:I9Y<B41Y @a!46@>46`:-D-9(PB@3;*C a!^ 3B9Ia!5>:(;041Y W

@>:(;F9=:8@39@F$C[6[6CD-5I@3!:B5>@9Y<9;><!5CF#\41Y<!CD-5I977![646=(9@>46C Y!5(‚

@3!:(;*:I4659EQ8:(Y!ah!9B@>C C[W*?9;h'9Y<c985>@9@a!5-?9;D3!:(;*:I@3!:Ia!5>:(;

=(9Yb;*:(9<b5>P 5>@>:(QSh5>@9@>:h-9Y<b?a!@>@>C YZFaY!=@>46C Y9[646@*Pb:€!7![19Y9(W

@>46C Y!5(R

2-3!:IFaY!=@>46C Y9[646@>46:5E7;*C` 41<!:(<Z? Pc@3!:BvI:y3!46@>:(?C 9;><U41Y!=[1a<!:‚

41QE9^:z[6C 9<!41Y!^hVF;*::W*39Y<£<;>9(D-41Y!^h_9;*:(9º5>:[6:=@>41Y!^hb=C[6C ;

=3!C C5>41Y!^hB5>=(;*C[6[641Y!^T@3!:V41QE9^:b[6C 9<!:(<hBC C Q841Y!^y@3!:_41QE9^:

[6C 9<!:(<h8j

g

MC 7:(Y!41Y!^h89Y<XG:57C[6:N£uUC Y!46@>C ;Z9=@>46`9@>46C YR

2-3!:8Q8C5>@-41QE7C ;*@9Y @-F$:(9@a;*:I465@39@-:(9=3SC 7:(;>9@>46C YU@3!:Ba!5>:(;

…-†1‡0ˆ‰(Š_Ê0B­E®'ŠVŽcŠ Ë£®†1¯(Š!°0ž'“'‰‘X†$’\ˆŠ'¢

41<!:(Y @>46=(9[W41Qc9^:UD3!46@>:(?C 9;><!5(R8vBYZ:€!9QE7![6:cCF-@3!:8vI:y3!46@>:W

?C 9;><b?:41Y!^ta!5>:(<t@>C_3!46^ 3![646^ 3 @c@*DCV@>CDY!5c9Y<b3!41{41Y!^t79@3

?:@*D::(Yc@3!:(QT46553!CDYE41Y8A'^ a;*:µ!R2-3!465A'^ a;*:-465@9{:(Y8F;*C Q

9YB:€ @>:(Y!5>46C YcCF'@3!:5>P 5>@>:(QSh D3!46=3ED:=(a;>;*:(Y @>[6PE<!:`:[6C 7h@39@

=(9YU9[65>CU39Y<![6:I5aQEQ8:(;I9=@>46` 46@>46:5R

2P!7!46=(9[6[6Ph#@3!:8=[646:(Y @8DC a![1<Z95{SF$C ;I<!465>@9Y!=:589Y<Z<!41;*:=@>46C Y!5

F;*C Q¥9U7;*C 7C5>:(<V[6C =(9@>46C Yh#59(PV9U3!C@>:[$h0@>CZ9Y!C@3!:(;h:R^R1h5{4

5>[6C 7:5(RV´PVa!5>41Y!^Z@3!:cy3!46@>:W*´C 9;><h#@3!:S9^:(Y @B=(9Y_41Y<!46=(9@>:

@3!:S[6C =(9@>46C Y!5U9Y<t<;>9(D¨;*C a!@>:5EC Yt@3!:SQE97h9==C QE79Y P 41Y!^

^:5>@a;*:5D-46@3E`:(;>?9[:€!7![19Y9@>46C Y!5(R2-3!:F;*C Y @*W:(Y<8CF@3!:GIH0W

J!KLIM0H-N 5>P 5>@>:(Q¨9[6[6CD-5@3!:I79;*@>46=4179Y @>5-@>C8=C QEQ8aY!46=(9@>:B:(Y W

@>41;*:[6PZD-46@3U57::=3Z9Y<Sa!5>:B^:5>@a;*:5D3!:(Y!:`:(;@3!:PcD-9Y @(R

4. SYSTEM EVALUATION

½4¤:(;*:(Y @:`9[1a9@>46C YS5>:5>5>46C Y!5-39(`:-?::(YE=C Y<a!=@>:(<h@9;*^:@>41Y!^

<!4¤:(;*:(Y @I957:=@>5(‚

ªR@3!:I41QE79=@B9Y<Ua!59?!46[646@*PUCFQ8a![6@>4W*Q8C!<9[641@*P'i

¸ R:€!7:(;*41Q8:(Y @>5F$C ;95>5>:5>5>41Y!^8@3!:-41QE79=@CF#Y!:@*DC ;>{B@;>9(Ác=

9Y<V@3!:c=C Y!5>:|!a!:(Y!=:5cCFI;*:(9[-79={:@*W[6C5>5(hC Y_@3!:E5>P 5*W

@>:(QSx5I7:(;F$C ;>QE9Y!=:i9Y<

¼!R:(Y< W@>CW:(Y<U7:(;F$C ;>QE9Y!=:8:`9[1a9@>46C Y!5(R

2-3!:8<9@9?95>:B=C[6[6:=@>:<_<a;*41Y!^c@3!:87;*Cd*:=@I9Y<SD3!46=3Z465B?:W

41Y!^Ua!5>:(<Z41YZ@3!:8`9;*46C a!5B:`9[1a9@>46C Y!584658<!:5>=(;*41?:(<_41YtÃ

¸

Ä*RI2-3!:

:`9[1a9@>46C Yc=C Y!=:(;>Y!41Y!^8uZa![6@>4W*uUC!<9[646@*Pc4657;*:5>:(Y @>:(<841Y8@3!:-9=W

=C QE79Y P 41Y!^UmIM!2 ¸¹¹¸ 7C5>@>:(;I7;*:5>:(Y @9@>46C YtöÄ*R

f

YS@3!465IDC ;>{

D:ID-46[6[07;*:5>:(Y @@3!:B;*:5a![6@>5F;*C QzG:@*DC ;>{c20;>9(Ác=I41QE79=@9Y<

@3!:BHY< W@>CW*HY<S:`9[1a9@>46C YR

4.1 Network traffic impact

f

Y\C a;S`9;*46C a!5Va!5>:(;S5>@a<!46:5V9Y<y<!:(Q8C Y!5>@;>9@>46C Y!5(hID:t39(`:

?::(YUF$C ;*=:(<V@>CS<!:(9[#D-46@3Z@3!:E<!:@;*41Q8:(Y @9[#:¤:=@>58CFY!:@*DC ;>{

=C Y!^:5>@>46C YZC YS@3!:B@;>9Y!5Q8465>5>46C YZCFÌC

f

Kb41YUC a;5>P 5>@>:(QSR2-3!:

=(;*46@>46=(9[cY!:@*DC ;>{y79@3!5U9;*:_@3!:_mI¼ ¸ ¼t=C YY!:=@>46C Y!5V?:@*D::(Y

@3!:cuU:(<!419@>C ;B9Y<Z@3!:cp[646:(Y @E9Y<ZvI^:(Y @(h'D3!46=3_;*:[6PVC YZ@3!:

jI½IKz7;*C@>C =C[$h-41Y\C ;><!:(;E@>C_^ a9;>9Y @>::Z;*:(9[W@>41Q8:t3!aQE9Y W@>CW

3!aQE9Y=C QEQ8aY!46=(9@>46C YRs!C ;0<!:(Q8C Y!5>@;>9@>46C Y87a;>7C5>:5(h(D:=(9Y

CF=C a;*5>:c=41;*=(aQB`:(Y @8@3!:S7;*C ?![6:(Q£? PV7C5>46@>46C Y!41Y!^_@3!:E@3;*::

=C QE7C Y!:(Y @>5841Y `C[6`:(<

e

=[646:(Y @(h9^:(Y @(h#Q8:(<!419@>C ;>nBD-46@3!41Yt=[6C5>:

7;*C€ 41Q846@*Ph'@3!465465I3!CD:`:(;Y!C@9E;*:(9[6465>@>46=c5>=:(Y9;*46CR

2CS|!a9Y @>4F$PU@3!:B41Y »a!:(Y!=:8CF-jI½IK\79={:@*W[6C5>5BC YZ;*:(9[WDC ;*[1<

5>P 5>@>:(QŒ7:(;F$C ;>QE9Y!=:hSD:y;>9Y9XY!aQ8?:(;ZCFU@>:5>@>5b?:@*D::(Y

o :(;>QE9Y=[646:(Y @t41Y!5>@9[6[19@>46C Y!5b41YT@3!:\jBJ v

e

p-uZj]9@_K#46@>@>5*W

?a;*^ 3nS9Y< o :(;>QE9Y P ejIlIvƒ9@VlB9;*[65;>a3!:(nU=(9[6[641Y!^9buU:W

<!419@>C ;841Y

f

@9[6P e$f*g

J!2-nh0D3!46=3t41Yt@a;>Y!58=C Y @9=@>:(<t@3!: o :(;W

QE9YºmIM!2ƒ5>:(;*`:(;t[6C =(9@>:(<º41YºlB9;*[65;>a3!:RÍ2-3!:\@>:5>@>5tD:(;*:

=C Y<a!=@>:(<t? PVF$::(<!41Y!^_9V3!46^ 3 W|!a9[646@*Pb;*:=C ;><!41Y!^_CFI@3!:

o

:(;W

QE9YV<!:`:[6C 7Q8:(Y @*W@>:5>@85>:@I=C[6[6:=@>:(<b9@@3!:E?:^41YY!41Y!^UCF@3!:

7;*Cd*:=@041Y @>CI9-=C QE7a!@>:(;5>:@*W*a7IF$C ;09-` 41<!:CW=C Y F$:(;*:(Y!=: h 4$R:R#D:

;*:(7![19=:(<c@3!:-Q846=(;*C 73!C Y!:? P89I½-v2t;*:=C ;><!:(;

e

C ;#9=C QE7a!@>:(;>n

7![19(P 41Y!^y9_@97:hID3!46[6:_[6:(9(` 41Y!^y:`:(;*P @3!41Y!^\:[65>:t95U46@UDC a![1<

?:SF$C ;E5>:5>5>46C Y!5UD-46@3\;*:(9[I5a?!d*:=@>5(R

f

Y\79;*@>46=(a![19;h-5>:^ Q8:(Y W

@9@>46C Y\D-95S9a!@>C QE9@>46=(9[6[6PT7:(;F$C ;>Q8:(<y? PbG:@uU::@>41Y!^R2-3!:

@3!a!5B7;*C!<a!=:(<Z5>:^ Q8:(Y @>58D:(;*:S;*:=C^ Y!46:(<t5>:(79;>9@>:[6Pt? PU@3!:

mIM!2T5>:(;*`:(;*5c9Y<Z@3!:c3 P!7C@3!:5>:58=C Y!=(9@>:(Y9@>:(<_@>CU=(9[6=(a![19@>:

g e

@3!:B<9(PcC YU<!4¤:(;*:(Y @I<9(P 5CF#@3!:ID::({R

vI[6[41Yc9[6[$h!D:D:(;*:I9?![6:@>C8;>aYSª(µI=C QE7![6:@>:I@>:5>@>5(h!;*:5a![6@>41Y!^841Y

9YB9(`:(;>9^:DC ;><B9==(a;>9=PBCF'µ ¹ R¶ ÎShÏD-46@3B5>41Y!^[6:`9[1a!:541YB@3!:

µ¼Î³@>CUÅÐÎ¥;>9Y!^:BF$C ;B79={:@*W[6C5>58=C Y<!46@>46C Y!58?:@*D::(Y ¹ R1ª(Î

9Y<BÅ!R¸ ÎSR#m46^ 3!:(;#79={:@*W[6C5>5;>9@>46C5(h;*:5a![6@>41Y!^F;*C QX^:(Y!:(;>9[6[6P

?9<VY!:@*DC ;>{U=C Y<!46@>46C Y!5(h#a!5a9[6[6PV[6:(<V@>CZ9S?;*:(9{ <!CDYVCF-@3!:

p[646:(Y @*W*uU:(<!419@>C ;cC ;8uU:(<!419@>C ;W*mIM!2z5>:(;*`:(;8[641Y{_<a!:c@>CZ@>41Q8:W

C a!@E=C Y<!46@>46C Y!5S?:41Y!^t;*:(9=3!:(<hC ;8@3!:S41Y9?!46[646@*P\@>CV:5>@9?![64653

9U=C YY!:=@>46C Yb9@E9[6[$R_2-3!:5>:U;*:5a![6@>5S9;*:S7;*:5>:(Y @>:(<_41Yt^ ;>973 W

46=(9[F;*C Q¥41YVA'^ a;*:cÑ!RcV:cD:(;*:S3!CD:`:(;89?![6:c@>CV;*:=C ;><VC Y!:

<!419[6C^ a!:SD-46@3 ¸ ªR¹ ΃79={:@8[6C5>5(h#D3!46=3t;*:5a![6@>:(<t41Yt9UDC ;><

9==(a;>9=PZCFÅ

¹ R¼ÎSR2-3!465B<!419[6C^ a!:8465I`:(;*PZ<!4Ác=(a![6@B@>CSaY<!:(;W

5>@9Y<c:`:(YSF$C ;-3!aQE9Y!5(R#s;*C Qz@3!:B;*:=C ;><!:(<U5>@9@>465>@>46=5(h'D3!46=3

D:87;*:5>:(Y @41YZ9c797:(;<!:5>=(;*41?!41Y!^S@3!:8G:57C[6:N<!:(Q8CS9[65>CS41Y

@3!:5>:E7;*C =::(<!41Y!^5(hD:B=C Y!=[1a<!:8@39@I9@[6:(95>@F$C ;I79={:@*W[6C5>5

;>9@>46C58?:[6CDÅÎSh'@3!465BY!aQ8?:(;9[6C Y!:E465BY!C@5a Ác=46:(Y @B@>CS7;*:W

<!46=@DC ;>< W:(;>;*C ;I;>9@>:Rs!C ; ¸¹ Ψ79={:@*W[6C5>5(h@3!:I[6C5>5I41YUyH

g

465B5>46^ Y!4A'=(9Y @(h?a!@D:85>@>46[6[C ?!5>:(;*`:8[6:5>58<!:^ ;>9<9@>46C YZ@39YZ;*:W

7C ;*@>:(<\41YTÃÒ(ÄIC Y\5>P!Y @3!:@>46=V<9@9!R

f

Y\7;>9=@>46=(9[Ba!5>:hC Y!:Z465(h

9==C ;><!41Y!^U@>CSC a;:€!7:(;*46:(Y!=:h[641{:[6P_@>CU<!:(9[#D-46@3_79={:@*W[6C5>5

;>9@>46C5-?:[6CDXÅÎSh D3!:(;*:@3!:(;*:465-Y!CB=[6:(9;=C ;>;*:[19@>46C YZ?:@*D::(Y

79={:@*W[6C5>5B9Y<SDC ;>< W:(;>;*C ;;>9@>:R

36 37 38 39 40 41 42

0 1 2 3 4 5 6

Word Error Rate (%)

Packet Loss (%) ITA-US ITA-GER

…-†1‡0ˆ‰(ŠtӍIԒՈ'Š’

 

ŠVž'¡I֓

 ×

Š ¯(Ÿ¿1ž(Bž0’tÀ8ž‰‘t“

   

ˆ‰(“

  ±

ž'¡-¯®'ŠtØSŠ!‰²Z“’b”SŠ!(Ö0ž¿1Š'›S‰(Š

 

ž'‡0’†1Ù Š!‰ ¢

o :(Y!:(;>9[6[6Ph!D:-=C Y!=[1a<!:F;*C QT@3!:5>:-:€!7:(;*41Q8:(Y @>5(h @39@79={:@*W

[6C5>5841Y »a!:(Y!=:58@3!:c7:(;F$C ;>QE9Y!=:cCF-@3!:E5>P 5>@>:(QSh?a!@I@3!:(;*:c465

Y!C8=[6:(9;I9Y<S<;>95>@>46=B41Y »a!:(Y!=:ICF79={:@*W[6C5>5IC Ycv8J

g

7:(;F$C ;W

QE9Y!=:EF$C ;B@3!:E=C Y<!46@>46C Y!58D:cC ?!5>:(;*`:(<_C YVC a;:€!7:(;*41Q8:(Y @>5(R

mCD:`:(;hB?:=(9a!5>:t[6C5>@V79={:@>5Z=(9YX9[65>C\C ==(a;V<a;*41Y!^b@3!:

@;>9Y!5Q8465>5>46C YtCF-5>P!Y @3!:5>46:(<t`C46=:h9Y<Z@3!:EC ;*46^41Y9[-`C46=:S465

9[65>Cc@;>9Y!5Q846@>@>:(<Z?:@*D::(YUvI^:(Y @9Y<Sp[646:(Y @(h'@3!:Ba!5>:(;465I:(95*W

46[6Pc<!465>@a;>?:(<c? PB@3!:=3!41;>7!41Y!^895>5>C =419@>:(<SD-46@3E[6C5>@79={:@>5(R#v

Fa![6[HY< W@>CW*HY<Z:`9[1a9@>46C YtaY<!:(;9[6[@*P!7:5ICF-Y!:@*DC ;>{S=C Y W

<!46@>46C Y!5I3!CD:`:(;-465I?:PC Y<S@3!:B5>=C 7:BCF@3!:B7;*:5>:(Y @>:(<UDC ;>{R

4.2 End-to-End evaluation

f

Y£½:=:(Q8?:(; ¸¹¹ ªhtD:z=C Y<a!=@>:(<£9¨[19;*^:º5>=(9[6:¨Q8a![6@>4W

[641Y!^ a9[U:(Y< W@>CW:(Y<z@;>9Y!5>[19@>46C Yº:`9[1a9@>46C Y³CFZ@3!:yG:57C[6:

A;*5>@*W53!CD=(95>:85>P 5>@>:(QSRBs!C ;-:(9=3ZCF@3!:B@3;*::8[19Y!^ a9^:E7941;*5

eHY!^[64653 Wf@9[6419Yh o :(;>QE9Y Wf@9[6419YT9Y<\s;*:(Y!=3 W f@9[6419YnhF$C a;

aY!5>::(YZ@>:5>@8<!419[6C^ a!:58@39@ID:(;*:cY!C@B7;*:` 46C a!5>[6PV5>::(Yt? PS@3!:

5>P 5>@>:(Q¨<!:`:[6C 7:(;*5D:(;*:Ba!5>:(<c@>C8:`9[1a9@>:B@3!:I7:(;F$C ;>QE9Y!=:ICF

@3!:B@;>9Y!5>[19@>46C YZ5>P 5>@>:(QSR2-3!:8<!419[6C^ a!:5B41Y!=[1a<!:(<Z@*DCE5>=:(Y9;W

46C5(‚C Y!:-=C`:(;*41Y!^ED-41Y @>:(;5{4'`9=(9@>46C Y!5(h@3!:C@3!:(;9?C a!@5aQBW

Q8:(;I;*:5>C ;*@>5(R8LIY!:BC ;-@*DCSCF@3!:E<!419[6C^ a!:5IF$C ;-:(9=3Z[19Y!^ a9^:

=C Y @941Y!:(<ZQ8a![6@>4W*Q8C!<9[:€!7;*:5>5>46C Y!5(RI2-3!:8<!419[6C^ a!:5B41Y!=[1a<!:(<

9_Q846€ @a;*:ZCF8<!419[6C^ a!:5S@39@cD:(;*:U=C[6[6:=(@>:(<XQ8C Y!CW[641Y!^ a9[6[6P

7;*46C ;8@>CZ5>P 5>@>:(Qƒ<!:`:[6C 7Q8:(Y @

e

?C@3_=[646:(Y @S9Y<_9^:(Y @857C {:

@3!:E59Q8:c[19Y!^ a9^:(nh#9Y<V<9@9S=C[6[6:=@>:(<\?!46[641Y!^ a9[6[6P

e

<a;*41Y!^

@3!:Zr a![6P

¸¹¹

ªZuZuÚ:€!7:(;*41Q8:(Y @nhIa!5>41Y!^_@3!:Z9=@a9[@;>9Y!5>[19(W

@>46C YZ5>P 5>@>:(QSR82-3!465BQ846€ @a;*:ECF-<9@9E=C Y<!46@>46C Y!5BD-95I41Y @>:(Y<!:(<

7;*41QE9;*46[6PVF$C ;=C QE7;*:(3!:(Y!5>46`:(Y!:5>5E9Y<VY!C@-F$C ;=C QE79;*465>C YVCF

@3!:c<!4¤:(;*:(Y @B=C Y<!46@>46C Y!5(RS2-3!:E:`9[1a9@>46C YtD-95B=C Y<a!=@>:(<_? P

3!aQE9YE^ ;>9<!:(;*5(h D3!CEQE9Y!a9[6[6Pc5>:^ Q8:(Y @>:(<S@3!:I<!419[6C^ a!:5-41Y @>C

§J :(QE9Y @>46=½419[6C^ a!:IjIY!46@>5>©

e

J!½Ij5n09Y<B@3!:(Y895>5>46^ Y!:(<E5>=C ;*:5

@>C8:`:(;*PUJ!½Ijy7;*:5>:(Y @41Yc@3!:a!@>@>:(;>9Y!=:R2-3!4655>=C ;*41Y!^E5>=3!:(Q8:

465I<!465>=(a!5>5>:(<Z41Y_õ(Ä*R

M09Y!^ a9^: 20;>9Y!5>=(;*41?:(< v8J

g

3 P!7C@3!:5>:5

HY!^[64653 W@>CW

f

@9[6419Y ÅÅÎ ¶ ¼Î

o :(;>QE9Y W@>CW

f

@9[6419Y ¼ ¸ Î ¸

ÑÎ

s;*:(Y!=3 W@>CWf@9[6419Y ¶¶ Î ¼¶ Î

f

@9[6419Y W@>CW*HY!^[64653 ¶ ÑÎ ¼ÑÎ

f

@9[6419Y W@>CWo :(;>QE9Y ¶ ÑÎ ¼!ª(Î

f

@9[6419Y W@>CW*s;*:(Y!=3 ¶ ¹ Î ¸

ÑÎ

­“'°0¿1Šy‹'VÛ8‰(ž(Ÿ¿†$’'‡0ˆ'“'¿B–B’‘Ÿ>¯(ž'Ÿ–B’‘T­-‰(“’(¿1“¯†1ž0’XÜcŠ Ÿ

ˆ¿1¯ºÝÞ …0‰(“

 

¯†1ž0’¨ž'¡bŽ

   

Š!Ö¯(“'°0¿1Š³—ßUàUzÝ*Ԓ¯(Š!‰¿†$’'‡0ˆ'“

àZ’†1¯áâ0áž0’U­-‰(“’

 

‰†°0Š!‘ZԒÖ#ˆ'¯I“’‘VãS±0Ö0ž'¯®'Š!Š!I¡*‰(ž0²

—Ö0Š Š

 

®\ÜcŠ

 

ž'‡0’†1¯†1ž0’#¢

2-3!:;*:5a![6@>5CF@3!:=(;*C5>5*W[641Y!^ a9[:`9[1a9@>46C Yc9;*:5aQEQE9;*46:(<E41Y

@9?![6:SªR-LIa;-;*:5a![6@>5I41Y<!46=(9@>:E@39@?:@*D::(Y

¸

ÑΨ9Y<S¶ ¼ÎºCF

f

Y @>:(;*[641Y!^ a9jIY!46@>5

e

4$R:R0@;>9Y!5>[19@>46C YE=C Y!=:(7!@>505a!=3895I§

g

:|!a!:5>@

@>C_;*:5>:(;*`:tªU;*C C Q£F$C ; ¸ 7:(;*5>C Y!5c9Y<yªSD::({©_C ;Z§HY!|!a!41;*:

<!465>@9Y!=:B?:@*D::(YU3!C@>:['9Y<c?a!5*W5>@>C 7!© n39(`:I?::(Yc@;>9Y!5>[19@>:(<

=C ;>;*:=@>[6PRy3!46[6:B@3!465[6:`:[CF0@;>9Y!5>[19@>46C YS9==(a;>9=Pc=(9YY!C@?:

=C Y!5>41<!:(;*:(<V41QE7;*:5>5>46`:h#C a;a!5>:(;5>@a<!46:5B9Y<U5>P 5>@>:(Q¥<!:(Q8C Y W

5>@;>9@>46C Y!5841Y<!46=(9@>:U@39@B46@8465E9[1;*:(9<!P_5a Ác=46:(Y @8F$C ;89=3!46:` 41Y!^

:¤:=@>46`:E=C QEQ8aY!46=(9@>46C Y_?:@*D::(YZ;*:(9[a!5>:(;*5(h:57:=419[6[1PVD-46@3

@3!:BQ8a![6@>4W*Q8C!<9[#=(979?!46[646@>46:(5BCF@3!:B7;*:5>:(Y @5>P 5>@>:(QSR

5. FURTHER INFORMATION

2-3!:BGIHJ!KLIM0H-N!7;*Cd*:=@IÃÅ(Ä03959[1;*:(9<!Pc[6:(9<U@>CE9EY!aQ8?:(;#CF

7a?![646=(9@>46C Y!5C Y857::=3c;*:=C^ Y!46@>46C YUÃÑ!hª ¹ h!ªÄ'9Y<

f

Y @>:(;*[641Y!^ a9(W

?95>:(<B57::=3 W@>CW57::=3E@;>9Y!5>[19@>46C YSõ!h¼!hÐ(Ä*R02-3!:-GIHJ!KLIM0H-N

<9@9?95>:465<!:5>=(;*41?:(<U41YZø Ä*i!95@3!:5>P 5>@>:(Qº465-=(a;>;*:(Y @>[6PS;*:^ a W

[19;*[6PS<!:(Q8C Y!5>@;>9@>:(<cD:I9;*:5>@>46[6[=C[6[6:=@>4Y!^S<9@9BaY<!:(;#98Y!aQBW

?:(;#CF0<!4¤:(;*:(Y @=C Y<!46@>46C Y!5(RvBYE9==C QE79Y P 41Y!^87C5>@>:(;7;*:5>:(Y W

@9@>46C Y84659[65>CB977:(9;*41Y!^I41Y8@3!:5>:-7;*C =::(<!41Y!^5öÄ*R#2-3!:7;*Cd*:=@

D:(? W5>46@>:8=(9YZ?:F$C aY<U9@ä

/-å>æ æ(+ /!0"(!#">(

R

6. ACKNOWLEDGMENTS

2-3!:8;*:5>:(9;*=3ZDC ;>{S;*:(7C ;*@>:(<Z3!:(;*:BD-955a77C ;*@>:(<U? Pc@3!:8GI9(W

@>46C Y9['J =46:(Y!=:Is!C aY<9@>46C Y8aY<!:(; o ;>9Y @Y!aQ8?:(;0ÐÐÒ

¸¸¸

ÑI9Y<

@3!:SHa;*C 7:(9Y_jIY!46C YtaY<!:(; o ;>9Y @EY!aQ8?:(;

f

J!2ºª(ÐÐÐ(Wªª(ŵ ¸

95c79;*@8CFI@3!:8d*C41Y @cHjI·VGBJ!sXuZM

f

vBu«;*:5>:(9;*=3b41Y!46@>419@>46`:R

vBY P8C 7!41Y!46C Y!5(h AY<!41Y!^59Y<c=C Y!=[1a!5>46C Y!5-C ;;*:=C QEQ8:(Y<9@>46C Y!5

:€!7;*:5>5>:(<U41YS@3!465QE9@>:(;*419[#9;*:B@3!C5>:ICF0@3!:B9a!@3!C ;

e

5n9Y<S<!C

7. ADDITIONAL AUTHORS

MR ´:59=46:(;h m8R ´[19Y!=3!C Yh 9Y< ½8R Ì9a F;*:PW

<9

e

p-M

f

KJ'i

o

;*:(Y!C ?![6:h s;>9Y!=:i :W*QE946[$‚

ç!( !(+!"$è é &!#"$è!!+'

ä

(+ê!0+(ë'0"ì!( í! , !(

)"í!

nh9Y<8MR209<<!:4

e

vBH2-m

g

vEivBY!=C Y9!h

f

@9[6P'i:W*QE946[$‚

" !!

ä

!0"

nR

8. REFERENCES

Ã1ªÄ8MR´:59=46:(;hm8R´[19Y!=3!C Yh!îER!s!C a!|!a!:@(h'rR o a!46[1?9a<h

J'Rm:[1Q8:h0J'RuZ9:(Y!C@(h'½8RuUC ;>9;>ah9Y<U½8R!Ì9a F;*:P!<9R

J!7::=3Z20;>9Y!5>[19@>46C YUF$C ;-s;*:(Y!=3U41YS@3!:8GIHJ!KLIM0H-N

Ha;*C 7:(9YUK;*Cd*:=@(R

f

YUïðñ(òóôõ!ðñö÷øøòùcú!û û ühvB9[1?C ;*^h

½:(YQE9;>{h ¸¹¹ ªR

f

J!pvER

ø

ÄEJ'R´-a;*^:(;hMR´:59=46:(;hK0R'pC[6:@>@>4$hsRuU:@>:h9Y<

pIR'uUC ;*:[$R'2-3!:8GIHJ!KLIM0H-N!ÌC

f

Kb½419[6C^ a!:c½I9@9?95>:R

f

YZïðñ(òóôõ!ðñö÷øøòùcú!û û üh vB9[1?C ;*^h½:(YQE9;>{h ¸¹¹ ªR

fJ!pvER

ü(Ä

g

Rp-9@>@>C Y!4$h'u_Rs!:(<!:(;*46=Ch09Y<cvERM09(` 46:R

g

C ?a!5>@

vBY9[6P 5>465ICFJ!7C {:(Y fY7a!@=C Q8?!41Y!41Y!^ZJ @9@>465>@>46=(9[#9Y<

lBY!CD-[6:(<!^:W*?95>:(<

f

Y F$C ;>QE9@>46C YZJ C a;*=:5(R

f

YUïðñ(òøøýþÿ

ñù!øEú!û û ü>ôôô Zñðùñ÷_ñÿõñþ$òBö÷øøòù

-øòñÿþþñÿÿýÿýøðÿýþÿIötú!û û üh

uZ9<!C YY9E<!4p-9QE7!46^[646Ch f@9[6Ph0ª

¸c¸¹¹ ªR

öÄBvERM09(` 46:h'MR´:59=46:(;hsR'uU:@>:h'sR'K#419Y!:5>4$h9Y<U9[$R

HY39Y!=41Y!^c@3!:Bj59?!46[646@*PZ9Y<UK0:(;F$C ;>QE9Y!=:8CF

GIHJ!KLIM0H-N W-9

g

:(9[WVC ;*[1<tJ!7::=3 W@>CW>J!7::=3

20;>9Y!5>[19@>46C Y_J P 5>@>:(QSR

f

YZïðñ(òó! #"%$\ú!û ûú h!J!9YU½46:^Ch

pvEh¼ ¸¹¹¸ R

ÃÅ(ÄBvERM09(` 46:h'sRK#419Y!:5>4$h09Y<S9[$RvB;*=3!46@>:=@a;*:E9Y<S½:5>46^ Y

pC Y!5>41<!:(;>9@>46C Y!5I41YZGIHJ!KLIM0H-N1‚9cJ!7::=3Z20;>9Y!5>[19@>46C Y

J P 5>@>:(QzF$C ;H0W*pC QEQ8:(;*=:cvB77![646=(9@>46C Y!5(R fYZïðñ(òó#ñù!ø

#"%$#ú!û û ühJ!9YS½46:^ChpvEh ¸¹¹ ªR!vIp-u_R

õ(Ä8MRM:` 41Yh'½8R o 9@>:5(h'sRK#419Y!:5>4$h½8R_9[6[19=:h

2IR_9@9Y9?:h9Y<Uu_R!VC5>=P!Y9!R0H#`9[1a9@>46C YZCF9

K;>9=@>46=(9[

f

Y @>:(;*[641Y!^ a98F$C ;2095{W>LI;*46:(Y @>:(<V½419[6C^ a!:5(R fY

ïðñ(òó&(')$*(+ö,-+."/ Zñðùñ÷)0ÿ>ÿ&$øð1þÿõ&2ÿý

>ÿ&$øð1þÿõ&1÷ ÷'ðñòù!øh!J :(9@>@>[6:hZvEh

¸¹¹¹

RvBuZ2vER

ÃÑ(Ä8sRuU:@>:hrRuU=(½C Y!C a!^ 3h9Y<Um8RJ C[6@9aR'J!7::=3

g :=C^ Y!46@>46C YZC`:(;G:@uU::@>41Y!^UpC YY!:=@>46C Y!5(R f YZïðñ(òó

ôõ!ðñö÷øøòùcú!û û üh vB9[1?C ;*^h½:(YQE9;>{h ¸¹¹ ªR

f

J!pvER

ÃÒ(Ä8´IRuU46[1Y!:(;I9Y<UJ'R'J :(QEY9Y!4$R g C ?a!5>@J!7::=3 g :=C^ Y!46@>46C Y

C`:(;

f

KbG:@*DC ;>{5(R

f

YUïðñ(òó!3%IööïXú!û û üh!J!9[6@IM09{:

p46@*PhjBJ vEh Å ¸¹¹ ªR

ÃÐ(ÄEJ'R

g

C5>59@>Chm8R´[19Y!=3!C Yh9Y<SMR´:59=46:(;R0H#`9[1a9@>46C Y

CF9cJ!7::=3U@>CSJ!7::=3Z20;>9Y!5>[19@>46C YVJ P 5>@>:(QS‚-s;*:(Y!=3

H#€!7:(;*46:(Y!=:E41YU@3!:8GIHJ!KLIM0H-NK;*Cd*:=@(R

f

YUöõ&4Eþ$øý

ñ*5-ïðñ(òó#ü*6ù>ÿ&$øðÿ!þñÿ!1%3ñÿøð>øÿ'òøEñÿ

3ñI÷'õþñÿ!1"0þÿõ!þþ$ò.3-07"%.82,Tú!û ûúh 209417:4$h

20946D-9Yh'Ò ¸¹¹¸ R

Ã1ª

¹

Ä8½8RÌ9a F;*:P!<9hMR´:59=46:(;hpIR'´:(;*^ 9Q841Y!4$h9Y<

g

RM09QBPR's;*C Qº^:(Y!:(;*46=8@>CE@95{WC ;*46:(Y @>:(<Z57::=3

;*:=C^ Y!46@>46C Y‚-s;*:(Y!=3U:€!7:(;*46:(Y!=:E41YU@3!:BGIHJ!KLIM0H-N

Ha;*C 7:(9YZ7;*Cd*:=@(R fYUïðñ(òó%$%( 9 Zñðùñ÷_ñÿ

Iý*÷!þñÿ'Zøùñý%(ñðIö÷øøòù-øòñÿþþñÿ'h!J C 73!419

vBY @>417C[6465(hs;>9Y!=:h ¸¹¹ ªR f2 g

TR