Capacity of Retro-Information Channels

(1)

HAL Id: inria-00072821

https://hal.inria.fr/inria-00072821

Submitted on 24 May 2006

HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub-

L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non,

Capacity of Retro-Information Channels

Philippe Jacquet, Véronique Joly

To cite this version:

Philippe Jacquet, Véronique Joly. Capacity of Retro-Information Channels. [Research Report] RR- 3836, INRIA. 1999. �inria-00072821�

(2)

ISRN INRIA/RR--3836--FR+ENG

a p p o r t

d e r e c h e r c h e

Capacity of retro-information channels

Philippe Jacquet, V´eronique Joly

N ˚ 3836

1999

TH `EME 1

(3)

(4)

) *+-,.+-//$021434576980;:=<;>?A@07BDCE+-6980%1FC,HGI

J$KML

N!O"NPRQ SUTNWVXNY[Z]\^N!_`VXa7VX_

L

N!O"NWV

bced[f

N_g`h bi

Skjmlon

S YDpqp d[c

_srqN

c

N!t K N c t K

Nvuw;x=yxz%Q P|{{={Q }=}p~Y=NWV

U!Dq=;

hu_

Kq

Vp~Y[p4N c

N uNWV_

;Y[_eN

K~d|c

N!_

ced[.

uq

d=c

OUYD_

d

u V'p

d

VV

q

N u

Yu

d

uZu

_eY

c

a"Zqu

=N

c

VN=hup~Y c _

t!Z

Y ck

No

=N'NWVX_

OY[_eN

d

Y=Va7Opq_

d _

t'tY[pY[t

_a

d c

N!_

ced[.

uq

d=c

OUYD_

d

ut

K

Y[uquqN

V

upY c Y

N

4d=cs

u^VN c

NWVW

J$K

N!VN

c

NWVZ

_V Y

c

NoV

[u

¡

tY[u_

ar

=N

c

N!u_¢

ced

O£t

Y=VXV

tWY

~

u

d=c

OY[_

d

u_

K N d=c

a c NWVZ

_V$YDu~r

d

pFN!u

u_eN

c

N!VX_

u~

p4N

c

VXpFNWt_

NWV!

¤¦¥;§4¨X©ª D«9= ¬

ZY[u_XZqO p K

a7V

t!VWRZqu

_®Y c

_a=

c

N!_

cd[

uq

d=c

OUY[_

d

u

i¢b

S¯VXp

u

VXa7VX_N!O"VW~

d=c

Y c rt

d

Zqp

u~°Zquqt!_

d

u~V!qt

K

Y[uquqN

tY[p~Y=t

_a

±³²´

µ·¶¸|¹

´

µº9»¼¶½-¾¿

ÀÁFÂkÃÅÄÇÆÈ]ÉÊ;ËÌDËXÉÉDÍÏÎHÐWÑDÒÅÓ!ÔDÍÕ×ÖDËØÙ=Ë®ÑÎÛÚWÙ

Ü

ÁFÂkÃÅÄÇÆÈ~ÐÝ|ÌÞ×ÖWÝØDÍWÙ|ÑÎÛÚÙ

Unit´e de recherche INRIA Rocquencourt

(5)

¥ ¥

YDu~VmtWNp~Y[p

N c

7u

d

Z~VmNÅ\qYDO

u d

u~Vkt

d

OONu7_

Y c TN!_

cd[

uq

d=c

OUY[_

d

uN!VX_

c

N!uqrZ~Np

d

VV

q

Nr~YDu~VrqN!VZqu

N

c

Vu d u Zqu

_eY

c

N=

i u pY

c _

tZ

N c u d ZqVr

d

uqu

d

u~V

rqNWVRN!VX_

OY[_

d

u~V`rqNWV'tWY[pY=t

_]TN!V'Y=Va7Opq_

d _

ZqNWVRrqN!VRtYDuY[Z\¦rqN c TN_

cd[

uq

d=c

OY[_

d

u

N!u pY c Y

L

N N d

Z^N!u^V7TN c

N= NWV

c TN!VXZ

_®Y[_Vkp

c TN!VN!u_N!u_rNWVsr

=N

c

N!u~t!NWV`V

=u

¡

tY[_

N!V

pY c`c

Y[pqp d=c

_'Y[Z\

c TNWVXZ

_®YD_eVt

Y=VXV

ZqNWVRrqNo_

K TN d=c

N rN

uq

d[c

OY[_

d

u N!_

dFc

N!u_RrNWV

p4N

c

VXpFNWt_

NWV

u_]TN c

N!VVY[u_eNWV!

ª × ¨ ¥ bK

a7V

Z~N

ZY[u_

Z~N=Zqu

_®Y cX

_]TN[

c TN_

cedD

u

d=c

OY[_

d

u 9VXa7VX_

L

N!O"NWVrqN

VXp

u ib

Sq

d

u~t!_

d

uqV`rNot

d

Zqp

Y=NY[Y[u~tÏTN=~tYDpY=t

_]TN'rqN!V tWY[uY[Z]\

(6)

) *

U %mW

+d[c

O

d[c

NR_

K

Y[u

¡

°_aUaNWY

c

Vs_

K

N'O

d

VX_mp ced

O u~Nu_

c

N!VNY

c t K N c V u p K

a]V

t!V

K

Y=N

d]d[

,

NWr

u [Y

u

d[c

Yt

d

u~V

VX_N!u_ _ K N

d[c

aU_

K

Y[_

$d

Z rZqu

°aU_

K

N

d[c

tWN!V

d

9_

K

N'Zqu

N

c

VN

- c

Y|

_®Y[_

d

u =N

N!t!_

ced

OY==u~N_

VXO

/.

1032

3 ' 4

_ K N d[c

a65798

V_

K N

Y=V_¢Y[__N!Opq_

_ d

r~Y[_N=4_

Kq

V -

N c a . t d

Op

tYD_eNWr_

K N d=c

a

K~d|

NN

c

u~N!NWrqV'_

dU

NNO

N!rqrqN!r

uY[u

Zqu

=N

c

VN

m

_ K Y[_

NWY=VX_ }[zr

ONu~V

d

u~Vk_

d

OY

,

N'Zqu

¡

tWY[_

d

u ;:`ZqO"N cX

tWY

NWV_

OY[_N

Y=VN!r

d u VXZqpFN

c

VX_

cX

u~_

K N d=c

a NY=rqVo_

d c

Y

_eY[_

d

uY

t d

u~V_®Y[u_eV"P=<>?A@

c

NYD_eN c d

mK

Y[_

V d=

VN

c

N!r

J$K

N

Z~NWV_

d=c

Zqu

¡

tWY[_

d

u

m

VXZ

c N a t d

u_

uZ~N2Y=;Y

u d=c

VN!=N c Y

aNWY

c

V!

Zq_ OUY[uap

K

a7V

V_eVVZqpqp d=c

__

K

NY=VVXN c _

d

u _ K Y[_ VXZ~t

K

Zqu

¡

tWY[_

d

u

OUYa V

O"p

au

d

_N\

VX_CB`uqrqN c _

Kq

VpFN

c

Vp4N!t!_

N"_

K

Nu d u Zqu

¡

N!r O d

rqN

d

kZqu

¼

N

c

VN

$d

Z

r¦Va7VX_eNOUYD_

tWY

ap

c

NWVXN!u_RVa7OO"N!_

c

a

d=

Y[_

d

u~VW;Y[Z~NNÅ\t!N!pq_

d

u%Y[u~r

u pY c _

tZ

Y c

Zqu

_®Y cX

_a"

d=

YD_

d

u~Vp cd=

Y

aYD_

-

N c a . V

K~d=c

_`VtY

N=

D

Np

c

NWVNu_o_

K

Np cd

p4N c _

NWV d

uq

d=c

OUY[_

d

u^_

c

Y[u~VÛN c V

Y=VN!r

d

u%_

K

NZqu

_®Y cX

_a

d=

YD_

d

u~V

uo_

K

Nu d u

Zqu

¡

Y

q

NZqu

=N

c

VNO

d

rqN

D N

m

V

K~d|

_ K Y[_ VXZ~t

K _ c

YDu~VXÛN c V

OUYa

d

t!t!Z c

Y=t

, Y c r

u _

O"NY[u~r_

K N c

N

d=c

NOUYao

=N cX

VN¢_

d

u~NWr

_9t d O

uY[_

d

uqV

u

uq

d=c

OUY[_

d

u_

K N d[c

a

D

Nt d[

u K N c N _

K

No_eN c O

"

_ d rqNu

d

_N

u

d=c

OY[_

d

u_

c

Y[u~VÛN c$

Y=t

, Y c r

u_

ON

-

YD_V K~d=c

_kVtWY

N .

j

d

u7=N

c

VN

a

NtWY[uUp cd

N

_ K Y[_

c

N_

cd[

uq

d=c

OY[_

d

u O"p

N!VRZqu

_eY c

_a

d=

Y[_

d

u FE

u~t!N

c

N!_

cd[

uq

d=c

OUY[_

d

u V

Y=VN!r

d u

ZY[u_XZqO _ K N d=c

a

c

d=ced

ZqVYD\

d

OY[_

t=Y

pY

c

Y=r d \

tWY

N

N!t!_eVtYDu

N

p c N!t

VXN

a^Y[uY

a]VXNWrhu¦pY c _

t!Z

Y c

Y[u

u_eN

c

N!VX_

u~t d O

uY[_

d

u d tWtZ

c V

mK

N c No_

K N

c

N!_

ced[.

uq

d[c

OY[_

d

u t K Y[uquqN

VVZ

O

__NWr _ d Y d=c

Y c r t d Zqp

uq2°Zqu~t_

d

uHG IJI

mK

N!uU_

K N c

NWVZ

_ d

_

K

N _

c

Y[u~VO

VV

d

u

VOUY[rqNY[Y

Y

q

Nk_

d _ K

Ns_

c

Y[u~VXO

_X_eN

cLK M

_ K No_

c

YDu~VXO

VXV

d

u d tWt!Z

c

VW hu%_

Kq

V`=N

c

atY[VN_

K

NtWY[pY=t

_a

d

_

K

Nt

K

Y[uu~N

tY[u

N

c NWY[_

a

Op cd

=NWr

ced

O

_VmNWV_

OY[_N

u^t

Y=VV

tY

E K

Y[uu

d

u^_

K N d=c

aN5}8-

J$K

N p~Y[p4N c

V

d[c

;Y[u

PO

N!r Y=VU

d= d|

QE]NWt_

d

u }

VrqN!

d

_eN!r _ d Y V

K~d=c

_ VXZ c

N!a

d

`_

K

N^p

K

a7V

tY

s

Y[t ,

ced

Zquqr

mKq

t K Y

d|

V_

d

OUY

,

NZqu

_®Y cX

_a

d=

Y[_

d

u u

t

d=cXc

NWVp

d

u~rqN!uqtWN

m

_ K c N!_

ced[.

uq

d[c

OY[_

d

u _ c YDu~VXÛN

c

VW2hu pY

c _

tZ

Y c

NUp ced

NU_

K N

°Zqu~r~Y[O"N!u_eY

c

N!VXZ

_ _

K

Y[_

c

N_

cedD

u

d=c

OY[_

d

u V`N

Z

[Y

N!u_ _

d

Zu

_eY c

_aU

d=

Y[_

d

u

E]NWt_

d

uxrqNWVXt c

N!VmY[u

K

ap d _ K

N!_

tY

u d u

Zqu

_®Y c a

ib

S Vp

uVXa7VX_N!O

mKq

t K t d Z r

Y=t!_

,

N¢Y

c

N!_

cd[

uq

d=c

OUY[_

d

u

q

uY

c

a't

K

YDuqu~N

d

uY cq

_ c Y c

aRVpY=t!N

_

O"N¢=NWt_

d=c

RE]N!t

_

d

uS7Y=rqr

c

NWVVXNWV

u rN!_®Y

V_

K N c

NWVXZ

_eVsY

4d

Z_

c

N_

cedD

u

d=c

OY[_

d

u"t

K

Y[uqu~N

V

u_

$d

tY=VXNWVJG

mK

Nu_

K

Nt

K

Y[uqu~N

V Y

c N u pY c Y

N Y[uqr

mK

Nu_

K

N!a^Y

c N u VXN c

NWV!

(7)

7 2 2

%!4 ^W&W W%( !"

!#"$%!&(')&+*,.-0/1'32+!45'3-%67+8:9<;(')8=-%;4 -?>(@!/

A t

Y=VXV

tWY

p K

a7V

tWY

NÅ\7p4N c

O"N!u_$t

d

u~V

V_eV_

d

O"NY=VZ

c

N`_

K

N t d7d=c

r uY[_NWV

-B@CEDCGF

. d

pY

c _ t N

OpY=t_

d u Y¦Vt

c

N!N!u

d

tYD_eNWr Y[_ r

V_®Y[u~t!N F

cd

O Y¦V

d Z c

t!N

d

mpY c _ t

NWVW

n

d=c

NNu~N c Y

a7_

d t K Y c

Y[t!_eN cO

NoYONWY=VXZ

c

N!O"N!u_

d

Yp

K

a7V

tY

N

N!t!_W

d

u~N'u~NWN!rqV

Pm_

K

N'O"NY=VZ

c

NONu_VXN!__

u~~N=q¢_

K

Nor

V_®Y[u~t!N F d

9_

K

NoVt

c

NWNu¦_

d _ K

N V d Z c

tWN

HJI

}]m_

K

NoONWY=VXZ

c

N!O"N!u_R[Y

Z~N d=

_®Y

u~N!r¦Zqu~rqN c _

K

VVXN!_X_

uqq4N[q`_

K

Nt d7d=c

r uY[_N

-B@CEDCGF

. d

9_

K

N'pY

c _ t N

O"pY[t!_

d

u^_

K

NoVXt

c

NWN!u

MN_K

N Y VN_

d

FONWY=VXZ

c

N!O"N!u_=Y

Z~N!V

d

Yop

K

a7V

tY

N

NWt_$ZquqrqN

c

Y

N!uVN__

u~

-

d=c

NÅ\Y[O"p

NmY'VN_

d

Ï_Zqp

N

-B@CDLCGF

.

Zqu~rqN c _ K

NsVeYDON

F

[Y

ZqN

. N!_)M

Nk_

K N

YN

°Zqu~t!_

d

u d

_

K

Nkp

K

a7V

tY

N

NWt!_rN

¡

u~N!r

d

u_

K

N$O"NY[VXZ

c

N!O"N!u_VN_

-

d=c

NÅ\Y[O"p

N_

K N

YN°Zqu~t_

d

u d

]_

K

NpY c _ t

NrqN

¡

u~N!r d u

-B@CDLCGF

. t

d7d=c

r uY[_NWV

. N_ON

N¢YmVXZ

VXN!_

d

ONWY=VXZ

c

N!O"N!u_[Y

Z~N!V

d

_

K

NVY

rp

K

a7V

tY

N

N!t!_

-

d[c

N\Y[Op

N_

K

NVN_eV

d

$Y

t

d7d=c

r uY[_NWV

-PB@CEDLCEF

.

VXZqt K _ K

Y[_

BRQ

<

u d _ K N c$d=c

rqVONWY=VXZ

c

N!O"N!u_

d u cX

K _ K Y

Vt

c

NWNu~V

.

9

d=c

NÅ\Y[O"p

NVN!N

¡

=Z

c N Ph_

V't

Y=VV

tY

u

ZY[u_XZqO¯_

K N d=c

a¦_

K

Y[_'_

K N

t d u~r

_

d

uY

p ced=

Y

q

_aRS

-

NJTUK . _ K

Y[_o_

K

NONWY=VXZ

c

NWr[Y

Z~N

N

d

u~V'_

d

N9

=N!u

_ K Y[_

_ N

d

uqVk_

d K

Vm

=N!u

a G

S - NJTVK

.3WYX[Z\^]

M_a`bM

Xc]

M _

`bM d - P .

¬

ZYDu7_

_aM_"rqNu

d

_eN!V_

K

N¦t d u f

Z~;Y[_N[Y

Z~N

d

M hu N

ZY[_

d

u P=

ZY[u_

_a

Me`RMf_kp

Ya]Vm_

K N ced=

N d

Yp cd=

Y

_arN!u~V

_a

. gh8i-')?.-0/j$?+8(6@+$*+

D

NVYa¦_

K

Y[_R_

K

NONWY=VXZ

c

N!O"N!u_'VXN!_kK

V'YZqu

N

c

VXNt ced

VV'VN!t!_

d

u%

d=c

Yp

K

a]V

tWY

N NWt!_

mK

N!u

_¢t

d

u_eY

u~VY

p d VXV

q

NsONWY=VXZ

c

N!O"N!u_¢[Y

Z~N!V¢

d[c

_

Kq

Vp

K

a7V

tWY

N

NWt!_W

+d[c

N\Y[Op

N

u_

K

NkVXt

c

N!N!u

OpY=t_9O"NY=VZ

c

NONu_lK%tY[u

Nk_

K

N$VN!_¢Y

t

d7d=c

r uY[_N

-B@CEDCGF

. mKq

t K V K Y c

NoVY[O"NR=Y

Z~NR

d=c F t

d7d=c

r uYD_eN=

J$K

N c N VkZqu

_eY c

_a

mK

Nu_

K N

(8)

N K K

+9

=Z

c

NP Gj

d

uqr

_

d

uY

p cd=

Y

q

_ N!V

u

Z~Y[u_ZqO p K a7V

tWV

u_eN!

c Y X

M_ ` M V

u[Y c

Y[u_

mK

N!u _ K

N^VXN!_JK =Y c

N!V -

d=c

NÅ\Y[O"p

N

mK

Nu _ K N

Vt

c

NWNup d V _

d

u[Y c

NWV

.

n d=c

N`p

c

NWt

VXN

a=

@K

>

Y[uqr K ? Y c N Zqu

N

c

VXNRt cd

VVVNWt_

d

u~V

-

VN!N

¡

=Z

c

N}

.

4_

K

N!u%_

K

N d|Ad

_

K

NV

ZY

c

NWr

Y=N°Zu~t!_

d

u M _ ` M _

Kqced

Z~

K K >

Vk_

K

NoVY[O"NY=Vm_

Kqcd

Z~

K K ?

>®

] M _

`RM

W

] M _

`RM

d - } .

huN

ZYD_

d

u%}

Z~Y[u_

_a M _ `RM p

Ya7V`_

K N cd=

N d

Yp ced=

Y

q

_aUtZ cc

N!u__

Kqced

Z~

K

apFN

c

VXZ

c

HY=tWN!V K >

Y[u~r K ? JMd

V O"p

°a"_

K

N p

c

N!VN!u_eY[_

d

u NtWY

3 ' ' %"

5P[8

d

oY VN_ KksY[u~r

N%rqN!u

d

_eN

a

- K . _ K N

ZY[u_

_a

X[]

M ` M_

J$K

NZqu

_®Y cX

_a

p

c

u~t

p N

V _ K N c

N!

d=c

NN Z

=Y

N!u_R_

d _ K

NpFN c V

VX_eNu~tWNt

d

u~VN

c

[Y[_

d

u d

N

c

Zqu

N

c

VN

t

ced

VVVN!t!_

d

u~V!

J$K

Nt

d

uqVN

Z~Nu~tWN

d

Zqu

_®Y cX

_a^p c

u~t

p N

VR_

K

Y[_R_

K

Np ced=

Y

q

_a

_ K Y[__

K

Np~Y c _ t N

Kq

_kK YD_Y tWN

c

_eY

u2

=N!u2VXZ

VN!_ N

u7K r d

NWVu

d

_orqN!pFN!uqr d u

_ K N d

=N c Y

V K YDp4N

d K d

Zq_V

rN_

K

N¦VXp

d

_W Bsu

_eY c

_a

VN!u~N c Y

a Y=VXVXZqO"NWr _ d

ÄVÆÃ-ÄÄ DÃ V ×ÂÂDÃ V|Ä !®Ã V#"%$'& ]Ã)(×Ã*HÄ·Æ+-, Ä+.(×Ä(V./0#12 DÃ*"3,Ã4*5$6 V78HÄ+&[V

#2/V9:2;& |Æ+"=<>oÃ@?*AB9 &9!DCBE À F.EHGICJEDF.EÀ!0(×Ã9-Ä+ÆKL, Ä2I2(|Ä(VM&*$N|ÄO ; V; K"Â&9

"×ÄÇÂ V7HÄ+&[V# Ã[V#"P V7& Q(#&;"#7802(×Ã* 8AJHÄÂ.K

(9)

z 2 2

K >

K ? J$

ON

EpY=tWN

+9

[Z

c

N}G bcd=

Y

_at

d

u~VXN

c

[Y[_

d

u u

ZYDu7_XZqO p K a7V

tWV

K~d=

r u O d

V_p

K

a7V

tY

O"NY[VXZ

c

N!O"N!u_

J$K

NZqu

_eY c

_a p c

u~t

p N K~d=

rqVUY[VUV d7d

u

_ K Nr

N

c

N!uqtWN d _ K

N'p cd=

Y

q

_atZ cc

N!u_~Va7O

4d= PO

NWr

a Me`bM_

V O N cd

NN c a

mK

N c N=

hM_

K

N Zqu

_®Y c

_ap cX

u~t

p N N c

NR_

d

N

d[

Y[_NWr;_

K

N!u_

K

Np ced[

Y

q

_a S - N TUK .

mKq

t

K

VsN

ZY

_ d - N .

- K .

$d

Z r [Y c a

m

_ K _ K NoV

K

YDp4N

d

)Kk$hu d _ K N

c`$d=c

rqV

Y[u

uq

d=c

OUYD_

d

uU_

c

Y[u~VXÛN cs$d

Z r d t!t!Z

cs

N!_

NWNu K Y[uqr N G

S - NJTUK

>

.W S -

NJTVK

? . d - x .

e -%%! +8(" !f?4 '3-%+!8 !8j;8.-%')?.-0/ a+!*+'3-%!f8

D N

m

p

cd

N

uU_

Kq

V$VXNWt!_

d

u_

K

Y[_Zqu

_®Y cX

_a

d=

Y[_

d

u Op

NWV

c

N_

cd[

uq

d=c

OY[_

d

u

Y[u~r

" 'J

D N

d

t!Z~V

d

u%_

K

Np

K

a7V

tY

N

N!t!_

mKq

t

K

V_

K

NONWY=VXZ

c

N!O"N!u_

d

Yp~Y c _ t

N p

c

NWVXN!u~t!N

u2t d]d[c

r uY[_eN

-B@CEDCGFC

.

uVXpY[tWN_

ON[

J$K

N K ap4N

cX

VXZ

c

HY=tWN

OUY=rN

d

p d=

u_eV

-B@CEDCGFC .

mKq

t

KK

YN VeY[O"N [Y

Z~N

V YZqu

N

c

VNt ced

VVRVXNWt!_

d

u

Zq_sY Zu

=N

c

VXN't cd

VVkVXNWt_

d

u tY[u

K

Y=NRO d=c

NNu~N c Y V K

Y[pFN=hupY c _

t!Z

Y c¢

_ktWY[u