Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis

(1)

HAL Id: inria-00070768

https://hal.inria.fr/inria-00070768

Submitted on 19 May 2006

HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis

Fabrice Rossi, Brieuc Conan-Guez

To cite this version:

Fabrice Rossi, Brieuc Conan-Guez. Functional Multi-Layer Perceptron: a Nonlinear Tool for Func-

tional Data Analysis. [Research Report] RR-5228, INRIA. 2004, pp.35. �inria-00070768�

(2)

ISSN 0249-6399 ISRN INRIA/RR--5228--FR+ENG

a p p o r t

d e r e c h e r c h e

Thème COG

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE

Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis

Fabrice Rossi — Brieuc Conan-Guez

N° 5228

Juin 2004

(3)

(4)

Unité de recherche INRIA Rocquencourt

Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France)

Téléphone : +33 1 39 63 55 11 — Télécopie : +33 1 39 63 53 30

2 3546798:;.<= <

>2?A@CBEDGFIHKJLAMNMND

∗†

^O2P BNDGHIQCFSRTLVUW?XUY3ZKQCH\[

‡

]^`_3acbd+e7fhgjilknmpoq_EacbEmsr3tvuvwxyoxyz{m

|2}t~bom++lpi

`Atv}qoslb,}qbNr^`b3}r^`b'wACIvvg I`xwKvvvg\XuvbNm

E31`vv ]^`xmXAb3}xm#wxac`}t1vbN.vbE}mqxtIw.tz2 I¡E¢£xw¤+^`xr^¥¤#b¦mpoqXlk.woq`}§XbnoqbEwmqxtIw

tvz¨K§yoxy©«ª=¬kIb3}|Cb3}rb3`oq}tvwm7{¨Sª®|°¯#otcz±`wroqxtvwv§£xw`lomE²2³b7mq^`t1¤"oq^o+z±`w`vaTbEw\o§=}qbNmp`§om

z±tI}¦r3§Imqmqxr3§¨´ª®|µr3wS¶XbTbnoqbEwlbNKoqtz±`wroqxtvwv§¨´ª=|C²A³bTtv¶loxw´`w`xvbE}m§``}t¬lxa.oqxtvw

}bEmq`§omo^1omq^`t1¤0o^`b+bl`}bEmmpxvb#At1¤°bE}tvzXz±wr;oxtIw§¨Sª®|&xmWr3tvacv}v¶`§b°oqt¦o^1o2tvzAwn`acb3}xr3§

¨Sª®|C²n³b¦tv¶loxwrtIwmqxmpoqbEwrkc}bEmq`§yom¤+^xr^xac`§kcoq^oo^`b·bNmoxa.oqxtvwtvz®tvloxa.v§AX}acbob3}m

z±tI}Wz±`wroqxtvwv§X¨´ª=|0xmmo1oqxmpoqxr3§§k¤#b3§§lb¸Xw`bE£²C³b+¸wv§§kcmp^`t1¤¹tvw¥mqxaº`§1oqbNcwT}bE§¤°tI}q§

1oºo^1o+o^`b,`}tvAtImqbE¥actllbE§®XbE}pz±tI}qa.mxwcIb3}k¥mqoqxmz{Ir;otv}k.¤#¬kI²

»K¼\½V¾¿À 1Áv w`bE`}§w`bo¤#tv}Âlm3ÃXa`§oqx©G§¬kvbE}Ab3}rbEloq}tvw®ÃAz±tIwr;oxtIw§C`1ovw§klmpxm3ÃA`w`xvbE}m§

v``}t¬lxa.1oxtIw®ÃnrtvwXmpxmob3wr3kvÃlw`tIw`§xw`bN}+}b3uI}qbNmqmqxtIw®Ãnr`}vbNm#r3§Imqmqx¸Xr3oqxtvw®ÃlmqXbNr;oq}tvacb3oq}xr7`o

∗

Ä®ÅXÆÅXÇ7ÈCÉCÅ®Ê¬ËÇ,Æ´Ä£ÌÆÍ¦ÎÏ;ÐÑ¬ÊË=Ò¬ÓÔÕÖØ×ØÓÙGÚ2Û`ÜÖ{Ó ×ØÝßÞßàÉCÜá¬â¬ãNÓ Ò¬Õ

†

^ä Üå¬ÖØÓ æÕ;çÆ®è;×G×GÓyéÓ ÒNÖØÓêÜNçëÖ

‡

^ì ÖØÓ Õá¬æ;çÄVè;Ò1ÜÒNÝ{íáNÕpîqéÓ Ò¬Ö{ÓêÜNçëÖ

(5)

. 3 + $!c<++< /12 3++<

d°bK}XtI}pocbEmpo¥`w`bKIb3}mpxtvw a3§xtI}EbKlb0\¡E¢·`vwmc§b\`b3§w`tvm3oq`xtIwm.`w`b

b3noqb3wXmpxtvw¥wX1oq}qbE§§b¦`|Cb3}rbEloq}tvw¨´`§yoxy©pd°tvXr^`bEm¦±|¨d¯lbNm°bEw\oq}3bEmz±tvwXr;oqxtvww`b3§§bNm3²tvm

actIwIo}qtIwm\`bW§bEm=}Nmp`§oom®z±tvw`vacb3w\ovl·b3nxmpow\om£XtI`}=§b2|¨dSr3§ImqmqxIbWXbE`vbEwIooq}bWo}vwm©

AtImEm°¥rEvm2l|¨dz±tvwXr;oqxtvww`b3§G²stvXm2tv¶`oqb3wtvwm°lbEm}Nmp`§oom2 v``}t¬nxa.1oxtIwTw`xIb3}mpbE§§bvÃ

\`xactvw\o}qbEwIo\`b§bEmTr3vvr3xyoEmT! ``}t¬lxa.oqxtvw5l |¨d z±tIwr;oxtIw`w`bE§mqtvw\ocrtvacv}v¶`§bEm"

r3b3§§bNmcl |¨d r§vmmpx\`bv²#stvXmºtI¶loqbEw`tvwXm.lbEmc}Emq`§o1omclbKrtvwXmpxmowr3bvÃ$Ix+aTtIw\oq}b3w\o\`b

§% bEmpoqxacoqxtvw lbEmcv}vac_oq}bEmºtv`oqxacvll |¨d z±tvwroqxtvw`w`bE§+bEmpocmpooqxmox&\`bEacb3w\o.¶`xbEw '¸`©

wxbI²(wl¸w®Ãlw`tIm)oqXlxtIwm°§b7rtIaTAtv}qoqbEacb3w\o#l|¨d¹z±tIwr;oxtIw`w`b3§£mq`}lbEm#ltvww'3bNm°mqxaº`§&3bEm°bo

}3bE§§bEmE²

* À N ¾ + }NmpbNl`bwb3`}tvw`bNm3Ã°XbE}r3b3lo}qtIw¹aº`§oqx©r3tvr^`bNm3Ã#wv§klmqb`b `tvw`w'EbEmTz±tIwr;©

oxtIw`w`bE§§bEmEÃl``}t¬lxa.oqxtvwc`w`xvbE}mqb3§§bIÃ\r3tvwmqxmowr3bvÃ\}Euv}bEmmpxtvwcw`tIwl©G§xw'Evx}bvÃ\lxmr}xaTxwoqxtvwlb

r3tv`}¶AbEmEÃ`ltvw`w,3bEm+mqAbEr;o}qtIaoq}xIbEm

(6)

+<

E À ÁÀ

À

'+ * +±¾ ½X¼ ¼ 1 ¼ 3 À

`²! #"`wroqxtvwv§=`1o5²,²,²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²

`²$"`wroqxtvwv§®w`b3}qtIwm5²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²

`² "`wroqxtvwv§=¨´ª®| ²,²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,² %

&(')

+* ¼ 1E,+# , À.- 5lÀ /

²! #0·b¸Xw`xyoxtIwmsvww`to1oqxtvwXm ²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,² ¡

²! I²! "``wroqxtvwv§®mpXvrbNm+wacbo}qxr3m7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,² ¡

²! I² e·w`b7^`xlb3w §¬kvb3}Ab3}rbEloq}tvwm ²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,² ¡

²$1w`xvb3}m§£`}qt¬lxacoqxtvw¤+xyo^z±wr;oxtIw§=¨Sª®| ²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²

² 0·xmqr3mqmqxtvwµ²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²

2 À

{E

¼

½À43

5

À

'+

*6 +¼

l

7 8

X²! «w\o}qtllroqxtvw´²,²7²,²,²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,² 9

X² |}qtI¶¶`x§xmpoqxr·z±}vaTbE¤°tI}qÂ²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,² 9

X²`²! "``wroqxtvwv§®`1oK²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,² 9

X²`² |Cv}vacboq}xractllb3§²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: N

X²`² e·loqxa.§£actllb3§=vwrtvwXmpxmob3wr3k"²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: ;

X²`² "``wroqxtvw tv¶XmpbE}q11oxtIwm ²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: ¬

X² d°tIwmqxmpoqbEwrk ²,²7²,²,²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: N

+± ¼

l5+* ¼ ¼ < À Á 3GÀ 3

v5À

'+

E

.&

`²! #"`wroqxtvwm+tI¶mqb3}vbE1o+xlb3w\oqxr3v§®AtvxwIom ²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: N

`²$"`wroqxtvw }qbE`}bEmqb3w\ooqxtvw ²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: E

=(> -?¼ @ ¼ E .=

%²! «w\o}qtllroqxtvw wb3nAb3}xaTbEw\o§®mqboqoqxw`u ²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: %

%²$A#}b3xa.w¤#¬IbEm ²,²,²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: 1¡

%²`²! d°§Imqmqxy¸Ar31oxtIw}bEmq`§om ²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: 1¡

%²`² |Cv}vacboqbE}w\a¶Ab3}m ²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: N

%²`² |2}qb3©mqactntoq^xw`u ²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²: 9

%²`² d°tvacacb3w\om²,²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²6v

%² ilXbNr;oq}tvacb3oq}xr7`o'²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²6B

%²²! s¬¤ `o ²,²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²6B

%²² inbEr3tvwtv}lb3}+lbE}qx11oxIbEm²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²6I

%²² d°tvacacb3w\om²,²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²6v

%² d°tIwr§mqxtIwm ²,²7²,²,²7²,²7²,²7²,²,²¦²,²7²,²7²,²,²7²,²7²,²¦²,²7²,²,²7²,²7²,²7²,²,²¦²,²6v

/C2 À +5À B

7 À®À43

(7)

º=C

"`wroqxtvwv§B0·o7swv§klmqxm"0Ãvmqb3b7 %¬¢lz±tI}C7r3tvac`}b3^`bEwmpxvb°xw\o}qtllroqxtvwºoqt " 0s acboq^tnm¯

xm¥vw b3noqb3wXmpxtvw tz7o}IlxyoxtIw§s1o0vw§klmpxmToqt5z±`wr;oxtIw§·`1o`²"«w o^`xm.z±}acb3¤#tv}ÂVÃbEIr^

xwlxnx`§®xmsr^v}Ir;ob3}xEbE.¶nktIw`b7tv}+actv}b7}qbN§£1§`bNz±wr;oxtIwm3ÃX}oq^`bE}#oq^vw¶nkºIbEroqtv}+tvz

R ⁿ

²sw´xaTAtv}qovw\osz±bEoq`}btz " 0s xmxyom¶x§xyokoqtovÂvb,xwIotvrErtI`w\o·lb3Ab3wXlb3wr3xbNms¶Abo¤#b3bEw wn`acbE}qxr3v§acbEImp`}b3acbEwIomCoq^X1o#`bEmr}x¶Ab·vw¥xwXlxnxlv§ØÃ\bEmqXbNrx§§kcmqaTtntvoq^`w`bNmqmE²z=¤°b}qbE`}qbNmpbEw\o

z±tI}·xwmpovwrbºoq^`b.mqxEbºtvz°r^`x§So7`xVb3}b3w\o,uvbNm¶nk´vbNr;oqtI}EÃAo}IlxyoxtIw§acbo^`tl`m7uvbEw`b3}§§k

r3tvwmqxlb3}7bEIr^S1§`bºoqt ¶AbTxwlbEXbEwlbEwIotvzo^`bctoq^b3}m3²º«w " 0sÃ£oq^`b.mqxEbcxm7}b3`}bEmqb3w\obE´Im¦

z±wr;oxtIw&{xw uIb3w`bE}v§VT}b3uI`§v}tvw`b¬¯2o^1osa.vmacbEvmq`}b3acb3w\ooqxacbEmot.rb3w\oxacbob3}m3²

«w5tI}`b3}otlbN§°¤+xyo^x}q}b3uI`§v},acbEvmq`}b3acb3w\omwX&oqt§§t1¤ wn`acb3}xrE§a.vw`x`§oqxtvw5tvz

z±wr;oxtIwm3Ã,"0 }qbE`§IrbNm¦Ir;o§Ctv¶XmpbE}q11oxtIwm·¶\kmqxaT§bTz±`wroqxtvwv§W}qbE`}bEmqb3w\ooqxtvw®²cin`§xw`b

¶XvmqbET``}t¬lxa.oqxtvwxmCo^`b+actImpoWr3tvacactvw`§kXmpbNacbo^`tl£ÃnvmCxo2}qbE`}qbNmpbEw\ombEIr^ºxwlxnxlX§`¶nk

mpactnto^´z±`wXr;oqxtvw=²7b3}w`b3§tv}¦¤#¬Ib3§bo¦¶vmqbE´v``}t¬lxa.1oxtIwmv}qbT§mptmqbE£² " 0s ^vm¦¶Ab3bEw

mqrErbEmmpz±`§§kv``§xbNot¦}bEv§l`}tv¶`§b3a.mCmpXr^TImWr§xa.1oxr#1}x1oqxtvwz±tv}bErEvmpoqxw`uTp%¢ß¯ÃIIrxlxy¸Ar31oxtIw

}qtlrbNmqm#mpoqlknxw`u ¢±¯;Ã`wX§knmqxmtvzr^`x§l}b3wmpx3b¦b3Itv§loqxtvw %¬¢±¯;Ãl§wmuIb`}bElxr;oxtIw¶ImpbN

tIwm1ob3§§xoqb7xa.uvbNm,1¢±¯;Ã`b3orv²

«woq^`xm7vXbE}EÃ®¤#bºz±tnr3m7tvw`}qbNrxmpbTkvb3o¦Ib3}kKuvbEw`b3}§oImpÂ¦¤°bcvmmpaTbºoq^X1o,¤°bctI¶mpbE}qIb

z±wr;oxtIwmImqmqtlrx1oqbNoqt.r3§ImqmqxrE§£o}uvb3os¬v}qx¶§bI²#]^`xms1v}qx¶`§br3vwK¶Xbz±tv}xwmpovwrb¥r3§Imqm

§¶Ab3§GÃWxw¤+^`xr^r3Impb¤°bXbE}pz±tI}qa mq`Ab3}\xmqbE5r3§Imqmqxy¸Ar31oxtIw®²Szoq^`b1}xv¶`§bxmT´}bEv§°1§`bN

IbEroqtv}NÃ¤°bXbE}pz±tI}qa K}b3uI}qbNmqmqxtIw®²´]^`bÂvb3k&xlbE´xmoq^oEÃ2¤+^b3}bEvmxw`xnxl§mT}blbEmr}x¶XbN

o^wÂnmoqtºz±`wroqxtvwmEÃl¤#b·mpoqx§§£¤w\ootº}qbNlxrooq}vlxoqxtvwX§Aw\aTbE}qxr3v§X1v§`bI²C«wa.1o^`b3a.1oxrE§

ob3}a.m3Ã¤°b^¬vb

n

b3lvac`§bNmlbNmqr3}qx¶XbN&¶nk

s + 1

1}xv¶`§bEmEÃ

(g ₁ ⁱ , . . . , g _s ⁱ , t ⁱ ) i∈{1,...,n}

ÃW¤+^`bE}qb

t ⁱ

xm¦oq^bºo}uvb3o¦1}x¶`§bK±¤+xoq^

t ⁱ ∈ R ^o

¯¦w¤+^`bE}qbcbEIr^

g ⁱ _l

xm,z±`wroqxtvw&¶Ab3§tvw`uIxw`uoqtKuvxvbEw z±wr;oxtIw§2mqvr3bv².]^`b.`}tv¶§bEa6xm¦ot `}qbNlxr;o

t ⁱ

¶ImpbNStIw

(g ⁱ ₁ , . . . , g ⁱ _s )

².«wo^`bcz±}vacb3¤#tv}Âtvz

" 0sÃ=mqb3vbE}v§CaTb3oq^`tl`m7^X¬vbc¶XbEb3w&`}tvAtImqbE´oqt´mqtv§vbºoq^`xm,ÂnxwXtvz°`}tv¶§bEaÃ®z±tv},xwmowr3bcoq^`b

§xw`bEv},z±`wroqxtvwv§actllb3§¦{mqb3b¥bI²uX² ¬¡N¢GÃ vN¢Ã %¬¢GÃ1¢ Ã9¬¢w ¢ß¯Ãz±wr;oxtIw§lxmqr3}qxacxwvw\o

vw§klmpxm+±bI²uX²° v¬¢ß¯Ãvz±`wXr;oqxtvwX§Xin§xrb+«wnvbE}mqb++b3uI}qbNmqmqxtIwØmpbEb,¢`z±tI}Woq^`bsr3§Imqmqxr3§il w 5%¬¢

z±tI}·xomz±`wroqxtvwv§Cvb3}mqxtIwX¯+wXKw`tvw`©Gv}vacboq}xr7Âvb3}w`bE§¶ImpbN z±`wroqxtvwv§bNmoxa.oqtv}mØmpbEb 3¢GÃ

N¬¢w E¬¢±¯;²

«w o^`xmvXbE}EÃ¤#b´mp^`t1¤!^`t1¤ ¨K`§oqx©«ª=¬kvbE}.|Cb3}rb3`oq}tvwm´Ø¨´ª®|#¯¥r3vw ¶XbS`x}bEroq§k v``§xbN

ot´z±`wXr;oqxtvwX§`1o`Ã2mqtSvmoqt`}qt1nxlb¥w`tIw`§xw`bN}TmpbEaTx©}acbo}qxrTz±`wroqxtvwr3§Imqmqx¸Xr3oqxtvw5wX

}b3uI}qbNmqmqxtvw®² ³b´xw\oq}tn`rb´0a.~tv}¥lxAbE}qbEwrbS¤+xyo^ oq}vlxoqxtvwv§ " 0s acbo^`tl`mtI`}¥actllb3§

¤#tv}Âlm·`x}bEroq§k´¤+xyo^So^`b¥mpoqlxbESz±`wroqxtvwmEÃ=¤+xoq^tvlo,mqxwu mqxac`§xy¸XbE}qbE`}bEmqb3w\ooqxtvw®²]^xm

¬Itvx`m+}bEmpoq}xroqxtvwmtvwKo^`bºz±`wr;oxtIw§¤#b3xuv^\o·}b3`}bEmqb3w\o1oqxtvw ¤+^`xr^SrEwKo^`b3}bz±tI}qbº¶XbTv`vloqbN

otoq^`b´r3tvw\oqb3\oN² "`tv}.xwmpovwrbIÃz±`wXr;oqxtvwX§`o¤+xoq^ §t1¤!lxaTbEwmqxtIw§+xw``lomqIrbEmcrEw ¶Xb

a.vw`x`§oqbNKoq^Xw`Âlm·oqtuvbEw`b3}§xEbEK§xw`bEv}·actllb3§mc{mqr^Im7mp`§xw`bEm¯;Ã£¤+^`bE}qbNvm¦¨´ª®|h}bXmpbN

z±tI}z±`wroqxtvwm+¤+xoq^ ^`xuv^ lxacb3wmqxtIw§£xw```ompIrbNm3²

³ ^`bEwSz±wr;oxtIw§W`ov}qbºXbE}pz±bNr;o§kKÂnw`t1¤+w®ÃAo^`bºb3noqb3wXmpxtvwtz¨´ª=| ¤#b`}tvAtImqbxm7¥v}p©

oxr3`§}7r3vmqbTtz°vwSbnob3wmqxtIwS`}tvAtImqbESwmolxbEKz±}tva `}qbE§k o^`b3tI}qb3oqxr3v§Atvxw\o7tvznxbE¤ xw

B ¢G²&«w"B ¢GÃWo^`b lo^`tv}Tmp^`t1¤smoq^X1oToq}vlxoqxtvwv§`wxIb3}mqv§#v``}t¬nxa.1oxtIw}bEmq`§omz±tv}c¨´ª®|

rEw¶Xb7b3\ob3w`bEoqtK{v§act\mo;¯°v}q¶xyo}v}qkcxw``lomqvr3bEmEÃnxwr3§XlxwuTxwl¸wxyoblxacbEwmpxtvwX§£vbNr;otv}xv§

mqIrbEmE²,]^`bEmqbT}qbNmp`§om¦}b3§k tvw´o^`b.`}qt¬lxacoqxtvwKtvz°rtIwIoxwn`tIm·§xw`bEv}¦z±tv}acm¦lb3¸w`bEtvwSoq^`b

(8)

¨Sª®|'xw``loºmqIrbv²«w0tv}¤°tI}qÂVÃ®¤#bmq^`t1¤ ^t1¤ otSr3v}q}k´tv`ooq^`xmÂnxwtzs`}qt¬lxa.1oqxtvwxw

}Ir;oqxrbIÃvz±tI}xwmpovwrb·¶nk.mpxw`uoq}vlxoqxtvwv§A¨Sª®|C²l³b7mq^`t1¤ oq^`xm¤¬ko^1o#z±`wroqxtvwv§V¨Sª®| }b

w`xIb3}mqv§\v``}t¬lxa.1otv}m=vw,o^`b3}bz±tI}qb°oq^oCoq^`bEkr3vw¶Ab#XmpbN,oqt7actllb3§`r3tvac`§blbEXbEwlbEwrxbEm

¶Abo¤#b3bEwT}bEv§£¬v§bEov}quIbo¬v}qx¶§b,wX¥z±`wXr;oqxtvwX§®xw``lom3²

¨KtI}qbEt1vbE}EÃC¤#bmq^`t1¤ o^1oToq}xw`xw`uv}vaTb3oq}xr¥z±`wroqxtvwv§¨Sª®| tvw¹S¸w`xoqb wn`aº¶XbE}Ttvz

z±wr;oxtIwb3lvac`§bNm#xm+mpooqxmoxrE§§k.1§x£Ã`vm°oq^b¦tIloqxa.§Vv}vaTb3oqbE}m°tv¶loxw`bE¥oq^vw`Âlm#oqtºoq^`t\mpb

b3`ac`§bEm`}qt1nxlb rtIwmqxmpoqbEwIo bEmpoqxa.1oxtIw"tzTvmqk\aclotoxrtvloxa.v§¦X}acbob3}m3ÃsbEvbEw"xz¤°b

Imqmq`acb§xaTxoqbNÂnw`t1¤+§bEluIbtIwbEIr^,z±`wroqxtvwTb`ac`§b·{xØ²bv²ÃbEIr^,z±`wroqxtvwºxmtvw§k7Ânw`t1¤+w,o^w`Âlm

ot¥º¸w`xoqbwn`aº¶XbE}stz±xw``loNÃXtIloq``o¯#vx}m¯²]^`xm+xmsclx}bEro+oq}wmq§1oqxtvwtzWr§vmmqxrE§V}qbNmp§yom3Ã

}qbNmpbEwIobExw&IN¢£z±tI}+xwXmowr3bvÃ¬1x§¶`§bz±tI}+wn`acb3}xrE§®¨´ª=|²

]^`bS}qbNmotvz7oq^`bAb3}¥xm¥tI}qu\w`x3bN vmcz±tI§§t1¤sm3²h«w o^`bK¸}mo}qoEÃ+¤#bSvmmq`acb oq^o¤°b

^X¬vbAb3}qz±bEro·Ânw`t1¤+§bEluIbtz2a.wx`§oqbEKz±`wr;oxtIwm+¤°bTmo}qo·¶nkxw\oq}tllrxw`uxwSmqbEroqxtvw.oq^`b

}qtIXt\mpbN¥z±`wXr;oqxtvwX§¨Sª®| actllb3§G²°]^`bEwK¤°bmq^`t1¤µxw´mqbEroqxtvwKc^`t1¤ oq^`b,}bEmq`§om+tvz+ ;¢r3vwK¶Xb

I``oqbEot.z±`wroqxtvwv§¨Sª®| otmq^`t1¤"o^`b3kKv}qbw`xIb3}mqv§=`}qt¬lxa.1oqtI}mE²#«wKoq^`bºmpbNrtvwX }qoEÃ

¤#bsoÂIb·xw\oqtºIr3r3tv`w\o#mac`§xw`u WrtIwmqxmpoqbEwrkctz£z±wr;oxtIw§£¨´ª=|o}vxw`xw`uºxmmpoqlxbExwmpbNr;oxtIw

X²inbEroqxtvwrtIac}bEmtv`}7`}qt\vr^ oqt §oqbE}qwX1oqxvbw`b3`}§Wmqtv§loqxtvwXm3ÃVtvw¥o^`b3tI}qb3oqxr3§AtvxwIo

tvzW\xb3¤,²]^`bEw®ÃXmqbEroqxtvw %cuvxvbNmsmqtvacb,blAb3}xacb3w\o§®}bEmq`§om+¶Ato^Ktvw´mqxaº`§oqbNKw}bE§=¤°tI}q§

1o²C|2}qtntvz{m+}b¦}qbNmpbEwIobExw mqbEr;oxtIwS¡n²

! "#$<

! #"%$! &'

·mºmpooqbN0xw5oq^`bxw\o}qtllroqxtvw®ÃWvw5tv¶mqb3}11oxtIw0xmTlbEmr}x¶XbN&¶\k

s + 1

1v§`bNm3Ã

(g 1 , . . . , g s , t)

^Ã

¤+^b3}bTbNvr^

g l

xmz±`wXr;oqxtvw Øw

t ∈ R ^o

¯;²¨KtI}qbc`}bEr3xmqb3§kvÃ¤°b¥Imqmq`acbToq^o

µ l

xm

σ

^©G¸w`xoqb

AtImqxoqxvb A#tv}b3§VacbEvmq`}b,lb¸wbEtvw

R ^u ^l

woq^X1o

g l

¶XbE§tIw`uIm#ot

L ^p ^l (µ l )

^²

( ! #"%!)*+

]^b#b3noqb3wXmpxtvwºtzXwn`acbE}qxr3v§\wb3`}tvwmotz±`wXr;oqxtvwX§lxw``lomCxmWmpoq}xuv^\opz±tI}q¤}£²£«w`b3bET

n

^xw``lo

¨Sª®| w`bE`}qtIwxmr^X}vr;ob3}xEbE¶\kT¸`lbEKIr;oqx11oxtIwz±`wXr;oqxtvw=Ã

T

Ã`Tz±wr;oxtIw z±}qtIa

R

oqt

R

Ã¶nk

vbEroqtI}2z±}tva

R ⁿ

ßo^`b¤#b3xuv^\oIbEr;otv}NÃ

w

¯°wX.¶nkc}qbN§1v§`bNcoq^}qbNmp^`tI§®Ã

b

²2f¦xvb3w¥vbNr;oqtI}qx§

xw```o

x ∈ R ⁿ

Ã`oq^`b,tIloq``ostz=o^`b,w`bE`}qtIwxm

N (x) = T (w.x + b)

^²

]^`xmz±tv}a`§.xm¶ImpbNKtvw o^`bT§xw`bEv}sz±tI}qa

x 7→ w.x

^²7³ ^{^`b3w}

x = (g 1 , . . . , g s ) ∈ L ^p ¹ (µ 1 ) × . . . × L ^p ^s (µ s )

ÃXº§xw`bEv}z±tv}a r3vw¶AbrtIwmo}qXr;oqbN¥o^wÂnm#ot.xw\ob3uv}§mEÃIz±tI}+xwXmowr3b

(g 1 , . . . , g s ) 7→

X s l=1

Z

f l g l dµ l ,

^N¯

¤+^b3}b

(f 1 , . . . , f s )

}b°acbEImp}v¶`§b°z±`wroqxtvwmr^`tImqb3wcmpXr^o^1o

f l g l ∈ L ¹ (µ l )

²1·mpxw`u¦oq^`xmW§xwbE}

z±tI}qa Ãl¤#b,r3w lb3¸w`bºz±`wroqxtvwv§®w`b3}qtIw

(9)

¼

±

À z±`wr;oxtIw§w`bE`}qtIwKtvw

E = L ^p ¹ (µ 1 ) × . . . × L ^p ^s (µ s )

xm·lb¸Xw`bE o^wÂnmsoqt

¸nbNKvroqx¬oqxtvw z±`wXr;oqxtvw

T

^z±}tva

R

^oqt

R

ÃA¤°bExuI^Io+z±wr;oxtIwm

f _l

{mqr^Koq^X1o

f _l g _l ∈ L ¹ (µ l )

^¯swX

T}bEv§£¬v§bEoq^`}bEmq^`tv§£Ã

b

^²WorE§r`§1obEm

N (g 1 , . . . , g s ) = T b + X s l=1

Z

f l g l dµ l

!

.

^Øv¯

]^`xm#z±`wroqxtvwv§£w`b3}qtIwxm#cmqXbNrx§£r3Impb¦tzuvbEw`b3}§Aw`b3}qtIwm#`}qtIXt\mpbN.xw 9lÃ`IlÃ`B ¢G²2]^`b

a.vxwKl}¬¤+¶vrÂtzoq^`xmsactllb3§xm+oq^oxyo·mpbNmz±`wroqxtvwv§®¤#b3xuv^\om+}1o^`b3}o^wKwn`acbE}qxr3v§®tvw`bNm3²

]^xm`}qtI¶`§b3a rEwc¶AbmptI§IbET¶nkºXmpxw`u,v}vaTb3oq}xr#}b3`}bEmqb3w\o1oqxtvwTtzVz±`wXr;oqxtvwXm3²W¨KtI}qb+`}bEr3xmqb3§kvÃ

¤#b,vmmpaTb7uIxIb3w

s

z±`wroqxtvwm

F 1 , . . . , F _s

mpXr^o^1o{^\knAto^`bEmqxm

H _a

^¯

v²

W l ⊂ R ^v ^l

l²

F l

xm+ºz±`wr;oxtIw z±}qtIa

W l × R ^u ^l

^oqt

R

`²#z±tv}sbNvr^

w _l ∈ W _l

^Ã

F _l (w l , .) ∈ L ^q ^l (µ l )

^{¤+^`bE}qb}

q _l

xmo^`brtIw1~`u\1oqb7b3nAtvwb3w\ovmmptlr3xoqbEoqt

p _l

"tv}ºxwmpovwrbIÃ

F l

rEw0¶AbxaT§bEaTbEw\oqbE0oq^vw`Âlm,oqtKwn`acb3}xrE§¨Sª®| {xw0o^`xmºrEvmqbvÃ

w l

xmoq^`b

¤#b3xuv^\osIbEr;otv}stvzWoq^`bº¨´ª®|°¯tv}soq^vw`Âlm+oqt¥oq^`b¸}mposz±`wXr;oqxtvwXmtvzW.oqtvAtv§tvuIxrE§®¶Xvmqxm+tvz

L ^q ^l (µ l )

{xwco^`xm2r3ImpbIÃv¤#b#^X¬vb

F l (w l , x) = P v l

i=1 w li ψ i (x)

Ãn¤+^`bE}qb

(ψ i ) i∈ N

xmCoq^`bsr3tvwmqxlb3}bEºoqtIXtI§tIuvxr3v§

¶Xvmqxm¯;²

³br3vww`t1¤ xw\o}qtllr3b¦oq^`blb3¸w`xoqxtvw tzWT}acb3oq}xrz±`wroqxtvwv§®w`b3}qtIw

¼

±À

}acbo}qxr7z±`wXr;oqxtvwX§Ww`bE`}qtIw´tvw

E = L ^p ¹ (µ 1 ) × . . . × L ^p ^s (µ s )

xm7lb3¸w`bN

o^wÂnm·ot ¸`lbNIr;oqx11oxtIw´z±`wroqxtvw

T

^z±}tva

R

^oqt

R

Ã=¤°bExuI^Io7vbNr;otv}

w ∈ W 1 × . . . × W s

vwº}bEv§£1§`bEoq^`}bEmq^`tI§£Ã

b

^²Cor3§r§oqbEm

N(g 1 , . . . , g s ) = T b + X s l=1

Z

F l (w l , x)g l (x) dµ l (x)

!

.

^{I¯

! #"

·m+ºz±`wr;oxtIw§=w`b3`}tvwuvxvbNmº}bEv§Vtvlo`loEÃ¤°b,^¬Ibotcmpb7wn`acb3}xr3§£wb3`}tvwm#b3lr3b3losxwoq^`b

¸X}mpo+§¬kIb3}#tzºz±`wXr;oqxtvwX§®¨´ª=|²«wv}poxr3`§}NÃnTtIw`b7^`xlb3w§¬kIb3}v}vaTb3oq}xrsz±`wroqxtvwv§£XbE}p©

r3b3lo}qtIw¤+xoq^tvw`b·z±`wroqxtvwv§£xw`loswtvw`b¦}qbN§Vtv`oq`losr3tvac`lobEmz±wr;oxtIwtvz®oq^`b¦z±tI§§t1¤+xwu

z±tI}qa

H (g) = X k i=1

a _i T

b _i + Z

F _i (w i , x)g(x) dµ(x)

,

^±\¯

¤+^b3}b·o^`b

a _i

}b·}bEv§£wn`a¶Ab3}m3Ã`Im¤°bE§§®Im#oq^`b

b _i

^Ã`vw

w _i

v}qb7v}vacboqbE}vbEroqtI}m°z±tv}

F _i

^²

ezrtI`}mpbIÃ°xoxm.tv¶nnxtImToqt0b3noqb3wX oq^`t\mpb´lb3¸w`xoqxtvwm.oqt5actv}boq^vw tvw`bKtIloqlowX ¬tI}

^x``b3w §¬kIb3}N²5]^`b tvw`§k5lxAbE}qbEwrb ¶Abo¤#b3b3w z±`wr;oxtIw§

n

^©^`x`lb3w §¬kvb3}TAb3}rb3`oq}tvw¹vw

wn`acbE}qxr3v§®tvw`b,xm+o^1oNÃAImsmpo1obEKv¶Xt1IbvÃ`¤#b,mqb,z±`wroqxtvwv§=w`bE`}qtIwm+tIw`§kxw´oq^`b,¸X}mpos§¬kIb3}N²°o

xmsv§mqtctv¶nnxtIm#oqt`b¸w`bcuIb3w`bE}v§Vz±`wroqxtvwv§¨´ª=| ¶\kmqxw`ucz±wr;oxtIw§®wb3`}tvwms}oq^`bE}oq^vw

X}acbo}qxrsz±wr;oxtIw§®wb3`}tvwmE²

(10)

<5,$$ .

7

) + #$ ! & +

³b,mqb7w`to1oqxtvwXm+wlb¸Xw`xyoxtIwmz±}tva6B ¢G²

&++ v5À '+ ` ¼ . Á ¼ 3@Øv

³b.lb3wtoqb

C(A, B)

o^`b.mpb3o,tz#r3tvw\oqxwn`tvXmsz±`wXr;oqxtvwXm¦z±}qtIa

A

^oqt

B

^{Ã®¤+^b3}b}

A

^w

B

^}bo¤#t

otvAtv§tvuIxrE§mqIrbEmE²7m7mqXbNrx§Wr3ImpbIÃ

C ⁿ

xmoq^bcmqbo¦tz°r3tvw\oqxwn`tvXmsz±`wXr;oqxtvwXmz±}tva

R ⁿ

ot

R

²

M ⁿ

xmso^`bmqbo¦tzs+A#tv}b3§ß¯acbEImp}v¶`§b7z±wr;oxtIwmsz±}tva

R ⁿ

oqt

R

²³bTlb3w`tvoqb

d _C

o^`bacbo}qxr,tIw

M ⁿ

oq^osuvxvbNm°w`xyz±tI}qa!rtIw\Ib3}uvbEwrb·t1vb3}+r3tvacvrosmp`¶Xmpb3om

d _C (f, g) = X

n∈ N ∗

1 2 ⁿ min

( sup

|x|≤n

|f (x) − g(x)|, 1 )

.

^Øv¯

³ ^b3w

K

xm.rtvacIr;osmq`¶mqbostz

X

ºoqtvAtv§tvuIxrE§®mqvr3bvÃl¤#blb¸Xw`b

ρ K

cacboq}xr7tvwoq^`bmqbostvz

z±wr;oxtIwmz±}tva

K

^oqt

R

^¶\k

ρ _K (f, g) = sup

x∈K

|f (x) − g(x)|.

^%I¯

¼

±À &

ª®b3o

X

¶Xbcacbo}qxr,mqvr3b,¤+xyo^

d

oq^`bImqmqtlrx1obEaTb3oq}xrv²°ª=bo

C

^w

S

^¶Ab,o¤°t

mq`¶mqbomtvz

X

^²

S

^xm

d

©GtIlomqx`bºlbEwmpbºxw0d xyzoq^`b

d

©«r§tImq`}btz

S

rtIwIoxwm

C

^Ã£vw

S

^xm

d

^©xwXmpxlb

`b3wmqb7xw

C

^{xyzoq^`b}

d

^©r3§t\mp}qb¦tz

S ∩ C

rtIwIoxwm

C

^²

³ ^`bEw

C = X

^Ã

d

^©xwmqxlblbEwmpxokxmb\`x¬v§bEw\ooqt

d

^©tvlompxlblbEwmqxyok&w&xmmqxaT§k&r3v§§bE

d

©«lb3wmqxokv²

&+ ¼ <,ØÁÁ ¼ +{ ½X¼ ¼ 1 ¼ 3 À

¼

±À

z

T

xm#7z±`wroqxtvw.z±}tva

R

oqt

R

wX

n

,Xt\mpxoqxvbxw\oqbEuvbE}EÃ

S _T ⁿ

xm2oq^`b¦mpb3o°tz£z±wr;©

oxtIwm#b`vroq§k.rtvac``oqbE¶nk.tvw`b·^`x`lb3w§¬kvb3}#Ab3}rb3`oq}tvwm°¤+xyo^

n

xw`lomwX¥tvwb·tIloq``oEÃ`wX

Xmpxw`u

T

vmvr;ox1oqxtvw¦z±`wroqxtvw®Ã¬xG²bI²®oq^b°mqbo®tznz±`wXr;oqxtvwXm=tvzIo^`b2z±tI}qa

h(x) = P p

i=1 β i T (w i .x+b i )

¤+^b3}b

p ∈ N

^Ã

β i ∈ R

^Ã`vw

(w i , b i ) ∈ R ⁿ⁺¹

^²

¼

±À z

X

xm·TotvAtv§tvuvxr3v§®vbNr;otv}mqvr3bvÃ

A

¥mq`¶mqbotvz

X ^∗

^wX

T

cz±`wroqxtvw z±}tva

R

^ot

R

^Ã

S _T ^X (A)

xm,o^`bmqboTtz+z±`wXr;oqxtvwXmb`Ir;oq§k&rtvac``oqbE5¶\ktvwb^`x`lbEw5§¬kIb3},uIb3w`bE}v§x3bN

Ab3}rbEloq}tvwXm¤+xoq^Txw``lo2xw

X

Ã1tvw`b}bE§ntIloq``oEÃIvw¤#b3xuv^\oCz±tv}a.mxw

A

^ÃIxØ²bv²oq^`b+mqboWtzXz±`wroqxtvwm z±}tva

X

^ot

R

tvz°o^`b.z±tv}a

h(x) = P p

i=1 β i T (l i (x) + b i )

^{¤+^`b3}b}

p ∈ N

^Ã

β i ∈ R

^Ã

b i ∈ R

^w

l i ∈ A

^²

toqbºoq^X1o

A

rEwSxw´z{Ir;o7¶XbcwnkKmqbo7tzWz±`wroqxtvwm·z±}tva

X

^ot

R

ÃVxw¤+^`xr^r3Impbº¤°bTltw`to xw\oq}tllrb,r3tvwmpovwIoob3}acm

b i

²

+rErtv}lxw`u¥oto^`xm,lb¸wxyoxtIw®ÃVz±`wroqxtvwv§tIw`bT^`xlb3w§¬kIb3}·XbE}r3b3lo}qtIwm·v}qbTmqAbErx§WrEvmqb

tvzi\oqxwr^r3tvaº¶Xb¹uvb3wb3}§xEbEhAb3}rb3`oq}tvwmxw ¤+^`xr^

X

xm"`}qtllXr;otvz

L ^p

mqvr3bEmSvw

A

xmKuIxIb3wh¶nk"§xw`bN}Kz±tI}qa.mKtvzºo^`b0z±tI}qa

l(g 1 , . . . , g s ) = P s l=1

R f l g l dµ l

{tv}

l(g 1 , . . . , g s ) = P s

l=1

R F l (w l , x)g l (x) dµ l (x)

z±tv}+v}vaTb3oq}xrz±`wroqxtvwv§®Ab3}rb3`oq}tvwm¯;²

(11)

( ) * + #" *! &' "! ! #"

ilb3vbE}v§£``}t¬lxa.oqxtvw}bEmq`§om+mq^`t1¤ o^1o

S _T ^X (A)

xm+xwXmpxlb,tv}+tIlomqxlblb3wXmpb,xwKlxVb3}b3w\o+z±`wXr;©

oxtIw§lmqvr3bEmE²®«wlbEbE ;¢®{Im¤#b3§§lvm#v¬¢vw¥ E¬¢±¯`}tvAtImqbEm=v``}t¬lxa.1oxtIw}bEmq`§yom®z±tI}

S _T ^X (A)

z±tI}#v§act\mo}¶`xyo}v}qkTmpXvrbNm

X

{mqb3bso^`b3tI}qbEa l² wXrtI}qtI§§}xbEm`²! I²,vw`²! I²z±}qtIa!B ¢ß¯²W«w tI}`b3}°oqt.`§kco^`tImqb7uvb3wb3}§A}qbNmp`§om°otT}Ir;oqxr3v§ArEvmqbEmEÃlrtvac`§b.obEr^`wxrE§£`}tvAb3}qoqxbEm#^¬Ibsoqt

¶Abm1oxmp¸bET¶nk

A

²C«wcoq^`xmmqbEroqxtvw®ÃI¤°bsmq^`t1¤¹oq^o2oq^tImqbs`}tvAb3}qoqxbEmW}bsm1oqxmp¸bET¶nkºIb3}kuvbEw`b3}§

z±wr;oxtIw§£tIw`b,^`x`lb3w §¬kvbE}°Ab3}rbEloq}tvwmE²

2 À À ++{l ½ $#&%'

µ

⁽ %*),+.-0/1'%203546/1'7/185%:93;<%=0>?%)546@A;<%*3-

R ⁿ

^B ^#&%'

1 < p ≤ ∞

⁽ ^%)C-D); ⁽ /1'7;<);6E

;F%F)C=,-0@A>

(

%G;H)C-JI

q

⁽ %K'1L0%NM3C-O6@QPR)'%D%FSG2 3C-J%-0'T3VU

p.

^#&%'

V

⁽ %N)WIQ%- 4%H4@

(

4%G'X3VU

L ^q (µ)

^B ^#&%'

A _V

⁽ %Y'ZL %Y4%'[3U\=]/1-%F)C;^UG3C;6>_4`3C-

L ^p (µ)

3U\'ZL %[UG3C;6>

l(f ) = R

f g dµ

^a[b ^{L %;<%}

g ∈ V

^B ^#&%'

T

⁽ ^%

)D>?%)546@A;<)

(

=%cU@A-JM'/3C-HU;<3>

R

^'3

R

46@0MLW'1L0)'

S _T ¹

^/d4

d _C

e

/1- 46/If%hgi;<%G42

B

d _C

e

3@A'4/If%jhIQ%- 4%?/1-

C ¹

^Blk ^{L %-}

S ^L _T ^p ^(µ) (A V )

^/d4

ρ K

^e

/1- 46/If%hgi;<%G42

B

ρ K

^e

3C@A'46/IQ%VjmIQ%- 4%n/1-

C(K, R )

^ab ^{L %;<%}

K

^/d4?)-0E

M3C>$20)QM'.46@

(

4%G'[3VU

L ^p (µ)

^B

2 À À ++{l ½ *#&%'

µ

⁽ %_)[+,-0/1'%.203546/1'/18%_M3C>$20)QM'=oEY46@p2f2 3C;6'i%I\93;<%=q>n%)4@A;F%X3-

R ⁿ

^B ^#&%'

T

⁽ ^%

)N>?%)546@A;<)

(

=%[U@A-MG'7/3-?U;<3C>

R

^'i3

R

a

46@0MLm'ZL )C'

S _T ¹

^/d4

d C

^e

/1- 46/IQ%hg7;F%6472

B

d C

^e

3C@A'46/IQ%VjDIf%G-04G%`/1-

C ¹

^B ^#%G'

V

⁽ ^%n)H4@ ⁽ ^4%G':3VU

L ^∞ (µ) d _C

e

/1- 46/If%KgV3C;

d _C

e

3@A'4/If%jNIf%G-04%_/1-

C ⁿ

^BKk ^L0%G-

S ^L

1 (µ) T (A V )

/d4

ρ _K

e

3@A'4/If%YIf%G-04%\/1-

C(K, R )

^a,b ^{L %;<%}

K

/d4_)-rEKMF3C>$20)QM'^4@

(

4%G':3VU

L ¹ (µ)

^B

+ + +

d°tI}qtI§§}k Tmp^t1¤smso^1o,vm·§tIw`uIm¤#bcr3w``}t¬lxa.oqb,z±`wXr;oqxtvwXm·xw

L ^q (µ)

^wXKxw

C ¹

^{ÃXo^`b3w}

vwtIw`bT^`xlb3w&§¬kvb3}¦Ab3}rb3`oq}tvw&r3w¶Xb.XmpbN´ot v``}t¬lxa.1obz±`wXr;oqxtvwXm,xw

C(K, R )

Ã=¤+^`bE}qb

K

xmTrtIaTXvr;o+mq`¶mqbotz

L ^p (µ)

²W|2}b3nxtIm°¤°tI}qÂlm°uvxvbIb3}kc¤°bNÂ.rtIwlxoqxtvwm°tvw

T

oq^o+xac`§k

d C

xwmqxlb·tv}°tvlompxlb·`b3wmqxyokTtz

S _T ¹

^z±tv}

C ¹

Ãlmqb3bz±tv}xwmpovwrb¦]^`b3tI}qbEa sxw´ ¬¢®vw.]^`b3tI}qbEa xw0 ¬¢² AvmqxrE§§kIÃ

T

ampo¶Abw`tIwKXtI§knw`tIacxv§=wKsxbEacvw`wKxwIob3uI}v¶`§b,tIw´.w`tIwl©`b3uvbEw`b3}1ob r3tvacIr;oCxw\oqbE}q1v§\tvz

R

Ãv}qtIXbE}poxbNm=o^1o2v}qb#tv¶nnxtImq§k,m1oqxmp¸bE¶\kXtI``§}Wvroqx¬oqxtvwºz±`wroqxtvwm mqr^ vm

tanh

^²

]^`bKuIb3w`bE}v§x3bN¹¨Sª®| mqbE xw r3tv}tv§§v}qk mqbEm.§xw`bEv}cz±tv}acmcxw

A V

w¹xm.oq^`bE}qb3z±tv}b

z±wr;oxtIw§#¨´ª®| ¤+xoq^¤°bExuI^Ioz±`wr;oxtIwmr^tImqb3w0xw

V

´lbEwmqbmp¶mpb3otz

L ^q (µ)

²´«w0`}vr;oxrE§

mqxoqoqxtvw®Ã£¤#b3xuv^\o¦z±`wr;oxtIwm,}bT}qbE`}qbNmpbEw\oqbEKoq^vw`Âlmot }acbo}qxr,z±wr;oxtIwm.

F (w, .)

^{¯;².]^`xm}

r3tvwmpoq}xw\oc`t\bNmcw`to.xw\oq}tn`rbKwnk0`}tv¶§bEaÃ#vmc§tvw`u&vmc¤#bKr^`tntImqbv}vacboq}xr¥`w`xvbE}m§

v``}t¬lxa.1otv}z±tI}

L ^q (µ)

²¦]^w`Âlmsoqt]^b3tv}b3a tvzs! 9¬¢GÃA¤#bºr3vwKmqbz±tv}·xwXmowr3btvw`b^`xlb3w

§¬kvbE}Ab3}rbEloq}tvwm#¶ImpbN.tvwvroqx¬oqxtvwz±`wr;oxtIw

U

^±xG²^bI²Ã

V = S _U ⁿ

¯#vm#§tvw`uTvm

U

xm#acbEvmq`}¶`§bvÃ

¶AtvwlbEwXw`tIwr3tvwmpovwIo,{Im

p > 1

^Ã

q < ∞

vw]^`bEtv}b3a ,`§xbEm¯;²eo^`b3}actllb3§m+r3vw¶Ab

XmpbNA°© mq`§xw`bIÃ¤¬vbE§b3oEÃB"`tI`}xbE}smpbE}qxbEmEÃ`bor² ¯.¶``oxac`§kxw uvbEw`b3}§®I`lxoqxtvwv§®}bEmpoq}xroqxtvwmtIw

o^`brtIwmqxlbE}qbN.z±`wXr;oqxtvwX§=mqvr3bv²

]^`bc`}tntztvz°rtI}qtI§§}k Tr3tv`§S¶AbcbnoqbEwlbNKoqt

p = 1

Ãw´oq^`bE}qb3z±tv}bvÃ£tvwbºacxuv^\o¦¤#tvwXlb3}

¤+^nkKrtI}qtI§§}k¥xm·mqbz±`§G²··m·Atvxw\oqbNKtvlo¦xw´oq^`bTxw\o}qtllroqxtvwKtvz ;¢ ÃAwt

S _T ⁿ

mpb3o·xm·lbEwmqbxw

L ^∞ (µ)

²W]^`bE}qb3z±tv}bvÃvr3tv}tv§§v}qk sa.xw¥vmmp`acloxtIwK

V

xmlbEwmqbsxw

L ^q (µ)

¯2rEw`wto2¶Ab·m1oqxmp¸bET¶nk

¨Sª®|&¶vmqbEcv``}t¬nxa.1oxtIw®²=]^`xmW}bElr3bEmWuI}qbN1o§k,o^`b+xwIob3}bEmpo2tz£rtI}qtI§§}k z±tv}

p = 1

^{²]^X1o}^m

¤+^nkSr3tv}tv§§v}qkKxm7Xmpb3z±`§Im7mp^`t1¤+wSz±tv},xwmpowXrbc¶nkS]^`b3tI}qbEa ctz· 1¢GÃ

S _U ⁿ

rEw¶Xb.mqbESoqt

(12)

}qt1nxlb`}qt¬lxa.1oqxtvw otr3tvw\oqxwn`tvXmsz±`wXr;oqxtvwXm·tIwrtvacIr;o,mpb3oE²,]^`bE}qb3z±tv}bvÃAoq^`bcmqxyo1oxtIw

z±tI}

p = 1

^xm Ixyobºmqxacx§v}soqtoq^`bºtvw`boq^o¦mpovw`mz±tv}

p > 1

ÃAb`r3b3lo·oq^o·o^`bacbEImp}qb^Xvm+ot

¶AbrtIacvroq§kmp`XtI}pobE£²

]^`xm+acbEvwmo^1o¤+^b3w

K

xm.rtvacIr;osmq`¶mqbostz2

L ^p (µ)

z±wr;oxtIw§=mqIrbvÃXwnk.z±`wroqxtvw z±}tva

C(K, R )

rEw.¶Ab·`}qt¬lxa.1oqbNotº,uIxIb3wc`}bEr3xmqxtIwc§bEvb3§X¶nkT7z±wr;oxtIw§V¨´ª®|5oq^omqbEm º¸wxyob,w\a¶Ab3}stvzv}vaTb3oqbE}m7±¶AbErEmqb7§xw`bN}z±tv}a.m+r3vw¶Ab}b3`}bEmqb3w\oqbN.z±tI}+xwmpovwrb¦o^w`Âlm

otSwn`acb3}xr3§¨´ª=|m¯² 0bNmp`xoqboq^b}vlxr3v§°r^vw`uvbxw0o^`bxw`locmqIrb`xacb3wXmpxtvw"±z±}qtIa

R ⁿ

otr3tvacIr;o·mq`¶mqbotvzcz±`wroqxtvwv§mqIrbN¯ÃX¤#brEwSmpoqx§§b VbEroqxvbE§k `}qt¬lxacoqbr3tvw\oqxwn`tvm

z±wr;oxtIwm3²

oxmvbE}qk rtvacactvw xw " 0s6oqt¹Imqmq`acbKo^1o molxbE z±`wXr;oqxtvwXmv}qb´mqact\tvoq^®Ãsoq^oxm1o

§bEImor3tvw\oqxwn`tvmE²Tz#¤#bctvw`§kSrtIwmqxlbE}rtIaTXvr;o,xw``lomqIrbEm·z±tI}7oq^`t\mpbTz±`wroqxtvwmEÃ®o^`b3x}rEvmqb

xmcrt1Ib3}bE&¶nk5rtI}qtI§§}k I²0«wlb3bN£Ãr3tvw\oqxwn`tvmz±`wroqxtvwm {tv}cactv}b}b3uv§v}z±`wroqxtvwm¯ºtvw

r3tvacIr;o¦mq`¶mqbo

Z

^tvz

R ⁿ

}btI¶n\xtvXmp§kbE§bEacb3w\om·tz

L ^∞ (λ)

^{¤+^`bE}qb}

λ

xmoq^`bT}bEmpoq}xroqxtvwKtzoq^`b ª=b3¶AbEmquv`bKacbNvmq`}qb ot

Z

²h¨´tv}b3t1vbE}¥0rtIaTXvr;omp`¶Xmpb3o

K

tz5mqvr3bKtz,}b3uv§v}.z±`wroqxtvwm

ØrtIwmpxlbE}qbNS¤+xoq^&o^`b.`w`xz±tv}a w`tI}qa¥¯¦xmKrtIacvromp`¶Xmpb3otz

L ^∞ (λ)

^² ]^`xm,acbEwXm¦oq^oºwnk r3tvw\oqxwn`tvXm®z±`wXr;oqxtvwºz±}tva

K

^oqt

R

r3vwº¶Ab+`}qt¬lxacoqbN,¶nksz±`wXr;oqxtvwX§`¨´ª=|Im§tvwu¦Im

L ¹ (λ)

rEw §mptT¶Ab``}t¬lxa.oqbEßo^`xmr3w ¶Abltvwb·o^wÂnm#ot

S _U ⁿ

^{! 9¬¢ß¯²}

(Wnob3wmqxtIw¹tvz·`}tvAtImqbErtv}tv§§}xbNm,oqta§yox`§b z±`wroqxtvwv§xw`lomcxm.mo}vxuI^\opz±tv}¤}£²&«w

z{Ir;oNÃvrtI}qtI§§}xbNm=v}qb°¶vmqbEtvwºv``}t¬lxa.1oxtIwtzX§xw`bEv}z±tv}acmtIw

X

o^`bxw`lo2mpXvrb#tzAbnoqbEwlbN

wb3`}tvwmE²W³ ^`bEw

X = L ^p ¹ (µ 1 ) × . . . × L ^p ^r (µ r )

ÃXv``}t¬nxa.1oxtIwtzCb3§b3acbEwIom+tz

X ^∗

xm+tv¶`oxw`bN

o^wÂnmsoqtv``}t¬lxa.1oxtIwmtzWbE§bEaTbEw\omstvz

(L ^p ⁱ (µ i )) ^∗

ÃA¶XbNr3Xmpbc§xw`bEv}sz±tv}a!tvw

X

xm.§xwbE}

r3tvaº¶`xwX1oqxtvwtz=§xw`bEv}°z±tI}qa.m#tvw

L ^p ⁱ (µ i )

ßo^`xm#z{vr;o+¤vm#mqbEoqtclb¸Xw`b¦oq^`b¦z±`wroqxtvwv§£w`b3}qtIwX¯;²

<= <®+° / 5& +,C 3

* $

·mb3l`§vxwbEKxw´o^`bºxw\oq}tllr;oxtIw®ÃVtv`}¦uvt\§xmoqtbl`§xwS¥o}uvb3o1}xv¶`§b

t ∈ R ^o

o^wÂnmoqt z±wr;oxtIw§tv¶XmpbE}q11oxtIwm

(g 1 , . . . , g s )

^² AImpxr3v§§kvÃW¤#bImqmq`acb¥o^1ocoq^b3}bxmT´z±`wroqxtvwv§#}b3§1©

oxtIwmq^`x0mqr^oq^o

t ' F (g 1 , . . . , g s )

vw¤°bco}qk´oqtKactllb3§

F

o^w`Âlm¦ot´z±`wr;oxtIw§°¨´ª®|C² ]^Xw`Âlm#oqt.w`xIb3}mqv§£``}t¬lxa.oqxtvw}bEmq`§omuIxIb3wxw o^`b,`}b3nxtImmpbNr;oxtIw®Ã`¤#b,Â\wt1¤ oq^X1ownk

}b3uI`§}

F

rEw´¶Abc``}t¬lxa.oqbE¶nk´.z±wr;oxtIw§C¨´ª®|C²!sbEvbE}po^`b3§bEmm3ÃVwSxacAtv}qow\o7`}tv¶`§b3a }b3a.vxwm

F

xm+tv¶nnxtvmq§kc`wÂ\wt1¤+wvw Tr3tv}}qbNr;o+`}qt¬lxacoqxtvwIm#oqt.¶Ab,rtvwXmo}qroqbN¥o^w`Âlm ot.º§xaTxoqbN wn`a¶Ab3}+tvzb`vaT§bNmtzoq^`xm+a.`xw`uX²

( * "+ ! * ) *

+ v5À '+ÁlN

ª=bom#w`t1¤ lbNmqr3}qx¶Xb·oq^b·`}tv¶X¶`x§xmpoqxr+z±}acb3¤#tv}Âºtvz=tv}°`}tv¶§bEa²W§§V}wltIa IXw\oqxoqxbEm#¤+x§§

¶Ablb¸wbEºtvwº·uvxvbEw`}tv¶v¶`x§xok,mpIrb

(Ω, A, P )

²"`tI}=o^`b+mqvÂvbtvzXmqxac`§xr3xyokIÃ1¤°brtIwmqxlbE}tIw`§k o^`b¥r3Impbctvzvww`x&\`bcz±wr;oxtIw§2xw```oE²¨KtI}qbc`}bEr3xmqb3§kvÃ¤°bca.ÂIbToq^`b.z±tI§§t1¤+xw`u ^\knAto^`bEmqxm

H _b

^¯

(13)

d [1 K

v²

Z

xm+Tr3tvacIr;osmp¶mpb3ostz

R ^u

l²

(G ⁱ , T ⁱ ) i∈ N

xm+wxØ²xØ²£²2mqb\`bEwrb¦tz=}wXltva b3§b3acbEwIom¤+xyo^1v§`bNm#xw

C(Z, R ) × R ^o

{xØ²bv²Ã

bEIr^

G ⁱ

xm¦¥acbEImp`}¶§b,z±wr;oxtIw´z±}tva

Ω

^oqt

C(Z, R )

r3tvwmqx`b3}bE ¤+xoq^Sxom A#tv}b3§mpxuva.

§uvbE¶`}TwXbNvr^

T ⁱ

xm+T}w`tva IbEr;otv}xw

R ^o

Ã`wo^`bmpb \`b3wr3b7xmxG²xG²£²¯

knXtvoq^`bNmpxmCtvwºoq^`b+tI¶mqb3}vbEz±`wroqxtvwmWv}qb \`xoqb+lxAbE}qbEwIoWz±}tva oq^`t\mpbtzVrtI}qtI§§}xbNm +vwT =tIw

o^`btIw`b^Xw

H b

}bmpoq}tvw`uIb3}oq^vwSrtI}qtI§§}xbNm^nk\Ato^`bEmqxm·Imso^`b3kKrtIwmqxlbE}tIw`§kKr3tvw\oqxwn`tvm

z±wr;oxtIwm2lb3¸w`bEctIw.,rtvacIr;omqboNÃvtvwTo^`bsto^`b3}^wºo^`b3kc}b¤°bNÂvbE}WvmWtI¶mpbE}qIbEz±`wroqxtvwm

`tTwtos¶Ab3§tvw`uToqt.crtIacvro+mq`¶mqbostvz

C(Z, R )

^²

l1' ¼ E Ø À Á ¼ +

³b¦oq}kcoqtTactn`b3§Voq^b·}b3§1oxtIwmp^x¶Xb3o¤°bEb3w

G ⁱ

^vw

T ⁱ

o^w`Âlm°oqtcTmpAbEr3xv§AÂnxwtz=v}vacboq}xr actllbE§2{cv}vaTb3oq}xrz±`wroqxtvwv§=¨´ª=|°¯°oq^os^vm#o^`b7z±tv§§t1¤+xw`uºz±tv}a

H(w, g) = U

w 0 , Z

F 1 (w 1 , x) g(x)dµ(x), . . . , Z

F _k (w k , x) g(x)dµ(x)

,

^G¡¯

¤+^b3}b

w = (w 0 , w 1 , . . . , w k ) ∈ W = W 0 × W 1 × . . . × W k

Ã\oq^b

F l

}bv}vacboq}xraTtllbE§m#vm°xw

X}acbo}qxrwb3`}tvwmEÃ

U

xmW¦}b3uI`§v}z±`wr;oxtIw.w

µ

¦¸wxyob+Xt\mpxoqxvbA#tv}b3§nacbEImp`}b7{lb3¸w`bETtIw

Z

¯;²W]^`xm2X}acbo}qxr#z±tv}a xm$Ixyobmpxacx§}oqt,o^`btIw`bs`}tvAtImqbEcxw.o^`brtIw\oqbnotvzin§xr3b«wnvbE}mqb

sb3uv}bEmmqxtIwº¶nk 5%1¢G²e·`}2a.vxw.actox1oqxtvwc^`b3}b+xmWoqtmpbsuvb3wb3}§nz±tv}a o^1o#rt1vbE}mz±wr;oxtIw§

aº`§oqx©G§¬kvbE}Ab3}rb3òq}tvwm¤+xyo^`tvloa.Ânxwùot\tºar^^\knAto^`bEmqxm°tvw¥oq^`bEx}+}r^`xoqbNr;oq}qb{wnà¶Ab3}

tvz§¬kvbE}mEÃlvr;ox1oqxtvwz±`wr;oxtIwmEÃ`§xw`bN}oqbE}qa.mEÃlbor² ¯;² "`tI}+xwXmowr3bvÃ`xz

U

xm+lb¸wbE vm#z±tI§§t1¤sm

U (w 0 , o 1 , . . . , o _k ) = X k l=1

a _l T (b l + o _l ),

^{I¯

¤+xoq^

w 0 = (a 1 , b 1 , . . . , a _k , b _k )

^{Ãnoq^b3w}

H(w, g)

xm#b`vroq§kcoq^`b7tv`oq`lostvzz±`wr;oxtIw§£tIw`b¦^`xlb3w

§¬kvbE},XbE}r3b3lo}qtIw®ÃCvmuIxIb3w&¶nkb \1oxtIw0²Kmº´mpxlb¥b AbNr;oNÃ¤#br3t1vb3}vwnkactllb3§oq^omqbEm

xw\oqbEuv}§motToq}wmpz±tv}a wxw``lo+z±`wXr;oqxtvw xw\oqt¥T}qbN§Vwn`a¶Ab3}N²

intIacb,}qbNmo}qxr;oxtIwm}b·w`bEbElbNtvw

F l

z±`wroqxtvwmwtvw

U

±^nknXtvoq^`bNmpxm

H c

¯

v²#z±tv}

0 ≤ l ≤ k

^Ã

W l

xm+cr3tvacvrosmp`¶Xmpb3ostz

R ^v ^l

l²#z±tv}

1 ≤ l ≤ k

^Ã

F l

xm+ºz±`wXr;oqxtvwz±}tva

W l × Z

^ot

R

mqr^oq^o

{\¯¥z±tI}+bEIr^

x ∈ Z

^Ã

F l (., x)

xm+rtIwIoxwn`tIm

±¶A¯¥z±tI}+bEIr^

w l ∈ W l

Ã

F l (w l , .)

xmacbEImp}v¶`§b

{rN¯

F _l

xmltvacxw1obE tvw

W _l

^Ã#xG²bv²Ã°o^`b3}b xm&aTbNvmq`}¶`§bz±wr;oxtIw

d _l ∈ L ^p (µ)

^{±¤+xoq^}

p ≥ 1

¯mqr^o^1o+z±tI}z±tv}sv§§

w ∈ W _l

^vw

x ∈ Z

^Ã

|F l (w, x)| ≤ d _l (x)

^²

`²

U

xm+vw`wxyz±tI}qac§krtIw\oqxw\tvm°z±`wroqxtvwz±}tva

W 0 × R ^k

^ot

R ^o

(14)

:1 CH

²

U

xm¶Atv`wXlbE

knXtvoq^`bNmpxm

H c

}b Ixyob,w1o`}v§®w}b¦z±`§¸§§bExw `}Ir;oxrE§®mqbopoxwuIm

d°tvacIrxok¥tzoq^`b,v}vacboqbE}+mpIrb7xmscr§vmmpxr3v§A^nknAtoq^bEmqxmxwKrtvwXmpxmob3wr3k¥}bEmq`§yom3²

1mqbz±`§Cr^`tIxr3bEmz±tI}

F l

wn`xyok.xma.w1oqtI}qkTxw`}vroqxrb¦vm#tvloxa.v§AX}acbob3}m}btI¶lovxwbE.o^wÂnm°otºuI}IlxbEw\o

¶vmqbE§uvtI}qxoq^acm,Øwo^`b3}bz±tI}qb

F l

xm+xwuIb3w`bE}v§£lxVb3}b3w\oxv¶`§b7¤+xoq^ }bEmqXbNr;o+oqt

w l

¯lz±tv}

oq^`b,§1oqoqbE}EÃr3tvw\oqxwn`xok.xm+tI¶n\xtvXm#Im

F l

xm§xw`bN}+¤+xoq^ }qbNmpAbErooqt

w l

²

m¦mo1obEK¶Abz±tI}qbIÃX¤+^`bEw

F _l

xmtv¶loxw`bEKoq^vw`Âlm+oqt.wn`acb3}xrE§¨´ª®|CÃVxyo¦xm¦¥r3tvw\oqxwn`tvm z±`wroqxtvw®²m

W _l

^wX

Z

}b7r3tvacIr;omqbomEÃ`o^`bltIaTxwoqxtvw ^nk\Ato^`bEmqxm+xmlotva.1oxrE§§k z±`§¸§§bE®²³ ^`bEw

F _l

xm,tv¶òxw`bNSo^wÂnm,oqtK¶Impxm7blvwmpxtvw=Ã woq`}§W^nknXtvoq^`bNmpxm,xm7oqt vmmpaTb¥oqôº¶Impxm7z±`wroqxtvwmº¶Ab3§tvwùKot

L ^p (µ)

²S]^`b3w=ÃCr3tvacIrxoktvz

W _l

xac`§xbNmu\xw oq^o+oq^`b`tvacxwX1oqxtvw^nknXtvoq^`bNmpxmxm+z±`§y¸X§§bE£²

U

r3tv}}qbNmpAtvwm2oto^`b7w`tvwz±`wr;oxtIw§Vv}potzz±`wXr;oqxtvwX§£¨´ª®|CÃlxo+xm#xwuIb3w`bE}v§Xwoq`}§

oqt vmmpaTboq^o¦xo¦xm·`w`xz±tv}aT§kKrtIwIoxwn`tImE²«wlbEbE£ÃVAtv`§v}¦Ir;oqx11oxtIwKz±`wroqxtvwm¦mpXr^

vm

tanh

vwoq^`b§tIuvxmoxr¦z±`wXr;oqxtvw´v}qb,w`xyz±tI}qac§kr3tvw\oqxwn`tvXm+w actv}b3t1Ib3}NÃ

W 0

xm·rtIaº©

vroEÃ£o^`b3}bz±tI}qbº¤+^`b3w

U

}b3}qbNmpbEwIom¨´ª®|µ¶ImpbN´tvwmow}´vroqx¬oqxtvwSz±`wr;oxtIwmEÃ®xyo xm°`w`xz±tv}ac§k.r3tvw\oqxwn`tvmE²¨´tv}b3t1vbE}EÃvXtI``§}°Ir;ox11oxtIwcz±`wroqxtvwm#}b§mqt¶XtI`wlbN¥wX

oq^`bImqmq`acloxtIwo^1o

U

xm¶XtI`wlbNxm+§mqtTwX1oq}v§Ø²

& 5'+ À Á ¼ +2

Á À

5Ø3 ¼ ½

]^bT§bEv}qwxwù`Împbcxwwb3`}§Ww`b3o¤°tI}qÂ´v``§xrE1oxtIwm7rtvwXmpxmom7xw¸w`xwùo^`b.¶XbNmoX}acbob3}m

z±tI}scuvxvbEwovmqÂA²W«w tI`}z±}vacb3¤#tv}ÂAÃn¤#b,vmmp`acb7uvxvbEwKT`xmpovwrb

c

^tIw

R ^o

vw¤°b,ImqmqbEmm#oq^`b

\v§xokTtz£oq^b·w`bE`}§actllbE§Aooq^bb31v§oqxtvw¥Atvxw\o

G ⁱ

oq^vw`ÂlmWot

c(T ⁱ , H(G ⁱ , w))

²W³b¦lb3¸w`b o^`b,uv§tv¶X§Vb3}}qtI}acIlb7¶nk.oq^`b,X}acbo}qxractllbE§

H

z±tI}sv}vaTb3oqbE}m

w ∈ W

^¶nk

λ(w) = E c(T ¹ , H(G ¹ , w))

,

^+9I¯

¤+^b3}b

E

acbNwm·blAbEr;o1oxtIw®²,ª®bEv}qwxw`uxm¦xw´z{vro¦}acb3oqb3}·bEmpoqxa.1oqxtvwS`}qtI¶`§b3a:xw¤+^`xr^

¤#bcoq}koqtKtv`oqxaTx3b

λ(w)

xw0tv}lb3},ot ¸w0KIbEroqtv}

w ∈ W ^∗

^{Ã¤+^`b3}b}

W ^∗ ⊂ W

xm7o^`bmqbotvz acxw`xaTx3bE}stz

λ(w)

²]^`b}Ir;oqxr3v§£`}tv¶`§b3a xmo^1o

λ(w)

r3vw`w`to+¶Abb`Ir;oq§krE§r`§1obEwxm v``}t¬lxa.1obEoq^vw`ÂlmCoqt¦¸Xw`xyobwn`aº¶XbE}2tzV}qbN§xN1oxtIwmCtz

(G ⁱ , T ⁱ )

²W¨KtI}qb+`}bEr3xmqb3§kvÃI¤°bs`b¸w`b vwbEac`x}xr3§£bE}q}tv}¶nk

b λ n (w) = 1 n

X n i=1

c(T ⁱ , H(G ⁱ , w)).

^NI¯

]^xm·b3ac`x}qxr3v§bE}q}tv}¦r3vw´¶Xbcacxw`xacx3bNKoqt`}tn`rb

b w n

b3oqbE}vbNr;otv}N² I¬¢7mq^`t1¤smco^1o¥z±tI}wn`acb3}xr3§¦¨´ª®|CÃ

b w n

xm5mo}qtIw`uv§k¹r3tvwmqxmob3w\obEmpoqxa.1oxtIw

tvzw tIloqxa.§7v}vaTb3oqbE}vbNr;otv}N² ¨KtI}qb`}qbNrxmpbE§kIÃ+xyz

d

`b3w`tvoqbEmoq^`b&lxmowr3bStIw

W

^{Ã+o^`b3w}

c

ã¬Ü×Ò¬èÙ=Ö{ÕpÜ ÙØèåÕ2Ü¬Ó ×{ÙÜÒNæpÕ;ÊÓÙ®æpÜÒ¦åÕ2ÜÒ ¦æè;ÒÙGÓ Ò3á¬è;á¬×âè;×GÓÙØÓÔÕCëá¬ÒNæÙØÓ è;Ò\ç

(15)

d [1 K

lim n→∞ d( w b _n , W ^∗ ) = 0

v§act\momq`}b3§kv² sactvw`u´oqbEr^w`xrE§2^nknAtoq^bEmqxmw`b3bNlbEotKb3wmq`}b.oq^`xm }bEmq`§oEÃ+¤#bSvloltvacxw1oxtIw ^nknAtoq^bEmqxm¥oqt0o^`b´z±`wXr;oqxtvwX§sz±}acbE¤°tI}qÂµ±^nknXtvoq^`bNmpxm

H _d

^¯

c(T ⁱ , H(G ⁱ , w))

^ImCoqt,¶AbltIacxwoqbN£Ãvxwcoq^`b·mpbEwmpb#o^1o2o^`b3}b+xm27Xt\mpxoqxvbz±wr;oxtIw

c max

z±}tva

R ^o

ot

R

mqr^o^1o

v²

∀w ∈ W, g ∈ C(Z, R )

^vw

t ∈ R ^o

^Ã

c(t, H(g, w)) ≤ c max (t)

l²

E(c max (T 1 )) < ∞

"tv}Tz±`wroqxtvwv§¨´ª=|ÃW^nknAtoq^bEmqxm

H d

v}qb \`xyob w1o`}v§Ø² «wlbEbE£Ã#^nknXtvoq^`bNmpxm

H c

±n¯a.vÂvbEm

H (g, w)

¶XtI`wlbN"wX oq^`bE}qb3z±tv}bSltIaTxwoqxtvw o`}qwXmxw\oqt w ^nknXtvoq^`bNmpxmtvw

T 1

w

c

^² ^"`tv}

xwmpovwrb·xyz

c

^{xmoq^b} (2Xr§xlbNwlxmpovwrb¦xw

R ^o

Ãno^`b3wltvacxw1oxtIw¥xm°tv¶`oxw`bN¥xz

T 1

^Im°TmpbNrtIw

tI}`b3}actvacb3w\oE²

d°tIaTX}bE&ot´oq^bwn`acb3}xr3§#r3ImpbIÃW¤°b^¬vb.o¤#tI`lxoqxtvwv§°lx¥r`§oqxbEmTxw5o^`bz±wr;oxtIw§

z±}acbE¤°tI}qÂ£¤#bv}qb#¤#tv}Â\xw`u¦¤+xyo^c}vwltva'bE§bEacb3w\omC¤+xoq^c1§`bEmCxwcz±wr;oxtIw§mqIrbvÃ1¤+^b3}bEvm

I¬¢lImqmq`acbEmo^1oWtv¶XmpbE}q11oxtIwm®¶Ab3§tvwuot7¸w`xoqb+lxacb3wmqxtvwv§nmqIrb 1actI}qbEt1vb3}NÃNXbE}pz±bNr;oWÂnw`t1¤+§y©

bNluvb#tzXtv¶mqb3}vbN7z±`wroqxtvwmCxmCmpbE§ltIahoq^`b+rEvmqb#vw¤#b^¬vboqt·oÂIb°xw\oqt7vrErtvwIooq^X1oCz±`wroqxtvwm

v}qb¦acbEImp`}bE1osT¸wxyob,w\a¶Ab3}+tztv¶mqb3}11oxtIwAtvxw\omE²

!

v5À À ¼ *``5À

«w7`}vroqxr3v§vmpxoqX1oqxtvwXm3ÃEbEvr^7tI¶mpbE}qIbEz±`wroqxtvw,xm®lbEmr}x¶XbN·¶nk¦#¸w`xoqb2wn`aº¶XbE}®tznxw`lo 1tvlo`lo

Xx}mEÃ1mpr^Tvm

(x j , g(x j )) j∈{1,...,m}

²³br^`tntImqb2o^`bz±tI§§t1¤+xw`ua.1o^`b3a.oqxr3§\actllb3§£±^nknAtoq^bEmqxm

H e

¯

v²

(X _j ⁱ ) i∈ N j∈ N

xmcmqb\`bEwrbtzxwlbEXbEwlbEwIo¥mqb\`bEwrbNmºtvz}wltIa 1}xv¶`§bNmº`b¸w`bN5tIw

(Ω, A, P )

w¤+xoq^ 1§`bEmxw

Z

^²

l²+s§§

X _j ⁱ

}bxlb3w\oxrE§§klxmpoq}x¶``oqbETwX,oq^b°xwlr3bEº`}tv¶v¶`x§xok¦acbNvmq`}qb°tvw

Z

^xm

µ = P _X

^²

`²

(E _j ⁱ ) i∈ N j∈ N

xm0mpb Ib3wr3bKtz,xwXlb3Ab3w`b3w\omqb\`b3wXrbEm¥tz7}vwltva 1}xv¶`§bNm.lb¸Xw`bE tIw

(Ω, A, P )

w¤+xoq^ 1§`bEmxw

R

^²

²"`tI}s§§

i

^Ã

(E _j ⁱ ) j∈ N

wX

(X _j ⁱ ) j∈ N

}b¦xwlbEXbEwlbEwIoN²

l²

E E _j ⁱ

= 0

^vw

E E _j ⁱ ^q

< ∞

Ã¦¤+^`bE}qb

q

xmo^`b0rtvw~`uIoqbSb3lXtIw`b3w\ooqt

p

mqbE"xw

^nk\Ato^`bEmqxm

H c

Ø1©rN¯;²

"tv}bEIr^

i

Ãnoq^`b,mqb\`bEwrb

(X _j ⁱ ) j∈ N

rtI}q}bEmqAtvw`m2oqtctv¶XmpbE}q11oxtIw¥AtvxwIom°z±tv}#oq^`b¦z±`wXr;oqxtvw

G ⁱ

^wX

o^`b·mqb\`bEwrb

(E _j ⁱ ) j∈ N

rtv}}bEmqXtIw`mWotacbEImp}qbEaTbEw\ob3}}qtI}mWz±tv}2o^`bEmqbtI¶mqb3}¬oqxtvw.Atvxw\omE²C¨´tv}b

}qbNrxmpbE§kIÃlxyz

g ⁱ

^Ã

x ⁱ _j

^vw

ε ⁱ _j

}b7}qbNmpAbEroqxvbE§k¥}bEv§xEoqxtvwm#tvz

G ⁱ

^Ã

X _j ⁱ

^vw

E _j ⁱ

Ã`¤°bImqmq`acb¦oq^os¤°b tI¶mqb3}vb#oq^`b·mpb Ib3wr3b

y _j ⁱ = g ⁱ (x ⁱ _j ) + ε ⁱ _j

²W¨KtI}qbEt1vb3}NÃ¬¤°b·vmmp`acbo^1o¤#b+Ânw`t1¤ tvw`§ko^`b

m ⁱ

^¸}mo

1v§`bNmtzoq^`xmsmqb\`b3wXrbv²

k\Ato^`bEmqxm

H e

Ato^`bEmqxm,xm

H e

Gv¯;Ã¤+^`xr^0mq¬klm¦oq^X1o,oq^b¥¤#¬kStv¶mqb3}11oqxtvwAtvxwIom}bc}vwltIaT§kSr^`t\mpbEw {xØ²bv²Ã

(16)

0 i

P _X

¯ºr3tv}}qbNmpAtvwX`m,oto^`b¤#¬k0xw\oqb3uI}v§mº}brE§r`§1obE

µ

^¯;² ^e·w vwxwIo`xoqxvbXtIxw\o.tznxb3¤,Ã o^`xm°acbNwm°oq^X1o+¤+^`b3wwxw`loz±`wr;oxtIwxm#a.1or^bE.otz±wr;oxtIw§£¤#b3xuv^\omoq^Xw`Âlm°oqtTxw\ob3uv}§

rE§r`§1oxtIw®Ã}qtI¶¶`§btI¶mpbE}q1oqxtvwKAtvxwIoms^¬Ibactv}b¤#b3xuv^\osoq^X1o7§bNmqm`}qtI¶¶§btIw`bEmE²]^`xm·xm

\`xoqb,wX1oq}v§Ø²

·m7z±`wroqxtvwmº}bTtIw`§k´Ânw`t1¤+woq^vw`Âlm¦oqtKtv¶XmpbE}q11oxtIwmEÃ®¤°b¥rEw`wtortIaTloqb¥vw\knactv}bToq^`b

xw\oqbEuv}§m¤+^`xr^}bv``}t¬lxa.1obEo^w`Âlmoqtb3ac`x}qxr3v§°acbEvwmE²¨KtI}qb`}bErxmqb3§kvÃW¤#b}b3`§vr3b

R F l (w l , x) g ⁱ (x)dµ(x)

^¶nk

1 m ⁱ

m ⁱ

X

j=1

F l (w l , x ⁱ _j )y _j ⁱ .

^N¯

]^b3}bz±tv}bvÃ\o^`b,b3ac`x}qxr3v§£b3}}qtI}

b λ n (w)

uvxvbEwxw b\1oxtIw Nxmsv``}t¬nxa.1obE¥¶nk.o^`b7z±tv§§t1¤+xw`u bEac`x}xr3§£bE}q}tv}

λ ^m _n (w) = 1 n

X n i=1

c



t ⁱ , U



w _o , 1 m ⁱ

m ⁱ

X

j=1

F 1 (w 1 , x ⁱ _j )y _j ⁱ , . . . , 1 m ⁱ

m ⁱ

X

j=1

F k (w k , x ⁱ _j )y _j ⁱ







 ,

^Nv¯

¤+^b3}b

t ⁱ

xmsT}bE§xE1oxtIwtvz

T ⁱ

^vw

m = inf 1≤i≤n m ⁱ

^²

]^`xmcb3ac`x}xrE§+b3}}tv}NÃ2¤+^`xr^¹xmc¶vmqbE¹tvw¸w`xoqbKwn`aº¶XbE}.tz·wn`acbE}qxr3v§+¬v§bEmEÃxmcbEvmqk&oqt

bE1§1obxw`}vroqxrb·vw¥rEw¶Ab¦mpbNcoqtTtv¶`oxw¥bEaTx}xrE§Atvloxa.v§AX}acbob3}m3Ã

w ^m _n

²2e·}°uItI§

xmotcmq^`t1¤"oq^o

w _n ^m

xmscrtIwmpxmpoqb3w\osbNmoxa.1otv}+tvzw tIloqxa.§®v}vacboqbE}vbEroqtI}EÃlxG²bI²rtIwnvb3}uvbNm ot

W ^∗

^²

+ + ')

d°tIwmqxmpoqbEwrk¹tz7oq^`b`}tvAtImqbE bEmpoqxa.1oqxtvw tvz,tvloxa.§·}acb3oqb3}m.xm¥uIxIb3w ¶nko^`b´z±tI§§t1¤+xwu

o^`b3tI}qbEa

< ¼nÀ ¼

-JIf%G;LAEF2 3C'1L0%646/d4

H b

^a

H c

^a

H d

)-I

H e

^a,b

%TL )8%

P

^e )=]>?3546'^46@A;<%G=oE

n→∞ lim lim

m→∞ d(w _n ^m , W ^∗ ) = 0.

]^`boq^`bEtv}b3a xmTw0b3\ob3wmqxtvw0tz,IN¢²KoTmq Vb3}m,z±}tva ´mqacv§§°§xacxyo1oxtIw o^`b§xaTxoºxm

mqb\`bEw\oqx§=tIw`bvÃA¤+^`xr^KacbEwXmso^1o¦xw´tI}`b3}+ot}bEvr^Kuvxvb3w´`xmpovwrb,ot

W ^∗

Ão^`bTw\a¶Ab3}tvz bE1§1oxtIwAtvxw\om#z±tv}+bNvr^z±`wroqxtvw0

m

¯lb3Ab3wX`m+tvwoq^b,w\a¶Ab3}stvz=z±`wroqxtvwm

n

^¯;²

8:C7

#< /1,:/1 5 3$ ¥<

+ + ) *A) $ $!) "Y +

1oqxtvwSAtvxw\omEÃ£oq^X1o,xm·o^`b3}bcxm7 mpb \`b3wr3b

(x j ) j∈ N

mqr^oq^o·z±tI}wnkKrtvwXmpxlb3}bE´z±`wroqxtvw

g

^Ã

¤#b7Ânw`t1¤

g(x j )

z±tv}sv§§

j

²¨´tv}b3t1vbE}EÃ\¤°bImqmqàcb¦oqôs¤°b,Xmpb¦oq^bmqvacb¦wnàº¶XbE}stztv¶mqb3}11oxtIw

(17)

66G

Atvxw\omz±tv}WbNvr^,z±wr;oxtIw Ølb3wtoqbN¶nk

m

¯;²C]^`bEmqb+r3ImpbNm=xwr§lb#z±tI}xwmpovwrb+mqxyo1oxtIwmxwT¤+^`xr^

acbNvmq`}qbEacb3w\oWXtIxw\om°}b+`wlbE}2mqb3}r3tvw\oq}tv§®{bv²u²Ã\mqAbEr;o}qt\mqr3tv`xr#acbEvmq`}b3acb3w\omWrtv}}bEmqXtIwlxw`u

ot.mpAbEr3xy¸Xr¦z±}b\`bEwrxbEm¯;²e·}sr3tv`}mpbIÃ\oq^`xmsr3Impb7xm+rt1Ib3}bE¥¶nk.o^`b3tI}qbEa v²

e·w.¦`}vr;oxrE§nAtvxwIo2tvzAnxb3¤,Ã1o^`bsmqxyo1oxtIwºxm2r§bEv}q§kmqxac`§b3}Co^wToq^b+uvb3wb3}§ntvw`bI²«wXlb3bN

bNvr^z±`wr;oxtIw

g

rEw¶Xb,r3tvwmqx`b3}bEIm+IbEroqtv}xw

R ^m

Ã`xG²bI²Ã

(g(x 1 ), . . . , g(x m ))

²2]^`bE}qb3z±tv}bvÃn¤°b rEwmq`¶`acxoo^`bEmqbaº`§oqx¬v}qx1obtI¶mpbE}q1oqxtvwmVot¦wn`acb3}xrE§I¨Sª®|C²1]^`xm`}qt\vr^,¤vm=`}qtIXt\mpbN

xw ! ; ;¢ ²¥ª®boXmrtIwmpxlbE}7oq^`b¥mqXbNrx§2rEvmqbTtvz mqxwuv§bT^x``b3w&§¬kIb3}7Ab3}rb3`oq}tvw¤+xyo^0tvw`bc}bE§

tIloqloE²inXr^ c¨´ª=| acvm+ºz±`wroqxtvw

g

^oqt

V (g) = X k i=1

a _i T



b _i + X m j=1

c _ij g(x j )



 .

^EI¯

«wKmqr^ Tmqboqoqxw`uÃltI`}+actllb3§®a.vm

g

^oqt

H (g) = X k i=1

a i T



b _i + 1 m

X m j=1

F i (w i , x j )g(x j )



 .

^3\¯

e·w`}Ir;oxrE§XtIxw\o,tz#\xb3¤,Ã®oq^`bca.xwIl1w\ovuvbºtz°tI`},`}qt\vr^Kt1vbE}o^`bcwn`acb3}xrE§Ctvw`b

xwoq^`xm+mpb3opoxw`ucxm#oq^`b,xwr3}qbNvmqbEXblx¶x§xyokxw`rbN¶nk.o^`b7mpb7tvz=oq^b,}acbo}qxr+z±wr;oxtIwm

F i

²

³b r3w5z±tv}cxwXmowr3b¥ovÂvbxw\oqt&vrErtI`w\oTmqaTtntvoq^`w`bNmqmºtz·tv¶mqb3}vbNz±`wr;oxtIwmT¶nkXmpxw`u&mpxac`§b

ºz±bE¤ w`tllbNm3Ãborv²¯²]^`xms§§t1¤smot.}qbNlr3b·o^`bwn`aº¶XbE}+tzz±}qbEb,}acbob3}m#xwoq^b,aTtllbE§®¤+^`x§b

xwr3tv}XtI}oqxw`u,blAb3}qo°Ânw`t1¤+§bEluIbsxw\otxoEÃn¤+^`b3}bEIm2xw¥o^`b·wn`acbE}qxr3v§X`}qt\vr^®ÃI¤°b·w`b3bN.xwbEIr^

wb3`}tvwtvw`b,r3tvw`w`bNr;oxtIw¤#b3xuv^\oz±tv}+bNvr^¥z±wr;oxtIwKtv¶mqb3}11oqxtvwXtIxw\oN²

¨KtI}qbEt1vbE}EÃ°xyoxm¥tI¶n\xtvXmcoq^ow v``}tv`}xoqbKr^`tIxr3bKtz,}acb3oq}xrz±`wroqxtvwm

F _i

§§t1¤sm ot}b3`}tllr3b´b`vroq§k oq^`bwn`acb3}xrE§actllbE§ØÃ·¤+^`xr^ `AbEv}m¥oq^`xm¤#¬k vmmqXbNrx§7r3Impb´tvz

o^`bcz±`wroqxtvwv§°v``}tIvr^=².«wlb3bNbEvr^

F _i

r3vw&¶Xb¥vwxw\oqbE}qAtv§1oxtIw&mq`§xwb.tv} ÂvbE}qwb3§2¶ImpbN

actllbE§C`bEmqxuIw`bEmpr^´oq^o¦z±tI}¦vwnk´mpb3o¦tvz¤°bExuI^\om

c _ij

ÃVoq^`bE}qbc}b¤#b3xuv^\o·IbEroqtv}m

w _i

mqr^´o^1o

F _i (w i , x _j ) = c _ij

^²

"xw§§kIÃ=o^`b¥`wxIb3}mqv§Cv``}t¬lxa.1oxtIw}bEmq`§o,uvxvb3w&xw ! ; ;¢°xm,§bEmm,uvbEw`b3}§oq^Xw0tv}m,Im,xyo

}b3§xbEmtvw`w`xz±tv}a mac`§xwu²

"tv},§§Coq^`t\mpbT}bEvmqtvwXm3ÃV¤#bº¶Ab3§xbEvbºoq^o7oq^`bTz±`wroqxtvwv§2`}qt\vr^´xm¦aTtI}qbTxwIob3}bEmpoqxw`uoq^vw

o^`bTa`§oqx1}xoqbc``}tIIr^®ÃAb3vbEwKz±tv}7`wxyz±tI}qac§k´mqvaT§bN z±`wroqxtvwmE² (WlAb3}xacb3w\om·b3lXt\mpbN´xw

mqbEroqxtvw %crtvw`¸}qa oq^`xm+AtvxwIostvznxb3¤,²

( *) * )+ ) &

wX1oqxvbv``}tIIr^¥oqt.tI`}m3²]^b,acvxwKxlbNcxmsmqxaT§koqtcoq}wXmz±tI}qa bEvr^z±`wroqxtvwv§®tv¶XmpbE}q11oxtIw

xw\oqt }b3}qbNmpbEwIo1oxtIwKoq^o§§t1¤sm¦bEImpk a.wx`§oqxtvw®²T¨Ktv}bº}qbNrxmpbE§kIÃ®§xmpo,tz#tv¶mqb3}11oqxtvwXm

(x j , g(x j ) + j ) j∈{1,...,m}

xm}b3§IrbE¶nkKw´v``}t¬nxa.1oxtIwtvz

g

^Ã

A(g)

r3tvwmpoq}r;obEo^w`Âlmsoqt o^`b,tv¶XmpbE}q11oxtIwmE²

Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis

HAL Id: inria-00070768

https://hal.inria.fr/inria-00070768

Submitted on 19 May 2006

HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis

Fabrice Rossi, Brieuc Conan-Guez

To cite this version:

Fabrice Rossi, Brieuc Conan-Guez. Functional Multi-Layer Perceptron: a Nonlinear Tool for Func-

tional Data Analysis. [Research Report] RR-5228, INRIA. 2004, pp.35. �inria-00070768�

ISSN 0249-6399 ISRN INRIA/RR--5228--FR+ENG

a p p o r t

d e r e c h e r c h e

Thème COG

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE

Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis

Fabrice Rossi — Brieuc Conan-Guez

N° 5228

Juin 2004

Unité de recherche INRIA Rocquencourt

Domaine de Voluceau, Rocquencourt, BP 105, 78153 Le Chesnay Cedex (France)

Téléphone : +33 1 39 63 55 11 — Télécopie : +33 1 39 63 53 30

∗†

‡

∗

†

‡

R n

n

s + 1

(g 1 i , . . . , g s i , t i ) i∈{1,...,n}

t i

t i ∈ R o

g i l

t i

(g i 1 , . . . , g i s )

s + 1

(g 1 , . . . , g s , t)

g l

t ∈ R o

µ l

σ

R u l

g l

L p l (µ l )

n

T

R

R

R n

w

b

x ∈ R n

N (x) = T (w.x + b)

x 7→ w.x

x = (g 1 , . . . , g s ) ∈ L p 1 (µ 1 ) × . . . × L p s (µ s )

(g 1 , . . . , g s ) 7→

X s l=1

Z

f l g l dµ l ,

(f 1 , . . . , f s )

f l g l ∈ L 1 (µ l )

E = L p 1 (µ 1 ) × . . . × L p s (µ s )

T

R

R

f l

f l g l ∈ L 1 (µ l )

b

N (g 1 , . . . , g s ) = T b + X s l=1

Z

f l g l dµ l

!

.

s

F 1 , . . . , F s

H a

W l ⊂ R v l

F l

R ⁿ

(g ₁ ⁱ , . . . , g _s ⁱ , t ⁱ ) i∈{1,...,n}

t ⁱ

t ⁱ ∈ R ^o

g ⁱ _l

t ⁱ

(g ⁱ ₁ , . . . , g ⁱ _s )

t ∈ R ^o

R ^u ^l

L ^p ^l (µ l )

R ⁿ

x ∈ R ⁿ

x = (g 1 , . . . , g s ) ∈ L ^p ¹ (µ 1 ) × . . . × L ^p ^s (µ s )

f l g l ∈ L ¹ (µ l )

E = L ^p ¹ (µ 1 ) × . . . × L ^p ^s (µ s )

f _l

f _l g _l ∈ L ¹ (µ l )

F 1 , . . . , F _s

H _a

W l ⊂ R ^v ^l

W l × R ^u ^l

w _l ∈ W _l

F _l (w l , .) ∈ L ^q ^l (µ l )

q _l

p _l

L ^q ^l (µ l )

E = L ^p ¹ (µ 1 ) × . . . × L ^p ^s (µ s )

a _i T

b _i + Z

F _i (w i , x)g(x) dµ(x)

a _i

b _i

w _i

F _i

C ⁿ

R ⁿ

M ⁿ

R ⁿ

d _C

M ⁿ

d _C (f, g) = X

1 2 ⁿ min

ρ _K (f, g) = sup