Bayesian Feature Weighting for Unsupervised ... - Semantic Scholar
!"$#% &(') * &+-,./0 ( 1 32 4 5 -67'('(8 9 :&=@?A9B>C$9 ( D EFHG1FHI(J"KLINMPORQ&FHGG1OTS U(KLQ&VWOXV&FZY[I\F^]_GNKL` ab1ced!fhghijb1klgmon0pPmli ceqrghb1fsrt uvbketb wkLuyxlbfDz{uyg}|@m!n~Bfhuyghuzh(pPmlyqLiLud 0doket mlqLxob1f1r~p
pBdokedoLd E
KLW&`GNKL`1OQ U(KrG1KL]F( &OX&`NOQ a
bcedof{gi b1kHgm!n s^gd\guvz{ghutz wkLuyxlbfDz{uyg}|@m!n~Bfhuyghuzh(pPmlyqLiLud 0doket mlqLxob1f1r~p
pBdokedoLd orL d!kem!ghebfuykez{gdoket b¤Lbfbn_b1d\gqLfb"¤Bbuv¥oHghuvkL¥ªcevd¡|rzdªzhuy¥o¢ kLuy¯RtdokHgPfmovbos^uykRt bgLbk^qLiRb1fPmonTced\guyb1klgDz0gbkeez0gm"b zhijdoyÑñ¬^kLm\¤uyke¥¶¤LutDZ¥ob1kLb1z
cLfm\xHurb ijmlfhb ruvzt fuvi uvked!¢ )bcLfb1zhbkHgd>i bghLmrn_mlf x¡dofhud!eybzhbvb1t5¢ h g mlfh|´uykLn_mofijd!ghuvmokX¤BmoqL)Rb3m!n¥ofb1d!g Rb1kLb ¯eg1(ÚÛkÐgheb1zhb guymlk£¡¤Bbuv¥oHghuvkL¥¦uyk§d!k¨qLkezhqLcbfxHuzhb1¨ybNd!fkLuyke¥ ! d cecLyutd!ghuvmokez1Ax\dofhud!Lvb¶zhbvb1t5guymlkÐuvz d!g/ghLb3ruvzt fb guymlkÐm!n tmokHghb©Hg
qez{uvkL¥ª~«d¡|lb1zhuvdokzhLfuykL¬\do¥obo«®«Lbedozhuvz h g e b¶uyk^xlb1z{ghuv¥ld\gmof/d!kR´i@d¡|Zb¶edlz{bN)mokÐcLfuymlf/uykrn_mlfhi@d!¢ n_mlf0ghebijmrrbRuvzBd°¯ekLuyghb
iju±©^ghqefhbmon[i"qLyghuvx\d!fu±¢ h g v u o m kA ÚÛk´¥lbkLb1fdoñLm\¤BbxlbfNRi@do¬HuvkL¥uykLn_mofi bNÊrbNt uz{uvmokRz d!ghb ²°doqezz{ud!kZruz{ghfuyLqLghuvmokez1)brb1ijmokez{ghfDd\gb o m . k ghLb3qrghuvyuyg}|Ðm!nx\d!fud!Lvb1z"ijd¡|)kLmogb¶n_b1dlz{uvLvb3zhmZ¤Bb Lm\¤)gLb0ijmrrbHced!fDd!ijbghbfDz[doke/t vqez{ghbf&dozz{uv¥okL¢ B ¤ o m L q ªvuv¬obghmjfbv|@mokzhtDLb1ijb1zBghm@zhbvb1t g«x\dofhud!Lvb1z«doqrghmo¢ ijbkHgDzªtdok³Rb´t moijcLqLghb1³zhuvi"qLygdokLbmlqez{v|µqRz}¢ @ i \ d g v u t1d!vy|l uvkL¥¶d!kb·@tuyb1kHg
¸º¹%d!v¥omlfhuygheiP»cLcLv|^uyke¥¶moqLf 0d!fud!Lvb(z{b1ybNt5ghuvmok¦gb1tDLkLuòHqLb1z¶n_mof¶zhqLcbfxHuzhb1¦ybNd!fkLuvkL¥ ~«d¡|obNz{ud!kz{LfuvkL¬\d!¥obBijmrrb^gm°dt mlijcLyb©"cLfmor¢ ed¡xlb Rb1bk´¤uvrb1y|Zz{ghqRruybNT/¾Lmlf
b©rdoijcLybNzTzhbb½²bmlfh¥lb vbi uvkmlr¼}b1t gWfb1tmo¥okeu±guymlkª½a
qL|^¥oqLvq[o~«dofhkedof[ d!kR ¾LmHz}gbfºÕNÖoÖ^ó^ Ò¥d!ke/ÓlmofDLdok"À!ÂoÂeÕo1sri uyghd!ke ô°mlLk rb³¾efhb1u±gDdozXd!kR¿¾emofDz{|HghÁÀ!ÂlÂlÀoà mlqLfXb ©rcbfu±¢ Õ1ÖlÖoõHÃ5Ws^qefhcLfuz{uvkL¥ov|o1ghebBzd!ijbºt1d!kLkLmogWbPzd!u d!moqLgWqLkr¢ ijbkHgDz|^uyb1v3¥om^mrªfb1zhqLygz1 zhqLcRb1fhx^uz{bN vb1dofhkLuvkL¥RW»zhurbBn_fhmli ked!uvxob«z{bNd!fDtD ijb gLmrLz ghebB¤Bmof¬m!nW½ö[uvq[H÷edokL¥e!Ødoyqei"m
d!kR"öAd¡¤fbkRt bBÀoÂoÂHÀoà zhbbi@z0ghm bgLbmlkLy| cLfuykRt uvcLybN@d!cLcefhmHdotD ghm/gLuzºcLfmoL¢ Ä ÅlÆÈÇÊÉ˵ÌÎͧÏ)ÇÊÅL赮 vbiöAuyq³ø ùú\ûºcefhmo¼}b1t5gghebjed\gdªghm(d3ym\¤Bbf°ruvijbkezhuymlk ®«Lb§uvi cmofhgdoket b§mon´qLkezhqLcbfx^uvzhb1ybNd!fkLuyke¥¿uz¥ofm\¤«¢ ¤ijuyu±gh©^ÔgqLØ«fhb"pBi » mrrd!b1kevµzm!d!n cLghcLLv|XbL¹Zd\d!gDdLf¬o«m\~Px)|tDed!d!kRuvd!kµv|l¹(guvt1mld!kHvghy|ªbuypBkHdoghb1fh¥ovm(fDd\gghm ¢ uvkL¥(uykÐi@d!k^|Zfb1zhb1doftD)d!fb1dlz[uvketyqeLuykL¥(euymluykrn_mlfhi@d!ghutz1 uvkL¥XmoqrgªghLbZmoghLb1f@ced!fDd!ijbghbfDz1ºgLb|zhdoijcLyb(mlkLv|.gheb Ld!gd(ijuvkLuyke¥e mor¼}bNt5g"fb1tmo¥lkLu±guymlk[ Ld\gDd!edlz{b¶tyqez{ghb1fhuvkL¥R Lfm\¤z{uvkL¥Xgm^mozªn_mlfLuy¥lu±gDd!°yuvLfDd!fuybNz
t movd!mofDd\ghuvxobZ¯e±¢ ijt mlu±ij©^gcRqLmlfhkLb@bdokHygvz1mrtd\®«gLuymlbk´cLx\fhmodo¼}fhb1ud!t Lghuvvmob1k@z°m!donAkeZghLgb°LLb@d\k^gDd/qLi"gm bd"f/ym\mo¤BnBbØ«fBpBr» u±¢ ghb1fhuvkL¥¶dokeuykrn_mlfhi@d!ghuvmokfhbghfuyb1x¡doº½~BvbuÑeÒ¥¶doke(ÓlmofDLd!k ijbkezhuvmok/uzAkLb1b1rbNghmt mokRz}gfhqet gAb ·¶tuyb1klg&¹Zd!f¬om\xtDed!uvkez1 À!ÂlÂlÀL ~«dofhkedofÔd!ke¾emofDz{|Hgh³À!ÂlÂLÕl ~«dofhkedof[Pa
qL|^¥oqLvq d!kR¶¾Lmlfzh|HghªÀ!ÂlÂLÕloaqe|H¥lqLvq¶b gd!ÑHÀoÂoÂlÀLl²movqL[Ls^vmokeuyi gh×fDm\d!¤BWrbxlmobi@fN\d!x\uvk(d!fd!uvdokeL[yebLzhb1bkevb1t t blgheuvmomokjkeb edoymHz&z{gbNm/zBRghLb
brmouykHkLgbqLu±uvgk uyxlghb/LbkLm!zhcguyb1mlt5k ¢ d!kRÔ®&d!i@d¡|om¦Õ1ÖlÖoÖe ×m!n_i@d!kekdoke¦Ø0qLÙ1uvtDed¦ÕNÖoÖoÖHÃ5¦ÚÛk ijmlz{gm!nAgLb1zhb°z{bg{ghuvkL¥HzrmlkLbg}|Hceuvt1d!vy|@b¥luykezed\gd d!kRd!y¢ m!n ¤ed!gdlt5gqed!Tx\d!fud!Lvb1z«d!fb°Rb1uyke¥¶z{b1ybNt5ghbNT |rz{uz^|(¤Pb1uy¥llguyke¥3mlfzhbvb1t ghuvkL¥dzhqLezhb g/m!nºuvkrn_mlfhi@d\guyxlb n_b1d!ghqLfb1z1ÚÛk.t moijcLqLghbf"xHuzhuymlk[An_mlf b ©Ldoi ceyblWuvk^xob1z{ghuv¥ld!¢ n_ÚÛmokfghi euvuyz
©^ghceqLd!fcb bijfNemr¤Brb bcLzfdob1kezhbkHg
b ©rdªcL~Bd!d¡uvk(|lb1Lzhm\uvdo¤Èku±zhgL|^fuyuvkeb¬¡Ldoz¥ob/d ijgfmrdokerbz{¢ ghmlfzjmonÜghb1kÎdozz{uv¥ok¦¤Pb1uy¥lHgz ghmÐn_bNd\gqLfhbNz¶zhqetD³doz@t mlymlqLfN cedofhb1klgi bghLmrÐn_mlf"x\d!fud!Lvb¶z{b1ybNt5guymlk£¡¤Bbuv¥oHghuvkL¥R®«eb z{ghbfbmRºijm!guymlk[0gb ©^ghqefhb(d!kRÔzhed!cbo³²bkeb(b ©rcLfb1zz{uvmok fbvbx\d!kHgWx\dofhud!Lvb1z&d!kR ijmrrb^cedofdoi bghb1fzWd!fbPt mlijcLqrghbN d!kRd!v|^zhuz¤uyghÎaÒ»Ýijut fm!¢Ûd!ffd¡|rz1¤LbfbmokLbZtyqRz}gbfDz xobNt5gmofDz½_ced!ghuvbkHgzDäuygh¶ghLmlqezhdokeLzºm!nTbkHghfuvb1z½¥ob1kLb1zDÃ5Huvz ¤uygh(d!kb ·¶t uvbkHg¸P¹7doy¥lmofu±gLi Þߺàlá}âHãä}åÛâHæèç æèé ê1ëèçHâHê1ìríá}æèî5êëã1ä{ïoíä5ð
ý ü þý ˵ǴÅ!ÿ ÇÊÅHÆ ³ ) b Rb1¥ouvk¤u±gd@zhuvi ceyb/b©rdoijcLyb/¤euvtDuvyvqez{ghfDd\ghbNz«gheb qrguyvu±g}|3uykx\d!fud!Lvbzhbvb1t ghuvmokn_mofqekez{qecRb1fhx^uz{bNªvb1dofhkLuvkL¥R ö[bg°ghLb@Ld!g d )b@ruz}gfhuvLqrgb1Zm\xlbf°dªijuy©^ghqLfbjm!nºiqL±¢ ghuvx\d!fuvd!ghb¥ldoqezz{ud!kez1
$½ # à ¤Lbfb * ij+ u±©^uvgz/qLghfhLb/b@tmorijuvijcRbmlkekLzhbuykHmlgDkÐz, m!# nºgLdob¶ke L d!g dL d! !*fb ghuez" b/ghLi &b@bN%(d!k^')kqL id!keRb1f/t mom!¢n x\d!fuvdoket b n_mofi uy©^ghqLfb/t ml i cmokeb' kH .g -\Ld!kRªgLb t vqez{ghb1fdoz{¢ zhuy¥lkLijbkHgcLfhmled!euyvu±guybNz z{qei ghm(Õl¾Lmof«gLuzb ©Ld!ijcLvbo ¤Bb°dlzhzhqLijb°d gm!gdoTm!nWghL f bb°iju±©^gqLfhb/tmoijcRmlkLbkHgDzrrud!¥o¢ mokRd!t m\x\d!fud!ketb¶i@d\ghfut b1zjdokeÔLuyijbkRz{uvmok * +0/ õLÔÚÛk doeru±guymlk[L¤Bb/z{bgBgLb/ijb1dokezBghm 122 Õ 4 À 9;:: 122 7 4  9;:: 122 8Ö 4 7 9;:: 22 5À 4 6 :: 22 > 4 Ö :: 22 7 4 õ :: 2 : 2 : 4 6 > 4 ó 7 # / 2 8 4  : # = / 2 ? 4 À : # @ / 22 688 44 A :: 3 8Â8 4v4 ÂÕ < 3 ?Â? 44 6À < 3 8Â8 44 Â7 < d!kR/dozz{uv¥okghebºx\d!fuvdoket b B C Õ/ÕÕÀ°À/GÀ FHld!ke°gLb0ijuy©H¢ ghqefhb/cLfmoRd!Lvu±guybNz /D 8 4 6oõ°/E? 4 ÀoD õ? 4 6IAGFJH_ ²uvxobk¨d.gfdouykLuvkL¥¦z{bg3m!n Ld\gDd.cmouvklgDLz K© 8© = 4M44 8© =ONONP zd!ijcLvb1)n_fmoi7ghLbªghfqLb¶iju±©^gqLfhbruz}gfhuvLqrg uy% mlk[ % ¤Pb¶% bNz}gu±¢ i@d\gbghLb(ijmrrbced!fDd!ijb gbfDz d!keQ #ÈqezhuykL¥X¸P¹X0)b dozzhqLijbgLRb B zdofhb¬^kLm\¤k[^LqrggLb/d!f¥oqLijb1klg«b ©^gbkeLz ked!ghqLfDd!vy|"ghm"d" OS zhtbkedofhuvm°¤u±g¶qLkL¬^kLm\¤kjx\d!fuvdoket bNz ¾Lfmoi d!m\xoblºuyg¶uvz@docLcedofhb1klg ghRd\g@gheb¯efz{gjghLfbbn_bNd\ghqefhbNzjm!n Ld!gTd d!fbÔqezhb n_qe¶uyk x\d!f|^uykL¥§rb1¥ofbb1z´n_mlf.t dozz{uy¯Rtd!¢ ghuvmokA)pPmok^xob1fzhbv|oAghLb3vdlz}g"ghLfbb@n_bNd\gqLfhbNz ed¡xlb@mokLv|Ðd i@d!f¥ouvked!eVb Uñb1t5gPmok¶rbghbfijuykeuykL¥ ghm ¤LutD¶t mlijcRmlkLbkHgºuvk gheb°ghfqLb/ruvz{ghfuvLqrghuvmok(djLd!gd cRmluykHgbvmokL¥Hz »z3uvyvqez{ghfDd\ghbNÎ^|¦ghLb)t mlklgmoqLf3cLvm!gzuvk ¾&uy¥lqLfbµÕouykr¢ t vqeruvkL¥XgLbÊdoz{g¶gLfhb1bZuvfhfbvbx\d!kHg@n_bNd\ghqefhbNz¶uvk³ghfDd!uvkLuvkL¥ b ©Ldlt bfed!ghb1zt dozzhu±¯Rt1d\guymlkZmokÊghLbjiju±©^gqLfhb@tmoijcRmlkLbkHgDz b1tdoqezhbʤBbÊi@d¡|³rb gb1t5guruymHz{|^ketfdlt uvb1z@uvk¨zd!ijcLvb1Wz A Ø0fqLkLuvkL¥°gLbuvfhfbvbx\d!kHg n_b1d!ghqLfb1z0LmoLzijmofbcLfmoijuz{b«n_mlf dZ¥lbkLb1fdoyuvÙbNÐb1z{ghuvi@d\ghbb1tdoqezhbª¤Bbª¤uvy«b3vb1zz"cefhmlkLb ghm¶ghfDd!uvkLuyke¥¶mokZdof{gu±ndlt5gzuyk(gLb"zd!ijcLvb"Ld!gdL³ebk(¤Bb xob1fhuy¯ebNµgLuz¶b ©rcbfuyijb1klgDd!vy|lt dozz{uy¯Rt1d\ghuvmok¦m!n°gLb´À!Âl ghfDd!uvkLuvkL¥(b ©Ldoi ceybNz°¤Bdlz/t moffb1t5g/mlkÐÖlÖL 7 cRb1ftbkHg m!n«gheb uvkez}gDd!ketb1zn_mof x¡dofhud!eyb"zhbvb1t ghuvmok[Lqrg°mokeyX| 6Hór 7 cbfDt b1kHg m!n&gheb°ghuvi b/¤ebk3ghfDd!uvkLb1mokd!vñgheb/x¡dofhud!eybNz ®«Luz@b ©Ldoi ceybZzhqL¥o¥lb1z{gz ged\g¶uyn d!k^|HghLuvkL¥eBx\d!fuvdoLvbZz{b¢ vb1t5guymlkedoz¶d)¥lfhbNd\g@cRmoghb1klguvdobkLb¯Lgªuvktvdlzhzhuy¯Rtd!ghuvmok d!kR¶t vqez{ghbfuvkL¥ cLfmoLvbi@z1Hdokejbxlbk¶ijmlfhbzhm ¤Lb1kªrbNd!y¢ uvkL¥µ¤uygh¨Luy¥lr¢Ûruyijb1kez{uvmokRd! ed\gde ¾efhmli z{mli b)z{uvijcLvb b ©rcbfuyijb1klgDz¤Pb´cRb1f{n_mlfhijb1[uygi@d¡|³d!z{mÔRb)gLb)t1dozhb ghRd\gºx\d!fud!Lvbz{b1ybNt5guymlk@uvzmonT¥ofb1d\gbfLb1ycjged!k@uvkªzhqLcbfh¢ x^uvzhb1)vb1dofhkLuvkL¥Rªs^qLfcLfhuzhuykL¥ly|lAd!vijmlz{g"d!v ghLbªyuyghb1fd!ghqLfb mok@x\dofhud!Lvbzhbvb1t ghuvmokªdoke@z{efhuvkL¬\d!¥lbuvzºuyk¶ghLb fhb1¥ofb1zz{uvmok t mlkHghb ©^gN
True mixture distribution 4
0.06
2
True mixture distribution
0.04
x2
4 0.06
0.02
0
0.02
10
0
0 5
20
−10
0.04
−5
−4
5
x1
10
−5
0
5
10
x1
4
44
0.06 0.06 22
2
0.04 0.04 0.02 0.02 0 0 5 5
0 5
−5 −5
20
−2 −2
−2
0 0
10
00
0
−10 −10
0 0
10 10
20 20
−4 −4 −5 −5
−4
0
−10
−5
0
00
55
x1
10 10
EM estimate using relevant variable
5
10
x1
4
0.06 2 0.04
x2
−5
010
−10
EM estimate using all variables EM estimate using all variables
0.02
0
0
20
x2
0.06
−5
0
0 −2
−4
x2
−5
2
−2
x2
0 5
0
0.04
0.02
0 −2
0 5 20 0
10 −5
−4
0 −10
−5
0
5
x1
10
¾&uy¥lqLfbÕYZ[løV\^]G_?`5ùbahú!ùbc$]d_ ]fePùhgLøúI[Gi\úG_Rùúkjløl]femi¡úda(cúnûyø `ø ûvpø oqù c$]G_rcJ_.qù st]u[dcJ\j&ø _8`(c$]G_?`&vxwygLWø \zc;{lqù |5ah}ø o~]G\.?]G_&ø _eù \@ødú _8`cJ_µhù gLø¶bù a(|e ø [Gc`5bù a(c$n&|rqù c$]G_ e~ap]G\sg,c$o~gsº}ø `Gú \.ûyø hù gLø [oú!ù^ú gLdú i¡^ø [dc &ø ahVø _R)ù i¡ú!û |e(ø `]Gi\Vø aJù geø/©T Õ o~]G\.?]G_&ø _e ù v (_}o~]G_?`5bù ahGú `5$ù Thù gLmø \@ødú _8`Gú ahø«hù gLø~ú yaO]&{IcJ\@ú\ùÛø û /hù gL)ø ` dú \jø cJ_ÐJù geø"©LÀ op]d\?]G_ñVø _R$ù msg,c$o~gL`(|jkjHVø `Dbù ` hù gLú\ù ya(|5_?cJ_jhù gLø `~ø op]d_[i\Gú a(cIú n ûvWø st]d|rû [nD}ø nD&ø _bø 0qù cú\û ù ]uoû |,`5ù&ø a(cJ_jv0wygLø [Gc`5qù a(c$nV|rqù c$]G_ scÜJù g^i¡dú a(cú nûy.ø `ø ûy~ø obù c$]d_nDøùùÛVø apú IaO]k{IcJ\jú!ùVø ` hù gLøjqù a(|e^ø [Gc`5qù a(c$nV|rqù c$]G_yv`~cJ_,j( ú `Gú \.ûyø¶ùVø `5ù `ø$ù sºRø j]\ù &ø a(aO]Ga~`]fevJd3Gú _[^IvMIeV]da hù gLøqù ahdú cJ_?cJ_j^scÜJù gdú _[scÜhù g, ]G|rù i\Gú a(cú nûyLø `øûy~ø o qù c$]G_yv]!ùøÊJù geø yaO]nDIú nVcÜû cÜqù [Gc`5bù a(c$n&|5 qù c$]G_8``Og8]ds_cJ_´Jù g5c`!jd|5aø"Gú aRø |5_ _]Ga(\@ú\;û c1~ø [Iv ý ËµÌ ¡ m ´Ï´Å ¢jÅrÏ ÇÊÅLË.Æ ®«Lb i mrrb1Ruzºd"z}gDd!keLdof ¯RkLu±gbijuy©HgqLfbm!n[iqLyghuvx¡dofhud\gb ²°d!qRzhzhuvdokLuvz{ghfuyeqrghuvmokezkY
£ ¤ M M ¥ I h½ O¦ # k%(') à ½}Õ¡Ã ¤Lb1fhb Kk §T¨ I" ¦© / Õ 4&4k4«ª¬PrbkLmoghbNz gLb3mlezhbfx¡d!¢ ghuvmokRz ¤z ½ ®% # %(' ÃBbketmoijcedlzhzhb1zdoyñgLb/ijm^Lb[cedofdoi ¢ b gbfDz rb1kLm!gb1zgheb@i uy©ruyke¥(¤Pb1uy¥llgDz® #¦doke rb1kLm!gb ghebZijb1 d!k³doke³t m\x\d!fud!ketb3mongLbZijuy©HgqLfbZt mo' ijcmokLb1kHg rb1kez{uyghuvb1z1[d!kR * rbkem!ghbNz ghLb k^qLi"bf°m!nBt moijcmokLb1kHgz1
®«Lb ijuy©^ghqLfb ijmrrbWuvz rb ¯ekeb1mokgLbz{gdokeLdofcLfmoed!¢ Luvyuyg}|3zhuvi ceyb©uK Y .¯  n_mlfd!v -doke ° / ÕdPH )b"t mlket b1klgfd!ghb°mokgLuvz z{uvijcLvb ijm^LbTn_mlfcLfb1zhbkHgd!ghuvmok cLqLfcmlzhb1z1 ×m\¤BbxlbfNb©Hgbkezhuvmokez3ghmLuvbfDd!fDtDLutdo ijuy©H¢ ghqefhbNz ½~BdofhkRd!fD doke¶¾emofDz{|HghªÀoÂoÂeÕoo×m!n_i@d!kLkÊÕ1ÖoÖlÖlà doke x\d!fuvd!ghuvmokedoTiju±©^ghqefhbNz ½~BvbuAbg d!ÑÀoÂoÂHÀoÃBd!fb/z}gfdouy¥llghn_mofh¢ ¤«d!fDT öWd\ghb1f1uvk)s^bNt5ghuvmok 7 vÕo¤PbcLfhbNz{b1kHg dªzhyuv¥oHgi mr^¢ uy¯Rtd!ghuvmok)m!nBghLuz°ijm^Lbn_mlf/moqLf/mlr¼}b1t g°fb1tmo¥lkLu±guymlk´doke i"qe±guyijb1Luvd gfdokez{d\guymlk3docLcLvuvt1d\ghuvmokRz )bÈuvkHghfmrrqet bÈgLb vd!ghb1klgÎdoyvmrtd\guymlkx\d!fud!Lvb1z²± § KlÕ 4k4&4 PghmÐuvkerutd\gbªged\g¶d)cedof{guvtqLvdof zhb1òHqLb1ket b
bv% mokL¥H%z/* gh m)dÊzhcRbNt uy¯RtªtyqRz}gbzf -!´®«LbNz{b3uykeLuvt1d\ghmlf"x\d!fuy¢ d!eybN³z K´± Õ 4k4&4 ª¬P t moffb1zhcRmlke@gmjdok3uÑ u T0zd!ijcLvb n_fmoigLb
f¦Or© u/z}gfhuvL% qrguyml% k µ&$½ ± / -à / ¶®·$¸ E ¹ ºk»^¹½¼AE ¾°zJ º Y ºNJ ¿°R º´»@U )bn_mlyvm\¤d3LuvbfDd!fDtDLuvt1d! ~«d¡|ob1zhud!kZz{ghfDd\ghb1¥o|(¤Lb1fhbgheb qLkL¬^kLm\¤k´ced!fDd!ijbghbfDz ¤ d!keZghLb@doyvmrtd\guymlkZx\d!fuvdoLvb1z³± d!fbfhb1¥ldofrbNµdlzjRb1uykL¥.Lfd¡¤kÔn_fhmli docLcLfmocLfuvd!ghbcLfuymlf ruz}gfhuvLqrguymlkez1´bdotD¬^kLm\¤vb1r¥lb/moqLf qLket b1f{gDd!uvkHg}|3d!moqLg ghebªb ©Ldlt5g/n_mofim!n«ghLb3cLfuymlf ^|)zhcRbNt uyn_|^uykL¥Êu±g uykÐgbfijz m!nºzhmoijb qekL¬^kLm\¤k(ced!fDd!ijbghbfDz ½H|^cbfced!fDd!ijbghbfDzDÃ5)b cLdotb^|^cRb1fhcefhuvmofDzmlk´zhmoijbmon0gheb ^|^cbfced!fDd!ijb gbfDzzhm ghRd\g0uvfhfbvbx\d!kHg n_b1d!ghqLfb1zdofhbzhLfqLkL¬ gm/d/t moijijmok x\d!vqLbo ®«ed!gªuvz1«ghebÊb1z{ghuvi@d\guymlk³m!n°ghLb´^|Hcbfcedofdoi bghb1fzj¤uvy d!vvm\¤µqez gm/bvuyijuvked\gbghebVb Uñb1t5gPm!nñuyffhb1yb1x\d!kHg n_b1d\gqLfb1zuvk gheb/i uy©^ghqLfb/ijmrrbÑ À qLfÎeuyb1fdoftDLutdo(~Bd¡|lb1zhuvdokijmrrb´uvz rbcLut5gb1$dlz³d ¥ofDd!ceLuvt1d![ijmrrb1Auvkʾ&uy¥lqLfhb"ÀL®«Lb"doyvmrtd\guymlkx¡dofhud!eybNz ± dofhbdlzhzhqLijb1 gm"brfDd¡¤kjn_fhmli d/iqLyghuvkLmoijud!ñruvz{ghfuy¢ L qrguymlk[? ± Á ½}Õ ¦ Ã5L¤LutD(dorijuygzBgLb rbkRz{uyg}| µWb½ ± ~£ à /  ?à bÄÅ«Æ$Ç % ¤Lb1fhb È $½ ± à / ÕBuy n bvmokL¥HzWghm°¥ofmoqLzc -Pdoke È b½ ± à /  m!gLbf¤uz{blW)bcLdotbd/t mok!¼}qL¥ld!ghba uyfuvtDeybgºcLfuymlfmokjgheb iju±©ruvkL¥´tm^b ·¶t uvbkHgz ÊÉ q½ ËLÃ5Rd¡xHuvkL¥(gLb¶n_mlyvm\¤uvkL¥ rb1kez{uyg}| µW½ £ ËLà / ½bË ÃyÌ Íkb½ Í&Ë Í N à ½bË Ã Â Î ~Ï % ½ÀlÃ Ì Ì ¤Lb1fhb Ì «½ Í ÃZrbkLmoghbNzghLbÔ²°doijijdÔn_qLkRt5ghuvmok doke Ë N / Ë )b¶dozz{uv¥ok)d²°doqezhzhud!k)cLfhuvmofgm3gLb¶t mlijcRmlkLbkHg/ijb1d!kRz # = = h½ #WS %OÐ Ã5 ¤Lbfb Ð uvzrud!¥lmokedo¤uyghÈbvbijbkHgz Ñzhb f% xo4&b14k34 % LÑ d\gD" dL0)®«b°Lb°gdou¬orb b1d #WuSz«ghghm@mjbNb z}gzhuyi@doijd\gcLb°yb°ghLijb b1dok3zmozhnWqetDgL3b/ghemod!Lg¢ gheb/uyffhb1yb1x\d!kHg«n_b1d\gqLfb1z«ed¡xlb Ñ S zkLbNd!fÙ1bfmjÑ doS keªghLb tmofh¢ fb1zhcRmlkeruvkL¥/t moijcmokLb1kHgz m!n # dotfhmHzhz&¥lfhmlqLcez d!fbz{LfqLkL¬ ghm\¤«d!fDLz«zhbkezhuyeyb/t mliji mlk3x\do yqLbNz
)b cLdotbdt mlk\¼}qL¥ld!ghb uyk^xob1fzhb ¢³uz{edof{gPcLfhuvmofPmokªghLb°t mo¢ x\d!fuvdoket bNz ') ÒÓ " b½ Ô % Ô ' SNÃ5Rdorijuyg{ghuvkL¥jgLb rbkRz{uyg}| µ&½ ' £ Ô %(' S tÃ Õ £ ' £ Ï®ÄÖ× " × Ç$Ø = b©^yc KÙ ½}GÕ Ú!ÀofÃ Û Ür$½ Ô ' S ' Ï ~à P ®«Luz¶cLfuvmof@uz¶t b1klgbfb1d\gªghLbÊtm\x\d!fuvdoket bm!n°ghebÊLd\gDd 'Ñ Ý = S!ºß)Þáb/à cL$½ vâ dlt b à «dokn_mouvf k^xoä b1f/ zhb°²°Õ do4&ij4k4 ij* d@+ L¿uvz{gh®«fLuyeuvzqrghruvmouz}kgfhmouvLkqrbNgdouymltDk % % doLi uygzghLb %prã b1kezhu±g}| µ&½ Ñ Ý = £ â %~ã à Õæå Ñ Ý?= ç ÏyèéÏ b©^uc ê Ù Ñ ã = 4 Ýáë ®«Lb Ñ Ý = dofhb/dozzhqLijb1ªghmjRb/uvkerb1cRb1kerb1kl´g Y µW½ Ð £ â %~ã à /  " µ&½ Ñ Ý = £ â %pã Ã Ý s^uvket b@doygLbjcLfuymlfz°d!fbjt mok!¼}qL ¥ld!ghboAmorgDd!uvkLuyke¥3gLb@cmlz{¢ ghb1fhuvmof ruvz{ghfuvLqrghuvmokRzm!n&gheb"cedofdoi bghb1fz«^|t mokRru±guymlkLuvkL¥ mok3gheb d!vymrtd!ghuvmokx\d!fuvdoLybNzBuvzz{ghfDd!uv¥oHghn_mof¤BdofT a α
Σ∗ Σ
b υ
µ∗
τ
λ
µ z x
¾&uy¥lqLfbªÀ5YìlZzí²eV]da¶ùhgLø^îúdoø(`(cúd_\zc;{lùq|5ahø^\^]k[lø ûscÜùJg `Og,a(cJ_5ïokú jllø ya(c$]Ga~`&vwge)ø {^~ø [g5pL&ø a(MeGú ahdú \jøù&ø a~`jdú ahzø ah ø ahVø `Vø _Rù~ø [scÜhù gTn~]&{^(ø `~@hù gLø i¡dú a(cú nûy(ø `[oøù&ø a(\cJ_~ø [²nV.hù gLø [oú!ùú3éú `[]d|?n ûvø o&cJaOoûyVø `p«Gú _[¶Jù geRø |5_5ïG_y]Gs_uaGú _[I]G\ði¡dú a(cJ ú nûyVø `RscÜJù gÊVø \.qù Wo&cJaOo ûv(ø `&v ý ÍÎÇ Ç´År赮 ñ Ï.Ë ®«Lb°cedofdoi bghb1fzPm!nWghLb°iju±©^gqLfhbijmrrb[t1d!kLkLmogRb/t mli ¢ cLqrgb1d!kRd!v|lguvt1d!vy|ªqLkLvb1zz«mokLb°¬^kLm\¤zBghebijuy©^ghqLfb/uykRru±¢ td!ghmlfBx\dofhud!Lvb1z1&´b°ed¡xlbgm fb1zhmofhgºgmjkHqei b1fhutdoñi bghr¢ mrLz1 À kLb/td!kuvijcLyb1ijbkHgd@²uyLRzzd!ijcLvbfBghm¶tmoijcLqrgb gheb"cedofdoi bghb1fzdoke(d!vymrt1d\ghuvmokx\d!fud!Lvb1z1®«Luvzuvz rmokeb ^|.zhdoijcLyuvkL¥´ghLbcedofdoi bghb1fz d!keÔd!vymrt1d\ghuvmokµx¡dofhud!eybNz n_fmoighLb1uyffhbNz{cb1t ghuvxob3cRmHz}gbfuymlfz1Z×m\¤BbxlbfNAgLuvz d!v¥omo¢ fu±gLi$td!kÊRb t moijcLqLgd\guymlked!vv|3uvkHghbkRz{uvxob"n_mofgLbdocLcLvu±¢ td!ghuvmokezº¤Pb ed¡xobuyk¶ijuvkeTÚÛkez{ghbNdo@¤Bbmlcrgºn_mlfBdok@b ©rcb1t5¢ gd!ghuvmok)i@d\©ruyijuvÙ1d!ghuvmok½¸º¹´Ã°d!v¥omofuyghLi$gm(t moijcLqLghbjgheb \@&ú {IcJ\z|5\%ú ?]é`5ùÛVø a(c$]da(c ½¹Z»ØBÃcRmluykHg b1z{ghuvi@d\gb1z°m!nBgheb iju±©^gqLfhb/ijmrrb1
ò·$¸ ¾³óô¿WõBX»}¹Wº öXó
»nÜgbfuykLuyghud!vuvÙ1d\guymlk[[gLbª¸P¹ doy¥lmofu±gLi$n_mlf"¹Z»Ø§bNz}gu±¢ i@d\guymlk3uyghb1fd!ghb1z«b g}¤Bbb1kghLb°n_mlyvm\¤uyke¥"g}¤Bm@z}gbcezkY ¸· ¾Á`1G1FHm ÷/pPmli ceqrghbghLb¿b ©rcRbNt5gDd\ghuvmok m!nXgheb¿t mli ¢ cLvb gb vmo¥o¢Ñcmlz{ghb1fhuvmofݤuyghd!vymrt1d\ghuvmok%x\d!fud!Lvb1ùz ø½ ¤ à / úû +ý þ~ÿ D yml ¥ µWb½ ± % % ¤ à FT¤Lbfb ¤ Ä Ç fbcefhbNz{b1klgDz gLbÄÅéx\ü doyqLbm!Ç n0gLb"cRd!fDd!ijb gbfDzd\g ghLb cLfbx^uvmoqezghuvijb z{ghb1c[ · ó `GNFH ÷°¹Zd\©ruvijuyÙ1b"m\xob1fgLbcRd!fDd!ijb gbfD&z Y ¤ Ä Ç / dofh¥0þi@d!© ø½ ¤ à ¾LmlfgLbj¸ z{ghbcA¤BbtmoijcLqrgb"gLb cRmHz}gbfuymlfm!ngLbjd!vymo¢ td!ghuvmokx\d!fuvdoLybN&z Y µWb½ ± / -
Ã
µW½b± / - £ % ¤ Ä Ç Ã / µ&h½ ~£% ¤ Ä % ¤ Ç ÄÃ Ç % ¤LutD[Luvk3mlqLftdlz{blruvz¥ouvxobk3^| Y $½ 6HÃ / h½ h½ O ¦ # k# %(') Ã Ã p
¦ %(') ¾Lmlf ghLb(¹ z{ghb1c[º¤BbkLm!gb3ged\g gheb3n_qeket5guymlk ø½ ¤ à b©^¢ cedokeLzBghm ¥ ¥ Ù ÀÕ à £ £ Ù ÀÕ ½h Ù # à H Ï ½h Ù # à '
Õ ' Õ ¥ Ù À yml¥ £ £ Ù À ½h# ÙL# S à H Ï ½h# ÙL# S Ã Ð Ð Õ ¥ Ù À ½bÔ * + Õ¡Ã^yml¥ £ £ Ù ÀÕ Û Ü^½bÔ S Ï Ã ') ' ' ¥ «½ ÙâÙ¦ÕNÃ^vmo¥ å Ñ Ý = ç Ù ã = 4 ÑÝ Ý ®&d!¬^uyke¥¨rb1fhuvx\d\ghuvxobNz"¤PbÔmorgDd!uvk ghLbÔn_movvm\¤uykL¥¨qLcñLd\gb b1òHqed!ghuvmokezBn_mlf«ghLb/ijmrrb1[ced!fDd!ijbghbfDzkY
ª ! Ë Ë Ù ÙÔÕ * # ½ V' Ï Ð Ï Ã Ï ' Ï ½ ¥ Ã Ð Ï # S D ½$ ÙL# à ½$ ÙL# ÃfH;F Ô ' S Ô ½ * + ÕNà ' Ñ Ý = â ã= Õ Àdâ *Õ À ¥ ½h# Ý Ù # ÝS à = ¤Lb1fhb M )®«eb1zhb¶qLcñLd\gb1z1 ghmo¥lb gLbf ¤u±g b1òHqed!ghuvmokн$H6 Ã5etmokez{ghuyghqrgb/moqLf¸P¹7doy¥lmofu±gLi
"
#
!
wzhuvkL¥"gLb°i@d\ghfuy©ªuyk^xlbfDz{uvmok¶vbiji@dL^¤Bb/td!k3fhb1¤fhuyghb gheb qLcñLd\gb z}gbcn_mof# doz # Ð ½ ') OÐ Ã Ï ½ ¥ à ') ½ ') OÐ Ã Ï # S
ÚÛk gLuz b ©rcLfb1zz{uvmok[¡¤BbBLmok S g&Rd¡xob0gm°uyk^xob1f{gWghLbrud!¥lmokedo i@d\gfhuy© Ð @®«Luz/cbfi uygz bvbijbkHgz m!n Ð ghm(¥lmghmÙb1fhmR d!vvm\¤uykL¥n_mof«n_bNd\gqLfhb zhbvb1t ghuvmok[ ¾Lfmoi7gheb¸P¹ qLced\ghbb1òHqed!ghuvmokez1 mokLb3td!kµfhbNdoruvy|)moL¢ zhbfxob gLbjz{LfuvkL¬\d!¥obuyk´mocbfDd\guymlk[/»z ÂLgLbbNz}gu±¢ i@d\gbBmonegLbijb1d!kRzz{LfuvkL¬rzAgmghLbzd!ijcLÑ vb«i bNd!kjd!ke"gheb t m\x\dofhud!ketbPzhLfuykL¬rzWghm ghebzhdoi ceyb«t m\x\d!fud!ketboA®P|^cLuvt1d!vy| ¤BbkLmlfhi@doyuz{bghebjed\gdzhmªged\g #WS / Âd!kR ' S / Ò " ×b1ket bl^ghLb°gbfÊ i Ô Suyk3gheb/qLced\ghb/monAgLb/t m\x\d!fuvdoket bNz z{gd!euyvuvzhb1z ghLbd!v¥omlfh' uyghei´®«ed\g uvz1u±gjcLfbxlbkHgz ghLb3uyv±¢ t mlkeruyghuvmokLuvkL¥cLLb1kLmoijbkemok´dofhuzhuykL¥ªn_fhmli$ed¡x^uyke¥dokÊqLkr¢ moqLkeLb1yuv¬ob1yuvLm^mrT Ë m´Ï)Ç ²É ´Ï.²Ë ³Æ¨ÅlÇ´År赮 ² L ÅrÏ ÇÊÅLË.Æ À xob1f)ghLbdoz{gXLb1tdlrbo@¤Bbed¡xob¦b ©rcbfuyb1ket bN¿dok¿b©^¢ cLvmlzhuymlkÝm!n.i"qe±guyijb1Luvduvk ruv¥ouygdoÊvuyefdofhuvb1zÎdoke>gheb ¤Bmofv^¢¤urb ¢¤Pb1[:ÚÛkced!fhghut qLd!fN¶¤BbÎed¡xlb³¤u±gkLb1zz{bN gheb)b1ijbf¥obkRt b)m!nd!f¥ob)t mlyvb1t ghuvmokezm!njd!kLkem!gd!ghbNÎuvi¢ d!¥lb1z1 ¸©Ld!ijcLvb1zÔm!nÊghLbNz{bÈuykRt vqerbÈghLbpPmlfhb1Ld!gd!¢ zhb g¦½z{b1bµ¾&uy¥lqLfxb 6là "ijmlz{gÊiqez{b1qLi uyi@do¥obµtmovybNt5ghuvmokRz ½ lÃ5«gheb ¤Bb¨doftDeuyxlbÔ½ rà ºkLb1¤zcLLmo¢ ghml¥ofDd!cLRzrcLfuvx¡d!ghb°cLLmoghm¶doyLqeijzd!kex^uvLbmlz1º¹(qe±guyijb ¢ rud fmom!guvt1zH¤Lbfbfmom!gDzPdltòHqLuvfhbuvi@d!¥lb1z1HzhmoqLkRLzºdoke ghb©^gWdoz[ghLb1| ked¡x^uv¥ld!ghb&ghLfmoqe¥o d«cedof{guvtqLvdof[bk^x^uvfhmlkLijbkHg d!zhm3fb1zhqLygzuyk´gheuvzg}|^cb monBLd!gde®P|Hceuvt1d!vy|lñghLbNz{b@d!kL¢ kLmogd\guymlkezPfhbn_bfBghmghLb/tmokHghb1klgBm!nWghLb°d!kLkem!gd!ghbN¶uvijdo¥obl Lqrg i@d¡|Zx\dofh|(uvk)ghLb1uyf"dlttqLfdlt |(d!kR)tmoketuvzhbkeb1zzj¾Lmlf uvkez}gDd!ketbo¡gLbpPmofbrd!kLkem!gd!ghuvmokez&rbNzhtfhuvRb«zhcRbNt uy¯RtBuyi@d!¥lb t mlkHghbkHgNeqrg/kLm!g/d!vWmonºuyg1 ¹(qezhbqei t mlyvb1t ghuvmokezd!fb m!nÜ¢ ghb1k(d!kLkLmogd!ghb1ª¤u±g(z{mli b/zhcRbNt uy¯Rti@d\ghb1fhud!TzhqetDdozBgheb d!fhghuz{gd!keXed\ghbªm!ndot1òlqeuvzhu±guymlk[d!keÐmonÜghb1kXghLb3d!kLkLmogd!¢ ghuvmokRzrb1do[¤u±g(z{mli b°fDd\gLbfd!Rz}gfdlt5gi@d\ghb1fhud!Ñ ®«Lb"dokLkLmogd\gb1uvi@d!¥obLd\gDd¶d!vym\¤zqezgm@n_mofi"qLd\gb moL¢ ¼}b1t gÊfb1t ml¥okLuyghuvmokÈdozZd³z{gd!ghuz}guvt1d! i@dltDLuykeb´gfdokezhvd!ghuvmok cLfmoLvbi ½aqe|H¥lqLvqµb g¶do0À!ÂlÂlÀlÃ5дbzhb¥oijb1klgjuvijdo¥obNz uvklgm´fb¥luymlkezª½LvmoezDÃ"dokeXgLbkÔybNd!fkXghm)cLfb1rut5g ¤Pmlfez qezhuyke¥´fb¥luymlkezX¸PdotD.fb¥luymlk.uvzjrbNzhtfhuvb1.^|.zhmoijbz{bg m!n"n_b1d\gqLfb1z1¿ÚÛk¨ijdltDLuvkLbÊgfdokezhvd!ghuvmok[dµyb©ruvtmokÎvuyke¬^z ¤BmofDLz)uykmlkLbvdokL¥oqedo¥obÔghm ¤BmofDLz)uyk gLb³m!gLbf.d!kL¢ ¥oqRd!¥oblÔ½~Pfm\¤k[a bvvd´Ø0uvb ghfDdLa bvvd)Ø0uvb gfdÊd!ke.¹Zbfh¢ t b1fÊÕNÖoÖ 6eº¹(b1vdoi bN À!ÂlÂLÕ¡Ã5 ÚÛkÎgLb´Lmoi@d!uvk³m!n mlr¼}b1t g fb1t ml¥okLuyghuvmokAºgLbn_b1d!ghqLfbZ¤BbZdozz{mrt ud\gb3¤uygh³uvi@d!¥lb(fhb¢ ¥ouvmokRz rmZkLmog"ked!ghqLfDd!vy|)mrttqLc^|´dZruzt fb ghb3z{cedlt bl®«eb zhuyijcLvb1z{gBzhmovqrghuvmok¶ghm gLuzºcLfmoeyb1i uzºghm qezhb ô¢ijb1dokezgm xobNt5gmofòHqed!kHguvzhbghLb uvi@d!¥lbfb¥luymlk3fbcefhbNz{b1klgDd\guymlk[®«Luvz d!cecLfhmHdotD[dormlcrghbN(uvkµ½a qL|^¥oqLvqÊbg°doTÀ!ÂlÂlÀlÃ5e¤«doz¤Pb1y
$
'
&%
$(*)
,+.-/-103254/4"6/6/687-1+:9A@87BC@/D.4CE/FGH4"-1+I9A@J7+1-"G:K ,+.-/-103254/4"6/6/6875FC@IL+H9M.>N7BC@1D
bn1
y uvmoki@d!keb¥lfdlzhz«zh¬^| ¼}bgcLd!kLb/zh¬H| ¾&uy¥lqLfb68Y {^úG\.ûyøV`e~aO]d\$ùJgeø ]Gahøû [oú\ùÛúW`ø ù hìR|5&j|rû| øùú\û v³,d v (ø geúGi\ø´úG`~`V]´o&cú\ùÛøp[ ïoø&Gst]Gap[é`ÊúG_y[ `øqj \@Vø _R$ù `)eV]Ga¶øDú o~g cJ\jkú jlVø ³n&|rù sºWø [I]G_ mù ïd_]dsTsg5c$opgst]GaO[ o~]Ga(ahVø `q8]d_[G`¶ù ]sg,c$o~gr` ø j\j&ø _e ù v wygL ø _?|5\^nDVø aW]«e^st]Gap[é` Gú _y[`ø jd\@&ø _ebù `oDGú _ nø [Gc Vø ah&ø _eù P&ø i¡&ø _sgeVø _´Jù geVø ªdú ahø hù gLø `Gú \@(ø sº)ø \jdú lgLdú i¡ø \]dahøhù gLdú _W]G_ø `qø j\@Vø _Rù eV]Ga³ú `(cJ_joûyø st]Gap[ém]da\]dahø hù gLdú _ ]d_ø st]GaO[.eV]Ga^ú `~cJ_,j!ûvø nû ]Inkv PO
XW
p(wn1|bn2)
:Y
[Z
fb1t b1uyxlb1Ô^|.ghebÊt mli ceqrghb1f@xHuzhuymlktmoiji"qekLu±g}|Ƚ_uygª¤Bmok b1z{g&cedocRb1fAcLfuvÙbºuvktmo¥lkLu±guyxlbºt mlijcLqrghb1fWx^uz{uvmok d!g&¸«ppP À!ÂlÂlÀlÃ5A)b¤BmoqL yuv¬ob«gm z{qLfijmoqLkHggLbcLfmoLvbi¿m!nñed¡xH¢ uvkL¥@ghmªuykHghfmrrqetb/kLmouz{b"H|3xobNt5ghmlfòHqed!kHguvzhuyke¥jghLb eymlez zhmµuvkez}gb1dlΤBb)dlrmocrgdÔLuvzt fb gb ¢}²°d!qezz{ud!kgfdokezhvd!ghuvmok ijmrrb^ged\gºdoyvm\¤zAqRz&ghmghfDd!kezhd\ghb²°d!qRzhzhuvdok"n_bNd\gqLfhbNz ru±¢ fb1t5gy|gmLuvzt fb gb"n_bNd\ghqefhbNz"®«ebjzhLfuyke¬¡do¥ob t moijcmokLb1kHg m!nmlqLf/ijm^LbPdoyvm\¤z/qez/ghmÊt1d!ffh|Zmlqrg/n_b1d!ghqLfbªzhbvb1t ghuvmok ¤uyghLuvkghLuz«ghfDd!kRz{d\guymlk3cLfmrt bNrqLfbo ·$¸ ¹W¿ªU ¼®õt¿°R º´»@U ó » ¾lõ)¼ À qLf°d!cLcefhmHdotD(gm3fb1tmo¥okeu±guymlkZuvz°doked!vmo¥lmoqez«gmijdltDLuvkLb ghfDd!kRz{d\guymlk[Rdlzmofuv¥ouvked!vy|3cLfmocmlzhb1^|)½aqL|^¥lqLyq´b g do À!ÂlÂlÀlÃ5°´b gfdokez{d\gb"uvi@d!¥obfhb1¥ouvmokez ½¾efhb1ketDRÃghm¤Pmlfez ½¸ºkL¥ovuz{Rà $ÚÛk§ced!fhghut qLd!fN°moqLf(ijmrrb1"dot gz(doz(d§ûvOø {IcJ o~]G_Rld°rbx^ut bNz ghed!g0cLfb1rut5gDzmokLb«fbcLfb1zhbkHgDd\ghuvmok½_¤BmofDLz ¸0ke¥ovuvzhRë¥luyxlbk(d!kLmoghLb1ffbcLfb1zhbkHgd!ghuvmokн_uvi@d!¥ob"fhb1¥ouvmokez ¦¦ ¾LfbkRtDRÃ5ö[bNd!fkLuyke¥Zdyb©^ut mlk)n_fhmliLd!gduz"d(z{gdokeLd!fD cLfmoLvbi¨uyk/i@dltDLuykebghfDd!kezhd\ghuvmokvu±gbfDd\ghqefhb½~Pfm\¤k°b gWdo Õ1ÖlÖ 6e¹(b1vdoijb1ÐÀ!ÂoÂeÕNà "®º|^cLutdoyv|o[dvb ©rut mok´uvz°vb1dofhkeb1 n_fmoi d n_mlfhi m!nLd\gDd@z{bg¬^kLm\¤kdozdokXú!û c;j_~ø [nVcÜùÛOø {lù dªghb ©^g°uyk´g}¤Bmªd!kL¥lqed!¥lb1z¤ebfbfmoqL¥lÊt mlfhfb1zhcmokerb1ket bl cbfed!cezd\ggLb cedofdo¥ofDd!cLmofzhbkHgbketb/yb1xobÑeuz¬^kLm\¤kA ®«Lb/cLfmoeyb1i m!n yb©ruvtmok(dot1òlqeuvzhu±guymlk3uvk^xomlyxlb1z«rb gbfijuykr¢ uvkL¥/cLfb1t uzhb«tmoffhbNz{cmokRrbketb1z&b g}¤Bbbkj¤BmofDLz m!nTru Ub1fhb1kHg d!kL¥lqed!¥lb1z1¦»ked!vmo¥lmoqezhy|lº¤Bb(td!k³tmokezhuvLbf¶dÐLd\gDdÐz{bg t mlkezhuvz{ghuvkL¥µmon"d!kLkem!gd!ghbN³uyi@do¥ob1z3dozd!k doyuv¥okeb1³Luyghb©^g zhuyketb¤Bbed¡xobd!k@uvi@d!¥lbt mokRz{uz}guyke¥/m!nñfhb1¥ouvmokez1od!kR@d/z{bg m!nBghb©^g1´b¶¬^kLm\¤¿gheb@ghb©Hg¥om^b1z°¤uyghÐgLb¶uvijdo¥oblALqrg ¤Bb°Lmok S g¬^kLm\¤ ¤LutD¤Pmlf3¥om^b1zB¤uygh(¤LutDfhb1¥ouvmok[ pPmoijcLqLghuvkL¥ ghLb gfdokez{d\guymlk cLfmoRd!Luvyuyghuvb1z uz kLmog z{ghfDd!uv¥oHg{n_mlfh¤«d!fDRbNtd!qRz{b¤Pbed¡xob"d htDLutD¬ob1kZd!keÊb¥l¥ zhu±gqed\guyml k Y§ghm¨LqLuvv ghLbÔghfDd!kezhd\ghuvmok cefhmled!Luvvu±guybNzZ¤Bb kLb1b1ghm°¬^kLm\¤.gLbt mlfhfb1t g tmoffhbNz{cmokRrbketb1z&b g}¤Bbbk uvi¢ d!¥lb1zBd!ke¶¤PmlfLz1HLqrg«ghm¯e¥oqefhb moqrgBghLb°t mlfhfb1zhcmokerb1ket bNz ¤Bb kLbbNghm@¬^kLm\¤Ègheb/ghfDd!kezhd\ghuvmokcLfmoRd!Luvyuyghuvb1z1«»zb©^¢ cLd!uvkLb1 uvk(½a qL|^¥oqLvq@b gºdolÀoÂoÂHÀoÃ5o¤Pbtdokjm\xobfDt mlijbºgLuvz \
bn3
TS
]
H^
`_
Ca
b n2) 2| p(w n
VU
RQ
bn2
wn1
p(wn3|bn2)
wn3
wn2
horse
Gandalf
trees
¾&uy¥lqLfbX>?Y wygeø)úG`~`V]´o&cú\ùqc$]G_xaO]InDún&cÜûcÜùbcøV`}yaO]Gi´c$[oø)ùhgLø o~]Ga(ahVø `q8]d_[løV_yoøV` ÛúG`~`~c;j_?\@ø&_eùb` nøùqsºøø&_ÊøDúo~gst]Gap[@úG_[ hù gLø i¡dú a(c$]G|,`RcJ\@ú&jHøR`ø j\jø&_eùb` fnû]nV` v cLfmoLvbi ^|Îi@dofh¥luykedoyuzhuykL¥Ôm\xob1fªgLbÐcRmHzhzhuyeybXdozzhm^tuvd!¢ ghuvmokRzqRz{uvkL¥Ðd´ijuy©^ghqLfb3ijmrrb1Bd!kµurbNdZged\g@¤«doz mofuy¥o¢ uvked!vy|(cefhmlcRmHz{bN(n_mof ghb©^g°uvk½~Bfhm\¤kÊb g d!Ñ Õ1ÖoIÖ 6là ®«Luvz ijmrrbrdozzhqLijb1zWmokLb¢gm!¢mokLbPcLfhmled!euyvuvz{ghutºdlzhzhuv¥okLijbkHgDzWdlz zhLm\¤k uvk ¾&uv¥oqLftb >RW¾Lmlf b1dotD"Lyml uvkghLb ¢g uvijdo¥obl1gLbfbBuvz dcefhmled!Luvvu±g}|°m!nLuyg Rã b1uykL§¥°do¨ zzh" m^tuvd!ghbN/¤* u±g b1dltD m!nrgLbB¤PmlfLz uvk gLbºuvi@d!¥lboW¹ZmofbºcLfb1tuvzhbv|oNgheb ghfDd!kRz{d\guymlkªijmrrb[uz ¥luyxlbkª^y| Y µW½ ã £ à /   ¥ µWb½ â / © fÃ Û ½ ã / ã £ / à M ¤Lb1fhb µWb½ â / © Ãrbkem!ghbNzghLb¶doyuv¥okei b1kHg°cefhmled!Luvvu±guybNz zhqetD ghed!g â uyn ghfDd!kezhd\ghbNz ghm ®«Lbk^qLi"bf m!n&Lvmoezdokeª ¤B/ mofD© LzBuvã k3 gLb * ¢Ñghuyi@d!¥lb/d! f b d!ke fb1zhcRbNt5ghuvxob1y|lsruyketb@gheb¶¤Pmlfez/uykÐgLbªdokLkLmokRd\ghuvmokRz d!fb qLkLmlfLbfb1TgLbfbÊuzkLmµfb1dlz{mlkn_mofcLfb n_b1fhfuyke¥µz{cb1tu±¯t d!vuv¥okLijbkHgDz®«Lb1fhbn_mofbor¤Bb°zhb g µ&$½ â / © à / éÕ Ú ÚÛk¿½aqe|H¥lqLvq¨bgdoÀ!ÂlÂlÀlÃ5 Û ½ ã / ã £ / êuzd ruzhtfhbghbgfdokezhvd!ghuvmokjgdoLvbo ÚÛk@gheuvzBd!cLcefhmHdotD[\gLbgfdokez{¢ d\ghuvmokjcLfmoRd!Luvyuyghuvb1áz Û «½ Í £ Í Ã0d!fb²°d!qezzhuvdok[W¹(mlfhbcefhbNt uz{b1y|l ghebfbZuvzªmokLbʲ°doqezz{ud!k¦n_mof3b1dltD¦¤BmofD¦uykgLbZxlm^t1d!LqL¢ d!f|o ¸ºdotD@¤BmofDj¥ob1kLbfDd\gb1zuvi@d!¥lb zhb¥oijb1klgDzn_fmoid tmofh¢ fb1zhcRmlkeruvkL¥ª²°d!qezzhuvdoktyqez{ghb1f1B~B|tyqez{ghb1fhuvkL¥jgLb/¤Pmlfez ½zd¡|ª¤uyghZô¢ijb1dokez«mofs^aijbghLmrLzDÃ5Ru±guzdovzhm@cRmHzhzhuy¢ Lvb"gm3Rd¡xob"d²°d!qezzhuvdokÊt vqez{ghbf n_mof°bNdotDÊtmoketbcrgN°®«eb ruzhtfhbghb¢Û²°doqezhzhud!k¶gfdokezhvd!ghuvmokªijmrrb1[uvz«kem\¤ µ&½ ã £ à / Â Ï Â ¥ Û ½ ã £ à bS
cU
dS
U
e
gf
f
f
e
ghji lk e
f
<e
i
<e
mf
<e
<e
Tn
Ro
o
<e
f
f
f
<e
o
f
! / Â Ï Â ¥ ½ ã ¦ # %(' Ã ½ Ã !
<e
h
i
e
hpi
k?i
o
5qsrt
h
<e
i
e
h
i
k?i
uf
¤Lb1fhb-/uvzuykÊghLbfdokL¥ob3½$- / Õ % 4&4k4 % WÃ5 rb1kLm!gb1z d cedof{guvtqLvdof¤Pmlf"ghml¬ob1k[od!kR ½ à / Õuyn d!cecRbNd!fDz uvk gheb ¢Ñgh d!kLkLmogd!ghuvmok[\moghLb1fh¤uz{bPu±g uz&ÂeW®«LbBuvkerb ©-ºuvz ghebuvker* b©ªn_mlfPgLb ¤BmofD@ghml¬ob1kezd!kedot1t mlfruvkL¥ly| gheb t vqez}gbfDz3ÚÛkÐghLbªbkeTWgheb¶mor¼}bNt5guyxlb@uvz ghm(¥ob1kLbfDd\gb ¤BmofDLzn_fhmli LvmoRz®«Luz/uvz"dZz}gfdouy¥lHg{n_mof¤«d!fDZd!cLceyutd!¢ ghuvmokªm!n[~«d¡|ob1z0fhqLvbo´ µW½ £ ã tà լµ&½ ã £ hà µW½ à ÕrµW½ ã £ úz{uvketb ¤Bb°tqLffhb1klgy|3dozz{qLijb/d qLkLuyn_mofi cLfuymlf«n_mof µ&½ à ®«LuzAijmrrb1Huz&dx\d!fuvd!ghuvmok monrghLbPi uy©^ghqLfbºijmrrb1HmonLb1òHqed!¢ ghuvmokÐÕl w z{uvkL¥jgLb°kLm!gDd\ghuvmok Û ½ Ã
! µ&½$â / ©V£ %~ã % ¤ Ä Ç Ã / Ý ã Û ½ ã £ £ Ý 5Ã % gheb/qLced\ghbNz«n_mof«gLb/cedofdoi bghb1fz«d!fb oJv
dq rt
xo
o
HfPw
uf
Ifpw
v
v
f
f
uf
f
2
e
f
f
<e
RMS error for µ
uf
e
f
<e
<e
1.5 MAP α=50
ML all
1
MAP α=11
kyi
z {y|~}/PII J| V
Þ
z |~}C
,
0.5
R
i i
I
lÖZLu;UñbfbkHg"¤BmofDLz1 )bt mlkez{urb1f n_moqLf0ijmrrb1vz1&®«eb¯efDz}g0uz0d°i@d\©ruvi"qLi¿yuv¬ob¢ vuyLm^mrijm^Lb[ged\ggDd!¬lb1zdoLx¡dokHgd!¥lb°m!nd!vTghLb n_b1d\gqLfb1z1 ®«Lb(zhb1t mlke.uzjz{uvijuyd!fNºb©Lt bcLgged\g@uyg¶uvzghfDd!uvkLbN.mokey| mokmoqef«tDemout bm!nWfbvbx\doklgBn_b1d!ghqLfb1z1rijb1dok3d!kR3z{gdokeLd!fD rb1xHud\guymlkm!n t mlymlqLf1È)bÊrud!¥omlked!vuvÙbghLb´t m\x\d!fuvdoket bNz uvkZRmogh)¹Zö.ijb gLmrLz ghm3ijdouykHgDd!uvkÊz}gDd!Luvvu±g}|m!ngLb¸P¹ d!v¥omlfhuygheido±gLmoqL¥lghLuz3i m\xlbÊt mlijb1zªd!g¶gheb´t mHz}g3m!n vmlzzm!nx\d!vqed!eyb uvkrn_mlfhi@d\guymlk[®«Lb doz{gg}¤Bm@i mrrb1vz d!fb x\d!fuvdokHgz0mon[gheb¹Z» Ø ^¤Lbfb¤BbLuvdo¥omokRd!vuyÙ1bghLb°t m\x\dofhuy¢ d!kRt b1zuykmokeb ijm^LbAdoke¬ob1bcghLb/qecLd!ghbN(t m\x\d!fuvdoket bNz qLkHghmlqetDLbN´uvkÐgheb¶m!gLbfN~Bmogh.~«d¡|obNz{ud!k´i bghLmrLz"qezhb cedofdoi bghb1fºx\d!vqLb1zºm!®n Ô / kÕ 6e â / Ù/Õ d!ke ã / éÕ Ú^ÕNÂoÂlÂoÂo doz«b n_mlfhbl ®WmijbNdozhqLfhbgheb@cRb1f{n_mlfhi@d!kRt b m!nºgLb@ijmrrbzW¤Pbji@d!kL¢ qedoyv|Xd!kLkLmogd!ghb1.ghLbuvijdo¥obNz uvk.ghebªgb1z{gjzhb gNXÚÛkÔzhmoijb tdlz{bNz.ghLb1fhb ijuy¥llg b¿ijmlfhb¿ghedok7mlkLbÁd!kLkLmogd!ghuvmok rb1bijb1XtmoffhbNt5g/RbNtdoqez{bjgLb¶Lvmo.tmokezhuz}gb1)m!nzhbxob1fdo zhqLr¼}b1t gz1´b°qezhb1ªg}¤Bmjzhuvi ceyb°Lqrg&b UbNt5guyxlbb1fhfmofBijb1d!¢ zhqLfhbN&z Y E ¹ Q Y&®«LuzPi bNdozhqLfbfhb1cRmlf{gDz0d!kªbffhmlfm!n0Õuyn[kLmokeb monPgLb@k´ijmHz}g vuy¬lbv|ZcLfb1rut5gb1´¤Pmlfez°fhbNz{qLygz°uvkÐd tmoffhbNt5g«Lyml(d!kLkLmogd!ghuvmok[ E ¹ `NKLX F^tV Y.®«euvzijb1dlz{qLfbÊfbcmofhgzªgheb´cLfmoL¢ doLuyvuyg}|Xm!n dok.uykRt moffb1t5gjd!kLkem!gd!ghuvmok.¥luyxlbkXged\gj¤Bb zd!ijcLvb/n_fmoi gLb"bNz}guyi@d!ghb1¤BmofD3cLfhmled!euyvu±guybNzn_mlf d cedof{guvtqLvdofLvmo[ ~Bm!g(bffhmlfi bNdozhqLfb1zdofhb d¡xlbfDd!¥obN¶m\xlbf«gheb k^qLi"bf m!n Lvmoezºuyk@bNdotDjuvijdo¥oblld!kR"gLbkªm\xobf gLbk^qLiRb1fºm!nTrmrt5¢ qLijbkHgDzuvkghLb"ed\gd@zhb gNº)b"d!zhm¶t moijcedofhbgLb ijmrrbz S cLfb1rut5guymlkezghm¶gLb cLfhbNrut5ghuvmokRzmlrgdouykLbN(qezhuyke¥¶ghebb1i¢ cLuvfhutdoº¤BmofD´n_fhbNòlqebket|Êm!ngLb@gfdouykLuvkL¥Êzhb gNZ¹Zd\gDtDLuvkL¥ ghebcRb1f{n_mlfhi@doket b«m!nghebbijcLuvfhutdoerbkRz{uyg}|"uzfb1òHqLuvfhbN gm rb1i mlkez{ghfDd\ghb/kemokr¢Ñghfuyx^ud![vb1dofhkeuykL¥RamluykL¥3z{qLRz}gDd!kHghud!vy| b g{gbfPghedok@gheuvzPmokjgLb°pPmlfhb1RLd!gd/uzºruy·¶t qLyg10®«eb d!kL¢ kLmogd\gmofDzg}|^cLutdoyv|cefhm\x^urbzhbxob1fdoet mliji mlk¶¤BmofDLz½hø´v jv `OïGé!sºú\ùÛVø a~8L~ø ]pñûyø¡Ã5rd!kR n_b1¤Pb1fybNzhztmoijijmok"¤BmofDLz«½h´ø v jv qù c;jl&ø a!Ã5X®«Luz"ijb1dokez/ged\g@d!kekLm!gDd\ghuvkL¥ÊdoyBuvijdo¥obNz"¤uygh[ zd¡|o `«ïdésºú\ùÛVø a5[doke e~ø ]pñûyøjuz d3ijm^LbfDd\ghb1y|zhqettb1zz}n_qL z{ghfDd\ghb1¥o|lµØ bfhn_mofi@d!ketbªqezhuyke¥ÊgLb(bijcLuvfhutdo«¤Pmlf.n_fhb¢ òHqLbkRt |ª¤Bmoqevb fhbNrqetb1u±n gLb bijcLuvfuvt1d!Arb1kezhu±g}|3¤Bdlz ijmofb Rd!g1µ®«^qez10gLbuyketfhb1ijbkHg mon cbfhn_mofi@d!ketbªm\xob1f gheb/bijcLuvfhutdo[rbkezhuyg}|¶uvzd zhbkRz{uvLvbuvkerutd!ghmlf1 ¾&uy¥lqLfb1zõ¶ghLfmoqe¥o)ó¶z{Lm\¤ÈgLbb1fhfmofi bNdozhqLfb cLvm!gz n_mlf Ø ¢ÕloØ « ¢ 6°d!kejØ «¢zd!ijcLvb1mokjm!gjghLbgfdouykeuykL¥/doke ghbNz}g«z{bgzºn_mof ÕNÀ°uvkerb1cRb1kerbkHgBghfuvdovzºqezhuykL¥ ghLbzhdoi bLd\gDd zhb g1&®«LbBx¡dofhud!kRt b0uvk/ghebPm¡©ceymogzWuvz&rqLbPghm fdokermoiÈuvkLu±¢ ghud!vuvÙ1d\guymlk[®«Lb/¹Z»ØÔgbkeLzBgm@z{Lm\¤ ybNzhz«x\d!fud!ketbrqeb ghm°gLbz{gd!euyvu±g}|"ghLbcefhuvmofDz&cLvdlt bmlk"gLbijm^LbÑ ®«euvzb©^¢ ghfDd@z{gd!euyvu±g}|3d!vym\¤z«qezghm¶doLmocrgn_qLvy¢tm\x¡dofhud!kRt bi mrrb1vz d!kRªLb1ket b/mlrgdouykb g{gbffb1zhqLygz1
0.1
0
Method
¾&uy¥lqLfbó,Y ø~o~]pjd_ cÜùbc$]d_)ø&a(aO]Ga~`R|,`(cJ_jªùhgLø fW\jøDúé`(|5ahø´v wygLWø g?]Ga(c´]G_Rùú!ûû cJ_Xø o~]da(ah(ø `q?]G_y[é`3 ù ]´Jù geø(øV\.cJa(c$oDú!û.[Gc`( qù a(c$nV|rqù c$]G_}ah~ø [Gc$oqù c$]G_8`&v ¸0kRt moqefdo¥ouvkL¥ov|oTgLbª~«d¡|obNz/ijb gLmrLz/gbke)gmZcLdot bªym\¤ uvi cmofhgdoket bmokÊghLbn_b1d!ghqLfb1z ¤Pb z{qRz{cb1t ged¡x^uvkL¥¶kLmfby¢ bx\doket b ghmgLb@t mokRt bcLgzgheb|´Lb1zt fuyboj®«Lbjb1z{ghuvi@d\ghbN rud!¥lmokedob1yb1ijbkHgzmon Ð ¤Pb1fhIb Y Ñ /D 8 4 >¨? 4yÕ8 4  ? 4 ÖÕ 4 A > 4 ÖÈ5À 4 >§8À 4 À 684 À 684 >dF ÚÛk¿ghLuz.zhu±gqed\guymlk[ ghLb¯efDz{g)n_mlqLfXt mli cmokebkHgzÐmonªgheb ijb1dokezfb n_b1fgmªgLbjd!fb1dLR©Tñ|Zd!keÊRmlqLkeLdofh|e£\dofhbNd n_b1d!¢ ghqefhbNzAd!kR°ghLbPvdlz}g z{uy©/t moffb1zhcRmlkeghmgLbºijbNd!k"doke z{gd!kL¢ Ldofrbx^ud\guymlk)½vdoRët mlymlqLf1 s^mli bjzd!ijcLvbfb1tmo¥okeu±guymlkZfhbNz{qe±gDzmlk´d!fLuyghfDd!f|ghb1z{g/z{bg uvijdo¥obNzd!fbzhLm\¤ uvk(¾&uy¥lqLfhbN)z A@d!keÖL
N«
m¶·«
ML
Original cat
flowers
cat
mane
cat
~¿
lion
cat
mane
cat cat
®«Lb pPmlfhb1^ed\gd°doke u±gDz0z{b1¥oijbkHgDd\ghuvmokRzW¤BbfbB¬Huvkerv|"cefhmo¢ x^uvLb1§^| ô°moLqezÊ~BdofhkRd!fDÈdoke Ø vkedofÊaqe|H¥lqLvq[)b ¤BmoqLyuv¬obZghm.ged!ke¬¦¸ºfhutZ~BfhmrtD^q³d!ke ô°b}¼}uvbÊ~«d!mXn_mlf cLfm^m!nÜ¢fhbNdoruvkL¥ gLb/cedocRb1f1 É ê ä}é^á}êæèä{îDï åã °ðH ê1ã1éHä{ï ïoåHã1êä}é^å ï!á}çlâ æ±îhá}àlð ä}íDå ð RíDêä}éHæèé °á}âHíåÛí êé Wã1ë_ð HçHçeð ð ê ä}é^á}êíä{ä}ï æèé °ê ð äÛá Bà Nàlë±à ñð[êé^ï Hãä}å !á}â ð ð &ëèàHå AãNëÜð HçlçRð !ð ëèíDæ ïlæ ä}ð æèî{3âHëèð íá&ê1ëèëèTã\î5ßêðá}æèãNé ðRê1éHï BNð ã ä{ïHð ê1«é æèíáÛ3á}íð ä}æèhî{ð â Lð íDð î ¡RíäWêá}ê1íDéHé\ï á ð Bâ^êâlä{ê ê éHæ í5ïlå Tä}íDåÛå ê ìoä}æ±ï Ní jßð ä}ã 0 é íä}ñîDðíhä « íDëèð ë±ê Að AæèíáÛä{ê ð r ð0âHßí ð «êá}íDâHëèë±í ê [êá}æèíæèîDáÛä{å0ê ã A åá{ð êá}oæèð0åá}ê1æèî5éHêï ë
ê1î{âHæèél í áÛä{ê1élåÛëyê á}æèãNé Têä{ê /íá}íäíDåð á}æ êá}æèãNé «à 1àHëèð à ñð ð êä}BéHêì ä{ïíîá@°ä}íDð îDã ïlNí éHæ lá} æèä}ãNíé¦æèá{êê1å å êð«îhêâlé^æ±élï íªláÛã1ä{êä}å éH!åÛá}ë±êâ á}! æèãNé RRð í5ê ä}éHæèé êë±í læèîDã1é vã1ä0ê oí5ï°æ ê Ní Nã\î5ê1ìlàHë±êä BíDãä NçHí æ ä}æè"î5êð ë hð1ê1ê éH\ïíD%å H Nã1ê åä}á}æyíêä ìHëèí0åÛð íDñëèíDð îá}æèãN$é # &Bð éHçlê1àHëèæèìlìlë±ä{æèêåÛá}âlæèí5ã1ïeé ð ê1«é^íDïçHíêäÛá á}/í /íDé\å á"&Bã élj'æ ¡íêä}é^åÛêæ á 1"í /ã íDRé\á í loê1îDåDæèð íDélîDíªê1é^ï Ñé vã1ä ê á}æ±ã1é oå BãNëèàlì ãNëèBíDî(ð àH ë±êðäAîDoë±ê1ëèåÛãNåÛél)æ Hæ î5êá}æè ãNé/ð ã °^ð î5êêéHé^îDï íh*ä &ê ë±ê1åÛê åA\ãïoæ±åÛîñã ð Níä ê1éHï ð îDë±ê1åÛå/,.ço-.ä}/í5ïl æèîá}æèã1éÊ0ì #\ð NíDélí í oçlä}íåÛåÛæ±ã1é /ãNéHæ á}ãä}æ±é + ð Tä}ãN3 ì^êìHæèëèæèåá}æ±î&ëyê á}íDé\áTåÛhíð êé!á}æèîAê1éHê1ë oåÛæèå 1 ã êéHé Bð + 2 1 ã êéHé BðAêé^ï [à 4Dæèî{â^ê lð íDëèå vã1äîDã1ëèëyêìrã1ä{ê á}5æ Ní 3 ^ë á}íä}æèé 607 98 ð Hê á}çlíDçRé\ð á°îDë±ê1åÛå /:!ð ã!ï Ræèà Plð ð;r"ð ð â^ê1é ð lð ê A\íDð åÛæ±Tê1éZêëèà îDëèàlìråá}ã íä}æè3é ð 0[ðAæ á}ê1â ã ? l=ð ð Wã1ëÜð@# @A ãä{ïB&Bélæ' ¡íä}åÛæ á Tä}íDåÛåDð íDë±ê /íDï hð GF ð D ð ! [ä}íDåÛåDð C 98 !ED ßã "ð á}âHðAí ê1éHAï ã1á}æèNé ãä{ïHBêé æèìHìl3åð îD{ë±êð åÛåÛæ' Híä ð 0æ&á}âÈãNé ¡êíçHä çl1ë±íDæèî5éHê îDá}íæèãNä{éÎêá}á}íDã å ê \íDåÛæ±êé íDêá}àlä}í@åÛíë±1íîð á}æèãNé HC I8 A oâlæ låÛí ðê1/éHïíDé\já{êá}êæèë±ãNæ é o!Eð !%! 0# ð Bãä ê1ëè'æ 4Dí5ï3îàlá}åê1éHï3æ ê 1í ^çHçeð# # 0#!ð /æ á}â àHåÛæè3é ð!êé^ê ï \íDåÛãNæ±ê1âlé
ý ü þý ˵ǴÅ!ÿ ÇÊÅHÆ ³ ) b Rb1¥ouvk¤u±gd@zhuvi ceyb/b©rdoijcLyb/¤euvtDuvyvqez{ghfDd\ghbNz«gheb qrguyvu±g}|3uykx\d!fud!Lvbzhbvb1t ghuvmokn_mofqekez{qecRb1fhx^uz{bNªvb1dofhkLuvkL¥R ö[bg°ghLb@Ld!g d )b@ruz}gfhuvLqrgb1Zm\xlbf°dªijuy©^ghqLfbjm!nºiqL±¢ ghuvx\d!fuvd!ghb¥ldoqezz{ud!kez1
$½ # à ¤Lbfb * ij+ u±©^uvgz/qLghfhLb/b@tmorijuvijcRbmlkekLzhbuykHmlgDkÐz, m!# nºgLdob¶ke L d!g dL d! !*fb ghuez" b/ghLi &b@bN%(d!k^')kqL id!keRb1f/t mom!¢n x\d!fuvdoket b n_mofi uy©^ghqLfb/t ml i cmokeb' kH .g -\Ld!kRªgLb t vqez{ghb1fdoz{¢ zhuy¥lkLijbkHgcLfhmled!euyvu±guybNz z{qei ghm(Õl¾Lmof«gLuzb ©Ld!ijcLvbo ¤Bb°dlzhzhqLijb°d gm!gdoTm!nWghL f bb°iju±©^gqLfhb/tmoijcRmlkLbkHgDzrrud!¥o¢ mokRd!t m\x\d!fud!ketb¶i@d\ghfut b1zjdokeÔLuyijbkRz{uvmok * +0/ õLÔÚÛk doeru±guymlk[L¤Bb/z{bgBgLb/ijb1dokezBghm 122 Õ 4 À 9;:: 122 7 4  9;:: 122 8Ö 4 7 9;:: 22 5À 4 6 :: 22 > 4 Ö :: 22 7 4 õ :: 2 : 2 : 4 6 > 4 ó 7 # / 2 8 4  : # = / 2 ? 4 À : # @ / 22 688 44 A :: 3 8Â8 4v4 ÂÕ < 3 ?Â? 44 6À < 3 8Â8 44 Â7 < d!kR/dozz{uv¥okghebºx\d!fuvdoket b B C Õ/ÕÕÀ°À/GÀ FHld!ke°gLb0ijuy©H¢ ghqefhb/cLfmoRd!Lvu±guybNz /D 8 4 6oõ°/E? 4 ÀoD õ? 4 6IAGFJH_ ²uvxobk¨d.gfdouykLuvkL¥¦z{bg3m!n Ld\gDd.cmouvklgDLz K© 8© = 4M44 8© =ONONP zd!ijcLvb1)n_fmoi7ghLbªghfqLb¶iju±©^gqLfhbruz}gfhuvLqrg uy% mlk[ % ¤Pb¶% bNz}gu±¢ i@d\gbghLb(ijmrrbced!fDd!ijb gbfDz d!keQ #ÈqezhuykL¥X¸P¹X0)b dozzhqLijbgLRb B zdofhb¬^kLm\¤k[^LqrggLb/d!f¥oqLijb1klg«b ©^gbkeLz ked!ghqLfDd!vy|"ghm"d" OS zhtbkedofhuvm°¤u±g¶qLkL¬^kLm\¤kjx\d!fuvdoket bNz ¾Lfmoi d!m\xoblºuyg¶uvz@docLcedofhb1klg ghRd\g@gheb¯efz{gjghLfbbn_bNd\ghqefhbNzjm!n Ld!gTd d!fbÔqezhb n_qe¶uyk x\d!f|^uykL¥§rb1¥ofbb1z´n_mlf.t dozz{uy¯Rtd!¢ ghuvmokA)pPmok^xob1fzhbv|oAghLb3vdlz}g"ghLfbb@n_bNd\gqLfhbNz ed¡xlb@mokLv|Ðd i@d!f¥ouvked!eVb Uñb1t5gPmok¶rbghbfijuykeuykL¥ ghm ¤LutD¶t mlijcRmlkLbkHgºuvk gheb°ghfqLb/ruvz{ghfuvLqrghuvmok(djLd!gd cRmluykHgbvmokL¥Hz »z3uvyvqez{ghfDd\ghbNÎ^|¦ghLb)t mlklgmoqLf3cLvm!gzuvk ¾&uy¥lqLfbµÕouykr¢ t vqeruvkL¥XgLbÊdoz{g¶gLfhb1bZuvfhfbvbx\d!kHg@n_bNd\ghqefhbNz¶uvk³ghfDd!uvkLuvkL¥ b ©Ldlt bfed!ghb1zt dozzhu±¯Rt1d\guymlkZmokÊghLbjiju±©^gqLfhb@tmoijcRmlkLbkHgDz b1tdoqezhbʤBbÊi@d¡|³rb gb1t5guruymHz{|^ketfdlt uvb1z@uvk¨zd!ijcLvb1Wz A Ø0fqLkLuvkL¥°gLbuvfhfbvbx\d!kHg n_b1d!ghqLfb1z0LmoLzijmofbcLfmoijuz{b«n_mlf dZ¥lbkLb1fdoyuvÙbNÐb1z{ghuvi@d\ghbb1tdoqezhbª¤Bbª¤uvy«b3vb1zz"cefhmlkLb ghm¶ghfDd!uvkLuyke¥¶mokZdof{gu±ndlt5gzuyk(gLb"zd!ijcLvb"Ld!gdL³ebk(¤Bb xob1fhuy¯ebNµgLuz¶b ©rcbfuyijb1klgDd!vy|lt dozz{uy¯Rt1d\ghuvmok¦m!n°gLb´À!Âl ghfDd!uvkLuvkL¥(b ©Ldoi ceybNz°¤Bdlz/t moffb1t5g/mlkÐÖlÖL 7 cRb1ftbkHg m!n«gheb uvkez}gDd!ketb1zn_mof x¡dofhud!eyb"zhbvb1t ghuvmok[Lqrg°mokeyX| 6Hór 7 cbfDt b1kHg m!n&gheb°ghuvi b/¤ebk3ghfDd!uvkLb1mokd!vñgheb/x¡dofhud!eybNz ®«Luz@b ©Ldoi ceybZzhqL¥o¥lb1z{gz ged\g¶uyn d!k^|HghLuvkL¥eBx\d!fuvdoLvbZz{b¢ vb1t5guymlkedoz¶d)¥lfhbNd\g@cRmoghb1klguvdobkLb¯Lgªuvktvdlzhzhuy¯Rtd!ghuvmok d!kR¶t vqez{ghbfuvkL¥ cLfmoLvbi@z1Hdokejbxlbk¶ijmlfhbzhm ¤Lb1kªrbNd!y¢ uvkL¥µ¤uygh¨Luy¥lr¢Ûruyijb1kez{uvmokRd! ed\gde ¾efhmli z{mli b)z{uvijcLvb b ©rcbfuyijb1klgDz¤Pb´cRb1f{n_mlfhijb1[uygi@d¡|³d!z{mÔRb)gLb)t1dozhb ghRd\gºx\d!fud!Lvbz{b1ybNt5guymlk@uvzmonT¥ofb1d\gbfLb1ycjged!k@uvkªzhqLcbfh¢ x^uvzhb1)vb1dofhkLuvkL¥Rªs^qLfcLfhuzhuykL¥ly|lAd!vijmlz{g"d!v ghLbªyuyghb1fd!ghqLfb mok@x\dofhud!Lvbzhbvb1t ghuvmokªdoke@z{efhuvkL¬\d!¥lbuvzºuyk¶ghLb fhb1¥ofb1zz{uvmok t mlkHghb ©^gN
True mixture distribution 4
0.06
2
True mixture distribution
0.04
x2
4 0.06
0.02
0
0.02
10
0
0 5
20
−10
0.04
−5
−4
5
x1
10
−5
0
5
10
x1
4
44
0.06 0.06 22
2
0.04 0.04 0.02 0.02 0 0 5 5
0 5
−5 −5
20
−2 −2
−2
0 0
10
00
0
−10 −10
0 0
10 10
20 20
−4 −4 −5 −5
−4
0
−10
−5
0
00
55
x1
10 10
EM estimate using relevant variable
5
10
x1
4
0.06 2 0.04
x2
−5
010
−10
EM estimate using all variables EM estimate using all variables
0.02
0
0
20
x2
0.06
−5
0
0 −2
−4
x2
−5
2
−2
x2
0 5
0
0.04
0.02
0 −2
0 5 20 0
10 −5
−4
0 −10
−5
0
5
x1
10
¾&uy¥lqLfbÕYZ[løV\^]G_?`5ùbahú!ùbc$]d_ ]fePùhgLøúI[Gi\úG_Rùúkjløl]femi¡úda(cúnûyø `ø ûvpø oqù c$]G_rcJ_.qù st]u[dcJ\j&ø _8`(c$]G_?`&vxwygLWø \zc;{lqù |5ah}ø o~]G\.?]G_&ø _eù \@ødú _8`cJ_µhù gLø¶bù a(|e ø [Gc`5bù a(c$n&|rqù c$]G_ e~ap]G\sg,c$o~gsº}ø `Gú \.ûyø hù gLø [oú!ù^ú gLdú i¡^ø [dc &ø ahVø _R)ù i¡ú!û |e(ø `]Gi\Vø aJù geø/©T Õ o~]G\.?]G_&ø _e ù v (_}o~]G_?`5bù ahGú `5$ù Thù gLmø \@ødú _8`Gú ahø«hù gLø~ú yaO]&{IcJ\@ú\ùÛø û /hù gL)ø ` dú \jø cJ_ÐJù geø"©LÀ op]d\?]G_ñVø _R$ù msg,c$o~gL`(|jkjHVø `Dbù ` hù gLú\ù ya(|5_?cJ_jhù gLø `~ø op]d_[i\Gú a(cIú n ûvWø st]d|rû [nD}ø nD&ø _bø 0qù cú\û ù ]uoû |,`5ù&ø a(cJ_jv0wygLø [Gc`5qù a(c$nV|rqù c$]G_ scÜJù g^i¡dú a(cú nûy.ø `ø ûy~ø obù c$]d_nDøùùÛVø apú IaO]k{IcJ\jú!ùVø ` hù gLøjqù a(|e^ø [Gc`5qù a(c$nV|rqù c$]G_yv`~cJ_,j( ú `Gú \.ûyø¶ùVø `5ù `ø$ù sºRø j]\ù &ø a(aO]Ga~`]fevJd3Gú _[^IvMIeV]da hù gLøqù ahdú cJ_?cJ_j^scÜJù gdú _[scÜhù g, ]G|rù i\Gú a(cú nûyLø `øûy~ø o qù c$]G_yv]!ùøÊJù geø yaO]nDIú nVcÜû cÜqù [Gc`5bù a(c$n&|5 qù c$]G_8``Og8]ds_cJ_´Jù g5c`!jd|5aø"Gú aRø |5_ _]Ga(\@ú\;û c1~ø [Iv ý ËµÌ ¡ m ´Ï´Å ¢jÅrÏ ÇÊÅLË.Æ ®«Lb i mrrb1Ruzºd"z}gDd!keLdof ¯RkLu±gbijuy©HgqLfbm!n[iqLyghuvx¡dofhud\gb ²°d!qRzhzhuvdokLuvz{ghfuyeqrghuvmokezkY
£ ¤ M M ¥ I h½ O¦ # k%(') à ½}Õ¡Ã ¤Lb1fhb Kk §T¨ I" ¦© / Õ 4&4k4«ª¬PrbkLmoghbNz gLb3mlezhbfx¡d!¢ ghuvmokRz ¤z ½ ®% # %(' ÃBbketmoijcedlzhzhb1zdoyñgLb/ijm^Lb[cedofdoi ¢ b gbfDz rb1kLm!gb1zgheb@i uy©ruyke¥(¤Pb1uy¥llgDz® #¦doke rb1kLm!gb ghebZijb1 d!k³doke³t m\x\d!fud!ketb3mongLbZijuy©HgqLfbZt mo' ijcmokLb1kHg rb1kez{uyghuvb1z1[d!kR * rbkem!ghbNz ghLb k^qLi"bf°m!nBt moijcmokLb1kHgz1
®«Lb ijuy©^ghqLfb ijmrrbWuvz rb ¯ekeb1mokgLbz{gdokeLdofcLfmoed!¢ Luvyuyg}|3zhuvi ceyb©uK Y .¯  n_mlfd!v -doke ° / ÕdPH )b"t mlket b1klgfd!ghb°mokgLuvz z{uvijcLvb ijm^LbTn_mlfcLfb1zhbkHgd!ghuvmok cLqLfcmlzhb1z1 ×m\¤BbxlbfNb©Hgbkezhuvmokez3ghmLuvbfDd!fDtDLutdo ijuy©H¢ ghqefhbNz ½~BdofhkRd!fD doke¶¾emofDz{|HghªÀoÂoÂeÕoo×m!n_i@d!kLkÊÕ1ÖoÖlÖlà doke x\d!fuvd!ghuvmokedoTiju±©^ghqefhbNz ½~BvbuAbg d!ÑÀoÂoÂHÀoÃBd!fb/z}gfdouy¥llghn_mofh¢ ¤«d!fDT öWd\ghb1f1uvk)s^bNt5ghuvmok 7 vÕo¤PbcLfhbNz{b1kHg dªzhyuv¥oHgi mr^¢ uy¯Rtd!ghuvmok)m!nBghLuz°ijm^Lbn_mlf/moqLf/mlr¼}b1t g°fb1tmo¥lkLu±guymlk´doke i"qe±guyijb1Luvd gfdokez{d\guymlk3docLcLvuvt1d\ghuvmokRz )bÈuvkHghfmrrqet bÈgLb vd!ghb1klgÎdoyvmrtd\guymlkx\d!fud!Lvb1z²± § KlÕ 4k4&4 PghmÐuvkerutd\gbªged\g¶d)cedof{guvtqLvdof zhb1òHqLb1ket b
bv% mokL¥H%z/* gh m)dÊzhcRbNt uy¯RtªtyqRz}gbzf -!´®«LbNz{b3uykeLuvt1d\ghmlf"x\d!fuy¢ d!eybN³z K´± Õ 4k4&4 ª¬P t moffb1zhcRmlke@gmjdok3uÑ u T0zd!ijcLvb n_fmoigLb
f¦Or© u/z}gfhuvL% qrguyml% k µ&$½ ± / -à / ¶®·$¸ E ¹ ºk»^¹½¼AE ¾°zJ º Y ºNJ ¿°R º´»@U )bn_mlyvm\¤d3LuvbfDd!fDtDLuvt1d! ~«d¡|ob1zhud!kZz{ghfDd\ghb1¥o|(¤Lb1fhbgheb qLkL¬^kLm\¤k´ced!fDd!ijbghbfDz ¤ d!keZghLb@doyvmrtd\guymlkZx\d!fuvdoLvb1z³± d!fbfhb1¥ldofrbNµdlzjRb1uykL¥.Lfd¡¤kÔn_fhmli docLcLfmocLfuvd!ghbcLfuymlf ruz}gfhuvLqrguymlkez1´bdotD¬^kLm\¤vb1r¥lb/moqLf qLket b1f{gDd!uvkHg}|3d!moqLg ghebªb ©Ldlt5g/n_mofim!n«ghLb3cLfuymlf ^|)zhcRbNt uyn_|^uykL¥Êu±g uykÐgbfijz m!nºzhmoijb qekL¬^kLm\¤k(ced!fDd!ijbghbfDz ½H|^cbfced!fDd!ijbghbfDzDÃ5)b cLdotb^|^cRb1fhcefhuvmofDzmlk´zhmoijbmon0gheb ^|^cbfced!fDd!ijb gbfDzzhm ghRd\g0uvfhfbvbx\d!kHg n_b1d!ghqLfb1zdofhbzhLfqLkL¬ gm/d/t moijijmok x\d!vqLbo ®«ed!gªuvz1«ghebÊb1z{ghuvi@d\guymlk³m!n°ghLb´^|Hcbfcedofdoi bghb1fzj¤uvy d!vvm\¤µqez gm/bvuyijuvked\gbghebVb Uñb1t5gPm!nñuyffhb1yb1x\d!kHg n_b1d\gqLfb1zuvk gheb/i uy©^ghqLfb/ijmrrbÑ À qLfÎeuyb1fdoftDLutdo(~Bd¡|lb1zhuvdokijmrrb´uvz rbcLut5gb1$dlz³d ¥ofDd!ceLuvt1d![ijmrrb1Auvkʾ&uy¥lqLfhb"ÀL®«Lb"doyvmrtd\guymlkx¡dofhud!eybNz ± dofhbdlzhzhqLijb1 gm"brfDd¡¤kjn_fhmli d/iqLyghuvkLmoijud!ñruvz{ghfuy¢ L qrguymlk[? ± Á ½}Õ ¦ Ã5L¤LutD(dorijuygzBgLb rbkRz{uyg}| µWb½ ± ~£ à /  ?à bÄÅ«Æ$Ç % ¤Lb1fhb È $½ ± à / ÕBuy n bvmokL¥HzWghm°¥ofmoqLzc -Pdoke È b½ ± à /  m!gLbf¤uz{blW)bcLdotbd/t mok!¼}qL¥ld!ghba uyfuvtDeybgºcLfuymlfmokjgheb iju±©ruvkL¥´tm^b ·¶t uvbkHgz ÊÉ q½ ËLÃ5Rd¡xHuvkL¥(gLb¶n_mlyvm\¤uvkL¥ rb1kez{uyg}| µW½ £ ËLà / ½bË ÃyÌ Íkb½ Í&Ë Í N à ½bË Ã Â Î ~Ï % ½ÀlÃ Ì Ì ¤Lb1fhb Ì «½ Í ÃZrbkLmoghbNzghLbÔ²°doijijdÔn_qLkRt5ghuvmok doke Ë N / Ë )b¶dozz{uv¥ok)d²°doqezhzhud!k)cLfhuvmofgm3gLb¶t mlijcRmlkLbkHg/ijb1d!kRz # = = h½ #WS %OÐ Ã5 ¤Lbfb Ð uvzrud!¥lmokedo¤uyghÈbvbijbkHgz Ñzhb f% xo4&b14k34 % LÑ d\gD" dL0)®«b°Lb°gdou¬orb b1d #WuSz«ghghm@mjbNb z}gzhuyi@doijd\gcLb°yb°ghLijb b1dok3zmozhnWqetDgL3b/ghemod!Lg¢ gheb/uyffhb1yb1x\d!kHg«n_b1d\gqLfb1z«ed¡xlb Ñ S zkLbNd!fÙ1bfmjÑ doS keªghLb tmofh¢ fb1zhcRmlkeruvkL¥/t moijcmokLb1kHgz m!n # dotfhmHzhz&¥lfhmlqLcez d!fbz{LfqLkL¬ ghm\¤«d!fDLz«zhbkezhuyeyb/t mliji mlk3x\do yqLbNz
)b cLdotbdt mlk\¼}qL¥ld!ghb uyk^xob1fzhb ¢³uz{edof{gPcLfhuvmofPmokªghLb°t mo¢ x\d!fuvdoket bNz ') ÒÓ " b½ Ô % Ô ' SNÃ5Rdorijuyg{ghuvkL¥jgLb rbkRz{uyg}| µ&½ ' £ Ô %(' S tÃ Õ £ ' £ Ï®ÄÖ× " × Ç$Ø = b©^yc KÙ ½}GÕ Ú!ÀofÃ Û Ür$½ Ô ' S ' Ï ~à P ®«Luz¶cLfuvmof@uz¶t b1klgbfb1d\gªghLbÊtm\x\d!fuvdoket bm!n°ghebÊLd\gDd 'Ñ Ý = S!ºß)Þáb/à cL$½ vâ dlt b à «dokn_mouvf k^xoä b1f/ zhb°²°Õ do4&ij4k4 ij* d@+ L¿uvz{gh®«fLuyeuvzqrghruvmouz}kgfhmouvLkqrbNgdouymltDk % % doLi uygzghLb %prã b1kezhu±g}| µ&½ Ñ Ý = £ â %~ã à Õæå Ñ Ý?= ç ÏyèéÏ b©^uc ê Ù Ñ ã = 4 Ýáë ®«Lb Ñ Ý = dofhb/dozzhqLijb1ªghmjRb/uvkerb1cRb1kerb1kl´g Y µW½ Ð £ â %~ã à /  " µ&½ Ñ Ý = £ â %pã Ã Ý s^uvket b@doygLbjcLfuymlfz°d!fbjt mok!¼}qL ¥ld!ghboAmorgDd!uvkLuyke¥3gLb@cmlz{¢ ghb1fhuvmof ruvz{ghfuvLqrghuvmokRzm!n&gheb"cedofdoi bghb1fz«^|t mokRru±guymlkLuvkL¥ mok3gheb d!vymrtd!ghuvmokx\d!fuvdoLybNzBuvzz{ghfDd!uv¥oHghn_mof¤BdofT a α
Σ∗ Σ
b υ
µ∗
τ
λ
µ z x
¾&uy¥lqLfbªÀ5YìlZzí²eV]da¶ùhgLø^îúdoø(`(cúd_\zc;{lùq|5ahø^\^]k[lø ûscÜùJg `Og,a(cJ_5ïokú jllø ya(c$]Ga~`&vwge)ø {^~ø [g5pL&ø a(MeGú ahdú \jøù&ø a~`jdú ahzø ah ø ahVø `Vø _Rù~ø [scÜhù gTn~]&{^(ø `~@hù gLø i¡dú a(cú nûy(ø `[oøù&ø a(\cJ_~ø [²nV.hù gLø [oú!ùú3éú `[]d|?n ûvø o&cJaOoûyVø `p«Gú _[¶Jù geRø |5_5ïG_y]Gs_uaGú _[I]G\ði¡dú a(cJ ú nûyVø `RscÜJù gÊVø \.qù Wo&cJaOo ûv(ø `&v ý ÍÎÇ Ç´År赮 ñ Ï.Ë ®«Lb°cedofdoi bghb1fzPm!nWghLb°iju±©^gqLfhbijmrrb[t1d!kLkLmogRb/t mli ¢ cLqrgb1d!kRd!v|lguvt1d!vy|ªqLkLvb1zz«mokLb°¬^kLm\¤zBghebijuy©^ghqLfb/uykRru±¢ td!ghmlfBx\dofhud!Lvb1z1&´b°ed¡xlbgm fb1zhmofhgºgmjkHqei b1fhutdoñi bghr¢ mrLz1 À kLb/td!kuvijcLyb1ijbkHgd@²uyLRzzd!ijcLvbfBghm¶tmoijcLqrgb gheb"cedofdoi bghb1fzdoke(d!vymrt1d\ghuvmokx\d!fud!Lvb1z1®«Luvzuvz rmokeb ^|.zhdoijcLyuvkL¥´ghLbcedofdoi bghb1fz d!keÔd!vymrt1d\ghuvmokµx¡dofhud!eybNz n_fmoighLb1uyffhbNz{cb1t ghuvxob3cRmHz}gbfuymlfz1Z×m\¤BbxlbfNAgLuvz d!v¥omo¢ fu±gLi$td!kÊRb t moijcLqLgd\guymlked!vv|3uvkHghbkRz{uvxob"n_mofgLbdocLcLvu±¢ td!ghuvmokezº¤Pb ed¡xobuyk¶ijuvkeTÚÛkez{ghbNdo@¤Bbmlcrgºn_mlfBdok@b ©rcb1t5¢ gd!ghuvmok)i@d\©ruyijuvÙ1d!ghuvmok½¸º¹´Ã°d!v¥omofuyghLi$gm(t moijcLqLghbjgheb \@&ú {IcJ\z|5\%ú ?]é`5ùÛVø a(c$]da(c ½¹Z»ØBÃcRmluykHg b1z{ghuvi@d\gb1z°m!nBgheb iju±©^gqLfhb/ijmrrb1
ò·$¸ ¾³óô¿WõBX»}¹Wº öXó
»nÜgbfuykLuyghud!vuvÙ1d\guymlk[[gLbª¸P¹ doy¥lmofu±gLi$n_mlf"¹Z»Ø§bNz}gu±¢ i@d\guymlk3uyghb1fd!ghb1z«b g}¤Bbb1kghLb°n_mlyvm\¤uyke¥"g}¤Bm@z}gbcezkY ¸· ¾Á`1G1FHm ÷/pPmli ceqrghbghLb¿b ©rcRbNt5gDd\ghuvmok m!nXgheb¿t mli ¢ cLvb gb vmo¥o¢Ñcmlz{ghb1fhuvmofݤuyghd!vymrt1d\ghuvmok%x\d!fud!Lvb1ùz ø½ ¤ à / úû +ý þ~ÿ D yml ¥ µWb½ ± % % ¤ à FT¤Lbfb ¤ Ä Ç fbcefhbNz{b1klgDz gLbÄÅéx\ü doyqLbm!Ç n0gLb"cRd!fDd!ijb gbfDzd\g ghLb cLfbx^uvmoqezghuvijb z{ghb1c[ · ó `GNFH ÷°¹Zd\©ruvijuyÙ1b"m\xob1fgLbcRd!fDd!ijb gbfD&z Y ¤ Ä Ç / dofh¥0þi@d!© ø½ ¤ à ¾LmlfgLbj¸ z{ghbcA¤BbtmoijcLqrgb"gLb cRmHz}gbfuymlfm!ngLbjd!vymo¢ td!ghuvmokx\d!fuvdoLybN&z Y µWb½ ± / -
Ã
µW½b± / - £ % ¤ Ä Ç Ã / µ&h½ ~£% ¤ Ä % ¤ Ç ÄÃ Ç % ¤LutD[Luvk3mlqLftdlz{blruvz¥ouvxobk3^| Y $½ 6HÃ / h½ h½ O ¦ # k# %(') Ã Ã p
¦ %(') ¾Lmlf ghLb(¹ z{ghb1c[º¤BbkLm!gb3ged\g gheb3n_qeket5guymlk ø½ ¤ à b©^¢ cedokeLzBghm ¥ ¥ Ù ÀÕ à £ £ Ù ÀÕ ½h Ù # à H Ï ½h Ù # à '
Õ ' Õ ¥ Ù À yml¥ £ £ Ù À ½h# ÙL# S à H Ï ½h# ÙL# S Ã Ð Ð Õ ¥ Ù À ½bÔ * + Õ¡Ã^yml¥ £ £ Ù ÀÕ Û Ü^½bÔ S Ï Ã ') ' ' ¥ «½ ÙâÙ¦ÕNÃ^vmo¥ å Ñ Ý = ç Ù ã = 4 ÑÝ Ý ®&d!¬^uyke¥¨rb1fhuvx\d\ghuvxobNz"¤PbÔmorgDd!uvk ghLbÔn_movvm\¤uykL¥¨qLcñLd\gb b1òHqed!ghuvmokezBn_mlf«ghLb/ijmrrb1[ced!fDd!ijbghbfDzkY
ª ! Ë Ë Ù ÙÔÕ * # ½ V' Ï Ð Ï Ã Ï ' Ï ½ ¥ Ã Ð Ï # S D ½$ ÙL# à ½$ ÙL# ÃfH;F Ô ' S Ô ½ * + ÕNà ' Ñ Ý = â ã= Õ Àdâ *Õ À ¥ ½h# Ý Ù # ÝS à = ¤Lb1fhb M )®«eb1zhb¶qLcñLd\gb1z1 ghmo¥lb gLbf ¤u±g b1òHqed!ghuvmokн$H6 Ã5etmokez{ghuyghqrgb/moqLf¸P¹7doy¥lmofu±gLi
"
#
!
wzhuvkL¥"gLb°i@d\ghfuy©ªuyk^xlbfDz{uvmok¶vbiji@dL^¤Bb/td!k3fhb1¤fhuyghb gheb qLcñLd\gb z}gbcn_mof# doz # Ð ½ ') OÐ Ã Ï ½ ¥ à ') ½ ') OÐ Ã Ï # S
ÚÛk gLuz b ©rcLfb1zz{uvmok[¡¤BbBLmok S g&Rd¡xob0gm°uyk^xob1f{gWghLbrud!¥lmokedo i@d\gfhuy© Ð @®«Luz/cbfi uygz bvbijbkHgz m!n Ð ghm(¥lmghmÙb1fhmR d!vvm\¤uykL¥n_mof«n_bNd\gqLfhb zhbvb1t ghuvmok[ ¾Lfmoi7gheb¸P¹ qLced\ghbb1òHqed!ghuvmokez1 mokLb3td!kµfhbNdoruvy|)moL¢ zhbfxob gLbjz{LfuvkL¬\d!¥obuyk´mocbfDd\guymlk[/»z ÂLgLbbNz}gu±¢ i@d\gbBmonegLbijb1d!kRzz{LfuvkL¬rzAgmghLbzd!ijcLÑ vb«i bNd!kjd!ke"gheb t m\x\dofhud!ketbPzhLfuykL¬rzWghm ghebzhdoi ceyb«t m\x\d!fud!ketboA®P|^cLuvt1d!vy| ¤BbkLmlfhi@doyuz{bghebjed\gdzhmªged\g #WS / Âd!kR ' S / Ò " ×b1ket bl^ghLb°gbfÊ i Ô Suyk3gheb/qLced\ghb/monAgLb/t m\x\d!fuvdoket bNz z{gd!euyvuvzhb1z ghLbd!v¥omlfh' uyghei´®«ed\g uvz1u±gjcLfbxlbkHgz ghLb3uyv±¢ t mlkeruyghuvmokLuvkL¥cLLb1kLmoijbkemok´dofhuzhuykL¥ªn_fhmli$ed¡x^uyke¥dokÊqLkr¢ moqLkeLb1yuv¬ob1yuvLm^mrT Ë m´Ï)Ç ²É ´Ï.²Ë ³Æ¨ÅlÇ´År赮 ² L ÅrÏ ÇÊÅLË.Æ À xob1f)ghLbdoz{gXLb1tdlrbo@¤Bbed¡xob¦b ©rcbfuyb1ket bN¿dok¿b©^¢ cLvmlzhuymlkÝm!n.i"qe±guyijb1Luvduvk ruv¥ouygdoÊvuyefdofhuvb1zÎdoke>gheb ¤Bmofv^¢¤urb ¢¤Pb1[:ÚÛkced!fhghut qLd!fN¶¤BbÎed¡xlb³¤u±gkLb1zz{bN gheb)b1ijbf¥obkRt b)m!nd!f¥ob)t mlyvb1t ghuvmokezm!njd!kLkem!gd!ghbNÎuvi¢ d!¥lb1z1 ¸©Ld!ijcLvb1zÔm!nÊghLbNz{bÈuykRt vqerbÈghLbpPmlfhb1Ld!gd!¢ zhb g¦½z{b1bµ¾&uy¥lqLfxb 6là "ijmlz{gÊiqez{b1qLi uyi@do¥obµtmovybNt5ghuvmokRz ½ lÃ5«gheb ¤Bb¨doftDeuyxlbÔ½ rà ºkLb1¤zcLLmo¢ ghml¥ofDd!cLRzrcLfuvx¡d!ghb°cLLmoghm¶doyLqeijzd!kex^uvLbmlz1º¹(qe±guyijb ¢ rud fmom!guvt1zH¤Lbfbfmom!gDzPdltòHqLuvfhbuvi@d!¥lb1z1HzhmoqLkRLzºdoke ghb©^gWdoz[ghLb1| ked¡x^uv¥ld!ghb&ghLfmoqe¥o d«cedof{guvtqLvdof[bk^x^uvfhmlkLijbkHg d!zhm3fb1zhqLygzuyk´gheuvzg}|^cb monBLd!gde®P|Hceuvt1d!vy|lñghLbNz{b@d!kL¢ kLmogd\guymlkezPfhbn_bfBghmghLb/tmokHghb1klgBm!nWghLb°d!kLkem!gd!ghbN¶uvijdo¥obl Lqrg i@d¡|Zx\dofh|(uvk)ghLb1uyf"dlttqLfdlt |(d!kR)tmoketuvzhbkeb1zzj¾Lmlf uvkez}gDd!ketbo¡gLbpPmofbrd!kLkem!gd!ghuvmokez&rbNzhtfhuvRb«zhcRbNt uy¯RtBuyi@d!¥lb t mlkHghbkHgNeqrg/kLm!g/d!vWmonºuyg1 ¹(qezhbqei t mlyvb1t ghuvmokezd!fb m!nÜ¢ ghb1k(d!kLkLmogd!ghb1ª¤u±g(z{mli b/zhcRbNt uy¯Rti@d\ghb1fhud!TzhqetDdozBgheb d!fhghuz{gd!keXed\ghbªm!ndot1òlqeuvzhu±guymlk[d!keÐmonÜghb1kXghLb3d!kLkLmogd!¢ ghuvmokRzrb1do[¤u±g(z{mli b°fDd\gLbfd!Rz}gfdlt5gi@d\ghb1fhud!Ñ ®«Lb"dokLkLmogd\gb1uvi@d!¥obLd\gDd¶d!vym\¤zqezgm@n_mofi"qLd\gb moL¢ ¼}b1t gÊfb1t ml¥okLuyghuvmokÈdozZd³z{gd!ghuz}guvt1d! i@dltDLuykeb´gfdokezhvd!ghuvmok cLfmoLvbi ½aqe|H¥lqLvqµb g¶do0À!ÂlÂlÀlÃ5дbzhb¥oijb1klgjuvijdo¥obNz uvklgm´fb¥luymlkezª½LvmoezDÃ"dokeXgLbkÔybNd!fkXghm)cLfb1rut5g ¤Pmlfez qezhuyke¥´fb¥luymlkezX¸PdotD.fb¥luymlk.uvzjrbNzhtfhuvb1.^|.zhmoijbz{bg m!n"n_b1d\gqLfb1z1¿ÚÛk¨ijdltDLuvkLbÊgfdokezhvd!ghuvmok[dµyb©ruvtmokÎvuyke¬^z ¤BmofDLz)uykmlkLbvdokL¥oqedo¥obÔghm ¤BmofDLz)uyk gLb³m!gLbf.d!kL¢ ¥oqRd!¥oblÔ½~Pfm\¤k[a bvvd´Ø0uvb ghfDdLa bvvd)Ø0uvb gfdÊd!ke.¹Zbfh¢ t b1fÊÕNÖoÖ 6eº¹(b1vdoi bN À!ÂlÂLÕ¡Ã5 ÚÛkÎgLb´Lmoi@d!uvk³m!n mlr¼}b1t g fb1t ml¥okLuyghuvmokAºgLbn_b1d!ghqLfbZ¤BbZdozz{mrt ud\gb3¤uygh³uvi@d!¥lb(fhb¢ ¥ouvmokRz rmZkLmog"ked!ghqLfDd!vy|)mrttqLc^|´dZruzt fb ghb3z{cedlt bl®«eb zhuyijcLvb1z{gBzhmovqrghuvmok¶ghm gLuzºcLfmoeyb1i uzºghm qezhb ô¢ijb1dokezgm xobNt5gmofòHqed!kHguvzhbghLb uvi@d!¥lbfb¥luymlk3fbcefhbNz{b1klgDd\guymlk[®«Luvz d!cecLfhmHdotD[dormlcrghbN(uvkµ½a qL|^¥oqLvqÊbg°doTÀ!ÂlÂlÀlÃ5e¤«doz¤Pb1y
$
'
&%
$(*)
,+.-/-103254/4"6/6/687-1+:9A@87BC@/D.4CE/FGH4"-1+I9A@J7+1-"G:K ,+.-/-103254/4"6/6/6875FC@IL+H9M.>N7BC@1D
bn1
y uvmoki@d!keb¥lfdlzhz«zh¬^| ¼}bgcLd!kLb/zh¬H| ¾&uy¥lqLfb68Y {^úG\.ûyøV`e~aO]d\$ùJgeø ]Gahøû [oú\ùÛúW`ø ù hìR|5&j|rû| øùú\û v³,d v (ø geúGi\ø´úG`~`V]´o&cú\ùÛøp[ ïoø&Gst]Gap[é`ÊúG_y[ `øqj \@Vø _R$ù `)eV]Ga¶øDú o~g cJ\jkú jlVø ³n&|rù sºWø [I]G_ mù ïd_]dsTsg5c$opgst]GaO[ o~]Ga(ahVø `q8]d_[G`¶ù ]sg,c$o~gr` ø j\j&ø _e ù v wygL ø _?|5\^nDVø aW]«e^st]Gap[é` Gú _y[`ø jd\@&ø _ebù `oDGú _ nø [Gc Vø ah&ø _eù P&ø i¡&ø _sgeVø _´Jù geVø ªdú ahø hù gLø `Gú \@(ø sº)ø \jdú lgLdú i¡ø \]dahøhù gLdú _W]G_ø `qø j\@Vø _Rù eV]Ga³ú `(cJ_joûyø st]Gap[ém]da\]dahø hù gLdú _ ]d_ø st]GaO[.eV]Ga^ú `~cJ_,j!ûvø nû ]Inkv PO
XW
p(wn1|bn2)
:Y
[Z
fb1t b1uyxlb1Ô^|.ghebÊt mli ceqrghb1f@xHuzhuymlktmoiji"qekLu±g}|Ƚ_uygª¤Bmok b1z{g&cedocRb1fAcLfuvÙbºuvktmo¥lkLu±guyxlbºt mlijcLqrghb1fWx^uz{uvmok d!g&¸«ppP À!ÂlÂlÀlÃ5A)b¤BmoqL yuv¬ob«gm z{qLfijmoqLkHggLbcLfmoLvbi¿m!nñed¡xH¢ uvkL¥@ghmªuykHghfmrrqetb/kLmouz{b"H|3xobNt5ghmlfòHqed!kHguvzhuyke¥jghLb eymlez zhmµuvkez}gb1dlΤBb)dlrmocrgdÔLuvzt fb gb ¢}²°d!qezz{ud!kgfdokezhvd!ghuvmok ijmrrb^ged\gºdoyvm\¤zAqRz&ghmghfDd!kezhd\ghb²°d!qRzhzhuvdok"n_bNd\gqLfhbNz ru±¢ fb1t5gy|gmLuvzt fb gb"n_bNd\ghqefhbNz"®«ebjzhLfuyke¬¡do¥ob t moijcmokLb1kHg m!nmlqLf/ijm^LbPdoyvm\¤z/qez/ghmÊt1d!ffh|Zmlqrg/n_b1d!ghqLfbªzhbvb1t ghuvmok ¤uyghLuvkghLuz«ghfDd!kRz{d\guymlk3cLfmrt bNrqLfbo ·$¸ ¹W¿ªU ¼®õt¿°R º´»@U ó » ¾lõ)¼ À qLf°d!cLcefhmHdotD(gm3fb1tmo¥okeu±guymlkZuvz°doked!vmo¥lmoqez«gmijdltDLuvkLb ghfDd!kRz{d\guymlk[Rdlzmofuv¥ouvked!vy|3cLfmocmlzhb1^|)½aqL|^¥lqLyq´b g do À!ÂlÂlÀlÃ5°´b gfdokez{d\gb"uvi@d!¥obfhb1¥ouvmokez ½¾efhb1ketDRÃghm¤Pmlfez ½¸ºkL¥ovuz{Rà $ÚÛk§ced!fhghut qLd!fN°moqLf(ijmrrb1"dot gz(doz(d§ûvOø {IcJ o~]G_Rld°rbx^ut bNz ghed!g0cLfb1rut5gDzmokLb«fbcLfb1zhbkHgDd\ghuvmok½_¤BmofDLz ¸0ke¥ovuvzhRë¥luyxlbk(d!kLmoghLb1ffbcLfb1zhbkHgd!ghuvmokн_uvi@d!¥ob"fhb1¥ouvmokez ¦¦ ¾LfbkRtDRÃ5ö[bNd!fkLuyke¥Zdyb©^ut mlk)n_fhmliLd!gduz"d(z{gdokeLd!fD cLfmoLvbi¨uyk/i@dltDLuykebghfDd!kezhd\ghuvmokvu±gbfDd\ghqefhb½~Pfm\¤k°b gWdo Õ1ÖlÖ 6e¹(b1vdoijb1ÐÀ!ÂoÂeÕNà "®º|^cLutdoyv|o[dvb ©rut mok´uvz°vb1dofhkeb1 n_fmoi d n_mlfhi m!nLd\gDd@z{bg¬^kLm\¤kdozdokXú!û c;j_~ø [nVcÜùÛOø {lù dªghb ©^g°uyk´g}¤Bmªd!kL¥lqed!¥lb1z¤ebfbfmoqL¥lÊt mlfhfb1zhcmokerb1ket bl cbfed!cezd\ggLb cedofdo¥ofDd!cLmofzhbkHgbketb/yb1xobÑeuz¬^kLm\¤kA ®«Lb/cLfmoeyb1i m!n yb©ruvtmok(dot1òlqeuvzhu±guymlk3uvk^xomlyxlb1z«rb gbfijuykr¢ uvkL¥/cLfb1t uzhb«tmoffhbNz{cmokRrbketb1z&b g}¤Bbbkj¤BmofDLz m!nTru Ub1fhb1kHg d!kL¥lqed!¥lb1z1¦»ked!vmo¥lmoqezhy|lº¤Bb(td!k³tmokezhuvLbf¶dÐLd\gDdÐz{bg t mlkezhuvz{ghuvkL¥µmon"d!kLkem!gd!ghbN³uyi@do¥ob1z3dozd!k doyuv¥okeb1³Luyghb©^g zhuyketb¤Bbed¡xobd!k@uvi@d!¥lbt mokRz{uz}guyke¥/m!nñfhb1¥ouvmokez1od!kR@d/z{bg m!nBghb©^g1´b¶¬^kLm\¤¿gheb@ghb©Hg¥om^b1z°¤uyghÐgLb¶uvijdo¥oblALqrg ¤Bb°Lmok S g¬^kLm\¤ ¤LutD¤Pmlf3¥om^b1zB¤uygh(¤LutDfhb1¥ouvmok[ pPmoijcLqLghuvkL¥ ghLb gfdokez{d\guymlk cLfmoRd!Luvyuyghuvb1z uz kLmog z{ghfDd!uv¥oHg{n_mlfh¤«d!fDRbNtd!qRz{b¤Pbed¡xob"d htDLutD¬ob1kZd!keÊb¥l¥ zhu±gqed\guyml k Y§ghm¨LqLuvv ghLbÔghfDd!kezhd\ghuvmok cefhmled!Luvvu±guybNzZ¤Bb kLb1b1ghm°¬^kLm\¤.gLbt mlfhfb1t g tmoffhbNz{cmokRrbketb1z&b g}¤Bbbk uvi¢ d!¥lb1zBd!ke¶¤PmlfLz1HLqrg«ghm¯e¥oqefhb moqrgBghLb°t mlfhfb1zhcmokerb1ket bNz ¤Bb kLbbNghm@¬^kLm\¤Ègheb/ghfDd!kezhd\ghuvmokcLfmoRd!Luvyuyghuvb1z1«»zb©^¢ cLd!uvkLb1 uvk(½a qL|^¥oqLvq@b gºdolÀoÂoÂHÀoÃ5o¤Pbtdokjm\xobfDt mlijbºgLuvz \
bn3
TS
]
H^
`_
Ca
b n2) 2| p(w n
VU
RQ
bn2
wn1
p(wn3|bn2)
wn3
wn2
horse
Gandalf
trees
¾&uy¥lqLfbX>?Y wygeø)úG`~`V]´o&cú\ùqc$]G_xaO]InDún&cÜûcÜùbcøV`}yaO]Gi´c$[oø)ùhgLø o~]Ga(ahVø `q8]d_[løV_yoøV` ÛúG`~`~c;j_?\@ø&_eùb` nøùqsºøø&_ÊøDúo~gst]Gap[@úG_[ hù gLø i¡dú a(c$]G|,`RcJ\@ú&jHøR`ø j\jø&_eùb` fnû]nV` v cLfmoLvbi ^|Îi@dofh¥luykedoyuzhuykL¥Ôm\xob1fªgLbÐcRmHzhzhuyeybXdozzhm^tuvd!¢ ghuvmokRzqRz{uvkL¥Ðd´ijuy©^ghqLfb3ijmrrb1Bd!kµurbNdZged\g@¤«doz mofuy¥o¢ uvked!vy|(cefhmlcRmHz{bN(n_mof ghb©^g°uvk½~Bfhm\¤kÊb g d!Ñ Õ1ÖoIÖ 6là ®«Luvz ijmrrbrdozzhqLijb1zWmokLb¢gm!¢mokLbPcLfhmled!euyvuvz{ghutºdlzhzhuv¥okLijbkHgDzWdlz zhLm\¤k uvk ¾&uv¥oqLftb >RW¾Lmlf b1dotD"Lyml uvkghLb ¢g uvijdo¥obl1gLbfbBuvz dcefhmled!Luvvu±g}|°m!nLuyg Rã b1uykL§¥°do¨ zzh" m^tuvd!ghbN/¤* u±g b1dltD m!nrgLbB¤PmlfLz uvk gLbºuvi@d!¥lboW¹ZmofbºcLfb1tuvzhbv|oNgheb ghfDd!kRz{d\guymlkªijmrrb[uz ¥luyxlbkª^y| Y µW½ ã £ à /   ¥ µWb½ â / © fÃ Û ½ ã / ã £ / à M ¤Lb1fhb µWb½ â / © Ãrbkem!ghbNzghLb¶doyuv¥okei b1kHg°cefhmled!Luvvu±guybNz zhqetD ghed!g â uyn ghfDd!kezhd\ghbNz ghm ®«Lbk^qLi"bf m!n&Lvmoezdokeª ¤B/ mofD© LzBuvã k3 gLb * ¢Ñghuyi@d!¥lb/d! f b d!ke fb1zhcRbNt5ghuvxob1y|lsruyketb@gheb¶¤Pmlfez/uykÐgLbªdokLkLmokRd\ghuvmokRz d!fb qLkLmlfLbfb1TgLbfbÊuzkLmµfb1dlz{mlkn_mofcLfb n_b1fhfuyke¥µz{cb1tu±¯t d!vuv¥okLijbkHgDz®«Lb1fhbn_mofbor¤Bb°zhb g µ&$½ â / © à / éÕ Ú ÚÛk¿½aqe|H¥lqLvq¨bgdoÀ!ÂlÂlÀlÃ5 Û ½ ã / ã £ / êuzd ruzhtfhbghbgfdokezhvd!ghuvmokjgdoLvbo ÚÛk@gheuvzBd!cLcefhmHdotD[\gLbgfdokez{¢ d\ghuvmokjcLfmoRd!Luvyuyghuvb1áz Û «½ Í £ Í Ã0d!fb²°d!qezzhuvdok[W¹(mlfhbcefhbNt uz{b1y|l ghebfbZuvzªmokLbʲ°doqezz{ud!k¦n_mof3b1dltD¦¤BmofD¦uykgLbZxlm^t1d!LqL¢ d!f|o ¸ºdotD@¤BmofDj¥ob1kLbfDd\gb1zuvi@d!¥lb zhb¥oijb1klgDzn_fmoid tmofh¢ fb1zhcRmlkeruvkL¥ª²°d!qezzhuvdoktyqez{ghb1f1B~B|tyqez{ghb1fhuvkL¥jgLb/¤Pmlfez ½zd¡|ª¤uyghZô¢ijb1dokez«mofs^aijbghLmrLzDÃ5Ru±guzdovzhm@cRmHzhzhuy¢ Lvb"gm3Rd¡xob"d²°d!qezzhuvdokÊt vqez{ghbf n_mof°bNdotDÊtmoketbcrgN°®«eb ruzhtfhbghb¢Û²°doqezhzhud!k¶gfdokezhvd!ghuvmokªijmrrb1[uvz«kem\¤ µ&½ ã £ à / Â Ï Â ¥ Û ½ ã £ à bS
cU
dS
U
e
gf
f
f
e
ghji lk e
f
<e
i
<e
mf
<e
<e
Tn
Ro
o
<e
f
f
f
<e
o
f
! / Â Ï Â ¥ ½ ã ¦ # %(' Ã ½ Ã !
<e
h
i
e
hpi
k?i
o
5qsrt
h
<e
i
e
h
i
k?i
uf
¤Lb1fhb-/uvzuykÊghLbfdokL¥ob3½$- / Õ % 4&4k4 % WÃ5 rb1kLm!gb1z d cedof{guvtqLvdof¤Pmlf"ghml¬ob1k[od!kR ½ à / Õuyn d!cecRbNd!fDz uvk gheb ¢Ñgh d!kLkLmogd!ghuvmok[\moghLb1fh¤uz{bPu±g uz&ÂeW®«LbBuvkerb ©-ºuvz ghebuvker* b©ªn_mlfPgLb ¤BmofD@ghml¬ob1kezd!kedot1t mlfruvkL¥ly| gheb t vqez}gbfDz3ÚÛkÐghLbªbkeTWgheb¶mor¼}bNt5guyxlb@uvz ghm(¥ob1kLbfDd\gb ¤BmofDLzn_fhmli LvmoRz®«Luz/uvz"dZz}gfdouy¥lHg{n_mof¤«d!fDZd!cLceyutd!¢ ghuvmokªm!n[~«d¡|ob1z0fhqLvbo´ µW½ £ ã tà լµ&½ ã £ hà µW½ à ÕrµW½ ã £ úz{uvketb ¤Bb°tqLffhb1klgy|3dozz{qLijb/d qLkLuyn_mofi cLfuymlf«n_mof µ&½ à ®«LuzAijmrrb1Huz&dx\d!fuvd!ghuvmok monrghLbPi uy©^ghqLfbºijmrrb1HmonLb1òHqed!¢ ghuvmokÐÕl w z{uvkL¥jgLb°kLm!gDd\ghuvmok Û ½ Ã
! µ&½$â / ©V£ %~ã % ¤ Ä Ç Ã / Ý ã Û ½ ã £ £ Ý 5Ã % gheb/qLced\ghbNz«n_mof«gLb/cedofdoi bghb1fz«d!fb oJv
dq rt
xo
o
HfPw
uf
Ifpw
v
v
f
f
uf
f
2
e
f
f
<e
RMS error for µ
uf
e
f
<e
<e
1.5 MAP α=50
ML all
1
MAP α=11
kyi
z {y|~}/PII J| V
Þ
z |~}C
,
0.5
R
i i
I
lÖZLu;UñbfbkHg"¤BmofDLz1 )bt mlkez{urb1f n_moqLf0ijmrrb1vz1&®«eb¯efDz}g0uz0d°i@d\©ruvi"qLi¿yuv¬ob¢ vuyLm^mrijm^Lb[ged\ggDd!¬lb1zdoLx¡dokHgd!¥lb°m!nd!vTghLb n_b1d\gqLfb1z1 ®«Lb(zhb1t mlke.uzjz{uvijuyd!fNºb©Lt bcLgged\g@uyg¶uvzghfDd!uvkLbN.mokey| mokmoqef«tDemout bm!nWfbvbx\doklgBn_b1d!ghqLfb1z1rijb1dok3d!kR3z{gdokeLd!fD rb1xHud\guymlkm!n t mlymlqLf1È)bÊrud!¥omlked!vuvÙbghLb´t m\x\d!fuvdoket bNz uvkZRmogh)¹Zö.ijb gLmrLz ghm3ijdouykHgDd!uvkÊz}gDd!Luvvu±g}|m!ngLb¸P¹ d!v¥omlfhuygheido±gLmoqL¥lghLuz3i m\xlbÊt mlijb1zªd!g¶gheb´t mHz}g3m!n vmlzzm!nx\d!vqed!eyb uvkrn_mlfhi@d\guymlk[®«Lb doz{gg}¤Bm@i mrrb1vz d!fb x\d!fuvdokHgz0mon[gheb¹Z» Ø ^¤Lbfb¤BbLuvdo¥omokRd!vuyÙ1bghLb°t m\x\dofhuy¢ d!kRt b1zuykmokeb ijm^LbAdoke¬ob1bcghLb/qecLd!ghbN(t m\x\d!fuvdoket bNz qLkHghmlqetDLbN´uvkÐgheb¶m!gLbfN~Bmogh.~«d¡|obNz{ud!k´i bghLmrLz"qezhb cedofdoi bghb1fºx\d!vqLb1zºm!®n Ô / kÕ 6e â / Ù/Õ d!ke ã / éÕ Ú^ÕNÂoÂlÂoÂo doz«b n_mlfhbl ®WmijbNdozhqLfhbgheb@cRb1f{n_mlfhi@d!kRt b m!nºgLb@ijmrrbzW¤Pbji@d!kL¢ qedoyv|Xd!kLkLmogd!ghb1.ghLbuvijdo¥obNz uvk.ghebªgb1z{gjzhb gNXÚÛkÔzhmoijb tdlz{bNz.ghLb1fhb ijuy¥llg b¿ijmlfhb¿ghedok7mlkLbÁd!kLkLmogd!ghuvmok rb1bijb1XtmoffhbNt5g/RbNtdoqez{bjgLb¶Lvmo.tmokezhuz}gb1)m!nzhbxob1fdo zhqLr¼}b1t gz1´b°qezhb1ªg}¤Bmjzhuvi ceyb°Lqrg&b UbNt5guyxlbb1fhfmofBijb1d!¢ zhqLfhbN&z Y E ¹ Q Y&®«LuzPi bNdozhqLfbfhb1cRmlf{gDz0d!kªbffhmlfm!n0Õuyn[kLmokeb monPgLb@k´ijmHz}g vuy¬lbv|ZcLfb1rut5gb1´¤Pmlfez°fhbNz{qLygz°uvkÐd tmoffhbNt5g«Lyml(d!kLkLmogd!ghuvmok[ E ¹ `NKLX F^tV Y.®«euvzijb1dlz{qLfbÊfbcmofhgzªgheb´cLfmoL¢ doLuyvuyg}|Xm!n dok.uykRt moffb1t5gjd!kLkem!gd!ghuvmok.¥luyxlbkXged\gj¤Bb zd!ijcLvb/n_fmoi gLb"bNz}guyi@d!ghb1¤BmofD3cLfhmled!euyvu±guybNzn_mlf d cedof{guvtqLvdofLvmo[ ~Bm!g(bffhmlfi bNdozhqLfb1zdofhb d¡xlbfDd!¥obN¶m\xlbf«gheb k^qLi"bf m!n Lvmoezºuyk@bNdotDjuvijdo¥oblld!kR"gLbkªm\xobf gLbk^qLiRb1fºm!nTrmrt5¢ qLijbkHgDzuvkghLb"ed\gd@zhb gNº)b"d!zhm¶t moijcedofhbgLb ijmrrbz S cLfb1rut5guymlkezghm¶gLb cLfhbNrut5ghuvmokRzmlrgdouykLbN(qezhuyke¥¶ghebb1i¢ cLuvfhutdoº¤BmofD´n_fhbNòlqebket|Êm!ngLb@gfdouykLuvkL¥Êzhb gNZ¹Zd\gDtDLuvkL¥ ghebcRb1f{n_mlfhi@doket b«m!nghebbijcLuvfhutdoerbkRz{uyg}|"uzfb1òHqLuvfhbN gm rb1i mlkez{ghfDd\ghb/kemokr¢Ñghfuyx^ud![vb1dofhkeuykL¥RamluykL¥3z{qLRz}gDd!kHghud!vy| b g{gbfPghedok@gheuvzPmokjgLb°pPmlfhb1RLd!gd/uzºruy·¶t qLyg10®«eb d!kL¢ kLmogd\gmofDzg}|^cLutdoyv|cefhm\x^urbzhbxob1fdoet mliji mlk¶¤BmofDLz½hø´v jv `OïGé!sºú\ùÛVø a~8L~ø ]pñûyø¡Ã5rd!kR n_b1¤Pb1fybNzhztmoijijmok"¤BmofDLz«½h´ø v jv qù c;jl&ø a!Ã5X®«Luz"ijb1dokez/ged\g@d!kekLm!gDd\ghuvkL¥ÊdoyBuvijdo¥obNz"¤uygh[ zd¡|o `«ïdésºú\ùÛVø a5[doke e~ø ]pñûyøjuz d3ijm^LbfDd\ghb1y|zhqettb1zz}n_qL z{ghfDd\ghb1¥o|lµØ bfhn_mofi@d!ketbªqezhuyke¥ÊgLb(bijcLuvfhutdo«¤Pmlf.n_fhb¢ òHqLbkRt |ª¤Bmoqevb fhbNrqetb1u±n gLb bijcLuvfuvt1d!Arb1kezhu±g}|3¤Bdlz ijmofb Rd!g1µ®«^qez10gLbuyketfhb1ijbkHg mon cbfhn_mofi@d!ketbªm\xob1f gheb/bijcLuvfhutdo[rbkezhuyg}|¶uvzd zhbkRz{uvLvbuvkerutd!ghmlf1 ¾&uy¥lqLfb1zõ¶ghLfmoqe¥o)ó¶z{Lm\¤ÈgLbb1fhfmofi bNdozhqLfb cLvm!gz n_mlf Ø ¢ÕloØ « ¢ 6°d!kejØ «¢zd!ijcLvb1mokjm!gjghLbgfdouykeuykL¥/doke ghbNz}g«z{bgzºn_mof ÕNÀ°uvkerb1cRb1kerbkHgBghfuvdovzºqezhuykL¥ ghLbzhdoi bLd\gDd zhb g1&®«LbBx¡dofhud!kRt b0uvk/ghebPm¡©ceymogzWuvz&rqLbPghm fdokermoiÈuvkLu±¢ ghud!vuvÙ1d\guymlk[®«Lb/¹Z»ØÔgbkeLzBgm@z{Lm\¤ ybNzhz«x\d!fud!ketbrqeb ghm°gLbz{gd!euyvu±g}|"ghLbcefhuvmofDz&cLvdlt bmlk"gLbijm^LbÑ ®«euvzb©^¢ ghfDd@z{gd!euyvu±g}|3d!vym\¤z«qezghm¶doLmocrgn_qLvy¢tm\x¡dofhud!kRt bi mrrb1vz d!kRªLb1ket b/mlrgdouykb g{gbffb1zhqLygz1
0.1
0
Method
¾&uy¥lqLfbó,Y ø~o~]pjd_ cÜùbc$]d_)ø&a(aO]Ga~`R|,`(cJ_jªùhgLø fW\jøDúé`(|5ahø´v wygLWø g?]Ga(c´]G_Rùú!ûû cJ_Xø o~]da(ah(ø `q?]G_y[é`3 ù ]´Jù geø(øV\.cJa(c$oDú!û.[Gc`( qù a(c$nV|rqù c$]G_}ah~ø [Gc$oqù c$]G_8`&v ¸0kRt moqefdo¥ouvkL¥ov|oTgLbª~«d¡|obNz/ijb gLmrLz/gbke)gmZcLdot bªym\¤ uvi cmofhgdoket bmokÊghLbn_b1d!ghqLfb1z ¤Pb z{qRz{cb1t ged¡x^uvkL¥¶kLmfby¢ bx\doket b ghmgLb@t mokRt bcLgzgheb|´Lb1zt fuyboj®«Lbjb1z{ghuvi@d\ghbN rud!¥lmokedob1yb1ijbkHgzmon Ð ¤Pb1fhIb Y Ñ /D 8 4 >¨? 4yÕ8 4  ? 4 ÖÕ 4 A > 4 ÖÈ5À 4 >§8À 4 À 684 À 684 >dF ÚÛk¿ghLuz.zhu±gqed\guymlk[ ghLb¯efDz{g)n_mlqLfXt mli cmokebkHgzÐmonªgheb ijb1dokezfb n_b1fgmªgLbjd!fb1dLR©Tñ|Zd!keÊRmlqLkeLdofh|e£\dofhbNd n_b1d!¢ ghqefhbNzAd!kR°ghLbPvdlz}g z{uy©/t moffb1zhcRmlkeghmgLbºijbNd!k"doke z{gd!kL¢ Ldofrbx^ud\guymlk)½vdoRët mlymlqLf1 s^mli bjzd!ijcLvbfb1tmo¥okeu±guymlkZfhbNz{qe±gDzmlk´d!fLuyghfDd!f|ghb1z{g/z{bg uvijdo¥obNzd!fbzhLm\¤ uvk(¾&uy¥lqLfhbN)z A@d!keÖL
N«
m¶·«
ML
Original cat
flowers
cat
mane
cat
~¿
lion
cat
mane
cat cat
®«Lb pPmlfhb1^ed\gd°doke u±gDz0z{b1¥oijbkHgDd\ghuvmokRzW¤BbfbB¬Huvkerv|"cefhmo¢ x^uvLb1§^| ô°moLqezÊ~BdofhkRd!fDÈdoke Ø vkedofÊaqe|H¥lqLvq[)b ¤BmoqLyuv¬obZghm.ged!ke¬¦¸ºfhutZ~BfhmrtD^q³d!ke ô°b}¼}uvbÊ~«d!mXn_mlf cLfm^m!nÜ¢fhbNdoruvkL¥ gLb/cedocRb1f1 É ê ä}é^á}êæèä{îDï åã °ðH ê1ã1éHä{ï ïoåHã1êä}é^å ï!á}çlâ æ±îhá}àlð ä}íDå ð RíDêä}éHæèé °á}âHíåÛí êé Wã1ë_ð HçHçeð ð ê ä}é^á}êíä{ä}ï æèé °ê ð äÛá Bà Nàlë±à ñð[êé^ï Hãä}å !á}â ð ð &ëèàHå AãNëÜð HçlçRð !ð ëèíDæ ïlæ ä}ð æèî{3âHëèð íá&ê1ëèëèTã\î5ßêðá}æèãNé ðRê1éHï BNð ã ä{ïHð ê1«é æèíáÛ3á}íð ä}æèhî{ð â Lð íDð î ¡RíäWêá}ê1íDéHé\ï á ð Bâ^êâlä{ê ê éHæ í5ïlå Tä}íDåÛå ê ìoä}æ±ï Ní jßð ä}ã 0 é íä}ñîDðíhä « íDëèð ë±ê Að AæèíáÛä{ê ð r ð0âHßí ð «êá}íDâHëèë±í ê [êá}æèíæèîDáÛä{å0ê ã A åá{ð êá}oæèð0åá}ê1æèî5éHêï ë
ê1î{âHæèél í áÛä{ê1élåÛëyê á}æèãNé Têä{ê /íá}íäíDåð á}æ êá}æèãNé «à 1àHëèð à ñð ð êä}BéHêì ä{ïíîá@°ä}íDð îDã ïlNí éHæ lá} æèä}ãNíé¦æèá{êê1å å êð«îhêâlé^æ±élï íªláÛã1ä{êä}å éH!åÛá}ë±êâ á}! æèãNé RRð í5ê ä}éHæèé êë±í læèîDã1é vã1ä0ê oí5ï°æ ê Ní Nã\î5ê1ìlàHë±êä BíDãä NçHí æ ä}æè"î5êð ë hð1ê1ê éH\ïíD%å H Nã1ê åä}á}æyíêä ìHëèí0åÛð íDñëèíDð îá}æèãN$é # &Bð éHçlê1àHëèæèìlìlë±ä{æèêåÛá}âlæèí5ã1ïeé ð ê1«é^íDïçHíêäÛá á}/í /íDé\å á"&Bã élj'æ ¡íêä}é^åÛêæ á 1"í /ã íDRé\á í loê1îDåDæèð íDélîDíªê1é^ï Ñé vã1ä ê á}æ±ã1é oå BãNëèàlì ãNëèBíDî(ð àH ë±êðäAîDoë±ê1ëèåÛãNåÛél)æ Hæ î5êá}æè ãNé/ð ã °^ð î5êêéHé^îDï íh*ä &ê ë±ê1åÛê åA\ãïoæ±åÛîñã ð Níä ê1éHï ð îDë±ê1åÛå/,.ço-.ä}/í5ïl æèîá}æèã1éÊ0ì #\ð NíDélí í oçlä}íåÛåÛæ±ã1é /ãNéHæ á}ãä}æ±é + ð Tä}ãN3 ì^êìHæèëèæèåá}æ±î&ëyê á}íDé\áTåÛhíð êé!á}æèîAê1éHê1ë oåÛæèå 1 ã êéHé Bð + 2 1 ã êéHé BðAêé^ï [à 4Dæèî{â^ê lð íDëèå vã1äîDã1ëèëyêìrã1ä{ê á}5æ Ní 3 ^ë á}íä}æèé 607 98 ð Hê á}çlíDçRé\ð á°îDë±ê1åÛå /:!ð ã!ï Ræèà Plð ð;r"ð ð â^ê1é ð lð ê A\íDð åÛæ±Tê1éZêëèà îDëèàlìråá}ã íä}æè3é ð 0[ðAæ á}ê1â ã ? l=ð ð Wã1ëÜð@# @A ãä{ïB&Bélæ' ¡íä}åÛæ á Tä}íDåÛåDð íDë±ê /íDï hð GF ð D ð ! [ä}íDåÛåDð C 98 !ED ßã "ð á}âHðAí ê1éHAï ã1á}æèNé ãä{ïHBêé æèìHìl3åð îD{ë±êð åÛåÛæ' Híä ð 0æ&á}âÈãNé ¡êíçHä çl1ë±íDæèî5éHê îDá}íæèãNä{éÎêá}á}íDã å ê \íDåÛæ±êé íDêá}àlä}í@åÛíë±1íîð á}æèãNé HC I8 A oâlæ låÛí ðê1/éHïíDé\já{êá}êæèë±ãNæ é o!Eð !%! 0# ð Bãä ê1ëè'æ 4Dí5ï3îàlá}åê1éHï3æ ê 1í ^çHçeð# # 0#!ð /æ á}â àHåÛæè3é ð!êé^ê ï \íDåÛãNæ±ê1âlé
