Dynamic Bayesian Networks for Language Modeling - KTH

Report 4 Downloads 110 Views
Dynamic Bayesian Networks for Language Modeling

ROBERT ZETTINGER

Master’s Degree Project Stockholm, Sweden 2004

TRITA-NA-E04082

Numerisk analys och datalogi KTH 100 44 Stockholm

Department of Numerical Analysis and Computer Science Royal Institute of Technology SE-100 44 Stockholm, Sweden

Dynamic Bayesian Networks for Language Modeling

ROBERT ZETTINGER

TRITA-NA-E04082

Master’s Thesis in Computer Science (20 credits) at the School of Engineering Physics, Royal Institute of Technology year 2004 Supervisor at Nada was Viggo Kann Examiner was Stefan Arnborg

rtsqu;v2w5x*yv 4+*B1D'()+)/mh"# 2"4 3*) C '(m%E?0*21t> 34Yz)44 *){ ; @*+#";B+*0*;BB0}4+*B1W1 *)+) C `g*)1 4YZn [ 20* 4YZn~c@*24€;2En ,0‚ 8+420{ 3ƒ|1 )„4;" 38$W@*@13  ;4 2nh+, BY…64@,22 BY{"2 ;)7* i" 37Znh4@,2131 BY* B!c *),nc)7"  > BY*2 B! *)60o+#"$&"™8"Y*;74;4  ;1Z"+0#?$•D 2n @P2 ; iš, D $&>1*)7+)7W #0 J ;1 *)? .0#24 3)7*20ZnP  @*1 ; ;c40„0"2420ZX d Y*l1)+)“ #0#;1q . ," i"+#40 O%o@B;]W*6@4 J $ J 4@,22 BY/"4 )B›@,0|64;: ":A 0#21 2nc0*90#;t2“0#2132tO))2h@A8B0#!1 744" 3)7"¼# BY?0#;0#B.@Al2 c4 ! !7c4aX%W;‡$&=7""‚0*;1 ;z4!+*131 |1954)7A{5o 0*;1 132" 20; ‘ -|-€X_7 J O* *;B0*
¿

ÀÂÁÄÃÅÆÁÄÖÇ

È É £‰v;w5¯Z°•²•yv2¥Œ¯,£ Ê ËÍ̓Π« ¯,w ¨ G X M Wc,  724 t*"!#|XXX.XX.XX.XXDXXX.XX.XX.XXX.XX G X M X M \W>a424 37$•  *"!#ÑXX.XX.XX.XXX.XX G X M X G \W> );;B1 3U54 ?$qY* 00#;/-|4!75:6 #0#21 ºXX.XXX.XX G X M X Ð d Y*." i44;"aBEn”@P;1 1Š BY* B! 3*),n)7"64o" 31 1>:24 +*"5" $S 4747n(t$4Y*44.$>>Y* BY€ "Y584Y*2„7*13„ 0*;1:;"j4 3 J @*1 13 *)7+* 4  0#2@,20#;,  22XW   724 ?*;%74!# C W BEY:7.4 ;c"13 OP;;?@*47@,c1 0 0 L 2 %@*"  *))2*;B1 U25" 37 $ ‘ -|-j;nc4Y,5% 2 34Y ‘ -|-|,0

 .;%74!# C W"En00# 4 ;+"ZY*5W W( ;O,g+0D$&•'Zm/ “)7;*2"1 ,0€$& 1*)7+)7? #0#;1 *)ng4@P2  3š, 21 137X{\1,nh 3 > 1 1 cB €4Y*/0# )…$W 1*)7+)7D #0#21("Y5. ;/@40# 4Y8@*"OO* 13 3$ht 2B /%7"05.t 2B  @P74 i" 37Znc0tl0#2" " 3@*4 t$”4Y*D 3 @*1 ; 27B5" 37t$Z"Y5 0*;1 Xqe• 1 1 n i> 131 7c" 13#4 $•4YD@P;4$&"> 31 1(OP“0# 4 ;+"0t"Y*;74;4  ;1 1 n7> 31 1 ‘ -j-|,0o W;n ,0“ ; @" 7O,;%2;“"Y*24%4Y*";0# i’‰;";cb@*@4c BY*‰4D@*"OO* 31 " b #0 J ;1> 131ZOP$•61 *)+,)D #0#;1 M

> 131ZOP0# 4 ;+4420ZXheŠ 131 n"Y*.4Y*2"t$b 1 +424 *)6> 31 1ZOP@*42c420O*" 33X Ž%Y@*4;lÐ/ cB .4Y?0#24 )$>/W œ+,0ˆ$&“1*)7+)7l #0#213 *)nq,0 0# 4 ;+"%Y54Y,5 #0#;1Z ";@*"24;c40?1 24* *)l  6@13262c420Zn#  0#4 ;4 O,0? / BY@*4; I X ‘ 5}4Y@,2$&74$P"Y*1*)7+)76#0#21 b"2420 g0*2" " 3OP20 t BY@*4; LX Ž%Y@*4;Ò6@*"24;cB4Y*"24+*13"$•4Y.424 *) $•4Y1 *)+)W6#0#21ŒX Ž%Y@*4; Ý ;c" 3,D€13#4 D$4Y5_ d ‘ X ž“+*10€24@P2  1 1 €13 !?4„4Y*!^ ))ˆ_*‚$&74;1 1 n d Y*7Y54Y*2Y5  BY@*4;X d Y*% BY,@#";Š1 4>  1 +0#Z"Y*h"Y*;74."+*,0WY5„" 27+4q"Y*g@P;4$&" #0#;1 n7>Y BY 131POP$Z c4;"2h1542g 4Y* 2n7>Y*21*)7+)7W #0#213 *)< > "+1 1 Y* BYj˜jD 4Y131h4;61 42 3„4Y* D4Y24 W˜| .+0j ˆ*%…˜™›$h… –@…†€1@*13¡D  ;(5 4 ™Z/ $4OY+#t1 4Y*;)+,1 )1(7YX :7d Y**Y*  BY8 (4Y*13 !213 2q$D0#š20“+*lO,2Š$, 7c4aB"ç †‡Y "Y*“@*"O,O* 13 3 44@P;1 130o7[  Їy  ‡s(5(5n ) :2t"Y5>"Y*%7"0' ¥"Š €¦§€( Y,:D 2 +*""20 34Y*“" D4;aBç \ „ ¡ …†€z‚n„…† ¨ ˆ‡s(Љ C D DEb g“ z42@,540 C +**"1 1 20Eb$&g+* J N OP;.$h" 3  34YB ;D 7**2 4 *)o:4 O13W.0# 3’‰;";c.4 6Y* 13t),X d Y* $&54+4“"< ;@*4+*"20ˆ 4Y*?D œ ‚eŠ )+4 G X G n(>Y*  BY  +**"1 1 20?$&4Y42W" 3 “42@;X 4"Y5%4Y*D"4+, 4+4$”4Y*W 0*;1 g4Y*D46 3t BY " 3 W42@Zn0 "Y5 4Y“Ž%m d >0# * BY*)7W5:7;%4  XbžK4Y"24@P2 D >"D41 13t"4  n*,0 I

0.1

W

VERB 0.4

0.4 0.5

W

0.1 0.7

NOUN 0.5

0.1

ADJ

W 0.2

e• 3)7+*4 G X Ð]q\—4 3 @*1 Y* 0*0#2-j"!5:  0*;1 CŒ‘ -|-jE 4Y86© „ ¡ …†€D*1  30* 254>"Y5D4Y*2/ ;j6#0#21("; @PB1q0#;@P;0*; ; 3;X d Y*"; @PB1Š0*;@P;0#2  22nP$h 7+*"4n,"“ ;@*4+*"20 /4Y8B ; ;*2 " 3)$b4Y;X \pD ™ ;ˆOP?/4+* 3"O13? BY   $&86#0#213 *)/"Y*?"4 " 21g0#2@,20#2  2 … 4Y 34YjW  C @*@P7420"?? DEnP>Y* BY|4Y*24;$&" +*> #0#;1($• BY  X

^_a`b_–^ c;dfeY«bimgzi"|~ey¬aoa­xe]l oaqsg®qbt-¯zoаz°zimgB±²eh|~}bqS³µ´¶q'°Oim¬Šd

\› 7 67ƒ‚$D #0#213 *)€B0#7 :5" O*1 2 …" 3 j4;" 2 (5 ™¹ CS‘ -j-jEn*>Y;".4 D$Š4Y*.B0#7œ:5" O*13"W7O24:720”n,0 4 Y*  BY 0*;1.4Y* @*"OO* 13 3.$,0# 3’‰;";c•@,4" J $ J 4@,22 BY$&7131 5> *)4Y*2Š@B J $ J 4@,22 BY l4+*B1 1*)7+)7.4aB;n‰>Y*24l2 BY/@,4 J $ J @P; BY|B546 ;|; 3.j 4+1(B0”X d Y* @*"OO* 13 3t$q *+$&7131 5> *)6/0¶ 4 :  H X Ý n,l+*o$&1 1 5> 3*)Y*;"j 3o +**"1 130ƒ$&Ð‚" 3 ";@2X "j"Y5 4Y ‘ -|-€n>‚*#0# ";@*"24;c"q."5"n7>Y*;"27Š >Y*  BY ;ƒO,| 1 1"Y*j0# 3’‰;";c?B5"22X d Y*24;$&"n 3e• )+*" G X I n"Y*jB ;?0#€* ";@*"24;co… *)713ˆ@*"OO* 31 3nO*+*/…@*"OO* 13 3‡0# 4" O*+#4  C "Y*€ ;4j$ 0# 4 ;4;4.:51 +*27*1 n*660#  . 724 ?*;%74! C D WE SEM

SEM

SEM

W

W

W

POS

POS

POS

t=1

t=2

t=3

e• )+*" G X L ]b\— ". ; @*1 a0*c, .  *"! :5" O*1 l;’P 4 *)"Y*t; 44 ˆ$g"Y*t7O24:720j:4 O137X6žKˆ$S7 2nŠ i61 135. C Y 0*0*;ˆ.O4;":0E>:54 O*1 6Y: 3*)’‰2 .7ˆo4Y*2 C Y* 0*0#2ˆ7W7O4;":20,E :5" O*1 D o4Y*“" 7l15";>" 3  J 413  7X d Y+;n*4Y*“ #0#21Z 3/e• )+*" G X I ;+*10”n $& ", ngO,)2*;B1 U;20‚ 3c4„4Y,5< 3}e• 3)7+*4 G X L ng>Y*;"?"Y*@*"OO* 31 3ˆ$ ; 3" 3*)| ;;4" 3ˆ%7"0D0*;@P;0*“*“7*13j>Y*  BY„@ J $ J 4@P;2 BY„ “a#@, "20”n O*+#1 46/7 .4;YW ¼ ;/0# " $S "" 3U2D ‘ -|-€X d Y* ”$S 474 U24 D (+;$&+*1 n0D5"+*B1 n2 4Y*„W ·$& ã " 3 |413  t,0 +4|{$W"Y*| #$&;";, 471  "Y*;"|"$&B54  / 2n>+ BY‡7 4Y* $ …†%™ž ™›…˜¡H…˜ ˆ…†( ·™ Ã!(…˜˜¦ ¡œW4Y*Ö Õ €ˆ…†( v–D™ Ã#(…˜Ȧp¡B0 5L 2 X d Y*l:5" O*138;1 3  J 4 /13)7" i"Y*» 74 " / ;""c *) +**2 ;2"44 2OP“ ;1 +1 420, n*0oO,+,0 8+1i" 3@*1 .4  22X [ 2D  0 I 2 $&0#;" 31;X d Y¶+* " 374";1 )74 34Y» 7 "  ; J :2" 3)4Y*t"!| 3c"jo4";t>Y;"Y*  BYj|71 0|:4 O13“# 2 +*Bl+WOP6 ;c4 )+*7+Q  0 T 2 XDžK 4Y "42n4Y*+  ™Ø(/€™S¡>Ã# Ÿ ‘…˜ #é™ Ã!(…˜˜¦ ¡º 2OP“+420”X d Y* 0#2 4B4 > 34Y76. * 34 1 Ÿ ( –…†™ C 6@*47OO 31 i0# 4" O*+#4 PEh$&7>27 BY 1 ‹7+Xh\— 1 ‹c+* 4Y;…4;,0*“"ˆj*; )YOP+*l4Y 6@P42c4 1 nh *) 4+*1 22] C M E>t*#0#“ ; OPl00#20"t"Y*“$&"c4 ;W i$1 1Š 3"W@";cB"813"270#? /4Y8$&"c4 ;n,0 C G E *#0#. ;tO,D"; 5:06$&47 4Y*W$&47c4 ;>Y*; iB BY 310#";tY:7OP;200#20”X d Y* 7";4$S ;D13)7" i"Y*p+427*13t4Y* $&"c4 ;4+@P0*40”X

"Ë ÄSÈÄ Ï ÄË r?³Š³•w5¯ ì ¥S¢‚x#v¥&­ « ¥S£•¤ « w « £Šy « `ba*  3#$&242   "Y*#0* ;jB!7ll+ BYj" 3 4Y;t C 0 M2 E%"Y5>"Y*4 +*B4 37

Ûåæ äOç #Ž5è#é©#êëSâã½ÙDÝ Æ†ÇÊÉ ÜÞäaÛåÌpߨàá%ÙDÆÈǧäÜFÉ Û!Ì > 131( ;:24)7"l"Y*[6 Û 4Y*7+* C PEnc:;"O C :*Eb0O,“ *7+*o :24O(mn € ; 34Y*26*+*7>:;"OZn*ª0 ( g2 i"Y*; /70¶2 4 :“7 :24OZX d Y+2n27 BY$q4Y*8%7"0* 4Yl42‹c+*;, “ 7+*10@,c44 3O13 OP>; i440lO“ 744Y, *Y* 0*0#2@47OO* 1 i $‰"Y*@ J $ J 4@,22 BY Ÿ ~ï"$&1 1 5> 3*)D"Y*@ J $ J 4@,22 BY Ÿ X d Y*>@*"O,O* 13 34 2g" 4"20ˆ €4YŽ%m d 74"24@P0# *)"/4Y*o"45.OP;24Y*Y* 0*0#;€:54 O*1 2 m × [ |eŠ )+4 G X I X%e*+*44Y*24 747n*+*@@,c“D Ù Æíì•!äaðzñ‘ŽòpÌ> 4Y“@*"OO* 31 3t$•4Y* B0·‡s(Š 0 Ð 2 C @,) L#ML ˜ L*M TcEX

MM

÷

ø½ù—ú›ûoü{ý

7 8 Å

g

hWiîÁkj

limjÑÅ

ÀÛÅoh n

žK4Y l BY@#";nŠž.> 1310#2" " O,?jW  "Y58žY,:< "2420Zn•0>Y*  BY€žD> 4Y 4 3 @*1 ; 27.0j"+0# 3j674l0#B 1ŒXWžK/4Y* D BY@#";n"Y5.W ¸> 31 1•O,60# J " " 3OP208)B@*YZn•0ˆ 38> 131g1 4/OP?0# 4 ;+4420„Y*5¸4Y*W œ ";@*"24;c40  31 1‰1OPW0# " +"0 >Y5 g*;0#20 34Yj4Y*4?a#@*1  34Y*“$S 4YW1 1(4+*B1 1*)7+)72“ *Y*24 3< ;4" 3{@*47OO 31 4  Ù I[Ñ &9w ä Xb5n 3$ 2B t$&54+4% 4Y*.1*)7+)7W"@47@,241 @,c 34 4Y,"Y*;B;X [ + BY6#0#21 %Y:71 40#6OP;;o "2420Zn7O*+*>Y%žh> 4Y i"Yj0# 3’P2427 $&"2‹c+*;, € }0# 3’‰;";ct c"at0#>Y584Y* i"Y* 3{4Y*" ?@ J $ J 4@,22 BY˜€ ;‚O,o 70# 34 *0€€"Y*o@2XˆžŸ$ 4Y4;acW O,7+# #$&"7"4+, 4+47n#4Y*8@*47OO 31 i€$ #Žl+1 0oOP“Y* )Y*2>4Y/ i +*10“;"g"Y*4;achO,7+#h ! *)X•\0l: ; J :;B"*]” 3$4Y4ab •O,7+#h ! *)n 4Y@*47OO 31 i ; J 4;aq b ñ‘O(1>Xq`g7 BY6 ;c4;aq> 1 1#Y:>Wc+8OP;b$‰B0*Š4Yh ŒŽ‘óˆè#èp’5Ž 3/ 4Y* +*10oO,l%7"0*"Y5D 3|4 84;,“4:7;"?";@*"24;c"4 :D$&4YW 7c4aX\ 4" ))0 ;c4;a> 31 1”4Y;/OP¿  ñ‘j$&7< 2B o4 6 x㠂 )3"ƒ&131ZB0*2‹c+1  M X d Y* > 5"+*"1Œn*4  . 3 "4+> i"Yo@47OO* 1 i M 4Y7 DB0t# 2 +*B;Xb-|4Y*2)7 3:7;oO

ϧñ‘Ž‘éE â

â â õ

(“$”  ‚  “$•–) ‚ ‘7’

Ú

ÆÈðQä9äÌsÍ[!

C Ð*X G E

>Y*;" —Dó D "Y*“0#  4 ,";1 1($&74Y*"24 *)n,< "@*+Y,4 4Y*“ ;"@*+2X OP; *)8 c424"20< t"Y*W c   ?%7"0* C 47@t%7"0"Enc4 3, "Y*;êê–O d Y*7 721 :51 10#7n4Yžg #0# iš,20$&>l?@*+*"@P7422X d } 1 +4;4Yˆ ;c4;aco: 47"tžt4Y*8 2 +*""; ;2$q27 BY @ J $ J 4@,22 BY„4" 3)7"›$&" 1 4)7 C @4 J å $ J 4@,22 BYˆ"))0E. 74@+;X ‘ 5;:7;n 4 3 ;D4Y*.+*8OP;>$(B)7  3o"Y*.B0#;! ¢ n#"Y*.c+8OP;>$•@,c44 O*13D"4 )B i"Y€@*@*"a# 3Y BY? ;lO* 32b"4 )BºB5" 4  ; > 34Y€O* )B "4 " 2 C 4Y*t+*lO,2“$0# 3’‰;";c“O* )B  4Y*?B0#;V! ¢» nq4 4Y“0*5B8$&"™6 ;"@*+> 34v Y ! ¢Ž¹ ! ¢Žº 4 + Ùt  ;cBEX d .7O#" 3l4Y*> ;0# 34 ,1@*"OO* 31 34 2Š$&b@ J $ J 4@P;2 BY“4" 3)7"¼ž(a""7 40 4Y8B)7D7*13o$&"Æ"Y*< "@*+D,0|+420|4Y* D")o ;"@*+DW 3*@+#.4 [ N>ž [ '(-€n 4+*B11)+)@*" ;2" *) C W'Zm%E 41 ! i?O}\0#"27 [ "1 B!X [ N>ž [ 'Š@*"5: 0#0 h> 34YlO B!7’81*)7+)7q6#0#21 “\N>m”\‚$&" 2n01 4>"+#" 3*”  Ž>êê}"Y5h)7 3:7%48 2 4•"W"Y*>@*"OO* 13 34 2q$P c4;"22Xqe*7b " #$&74$&7W BYj ;c4;ac4Y* DO,  W|27 "7! #)7l"Y*"+*)7Y"Y*“ 74@+$&47pOP;) ** *) "13* ;c4;ac 7 4 :7Xb†„24.*t ;c4;a2:2 " 3:7n*131 B0  2 +*""; ;2b+*10 4Yt4lO,213 ;:7"Y5 3  ¥Œ¢€³g¯Pu2u¥&s ±S«D$&7>8 2B  B08"“# ; ;+*g ?“ ;c4;acn¶+%OP2 2+4 3%g*%4;2t0#+*" 3)4B * *)X d Y*;" J $&"n74Y “ 󎕌q" 3 D“ 2B t%7"0Pð").@ g g2 7+*c4240 i"Y 26 3,"20{$DU;;"22X ‘ 5%2:;nb 76B0* C "at"4 *)c"El ;…** ;,0#134 C |>Y*  BY| ;7"Y*8@47O*132™+1 0*WY:7# ; +4"20o /4Y*8šB@1 7 E MÒ

> ;1 1 20©•é©ññ‘Œ@Âóˆè‰X †‡ i"YY*;"g BY“ 0# : 0*+1 4;a.4" 3) . , 0#;"20|4oO, 34Y|êêlnZ4" *)o131b*U2;" ;1 ; 27B 3/lš1 .4Y27 13t 2OP40tO?4Y*0# #0# *)< 3 @*1 ; 27B5" 37ZX

=¬ ¬

@ P'KVXVUFIC`S

žq> 4Y*08"“ 6@13262c%0#2 ;#0# 3)“@*")B—"Y5%) :2b4Y*@47OO* 1 i8$&g.B0 42‹c+*;, nc>Y*24DQ  ðzñ‘Žò< % ;4 0#;"20 "8OPD“4;ac>4" 3*),n7  X Xq4YW:7;"O-•/ñ‘Ž“,0 4Y“0¶ 4 :Q  •5ñ‘Žl".42)7"0#0”n  @*137n#4 OP.4Y*B0©•/ñ‘ŽX ‘ : *)64Y*"+#" 32$&>7O#" 3 3*)6"Y*“ 70# 34 1”@*47OO 31 i" 3$&"Y*@4 J $ J 4@,22 BYl4" 3)7" q Ž>êê}$&"¸4Y [ N>ž [ '(-·"1 !c 3g,08"Y*WÚµŽ%m d ""206  š,137ncžg+0t0#6  W@*47)B  3).48  @*1 ; ;c>80# #0# *)l@47)B Ž>êêlX d Y*.1 )74 34Y*º"24;8O13h"Y5>0#2" " O,0t ?2‹c+4  G X G ˜ G X I X ‘ 5;:7;nžh> 4Y 4?+84" 3)7"™"4 " 2> 34Y* /"Y*lÙ»Ž%m d n‰,0/  84Y*61 )74 34Y*·0#2" " O,0  G X G ˜ G X I y$&");"1 {.2:;"c4Y* *) C 3j@44  +*14Y*l:13+“$b"Y*8Y* 0*0#2|:5" O*1  $&D"Y*l@,4 J $ J @P; BY,E"Y5 D$S44Y*2"Y M 42@jO7 B!/ 3„4  n”"Y* 1 )" 34Y* 8+,>OP6#0# 3š0”X 'Z;

ÆÈŒaÌÞ͇ÙDÆÈð ä aä ð å ;ä  3Øäaðq&9w ä ¨  î äaðq& ¨ pÌ

CI XM E  X 7XŠ"Y*@47OO* 1 il$(1 1,4Y*W%7"0* C 4;a4" 3*)c"Eb 3 i"Y 4Y. ;"4@P,0# 3)4B4 34 ?@47OO* 1 i " *"Y*;@ J $ J 4@,22 BYZn,0”nš131 n 8+1i" 3@*1  3){> 34Y"Y*ˆ@*47OO 31 iƒ$4Yo@ J $ J 4@P;2 BY‡2 i44 *){"Y* +*"42c B0”X•-j54Y; 34Y* |644O*13W"*)7X

MT

÷

7

ø½ù—ú›ûoü{ý ÅÆÇ{Ã>Ákj

Ô

Ã

8 Å

Jli«jîÅ

hWiÑÁkj

n

ÀÛÅÕh

d 42Z"Y*h@P;4$&"  q$7"Y*h1*)7+)7• #0#21Œn4Yh0#2 ;0* 3*)13)7" i"Y*z Z@*@*1 30 4t4Y*842D ;"@*+2X d Y* )7 3:72>"Y*8@47OO* 1 i$&4Y*842D ;"@*+2n>Y*  BYZnP+4 3*) 2‹c+4  G X Ý ,0 G X Òn) :2"Y*@P;"@*13;a# i7X d Y*;"""Y*";.0# i’‰;";c>@"6;42"%$• 3c424"Y5> 3)7Yc;’P 4YD"24+*132n ,0‚ž“> Y…4ˆ"+*‚"Y*/0#2 ;0* 3*)ˆ1 )74 34Y*¾> 34Y}0# 3’P2427Y54Y* )7 3:72> /";" W$b@P;"@*1 a# i7X d Y*84Y*";“@,B ";B " M X d Y*+*8OP; $D0# i’‰;";c< 77"a"2XžŸ6 644O*1  4ˆO,213 ;:7?"Y564Y* +*8OP;$0* i’‰;";c8 7c4aB.’‰2 B.4YB0o 4;2,焆‡ i"Yj< 7c4a"+1Z 2674$bU;24,n#*? ;c4;ac"+1 #$&"žŸD 4Y*24;$&"80# "O*1  4lš081 ;)4Y$Š4Y*. 77"a4+,1‰ ; "64Y%"4+*1  3)8B0*g> 34Y 3?4Y*D1 *)+,)W 3?4Y* 74@+;X Ð*X+*lO,2 $"4 ))7;“B0*2X d Y*?4"1+*8OP; $>4" 3)7);l%7"0$&627 BY 7c4aXjžŸ$>4Y24o4 131O,o 4 :4;10#7onb04Yo ;c4;ac"+1 #$&"$&71 4)7;:513+*;X d Y,5 ;nP> 34Y|* *8 ;13+,";B;nP iW7277nOo13! *)t5 4YB0*h ? BY? ;13+422n7462"Y*D ;Y*242 > i"Y* 3?4Y*. 1 +42"2X d YD ;13+42" ;"t "?61 2"8";15"20ˆ4j4@P2  3š, t4@ ng+, BY{6@P4"l6"# B!ˆ 34Y/6 3c424@4;420?47@*  WY20*13 *X [ @P4" ÙڎۋÜ:Ý|ÞT߄Ú:ٝà€ÞTáâã܃ÛäŽåsæçÞéèâ ê|ÞìëãàsڎߎíÇà€Þ…î$àsڄî$ä$ê|Þ ï‹ëãÚ$æ„àãðŒÞÀßÚ:ÙàÇîÞ…Ü ísï|ÞVÙâ êsísۄàÇîÞìîäÇÜsÜ$àŽå

[ 4# B! 4!7

Ùڎåãñ„àŽÛçÞë„â:ñ„àë$æŒÞTå„à:Ùڋâ'êÇàãðŒÞTòŽåâƒðڎæŒÞìÜ$ä$ê۝â êsíÇàãð€Þ àŽóãï„àÇ܃ۄàãð€ÞÀðà:ٝÚ$ê„ðŒÞÀïÇä„îâ:Ûâ:áà€ÞìîƒÛ„Ú$åsۄàãð

N>;@P4"2n#*2

îƒÛ„Ú$ۄà:Ùà$êsÛçÞHî:ï„äŽñ„àÇî ÙÚ$ê|ÞTÚêÇÚë$æî:ÛçÞTå„àãòà$åsåâ êßŒÞ äãòsò‹âãÜâÚëîÞHî$äíåÜ$àÇî–Þéèxâ:Ûãê„àÇîsî$àÇî–Þ…â êۄàê„ðàãð

Ž% @c7n#O*+4 32"

Ü$ä:لïÇÚ$êæçÞVïå„äãòâ ۝îÞéïsísåÜ:ÝÇÚÇîà€ÞÀå„àãð$íÜ$àãðŒÞéæ„àsڎåçÞ î$äë$ðŒÞTå„Ú‹âãîàãðŒÞÀïÇڋâ:ðŒÞÀísêxâ:ۋîޅÜ$ÚÇî:ÝçÞvâ'êá„àÇîƒÛ

Ž% i" 3

îƒÛ„ä„܃ñãÝÇäë'ÙWÞHîƒæsðŽêÇàŽæçÞÀô„ä:ÙÇôÇڎæŒÞ`õsä$ÝÇÚêsêÇàÇî:ôãíåsßçÞ ëãä$êðä$ê|ÞìîäãòâڀÞõãڎñ„ÚŽåsÛڀÞ`ðŽísô‹ë„â ê|ÞéïÇÚ$åâãî

[ #  

߄äŽáàŽåãê$ÙàêÛçÞHÜä$ísêÛsåãæçÞéïÇàsäï‹ëãà€Þéè„äŽåsñçÞVÙÚëŽà€Þ Ûâ_ٝà€ÞÀï‹ëãÚ$êãêÇàãðŒÞ`Ú$ßså„àsàãð€Þ`ðàÇÜâƒðsàãðŒÞéï‹ëŽÚ$êî

[ 4# B! 4!7 G

ïÇàŽå‹Ü$à$êÛçÞéåâãî$à€Þ`òsÚësë Þaâ êÜ:å„àsÚÇî$à ÞTðãå„ä$ïãïÇàãðŒÞ å„äÇîà€Þ`òâ:ßãíså„à€Þ›â ê„òëãڎÛâäê|ÞTàsڄî$àãðŒÞ´ÙäêÛãÝ

GH

*! *) Ü$à$êsÛså„Úë ÞVôÇÚ$êñçޅÜä:ÙsÙàŽå‹ÜâÚë ÞDÙàŽåÜ ÝÇÚ$êÛçÞ ôÇÚ$êsñ„àŽåîÞÀö„ëãäŽÛsæŒÞ…î:èxâ:ÛösàŽåÇëãÚ$êðŒÞÜ:å„àãðâ:Û

mq1 i" 21

ëãàsڎðàŽåçÞTðsà$ïsíÛsæŒÞTå„àÇîâ:ߎêÇڎÛâäê|ÞÜä$êßså„à„îsîÞ ïÇڎåãÛsæçޅÜ$Ú$ôâ êÇàŽÛçÞTàëãàÇ܃۝âä$êîÞ´ïÇڎåÇë„âÚ:Ùà$êsÛ

e*"›"Y*24< 1 +4;B2n”%4".$g"4 ))7;.%7"0;n ã ä 0 ã å n(;" BY*74;" ã ä Y: *)jÒR Ý "4 ))7;8B0*“4Y6")74Y;8# 2 +*"40‚@@*4a#  i"Yz€:24}1 5™$&"2‹c+*2 }$“# 2 +*"42 /;"|76 3"20”nW   4Y;%7+*10/*0#8+ BY|$%?0* i’‰;"; ;lcXD\1,nPB0*> i"Y„t:7;"Y 3)7Y $&"2‹c+*;, 8;"> 3"20”X d Y*"2776$&b"Y5gb4Yh4Y*%7"0*g2; 206"“O, :24)7;*2"1 C ŒX X 0# 0j*DOP2| 77"a4+,1q 3*$&" 4 ,EW,0j )Yc.7D%2131 Y:7WOP;2o  ;13+0*20o 3o"Y*“"@o13 >$&47œ4Y*“"X žŸ4Y*+*10ƒOP|*"20}"Y5€0* i’‰;";c?+*lO,2t$.4" ))2%7"0* $&t0* i’‰;";ct 77"a" ;c4;ac>;"D BY74;Zn"Yo$&"Y*“4# B!t* * 7c4aB;n ã(ä 0 ã”å X

_–^'_a` ÷

øCù

ã ä gl;%$”"4 ))7;hB0*h4Y% @*@P2B2X d Y*"24+*1iB >7>Y5> 4Y*.BO*1 OP;1 5X ú ä$êsۄàŽós۽ٝà:ÙäŽåsæ|û ÿ àŽåŽï‹ëãàŽóâ Ûsæû

.p,ü

p. *pý:ü,

p. þs*pü,

G#M

. .p*ü

_–^'_–^ ÷

ø

ã å  4>$•4" ))2%7"0*%"Y5> "B1Z# ; ;+*"40t:2")W;:24tT4Yo%7"0  4Y“4B * *)? ;"@*+2nP0Y*;, l 77"a ;a#@, 404O,84" 3)7)240;:24oT5"Y B0”X d Y*“@P;"@*1 a# io4Y;j 21 +*15"20o+4 3*)t0* i’‰;";c1 ;*)4Y$h 7c4a ; J "n4Y*c+8OP;g$”4  ";@ 7c4ag g ;4 0#;"206"“O,W " 3:75$F";.4" 3)7)2 B07>Y5> 4Y*.BO*1 OP;1 5X ú ä$êsۄàŽós۽ٝà:ÙäŽåsæ|û ÿ Žà åŽï‹ëãàŽóâ Ûsæû

.p,ü

p. *ý:ü

p. *ý

)

p. þs*pü)

_–^'_–º ©š i"|LJn¬ri"k'orlw qbt-e z‡ eh| lãe5qstedã‡[i"im¾Â¯ qsgz¬rw®¬reygO«ÞÀOeh«bi½´¶q°zim¬ ÷

žŸ >$• 3c424>"<  @4D"Y*4+1i>$•4Y1 *)+)D 0*;1”"Y5 ;c" 3> ; J 4;a4+1P #$&74 34Y< 7c4a"+1 #$&" 1 +424 *)8 %*4Y*D@*4  1P BY  >$&7g"Y*D ;45" 37"Y*ˆc+8OP;o$l ;c4;acB?"Y5D$&W4Yl28;"l ;Y*242c ,0?4;; 0 46O,2137*)l4 84@,  3š, W4@ X ‘ 5%2:22n7 i>4Y24 2n< 7c4a >2 i"Y*;zñ‘7H(1>X ‘ 5;:7;n# i  3)7Yc“O,to)#0„ 0#o4/ 4270j1 6o ;c4;a“O,tc„ +*c'$ ñ‘bX d Y*2ZnŠ 4" ))2%B0t 4Y*."2 2c@, ;+*10?Y,:.8)74542%  3+; ;t"Y*.@*"20#  " 37 $D4Y|%7"0}5),X ‘  : *)|*7 J O* 3,"„ 7c4aB“+*10‚14|) :t" Zn  X 7XŠB0*q !ä23Ø äaŒs4!"!*5>ZX ‘ 5;:7;n „4 84Y*2@*@*1  ;5" 372n$&7W ", 6>Y*;ˆ@*@*1  3)t4Yl1*)7+)7  #0#;1484 >>" i44;t4an"Y*>$&+#"+*4D 7+*1 0 0#220 OP 74 0#240l4“OP!*5>ZX d Y*24;$&"nq iž [ 'Š- d c713! 3Š$&7•W'Zmn";1 27 M X ÐX ÐX:4;'#>@ ¤BACDCDEn GH7H Ð*X•Yc"@Z] ð7ð>>X @P; BYZX " ŒX 7?ð@*"¶ "ð54" 31 ?ðX ‹D;’P";v ‹6XbQP; )FX 4 Ÿ €¦F'z€(ŠÃ …˜ˆ…†( ‡y…˜ȦHG¿„ ¡H…†€D‚n„…† I6¿–‡s(Љ‘X mhYó4Y* ;n*¹* :;B4 it$bŽ13 3$&"* *n# ;"!;1 ;7n M R7RT*X

G7Ý

ú ú üLKNMPOQ J

7

ÅSRéÃlimh

J

zÅÆÇƒÀ

T œÅ·Ç

d Y* Y*  BY‡ "@PB„Y,:/OP;;‡+,0‡0ƒY*5™4Y;}Y:/OP;2 4"240”n5Y*54Y0* 4 4 2($B0*•0“")c(Y,:gOP;26 ;45"20”nY*5‚+*!*5> B0*qY:>OP;2 4"24201 ";BbY:7 OP;;Y0#1 20”X

=? T

YX[ZʼX[ZhE ]

\¼ 74@+ 61"). 7131 2 4 o$("a2n6c ;  *1 $("Y*“N>2+#42"Ž%74@*+, C $&> ". 3*$&" 4 Zn 4;jYc44@Z] ðð5>>X ";+#";B;X 7?ð"242B BY0*",0*B0*ð 7@*+ðEX—žtY:j+0 MH 0*#6$&"¾"Y*j 74@+;n% 213 M RR ÝJKHIJ"MH 4 M R7R ÝJŸHIJBM R*X d Y*| 74@+;n%>Y*  BY  X a 1%$&"Ð ILHH R*X \¼"24 *) 13!#1 3!7D4Y* ;] e Ç Ý à j íså„ä$ïÇàsÚê ú ä:Ùsٖâãîsîâäê¡ïå„ä$ï„äÇî$àãðäê } àãðŽêÇàÇîƒðڎæ‰îƒÛãå„àsÚ:Ùxë„â x ê â êß ÛãÝÇà j s‚h v î ÙÇí‹ëÛâ ôx$â ëãëÇâä$êƒu:ðäsësëŽÚ$å½å„àÇî$àãڎåÜ:Ý¡ïså„äŽßså„Ú ÙsÙà ۄäfòäÇÜ íî $ä ê

ïå„äãõsàÇ܃۝îvÛãÝÇڎۍôÇäsä„îƒÛdâ ê„ðŽíîƒÛsåâÚsëfÜ$ä:ÙÇï„àŽÛâ:Ûâ á„à$êÇàÇîãîvÚê„ðdâ_ÙÇïå„ä$á„à5ÛãÝÇà €ŽíÇÚsëÇâ:ÛsæfäŽòLëÇâ:òà n ] Ûdî$ڋâ:ð[â Û èÇڄî¡Úsë„î$ä5ïå„ä$ï„äÇîâ ê߆ÙäŽå„àò„ëãà$óâ ô‹ëãà½ïå„äÇÜ$àŽðŽíå„àÇîvòäŽå Ú$èÇÚ$åðâ ê߆Ùä$êÇàŽæÛäfÛã݄àLÜä:ÙÇïÇÚ$êâàÇî Ú$êðfåàÇî$àsڎå‹Ü:ݍôÇäãðâƒàÇî½ÛãÝÇڎÛfۄÚ$ñ„à ä$êfïå„äãõsàÇ܃۝î†íãê„ðàŽåÛã݄àLî ä uãÜ$Úëãëãàãð p â:òãÛãÝ p å„Ú:ٝà$èÇäŽåsñ ÿ å„äŽßãå„Ú:ÙsÙà n e ÝÇà ú ä ÙsÙâãîsîsâä$ê‰îڋâƒðÛãÝÇà¡ïå„äŽßãå„Ú:ÙsÙà ÞvÜäŽá„àŽåâ'êߍÛãÝÇà5ïÇàŽåâäãð ý  uþsüsüãþ ކî ÝÇä$í‹ëŽð‰Üä$êÜ$à$êsÛså„ÚŽÛ„à ä$ê[îâ:ófôÇÚÇîâŽÜ½ÛãÝÇà:Ùà„î ކâ êÜŽëí„ðâ'êß ÛãÝÇàfàÇÜäÇîƒæîƒÛà:ÙLÚ$ê„ðÛ„àsëãàÇÜ$ä:ÙãÙÇísêxâãÜڎÛâäƒêîaÚ$ê„ðLÜ$ä:ÙÇïãíۄàŽåÛ„à„Ü:ÝsêÇäëŽäŽßsæ ÛãÝÇÚ$Û[ÜÚ$ê[܃å„àsڎÛàÚ X íî$àŽ, å uƒòãåâàê„ð„ë$æ â ê„òä$åÙڎÛâƒä$ê‰î$ä„ÜâàŽÛsæ X n ] Ûdî:ÝÇäí‹ëŽðfÚë„îäÛڎås߄àŽÛ X Ü$ä:ÙÇï„àŽÛâ:Ûâ á„à Úê„ð[î íîƒÛ„Ú‹â'êÇÚ$ô‹ëãà½ßså„ä$èsÛãÝ X Þ î:ísïãïÇäŽåsÛâ'êß5å„à„î$àsڎåÜ ÝEÞìòsäŽåLà$ó„Ú:ÙÇï‹ëŽà?ކâ'êۄä‰ÜŽëãàsÚêLÚê„ð X

#,

GR

â êÛàësëÇâ:ßà$êÛ X ïå„äŽðŽí܃۝î½Ú$ê„ð ÙÚ$êsíòÚÇ܃Ûãísåâ êß Û„àÇÜ:Ýãêx‎íÇà„î ÞHێÝÇà ú :ä ÙãÙâãîsîâƒä$ê‰î$ÚÇâƒðdâ êdÚLîƒÛ„Ú$ۄà:Ùà$êsÛ n e ÝÇà5ôsí‹ë$ñXäãòfÛãÝÇà5ôsí„ðŽß„àŽÛ¡èÇä$íÇëŽð Ü$äŽáàŽåå„àÇî$àãڎåÜ:Ýdâ'ê‰Ûã݄äÇî$à¡ÛãÝå„àãàÚŽå„àsÚÇî ކâ:Ûdî$ڋâƒð n

= < @ IKsUSIXQC1E[Z]A DX QÊWNX[ZU1R EQC`UU]E>SQR cÔ_–^_Š` ˆoоl~orqsgze]|~w qst+v{ qb|°zd T

\1 1B0* C "a?"4 *)c"E84Y,5? 74 @P2 ; 1 BY"7 42"q ;4 34+#"4Y* 0#  " 37"X d Y*4@,  1Z BY"7 42"%"Y5" 7 0#240")7h ;45"206O8"Y*>"))7; C d "; d )7)2 Ð*X M 0 Ò 2 ED0ˆ4 l;a4BtB)7.70*0#20„O [ N>ž [ '(-€X d Yl"B1b+*8OP;.$g")7D  4Y“0# 4 4B0,ðB) J @ 3BŠ4Yg%244;2t0#+*" 3)4B * *)%24W , 0#;"20l"“O, a# " 3)6B0,ð") J @, "2X d Y*24" G7Ý Ð I R60# 3’P2427>B0,ðB) J @ 3B2X

=\ T

FP

FCF\DCFXzW C^‘ WYX[Z U

¸d¯ ?N

× *ˆ;c4"‡ 4Y0* 4 4ƒ 424:720}$&o"Y*ƒñ>+**!*5>Zò›B0”X d Y* o   74 0#240 4 OP.%7"0.¶+,1 3!7D 34Y4Y.0* i’‰;"; ;D4Y*1