Dynamic Bayesian Networks for Language Modeling
ROBERT ZETTINGER
Master’s Degree Project Stockholm, Sweden 2004
TRITA-NA-E04082
Numerisk analys och datalogi KTH 100 44 Stockholm
Department of Numerical Analysis and Computer Science Royal Institute of Technology SE-100 44 Stockholm, Sweden
Dynamic Bayesian Networks for Language Modeling
ROBERT ZETTINGER
TRITA-NA-E04082
Master’s Thesis in Computer Science (20 credits) at the School of Engineering Physics, Royal Institute of Technology year 2004 Supervisor at Nada was Viggo Kann Examiner was Stefan Arnborg
rtsqu;v2w5x*yv 4+*B1D'()+)/mh"#2"4 3*) C '(m%E?0*21t> 34Yz)44 *){; @*+#";B+*0*;BB0}4+*B1W1 *)+) C `g*)1 4YZn [ 20* 4YZn~c@*24;2En ,0 8+420{ 3|1 )4;" 38$W@*@13 ;4 2nh+,BY
64@,22BY{"2;)7* i" 37Znh4@,2131 BY*B!c *),nc)7" >BY*2B! *)60o+#"$&"8"Y*;74;4 ;1Z"+0#?$D 2n @P2; i,D $&>1*)7+)7W #0 J ;1 *)? .0#24 3)7*20ZnP @*1 ; ;c400"2420ZX d Y*l1)+) #0#;1q .," i"+#40 O%o@B;]W*6@4 J $ J 4@,22BY/"4 )B@,0|64;: ":A 0#21 2nc0*90#;t20#2132tO))2h@A8B0#!1 744" 3)7"¼#BY?0#;0#B.@Al2 c4 ! !7c4aX%W;$&=7""0*;1 ;z4!+*131 |1954)7A{5o 0*;1 132" 20; -|-X_7 J O* *;B0*
¿
ÀÂÁÄÃÅÆÁÄÃÇ
È É £v;w5¯Z°²yv2¥¯,£ Ê ËÍÌÎ « ¯,w ¨ G X M Wc, 724 t*"!#|XXX.XX.XX.XXDXXX.XX.XX.XXX.XX G X M X M \W>a424 37$ *"!#ÑXX.XX.XX.XXX.XX G X M X G \W> );;B1 3U54 ?$qY* 00#;/-|4!75:6 #0#21 ºXX.XXX.XX G X M X Ð d Y*." i44;"aBEn@P;1 1BY*B! 3*),n)7"64o" 31 1>:24 +*"5" $S4747n(t$4Y*44.$>>Y* BY "Y584Y*27*13 0*;1:;"j4 3 J @*1 13 *)7+* 4 0#2@,20#;, 22XW 724 ?*;%74!# C W BEY:7.4;c"13 OP;;?@*47@,c1 0 0 L 2 %@*" *))2*;B1 U25" 37 $ -|-j;nc4Y,5%2 34Y -|-|,0
.;%74!# C W"En00# 4;+"ZY*5W W(;O,g+0D$&'Zm/ )7;*2"1 ,0$& 1*)7+)7? #0#;1 *)ng4@P2 3,21 137X{\1,nh 3 > 1 1cB 4Y*/0# )
$W 1*)7+)7D #0#21("Y5.;/@40# 4Y8@*"OO* 13 3$ht2B /%7"05.t2B @P74 i" 37Znc0tl0#2"" 3@*4 t$4Y*D 3 @*1 ; 27B5" 37t$Z"Y5 0*;1 Xqe 1 1 n i> 131 7c" 13#4 $4YD@P;4$&"> 31 1(OP0# 4;+"0t"Y*;74;4 ;1 1 n7> 31 1 -j-|,0o W;n ,0; @" 7O,;%2;"Y*24%4Y*";0# i;";cb@*@4cBY*4D@*"OO* 31 " b #0 J ;1> 131ZOP$61 *)+,)D #0#;1 M
> 131ZOP0# 4;+4420ZXhe 131 n"Y*.4Y*2"t$b1 +424 *)6> 31 1ZOP@*42c420O*" 33X %Y@*4;lÐ/cB .4Y?0#24 )$>/W +,0$&1*)7+)7l #0#213 *)nq,0 0# 4;+"%Y54Y,5 #0#;1Z ";@*"24;c40?1 24* *)l 6@13262c420Zn# 0#4;4 O,0? /BY@*4; I X 5}4Y@,2$&74$P"Y*1*)7+)76#0#21 b"2420 g0*2"" 3OP20 tBY@*4; LX %Y@*4;Ò6@*"24;cB4Y*"24+*13"$4Y.424 *) $4Y1 *)+)W6#0#21X %Y@*4; Ý ;c" 3,D13#4 D$4Y5_ d X +*1024@P2 1 1 13 !?44Y*!^ ))_*$&74;1 1 n d Y*7Y54Y*2Y5 BY@*4;X d Y*%BY,@#";1 4> 1 +0#Z"Y*h"Y*;74."+*,0WY5" 27+4q"Y*g@P;4$&" #0#;1 n7>Y BY 131POP$Z c4;"2h1542g 4Y* 2n7>Y*21*)7+)7W #0#213 *)< >"+1 1 Y* BYjjD 4Y131h4;61 42 34Y* D4Y24 W| .+0j *%
$h
@
1@*13¡D ;(5 4 Z/ $4OY+#t1 4Y*;)+,1 )1(7YX :7d Y**Y* BY8 (4Y*13 !213 2q$D0#20+*lO,2$,7c4aB"ç Y "Y*@*"O,O* 13 3 44@P;1 130o7[ y s(5(5n ) :2t"Y5>"Y*%7"0' ¥"¦§( Y,:D2+*""20 34Y*" D4;aBç \ ¡
zn
¨s( C D DEb g z42@,540 C +**"1 1 20Eb$&g+* J N OP;.$h" 3 34YB;D7**24 *)o:4 O13W.0# 3;";c.4 6Y* 13t),X d Y* $&54+4"<;@*4+*"20 4Y*?D e )+4 G X G n(>Y* BY +**"1 1 20?$&4Y42W" 3 42@;X 4"Y5%4Y*D"4+,4+4$4Y*W 0*;1 g4Y*D46 3tBY " 3 W42@Zn0 "Y5 4Y%m d >0# *BY*)7W5:7;%4 XbK4Y"24@P2D >"D41 13t"4 n*,0 I
0.1
W
VERB 0.4
0.4 0.5
W
0.1 0.7
NOUN 0.5
0.1
ADJ
W 0.2
e 3)7+*4 G X Ð]q\4 3 @*1 Y* 0*0#2-j"!5: 0*;1 C -|-jE 4Y86© ¡
D*1 30* 254>"Y5D4Y*2/;j6#0#21("; @PB1q0#;@P;0*;; 3;X d Y*"; @PB10*;@P;0#2 22nP$h7+*"4n,";@*4+*"20 /4Y8B;;*2" 3)$b4Y;X \pD ;OP?/4+* 3"O13?BY $&86#0#213 *)/"Y*?"4 " 21g0#2@,20#2 2
4Y 34YjW C @*@P7420"?? DEnP>Y* BY|4Y*24;$&" +*> #0#;1($BY X
^_a`b_^ c;dfeY«bimgzi"|~ey¬aoaxe]l oaqsg®qbt-¯zo°z°zimgB±²eh|~}bqS³µ´¶q'°Oim¬d
\7 67$D #0#213 *)B0#7 :5" O*1 2
" 3 j4;" 2 (5 ¹ CS -j-jEn*>Y;".4 D$4Y*.B0#7:5" O*13"W7O24:720n,0 4 Y* BY 0*;1.4Y* @*"OO* 13 3.$,0# 3;";c@,4" J $ J 4@,22BY$&7131 5> *)4Y*2@B J $ J 4@,22BY l4+*B1 1*)7+)7.4aB;n>Y*24l2BY/@,4 J $ J @P;BY|B546;|; 3.j4+1(B0X d Y* @*"OO* 13 3t$q *+$&7131 5> *)6/0¶4 : H X Ý n,l+*o$&1 1 5> 3*)Y*;"j 3o +**"1 130$&Ð" 3 ";@2X "j"Y5 4Y -|-n>*#0# ";@*"24;c"q."5"n7>Y*;"27 >Y* BY ;O,| 1 1"Y*j0# 3;";c?B5"22X d Y*24;$&"n 3e )+*" G X I n"Y*jB;?0#* ";@*"24;co
*)713@*"OO* 31 3nO*+*/
@*"OO* 13 30# 4" O*+#4 C "Y*;4j$ 0# 4;4;4.:51 +*27*1 n*660# . 724 ?*;%74! C D WE SEM
SEM
SEM
W
W
W
POS
POS
POS
t=1
t=2
t=3
e )+*" G X L ]b\ ".; @*1 a0*c, . *"! :5" O*1 l;P4 *)"Y*t; 44 $g"Y*t7O24:720j:4 O137X6K$S72n i61 135. C Y 0*0*;.O4;":0E>:54 O*1 6Y: 3*)2.7o4Y*2 C Y* 0*0#27W7O4;":20,E :5" O*1 D o4Y*" 7l15";>" 3 J 413 7X d Y+;n*4Y* #0#21Z 3/e )+*" G X I ;+*10n $& ",ngO,)2*;B1 U;20 3c44Y,5< 3}e 3)7+*4 G X L ng>Y*;"?"Y*@*"OO* 31 3$ ; 3" 3*)|;;4" 3%7"0D0*;@P;0**7*13j>Y* BY@ J $ J 4@P;2BY a#@,"20n O*+#1 46/7 .4;YW ¼;/0# " $S"" 3U2D -|-X d Y* $S474 U24 D (+;$&+*1 n0D5"+*B1 n2 4Y*W ·$& ã " 3 |413 t,0 +4|{$W"Y*| #$&;";,471 "Y*;"|"$&B54 / 2n>+BY7 4Y* $
%
¡H
(· Ã!(
¦ ¡W4Y*Ö Õ
(vD Ã#(
Ȧp¡B0 5L 2 X d Y*l:5" O*138;1 3 J 4 /13)7" i"Y*»74 " /;""c *) +**2;2"442OP;1+1 420,n*0oO,+,0 8+1i" 3@*1 .4 22X [ 2D 0 I 2 $&0#;" 31;X d Y¶+*" 374";1 )74 34Y»7 " ; J :2" 3)4Y*t"!| 3c"jo4";t>Y;"Y* BYj|71 0|:4 O13#2+*Bl+WOP6;c4 )+*7+Q 0 T 2 XDK 4Y "42n4Y*+ Ø(/S¡>Ã#
#é Ã!(
¦ ¡º2OP+420X d Y* 0#2 4B4 > 34Y76. * 34 1 (
C 6@*47OO 31 i0# 4" O*+#4 PEh$&7>27BY1 7+Xh\1 c+* 4Y;
4;,0*"j*; )YOP+*l4Y 6@P42c4 1 nh *) 4+*1 22] C M E>t*#0#; OPl00#20"t"Y*$&"c4 ;W i$1 1 3"W@";cB"813"270#? /4Y8$&"c4 ;n,0 C G E *#0#.;tO,D"; 5:06$&47 4Y*W$&47c4 ;>Y*; iBBY 310#";tY:7OP;200#20X d Y* 7";4$S;D13)7" i"Y*p+427*13t4Y* $&"c4 ;4+@P0*40X
"Ë ÄSÈÄ Ï ÄË r?³³w5¯ ì ¥S¢x#v¥& « ¥S£¤ « w « £y « `ba* 3#$&242 "Y*#0*;jB!7ll+BYj" 3 4Y;t C 0 M2 E%"Y5>"Y*4+*B4 37
Ûåæ äOç #5è#é©#êëSâã½ÙDÝ ÆÇÊÉ ÜÞäaÛåÌpߨàá%ÙDÆÈǧäÜFÉ Û!Ì > 131(;:24)7"l"Y*[6 Û 4Y*7+* C PEnc:;"O C :*Eb0O, *7+*o :24O(mn ; 34Y*26*+*7>:;"OZn*ª0 ( g2 i"Y*; /70¶24 :7 :24OZX d Y+2n27BY$q4Y*8%7"0* 4Yl42c+*;,7+*10@,c44 3O13 OP>; i440lO 744Y, *Y* 0*0#2@47OO* 1 i $"Y*@ J $ J 4@,22BY ~ï"$&1 1 5> 3*)D"Y*@ J $ J 4@,22BY X d Y*>@*"O,O* 13 34 2g" 4"20 4Y%m d 74"24@P0# *)"/4Y*o"45.OP;24Y*Y* 0*0#;:54 O*1 2 m × [ |e )+4 G X I X%e*+*44Y*24 747n*+*@@,cD Ù Æíì!äaðzñòpÌ> 4Y@*"OO* 31 3t$4Y* B0·s( 0 Ð 2 C @,) L#ML L*M TcEX
MM
÷
ø½ùúûoü{ý
7 8 Å
g
hWiîÁkj
limjÑÅ
ÀÛÅoh n
K4Y lBY@#";n.> 1310#2"" O,?jW "Y58Y,:<"2420Zn0>Y* BYD> 4Y 4 3 @*1 ; 27.0j"+0# 3j674l0#B 1XWK/4Y* DBY@#";n"Y5.W ¸> 31 1O,60# J "" 3OP208)B@*YZn0 38> 131g1 4/OP?0# 4;+4420Y*5¸4Y*W ";@*"24;c40 31 11OPW0# "+"0 >Y5 g*;0#20 34Yj4Y*4?a#@*1 34Y*$S4YW1 1(4+*B1 1*)7+)72 *Y*24 3<;4" 3{@*47OO 31 4 Ù I[Ñ &9w ä Xb5n 3$ 2B t$&54+4% 4Y*.1*)7+)7W"@47@,241 @,c 34 4Y,"Y*;B;X [ +BY6#0#21 %Y:71 40#6OP;;o"2420Zn7O*+*>Y%h> 4Y i"Yj0# 3P2427 $&"2c+*;, }0# 3;";ctc"at0#>Y584Y* i"Y* 3{4Y*" ?@ J $ J 4@,22BY;O,o70# 34 *0"Y*o@2X$ 4Y4;acW O,7+# #$&"7"4+,4+47n#4Y*8@*47OO 31 i$ #l+1 0oOPY* )Y*2>4Y/ i +*10;"g"Y*4;achO,7+#h! *)X\0l: ; J :;B"*] 3$4Y4ab O,7+#h! *)n 4Y@*47OO 31 i; J 4;aq b ñO(1>Xq`g7BY6;c4;aq> 1 1#Y:>Wc+8OP;b$B0*4Yh óè#èp5 3/ 4Y* +*10oO,l%7"0*"Y5D 3|4 84;,4:7;"?";@*"24;c"4 :D$&4YW7c4aX\ 4" ))0;c4;a> 31 14Y;/OP¿ ñj$&7<2B o4 6 xã )3"&131ZB0*2c+1 M X d Y* > 5"+*"1n*4 . 3 "4+> i"Yo@47OO* 1 i M 4Y7 DB0t#2+*B;Xb-|4Y*2)7 3:7;oO
ϧñéE â
â â õ
($ $) 7
Ú
ÆÈðQä9äÌsÍ[!
C Ð*X G E
>Y*;" Dó D "Y*0# 4 ,";1 1($&74Y*"24 *)n,<"@*+Y,4 4Y*;"@*+2X OP; *)8 c424"20< t"Y*W c ?%7"0* C 47@t%7"0"Enc4 3,"Y*;êêO d Y*7 721 :51 10#7n4Yg #0# i,20$&>l?@*+*"@P7422X d }1 +4;4Y;c4;aco:47"tt4Y*82+*"";;2$q27BY @ J $ J 4@,22BY4" 3)7"$&" 1 4)7 C @4 J å $ J 4@,22BY"))0E.74@+;X 5;:7;n 4 3;D4Y*.+*8OP;>$(B)7 3o"Y*.B0#;! ¢ n#"Y*.c+8OP;>$@,c44 O*13D"4 )B i"Y@*@*"a# 3Y BY?;lO* 32b"4 )BºB5" 4 ; > 34YO* )B "4 " 2 C 4Y*t+*lO,2$0# 3;";cO* )B 4Y*?B0#;V! ¢» nq4 4Y0*5B8$&"6;"@*+> 34v Y ! ¢¹ ! ¢º 4 + Ùt ;cBEX d .7O#" 3l4Y*>;0# 34 ,1@*"OO* 31 34 2$&b@ J $ J 4@P;2BY4" 3)7"¼(a""740 4Y8B)7D7*13o$&"Æ"Y*<"@*+D,0|+420|4Y* D")o;"@*+DW 3*@+#.4 [ N> [ '(-n 4+*B11)+)@*";2" *) C W'Zm%E 41 ! i?O}\0#"27 [ "1B!X [ N> [ '@*"5: 0#0 h> 34YlOB!781*)7+)7q6#0#21 \N>m\$&" 2n01 4>"+#" 3* >êê}"Y5h)7 3:7%4824"W"Y*>@*"OO* 13 34 2q$P c4;"22Xqe*7b " #$&74$&7WBYj;c4;ac4Y* DO, W|27 "7! #)7l"Y*"+*)7Y"Y*74@+$&47pOP;) ** *) "13*;c4;ac 74 :7Xb24.*t;c4;a2:2" 3:7n*131 B0 2+*"";;2b+*10 4Yt4lO,213 ;:7"Y5 3 ¥¢³g¯Pu2u¥&s ±S«D$&7>82B B08"#;;+*g ?;c4;acn¶+%OP22+4 3%g*%4;2t0#+*" 3)4B * *)X d Y*;" J $&"n74Y óq" 3 D2B t%7"0Pð").@ g g27+*c4240 i"Y 26 3,"20{$DU;;"22X 5%2:;nb 76B0* C "at"4 *)c"El;
** ;,0#134 C |>Y* BY|;7"Y*8@47O*132+1 0*WY:7#;+4"20o /4Y*8B@1 7E MÒ
>;1 1 20©é©ññ@ÂóèX i"YY*;"gBY 0# : 0*+1 4;a.4" 3) ., 0#;"20|4oO, 34Y|êêlnZ4" *)o131b*U2;" ;1 ; 27B 3/l1 .4Y27 13t2OP40tO?4Y*0##0# *)< 3 @*1 ; 27B5" 37ZX
=¬ ¬
@ P'KVXVUFIC`S
q> 4Y*08" 6@13262c%0#2;#0# 3)@*")B"Y5%) :2b4Y*@47OO* 1 i8$&g.B0 42c+*;,nc>Y*24DQ ðzñò< %;4 0#;"20 "8OPD4;ac>4" 3*),n7 X Xq4YW:7;"O-/ñ,0 4Y0¶4 :Q 5ñl".42)7"0#0n @*137n#4 OP.4Y*B0©/ñX : *)64Y*"+#" 32$&>7O#" 3 3*)6"Y*70# 34 1@*47OO 31 i" 3$&"Y*@4 J $ J 4@,22BYl4" 3)7" q >êê}$&"¸4Y [ N> [ '(-·"1 !c 3g,08"Y*WÚµ%m d ""206 ,137ncg+0t0#6 W@*47)B 3).48 @*1 ; ;c>80##0# *)l@47)B >êêlX d Y*.1 )74 34Y*º"24;8O13h"Y5>0#2"" O,0t ?2c+4 G X G G X I X 5;:7;nh> 4Y 4?+84" 3)7""4 " 2> 34Y* /"Y*lÙ»%m d n,0/ 84Y*61 )74 34Y*·0#2"" O,0 G X G G X I y$&");"1 {.2:;"c4Y* *) C 3j@44 +*14Y*l:13+$b"Y*8Y* 0*0#2|:5" O*1 $&D"Y*l@,4 J $ J @P;BY,E"Y5 D$S44Y*2"Y M 42@jO7B!/ 34 n"Y* 1 )" 34Y* 8+,>OP6#0# 30X 'Z;
ÆÈaÌÞÍÙDÆÈð ä aä ð å ;ä 3Øäaðq&9w ä ¨ î äaðq& ¨ pÌ
CI XM E X 7X"Y*@47OO* 1 il$(1 1,4Y*W%7"0* C 4;a4" 3*)c"Eb 3 i"Y 4Y.;"4@P,0# 3)4B4 34 ?@47OO* 1 i " *"Y*;@ J $ J 4@,22BYZn,0n131 n 8+1i" 3@*1 3){> 34Y"Y*@*47OO 31 i$4Yo@ J $ J 4@P;2BY2 i44 *){"Y*+*"42c B0X-j54Y; 34Y* |644O*13W"*)7X
MT
÷
7
ø½ùúûoü{ý ÅÆÇ{Ã>Ákj
Ô
Ã
8 Å
Jli«jîÅ
hWiÑÁkj
n
ÀÛÅÕh
d 42Z"Y*h@P;4$&" q$7"Y*h1*)7+)7 #0#21n4Yh0#2;0* 3*)13)7" i"Y*z Z@*@*1 30 4t4Y*842D;"@*+2X d Y* )7 3:72>"Y*8@47OO* 1 i$&4Y*842D;"@*+2n>Y* BYZnP+4 3*) 2c+4 G X Ý ,0 G X Òn) :2"Y*@P;"@*13;a# i7X d Y*;"""Y*";.0# i;";c>@"6;42"%$ 3c424"Y5> 3)7Yc;P4YD"24+*132n ,0> Y
4"+*"Y*/0#2;0* 3*)1 )74 34Y*¾> 34Y}0# 3P2427Y54Y* )7 3:72> /";" W$b@P;"@*1 a# i7X d Y*84Y*";@,B ";B " M X d Y*+*8OP; $D0# i;";c<77"a"2X6 644O*1 4O,213 ;:7?"Y564Y* +*8OP;$0* i;";c87c4aB.2B.4YB0o 4;2,ç i"Yj<7c4a"+1Z 2674$bU;24,n#*?;c4;ac"+1 #$&"D 4Y*24;$&"80# "O*1 4l081 ;)4Y$4Y*.77"a4+,1 ; "64Y%"4+*1 3)8B0*g> 34Y 3?4Y*D1 *)+,)W 3?4Y* 74@+;X Ð*X+*lO,2 $"4 ))7;B0*2X d Y*?4"1+*8OP; $>4" 3)7);l%7"0$&627BY 7c4aXj$>4Y24o4 131O,o4 :4;10#7onb04Yo;c4;ac"+1 #$&"$&71 4)7;:513+*;X d Y,5 ;nP> 34Y|* *8;13+,";B;nP iW7277nOo13! *)t5 4YB0*h ?BY?;13+422n7462"Y*D;Y*242> i"Y* 3?4Y*.1 +42"2X d YD;13+42" ;"t "?61 2"8";15"204j4@P2 3,t4@ ng+,BY{6@P4"l6"#B! 34Y/6 3c424@4;420?47@* WY20*13 *X [ @P4" ÙÚÛÜ:Ý|ÞTßÚ:ÙàÞTáâãÜÛäåsæçÞéèâ ê|ÞìëãàsÚßíÇàÞ
î$àsÚî$ä$ê|Þ ïëãÚ$æàãðÞÀßÚ:ÙàÇîÞ
Ü ísï|ÞVÙâ êsísÛàÇîÞìîäÇÜsÜ$àå
[ 4#B! 4!7
ÙÚåãñàÛçÞëâ:ñàë$æÞTåà:ÙÚâ'êÇàãðÞTòåâðÚæÞìÜ$ä$êÛâ êsíÇàãðÞ àóãïàÇÜÛàãðÞÀðà:ÙÚ$êðÞÀïÇäîâ:Ûâ:áàÞìîÛÚ$åsÛàãð
N>;@P4"2n#*2
îÛÚ$Ûà:Ùà$êsÛçÞHî:ïäñàÇî ÙÚ$ê|ÞTÚêÇÚë$æî:ÛçÞTåàãòà$åsåâ êßÞ äãòsòâãÜâÚëîÞHî$äíåÜ$àÇîÞéèxâ:ÛãêàÇîsî$àÇîÞ
â êÛàêðàãð
% @c7n#O*+4 32"
Ü$ä:ÙïÇÚ$êæçÞVïåäãòâ ÛîÞéïsísåÜ:ÝÇÚÇîàÞÀåàãð$íÜ$àãðÞéæàsÚåçÞ î$äë$ðÞTåÚâãîàãðÞÀïÇÚâ:ðÞÀísêxâ:ÛîÞ
Ü$ÚÇî:ÝçÞvâ'êáàÇîÛ
% i" 3
îÛäÜñãÝÇäë'ÙWÞHîæsðêÇàæçÞÀôä:ÙÇôÇÚæÞ`õsä$ÝÇÚêsêÇàÇî:ôãíåsßçÞ ëãä$êðä$ê|ÞìîäãòâÚÞõãÚñÚåsÛÚÞ`ðísôëâ ê|ÞéïÇÚ$åâãî
[ #
ßäáàåãê$ÙàêÛçÞHÜä$ísêÛsåãæçÞéïÇàsäïëãàÞéèäåsñçÞVÙÚëàÞ Ûâ_ÙàÞÀïëãÚ$êãêÇàãðÞ`Ú$ßsåàsàãðÞ`ðàÇÜâðsàãðÞéïëÚ$êî
[ 4#B! 4!7 G
ïÇàåÜ$à$êÛçÞéåâãî$àÞ`òsÚësë Þaâ êÜ:åàsÚÇî$à ÞTðãåä$ïãïÇàãðÞ åäÇîàÞ`òâ:ßãísåàÞâ êòëãÚÛâäê|ÞTàsÚî$àãðÞ´ÙäêÛãÝ
GH
*! *) Ü$à$êsÛsåÚë ÞVôÇÚ$êñçÞ
Üä:ÙsÙàåÜâÚë ÞDÙàåÜ ÝÇÚ$êÛçÞ ôÇÚ$êsñàåîÞÀöëãäÛsæÞ
î:èxâ:ÛösàåÇëãÚ$êðÞÜ:åàãðâ:Û
mq1 i" 21
ëãàsÚðàåçÞTðsà$ïsíÛsæÞTåàÇîâ:ßêÇÚÛâäê|ÞÜä$êßsåàîsîÞ ïÇÚåãÛsæçÞ
Ü$Ú$ôâ êÇàÛçÞTàëãàÇÜÛâä$êîÞ´ïÇÚåÇëâÚ:Ùà$êsÛ
e*""Y*24<1 +4;B2n%4".$g"4 ))7;.%7"0;n ã ä 0 ã å n(;" BY*74;" ã ä Y: *)jÒR Ý "4 ))7;8B0*4Y6")74Y;8#2+*"40@@*4a# i"Yz:24}1 5$&"2c+*2}$#2+*"42/;"|76 3"20nW 4Y;%7+*10/*0#8+BY|$%?0* i;";;lcXD\1,nPB0*> i"Yt:7;"Y 3)7Y $&"2c+*;,8;"> 3"20X d Y*"2776$&b"Y5gb4Yh4Y*%7"0*g2; 206"O, :24)7;*2"1 C X X 0# 0j*DOP2|77"a4+,1q 3*$&" 4 ,EW,0j )Yc.7D%2131 Y:7WOP;2o ;13+0*20o 3o"Y*"@o13 >$&474Y*"X 4Y*+*10OP|*"20}"Y50* i;";c?+*lO,2t$.4" ))2%7"0* $&t0* i;";ct77"a";c4;ac>;"DBY74;Zn"Yo$&"Y*4#B!t* *7c4aB;n ã(ä 0 ãå X
_^'_a` ÷
øCù
ã ä gl;%$"4 ))7;hB0*h4Y% @*@P2B2X d Y*"24+*1iB >7>Y5> 4Y*.BO*1 OP;1 5X ú ä$êsÛàósÛ½Ùà:Ùäåsæ|û ÿ àåïëãàóâ Ûsæû
.p,ü
p. *pý:ü,
p. þs*pü,
G#M
. .p*ü
_^'_^ ÷
ø
ã å 4>$4" ))2%7"0*%"Y5> "B1Z#;;+*"40t:2")W;:24tT4Yo%7"0 4Y4B * *)?;"@*+2nP0Y*;,l77"a ;a#@,404O,84" 3)7)240;:24oT5"Y B0X d Y*@P;"@*1 a# io4Y;j21+*15"20o+4 3*)t0* i;";c1 ;*)4Y$h7c4a ; J "n4Y*c+8OP;g$4 ";@7c4ag g;4 0#;"206"O,W" 3:75$F";.4" 3)7)2 B07>Y5> 4Y*.BO*1 OP;1 5X ú ä$êsÛàósÛ½Ùà:Ùäåsæ|û ÿ à åïëãàóâ Ûsæû
.p,ü
p. *ý:ü
p. *ý
)
p. þs*pü)
_^'_º © i"|Çn¬ri"k'orlw qbt-e z eh| lãe5qstedã[i"im¾Â¯ qsgz¬rw®¬reygO«ÞÀOeh«bi½´¶q°zim¬ ÷
>$ 3c424>"< @4D"Y*4+1i>$4Y1 *)+)D 0*;1"Y5;c" 3>; J 4;a4+1P #$&74 34Y<7c4a"+1 #$&"1 +424 *)8 %*4Y*D@*4 1PBY >$&7g"Y*D;45" 37"Y*c+8OP;o$l;c4;acB?"Y5D$&W4Yl28;"l;Y*242c ,0?4;; 0 46O,2137*)l4 84@, 3,W4@ X 5%2:22n7 i>4Y24 2n<7c4a >2 i"Y*;zñ7H(1>X 5;:7;n# i 3)7YcO,to)#0 0#o4/ 4270j1 6o;c4;aO,tc +*c'$ ñbX d Y*2Zn 4" ))2%B0t 4Y*."22c@,;+*10?Y,:.8)74542% 3+;;t"Y*.@*"20# " 37 $D4Y|%7"0}5),X : *)|*7 J O* 3,"7c4aB+*1014|) :t" Zn X 7XB0*q !ä23Ø äas4!"!*5>ZX 5;:7;n 4 84Y*2@*@*1 ;5" 372n$&7W ",6>Y*;@*@*1 3)t4Yl1*)7+)7 #0#;1484 >>" i44;t4an"Y*>$&+#"+*4D7+*1 0 0#220 OP74 0#240l4OP!*5>ZX d Y*24;$&"nq i [ '- d c713! 3$&7W'Zmn";1 27 M X ÐX ÐX:4;'#>@ ¤BACDCDEn GH7H Ð*XYc"@Z] ð7ð>>X @P;BYZX " X 7?ð@*"¶"ð54" 31 ?ðX D;P";v 6XbQP; )FX 4 ¦F'z(ÃÂ
( y
ȦHG¿¡H
Dn
I6¿s(X mhYó4Y* ;n*¹* :;B4 it$b13 3$&"* *n# ;"!;1 ;7n M R7RT*X
G7Ý
ú ú üLKNMPOQ J
7
ÅSRéÃlimh
J
zÅÆÇÀ
T Å·Ç
d Y* Y* BY"@PBY,:/OP;;+,00Y*54Y;}Y:/OP;2 4"240n5Y*54Y0* 4 4 2($B0*0")c(Y,:gOP;26;45"20nY*5+*!*5> B0*qY:>OP;2 4"24201 ";BbY:7 OP;;Y0#1 20X
=? T
YX[ZʼX[ZhE ]
\¼74@+ 61").7131 24 o$("a2n6c; *1 $("Y*N>2+#42"%74@*+, C $&> ". 3*$&" 4 Zn 4;jYc44@Z] ðð5>>X ";+#";B;X 7?ð"242BBY0*",0*B0*ð7@*+ðEXtY:j+0 MH 0*#6$&"¾"Y*j74@+;n% 213 M RR ÝJKHIJ"MH 4 M R7R ÝJHIJBM R*X d Y*|74@+;n%>Y* BY X a 1%$&"Ð ILHH R*X \¼"24 *) 13!#1 3!7D4Y* ;] e Ç Ý à j ísåä$ïÇàsÚê ú ä:ÙsÙâãîsîâäê¡ïåä$ïäÇî$àãðäê } àãðêÇàÇîðÚæîÛãåàsÚ:Ùxëâ x ê â êß ÛãÝÇà j sh v î ÙÇíëÛâ ôx$â ëãëÇâä$êu:ðäsësëÚ$å½åàÇî$àãÚåÜ:Ý¡ïsåäßsåÚ ÙsÙà ÛäfòäÇÜ íî $ä ê
ïåäãõsàÇÜÛîvÛãÝÇÚÛôÇäsäîÛdâ êðíîÛsåâÚsëfÜ$ä:ÙÇïàÛâ:Ûâ áà$êÇàÇîãîvÚêðdâ_ÙÇïåä$áà5ÛãÝÇà íÇÚsëÇâ:ÛsæfäòLëÇâ:òà n ] Ûdî$Úâ:ð[â Û èÇÚî¡Úsëî$ä5ïåä$ïäÇîâ êßÙäåàòëãà$óâ ôëãà½ïåäÇÜ$àðíåàÇîvòäå Ú$èÇÚ$åðâ êßÙä$êÇàæÛäfÛãÝàLÜä:ÙÇïÇÚ$êâàÇî Ú$êðfåàÇî$àsÚåÜ:ÝôÇäãðâàÇî½ÛãÝÇÚÛfÛÚ$ñà ä$êfïåäãõsàÇÜÛîíãêðàåÛãÝàLî ä uãÜ$Úëãëãàãð p â:òãÛãÝ p åÚ:Ùà$èÇäåsñ ÿ åäßãåÚ:ÙsÙà n e ÝÇà ú ä ÙsÙâãîsîsâä$êîÚâðÛãÝÇà¡ïåäßãåÚ:ÙsÙà ÞvÜäáàåâ'êßÛãÝÇà5ïÇàåâäãð ý uþsüsüãþ Þî ÝÇä$íëðÜä$êÜ$à$êsÛsåÚÛà ä$ê[îâ:ófôÇÚÇîâܽÛãÝÇà:Ùàî Þâ êÜëíðâ'êß ÛãÝÇàfàÇÜäÇîæîÛà:ÙLÚ$êðÛàsëãàÇÜ$ä:ÙãÙÇísêxâãÜÚÛâäêîaÚ$êðLÜ$ä:ÙÇïãíÛàåÛàÜ:ÝsêÇäëäßsæ ÛãÝÇÚ$Û[ÜÚ$ê[ÜåàsÚÛàÚ X íî$à, å uòãåâàêðë$æ â êòä$åÙÚÛâä$êî$äÜâàÛsæ X n ] Ûdî:ÝÇäíëðfÚëîäÛÚåsßàÛ X Ü$ä:ÙÇïàÛâ:Ûâ áà Úêð[î íîÛÚâ'êÇÚ$ôëãà½ßsåä$èsÛãÝ X Þ î:ísïãïÇäåsÛâ'êß5åàî$àsÚåÜ ÝEÞìòsäåLà$óÚ:ÙÇïëà?Þâ'êÛäÜëãàsÚêLÚêð X
#,
GR
â êÛàësëÇâ:ßà$êÛ X ïåäðíÜÛî½Ú$êð ÙÚ$êsíòÚÇÜÛãísåâ êß ÛàÇÜ:ÝãêxâíÇàî ÞHÛÝÇà ú :ä ÙãÙâãîsîâä$êî$ÚÇâðdâ êdÚLîÛÚ$Ûà:Ùà$êsÛ n e ÝÇà5ôsíë$ñXäãòfÛãÝÇà5ôsíðßàÛ¡èÇä$íÇëð Ü$äáàååàÇî$àãÚåÜ:Ýdâ'êÛãÝäÇî$à¡ÛãÝåàãàÚåàsÚÇî Þâ:Ûdî$Úâð n
= < @ IKsUSIXQC1E[Z]A DX QÊWNX[ZU1R EQC`UU]E>SQR cÔ_^_` o¾l~orqsgze]|~w qst+v{ qb|°zd T
\1 1B0* C "a?"4 *)c"E84Y,5?74 @P2; 1BY"742"q;4 34+#"4Y* 0# " 37"X d Y*4@, 1ZBY"742"%"Y5"7 0#240")7h;45"206O8"Y*>"))7; C d "; d )7)2 Ð*X M 0 Ò 2 ED04 l;a4BtB)7.70*0#20O [ N> [ '(-X d Yl"B1b+*8OP;.$g")7D 4Y0# 4 4B0,ðB) J @ 3B4Yg%244;2t0#+*" 3)4B * *)%24W, 0#;"20l"O, a# " 3)6B0,ð") J @, "2X d Y*24" G7Ý Ð I R60# 3P2427>B0,ðB) J @ 3B2X
=\ T
FP
FCF\DCFXzW C^ WYX[Z U
¸d¯ ?N
× *;c4" 4Y0* 4 4 424:720}$&o"Y*ñ>+**!*5>ZòB0X d Y* o 74 0#240 4 OP.%7"0.¶+,1 3!7D 34Y4Y.0* i;";;D4Y*1