CALIFORNIA INSTITUTE OF TECHNOLOGY

DIVISION OF THE HUMANITIES AND SOCIAL SCIENCES

CALIFORNIA INSTITUTE OF TECHNOLOGY PASADENA, CALIFORNIA 91125

A MODEL FOR BAYESIAN FACTOR ANALYSIS WITH JOINTLY DISTRIBUTED MEANS AND LOADINGS

ST

IT U T E O F

Y

AL C

HNOLOG

1891

EC

IF O R NIA

N

T

I

Daniel B. Rowe

SOCIAL SCIENCE WORKING PAPER 1108 January 2001





‘ ’M“ ”–•—‘`˜š™œ›`“ ž‚Ÿm›¡  { Z ¢ ›o£¤‚‘`˜¥š M›o”ldž‚Ÿmžh¦¥ŸW¤u§ ¨ ‘`Ÿf 1¤u”l ©iŸmžI¤u˜%Ÿfª]«K¤a“ ’  “ ›o ]ž¬›o ]’ ­‘-›o’]Ÿm M®Sž JKqsrut¯v°x^dyYZz$|Sv²± ³¡´¶µ[·W¸l¹º‡· »†¼½/¾À¿‚„[‹‡¾[ÁÂ憄fÄ7ÄŠŅ„‡Æ½¼ÅÇȄ‡ÆɼŇŠÊ„‡†7„‡Ë̋—ÁÂÍÁÏÎl„[Ðf„‡ÂÍË̈́fÑË̾ÊÄ7ŠÒÂÌҊÔӉ†7ÅWÕË×Ö ¾[Ø/ه¾OŠ¾Ïم„fŠØÂ͆/ÙÚ¼½/¾OÛ Å‰Ø7¾[ËIÄ°„fŠ„‡Û ¾Ï¼¾ÏŠÁ ÂÍÁ܉ˆ7„‡†Ý¼Â×Þ¾[ØMÂ͆K¼½/¾oÇßҊÒÛàÅ‡Ç Ä7ŠÂÌҊ"Ø7ÂÍÁ¼ŠÒÂÌш/¼ÂÌŅ†Áu„‡†7Ø1Â͆7ÆÉҊÄ$Ҋ„f¼¾[ØSÂ͆á¼Å¡¼½/¾Â͆/ÇȾϊ¾[†7Æɾ[Á"„‡ËÌŅ†/Ù¡ÕÂ̼½ ¼½/¾Ø7„f¼„—âbã½/¾Â͆7ÆÉҊÄ$Ҋ„f¼ÂÌŅ†¡Å‡ÇsÄ7ŠÂÌҊ‚Ó—†/ÅWÕRË̾[Ø/ه¾½7„‡Á‚¼½/¾„‡ØØ/¾[ØOÆÉŅ†—Ö Á¾[܉ˆ/¾[†7ÆɾäŇÇb¾[ËÍÂÍÛ Â͆„f¼Â͆/Ù¼½/¾„‡ÛÑÂÌمˆÂ̼w‹OŇÇeŠŇ¼„f¼ÂÍŅ†Ú„‡†Ø-¼½/¾†/¾Ï¾[Ø`ÇÈҊ Û Å—Ø/¾[ËÆÉŅ†7Á¼Š„‡Â͆ݼÁ!ÇÈŅˆ7†7Ø;Â͆]¼½/¾Ú¼Š„‡Ø7Â̼ÂÍŅ†7„‡ËuÇ儇ÆɼҊo„‡†„‡Ë̋‰ÁÂÍÁ!Û Å—Ø/¾[Ëæâ ç ÇÈŗÆψ7Á&ŇÇbŠ¾[Æɾ[†Ý¼ÕaҊÓ]èåé%ÅWÕa¾‡ÎeŒf‡‡‡„-„‡†7Ø{é%ÅlÕI¾‡ÎeŒf‡‡fÑd„‡†7Ø{éÅWÕa¾‡Î Œf‡‡‡ÆWê ½„‡Á Ñ$¾Ï¾[†]Ņ†@܉ˆ7„‡†Ý¼ÂÌÇȋ‰Â͆7ÙZ„‡†7ØHÂ͆7ÆÉҊÄŇŠÒ„f¼Â͆/Ù{„[Ðf„‡ÂÍË̈́fÑË;-Ä7ŠÂÌҊ Ӊ†7ÅWÕË̾[Ø7ه¾`Õ½/¾[†;¾[Á¼ÂÍÛ!„f¼Â͆/Ùd¼½7¾SÄ$ŇĈ7ËÄf¼ÂÌŅ†HÛ ¾[„‡†Ôâã%½7ÂÃÁ Ä7Š¾ÏЗÂÌŅˆ7Á ÕIҊÓH½7„‡ÁëÆÉŅ†ÁÂÍØ/¾ÏŠ¾[ØìÎaÐf„fمˆ/¾‡ÎÆÉŅ†fíˆ/م„f¼¾1„‡†7Ø@ه¾[†/¾ÏŠ„‡ËÍÂÌîϾ[Ø=ÆÉŅ†míˆ/م„f¼¾ Ø7ÂÍÁ¼ŠÒÂÌш/¼ÂÌŅ†Á‚ÇßҊ&¼½/¾Ä$ŇĈ7Ë̈́f¼ÂÌŅ†SÛ ¾[„‡†Ôâ&»†S¼½ÂÍÁÄ°„fľϊWΈ7†ËÍÂÌӇ¾Ä7Š¾ÏЉÂ×Ö Å…ˆ7ÁÊÕaҊÓ°Îݼ½/¾uÄ$ŇĈ7Ë̈́f¼ÂÍŅ†Û ¾[„‡† Ї¾[ÆɼҊa„‡†7ؼ½7¾uÇȄ‡ÆɼҊaËÌŅ„‡Ø7Â͆/ÙÛ „f¼ŠÒÂ×ï „fŠ¾O¼„fӇ¾[†]¼ÅZÑ$¾äíŅÂÆá¼Ë̋KØ7ÂÍÁ¼ŠÒÂÌш/¼¾[ØdÕ½7ÂÍÆÒ½]„‡ËÍËÌÅWÕRÁ„WÐm„‡ÂÃË̈́fÑË̾OÂ͆ݼ¾ÏŠŠ¾ÉÖ Ë̈́f¼¾[ØSÄ7ŠÂÌҊ"Â͆/ÇÈҊÛ „f¼ÂÌŅ†O¼Å¡Ñ$¾܉ˆ7„‡†Ý¼Â×Þ¾[Ø`„‡†ØSÂ͆ÆÉҊÄ$Ҋ„f¼¾[Ø-ÕÂͼ½-¼½/¾ Ø7„f¼„—â‚ã%½/¾Û Å—Ø/¾[ËÔÄ„fŠÒ„‡Û ¾Ï¼¾ÏŠÁ„fŠ¾¾[Á¼ÂÍÛ „f¼¾[Ø`Ñ݋`ð&ÂÍÑ7ÑÁuÁ„‡Û Ä°ËÍÂ͆/Ù „‡†7Ø Â̼¾ÏŠ„f¼¾[ØSÆÉŅ†7Ø7Â̼ÂÌŅ†„‡ËÛ Å‰Ø/¾[Á„‡ËÌهҊÂ̼½7Û!ÁÏâ

ñÒò¶óWôõô¯öø÷wù‰óWúÝû‡öúáüöý[úÝû ôõöÒþmÿ…öÒ÷
õ÷ÍóWôaôõöù…ô ú÷b÷…óWÿ ×û ‰ö&ýWû…û‡ôõöÒ÷õ÷¯öÒû ¯óaý[ú  ö Àó¶ö ×÷ óWúó Àÿ !ý["ú # öø÷Àý[úá û $fó‡%ü ×ý &$‡ü  öÒúáüöø÷ Ýòs'ý ÍóWôõ ú ×)ý (æúÝ*÷ #õÿ+¯öu'ó -,°öÒ.ü …ú…ó ó /'0  òsý 5ÍóWôõ ú  6ý 7 ‡8û 5"9Ôýl÷¯ýlû‡öúá"ý ‡7ò :ðñÐUÛ&Ó0ÌRÎÇÖ_ÏkЗÑLæ3ß&ډßóò^Ì°çUÕ&Ñ

TV8T]WEPX}

J«

ô×Ú}Ó}Ôâdß&ÓÚ}ØÇЗÓ0Õ·ç
õ_æ"å Õ&ÎåáЗÎaЗØÙÕ&Ó0Õ&Î)ß

Ô NYPQWEXBWd&Q\T]^ENYpQM&Na_]yœjWEV8o `P_gc_n]Vd$SMXŽfQ^EWYXŽNIV€_]ya S_^N2PKUT]^Y_gcXBMuTed$6PuTH\‹QgIXBgcgd°  £ ¬  žž d J+žž8¬ } '}õœjP

v {¡ Hƒ

òöÍUÑLӄÚ}÷RЗÎ&ڄЗÓ0ÕNÖ_ÏkЗÑLæjß&Ú‰ß I

†} rQMmuT]gcg}

Ù«

%



'} 6PuT]^YgcQWlªr^YX aM

#—_Mm_M7dWYQ`_MmQmXŽN2Xc_M„d

Ú#°zd

6_]p\uTHM&V

JžŸ ¤-}

3 %  " v R{ë a # -Ë ÌRÍUÎ"ÏkЗÑøÌÒùÓ\Ô ÕbúKÌRæ—ЗÑzÜÞÓЗӄډß&ӄÚ(۷ЗÑ#Ü#ÌjÛ&Ú(Õ&ÓæSí z}

z}

—XBM-mgBQ'V@T]Mm

‡}

6}

w}

FpXŽN2P„}©RUTV]QW~QWENYXBpTHN2QWOy*_]^ONYPQ®gBXBM-QT]^

p_FmQg}

ldu° « › J   d J+ž8¬ £F}

fûSÕ&ÏkçüЗÑ}Ñß ýñÖ*ç—÷RЗÏzÛ)Õ·çþã#Ô Õ)ÌRÎ"æ`ÌÒÿÜÞÓ(ЗÓډß&ӄÚ(Û)ß
kÌRÑLÍ ØÙÕ—í v  {!   íNЗæüÕ)ß&ڄЗÏëà&ÏBÒBÕ&ΕÕ&ÏzÛ)Õ   
ì  ‡}

zˆ T]n]QM„}

'}

v {¡

]_]PM®âãXcgBQ'V€T]Mm

e_]MW

IM-`]}Žd SQk

)_^Yi§d J+ž]ž]« }

Ö$åüåkÑLÚ(Õ·çóòÿÍ ÑLӄÚ}÷RЗÎ"ڄЗÓ՞Ö_ÏkЗÑLæ3ß&Ú‰ß  #ß&Ú}ÏUèóí*ЗæïÕ)ß&ڄЗÏîЗÏkçóðzΕÕ&ì b 3ƒ   ÍÞÕ&Ï Ó„Ú‰ß&Ó òÕ&Ó}Ô Ì°çRßKÌÒà&ÏBÒBÕ&ΕÕ&ÏzÛ)Õ

‹} -}‹œj^YQWYW}

#¬

'}¢l_hQ^EN } r^YXcQnQ^—œjthgcXBWYP-XBMn

–T]gBT]huT]^d$ gc_^YXcmuT-d

v {¡

J+žŸ £e}

íNЗæüÕ)ß&ڄЗÏÙÜÞÓЗӄډß&ӄÚ(Û)ß Zê-Î"Ú}ÏzÛ&ÚåkщÕ)ß
ñòÌ°çUÕ&Ñß
ЗÏkçbÖ$åüåkÑLÚ(۷ЗÓÚ(ÌRÏáß

‹}-}&œj^YQWYW}

èŸ

'}

Ke_MWdì SQk )_^Yi§d

]_PM€âãXBgcQV[T]Mm

v {¡ èž

J+ž]Ÿž }

ƒ À
-ÌRÏ ÓÎ"Ú°ÍUÓÚ(ÌRÏáßóÓÌöê-ΕÌ)аÚ}ÑLÚ}ӄæîЗÏkç»ÜÞÓЗӄډß&ӄÚ(Û)ß ‹}-}—œj^EQWYWbT]M-m

q} FPXBnQp~THWYt„}‰RUTVQWYXZTHM†XcM-y*Q^EQM`QqXBMxy
T]`'N2_^ T]MT]gcVFWYXcW}

IM

‘Q^EgZT]nd

v  {¡

'd|`PuTH\-N2Q^


ƒ e

e\^EXBMn]Q^o

À

q} ePXcnQpT]WEt„}bRUTVQWEXZT]MwXBMey*Q^YQM`QqXcM–y
T]`'N2_^rTHMuT]gcVFWEXBWo

& _}-£ WYXŽNIV[_]y‚UT]gBXŽy*_^YM-XZT-de¢XŽfQ^YWYXcmQ]d²"

°

¢Q'fFXBWYQm„} Q`PMXc`T]g7¢Q\‹_^N

v {ë

 %

J e}

J+žŸž }

‹} -}„œ‘^EQWEW‰THMm

ÏJ ¤

ÏJJ

6_pa\uT]M8Vd

b



« °-d Q\uTH^EN2paQM8N|_]y FN2THN2XcWENYXB`Wd MXcf]Q^%o

— $

ž £ £ J d –TV

J+žž8¬ }

9M¡QWENYXBpTHN2XcMn†NYPQxpaQT]M¡XcM RUTVQWYXBT]M¡y
T]`NY_^€T]MT]gcVFWYXcW} e_F`XZTHgF`XBQM`QUâ†_^EiFXcMnrœT]\‹Q^ J ¤ ž ed—XcfFXcWYXB_]M‰_]y¶tp~THMXcNYXBQWT]Mm`F_e`XZT]g e`XcQM`QWdsUTHgcN2Q`P„d§œTHW2T]mQMuT-d²" ž-JJ £—ed]tgŽV‚£]¤]¤¤T-}

z}6RS}6¢l_+k6QH}

J



v R{ë ÏJ £


IM-`_^E\‹_^YTHN2XcMn \^YXc_^Oi&M_+klgBQm-nQ–^EQn8T]^EmXBM-n NYPQ®pQT]M¨XcM RUTVQWYXZTHMOy
TH`N2_]^‘T]MuT]gŽVeWEXBW}²e  _e`XZT]g$e`XcQM`QâŒ_^Ei&XBMn œT]\‹Q^ J ¤ ž8¬ d/XcfFXBWEXB_M _]yìtp~THMXcNYXBQWT]M-mOe  _F`XBT]g°e `XcQM`QWdUTHgcN2Q`P„dœT]W2THmQMuTed" ž-JJ £ed]tgcV z}‘R })¢_+k|Q]}

£]¤¤¤Hh„}

v  {ë ÏJ °

"ÒRUTVQWYXZTHMy
T]`'N2_^lT]MT]gcVFWYXcWlp_FmQg‹klXcN2P®nQMQ^YT]gBXc¥Qm‚\^EXB_^ XBM-y*_]^YpTHN2Xc_M„}²e  _F`XBT]gìe`XBQM-`QlâŒ_^Ei&XBMnbœTH\‹Q^ J ¤ žž d7XcfFXcWYXB_]Mq_]yetp~THMXŽo N2XcQW‘T]MmÚe_F`XBT]gìe  `XBQM-`QWdÔUT]gŽN2Q`P„dFœT]WYT]mQMT-d$" ž-JJ £ed/  t-ntWEN6£]¤]¤¤]`]} z}uR }§¢l_+k6QH}

v {ë ÏJ«

+‹}-}Uœj^YQWYW}ܪrXBhhWW2T]pa\gcXBMnŒT]MmãPXBgcgl`gBXcpzhXcMnŒXcM RUTVQWYXZTHM…y
T]`NY_^qT]MuTHgcVFWYXcW}M  Q`PM-XB`THg¢Q\‹_]^EN- _}¦£—ed%Q\T]^ENYpQM&N‡_]y FNT"N2XBWN2Xc`WdSMXŽfQ^YWYXŽNIV‚_]y‚UT]gBXŽy*_^YMXBT-dF¢XŽfQ^YWYXcmQ]d²" ž £—£ J dì  T+V J+žžŸ } z}6RS}U¢l_ k|QwT]Mm

v R{ë $ $ ÏJ

íNЗæüÕ)ß&ڄЗÏ×ðñÐUÛ&Ó0ÌRÎZÖ_ÏkЗÑLæjß&Ú‰ß Ô

z} w} eP-Q^2Te}

ì

'}œjP

QT]gŽN2P„duR|_WENY_M„d²Ò¤8£

WYXŽNIVd e`P-_e_g—_Hy¦œjthgcXB`

J



Ô

{MXcf]Q^%o

NYPQWEXBWd T]^fHT]^Ym

 ì

J]J ed –TH^Y`P–£]¤¤¤-}