An Examination of Tunable, Random Search Landscapes - CiteSeerX

Report 0 Downloads 29 Views
$Q([DPLQDWLRQRI7XQDEOH5DQGRP6HDUFK/DQGVFDSHV

R. E. Smith 'HSDUWPHQWRI $HURVSDFH(QJLQHHULQJ DQG0HFKDQLFV 7KH8QLYHUVLW\RI$ODEDPD 7XVFDORRVD$ODEDPD UVPLWK#LFVXZHDFXN



-(6PLWK 7KH,QWHOOLJHQW&RPSXWLQJ 6\VWHPV&HQWHU 7KH8QLYHUVLW\RI 7KH:HVWRI(QJODQG %ULVWRO%64< MLP#LFVXZHDFXN

 Abstract This paper carefully considers random landscapes related to Kauffman’s NK model. In particular, it considers a superset of this model (the NKP model) recently suggested in the GA-analytic literature. Landscapes are exhaustively examined for both the distribution of local optima relative to the global optima, and for characteristics that would effect juxtapositional (building block based) search. The later is accomplished through a Walsh-based analysis. The results indicate that K and P have distinct effects on peak distribution, K controlling peak placement, and P affecting relative peak height. The results indicate that P has little effect on a landscape’s expected juxtapositional complexity. Moreover, the results suggest that landscapes developed by the NKP procedure are unlikely to have substantial juxtapositional complexity. A Walsh-based procedure that embodies the flavor of the NKP procedure, but can allow for greater expected juxtapositional complexity, is suggested. ,QWURGXFWLRQ

,Q H[DPLQLQJ HYROXWLRQDU\ FRPSXWDWLRQ (&  V\VWHPV LW LV XVHIXO WR FRQVLGHU WKH QDWXUHRIWKHVHDUFKSUREOHPVWRZKLFKWKH\DUHDSSOLHG$JUHDWGHDORIWKHJHQHWLF DOJRULWKP *$  OLWHUDWXUH LV GLUHFWHG DWW KLV H[DPLQDWLRQ &DUHIXO FRQVLGHUDWLRQR I

VHDUFK SUREOHPV RU VHDUFKODQGVFDSHV DV WKH\ DUH RIWHQ FDOOHG  DOVRK DV XVHV LQ GHVFULSWLYH VFLHQFH )RU LQVWDQFH FRQVLGHU .DXIIPDQ©V H[DPLQDWLRQR I UDQGRP ODQGVFDSHV ZLWK WXQDEOH OHYHOV RIHSLVWDVLV DV DQ H[SODQDWLRQR I FRPSOH[LW\ LQ ELRORJLFDOV\VWHPV .DXIIPDQ 6LQFHHSLVWDVLVLVDSKHQRPHQRQWKDWLVHDVLO\ UHODWHG WR WKH *$ VHDUFK SURFHVV .DXIIPDQ©V 1. ODQGVFDSHV DUH UHFHLYLQJ LQFUHDVLQJXVHDVWHVWSUREOHPVIRU*$V 7KLV SDSHU H[DPLQHV 1. ODQGVFDSHV DQG WKHLU H[WHQVLRQV  DV (& WHVW SUREOHPV 0RUHRYHU LW IRUPV UHODWLRQVKLSV EHWZHHQ .DXIIPDQEDVHG DQG :DOVKEDVHG GHFHSWLRQEDVHG ODQGVFDSHDQDO\VLVDQGGHVLJQ)LQDOO\LWVXJJHVWVQHZPHWKRGV IRUWHVWODQGVFDSHGHVLJQDQGIRUXQGHUVWDQGLQJRIUHDOZRUOGVHDUFKODQGVFDSHV 

$GYDQWDJHVRI1./DQGVFDSHV

7KHUHDUHWZRPDLQDGYDQWDJHVWRXVLQJ1.ODQGVFDSHVDV(&WHVWSUREOHPV

x The landscapes have two tunable parameters, (N and K) that can be used to control characteristics (e.g., landscape size and epistasis, respectively) of landscapes. x For given values of N and K, one can generate a large number of landscapes, at random. 7KHVHDGYDQWDJHVDOORZRQHWRHDVLO\JHQHUDWHDODUJHQXPEHURI(&WHVWSUREOHPV DQG H[DPLQH (& SHUIRUPDQFH YHUVXV WKH SDUDPHWHUV 1 DQG . +RZHYHU WKH PHDQLQJIXOQHVV RI VXFK H[DPLQDWLRQV GHSHQGV RQ WKH UHODWLRQVKLSE HWZHHQ WKHVH SDUDPHWHUVDQGWKHGLIILFXOW\RIWKHODQGVFDSHVIRUVHDUFKLQJHQHUDODQG(&VHDUFK LQ SDUWLFXODU .DXIIPDQ©V ZRUN SURYLGHVV RPH LQGLFDWLRQR I WKH UHODWLRQVKLS EHWZHHQ WKH SDUDPHWHUV DQG FHUWDLQ DVSHFWV RI ODQGVFDSHF RPSOH[LW\ 7KLV FRPSOH[LW\PD\ RUPD\QRW LQGLFDWHVHDUFKGLIILFXOW\ 7KHF RPSOHWH UHODWLRQVKLSE HWZHHQ WKH 1. SDUDPHWHUV DQG WKH GLIILFXOW\ RI WKH VHDUFK ODQGVFDSHV WKH\ LQGXFH LV QRW HQWLUHO\ FOHDU IRU VHYHUDO UHDVRQV )LUVW .DXIIPDQ©V GHVFULSWLRQV DUH SULPDULO\ FRQFHUQHG ZLWK WKH UHODWLRQVKLSE HWZHHQ HSLVWDVLV DQG FRPSOH[LW\ IRU SXUSRVHV RI XQGHUVWDQGLQJE LRORJLFDO V\VWHPV UDWKHU WKDQ XQGHUVWDQGLQJJ HQHUDOL]HG VHDUFK SUREOHPV 6HFRQG .DXIIPDQ GRHV QRW H[KDXVWLYHO\ H[DPLQHD Q\ ODQGVFDSHV IRU WKH UHODWLRQVKLSE HWZHHQ SDUDPHWHUV DQG JHQHUDO SURSHUWLHV ,QVWHDG KH RQO\ FRQVLGHUV WKH UHVXOWV RI UDQGRPO\ UHVWDUWHG KLOOFOLPELQJ RQ WKHVH ODQGVFDSHV 7KLUG .DXIIPDQRQ O\ FRQVLGHUV DVSHFWV RI WKH ODQGVFDSHV WKDW SHUWDLQ WRK LOOFOLPELQJ VHDUFK ,Q WKLV SDSHU WKHVH ZLOO EHFD OOHG SHDN GLVWULEXWLRQ FKDUDFWHULVWLFV .DXIIPDQ GRHV QRW FRQVLGHU DVSHFWV RI WKH ODQGVFDSHV WKDW SHUWDLQ WR MX[WDSRVLWLRQDO VHDUFKR SHUDWRUV OLNHF URVVRYHU ,Q WKLV SDSHUWKHVHZLOOEHFDOOHGMX[WDSRVLWLRQDOFKDUDFWHULVWLFV

0RUHRYHU LW KDV EHHQ UHFHQWO\ VKRZQ WKDWW KH 1. ODQGVFDSHV RQO\ FRYHU D VPDOO UHJLRQR I WKH VSDFH RI SUREOHPV ZLWK VL]H 1 DQG HSLVWDVLV . +HFNHQGRUQ DQG :KLWOH\   GHPRQVWUDWH WKLV IDFW E\ H[DPLQLQJ OLPLWDWLRQV RQ WKH QXPEHU RI QRQ]HUR :DOVK FRHIILFLHQWV LQGXFHGE \ WKH 1. ODQGVFDSH JHQHUDWLRQ SURFHVV +HFNHQGRUQ DQG :KLWOH\©V ZRUN DORQJ ZLWK HDUOLHU ZRUN E\ $OWHQEHUJ    VXJJHVWV D EURDGHU FODVV RI UDQGRP ODQGVFDSHV WKDW FRYHU WKHF RPSOHWH VSDFH RI VL]H 1 SUREOHPV ZLWK HSLVWDVLV . WKURXJK WKH LQWURGXFWLRQR I DQRWKHU SDUDPHWHU3:HZLOOFDOOWKHVH1.3ODQGVFDSHV

7KLVSDSHUSURYLGHVDQH[WHQVLYHDQDO\VLVRI1.3ODQGVFDSHV7KH1.ODQGVFDSHV DUHD VXEVHWRIWKH1.3 ODQGVFDSHV DQG WKHUHIRUH WKLV LPSOLHV D PRUHH [WHQVLYH DQDO\VLVRI1.ODQGVFDSHVDVZHOO7KHSDSHUDWWHPSWVWRDQVZHUVHYHUDOTXHVWLRQV x Does the P parameter change the complexity characteristics of the NK landscapes examined by Kauffman? If so, how? x Does an exhaustive examination of several NKP landscapes yield complexity characteristics that agree with those reported by Kauffman? x How does the difficulty of NKP landscapes for juxtapositional operators vary with N, K, and P (e.g., how are N, K, and P related to deception and other GAanalytic measures of difficulty)? 7KHSUDFWLFDOLPSOLFDWLRQVRIWKHVHH[DPLQDWLRQVDUHWZRIROG

x They provide greater understanding of the expected difficulty of EC test problems generated via the NKP (and therefore, the NK) landscape procedure. x They suggest possible alternative methods for generating random landscapes with tunable difficulty for use as EC test problems. 0RUHRYHU WKHVHH [DPLQDWLRQV PD\ SURYLGH IXUWKHU LQVLJKW LQWR WKH QDWXUH RI WKH VHDUFKSUREOHPVLQGXFHGE\UHDOZRUOGSUREOHPV

7KHUHPDLQGHURIWKLVSDSHUEHJLQVZLWKDQLQWURGXFWLRQWRWKH1.ODQGVFDSHVWKHQ LQWURGXFHV DQ DQDORJRXVV HW RI 1.3 ODQGVFDSHV DQG ODQGVFDSHV EDVHG RQ :DOVK IXQFWLRQV 7KLV DOVR DOORZV IRU LQWURGXFWLRQR I WKH 1.3 ODQGVFDSHF RQFHSWV SUHVHQWHGE \ +HFNHQGRUQ DQG :KLWOH\ *LYHQ WKLV LQWURGXFWLRQ D GHWDLOHG H[DPLQDWLRQRIWKHSHDNGLVWULEXWLRQFKDUDFWHULVWLFVRI1.3ODQGVFDSHVLVSUHVHQWHG 7KLV LV IROORZHGE \ D :DOVK DQDO\VLV SHUVSHFWLYH RQ WKH MX[WDSRVLWLRQDO FKDUDFWHULVWLFV RI 1.3 ODQGVFDSHV )LQDO FRPPHQWV LQFOXGH VXJJHVWLRQV IRU DOWHUQDWLYHPHWKRGVRIJHQHUDWLQJUDQGRPWXQDEOHODQGVFDSHV 

.DXIIPDQ©V1./DQGVFDSHV

,QWKLVGLVFXVVLRQZHZLOODVVXPHDOOJHQHVDUHELQDU\IRUFRQYHQLHQFH+RZHYHU WKHUHVXOWVDUHH[WHQVLEOHWRSUREOHPVZLWKODUJHUJHQHDOSKDEHWV

6SHFLI\LQJDQ1.ODQGVFDSHUHTXLUHVWKHIROORZLQJSDUDPHWHUV 1WKHWRWDOQXPEHURIELWV JHQHV 

.WKHDPRXQWRIHSLVWDVLV(DFKELWGHSHQGVRQ.RWKHUELWVWRGHWHUPLQHWKDWLWV ILWQHVV FRQWULEXWLRQ :H ZLOO FDOO WKH .E LWV LQYROYHG LQ HDFK FRQWULEXWLRQ D VXEIXQFWLRQ EL 1 SRVVLEO\UDQGRP ELWPDVNV L ž1 (DFKELWPDVNLVRIOHQJWK1DQG FRQWDLQV . RQHV 7KH V LQ D ELWPDVN LQGLFDWH WKH ELWV LQ DQ LQGLYLGXDO WKDW DUH XVHGWRGHWHUPLQHWKHYDOXHRIWKHLWKVXEIXQFWLRQ *LYHQWKHVHSDUDPHWHUVRQHFDQFRQVWUXFWDUDQGRP1.ODQGVFDSHVDVIROORZV $ &RQVWUXFWDQ1E\. WDEOH;

% )LOO;ZLWKUDQGRPQXPEHUVW\SLFDOO\IURPDVWDQGDUGXQLIRUPGLVWULEXWLRQ

*LYHQWKHWDEOH;DQGWKHELWPDVNVRQHGHWHUPLQHVWKHILWQHVVRIDQLQGLYLGXDODV IROORZV $ )RUHDFKELWPDVNEL VHOHFW RXWW KH VXEVWULQJ RI WKH LQGLYLGXDO WKDW FRUUHVSRQG ZLWKWKH.RQHYDOXHGELWVLQWKDWELWPDVN % 'HFRGHWKHVHELWVLQWRWKHLUGHFLPDOLQWHJHUHTXLYDOHQWM

& $GGWKHHQWU\$ LM WRWKHRYHUDOOILWQHVVIXQFWLRQYDOXHIRUWKLVLQGLYLGXDO 1RWHWKDWWKHILWQHVVYDOXHVDUHQRUPDOL]HGE\GLYLGLQJE\1

$ W\SLFDO VHW RI ELWPDVNV IRU WKLV W\SH RI SUREOHP FRQVLVWV RI DOO 1 ELWPDVNV WKDW KDYH.FRQVHFXWLYHRQHV,QWKLVFDVHWKHVWULQJLVWUHDWHGDVDFLUFOHVRWKDWWKH FRQVHFXWLYHELWVZUDSDURXQG7KLVVHWRIELWPDVNVRXWOLQHVDIXQFWLRQZKHUHDQ\ JLYHQELWGHSHQGV RQ WKH . SUHFHGLQJE LWV WR GHWHUPLQH LWV FRQWULEXWLRQ WR ILWQHVV +RZHYHUELWPDVNVDUHVRPHWLPHVXVHGVXFKWKDWEL KDVWKHLWK ELW VHWW R RQH EXW WKH UHPDLQLQJ . RQHYDOXHGE LWV DUH VHOHFWHG DW UDQGRP 6RPH RWKHU SRVVLELOLWLHV DUHGLVFXVVHGLQ$OWHQEHUJ   

1.3/DQGVFDSHV

$OWHQEHUJ  DQGODWHU+HFNHQGRUQDQG:KLWOH\  DOOXGHWRDVHW RIODQGVFDSHVWKDWZHZLOOFDOOWKH1.3ODQGVFDSHV,IRQHXVHV DQ DQDORJ\ WR WKH 1.ODQGVFDSHVVSHFLI\LQJDQ1.3ODQGVFDSHUHTXLUHVWKHVDPHSDUDPHWHUVDVWKH 1.ODQGVFDSHVZLWKRQHDGGLWLRQ

3  WKH QXPEHU RI VXEIXQFWLRQV HDFK DVVXPHG WR EH RI HSLVWDVLV . IRU WKLV GLVFXVVLRQ  WKDW FRQWULEXWH WR WKH RYHUDOO ILWQHVV IXQFWLRQ 7KLV GLVFXVVLRQ DOVR DVVXPHVWKDWWKH3VXEIXQFWLRQVDUH VLPSO\ VXPPHG WR GHWHUPLQH RYHUDOO ILWQHVV

(DFK VXEIXQFWLRQ LV DVVRFLDWHG ZLWK D ELWPDVN DOVR FDOOHG DSDUWLWLRQ  EL 1RWH WKDWIRUFRYHUDJHRIWKHVSDFHRIDOO.HSLVWDWLFIXQFWLRQV § 1 · ¸¸   d 3 d ¨¨ © .   ¹

0RUHRYHU WKLV PHDQV WKDW RQH PXVW VSHFLI\ 3 ELWPDVNV UDWKHU WKDQRQ O\ 1 7KLV PHDQVWKDWWDEOH; PXVWEHH[WHQGHGWREH3E\.2WKHUZLVHWKHFRQVWUXFWLRQ DQGGHFRGLQJSURFHGXUHLVWKHVDPHDVWKDWIRU1.ODQGVFDSHV 

:DOVKEDVHG(SLVWDWLF/DQGVFDSHV

$VHWRIIXQFWLRQVVLPLODUWRWKH1.3ODQGVFDSHVFDQ EHF RQVWUXFWHGX VLQJ :DOVK FRHIILFLHQWV 7KLV LV FRQYHQLHQW VLQFH :DOVK FRHIILFLHQWV KDYH RIWHQ EHHQ XVHG LQ *$ DQDO\VLV 0RUHRYHU LW ZLOO KHOS WR LOOXVWUDWH +HFNHQGRUQ DQG :KLWOH\©V FRQFOXVLRQV+RZHYHURQHPXVWPDNHQRWHRIZKDWLVPHDQWE\HSLVWDVLVLQ:DOVK EDVHGODQGVFDSHV6RPHWHUPLQRORJ\ZLOOEHXVHIXOKHUH &RQVLGHUDVHDUFKVSDFHGHILQHGRYHUOHQJWK/ELQDU\VWULQJV,QWHUPVRIWKH:DOVK FRHIILFLHQWVGHILQHWKHILWQHVVRIDQLQGLYLGXDODV HSLA (Blue)

SSLA (Blue)

200

200

150

150

100

100

50

50

0

0

10

20

30

0

B2BH (Blue)

100 50

0

HSLA (Red)

10

20

30

0

0

SSLA (Red)

150

150

100

100

DEF (Blue)

150

10

20

30

OFF (Blue)

200

200

150

150

100

100

50

50

0

0

B2BH (Red)

10

20

30

0

0

DEF (Red)

10

20

30

OFF (Red)

200

200

200

150

150

150

100

100

100

ZKHUH[ LVWKHELWVWULQJUHSUHVHQWLQJWKHLQGLYLGXDO[L LVWKHLWKELWLQWKDWVWULQJZM LVWKH:DOVK FRHIILFLHQW FRUUHVSRQGLQJ WR WKHSDUWLWLRQ ELWPDVN  QXPEHUHGM- LV WKHELWPDVN ZKLFKLVWKH1ELWELQDU\LQWHJHUUHSUHVHQWDWLRQRIM -L LVWKHLWKELWLQ WKHELWPDVNDQG< LVWKHIXQFWLRQGHVFULEHLQ7DEOH 50

0

50

0

10

20

30

0

50

0

10

20

30

0

50

0

10

20

30

0

50

0

10

20

30

0

0

10

20

30

[L

0 0 1 1

-L

   

< [L  - L

   

7DEOH:DOVK7UDQVIRUP)XQFWLRQ