Ивахненко А.Г. и др. Самоорганизующие нейронные сети с Активными нейронами

Подождите немного. Документ загружается.

6HOIRUJDQL]DWLRQRI1HXUDO1HWZRUNVZLWK$FWLYH1HXURQV

3XEOLVKHGLQ3DWWHUQ5HFRJQLWLRQDQG,PDJH$QDO\VLVYQRSS

$*,YDNKQHQNR



*$,YDNKQHQNR



DQG-$0OOHU





*OXVKNRY,QVWLWXWHRI&\EHUQHWLFV1DWLRQDO$FDGHP\RI6FLHQFHV.LHY8NUDLQD



+RFKVFXOHIU7HFKLNXQG:LUWVFKDIW'UHVGHQ*HUPDQ\

$EVWUDFW

7KHSDSHUGLVFXVVHVQHXUDOQHWZRUNVLQWHQGHGWRKDQGOHWKHWDVNVRIUHODWLRQ

DSSUR[LPDWLRQ LGHQWLILFDWLRQ DQG UDQGRP SURFHVV H[WUDSRODWLRQ IRUHFDVWLQJ 7KHLU

VDOLHQWIHDWXUHLVWKDWWKHLUHQVHPEOHVRIHOHPHQWVDUHVSHFLILHGDSULRULDVSHUFHSWURQV

RU SHUFHSWURQOLNH *0'+ DOJRULWKPV EULHIO\ RXWOLQHG KHUHLQ &RPSOH[ QHXURQ

HQVHPEOHVPD\ EH FDOOHG DFWLYH QHXURQV LQ FRQWUDVW WR VLPSOH ELQDU\ QHXURQV ,Q WKH

FRXUVH RI OHDUQLQJ RU VHOIRUJDQL]DWLRQ DFWLYH QHXURQV VHOHFW WKHLU LQSXW VWLPXOL

DFFRUGLQJWRDVSHFLILHGFULWHULRQDQGGHWHUPLQHZHLJKWFRHIILFLHQWVIRUFRQQHFWLRQV,Q

WKLVZD\WKH\RUJDQL]HWKHVWUXFWXUHRIWKHHQWLUHQHXUDOQHWZRUN7KHREMHFWLYHVRXJKW

LQFRQVWUXFWLQJDQHXUDOQHWZRUNLVWRHQKDQFHWKHHIILFLHQF\LQKDQGOLQJWKHWDVNVHWIRU

HDFKQHXURQ7KHQXPEHURIDFWLYHQHXURQVLVGHWHUPLQHGE\WKHDPRXQWRILQIRUPDWLRQ

FRPLQJLQIRUSURFHVVLQJDVDVDPSOHRIREVHUYDWLRQVRYHUDWHVWRUFRQWUROOHGREMHFW,Q

HDFKOD\HURI D QHXUDOQHWZRUN WKH DFWLYH QHXURQVGLIIHU IURP RQH DQRWKHU LQVHWV RI

LQSXWDQGRXWSXWYDULDEOHV7KHPRUHLPSRUWDQWGLIIHUHQFHEHWZHHQDFWLYHQHXURQVOLHV

LQWKHVWUXFWXUHRIWKHLUDOJRULWKPVZKLFKLQIDFWUXQWVDQDFWLYHQHXURQQHXUDOQHWZRUN

LQWRDPXOWLOD\HUHGGHFLVLRQFROOHFWLYHUXOH>,@

,QWURGXFWLRQ

$FFRUGLQJ WR SK\VLRORJLVWVFRQQHFWLRQVEHWZHHQ QHXURQVLQWKH EUDLQDUH QRW SHUPDQHQW 7KH\

IRUP DQG EUHDN XS LQ UHVSRQVH WR H[WHUQDO VWLPXOL DQG WKLV KDSSHQV DW DQ HVSHFLDOO\ KLJK UDWH

GXULQJWKHILUVWGD\VDIWHUWKHELUWKRIWKHRUJDQLVP6XSSRVHGO\WKLVSURFHVVGHSHQGVVROHO\RQ

WKH DGDSWDELOLW\ RI D QHXURQ LWVHOI WR H[WHUQDO VWLPXOL $ IXQGDPHQWDO IDFW LV WKDWHYHU\ QHXURQ

VHOHFWVLWVLQSXWFRQQHFWLRQVDOOE\ LWVHOIDFFRUGLQJ WRDVSHFLILHGFULWHULRQWKHFRQQHFWLRQV DUH

QRWLPSRVHGRQLWE\WKHHQYLURQPHQW7KHHQYLURQPHQWRQO\VHWVOLPLWVIRUWKHFKRLFHRIVWLPXOL

DFFRUGLQJWRWKHFULWHULRQGHILQHGIRUQHXURQV1HXURQVIRUZKLFKFRQQHFWLRQVDUHDVVLJQHGIURP

ZLWKRXW E\ WKH SHUVRQ LQ FKDUJH RI PRGHOLQJ RU E\ RWKHU QHXURQV VKRXOG EH FDOOHG

SDVVLYH

QHXURQV

 ,Q FRQWUDVW QHXURQV WKDW VHOHFW WKHLU LQSXW YDULDEOHV WKURXJK OHDUQLQJ RU VHOI

RUJDQL]DWLRQPD\EHFDOOHG

DFWLYHQHXURQV

7KHFRQQHFWLRQVVHOHFWHGE\DFWLYHQHXURQVXQLTXHO\

GHILQH WKH VWUXFWXUH RI FRQQHFWLRQV IRU WKH HQWLUH QHXUDO QHWZRUN 6R IDU QRZ QHXUDO QHWZRUNV

KDYHEHHQPDLQO\GHYHORSHGIRUSDVVLYHQHXURQVVXFKDVWKHVLPSOHQHXURQVRI0F&XOORFKDQG

3LWWVZLWKVSHFLILHGELQDU\LQSXWYDULDEOHV>@

7KHDLPRIWKLVSDSHULVWRH[WHQGWKHWKHRU\RIVHOIRUJDQL]DWLRQIRULVRODWHGPRGHOV>@WR

DFWLYHQHXURQ QHWZRUNV QHXURQV ,Q IDFW WKHUH LV D JRRG GHDO RI VLPLODULW\ EHWZHHQ WKH VHOI

RUJDQL]DWLRQRIPRGHOVDQGWKHVHOIRUJDQL]DWLRQRIQHXUDOQHWZRUNV7KHNH\SURFHGXUHVRIVHOI

RUJDQL]DWLRQIRUPRGHOVVXFKDVWKHVHOHFWLRQRIOD\HUQXPEHUE\H[KDXVWLYHVHDUFKDFFRUGLQJWR



DQ H[WHUQDO FULWHULRQ RSWLPL]DWLRQ RI VHWV RI LQSXW DQGRXWSXW YDULDEOHV DQG H[KDXVWLYHVHDUFK

WHUPLQDWLRQ UXOHV DUH YDOLG IRU WKH VHOIRUJDQL]DWLRQ RI ERWK DQ LVRODWHG PRGHO DQG D QHXUDO

QHWZRUN

7KH REMHFWLYH VRXJKW LQ FRPELQLQJ DFWLYH QHXURQV LQWR D QHXUDO QHWZRUN LV WR HQKDQFH WKH

DFFXUDF\LQDFKLHYLQJWKHWDVNIDFLQJERWKHYHU\QHXURQDQGWKHHQWLUHQHXUDOQHWZRUN1HXURQV

ILQGWKHPVHOYHVLQGLIIHUHQWFRQGLWLRQV7KH\PD\GLIIHULQERWKRXWSXWYDULDEOHVDQGLQWKHVHWRI

LQSXW YDULDEOHV ,Q WKH H[DPSOH WKDW IROORZV D QHXUDO QHWZRUN LV XVHG WR IRUHFDVW UDQGRP

SURFHVVHVLQDFRPSOH[HFRQRPLFREMHFWZLWKIX]]\FKDUDFWHULVWLFV

7KHVSHFWUXPRI*0'+DOJRULWKPVXVHGDVDFWLYHQHXURQV

7KH*0'+DOJRULWKPVPDLQO\GLIIHULQKRZWKHFDQGLGDWHPRGHOVWREHWHVWHGE\DQH[KDXVWLYH

VHDUFKIRUFRPSOLDQFHZLWKDQH[WHUQDOFULWHULRQDUHJHQHUDWHG7KHFULWHULDXVHGPRVWRIWHQDUHRI

WKHSUHFLVLRQGLIIHUHQWLDORULQIRUPDWLYHW\SH

7KHSULQFLSDO*0'+DOJRULWKPVOLVWHGLQ7DEOHKDYHEHHQGHYHORSHGIRUFRQWLQXRXVYDULDEOHV

$PRQJ WKH SDUDPHWULF DOJRULWKPV ZLWK WKH PRGHO FRHIILFLHQWV HYDOXDWHG DFFRUGLQJ WR WKH

FULWHULRQ PLQLPXP WKRVH PRVW NQRZQ DUH WKH

&RPELQDWRULDO DOJRULWKP

>@ WKH

0XOWLOD\HUHG

,WHUDWLYH DOJRULWKP

>@DQGWKH

2EMHFWLYH6\VWHPV$QDO\VLVDOJRULWKP

>@7KHEDVLFRQHLVWKH

&RPELQDWRULDODOJRULWKPZKLFKDSSOLHVDQH[KDXVWLYHVHDUFKWRDOOSRO\QRPLDOPRGHOVWKDWFDQ

EHGHULYHGIURPDFRPSOHWHOLQHDUSRO\QRPLDOE\ HOLPLQDWLQJVRPHRILWVWHUPV,QVRPHFDVHV

WKH 0XOWLOD\HUHG DOJRULWKP PD\ PLVV VRPH PRGHOV WKXV JLYLQJ ULVH WR ZKDW LV NQRZQ DV

PXOWLOD\HUHUURU)RUH[DPSOHLWPD\RFFXUZKHQWKHWUXHUHODWLRQFRQWDLQVWHUPVWKDWFDQQRWEH

IRUPHGZLWKSDUWLDOOLQHDUGHVFULSWLRQV

7KRVHOHVVNQRZQDUHWKHSDUDPHWULFDOJRULWKPVZKLFKDSSO\ DQH[KDXVWLYHVHDUFKWRKDUPRQLF

DQGKDUPRQLFH[SRQHQWLDOIXQFWLRQVDQGWKH

0XOWLSOLFDWLYH$GGLWLYH

*0'+DOJRULWKPLQZKLFK

WKH SRO\QRPLDO PRGHOV WR EH WHVWHG E\ H[KDXVWLRQ DUH REWDLQHG E\ WDNLQJ WKH ORJDULWKP RI WKH

SURGXFWRILQSXWYDULDEOHV>@

*0'+DOJRULWKPV

9DULDEOHV 3DUDPHWULF 1RQSDUDPHWU LF

&RPELQDWRULDO&20%, 2EMHFWLYH&RPSXWHU

0XOWLOD\HUHG,WHUDWLRQDO0,$ &OXVWHUL]DWLRQ2&&

&RQWLQXRXV 2EMHFWLYH6\VWHP$QDO\VLV26$ 3RLQWLQJ)LQJHU3)

+DUPRQLFDO FOXVWHUL]DWLRQDOJRULWKP

7ZROHYHO$5,0$' $QDORJXHV&RPSOH[LQJ$&

0XOWLSOLFDWLYH$GGLWLYH

'LVFUHWHDQG

ELQDU\

+DUPRQLFDO5HGLVFUHWL]DWLRQ $OJRULWKPRQWKHEDVHRQ

0XOWLOD\HUHG7KHRU\RI6WDWLVWLFDO

'HFLVLRQV076'

7DEOH6SHFWUXPRI*0'+DOJRULWKPV



7KHSDUDPHWULF*0'+DOJRULWKPVKDYHSURYHGKLJKO\HIILFLHQWLQFDVHVZKHUHRQHLVWRPRGHO

REMHFWV ZLWK QRQIX]]\ FKDUDFWHULVWLFV VXFK DV HQJLQHHULQJ REMHFWV ,Q FDVHV ZKHUH PRGHOLQJ

LQYROYHVREMHFWVZLWKIX]]\FKDUDFWHULVWLFVLWLVPRUHHIILFLHQWWRXVHWKHQRQSDUDPHWULF*0'+

DOJRULWKPVLQZKLFKSRO\QRPLDOPRGHOVDUHUHSODFHGE\DGDWDVDPSOHGLYLGHGLQWRLQWHUYDOVRU

FOXVWHUV 7KH\ DUHH[HPSOLILHGE\ WKH

2EMHFWLYH&RPSXWHU&OXVWHUL]DWLRQ

2&& DOJRULWKPWKDW

RSHUDWHVZLWKSDLUVRIFORVHO\VSDFHGVDPSOHSRLQWVFDOOHGGLSROHV>@LPSOHPHQWHGE\UHVWLQJ

WZRKLHUDUFKLFDOFOXVWHULQJWUHHVIRUFRPSOLDQFHZLWKWKHEDODQFHFULWHULRQ>@DQGWKH

$QDORJ

&RPSOH[LQJDOJRULWKP

>@7KHQRQSDUDPHWULFFODVVDOVRLQFOXGHVWKH*0'+DOJRULWKPEDVHG

RQWKH

6WDWLVWLFDO'HFLVLRQ7KHRU\

>@,WLVUHFRPPHQGHGLQFDVHVZKHUHRQHLVWRWHVWWKHWUXWK

RIWKHLQSXWGDWDVDPSOHDQGWRUHPRYHIURPLWWKHHUURUFDXVHGE\WKHVDPSOHGHILQLQJH[SHUW

$VDOUHDG\QRWHG*0'+DOJRULWKPVKDYHEHHQGHYHORSHGIRUFRQWLQXRXVYDULDEOHV,QSUDFWLFH

KRZHYHU WKH VDPSOH ZLOO RIWHQ LQFOXGH YDULDEOHV GLVFUHWL]HG LQWR D VPDOO QXPEHU RI OHYHOV RU

HYHQELQDU\YDOXHV7RH[WHQG*0'+DOJRULWKPVWRGLVFUHWL]HGRUELQDU\YDULDEOHVWKHKDUPRQLF

GHGLVFUHWL]DWLRQDOJRULWKPKDVEHHQGHYHORSHG>@

7KHH[LVWHQFHRIDEURDGJDPXWRI*0'+DOJRULWKPVLVWUDFHDEOHWRWKHIDFWWKDWLWLVLPSRVVLEOH

WRGHILQHWKHFKDUDFWHULVWLFVRIWKHUHVWRUFRQWUROOHGREMHFWVH[DFWO\LQDGYDQFH,QGHHGRQHW\SH

RIREMHFWVPD\UHTXLUHRQHDOJRULWKPDQGDQRWKHUW\SHDGLIIHUHQWDOJRULWKP7KHUHIRUHLWZLOOEH

JRRGSUDFWLFHWRWU\VHYHUDO*0'+DOJRULWKPVRQHDIWHUDQRWKHUDQGWRGHFLGHZKLFKRQHVXLWVD

JLYHQW\SHRIREMHFWVEHVW7KHORZHUWKHPLQLPXPRIWKHGLVFULPLQDWLQJFULWHULRQWKHEHWWHUWKH

UHVWHGDOJRULWKP,QWKLVZD\WKHW\SHRIDOJRULWKPLVFKRVHQREMHFWLYHO\DFFRUGLQJWRWKHYDOXH

RIWKHUHVWFULWHULRQ

7KH&RPELQDWRULDO*0'+DOJRULWKP&20%,

7KHIORZFKDUWRIWKHDOJRULWKPLVVKRZQLQ)LJ7KHLQSXWGDWDVDPSOHLVDPDWUL[FRQWDLQLQJ1

OHYHOVSRLQWVRIREVHUYDWLRQVRYHUDVHWRI0YDULDEOHV7KHVDPSOHLVGLYLGHGLQWRWZRSDUWV

7ZRWKLUGV RI SRLQWV KDYLQJ D KLJK YDULDQFH PDNH XS WKH OHDUQLQJ VXEVDPSOH 1

 DQG WKH

UHPDLQLQJ RQHWKLUG RI SRLQWV IRUP WKH FKHFN VXEVDPSOH 1

 7KH OHDUQLQJ VDPSOH LV XVHG WR

GHULYH HVWLPDWHV IRU WKH FRHIILFLHQWV RI WKH SRO\QRPLDO DQG WKH FKHFN VXEVDPSOH LV XVHG WR

FKRRVHWKHVWUXFWXUHRI WKH RSWLPDOPRGHO WKDW LVRQH IRU ZKLFK WKH UHJXODULW\ FULWHULRQ

$5V

WDNHVRQDPLQLPDOYDOXH

 









PLQ









RUEHWWHUWRXVHWKHFURVVYDOLGDWLRQFULWHULRQ

355V

LWWDNHLQWRDFFRXQWDOOLQIRUPDWLRQLQGDWD

VDPSOHDQGLWFDQEHFRPSXWHGZLWKRXWUHFDOFXODWLQJRIV\VWHPIRUHDFKFKHFNLQJSRLQW

35 5









PLQ



















/     0







;



N 

N 

/HDUQLQJVXEVDPSOH

N

&KHFNLQJ

VXEVDPSOH

< < D



D



[

) PRGHOV

L M

< < D



D



[

L

D



[



PLQ

2XWSXW

PRGHO

L M S

< < D



D



[

L

D



[

D



[

 

L M O

< < D



D



[

L

D



[

D

[

   

)LJ&RPELQDWRULDO*0'+DOJRULWKP

GDWDVDPSOLQJ

OD\HUVRISDUWLDOGHVFULSWLRQVFRPSOH[LQJ

IRUPRISDUWLDOGHVFULSWLRQV

FKRLFHRIRSWLPDOPRGHOV

DGGLWLRQDOPRGHOGHILQLWLRQE\GLVFULPLQDWLQJFULWHULRQ



7RREWDLQDVPRRWKH[KDXVWLYHVHDUFKFXUYH)LJZKLFKZRXOGSHUPLWRQHWRIRUPXODWHWKH

H[KDXVWLYHVHDUFK WHUPLQDWLRQ UXOH WKH H[KDXVWLYH VHDUFK LV SHUIRUPHG RQ PRGHOV FODVVHG LQWR

JURXSVRIDQHTXDOFRPSOH[LW\7KHILUVWOD\HUXVHVWKHLQIRUPDWLRQFRQWDLQHGLQHYHU\FROXPQRI

WKHVDPSOHWKDWLVWKHVHDUFKLVDSSOLHGWRPRGHOVRIWKHIRUP

[









 



 

7KHRXWSXWYDULDEOHPXVWEHVSHFLILHGLQDGYDQFHE\ WKHH[SHULPHQWHU2QO\ DVPDOOQXPEHURI

YDULDEOHVXVXDOO\) VKRZLQJWKHEHVWUHVXOWVLQWKHILUVWOD\HUDUHDOORZHGWRIRUPVHFRQG

OD\HUFDQGLGDWHPRGHOVRIWKHIRUP

[











 



 

[





[





/&0





< D



D



1RQSK\VLFDOPRGHOV

< D



D



[



D



[



< D



D



[



D



[



D



[



D



[



D



[



D



[



3K\VLFDOPRGHO













[







)LJ([WHUQDODFFXUDF\FULWHULRQPLQLPDYDOXHVSORWWHGDJDLQVWFRPSOH[LW\RIPRGHO

VWUXFWXUH6IRUGLIIHUHQWQRLVHYDULDQFH[





/&0ORFXVRIFULWHULRQPLQLPDOLQH

PRGHOFKRLFHE\FULWHULRQPLQLPXP

ÂÂPRGHOFKRLFHE\OHIWFRUQHUUXOH



7KHVHFRQGOD\HUPRGHOVDUHHYDOXDWHGIRUFRPSOLDQFHZLWKWKHFULWHULRQDQG)EHVWYDULDEOHVDUH

DOORZHG WR IRUP WKLUGOD\HU FDQGLGDWHV 7KH SURFHGXUH LV FDUULHG RQ DV ORQJ DV WKH FULWHULRQ

GHFUHDVHVLQYDOXH

7KHDERYHSURFHGXUHDFKLHYHVWKHIROORZLQJJRDOV,2QO\WKHQXPEHU

)

RIYDULDEOHV\LHOGLQJ

WKH EHVW UHVXOW DUH DOORZHG WR IRUPWKH PRUH FRPSOLFDWHG PRGHOV RI WKH VXEVHTXHQW OD\HUV

,QVWHDGRIRQHOD\HUWZRODVWOD\HUVDUHXVHGWRGHWHUPLQHWKHEHVWUHVXOWRIWKHH[KDXVWLYHVHDUFK

VRWKDWWKHYDOXHRIWKHFULWHULRQRQWKHH[KDXVWLYHVHDUFKFXUYHFDQRQO\GHFUHDVHFRPSDUHWKH

YDOXHVUHSUHVHQWHGE\WKHGDVKHGDQGVROLGOLQHVLQ)LJ7KHRSWLPDOPRGHOKDVWREHFKRVHQ

QRWE\WKHFULWHULRQEXWE\ZKDWZHFDOOWKH

OHIWFRUQHUUXOH

7KHEHVWYDULDEOHVRIHDFKOD\HU

DUH XVHG WR FRQWLQXRXVO\ H[SDQG WKH LQSXW GDWD VDPSOHZLWK HDFK OD\HU WKH H[KDXVWLYH VHDUFK

DGGV)FROXPQVWRWKHLUQXPEHULQWKHVDPSOH7\SLFDOFXUYHVIRUWKHH[KDXVWLYHVHDUFKRQWKH

EDVLV RI WKH SUHFLVLRQ FULWHULRQ DQG IRU GLIIHUHQW QRLVH YDULDQFHV DUH VKRZQ LQ )LJ  ,W ZDV

SURYHGWKDWFDOFXODWLRQVDUHIDVWHUZKHQ

DLQDOOIRUPXODHLQIRUPDWLRQDODUUD\

LVXVHGLQVWHDGRIGDWDVDPSOLQJDUUD\

: ;<



EPRGHOVSDUDPHWHUVDUHFDOFXODWHGE\UHFXUVLRQPHWKRGRIIUDPLQJ

$VDOLHQWIHDWXUHRIWKH*0'+DOJRULWKPVLVWKDWZKHQWKH\DUHSUHVHQWHGFRQWLQXRXVRUQRLV\

LQSXWGDWDWKH\ZLOO\LHOGDVRSWLPDO

VRPHVLPSOLILHGQRQSK\VLFDOPRGHO

,ILVRQO\LQWKHFDVHRI

GLVFUHWHRUH[DFWGDWDWKDWWKHH[KDXVWLYHVHDUFKIRUFRPSOLDQFHZLWKWKHSUHFLVLRQFULWHULRQZLOO

\LHOG ZKDW LV FDOOHG D

SK\VLFDO PRGHO

 WKH VLPSOHVW RI DOO XQELDVHG PRGHOV :LWK QRLV\ DQG

FRQWLQXRXV LQSXW GDWD VLPSOLILHG 6KDQQRQ PRGHOV >@ SURYH PRUH SUHFLVH LQ

DSSUR[LPDWLRQDQGIRUIRUHFDVWLQJWDVNV

7RWHVWDPRGHOIRUFRPSOLDQFHZLWKWKHGLIIHUHQWLDOEDODQFHFULWHULRQWKHLQSXWVDPSOHLVGLYLGHG

LQWRWZRHTXDOSDUWV7KHFULWHULRQUHTXLUHVWRFKRRVHDPRGHOWKDWZRXOGDVIDUDVSRVVLEOHEH

WKHVDPHRQERWKVXEVDPSOHV7KHEDODQFHFULWHULRQZLOO\LHOG WKHRQO\ RSWLPDOSK\VLFDOPRGHO

VROHO\LIWKHLQSXWGDWDDUHQRLV\:LWKH[DFWQRLVHIUHHGDWDWKHFULWHULRQOHDGVWRDPXOWLSOLFLW\

RI RSWLPDO PRGHOV 7R UHVROYH WKH DPELJXLW\ LQ VXFK D FDVH UHVRUW KDV WR EH PDGH WR D

UHJXODUL]LQJFRPELQDWLRQFULWHULRQWKHDOJRULWKPIRUWKHH[WHQGHGGHILQLWLRQRIWKHRQO\RSWLPDO

PRGHO

7KH0XOWLOD\HUHG,WHUDWLYH*0'+DOJRULWKP0,$

7KH &RPELQDWRULDO DOJRULWKP GHVFULEHG LQ WKH SUHYLRXV VXEVHFWLRQ PD\ OLNHZLVH EH FDOOHG D

PXOWLOD\HUHGRULWHUDWLYHRQHGHVSLWHWKHIDFWWKDWWKHLWHUDWLRQUXOHJURZVPRUHFRPSOLFDWHGZLWK

HYHU\ OD\HU 7KLV LV SRVVLEO\ WKH UHDVRQ ZK\ LW LV FXVWRPDU\ WR FDOO WKH 0XOWLOD\HUHG ,WHUDWLYH

*0'+DOJRULWKPDVDOJRULWKPLQZKLFKWKHLWHUDWLRQUXOHUHPDLQVXQFKDQJHGIURPRQHOD\HUWR

WKH QH[W $V LV VKRZQ LQ )LJ WKH ILUVW OD\HU WHVWV WKH PRGHOV WKDW FDQ EH GHULYHG IURP WKH

LQIRUPDWLRQFRQWDLQHGLQDQ\WZRFROXPQVRIWKHVDPSOH7KHVHFRQGOD\HUXVHVLQIRUPDWLRQIURP

IRXUFROXPQVWKHWKLUGIURPDQ\ HLJKWFROXPQVHWF7KHH[KDXVWLYHVHDUFKWHUPLQDWLRQUXOHLV

WKHVDPHDVIRUWKH&RPELQDWRULDODOJRULWKPLQHDFKOD\HUWKHRSWLPDOPRGHOVDUHVHOHFWHGE\WKH



PLQLPXPRIWKHFULWHULRQRUE\WKHOHIWKDQGFRUQHUUXOH,QHDFKOD\HUWKH)EHVWPRGHOVDUHXVHG

WRVXFFHVVLYHO\H[WHQGWKHLQSXWGDWDVDPSOH)LJ

/  0   )



 )









;

N 

N 



N

)



)



L M O

= D



D



[

L

D



[

9 E



E



]

L

E



]



RXWSXW

PRGHO

)



PLQ

: F



F



L

F





   

2XWSXWPRGHO<

N

G



G



[

N

G



[

N

G

P

[

0N

[

0N

)LJ 0XOWLOD\HUHG,WHUDWLRQDOJRULWKP

GDWDVDPSOLQJ

OD\HUVRISDUWLDOGHVFULSWLRQVFRPSOH[LQJ

IRUPRISDUWLDOGHVFULSWLRQV

FKRLFHRIRSWLPDOPRGHOV

DGGLWLRQDOPRGHOGHILQLWLRQE\GLVFULPLQDWLQJFULWHULRQ

)DQG)QXPEHURIYDULDEOHVIRUGDWDVDPSOLQJH[WHQVLRQ



$V ZLWK WKH &RPELQDWRULDO DOJRULWKPWKH RXWSXW YDULDEOH PXVW EH VSHFLILHG LQ DGYDQFH E\ WKH

SHUVRQLQFKDUJHRIPRGHOLQJZKLFKFRUUHVSRQGVWRWKHXVHRIVRFDOOHGH[SOLFLWWHPSODWHV>@

  0

D E

N

N

N

 N

)LJ'HULYDWLRQRIFRQGLWLRQDOHTXDWLRQVRQDGDWDVDPSOH

DH[SOLFLWWHPSODWHVIRUPELPSOLFLWWHPSODWHV

7KH2EMHFWLYH6\VWHP$QDO\VLVDOJRULWKP26$

,Q GLVFUHWH PDWKHPDWLFV WKH WHUP WHPSODWH UHIHUV WR D JUDSK LQGLFDWLQJ ZKLFK RI WKH GHOD\HG

DUJXPHQWVDUHXVHGLQVHWWLQJXSFRQGLWLRQDODQGQRUPDO*DXVVHTXDWLRQV$JUDGXDOLQFUHDVHLQ

WKH VWUXFWXUDO FRPSOH[LW\ RI FDQGLGDWH PRGHOVFRUUHVSRQGVWR DQ LQFUHDVH LQ WKH FRPSOH[LW\ RI

WHPSODWHV ZKRVH H[SOLFLW DQG LPSOLFLW IRUPV DUH VKRZQ LQ )LJ  :KHQ RQH XVHV LPSOLFLW

WHPSODWHVRQHKDVEHJLQQLQJIURPWKHVHFRQGOD\HURIWKHH[KDXVWLYHVHDUFKWRVROYHDV\VWHP

RI HTXDWLRQV DQG WR HYDOXDWH WKH PRGHO XVLQJ D V\VWHP FULWHULRQ 7KH V\VWHP FULWHULRQ LV D

FRQYROXWLRQRIWKHFULWHULDFDOFXODWHGE\WKHHTXDWLRQVWKDWPDNHXSWKHV\VWHP

V\VW









PLQ



ZKHUH

LVWKHQXPEHURIHTXDWLRQVLQWKHV\VWHP

7KHIORZFKDUWRIWKH26$DOJRULWKPLVVKRZQLQ)LJ7KHNH\IHDWXUHRIWKHDOJRULWKPLVWKDWLW

XVHV LPSOLFLW WHPSODWHV DQG DQ RSWLPDO PRGHO LV WKHUHIRUH IRXQG DV D V\VWHP RI DOJHEUDLF RU

GLIIHUHQFHHTXDWLRQV$QDGYDQWDJHRIWKHDOJRULWKPLVWKDWWKHQXPEHURIUHJUHVVRUVLVLQFUHDVHG

DQG LQ FRQVHTXHQFH WKH LQIRUPDWLRQ HPEHGGHG LQ WKH GDWD VDPSOH LV XWLOL]HG EHWWHU $

GLVDGYDQWDJHRIWKHDOJRULWKPLVWKDWLWFDOOVIRUDODUJHDPRXQWRIFDOFXODWLRQVLQRUGHUWRVROYH

WKH V\VWHP RI HTXDWLRQV DQG D JUHDWHU QXPEHU RI FDQGLGDWH PRGHOV KDYH WR EH VHDUFKHG 7KH

DPRXQW RI VHDUFK FDQ EH UHGXFHG XVLQJ D FRQVWUDLQW LQ WKH IRUP RI DQ DX[LOLDU\ SUHFLVLRQ

FULWHULRQ,QVHWWLQJXSWKHV\VWHPRIHTXDWLRQVRQHWKHQGLVFDUGVWKHSRRUO\IRUHFDVWLQJHTXDWLRQ

XVLQJHTXDWLRQRQO\IRUZKLFKWKH

YDULDWLRQDFFXUDF\FULWHULRQ

IRUWKHIRUHFDVWLVOHVVWKDQXQLW\

QDUURZLQJRSHUDWLRQ























PLQ





ZKHUH

LVWKHYDULDEOHYDOXHLQWKHWDEOH



LVWKHYDOXHFDOFXODWHGDFFRUGLQJWRWKHPRGHO

DQG

LVWKHPHDQYDOXH

7KLV FULWHULRQ LV UHFRPPHQGHG LQ WKH OLWHUDWXUH LQ RUGHU WR HYDOXDWH WKH VXFFHVV RI DQ

DSSUR[LPDWLRQRURIDIRUHFDVW>@:LWK



WKHUHVXOWRIPRGHOLQJLV WDNHQWREH JRRG

ZLWK



LWLVWDNHQWREHVDWLVIDFWRU\ZLWK



!PRGHOLQJLVFRQVLGHUHGWRKDYH

IDLOHGDQGWKHPRGHO\LHOGVPLVLQIRUPDWLRQ

    0





 L M

;

N

N

N

V\VW









[

LN

D



D



[

LN

D



[

LN

L M

[

LN

D



D



[

LN

D



[

LN





[

MN

D



[

MN

D



[

MN

[

MN

E



E



[

LN

E



[

LN

)





[

MN

E



[

MN

E



[

MN

PLQ

L M

[

LN

[

MN

[

ON

)LJ2EMHFWLYHV\VWHPDQDO\VLV26$DOJRULWKP



([WHQGHGGHILQLWLRQRIWKHRQO\RSWLPDOPRGHOE\WKHWKHRU\

RIGLVFULPLQDWLQJFULWHULD

,W KDV EHHQ GHPRQVWUDWHG WKHRUHWLFDOO\ DQG H[SHULPHQWDOO\ WKDW WKH H[KDXVWLYHVHDUFK FXUYHV

VKRZQ LQ )LJ  DUH JUDGXDO DQG XQLPRGDO IRU WKH H[SHFWHG YDOXH RI WKH FULWHULRQ >@ 7KH

QXPEHURIFDQGLGDWHPRGHOVWHVWHGLQHDFKH[KDXVWLYHVHDUFKOD\HUFDQQRWEHLQILQLWHO\ODUJH,Q

RWKHUZRUGVLQ FRQVWUXFWLQJ H[KDXVWLYH VHDUFKFXUYHVWKH H[SHFWHGYDOXHRIWKH FULWHULRQ LV LQ

HIIHFWUHSODFHGE\LWVPHDQRUOHDVWYDOXH%HFDXVHRIWKLVWKHFXUYHVWDNHRQDVOLJKWO\ZDY\

VKDSHDQGDVPDOOHUURUPD\FUHHSLQWRWKHRSWLPDOPRGHOVWUXFWXUHFKRLFH

7KHWKHRU\RIGLVFULPLQDWLQJFULWHULDKDVEHHQGHYHORSHGE\)HGRURY>@DQG<XUDFKNRYVN\>@

ZLWK VSHFLDO UHIHUHQFH WRH[SHULPHQWDO GHVLJQ ,W KDVKRZHYHU SURYHG LWV UHOHYDQFH WR WKH VHOI

RUJDQL]DWLRQ RI PRGHOV DQG DFWLYHQHXURQ QHXUDO QHWZRUNV 7KH WKHRU\ SURFHHGV IURP WKH

IROORZLQJ SUHPLVHV , WKHUH H[LVWV D WUXH PRGHO UHSUHVHQWHG LQ WKH GDWD VDPSOH  WKH

DVVXPHG IHZ REMHFW GHVFULSWLRQV ILW WKH PRGHO WR D GLIIHUHQW GHJUHH  WKH PRGHO WKDW FRPHV

FORVHVWWRWKH WUXH PRGHO FDQ EH VHOHFWHGIURP LWV FRPSOLDQFH ZLWK DQ

DX[LOLDU\GLVFULPLQDWLQJ

FULWHULRQ



:LWK VXFK DQ DSSURDFK HYHU\ *0'+ DOJRULWKP FRQVHFXWLYHO\ XVHV WZR FULWHULD $W ILUVW DQ

H[KDXVWLYHVHDUFKLVDSSOLHGWRDOOFDQGLGDWHPRGHOVIRUFRPSOLDQFHZLWKWKHPDLQFULWHULRQDQGD

VPDOOQXPEHURIPRGHOVZKRVHVWUXFWXUHLVFORVHWRRSWLPDOLVVHOHFWHG7KHQRQO\ RQHRSWLPDO

PRGHO LV VHOHFWHG WKDW FRPSOLHV ZLWK D VSHFLDO GLVFULPLQDWLQJ FULWHULRQ 7KH WKHRU\ RI RSWLPDO

GLVFULPLQDWLQJ FULWHULD LV VWLOO LQ WKH GHYHORSPHQWDO VWDJH EXW VXFFHVVIXOGLVFULPLQDWLQJ FULWHULD

DUHDOUHDG\NQRZQ

,QFDVHVLQYROYLQJWKHVHOHFWLRQRIDVWUXFWXUHIRURSWLPDOSRO\QRPLDOPRGHOVWKHDSSUR[LPDWLRQ

RUIRUHFDVWYDULDWLRQFULWHULRQVHUYHVZHOO,QWKHVHOHFWLRQRIRSWLPDOFOXVWHUL]DWLRQJRRGUHVXOWV

DUHREWDLQHGZLWKWKHV\PPHWU\FULWHULRQIRUWKHFOXVWHUVGLVWDQFHPDWUL[FDOFXODWHGUHODWLYHWRWKH

VHFRQGDU\GLDJRQDO>@HWF

6HOIRUJDQL]DWLRQRIDQDFWLYHQHXURQQHXUDOQHWZRUN

$QHXUDOQHWZRUNLVGHVLJQHGWRKDQGOHDSDUWLFXODUWDVN7KLVPD\LQYROYHUHODWLRQLGHQWLILFDWLRQ

DSSUR[LPDWLRQ SDWWHUQ DQG VLWXDWLRQ UHFRJQLWLRQ RU D IRUHFDVW RI UDQGRP SURFHVVHV DQG

UHSHWLWLYHHYHQWVIURPLQIRUPDWLRQFRQWDLQHGLQDVDPSOH RIREVHUYDWLRQVRYHUD WHVW RU FRQWURO

REMHFW

(DFK QHXURQ LV DQ HOHPHQWDU\ V\VWHP WKDW KDQGOHV WKH VDPH WDVN 7KH REMHFWLYH VRXJKW LQ

FRPELQLQJPDQ\QHXURQVLQWRDQHWZRUNLVWRHQKDQFHWKHDFFXUDF\LQDFKLHYLQJWKHDVVLJQHGWDVN

WKURXJK D EHWWHU XVH RI LQSXW GDWD $V DOUHDG\ QRWHG WKH IXQFWLRQ RI DFWLYH QHXURQV FDQ EH

SHUIRUPHG E\ YDULRXV UHFRJQLWLRQ V\VWHPV QRWDEO\ E\ 5RVHQEODWWV WZROD\HU SHUFHSWURQV >@

6XFK D QHXUDO QHWZRUN DFKLHYHV WKH WDVN RI SDWWHUQ UHFRJQLWLRQ ,WV WKHRU\ LV SUHVHQWHG LQ WKH

DOJHEUDLFWKHRU\GXHWR=KXUDYOHY>@