ukuba ncedisa imibutho lungiselela uhlaselo lwekhompyuter, uMicrosoft ukhuphe isixhobo esitsha esinikezela ngemodeli yokulinganisa yoqeqesho ngokusekwe kufundo oluqinisiweyo. Ikhowudi yemithombo yeCyberBattleSim yenziwa kwiPython kunye ne-OpenAI Gym interface, ingumthombo ovulekileyo onelayisensi phantsi kwelayisensi yeMIT kwaye kuyakhankanywa ukuba iimpawu zorhwebo okanye iilogo zeeprojekthi, iimveliso okanye iinkonzo, ziqulathe ukusetyenziswa okugunyazisiweyo kweempawu zorhwebo okanye iilogo zikaMicrosoft kunye ixhomekeke kwiimpawu zophawu lwentengiso kunye nezikhokelo zorhwebo.
ICyberBattleSim liqonga lophando lokulinga lokuphanda ukusebenzisana kweearhente ezizenzekelayo esebenza kwindawo yenethiwekhi yeshishini elingelolakho. Ukulinganisa kubonelela kwinqanaba eliphezulu lokukhutshwa kwenethiwekhi zekhompyuter kunye nokuqonda ukhuseleko kwi-cyber. I-interface yayo esekwe ePython evulekileyo ye-AI yeGym yenza ukuba uqeqesho lwearhente oluzenzekelayo lusebenzise ukuqinisa ubuchule bokufunda.
Imeko yokulinganisa ipharamitha yithopholoji yenethiwekhi emiselweyo kunye neseti yokuba semngciphekweni abanokuthi basebenzise iiarhente ukuhamba kamva kwinethiwekhi. Injongo yomhlaseli kukuthatha indawo yenethiwekhi ngokusebenzisa ubungozi obufunyenwe kwindawo yekhompyuter.
Njengoko umhlaseli ezama ukusasaza kwinethiwekhi, iarhente ekhuselayo ijonge umsebenzi wenethiwekhi kwaye izama ukufumana naluphi na uhlaselo olwenzekayo kunye nokunciphisa ifuthe kwinkqubo ngokukhupha umhlaseli.
Sinika isikhuseli esisisiseko se-stochastic esibhaqa kwaye sinciphise uhlaselo oluqhubekayo ngokusekwe kwimpumelelo echaziweyo. Siphumeza ukuthomalalisa ngokucinga kwakhona iindawo ezosulelekileyo, inkqubo yokumodareyitha njengamanyathelo okulinganisa amaninzi.
Ukuqiniswa kokufunda ludidi lokufunda ngomatshini apho iiarhente ezizimeleyo zifunda ukwenza izigqibo ngokwenza ngokuhambelana nokusingqongileyo.
Injongo yokulinganisa isoyikiso kukuqonda indlela umhlaseli akwazi ngayo ukuba ulwazi oluyimfihlo. Ngokufunda iindlela zabo zokungenelela, abakhuseli banokulindela ngcono umngcipheko kunye nemingxunya kwaye baqalise amanyathelo okulungisa.
Kodwa akufuneki silibale into yokuba amaqela ezokhuselo ahlala elinyathelo elinye emva kwabahlaseli abagqiba ukuba yeyiphi i-vector ehlaselweyo ekufuneka bayisebenzise ngelixa abakhuseli kufuneka bazilungiselele ngaphandle kokwazi ukuba uhlaselo luzakwenzeka phi. Ngamafutshane, indima yomgcini wegoli ngaphezu kwawo onke amaqela anokufumana amanqaku ngasemva nangaphezulu kwakhe ...
ICyberBattleSim iimeko zokuhlaselwa kwe-cyber zahlukile Kwaye basuka kubusela beziqinisekiso baye ekuhluzweni kweepropathi zeendawo zokunyuka kwamalungelo, kunye nokuxhaphazwa kweendawo zeSabelo ngokubeka emngciphekweni iziqinisekiso zeSSH.
Microsoft Ikwachaza ukuba imeko ye-Gym ivumela ubhetyebhetye obukhulu kulungelelwaniso kunye noqwalaselo ukulinganisa ukuhlaselwa kwe-cyber. Umpapashi ukwabandakanye isixhobo somgangatho wokulinganisa kunye nokuthelekisa impumelelo yezenzo zokhuselo lwe-cyber esekwe kufundo lomatshini.
Ukulinganisa kwiCyberBattleSim kulula, kwaye kunezibonelelo zayo: ubume bayo obunqabileyo buthintela ukusetyenziswa ngokuthe ngqo kwiinkqubo zehlabathi lokwenyani, oko ke kunika ukhuselo ekusetyenzisweni okunokuba yingozi kweearhente ezizenzekelayo eziqeqeshwe nayo.
Ikwasivumela ukuba sigxile kwimimandla ethile yokhuseleko esifuna ukuyifunda kunye nokuzama ngokukhawuleza ngokufunda ngomatshini kunye nobuchule bokufakelwa kobukrelekrele: kungoku sigxile kubuchwephesha bentshukumo esecaleni, ngenjongo yokuqonda ukuba topology kunye noqwalaselo lwenethiwekhi zichaphazela ezi ndlela. Ngale njongo engqondweni, besicinga ukuba ukumodareyitha ukugcwala kwenethiwekhi bekungeyomfuneko, kodwa le yimida ebalulekileyo enokuthi ifumaneke ukujongana negalelo elizayo. "
Gqibela ukuba unomdla wokwazi okungakumbi ngayo malunga neCyberBattleSim okanye ukuba ufuna ukwazi ukuba ungasisebenzisa njani esi sixhobo kwindlela yakho ungajonga iinkcukacha kunye / okanye ufakelo kwaye usebenzise imiyalelo Kule khonkco ilandelayo.