Okwamanje, Sesiqalile ukubona ukwanda izixazululo ezahlukene ukuthi baqala ukunikeza maqondana ukukhiqiza amakhodi kusetshenziswa ubuhlakani bokwenziwa (AI) futhi kungenxa yokuthi umkhakha wokucubungula ulimi lwemvelo (NLP) usuvule indlela yochungechunge lwama-AI akhiqiza amakhodi ngezilimi ezihlukahlukene zokuhlela.
Yikuphi singagqamisa ngokwesibonelo i-GitHub Copilot, i-AlphaCode ne-Codex futhi lapho manje singakwazi ukwengeza isisombululo esisha esivela esandleni se- abacwaningi baseCarnegie Mellon University labo isanda kwethulwa i-"PolyCoder", ugenerator wekhodi osuselwe kumodeli yolimi ye-OpenAI ye-GPT-2 eyaqeqeshwa kusizindalwazi sekhodi engu-249 GB ngezilimi zokuhlela eziyi-12.
Mayelana ne-PolyCoder
Ababhali bePolyCoder bathi kunjalo ekwazi ukubhala u-C ngokunembe kakhulu kunanoma iyiphi imodeli eyaziwayo, kuhlanganisa ne-Codex.
Ikhodi ekhiqiza i-AI, ingabhala ikhodi yomthombo ngezilimi zokuhlela ezihlukene Kusukela nje ku-bat, ithembisa ukwehlisa izindleko zokuthuthukiswa kwesofthiwe ngenkathi ivumela abathuthukisi ukuthi bagxile emisebenzini ephindaphindayo, yokudala.
I-PolyCoder inikwe amandla yidatha evela kumakhosombe ahlukahlukene e-GitHub, ehlanganisa izilimi zokuhlela ezidumile eziyi-12: C, C#, C++, Go, Java, JavaScript, PHP, Python, Ruby, Rust, Scala, and TypeScript.
Isethi yedatha engahlungiwe ihlanganise u-631 GB wedatha namafayela ayizigidi ezingu-38,9. Ithimba lakusho lokho ukhethe ukuqeqesha i-PolyCoder nge-GPT-2 ngenxa yezinkinga zesabelomali. I-PolyCoder iyatholakala njengomthombo ovulekile, futhi abacwaningi bathemba ukuthi ingakwazi ukwenza ucwaningo ngentando yeningi emkhakheni wokukhiqiza amakhodi we-AI, okuze kube manje ubuswa izinkampani ezixhaswe kahle ngemali.
Abacwaningi bakholelwa ukuthi i-PolyCoder isebenza kangcono kunamanye amamodeli ekukhiqizeni ikhodi ngolimi C. Nokho, iCodex ibilokhu iyidlula ngezinye izilimi. "I-PolyCoder idlula i-Codex kanye nawo wonke amanye amamodeli ngolimi C.
“Lapho u-Copilot ephuma ku-GitHub ehlobo eledlule, kwacaca ukuthi lawa mamodeli amakhodi olimi amakhulu kakhulu angaba usizo olukhulu ekusizeni onjiniyela nokwandisa umkhiqizo wabo. Kepha ayikho imodeli esondelene naleso sikali ebitholakala esidlangalaleni,” abacwaningi batshele iVentureBeat nge-imeyili. “Ngakho-ke [i-PolyCoder] yaqala ngokuthi uVincent ezama ukuthola ukuthi iyiphi imodeli enkulu kunazo zonke engaqeqeshwa kuseva yethu yelebhu, egcine ibe amapharamitha ayizigidi eziyizinkulungwane ezingama-2700… .zazitholakala esidlangalaleni ngaleso sikhathi.”
Uma uqhathanisa amamodeli omthombo ovulekile kuphela, I-PolyCoder idlula imodeli ye-GPT-Neo 2.7B enosayizi ofanayo ku-C, JavaScript, Rust, Scala, ne-TypeScript." bayakhomba Kwezinye izilimi eziyi-11, zonke ezinye izinhlobo zemithombo evulekile, okuhlanganisa neyethu, zimbi kakhulu (ukudideka okukhulu) kuneCodex," kwengeza abacwaningi be-CMU.
Ngalokhu, i-PolyCoder ibekwe njengesixazululo esithakazelisa kakhulu, njengoba ngenkathi amalabhorethri ocwaningo afana ne-OpenAI ka-Elon Musk kanye ne-Alphabet's DeepMind athuthukise i-AI ekhiqiza ikhodi enamandla, amasistimu amaningi aphumelela kakhulu awatholakali emthonjeni ovulekile. Izinkampani ezihola kancane azikwazi ukufinyelela kuyo futhi lesi simo sinciphisa ucwaningo lwazo kulo mkhakha.
Isibonelo, idatha yokuqeqesha evela ku-OpenAI Codex, enika amandla isici se-GitHub's Copilot, ayizange yenziwe esidlangalaleni, ivimbela abacwaningi ukuthi bacwengisise imodeli ye-AI noma ukutadisha izici ezithile zayo, njengokusebenzisana.
"Izinkampani ezinkulu zobuchwepheshe aziwakhiphi obala amamodeli azo, okuyinto ebambezela ucwaningo lwesayensi kanye nokwenza intando yeningi yamamodeli amakhulu kangaka ekhodi yolimi," kusho abacwaningi. “Ngezinga elithile, sithemba ukuthi imizamo yethu yomthombo ovulekile izoqinisekisa abanye ukuthi benze okufanayo. Kodwa isithombe esikhulu wukuthi umphakathi kumele ukwazi ukuziqeqeshela wona ngokwawo la mamodeli. Imodeli yethu yeqe umkhawulo walokho ongakwazi ukukuqeqesha kuseva eyodwa - noma yini enkulu idinga iqoqo lamaseva, anyusa kakhulu izindleko. "
Okokugcina uma unentshisekelo yokwazi kabanzi ngakho, ungabheka imininingwane kufayela le- isixhumanisi esilandelayo.