Muna Chivabvu 2020, OpenAI, iyo kambani yeAI yakavambwa naElon Musk naSam Altman, yakaburitswa GPT-3, ndokuzoratidzwa seyakanyanya neural network yenguva. Chimiro chemutauro wezvino-zvino, GPT-3 inosanganisira 175 bhiriyoni paramita zvichienzaniswa ne1,5 bhiriyoni paramita yeyakatangira GPT-2.
GPT-3 kurova iyo NLG Turing modhi (Turing Natural Language Generation) kubva kuMicrosoft ine 17 bhiriyoni paramita yaimbobata rekodhi yeiyo huru neural network. Mutevedzeri wemutauro wakashamiswa, wakatsoropodzwa uye kunyange kuiswa pasi pekuongororwa; yakawanawo zvitsva uye zvinonakidza zvikumbiro.
Saka zvino makuhwa akaburitswa kuti kuburitswa kweGPT-4, iyo inotevera vhezheni yeOpenAI mutauro modhi, inogona kunge iri kuuya munguva pfupi.
Kunyange zvakadaro hapana zuva rekuburitswa raziviswa, OpenAI yakapa zvimwe zviratidzo pamusoro pemaitiro emutsivi weGPT-3, izvo zvingatarisirwa nevakawanda, kuti GPT-4 haifaniri kunge yakakura kudarika GPT-3, asi inofanira kushandisa mamwe mashandisirwo ekugadzirisa, izvo zvichaderedza kukanganisa kwayo kwezvakatipoteredza.
Panguva yemusangano, Altman akataura izvozvo, zvinopesana nezvinodavirwa nevakawanda, GPT-4 haizove iyo yakakura mutauro modhi. Iyo modhi pasina mubvunzo ichave yakakura kupfuura yakapfuura zvizvarwa zveneural network, asi saizi haizove chiratidzo chayo.
Kutanga, makambani akaona kuti kushandisa saizi yemhando sechiratidzo chekuvandudza mashandiro haisi iyo chete kana nzira yakanaka yekuzviita. Muna 2020, Jared Kaplan nevamwe vake veOpenAI vanonzi vakagumisa kuti mashandiro anowedzera zvakanyanya kana kuwedzera kwebhajeti yekombuta kunonyanya kupihwa kuwedzera huwandu hwema paramita, zvichitevera hukama hwesimba-mutemo. Google, Nvidia, Microsoft, OpenAI, DeepMind, uye mamwe makambani anovandudza mamodheru emitauro atora nhungamiro iyi pahuso.
Asi MT-NLG (Megatron-Turing NLG, neural network yakavakwa naNvidia neMicrosoft gore rapfuura ne530 bhiriyoni paramita), yakakura sezvairi, haisi iyo yakanyanya kunaka kana zvasvika pakuita. Muchokwadi, haina kuverengerwa zvakanakisa mune chero benchmark chikamu. Madiki modhi seGopher kana Chinchilla (70 bhiriyoni paramita), chikamu chidimbu chehukuru hwawo, angave ari nani kupfuura MT-NLG mumabasa ese. Nokudaro, zvakava pachena kuti ukuru hwemuenzaniso hausi iwo chete chinhu chinotungamirira kunzwisisa zviri nani mutauro.
Sekureva kwaAltman, mamodheru emitauro anotambura nekushomeka kwakanyanya. kana zvasvika pakugadzirisa. Kudzidzira kwaizodhura zvekuti makambani aizofanira kukanganisa pakati pekururama uye mutengo. Izvi zvinowanzoita kuti mamodheru asanyatsogadziriswa.
Mutungamiriri Mukuru akashuma kuti GPT-3 yakadzidziswa kamwe chete, pasinei nezvimwe zvikanganiso izvo mune dzimwe nguva zvingadai zvakakonzera kudzidzira zvakare. Nekuda kweizvi, OpenAI inonzi yakafunga kupokana nazvo nekuda kwemutengo usingadhurike, izvo zvakatadzisa vaongorori kuwana yakanakisa seti ye hyperparameter yemuenzaniso.
Imwe mhedzisiro yemitengo yakakwira yekudzidzisa ndeyekuti ongororo yemaitiro emhando yaizoganhurwa. Maererano nemumwe mushumo, apo vatsvakurudzi veAI vakagumisa kuti ukuru hwemuenzaniso ndiyo inonyanya kukosha yekuvandudza kushanda, havana kufunga nezvehuwandu hwematokeni ekudzidzira, kureva, huwandu hwemashoko anopiwa kune mienzaniso. Izvi zvaizoda huwandu hunoshamisa hwekushandisa komputa. Makambani eTech anonzi akatevera zvakawanikwa nevaongorori nekuti ndizvo zvaive zvakanakisa zvavaive nazvo.
Altman yakataura kuti GPT-4 ichashandisa akawanda akawanda maverengero kupfuura ayo akatangira. OpenAI inotarisirwa kuita mazano ane chekuita nekugadzirisa muGPT-4, kunyangwe kusvika papi isingagone kufanotaurwa sezvo bhajeti rayo risingazivikanwe.
Zvisinei, mashoko a Altman anoratidza kuti OpenAI inofanirwa kutarisa pakugadzirisa zvinosiyana kunze kwesaizi yemhando.. Kutsvaga yakanakisa seti ye hyperparameter, yakaringana modhi saizi, uye huwandu hwema paramita zvinogona kutungamira kukuvandudza kunoshamisa pamabhenji ese.
Maererano nevanoongorora, fungidziro dzose dzemhando dzemitauro dzichaparara kana nzira idzi dzakabatanidzwa kuva muenzaniso mumwe. Altman akatiwo vanhu havangatendi kuti mamodheru ari nani angave akaita sei pasina kuve akakura. Zvinogona kunge zvichireva kuti kuyera kuedza kwakapera parizvino.
OpenAI inonzi yakaisa simba rakawanda mukugadzirisa dambudziko reAI: maitiro ekuita mamodheru emitauro kutevera zvinangwa zvevanhu uye kutevedzera hunhu hwevanhu?
Vaongorori vanoti iri harisi dambudziko rakaoma remasvomhu chete (tinoita sei kuti AI inzwisise zvatiri kuda?), asiwo yehuzivi (hapana nzira yepasirese yekuyananisa AI nevanhu, kubva mukusiyana kwehunhu hwevanhu. kubva kuboka kuenda kuboka rakakura uye rinowanzopokana).
Finalmente kana iwe uchifarira kuziva zvakawanda nezvazvounogona kutarisa kune yekutanga positi Mune inotevera chinongedzo.