Google yakaburitsa yechipiri vhezheni yeLyra, yayo yepamusoro-mhando, yakaderera-bitrate codec inoita kuti kutaurirana kwezwi kuvepo kunyangwe pane inononoka network.
Munguva pfupi yapfuura Google yakavhurwa kuburikidza ne blog post, ichiburitsa yechipiri vhezheni yako yekuteerera codec "Lyra-V2", iyo inoshandisa matekiniki ekudzidza muchina kuwana iyo yepamusoro inzwi remhando kana uchishandisa inononoka kutaurirana nzira.
Shanduro nyowani inosuma shanduko kune itsva neural network architecture, tsigiro yemamwe mapuratifomu, yakagadziridzwa bitrate control, kuvandudzwa kwekuita, uye mhando yepamusoro yekuteerera.
Isu tave kuburitsa Lyra V2, iine chivakwa chitsva chinonakidzwa nerutsigiro rwakafara rwepuratifomu, inopa scalable bitrate kugona, kuita zvirinani, uye emhando yepamusoro odhiyo. Nekuburitswa uku, isu tinotarisira kuenderera mberi nekushanduka nenharaunda uye, nehunyanzvi hwako hwekuita, ona maapplication ari kugadzirwa uye nzira nyowani dziri kubuda.
About Lyra
Nezve mhando ye data yezwi inofambiswa nekumhanya kwakaderera, Lyra yakanyanya kukwirira kune echinyakare macodecs vanoshandisa nzira dzedhijitari dzekugadzirisa zviratidzo. Kuti uwane yemhando yepamusoro kufambisa kwezwi pasi pemamiriro ehuwandu hushoma hweruzivo rwakafambiswa, mukuwedzera kune yakajairwa odhiyo yekumanikidza uye nzira dzekushandura chiratidzo, Lyra anoshandisa modhi yezwi yakavakirwa pamuchina wekudzidza sisitimu izvo zvinokutendera kuti udzokorore ruzivo rusipo. zvichibva pamaitiro ekutaura.
Iyo codec inosanganisira encoder uye decoder. Iyo encoder algorithm inobvisa iyo izwi data paramita ega ega makumi maviri milliseconds, anoamanikidza uye oaendesa kune anogamuchira. pamusoro petiweki nekamwe mwero we3,2 kbps kusvika 9,2 kbps.
Kudivi rekugamuchira, decoder inoshandisa modhi yekugadzira kudzoreredza iyo yekutanga yekutaura siginecha zvichienderana nekufambiswa kwemaodhiyo paramita, kusanganisira logarithmic chaki spectrograms iyo inofunga nezvesimba maitiro ekutaura muma frequency akasiyana siyana. .
Chii chitsva muLyra V2?
Lyra V2 inoshandisa itsva generative modhi yakavakirwa paSoundStream neural network, iyo ine yakaderera computational zvinodiwa, kubvumira chaiyo-nguva decoding kunyange pane yakaderera-simba masisitimu.
Iyo modhi yakashandiswa kugadzira ruzha yakadzidziswa uchishandisa zviuru zvemaawa ekurekodha mazwi mumitauro inodarika makumi mapfumbamwe (TensorFlow Lite inoshandiswa kumhanyisa modhi) Kuita kweiyo yakarongwa kuita kwakakwanira encode uye decode izwi pamafoni emhando yakaderera yemutengo.
Pamusoro pekushandisa akasiyana generative modhi, iyo vhezheni nyowani zvakare yakamira kunze kwekubatanidzwa kwezvinongedzo neRVQ quantifier (Residual Vector Quantizer) muiyo codec architecture, iyo inoitwa kune anotumira divi risati ratumirwa data, uye padivi rekugamuchira mushure mekugamuchira data.
Iyo quantizer inoshandura ma parameter akapihwa necodec kuita seti yemapaketi, encoding iyo ruzivo maererano neiyo yakasarudzwa bit rate. Kuve nechokwadi chemhando dzakasiyana dzemhando, maquantizer anopihwa matatu bitrate (3,2kbps, 6kbps, uye 9,2kbps), iyo yakakwira bitrate, inova nani mhando, asi yakakwirira iyo bandwidth inodiwa.
chivakwa chitsva yakaderedza kunonoka kutapurirana kwechiratidzo kubva pa100 milliseconds kusvika pamakumi maviri milliseconds. Kuenzanisa, iyo Opus codec yeWebRTC yakaratidza kunonoka kwe26,5 ms, 46,5 ms, uye 66,5 ms pabit rates dzakaedzwa. Encoder uye decoder kuita kwakawedzera zvakanyanya: Kuenzaniswa neshanduro yapfuura, kune kukurumidza kusvika ku5 nguva. Semuyenzaniso, paPixel 6 Pro smartphone, iyo codec itsva inoisa kodhi uye decode 20ms sampuli mu 0,57ms, iyo inomhanya kakapetwa ka35 pane inodiwa pakutepfenyura-nguva chaiyo.
Pamusoro pekuita, isu takakwanisawo kuvandudza kunaka kwekudzoreredza inzwi: zvinoenderana nechiyero cheMUSHRA, hunhu hwekutaura pabit rates ye3,2 kbps, 6 kbps uye 9,2 kbps pakushandisa iyo Lyra V2 codec inoenderana nebit rates ye10 kbps, 13 kbps uye 14 kbps paunenge uchishandisa Opus codec.
Finalmente kana iwe uchifarira kuziva zvakawanda nezvazvo, unogona kutarisa ruzivo mu chinotevera chinongedzo.