Google ya ƙaddamar da tsari ga Linux don inganta musayar bayanan cibiyar sadarwa tsakanin na'urori

Tux, mascot na Linux Kernel

Kwayar Linux ita ce kashin bayan tsarin aiki na Linux (OS), kuma ita ce babbar hanyar sadarwa tsakanin kayan aikin kwamfuta da hanyoyinta.

Kwanan nan labari ya bazu cewa Google ya yi shawara ta hanyar jerin aikawasiku na masu haɓaka kernel na Linux, don canja wurin bayanan cibiyar sadarwa tsakanin na'urori.

Shawarwarin kamar haka shine game da aiwatar da tsarin TCP ƙwaƙwalwar ajiya (devmem TCP), wanda ke ba da damar canja wurin bayanai kai tsaye a kan hanyar sadarwa daga ƙwaƙwalwar ajiyar wasu na'urori zuwa ƙwaƙwalwar ajiyar wasu na'urori, ba tare da yin kwafi na tsaka-tsaki na wannan bayanan a cikin buffers da ke cikin ƙwaƙwalwar ajiyar tsarin ba.

Game da shawarar Google, an ambaci hakan Ana sa ran ƙwaƙwalwar TCP na na'ura zai ƙara haɓaka aiki sosai na mu'amala a cikin gungu da kuma rarraba tsarin koyo na inji ta amfani da ƙarin allunan hanzari.

Bugu da kari, an ambaci cewa yin amfani da na'ura mai saurin ilmantarwa yana haifar da karuwa mai yawa a cikin adadin bayanan da aka canjawa wuri a cikin tsarin horarwa na horo daga ajiya zuwa ƙwaƙwalwar GPU / TPU. A wasu lokuta, horar da injin koyo model zai iya cinye kashi 50% na albarkatun lissafin TPU da ke akwai, kuma hanya ɗaya don kawar da raguwar lokaci da yin amfani da cikakken amfani da albarkatun GPU/TPU shine ƙara yawan aiki da kuma canja wurin bayanai.

A halin yanzu, canja wurin bayanai tsakanin na'urori akan runduna daban-daban yana iyakance ga kwafin bayanai na na'urar ƙwaƙwalwar ajiya don ɗaukar nauyin ƙwaƙwalwar ajiya, canja wuri bayani zuwa wani runduna akan hanyar sadarwa da kwafi daga memorin mai watsa shiri makoma zuwa ƙwaƙwalwar ajiyar wata na'ura. Irin wannan makirci ba shi da kyau kuma, ta hanyar canja wurin bayanai masu yawa, yana haifar da ƙarin kaya akan bandwidth ƙwaƙwalwar ajiya da bas ɗin PCIe.

A yau, yawancin canja wurin bayanan na'ura zuwa na'ura akan hanyar sadarwa sune aiwatar da ƙananan ayyuka masu zuwa: kwafi daga na'ura zuwa masauki, Mai watsa shiri-zuwa mai masaukin baki canja wurin hanyar sadarwa da kwafi-zuwa na'ura.

Aiwatar da ita ba ta da kyau, musamman don yawan canja wurin bayanai, kuma maiyuwa sanya matsa lamba mai mahimmanci akan albarkatun tsarin, kamar bandwidth mai ɗaukar hoto,PCIe bandwidth, da dai sauransu. Wani muhimmin dalili a bayan halin da ake ciki yanzu shine rashin ilimin ilimin kernel don bayyana na'urar zuwa hanyar sadarwa.

TCP ƙwaƙwalwar ajiyar na'urar yana ba ku damar ware ƙwaƙwalwar ajiyar mai watsa shiri daga wannan sarkar kuma nan da nan canja wurin bayanai akan hanyar sadarwa daga ƙwaƙwalwar na'urar kuma sanya bayanan da aka karɓa a cikin fakitin cibiyar sadarwa a cikin ƙwaƙwalwar na'urar.

Don TCP ƙwaƙwalwar na'ura ta yi aiki, ana buƙatar katin cibiyar sadarwa wanda zai iya sarrafawa daban fakitin buga kai da bayanan fakiti (nauyin kaya) a cikin buffer daban-daban. Ana ɗora bayanai daga ƙwaƙwalwar na'ura zuwa ma'aunin biyan kuɗi na NIC ta amfani da injin dmabuf, kuma ana wucewa da masu kai daga babban ƙwaƙwalwar ajiya kuma tsarin TCP/IP ya cika. Don inganta inganci, ana iya amfani da ƙarfin katunan cibiyar sadarwa don sarrafa daban-daban na gudana a cikin layukan rx daban-daban.

Bukatar tsarin musayar bayanai mai girma tsakanin na'urori yana ƙaruwa idan aka yi la'akari da yin amfani da tsarin rarrabawa don koyon injin, inda masu haɓakawa ke kan runduna daban-daban, da kuma lokacin da aka canja wurin bayanai don horar da samfuri daga SSDs na waje. gwaje-gwajen aiki da aka yi a cikin tsari tare da GPUs 4 da katunan cibiyar sadarwa 4 ya nuna cewa amfani da na'ura Memory TCP yana ba shi damar kaiwa matakin 96,6% na gudun akwai layi lokacin canja wurin bayanai kai tsaye tsakanin žwažwalwar ajiyar na'urar.

A karshe yana da kyau a ambaci hakan aiwatarwa har yanzu yana cikin matakin RFC, wato don tattaunawa da nazari ne daga al'umma, amma ba a tsara shi ba don ƙaddamar da babban reshe na kernel na Linux.

Source: https://lore.kernel.org/


Bar tsokaci

Your email address ba za a buga. Bukata filayen suna alama da *

*

*

  1. Wanda ke da alhakin bayanan: Miguel Ángel Gatón
  2. Manufar bayanan: Sarrafa SPAM, sarrafa sharhi.
  3. Halacci: Yarda da yarda
  4. Sadarwar bayanan: Ba za a sanar da wasu bayanan ga wasu kamfanoni ba sai ta hanyar wajibcin doka.
  5. Ajiye bayanai: Bayanin yanar gizo wanda Occentus Networks (EU) suka dauki nauyi
  6. Hakkoki: A kowane lokaci zaka iyakance, dawo da share bayanan ka.