Idatabricks ikhuphe ikhowudi yeDelta Lake kunye neMLflow

Ngexesha leNgqungquthela yeDatha + ye-AI Izitena zedatha zityhiliwe ngentengiso, eyayiza kukhulula yonke inkqubo yokugcina yeDelta Lake umthombo ovulekileyo phantsi kweliso leSiseko seLinux.

Kufanelekile ukuba ukhankanye loo nto I-Delta Lake ibiyiprojekthi yeSiseko seLinux ukusukela ngo-Okthobha ka-2019 kwaye ngumaleko wokugcinwa ovulekileyo ozisa ukuthembeka kunye nokusebenza kumachibi edatha ngokusebenzisa "i-architectures yamachibi", eyona nto ingcono yokugcina idatha kunye namachibi edatha phantsi kophahla olulodwa.

Kule minyaka mithathu idlulileyo, iLakehouses ibe sisisombululo esikhangayo kwiinjineli zedatha, abahlalutyi, kunye nososayensi bedatha abafuna ukuguquguquka ukuze baqhube imisebenzi eyahlukeneyo kwidatha efanayo kunye nobunzima obuncinci kwaye akukho ukuphindaphinda, ukusuka kuhlalutyo ukusuka kwidatha ukuya kuphuhliso koomatshini bokufunda. . I-Delta Lake yeyona fomati yendlu yechibi esetyenziswa kakhulu kwihlabathi kwaye ngoku ibona ngaphezulu kwe-7 yezigidi ezikhutshelweyo ngenyanga (kwaye ikhula).

“Ukususela ekuqaleni, iDatabricks izibophelele kwimigangatho evulekileyo kunye noluntu oluvulelekileyo. Sidale, saba negalelo, sakhuthaza ukukhula kwaye sanikela ngezona zinto zintsha zinefuthe kwitekhnoloji yomthombo wangoku ovulelekileyo, utshilo uAli Ghods.

Oko ikukuthi Akusayi kuphinda kubekho umahluko osebenzayo phakathi kohlobo lweDelta Lake lweDatabricks kunye nenguqulelo yomthombo ovulekileyo. Inkampani ithe iza kukhupha izixhasi zayo zakutsha nje kwiqonga lokufunda lomatshini weMLflow kunye nesikhokelo sohlalutyo se-Apache Spark. I-Databricks iye yakhupha amanqaku amaninzi amatsha kwi-Lakehouse data echibini.

“Phambi kweDelta Lake, ubugcisa obufana neSpark bucubungule isixa esikhulu sedatha; I-Delta Lake ikuvumela ukuba usebenze i-deltas encinci kunye nazo zonke iinguqu ezigcinwe kwimbali ukuze ukwazi ukubuyela emva naphambili, "utshilo u-Ali Ghodsi Co-Founder of Databricks kunye ne-CEO yeDatabricks. "Oku kubalulekile kwiindlela zophicotho kunye nokuthotyelwa ukuze ubuyele emva kwaye ufumane izigqibo ozenzileyo kunyaka odlulileyo."

Ukongeza, kufuneka kuqatshelwe ukuba inguqulo entsha ye-2.0 yeDelta Lake ibonisa ukusebenza kombuzo ongcono kunye nesiseko esisekelwe kwimigangatho evulekileyo. Umgqatswa wokukhululwa uyafumaneka ngoku kwaye kulindeleke ukuba aphume ngokubanzi kamva kulo nyaka.

Databricks yatsho njalo uhlaziyo lubonisa igalelo elivela kubaphuhlisi abangaphezu kwe-6400 kwaye yaqaphela ukuba izibophelelo zizonke zikhule nge-95% kunye ne-avareji yenani lemigca yekhowudi kwisibophelelo ngasinye enyuke ngama-900% kulo nyaka uphelileyo.

Inkampani ikwabhengeza inguqulelo 2.0 yeMLflow, iqonga lokulawula iiprojekthi zokufunda koomatshini. Ukuphehlelelwa ibandakanya iMibhobho, into entsha yokukhawulezisa kunye nokwenza lula ukuhanjiswa kwemodeli yokufunda koomatshini. Imibhobho inika izazinzulu zedatha ngokuchazwa kwangaphambili, iitemplates ezilungele ukuveliswa ngokusekelwe kuhlobo lwemodeli abayakhayo ukwenzela ukuba uphuhliso lwemodeli olukhawulezayo noluthembekileyo ngaphandle kokufuna ungenelelo kwiinjineli zemveliso.

Abasebenzisi banokuchaza izinto zombhobho kwifayile yoqwalaselo kunye ne-MLflow Pipelines ilawula ukubulawa ngokuzenzekelayo, inkampani yathi. I-Databricks yongeze ii-terminals zemodeli ezingenasiphelo ukuxhasa ngokuthe ngqo imodeli yokuvelisa imodeli, kunye nemodeli eyakhelwe-ngaphakathi yeedashbhodi zokubeka iliso ukunceda amaqela ahlalutye imodeli yokwenene yehlabathi.

“Iprojekthi yeDelta Lake ifumana umsebenzi omangalisayo kunye neendlela zokukhula ezibonisa ukuba uluntu oluphuhlisayo lufuna ukuba yinxalenye yeprojekthi. Amandla abaxhasi anyuswe ngama-60% kulo nyaka uphelileyo kwaye ukukhula kwezibophelelo zizonke kunyuke nge-95% kwaye umyinge womgca wekhowudi kwisibophelelo ngasinye unyuke nge-900%. Sibona oku kunyuka kwesantya kwimibutho enegalelo efana ne-Uber Technologies, Walmart, kunye ne-CloudBees, Inc., phakathi kwabanye. " —UMlawuli oLawulayo weLinux Foundation, uJim Zemlin.

Ukuba ukhona unomdla wokwazi ngakumbi malunga nayo, unokujonga iinkcukacha Kule khonkco ilandelayo.


Umxholo wenqaku uyabambelela kwimigaqo yethu imigaqo yokuziphatha yokuhlela. Ukuxela impazamo cofa apha.

Yiba ngowokuqala ukuphawula

Shiya uluvo lwakho

Idilesi yakho ye email aziyi kupapashwa.

*

*

  1. Uxanduva lwedatha: UMiguel Ángel Gatón
  2. Injongo yedatha: Ulawulo lwe-SPAM, ulawulo lwezimvo.
  3. Umthetho: Imvume yakho
  4. Unxibelelwano lwedatha: Idatha ayizukuhanjiswa kubantu besithathu ngaphandle koxanduva lomthetho.
  5. Ukugcinwa kweenkcukacha
  6. Amalungelo: Ngalo naliphi na ixesha unganciphisa, uphinde uphinde ucime ulwazi lwakho.