Ngexesha leNgqungquthela yeDatha + ye-AI Izitena zedatha zityhiliwe ngentengiso, eyayiza kukhulula ngokupheleleyo isakhelo sogcino lweDelta Lake kwindawo evulekileyo phantsi kweliso leSiseko seLinux.
Kufanelekile ukuba ukhankanye loo nto I-Delta Lake ibiyiprojekthi yeSiseko seLinux ukusukela ngo-Okthobha ka-2019 kwaye ngumaleko wokugcinwa ovulekileyo ozisa ukuthembeka kunye nokusebenza kumachibi edatha ngokusebenzisa "izakhiwo zechibi," ezona ndawo zokugcina idatha kunye namachibi edatha phantsi kophahla olulodwa.
Kule minyaka mithathu idlulileyo, iLakehouses ibe sisisombululo esikhangayo kwiinjineli zedatha, abahlalutyi kunye nososayensi bedatha abafuna ukuguquguquka kokuqhuba imisebenzi eyahlukeneyo kwidatha efanayo kunye nobunzima obuncinci kwaye akukho ukuphindaphinda, ukusuka kuhlalutyo ukusuka kwidatha ukuya kuphuhliso loomatshini bokufunda. I-Delta Lake yeyona fomati yendlu yechibi esetyenziswa kakhulu kwihlabathi kwaye ngoku ibona ngaphezulu kwe-7 yezigidi ezikhutshelweyo ngenyanga (kunye nokukhula).
“Ukususela ekuqaleni, iDatabricks izibophelele kwimigangatho evulekileyo kunye noluntu oluvulelekileyo. “Sidale, saba negalelo, sikhuthaze ukukhula kwaye sanikela ngowona tshintsho lunempembelelo kwitekhnoloji yomthombo ovulekileyo wale mihla,” utshilo u-Ali Ghods.
Oko ikukuthi Akusayi kuphinda kubekho iyantlukwano esebenzayo phakathi kwe-Databricks' Delta Lake brand kunye nenguqulelo yomthombo ovulekileyo. Inkampani ithe iyakukhupha ngokufanayo izixhasi zayo zamva nje kwiqonga le-MLflow yokufunda umatshini kunye nesakhelo sohlalutyo se-Apache Spark ukuvula umthombo. I-Databricks iphinde yaphunyezwa amanqaku amaninzi amatsha kwi-Lakehouse data echibini.
“Phambi kweDelta Lake, ubugcisa obufana neSpark bucubungule inani elikhulu ledatha; I-Delta Lake ikuvumela ukuba usebenze i-deltas encinci kunye nazo zonke iinguqu ezigcinwe kwimbali ukuze ukwazi ukubuyela emva naphambili, "utshilo u-Ali Ghodsi umseki weDatabricks kunye ne-CEO yeDatabricks. "Oku kubalulekile kwiindlela zophicotho kunye nokuthobela, ukuze ubuyele umva kwaye ufumane izigqibo ozenzileyo kunyaka ophelileyo."
Ngaphezu koko, kufuneka kuqatshelwe ukuba inguqulo entsha ye-Delta Lake 2.0 ibonisa ukusebenza kombuzo ongcono kunye nesiseko esisekelwe kwimigangatho evulekileyo. Umgqatswa wokukhululwa uyafumaneka ngoku kwaye kulindeleke ukuba ahambe ngokubanzi ekupheleni kwalo nyaka.
Databricks yathetha loo nto Uhlaziyo lubonisa igalelo elivela kubaphuhlisi abangaphezu kwe-6400 kwaye yaqaphela ukuba izibophelelo zizonke zikhule nge-95% kunye ne-avareji yemigca yekhowudi kwisibophelelo ngasinye sonyuke ngama-900% kulo nyaka uphelileyo.
Inkampani ikwabhengeza inguqulelo 2.0 yeMLflow, iqonga lokulawula iiprojekthi zokufunda koomatshini. Ukuphehlelelwa ibandakanya iMibhobho, into entsha yokukhawulezisa kunye nokwenza lula ukuhanjiswa kwemodeli yokufunda koomatshini. Imibhobho inika izazinzulu zedatha echazwe kwangaphambili, iitemplates ezilungele ukuveliswa ngokusekelwe kuhlobo lwemodeli abayakhayo ukwenzela ukuba uphuhliso olukhawulezayo, oluthembekileyo ngakumbi ngaphandle kokufuna ungenelelo kwiinjineli zemveliso.
Abasebenzisi banokuchaza izinto zemibhobho kwifayile yoqwalaselo kunye ne-MLflow Pipelines ilawula ukubulawa ngokuzenzekelayo, inkampani yathi. I-Databricks iye yongeza i-serverless endpoints imodeli yokuxhasa ngokuthe ngqo imodeli yemveliso yokubamba, kunye nemodeli edibeneyo yokubeka iliso kwiideshibhodi ukunceda amaqela ahlalutye imodeli yokwenene yehlabathi.
“Iprojekthi yeDelta Lake ifumana umsebenzi omangalisayo kunye neendlela zokukhula ezibonisa ukuba uluntu oluphuhlisayo lufuna ukuba yinxalenye yeprojekthi. Amandla abaxhasi anyuke nge-60% kulo nyaka uphelileyo kwaye ukukhula kwitotali yeziphoso kunyuke nge-95% kwaye umyinge womgca wekhowudi kwisibophelelo ngasinye unyuke nge-900%. "Sibona oku kunyuka kwesantya kwimibutho enegalelo efana ne-Uber Technologies, Walmart, kunye ne-CloudBees, Inc., phakathi kwabanye." -UMlawuli oyiNtloko weSiseko seLinux uJim Zemlin.
Ukuba ukhona unomdla wokufunda ngakumbi malunga nayo, unokujonga iinkcukacha Kule khonkco ilandelayo.