I-HSE, injini yokugcina yomthombo ovulekile, elungiselelwe i-SSE ye-SSD

I-Micron Technology (inkampani egxile ekukhiqizweni kwe-DRAM kanye ne-flash memory) imemezele ukwethulwa kwenjini entsha ebizwa ngokuthi "i-HSE" (i-Heterogeneous-memory Storage Engine), eyathuthukiswa kucatshangelwa izici ezithile zokusetshenziswa kumayunithi e-SSD ngokusekelwe ku-NAND flash (X100, TLC, QLC 3D NAND) noma i-read-only memory (NVDIMM).

Injini yakhelwe njengomtapo wolwazi wokushumeka kwezinye izinhlelo zokusebenza futhi isekela ukucutshungulwa kwedatha enani elibalulekile . Ikhodi ye-HSE ibhalwe ngo-C futhi isatshalaliswa ngaphansi kwelayisensi ye-Apache 2.0.

Phakathi kwezinhlelo zokusebenza zenjini kukhona isitoreji sedatha esisezingeni eliphansi ku-NoSQL DBMS, isitoreji esichazwe yisoftware (SDS) njenge-Ceph kanye ne-Scality RING, amapulatifomu okucubungula inani elikhulu ledatha (i-Big Data), izinhlelo ze-high-performance computing (i-HPC), amadivayisi e-Internet of Things (i-IoT), kanye nezixazululo zezinhlelo zokufunda komshini.

I-HSE ayilungiselelwe ukusebenza okuphezulu kuphela kodwa futhi nokuqinisekisa ukuqina kwezinhlobo ezahlukene ze-SSD. Isivinini esikhulu sitholakala ngemodeli yokugcina ehlanganisiwe: idatha efanele kakhulu igcinwa ku-cache, okunciphisa inani lokufinyelela kuma-disk.

Njengesibonelo sokuhlanganisa i-injini entsha kumaphrojekthi wezinkampani zangaphandle, kwalungiswa uhlobo oluqondiswe kumadokhumenti lwe-MongoDB DBMS, eyahunyushelwa ukusebenzisa i-HSE.

Ngokobuchwepheshe, i-HSE isekelwe kumojuli eyengeziwe eyinhloko, i-mpool , esebenzisa isikhombimsebenzisi esikhethekile sokugcina izinto zama-drive aqinile, kucatshangelwa amakhono azo nezici zazo, ngaleyo ndlela kuvunyelwe izici zesivinini nokuqina ezihlukile. I-Mpool futhi iyintuthuko yomthombo ovulekile yi-Micron Technology, ekhishwe kanyekanye ne-HSE, kodwa ivelele njengephrojekthi yengqalasizinda ehlukile. I-Mpool ithatha ukusetshenziswa kwememori eqhubekayo kanye nesitoreji sendawo, kodwa okwamanje kusekelwa ama-SSD endabuko kuphela.

Ukuhlolwa kokusebenza okusebenzisa iphakheji ye-YCSB (Yahoo Cloud Serving Benchmark) kubonise ukwanda okukhulu kokusebenza lapho kusetshenziswa isitoreji esingu-2 TB ngokucubungula ibhulokhi yedatha engu-1 KB. Ukwanda okukhulu kokusebenza kubonwe esivivinyweni ngokusatshalaliswa okufanayo kwemisebenzi yokufunda nokubhala.

Isibonelo, i-MongoDB enenjini ye-HSE ibonakale ishesha cishe izikhathi ezingu-8 kunenguqulo enenjini ejwayelekile ye-WiredTiger, kanti injini ye-RocksDB DBMS iphumelele kakhulu kune-HSE izikhathi ezingaphezu kwezingu-6. Izinkomba zokusebenza ezinhle kakhulu nazo ziyabonakala ezivivinyweni, ezazinemisebenzi yokufunda engu-95% kanye nezinguquko noma izengezo ezingu-5% kuphela.

Olunye uvivinyo olwenziwe lubandakanya ukusebenza okufundwayo kuphela, kukhombisa inzuzo engaba ngama-40%. Ukwanda kokusinda kwama-SSDs ngesikhathi sokubhala kuqhathaniswa nesisombululo esise-RocksDB kulinganiselwa ukuthi kube izikhathi eziyi-7.

Izici ezibalulekile ze-HSE:

  • Ukusekelwa kwama-opharetha ajwayelekile futhi athuthukile ukucubungula idatha ngefomethi yokhiye / yenani;
  • Ukusekelwa okuphelele kokuthengiselana kanye namandla okuhlukanisa izingxenye zesitoreji ngokwakha izifinyezo (izifinyezo zingasetshenziswa futhi ukugcina amaqoqo ahlukile esitolo).
  • Amandla wokusebenzisa izikhombisi ukudabula idatha kuzethulo ezisuselwe kuzithombe.
  • Imodeli yedatha elungiselelwe izinhlobo zomthwalo ezihlanganisiwe endaweni yokugcina eyodwa.
  • Izindlela eziguquguqukayo ukuphatha ukuthembeka kwesitoreji.
  • Izikimu zokwenziwa kwedatha ezenziwe ngokwezifiso (ukusatshalaliswa ngezinhlobo ezahlukahlukene zememori ekhona endaweni yokugcina izinto).
  • Umtapo wezincwadi one-C API engaxhunyaniswa ngamandla kunoma yiluphi uhlelo lokusebenza.
    Amandla wokukala kuma-terabyte wedatha namakhulu ezigidigidi zokhiye kwisitoreji.
  • Ukusebenza okusebenzayo kwezinkulungwane zemisebenzi efanayo.
  • Ukwanda okuphawulekayo komkhawulokudonsa, ukunciphisa ukubambezeleka, nokukhuphuka kokufunda / ukubhala kwezinhlobo ezahlukahlukene zomthwalo womsebenzi kuqhathaniswa nokusebenza okujwayelekile.
  • Amandla wokusebenzisa amakilasi ahlukene ama-SSDs kusitoreji esifanayo ukukhulisa ukusebenza nokuqina.

Ungafinyelela ikhodi yenjini kusuka kusixhumanisi esilandelayo.


Engeza njengomthombo okhethwayo ku-Google