Big Dhata, Yemahara Software uye Yakavhurwa Sosi: Inowanikwa Zvishandiso

Big Data ipfungwa yetekinoroji inoenderana nekutungamira kwemazana makuru e data, yakarongeka uye isina kurongeka, izvo zviri kutarisirwa parizvino neakakura mabhizinesi, tekinoroji, sainzi uye kunyangwe zvikamu zvehurumende.

Kunyangwe uchitaura nezvazvo Big Data, harisi iro iro iro data rakakosha, asi nemasangano anoita nedata iri. Sezvo Big Data, hunyanzvi hwayo hwakabatana, inogona kuiongorora kuti iwane mazano anotungamira mukuita sarudzo zviri nani, mafambiro uye marongero. Uye muchinhu ichi, Yemahara Software (SL) uye Yakavhurika Sosi (CA) dzakapa zvakawanda kune iyi tekinoroji, sezvo mafomu mazhinji akagadziridzwa akaitwa mune ino fomati yekuvandudza.

Big Data uye Mahara Software

Kune avo vane hunyanzvi mune hunyanzvi, zvakatozivikanwa kuti Yemahara Software, modhi yayo yekuvandudza, uzivi hwayo, hwakavakirwa mukugadzira matekinoroji, kunyanya zvigadzirwa zve software, izvo zvinokwanisa kushandiswa, kushandurwa uye kugoverwa zvakasununguka. Uye iyo Open Source chinhu chakakosha mukugadzirwa kwesoftware yemahara, nekuti inotarisa pane zvinobatsira zveiyi budiriro zvine simba kupfuura pamitemo yerusununguko rwechigadzirwa uye vagari.

Naizvozvo, apo Iyo SL / CA inopa pamwe nenzira dzekuita Big Data, Big Data inokwenenzvera izvi zvisina kunangana, kwete chete kubatsira kwekukurumidza kuwedzera kwekuvandudza tekinoroji, asi zvakare nerusununguko rwekuwana ruzivo rwunounzwa neBig Data.

Ndeipi data hombe?

Concept

Kune imwe yemakuru eSoftware uye nekuvandudza tekinoroji, IBM, Big Data ndeye:

«... tekinoroji yakavhura mikova kunzwisisiro nyowani uye nzira yekuita sarudzo, iyo inoshandiswa kurondedzera huwandu hwakawanda hwe data (hwakarongedzwa, husina kusarudzika uye hwakaumbwa) hunotora nguva yakareba uye hunodhura kwazvo kuisa mukati relational database yekuongorora.

Chinangwa

Big Data, hunyanzvi hwayo, hwakazvarwa uine chinangwa chekuvhara iyo yakazara spectrum yedata ongororo inogonekandiko kuti, kufukidza zvese zviripo uye zvakagadziriswa neazvino uye akasiyana matekinoroji, pamwe neizvo zvisina kugadziriswa nematekinoroji aripo, senge kuchengetedza uye manejimendi evhoriyamu hombe dzedata izvo zvine chaiwo maitiro.

Data

Bhidhi Dhata inobata mavhoriyamu e data ayo anowanzo kutsanangurwa neanotevera hunhu:

• Bhuku: Kukura kwedata kubva kunzvimbo zhinji.
• Speed: Speed ​​iyo data kubva kunzvimbo zhinji inosvika uye inotarisirwa.
• Zvakasiyana-siyana: Fomati yeiyo yakaongororwa dhata kubva kune akawanda masosi.

Ndinoreva mavhoriyamu e data ayo anowanzo kuve akaumbwa Akarongedzwa, Semi-akaumbwa uye Asina kurongeka dhata, uye inobatwa muhuwandu hwakawanda uhwo hunowanzo kurondedzerwa nezvisimboti zvehuwandu hwakawanda, senge: Tera, Peta kana Exa, pakati pevamwe.

Uye kubva kumarudzi ese ezvinowanikwa, senge Internet (Masocial network, Dhijitari Midhiya, Mawebhusaiti uye Dhatabhesi), Teams (Nhare mbozha, vatambi veMultimedia, Positioning masisitimu, eVanhu uye eindasitiri maseru maseru, pakati pevamwe) uye Masangano (Yakavanzika uye Veruzhinji, Zvekutengesa, Hurumende uye Nharaunda).

Kukosha

Chii chinoita kuti Big Data ive tekinoroji inobatsira seMasangano (Yakavanzika uye Veruzhinji, Zvekutengesa, Hurumende uye Nharaunda), ndeyekuti inopa ruzivo rwakakosha iyo nguva zhinji inoshanda seyakarurama uye yakavimbika mhinduro kumibvunzo iyo isina kana kumbobvunzwa kune mamwe mamiriro kana matambudziko. Ndokunge, kubatsira kwayo kunowanzoonekwa pane izvo zvinowanzo simuka kubva kune imwecheteyo ruzivo rwunounganidzwa nekutarisirwa.

Kugadziriswa kwemazana makuru eruzivo kunoita kuti zvive nyore kune iro rakagadziriswa dhata kuti riumbwe kana kuyedzwa nenzira yakakodzera kwazvo. kana kudoma, iyo inoonekwa seyakakodzera nemubati wayo. Izvi zvinobvumira masangano anoshandisa Big Data kuti akwanise kuona matambudziko nenzira inonzwisisika.

Iko kuunganidzwa kwemazana evhoriyamu e data uye ongororo yaro inotevera yekutsvaga maitiro mukati mawo anotendera Masangano kuti anyatso shanda nekuita, nekufamba nekukurumidza zvakanyanya, mushe uye nenzira yakakodzera pamusoro pavo. Uye zvakare, inovatendera kuti vabvise nzvimbo dzine matambudziko matambudziko asati asvika kwavari, zvichivaita kuti varasikirwe nemabhenefiti, mukurumbira kana rutsigiro.

Kubatsirwa

Big Data inobatsira Masangano kubata dhata ravo zvirinani, izvi zvinoguma nekuonekwa kwemikana mitsva yakanaka kana inogutsa yenhengo dzayo (vatengi kana vagari). Uye izvi zvakare, zvinotungamira kune zvine hungwaru uye zvine chiito zviito, kuchengetedza mumaawa / basa nemari, izvo zvinowanzo shandura kuva mufaro kune wese munhu anobatanidzwa. Kana Big Data yashandiswa, kukosha kunowanzo kuwedzerwa kune zviitiko zvinoitwa nenzira dzinotevera:

• Kuderedza mutengo: Mukuchengetedza uye manejimendi evhoriyamu hombe dzedata.
• Kuderedza nguva: Kunyanya kushanda pamwe nekubudirira mukuita sarudzo.
• Zvitsva zvigadzirwa uye masevhisi: Nekwaniso yekuyera uye kutarisira zvinodiwa nezvinetso zvevashandisi (vatengi uye / kana vagari), kugutsikana kwavo kunowedzera.

Batsirwa

Yakanyatso shandiswa Big Data kazhinji inokwanisa kuona izvo zvinokonzera kukanganisa, matambudziko uye kukanganisa mune ingangoita chaiyo nguva. Nekudaro, ndeye kufunga nezve izvo Big Data tekinoroji haisi mushonga wega pachawo. Saka kududza imwe huru yehunyanzvi senge Oracle, inogona kuwedzerwa kuti:

«Kuziva kukosha kwedata hombe hazvireve kungoiongorora (izvo zvatova mukana pachayo). "Iyi inzira yekutsvaga yakazara inoda vaongorori, vashandisi vebhizinesi, uye vatungamiriri kuti vabvunze mibvunzo kwayo, vaone mapatani, voita sarudzo zvine ruzivo, uye kufanotaura maitiro."

SL / CA Zvikumbiro zveBig Data

Pakati peMahara Software uye Open Source kunyorera izvo zvinofanirwa kutaurwa pakutsvagisa, kuyedza, uye kuitisa ndeizvi:

Yakabatana

• Apache Hadoop: Vhura sosi chikuva chakagadzirwa neHadoop Distributed File System (HDFS), Hadoop MapReduce, uye Hadoop Common.
• Avro: Apache chirongwa chinopa serialization masevhisi.
• Cassandra: Yakagoverwa isiri-yehukama dhatabhesi inoenderana neyekuchengetedza modhi ye , Yakagadzirwa muJava.
• Chukwa: Software yakagadzirirwa kuwanda-hukuru kuunganidzwa uye kuongororwa kwechiitiko matanda.
• Kuyerera: Software rine basa guru rekutungamira dhata kubva kune imwe sosi kuenda kune imwe nzvimbo.
• HBase: Columnar dhatabhesi (dhata-inotungamirwa dhatabhesi) inomhanya paHDFS.
• Mukoko: "Dura Warehouse" zvivakwa izvo zvinofambisa manejimendi makuru e data ayo akachengetwa munzvimbo yakagoverwa.
• Jaql: Unoshanda uye unodudzira mutauro unobvumidza kushandiswa kwedata muJSON fomati yakagadzirirwa kugadzirisa mavhoriyamu makuru eruzivo.
• Lucene: Software inopa mareibhurari ekunongedzera uye kutsvaga pane zvinyorwa.
• oozie: Vhura sosi purojekiti iyo inorerutsa mafirifomu uye kubatana pakati peimwe neyakaitwa.
• Nguruve: Software inobvumidza vashandisi veHadoop kuti vatarise zvakanyanya pakuongorora ese data data uye voshandisa nguva shoma kuvaka MapReduce zvirongwa.
• ZooKeeper Zvivakwa zvepakati nepakati uye masevhisi anogona kushandiswa nemaapplication kuona kuti mashandiro epakati pesumbu akaiswa serial kana kuwiriraniswa.

Independent

Vamwe vanozivikanwa zvakaenzana, asi vasina hukama neyakavhurwa sosi chikuva Hadoop ndeaya:

• Elastic search: Yakazara-zvinyorwa-zvakavakirwa pakutsvaga uye yekuongorora injini.
• MongoDB: NoSQL dhatabhesi inoenderana negwaro dhata modhi.
• Cassandra: Apache open source projekiti yakagadzirirwa NoSQL dhatabhesi manejimendi.
• CouchDB: Vhura sosi yeNoSQL dhatabhesi yakavakirwa pane zvakajairwa zviyero zvekuwanika nyore uye webhu kuenderana neakasiyana.
• Zuva: Vhura sosi yekutsvaga injini kunoenderana neLucene chirongwa Java raibhurari.
  Mamwe maRBMS maturusi: MySQL Cluster uye VoltDB.

Mhedziso

Yedu yazvino (uye nekukasira inotevera) nguva yakanyudzwa kana kunyudzwa mune yakakura uye iri kukura dhata, iyo ine zvakawanda zvekutaura seyakazara, pane yega. Naizvozvo, kushandiswa kweBig Data tekinoroji mune yazvino uye munguva pfupi iri kutevera, kunobatsira nzanga, iyo yese yevanhu, kuti vaone kusaguma kwezvinhu (zviitiko kana zvigadzirwa), izvo zvingadai zvakatora makore mazhinji kuti vazvizive. , pasina kushandiswa kweizvi.

Kubva Big Data uye zvishandiso zvayo zvinopa kukwana kwakakwana kuongorora ongorora mhedzisiro yakawanikwa nekukurumidza uye woigadzirisazve kakawanda sezvazvinodiwa, munguva pfupi, kuti uwane kukosha kwechokwadi kana kwepedyo kwauri kuyedza kusvika. Kana iwe wawana musoro weBig Data unonakidza iwe unogona kuwedzera iwo musoro zvishoma zvishoma nekuverenga Ripoti iri BBVA.