Zazzage dukkan rukunin yanar gizo tare da wget koda kuwa akwai takura

Menene wget?

Ba abin da ya fi wikipedia don bayyana abin da wannan kayan aikin ya ƙunsa:

GNU Wget kayan aikin kayan aikin kyauta ne wanda ke ba da damar sauke abubuwa daga sabar yanar gizo ta hanya mai sauƙi. Sunanta ya samo asali ne daga Gidan yanar gizo na Duniya (w), kuma daga "get" (a Turanci samu), wannan yana nufin: samu daga WWW.

A halin yanzu yana tallafawa saukarwa ta amfani da ladabi na HTTP, HTTPS da FTP.

Daga cikin fitattun sifofin da take bayarwa wget akwai yiwuwar sauƙaƙan sauke abubuwa masu rikitarwa a cikin madubi akai-akai, sauya hanyoyin haɗi don nuna abubuwan HTML a cikin gida, tallafi don wakilta ...

De wget Mun riga mun yi magana isa a nan a DesdeLinux. A gaskiya ya Mun ga yadda ake saukar da cikakken rukunin gidan yanar gizo tare da wget, matsalar kuwa ita ce, a halin yanzu masu gudanarwa ba koyaushe suke barin kowa ya saukar da gidan yanar gizon su duka haka ba, ba wani abu bane da suke so sosai ... kuma, a bayyane na fahimta. Shafin yana nan akan Intanet don tuntubarsa, mai karatu yana samun damar abun cikin sha'awa kuma mai gudanar da shafin yana cin riba sosai (ta hanyar talla), kamar ziyara, da sauransu. Idan mai karatu ya saukar da shafin a kwamfutarsa, ba lallai bane ya hau yanar gizo don tuntubar wani rubutu da ya gabata ba.

Don sauke rukunin yanar gizo tare da wget yana da sauƙi kamar:

wget -r -k http://www.sitio.com

• -r : Wannan yana nuna cewa za a saukar da dukkanin rukunin gidan yanar gizon.
• -k : Wannan yana nuna cewa hanyoyin yanar gizon da aka zazzage za a canza su ta yadda za a iya kallon su ta kwamfuta ba tare da intanet ba.

Yanzu, abubuwa suna da rikitarwa lokacin da mai gudanarwa ta yanar gizo ta sanya mana wahala ...

Waɗanne ƙuntatawa zasu iya kasancewa?

Mafi sanannen abin da zamu iya samu shine cewa ana ba da izinin shiga kawai idan kuna da ƙwarewar UserAgent. A takaice, shafin zai gane cewa UserAgent da ke sauke shafuka da yawa ba ɗaya daga cikin "na al'ada" ba saboda haka zai rufe hanya.

Hakanan ta hanyar fayil din robots.txt zaka iya tantance wancan wget din (kamar tarin yawa kayan aikin kama) Ba za ku iya yin kwafa kamar yadda abokin ciniki yake so ba, da kyau ... da kyau, mai kula da shafin yana so, lokaci 😀

Yaya za a keta waɗannan ƙuntatawa?

A karon farko zamu kafa UserAgent don wget, zamu iya yin wannan tare da zaɓi –Mai wakilcin, a nan zan nuna muku yadda:

wget --user-wakili = "Mozilla / 5.0 (X11; Linux amd64; rv: 32.0b4) Gecko / 20140804164216 ArchLinux KDE Firefox / 32.0b4" -r http://www.site.com -k

Yanzu, don yin kusa da robots.txt, kawai keɓe wannan fayil ɗin, wato, bari wget ya sauke rukunin yanar gizon kuma kar ku damu da abin da robots.txt ya ce:

wget --user-wakili = "Mozilla / 5.0 (X11; Linux amd64; rv: 32.0b4) Gecko / 20140804164216 ArchLinux KDE Firefox / 32.0b4" -r http://www.site.com -k-robots = kashe

Yanzu ... akwai wasu zaɓuɓɓuka ko sigogi waɗanda za mu iya amfani da su don yaudarar shafin har ma da ƙari, misali, nuna cewa mun shiga shafin daga Google, a nan na bar layin ƙarshe tare da komai:

wget --header = "Accept: rubutu / html" --user-agent = "Mozilla / 5.0 (X11; Linux amd64; rv: 32.0b4) Gecko / 20140804164216 ArchLinux KDE Firefox / 32.0b4" --referer = http: / /www.google.com -r http://www.site.com -e mutummutumi = kashe -k

Shin yayi kyau ayi wannan?

Wannan ya dogara ... koyaushe ku ganshi daga duka ra'ayoyin biyu, daga mai kula da rukunin yanar gizo amma kuma daga mai karatu.

A gefe guda, a matsayina na mai gudanarwa, ba zan so cewa suna ɗaukar kwafin HTML na shafin yanar gizo kamar haka ba, a nan kan layi ne ba don jin daɗi ba, don jin daɗin duka ... burinmu shi ne samun abubuwan da ke da ban sha'awa a gare ku, waɗanda za ku koya.

Amma, a gefe guda ... akwai masu amfani waɗanda ba su da intanet a gida, waɗanda za su so duk sashin Koyarwar da muka sanya a nan ... Na sanya kaina a wurin su (a gaskiya ni ne, domin a gida ba ni da intanet) kuma ba shi da daɗin zama kan kwamfutar, samun matsala ko son yin wani abu da rashin iyawa saboda ba ku da damar shiga cibiyar sadarwar yanar gizo.

Ko daidai ne ko kuskure ne ga kowane mai gudanarwa, gaskiyar kowane mutum ... abin da zai fi damuna shine amfani da albarkatun da ke haifar da sabar, amma tare da kyakkyawan tsarin ɓoye ya isa ga saba bai wahala ba.

ƘARUWA

Ina rokonka kar ka fara downloading yanzu. DesdeLinux HA HA HA!! Misali, budurwata ta ce in sauke wasu daga cikin Geometry Dash Cheats (wani abu kamar Geometry Dash Cheats), ba zan zazzage dukkan gidan yanar gizon ba, amma kawai zan bude shafin da nake so in ajiye shi a PDF ko HTML ko wani abu, wannan shine. abin da zan ba ku shawara.

Idan kuna da koyawa DesdeLinux wanda kake son adanawa, ka adana shi a cikin alamominka, azaman HTML ko PDF...

To babu komai, ina fata yana da amfani ... gaisuwa