I-jar yamakhukhi ye-Scrapy ingeyaseshini, hhayi ku-proxy ngokuzenzakalela

Khetha ubunikazi obucacile bekhukhi jar lapho imisebenzi eminingi ye-proxy yabelana ngesicabucabu esisodwa, bese udlulisa lobo bunikazi ezinwetshini ezilandelayo.

Ukushintsha i-proxy akushintshi amakhukhi esicabucabu ngokuzenzakalela. Lokho kungaba usizo kuseshini eyodwa eqhubekayo futhi kumangaze lapho amaseshini amaningi azimele abelana ngesicabucabu esisodwa.

I-middleware yamakhukhi ye-Scrapy isekela amajar ahlukene akhethwa yi-metadata cookiejar yesicelo. Nika lelo khiye ubunikazi obuhlose ukubugcina ngempela:

yield scrapy.Request(
    'https://example.com/start',
    meta={'proxy': selected_proxy, 'cookiejar': 'workflow-17'},
)

I-endpoint nokhiye wejar yizinqumo ezizimele. Ukukhangela komphakathi okungaqinisekisiwe kungathatha i-endpoint yayo ye-HTTP ekhethiwe kusuka kuhlu lwama-proxy e-HTTP lapho lo mzila uvunyelwe khona; umsebenzi usengumnikazi wokhiye wejar. Isicelo esilandelayo okufanele sihlale kule seshini sidinga ukhiye wejar ofanayo; i-metadata ayinamatheli ngokuzenzakalela kuso sonke isicelo esisha osidalayo. Dlulisa izinkambu ezithile ezidingwa umsebenzi esikhundleni sokukopisha ngobumpumputhe yonke i-metadata ye-middleware.

Ukusebenzisa ikheli le-proxy njengokhiye wejar kuwumgomo owodwa kuphela

Leyo ndlela emfushane ihlanganisa isimo nge-endpoint. Ayihlanganisi ngempela ngomuntu, i-akhawunti noma ukuphuma komphakathi. I-endpoint eyodwa yomhlinzeki ingashintsha ukuphuma, futhi ama-akhawunti amaningi angasebenzisa i-endpoint efanayo.

Emsebenzini ogunyaziwe odinga isimo esizinzile, rekhoda ngokwehlukana isihlonzi se-akhawunti/iseshini, isihlonzi sejar nomzila okhethiwe. Uma unquma ukushintsha umzila phakathi nendawo, nquma futhi okufanele kwenzeke kuseshini yohlelo lokusebenza.

Amajar ahlukene avimbela ukwabelana ngamakhukhi ngengozi phakathi kwamaqembu owachazile. Awathembisi ukuthi indawo ekuyiwa kuyo ayikwazi ukuhlobanisa izicelo ezimbili nge-akhawunti noma enye idatha yohlelo.

Uma ikhasi elingalungile lisaqhubeka ngemuva kokushintsha ama-IP, hlola ukuthi iyiphi ijar eyathumela isicelo ngaphambi kokususa wonke amakhukhi noma ukushintsha lonke iqoqo lama-proxy. Isimo esigciniwe singachaza ikhasi kahle impela.

Izihloko ezihlobene