Haɗa wakili da buƙatun hoto na Scrapy

Yi ado da Requests ɗin da ImagesPipeline ke ƙirƙira domin saukar hotuna su sami wakili ba tare da sake gina dabarar buƙatu ta bututun ba.

from scrapy.pipelines.images import ImagesPipeline

class ProxiedImagesPipeline(ImagesPipeline):
    def get_media_requests(self, item, info):
        for request in super().get_media_requests(item, info):
            request.meta['proxy'] = 'http://proxy.example:8080'
            yield request

Don Scrapy 2.13.3, maye gurbin daidaitaccen shigarwar ImagesPipeline a cikin ITEM_PIPELINES da hanyar shigo da wannan ƙaramin aji. Riƙe IMAGES_STORE da sauran saituna.

Kiran iyaye yana kiyaye filin URL na hoto da aka saita da kuma kiran dawowa. Ƙaramin ajin yana ƙara hanyar buƙata kawai, wadda HttpProxyMiddleware da aka kunna ke cinyewa. Kowace URL ta hoto ta kasance makomarta. Sabbin buƙatun hotuna na jama'a marasa shaidar wakili na iya amfani da wata shigarwa daga jerin wakilan HTTP idan an ba da izinin wannan hanyar.

Buƙatun shafi suna riƙe da nasu manufofin. Tare da yanayin wakili na duniya, meta={'proxy': None} yana mai da zaɓaɓɓen buƙatar shafi kai tsaye a wannan fitowar.

Tabbatar an fitar da saukewa da gaske. Bugun ajiyar bututu na iya guje wa buƙatar cibiyar sadarwa. Don sabbin canja wuri, kwatanta shigarwar sakamakon hoto da aka kammala da URL ɗin da aka nema: ayyukan da suka yi nasara suna bayyana a can, yayin da gazawa na iya barin filin URL na asali cike. Bibiyi sakamakon da suka ɓace ta rajistan mai saukarwa da wakilin da aka zaɓa.

Labarai masu alaƙa