Akhri barta dambeeya ee proxy-ga iyo IP-ga xiriirka ee Scrapy
Isticmaal metadata-da codsiga ee proxy-ga la doortay, u qaado response.ip_address sida macluumaadka peer-ka ee uu bixiyo handler-ka, oo hubi IP-ga bixidda ee meesha loo socdo.
Markaad baarto jidka la doortay, isticmaal Request-ka ku lifaaqan jawaabta dhammaatay. Saddexda indho-indheyn kala sooc:
| Goob | Macne |
|---|---|
response.request.meta.get('proxy') | URL-ka proxy-ga la doortay ee codsigan, marka uu jiro |
response.ip_address | Cinwaanka uu bixiyo handler-ka soo dejinta, laga yaabee None |
| Warbixinta isha ee meel la aamini karo | Isha dadweynaha ee halkaas lagu arkay |
Gudaha callback-ka, ka reeb qaybaha URL-ka ee xambaarsan aqoonsiga ogeysiiska caadiga ah:
from urllib.parse import urlsplit
proxy = response.request.meta.get('proxy')
proxy_host = urlsplit(proxy).hostname if proxy else None
self.logger.info(
'target_host=%s proxy_host=%s peer_ip=%s',
urlsplit(response.url).hostname, proxy_host, response.ip_address,
)Handler-ka HTTP/1.1 ee Scrapy 2.13.3 cinwaanku wuxuu ka yimaadaa peer-ka xiriirka jawaabta, ma aha adeeg IP bixid. Waddooyinka qaarkood, oo ay ku jiraan jawaabaha dhererkoodu eber yahay, waxay ka tagi karaan None. Handler-yada kale si kale ayay u buuxin karaan. None keligiis ma caddeeyo marin toos ah.
Si loo hubiyo bixidda, waydii barta dambeeya ee la aamini karo marka la raaco siyaasadda proxy-ga loogu talagalay oo hayso aqoonsiga codsiga indho-indheynta. Middleware-ka wareegaya waxa uu hubin dambe siin karaa barta kale.
Dib-u-jiididda sidoo kale waxay abuurtaa codsi kale. Metadata-da ugu dambeeya waxay sharraxaan marxaladdaas; baadh taariikhda dib-u-jiididda iyo dib-u-doorasho kasta oo middleware ah halkii aad u qaadan lahayd caddayn jidka URL-ka kowaad.