Crawlee 3 yana haɗa URL na wakili da ID na zama

Yi amfani da hujjar zama ta ProxyConfiguration a Crawlee 3.14 don zaɓin hanya mai tsayawa, kuma yi la'akari da canza tsarin mallaka a takardun ƙaura zuwa v4.

A cikin Crawlee 3.14, ProxyConfiguration na iya haɗa ID na zama da URL na wakili da aka zaɓa:

import { ProxyConfiguration } from 'crawlee';

const proxies = new ProxyConfiguration({
  proxyUrls: [
    'http://proxy-a.example:8080',
    'http://proxy-b.example:8080',
  ],
});
const first = await proxies.newUrl('checkout-a');
const sameRoute = await proxies.newUrl('checkout-a');
const anotherSession = await proxies.newUrl('checkout-b');

Jerin wakilan HTTP yana ba da 'yan takara na jama'a don proxyUrls. Maimaita kira da wannan ID na zama yana mayar da URL ɗin da aka haɗa da shi. Idan babu ID na zama, jerin da aka bayar yana juyawa bi da bi. Wannan yana zaɓar wurin ƙarshe da aka saita; sabis na sama da ke juyar da fita a bayan URL ɗaya har yanzu yana sarrafa halin fita nasa.

Don zama da crawler ke sarrafawa, yi amfani da tafkin zama na crawler da tsarin adana kukis. Rage maxConcurrency zuwa ɗaya ba ya maye gurbin ayyana waɗanne buƙatu ke cikin zama ɗaya.

Fitar da zama yana ƙirƙirar sabuwar iyakar ainihi. Ka riƙe hanyarsa, kukis ɗinsa da yanayin aikin sa daidai maimakon juyar da fili ɗaya kawai yayin shiga ko aiki mai matakai da yawa.

Babban sigar yana da muhimmanci. Takardun ƙaura na Crawlee zuwa v4 suna cire hujjar sessionId daga newUrl kuma suna motsa haɗin wakili zuwa mallakar Session. Misalin da ke sama yana amfani da hanyar v3 da gangan; kada ka kwafa hujjarsa zuwa wata babbar siga ba tare da daidaita wannan tsarin rayuwa ba.

Labarai masu alaƙa