I-Crawlee 3 ihlanganisa i-proxy URL ne-session ID

Sebenzisa i-session argument ye-ProxyConfiguration ku-Crawlee 3.14 ukuze ukhethe umzila ozinzile, futhi ubheke imodeli yobunikazi eshintshile emibhalweni yokufuduka ku-v4.

Ku-Crawlee 3.14, i-ProxyConfiguration ingahlanganisa isihlonzi se-session ne-proxy URL ekhethiwe:

import { ProxyConfiguration } from 'crawlee';

const proxies = new ProxyConfiguration({
  proxyUrls: [
    'http://proxy-a.example:8080',
    'http://proxy-b.example:8080',
  ],
});
const first = await proxies.newUrl('checkout-a');
const sameRoute = await proxies.newUrl('checkout-a');
const anotherSession = await proxies.newUrl('checkout-b');

Uhlu lwe-proxy ye-HTTP luhlinzeka ngabazongenela umphakathi be-proxyUrls. Izingcingo eziphindwayo nge-session ID efanayo zibuyisela i-URL ehlanganiswe nayo. Uma i-session ID ingekho, uhlu olunikeziwe luyazungeza. Lokhu kukhetha indawo yokugcina elungiselelwe; isevisi ephezulu edonsa iziphumuli ngemuva kwe-URL eyodwa isalawula ukuziphatha kwayo kokuphuma.

Kuma-session aphethwe yi-crawler, sebenzisa ichibi lama-session le-crawler kanye nokugcinwa kwama-cookie. Ukwehlisa i-maxConcurrency kube kukodwa akusikho ukumisela ukuthi yiziphi izicelo ezisetshenziswa ku-session eyodwa.

Ukuhoxisa i-session kudala umngcele omusha wobunikazi. Gcina umzila wayo, ama-cookie nesimo somthwalo womsebenzi kuhambisana esikhundleni sokuzungezisa inkambu eyodwa ngesikhathi sokungena noma umsebenzi wezinyathelo eziningi.

Inguqulo enkulu ibalulekile. Imibhalo yokufuduka kwe-Crawlee ku-v4 isusa i-sessionId argument ku-newUrl futhi ihambisa ukuhlanganiswa kwe-proxy kubunikazi be-Session. Isibonelo esingenhla sisebenzisa i-v3 interface ngamabomu; ungakopishi i-argument yayo kwenye inguqulo enkulu ngaphandle kokulungisa lowo mjikelezo wokuphila.

Izihloko ezihlobene