Bincika lokacin ƙarewar proxy na Puppeteer ta buƙata da matakin shafi

Yi amfani da requestfailed don gazawar cibiyar sadarwa da matsayin HTTPResponse don amsoshin uwar garke kafin ka zargi proxy da jinkirin kewaya cikakken shafi.

Amsa mai sauri daga curl ko Axios yawanci hanya ɗaya ce. Puppeteer kuma na iya ɗebo rubutun kode, hotuna, firam ko API daga mashigai da yawa, sannan ya jira wani matakin shafi na gaba.

Tunda an riga an saita proxy a shafin da ke akwai, lura da gazawa ɗaya-ɗaya yayin kewayawa:

page.on("requestfailed", request => {
  console.log(request.url(), request.failure()?.errorText);
});

await page.goto(targetUrl, {
  waitUntil: "domcontentloaded",
  timeout: 30000,
});

Gudanar da wannan a cikin tsarin aiki na async tare da ainihin targetUrl. Misalin yana jiran DOMContentLoaded, wanda ya zo kafin kammala kowace hoton da ake buƙata ko amsar aikace-aikace ta gaba. Kwatanta wannan matakin da wanda ainihin kewayawa ya jira: babban takarda, DOM, load ko kwanciyar cibiyar sadarwa sakamako ne daban-daban.

Amsar 403 ko 500 ba lamarin requestfailed ba ne. Karanta matsayin ta hanyar HTTPResponse kuma.

Yi amfani da abubuwan lura don gano hanya mai jinkiri ko da aka ƙi, tabbatarwa maimaita, ko wani yanayin jira na gaba. Dogon lokacin ƙarewa yana ƙara tsawon jira ne kawai; ba ya rage aikin burauza kuma ba ya tabbatar da an karɓi kowace hanyar haɗin hanya.

Labarai masu alaƙa