U dooro proxy kasta oo ka mid ah kheyraadka Splash

Dooro proxy-ga Splash heerka render ama gudaha on_request callback marka kheyraadka gaar ah u baahan yihiin dariiqooyin kala duwan.

Codsiga Scrapy wuxuu si guul leh u gaari karaa Splash, halka browser-ka ku jira Splash uu weli u baahan yahay dariiqa bixitaanka oo kala duwan. Kuwani waa laba xiriir:

Scrapy → Splash API
Splash browser → forward proxy → website

Hal proxy halkii render, gudbi doodda proxy ee HTTP API. Splash 3.5 waxay diiwaangelisaa URL proxy sida http://proxy.example:8080, ama magaca proxy-profile la habeeyay. Qaabka URL-keeda waxay sidoo kale taageertaa SOCKS5 iyo aqoonsiga ikhtiyaariga ah.

Marka kheyraadka bogga gaar ah u baahan yihiin dhibco kala duwan, isticmaal script execute oo diiwaangeli doorashada ka hor navigation:

function main(splash, args)
  splash:on_request(function(request)
    local host = args.default_proxy
    if request.url == args.special_resource then
      host = args.special_proxy
    end
    request:set_proxy{host = host, port = 8080, type = 'HTTP'}
  end)

  assert(splash:go(args.url))
  return splash:html()
end

Gudbi default_proxy iyo special_proxy sida magacyo martigeliyaha, iyo special_resource sida URL-ka saxda ah ee kheyraadka si gooni loo maro. Beddel port-ka kaliya ee tusaalaha marka labada dhageystayaal ay kala duwan yihiin. Kheyraadka kale waxay helaan dariiqa caadiga ah. Liiska proxy HTTP wuxuu bixiyaa musharrixiinta dhibcaha dhamaadka ee beerahan martigeliyaha iyo port-ka marka dariiqooyinka kheyraadka dadweynaha la ogolaaday oo aan aqoonsi proxy lagu darin musharrixiinta.

Habka request wuxuu aqbalaa beeraha username iyo password ee ikhtiyaariga ah. Nooca HTTP, yoolalka HTTPS waxay isticmaalaan CONNECT iyada oo loo marayo proxy-ga HTTP; uma baahna nooc proxy HTTPS la hindisay.

Callback-ku wuxuu socdaa ka hor codsi kasta. Hababka request ma beddeli karaan codsi ka dib marka la diro, callback-kuna ma wici karo hababka Splash asynchronous sida splash:go ama splash:wait.

Hayso doorashada dariiqa mid deggan marka boggu filayo hal fadhi ama aqoonsi hal il. U qoondaynta sawir kasta iyo codsi API si random ah meel kale oo bixitaan ah waxay soo saari kartaa bog la render oo codsiyadiisu aanay hadda ka tirsanayn hal fadhi isku xiran.

Maqaallo la xiriira