Samun shafi ta hanyar HTTP proxy a cikin jsoup

jsoup na iya samun shafin ta hanyar HTTP proxy kuma ya yi nazarin amsa a cikin kira ɗaya:

Document page = Jsoup.connect("https://www.example.com/")
    .proxy("proxy.example", 8080)
    .get();

Sunan mai masauki da cikakken lambar tashar suna gano proxy ɗin. Don buƙatun da aka yarda na shafukan jama'a, zaɓi HTTP endpoint daga sabis ɗinka ko daga jerin HTTP proxy. URL ɗin da aka ba connect ya kasance shafin da kake so. Ba sai ka sauke HTML cikin zaren rubutu da URLConnection daban kawai don ƙara wannan hanya.

proxy(String, int) yana zaɓar HTTP proxy don wannan buƙatar. Lambar tasha kamar 1080 ba ta canza ka'idarsa zuwa SOCKS ba; dole ne ƙarshen proxy ɗin ya yi magana da nau'in da ake daidaitawa. jsoup kuma yana ba da wata hanya da ke karɓar java.net.Proxy, amma tallafi ga wata hanya ta musamman ya dogara ne da tsarin HTTP da ake amfani da shi.

Ba kowane ma'aikaci nasa buƙatar

Zaɓi a matakin buƙata yana sauƙaƙa aiki a lokaci ɗaya fiye da canza kaddarorin tsarin JVM a kowane saukewa. Ka riƙe buƙatar da za ta iya canzawa daban ga kowane ma'aikaci. jsoup na zamani na iya raba saitunan zama da ajiyar kukis yayin ƙirƙirar sabuwar buƙata:

Connection session = Jsoup.newSession();
Document first = session.newRequest()
    .url("https://www.example.com/one")
    .proxy("proxy-a.example", 8080)
    .get();
Document second = session.newRequest()
    .url("https://www.example.com/two")
    .proxy("proxy-b.example", 8080)
    .get();

Kiraye-kirayen da ke sama suna gudana bibiyu don bayyanawa. Idan an rarraba aikin a lokaci ɗaya, ƙirƙiri buƙatun da kansu maimakon canza proxy a kan Connection ɗaya da ke gudana. Zama da aka raba yana raba kukis kuma; yi amfani da zama daban idan ya kamata asalin bincike ya kasance daban.

Waɗannan mu'amaloli suna cikin jsoup 1.21.2. Mu'amalar newRequest() ba tare da hujja ba ta fara ne daga 1.14.1, saboda haka tsohuwar manhaja ya kamata ta duba dogaro da ita kafin ta karɓi misalin zama.

Takardun shaidar sirri buƙata ce ta ƙari ga proxy da aka tabbatar. Zaɓin hanya mai nasara ba ya ba da asusu, kuma karɓar ƙalubalen proxy ya bambanta da kasa haɗawa da tasharsa.