Python 3.14 Executor.map buffersize yamaqembu amakhulu e-proxy

max_workers=8 likhawulela izintambo ezisebenzayo. Nokho alivimbeli umjikelezo wokuthumela ohlukile ekudaleni i-Future yayo yonke indawo yokugcina kokufakiwe okukhulu.

I-Python 3.14 yengeza inketho yokufunda kusengaphambili enomkhawulo:

from concurrent.futures import ThreadPoolExecutor

with ThreadPoolExecutor(max_workers=8) as executor:
    for result in executor.map(check_proxy, endpoints, buffersize=24):
        record_result(result)

check_proxy wukuhlola okuvumelanayo okukhona, okunezikhathi zenethiwekhi nokuhlanza; i-record_result ibhekana nokubonwayo okubuyiswayo. Amanani 8 no-24 ayizabelomali eziyisibonelo. uhlu lwe-proxy lwamahhala inikeza abantu abagqamile emphakathini babo bonke indawo yokugcina; gcina iphrothokholi yabo nekwedi ngayinye ukuze i-check_proxy isebenzise ukuthutha okufanele.

Lapho ibhafa yokuthumela igcwala, i-map iyamisa ukusetshenziswa kwento ephindwayo kuze kukhishwe imiphumela. Lokhu kusebenza nakuma-generator.

I-map isakhipha ngokulandelana kokufakiwe: ukuhlola kwasekuqaleni okuhamba kancane kungabamba imiphumela yakamuva eseyiqediwe futhi kubambezele okunye ukufakiwe. Ukuze ucubungule ngokulandelana kokuqedwa, sebenzisa isethi yama-futures enomkhawulo ocacile efakwa kabusha lapho eqeda.

Bhekana nokwehluleka kwenethiwekhi okulindelekile ngaphakathi kokuhlola uma iqembu kufanele liqhubeke likhipha imiphumela. Ukuhlukile okungabhekwanga kuphakanyiswa lapho leyo nto ithathwa. I-chunksize ku-ThreadPoolExecutor ayinikezi lesi sabelomali sokuthumela, futhi izinguqulo zangaphambilini ze-Python azinayo i-buffersize.