Ukufunda i-CSV ngokusebenzisa i-proxy nge-pandas ne-Requests

Lapho indlela ye-HTTP idinga ukuphathwa kwe-proxy okucacile, landa i-CSV kuqala bese uvumela i-pandas ukuthi iphathe ama-byte akhishiwe:

from io import BytesIO
import pandas as pd
import requests

route = {
    'http': 'http://proxy.example:8080',
    'https': 'http://proxy.example:8080',
}
with requests.get(
    'https://data.example/report.csv',
    proxies=route,
    timeout=(5, 30),
) as response:
    response.raise_for_status()
    frame = pd.read_csv(BytesIO(response.content), encoding='utf-8')

I-proxy iphatha ukuthutha; uhlu lwe-proxy ye-HTTP lunikeza abantu abazongenela indawo yokugcina yomzila we-HTTP womphakathi. I-pandas ithola into efana nefayela futhi isebenzisa izinketho zayo ezijwayelekile ze-delimiter, ikholomu, i-encoding nezinhlobo zedatha.

Ukuhlola umphumela we-HTTP ngaphambi kokuhlaziya kugwema ukuphatha umzimba wephutha le-HTTP ocacile njengethebula. Hlola futhi okuqukethwe okungalindelekile: ikhasi lokungena noma lenqubomgomo lingabuyisela u-200 kepha libe yi-HTML esikhundleni se-CSV eceliwe.

Kuma-URL e-HTTP, ama-storage_options we-read_csv adluliswa njengezihloko zesicelo. Leyo interface ayisiwona umdwebo wama-proxies ngendlela ye-Requests.

I-buffer ayinalo igama lefayela lengqoqo elizoqondisa ukucatshangelwa kokucindezelwa. Nikeza i-compression lapho i-payload etholiwe iyidinga. Ukuhlelwa okufanayo kokuthola-kuqala kusebenza ne-read_excel ne-byte buffer, kusetshenziswa injini yespredishithi efanele lelo fomethi.

Lesi sibonelo sigcina impendulo yonke ememoreni. Okokuthumela okukhulu, kusakaza kufayela lendawo elilawulwayo bese uhlaziya lelo fayela, ngokuhlukanisa izingxenye lapho uhlelo lwedatha lusekela khona.