Karanta CSV ta hanyar wakili da pandas da Requests

Kawo CSV da injin Requests da aka saita, duba sakamakon HTTP, sannan ka ba pandas buffer na byte don yin bincike.

Lokacin da hanyar HTTP tana buƙatar sarrafa wakili kai tsaye, ka fara kawo CSV ɗin sannan ka bar pandas ya yi aiki da byte ɗin da aka samu:

from io import BytesIO
import pandas as pd
import requests

route = {
    'http': 'http://proxy.example:8080',
    'https': 'http://proxy.example:8080',
}
with requests.get(
    'https://data.example/report.csv',
    proxies=route,
    timeout=(5, 30),
) as response:
    response.raise_for_status()
    frame = pd.read_csv(BytesIO(response.content), encoding='utf-8')

Wakilin ne ke kula da jigilar; jerin wakilan HTTP yana bayar da masu neman ƙarshen hanya don hanyar HTTP ta jama'a. pandas yana karɓar abu mai kama da fayil kuma yana amfani da zaɓuɓɓukansa na yau da kullun na rabawa, ginshiƙai, ɓoyewa da nau'ikan bayanai.

Duba sakamakon HTTP kafin bincike yana hana ɗaukar bayyanannen jikin kuskuren HTTP a matsayin tebur. Ka kuma duba abin da ba a zata ba: shafin shiga ko manufa na iya mayar da 200 kuma har yanzu ya zama HTML maimakon CSV ɗin da aka nema.

Ga URL na HTTP, ana tura storage_options na read_csv a matsayin kanunin buƙata. Wannan fuskar ba taswirar proxies irin ta Requests ba ce.

Buffer ba shi da sunan fayil ɗin ajiya da zai jagoranci tunanin matsewa. Ka bayyana compression lokacin da kayan da aka samu ke buƙatar hakan. Wannan tsarin fara-kawowa ɗaya yana aiki da read_excel da buffer na byte, tare da injin tebur da ya dace da wannan tsari.

Wannan misalin yana riƙe da dukan amsa a ƙwaƙwalwa. Don babban fitarwa, ka watsa shi zuwa fayil ɗin gida da ake sarrafawa sannan ka bincika wannan fayil, tare da raba gida-gida inda tsarin aikin bayanai ya goyi bayan hakan.

Labarai masu alaƙa