Tsaftace jerin proxy na IP:port da Python

Duba fayil ɗin IPv4 mai sauƙi, daidaita port sannan cire maimaitawa tare da barin port daban-daban na IP guda.

Sanya shigar IPv4 guda IP:port a kowace layi cikin proxies.txt. Dukkan su dole su kasance na sanannen tsarin proxy guda. Idan ana tattarawa daga jerin proxy kyauta, raba tsarin sadarwar kafin gina wannan shigar rubutu. Tsaftacewar ba ta karɓar URL mai bayanan shiga, ginshiƙan CSV ko adiresoshin IPv6.

Ajiye wannan rubutun da ke amfani da ɗakin karatu na asali da sunan clean-proxies.py a babban fayil ɗin nan:

from ipaddress import IPv4Address
from pathlib import Path

seen = set()
cleaned = []

for number, raw in enumerate(
    Path("proxies.txt").read_text(encoding="utf-8").splitlines(),
    start=1,
):
    text = raw.strip()
    if not text:
        continue
    try:
        host, port_text = text.rsplit(":", 1)
        host = str(IPv4Address(host))
        port = int(port_text)
        if not 1 <= port <= 65535:
            raise ValueError("port out of range")
    except ValueError:
        print(f"Skipping line {number}: invalid IPv4 endpoint")
        continue

    endpoint = (host, port)
    if endpoint not in seen:
        seen.add(endpoint)
        cleaned.append(f"{host}:{port}")

output = "\n".join(cleaned)
Path("proxies-clean.txt").write_text(
    output + ("\n" if output else ""),
    encoding="utf-8",
)
print(f"Saved {len(cleaned)} endpoints")

Gudanar da shi daga wannan babban fayil:

uv run --no-project python clean-proxies.py

Duba saƙonnin layukan da aka tsallake da proxies-clean.txt; fayil ɗin asali ba ya canzawa. Sakamakon yana barin tsarin farkon bayyana kuma yana cire maimaitawa bisa adireshi tare da port na lamba. Kwafi biyu na 203.0.113.10:8080 da guda na 203.0.113.10:3128 suna ba da endpoints biyu. Ana daidaita port na goma 08080 zuwa 8080.

Adireshin misali don nuna tsari ne kawai. Ingantacciyar rubutun IPv4 ta haɗa da adiresoshin sirri da na musamman, don haka tsaftatacciyar shigar ba lallai a iya samunta daga jama’a ba. Ƙara bayyananniyar manufar adireshi idan ana so jerin jama’a kaɗai.

Ga shigar HTTP/SOCKS da aka gauraya, riƙe bayanin tsarin a fayil daban ko ginshiƙi; kada a tantance shi daga port 1080. Yi amfani da mai fassara IPv6 mai baka murabba’i idan wannan ne tsarin gaske. Rubutun yana ƙin abin da ba ya tallafawa maimakon zato, kuma sakamakon ba ya nuna aiki, ɓoyewar suna, ƙasa ko sauri. Waɗannan suna bukatar gwaje-gwajen haɗi da aka sarrafa.

Labarai masu alaƙa