Saita proxy don haɗin Spark na Snowflake a AWS

Don haɗin Snowflake Spark a AWS, saita mai karatu da zaɓuɓɓukan proxy na haɗin kansa:

options = {
    **snowflake_options,
    'use_proxy': 'true',
    'proxy_host': 'proxy.example',
    'proxy_port': '8080',
    'proxy_protocol': 'http',
}
reader = spark.read.format('snowflake').options(**options)

snowflake_options yana riƙe da saitunan ƙarshen hanya da tabbatarwa na aikace-aikacen. Ƙara teburin ko tambayar da ake so kafin kiran load.

use_proxy yana zama false ta tsoho. Idan an kunna shi, yana buƙatar proxy_host da proxy_port a matsayin filaye daban. proxy_user da proxy_password suna ba da asusun tsaka-tsaki. Ba tare da tabbatarwar proxy ba, hanyar proxy ta jama'a da aka yarda za ta iya amfani da 'yan takarar host da port daga jerin proxy na HTTP yayin da yake riƙe saitunan asusun Snowflake.

Snowflake yana rubuta filayen asusu, proxy_protocol da non_proxy_hosts a matsayin na AWS kawai. An ƙara proxy_protocol a haɗin 2.11.1 kuma ta tsoho http ne. non_proxy_hosts yana raba host da bututu da aka tsere a URL (%7C) kuma yana goyon bayan alamar tauraro a matsayin wildcard.

Yi amfani da haɗin da ya dace da sigogin Spark da Scala na aikin. Waɗannan zaɓuɓɓukan tushen bayanai suna da nasu sunaye da tsari; kaddarorin JDBC da abubuwan java.net.Proxy ba shigarwar da za a iya musanya ba.