Hadoop DistCp: saita wakilin S3A akan ayyukan ma'aikata

Don haɗin S3A na Hadoop 3.4.2 ta hanyar wakilin HTTP, haɗa waɗannan shigarwar cikin saitin Hadoop na aikin, yawanci core-site.xml da ya dace:

<property>
  <name>fs.s3a.proxy.host</name>
  <value>gateway.example</value>
</property>
<property>
  <name>fs.s3a.proxy.port</name>
  <value>8080</value>
</property>
<property>
  <name>fs.s3a.proxy.ssl.enabled</name>
  <value>false</value>
</property>

Don gwajin da aka ba da izini daban a kan wurin ƙarshen S3 da ake iya isa ga kowa ba tare da shaidar wakili ba, jerin wakilan HTTP yana bayar da ƙimar da za a iya zaɓa don sunan mai masauki da tashar jiragen ruwa bayyananna. fs.s3a.proxy.ssl.enabled=false yana zaɓar haɗin HTTP na fili zuwa wannan wakili; ba ya kashe TLS daga S3A zuwa S3. Yi amfani da ƙimar da ta dace da ainihin mai sauraron wakilin.

Duba duka masu amfani. Abokin ciniki mai aikawa na iya lissafa S3 cikin nasara yayin da kwantena na ayyukan taswirar DistCp ba za su iya isa wakilin ba ko loda wannan saitin tsarin fayil ɗin ba. Waɗannan ayyukan ne suke yin jigilar.

Don aikin da ya gaza, riƙe mai masaukin aiwatarwa, saitin da ke aiki da wurin ƙarshen da aka zaɓa tare da kuskuren. Yanayin harsashin aikawa bai isa shaida ba ga ma'aikaci.

Waɗannan saitunan suna jagorantar s3a://. Tsofaffin girke-girken haɗin Jets3t suna saita wani aiwatarwa kuma ba sa maye gurbin zaɓuɓɓukan S3A da wannan aiki ke amfani da su.