A version of Avro Tools that supports files directly accessed on Amazon Web Services.
The way to use this application is identical to the original version of Avro Tools except this version will create a core-site.xml
file in the directory where it is running from, to allow the Hadoop client, Avro Tools relies on, to establish connectivity to AWS.
Usage:
- Make sure the AWS credentials are set in one of the supported mehtods
- Run:
java -cp .:path-to-avro-tools-aws/avro-tools-aws.jar org.apache.avro.tool.AWSConnection getmeta s3a://bucket/../...avro
To use the original Avro Tools without AWS support simply use: java -cp .:build/libs/avro-tools-aws-1.8.2-all.jar org.apache.avro.tool.Main getmeta s3a://bucket/../...avro