Skip to content

Segence/avro-tools-aws

Repository files navigation

Avro Tools AWS

Build Status Download

A version of Avro Tools that supports files directly accessed on Amazon Web Services.

The way to use this application is identical to the original version of Avro Tools except this version will create a core-site.xml file in the directory where it is running from, to allow the Hadoop client, Avro Tools relies on, to establish connectivity to AWS.

Usage:

  1. Make sure the AWS credentials are set in one of the supported mehtods
  2. Run: java -cp .:path-to-avro-tools-aws/avro-tools-aws.jar org.apache.avro.tool.AWSConnection getmeta s3a://bucket/../...avro

To use the original Avro Tools without AWS support simply use: java -cp .:build/libs/avro-tools-aws-1.8.2-all.jar org.apache.avro.tool.Main getmeta s3a://bucket/../...avro