Worochi

Worochi provides a standard way to interface with Ruby API wrappers provided by various cloud storage services such as Dropbox and Google Drive.

Installation

Worochi can be installed as a gem.

gem install worochi

Documentation

http://rdoc.info/gems/worochi

Basic Usage

Pushing files is easy. Just create an agent using the OAuth authorization token for the user and then call Worochi::Agent#push or Worochi.push. File origins can be local, HTTP, or Amazon S3 paths.

Pushing files to Dropbox

token = '982n3b989az'
agent = Worochi.create(:dropbox, token)
agent.push('test.txt')
agent.files # lists the files in the default directory
# => ['test.txt']

Pushing multiple files

agent.push(['a.txt', 'folder1/b.txt', 'http://example.com/c.txt'])
agent.files
# => ['a.txt', 'b.txt', 'c.txt']

Pushing to more than one service

a = Worochi.create(:dropbox, 'hxhrerx')
b = Worochi.create(:dropbox, 'cdgrhdg')
Worochi.push('test.txt')
a.files
# => ['test.txt']
b.files
# => ['test.txt']

Specifying remote paths

Instead of pushing all the files to the default directory at /, you can specify the default path and also the path of every file individually.

agent = Worochi.create(:dropbox, token, { dir: '/parent' }) # default path
agent.push([
  { source: 'a.txt', path: 'A.txt' },
  { source: 'b.txt', path: 'folder1/B.txt' },
  { source: 'c.txt', path: '/C.txt' } # absolute remote path
])

agent.files
# => ['A.txt']

agent.files_and_folders
# => ['A.txt', 'folder1']

agent.files('/parent') # same as default directory
# => ['A.txt']

agent.files('/parent/folder1')
# => ['B.txt']

agent.files('/') # root
# => ['C.txt']

Amazon S3 Support

Files can be retrieved directly from their Amazon S3 location either using the bucket name specified in the configuration or by specifiying a bucket name in the path.

Worochi::Config.s3_bucket = 'rawr'

agent.push('s3:path/to/file')
# Retrieves from https://rawr.s3.amazonaws.com/path/to/file?AWSAccessKeyId=...

agent.push('s3:pikachu:path/to/file')
# Retrieves from https://pikachu.s3.amazonaws.com/path/to/file?AWSAccessKeyId=...

This uses Amazon's Ruby SDK to create a presigned URL for the specified file and then retrieves the file over HTTPS. AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY should be present in your environmental variables for this to work.

OAuth2 Flow

Worochi provides helper methods to assist with the OAuth2 authorization flow.

Example in Rails

class ApiTokensController < ApplicationController

  # GET /worochi/token/new/:service
  def create
    session[:oauth_flow_state] = state = SecureRandom.hex
    redirect_to oauth.flow_start(state)
  end

  # GET /worochi/token/callback/:service
  def callback
    raise Error unless session[:oauth_flow_state] == params[:state]
    token = oauth.flow_end(params[:code])
    # token is a hash containing the retrieved access token
  end

private

  def oauth
    service = params[:service].to_sym
    redirect_url = oauth_callback_url(service) # defined in routes.rb
    Worochi::OAuth.new(service, redirect_url)
  end
end

Service-specific settings for OAuth2 are predefined in the gem, so the framework just needs to handle verification of session state (this is usually optional) and storing the retrieved access token value.

Refresh Token

Retrieved tokens can be refreshed if refresh_token is supported by the service.

token = oauth.flow_end(code)

new_token = oauth.refresh(token)

Tokens are hashes and refresh expects a hash containing the field refresh_token. It raises an error if refresh_token is invalid.

Supported Services

Currently these services are fully supported:

Dropbox

• Service name :dropbox
• Env variables DROPBOX_ID DROPBOX_SECRET DROPBOX_TEST_TOKEN

GitHub

• Service name :github
• Env variables GITHUB_ID GITHUB_SECRET GITHUB_TEST_TOKEN

Google Drive

• Service name :google_drive
• Env variables GOOGLE_ID GOOGLE_SECRET GOOGLE_TEST_TOKEN

Box

• Service name :box
• Env variables BOX_ID BOX_SECRET BOX_TEST_TOKEN

Environmental Variables

ID and SECRET variables are only needed for retrieving access tokens and can be omitted if you are using other OAuth2 libraries for that purpose.

TEST_TOKEN is a valid user access token used for RSpec testing. The user account being used for testing should contain these [test files] (https://github.com/darkmirage/test) at the directory specified by the tests.

MIME Types

Some services such as Google Drive require Worochi to provide MIME types for the files being uploaded. Worochi will attempt to use the file name to determine the MIME type, but this does not work well. You can use ruby-filemagic for better MIME type detection using magic numbers.

gem install ruby-filemagic

Development

Each service is implemented as an Worochi::Agent object. Below is an overview of the files necessary for defining an agent to support a new service.

The behaviors for each API are defined mainly in two files:

/worochi/lib/agent/foo_bar.rb
/worochi/lib/config/foo_bar.yml

Optional helper file:

/worochi/lib/helper/foo_bar_helper.rb

Test file:

/worochi/spec/worochi/agent/foo_bar_spec.rb

Use underscore for filenames and corresponding mixed case for class name. The class name and service name symbol for the above example would be:

class Worochi::Agent::FooBar < Worochi::Agent
end

Worochi.create(:foo_bar, token)

RSpec tests use the VCR gem to record and playback real HTTP interactions. Remember to filter out API tokens in the recordings.

Name

Worochi is the archaic spelling of Orochi, a mythical eight-headed serpent in Japanese mythology.