Skip to content

Latest commit

 

History

History
86 lines (60 loc) · 2.39 KB

README.md

File metadata and controls

86 lines (60 loc) · 2.39 KB
Raw

MongoDB backup and restore

This is an example of using Akka Streams to:

  1. Backup MongoDB collection to AWS S3.
  2. Restore it from AWS S3 back to MongoDB.

This example contains a full runnable code presented in a two-part article:

Dependencies

  • Akka Streams
  • Alpakka S3 connector
  • MongoDB Reactive Streams driver

Running

The scenario located in the Main is the following:

  1. Perform a backup to S3.
  2. Drop the collection.
  3. Perform a restore.

This project uses Minio, a fully compatible S3 object storage, to replace Amazon S3. It's being ran locally in a docker-compose along with MongoDB. That's why you'll be able to run this example in less than a minute!

Steps to run the example:

  1. Create dirs

    mkdir -p /tmp/data/mybucket /tmp/config

  2. Run Minio and MongoDB

    docker-compose up -d

  3. Run Mongo shell

    docker run -it --net host --rm mongo sh -c 'exec mongo "localhost:27017"'

  4. Insert a document

    > use CookieDB
switched to db CookieDB

> db.cookies.insert({"name" : "cookie1", "delicious" : true})
WriteResult({ "nInserted" : 1 })

  5. sbt run

    In the default scenario, the collection is being backed up to Minio, removed from Mongo and restored. You can go to http://127.0.0.1:9000/minio/mybucket/ (login: minio_access_key, password: minio_secret_key) and see the backup file (backup.json).

  6. Clean up afterwards

    docker-compose down

MongoDB basics

The following snippet presents a basic set of MongoDB commands useful when playing with backup/restore streams.

> show dbs
admin  0.000GB
local  0.000GB

> use CookieDB
switched to db CookieDB

> db.cookies.insert({"name" : "cookie1", "delicious" : true})
WriteResult({ "nInserted" : 1 })

> show collections
cookies

> db.cookies.find()
{ "_id" : ObjectId("599b0d9a266a67c9516e0245"), "name" : "cookie1", "delicious" : true }

> db.dropDatabase()
{ "dropped" : "CookieDB", "ok" : 1 }