Anna DB research

[pdgetrf]

A promising building block solution for cross-cluster KV storage is anna. It's based on CRDT. See this for a good explanation of the lattice data structure used in Anna.

This task is to evaluate anna in the following aspects:

• Build anna
• Run anna KV
• Understand how it works within a single node
• Understand how it works with multiple nodes in a cluster
• Build & run anna in a K8s cluster
• Can it work with existing serverless framework such as Kubeless?
• Performance evaluation (e.g. the communication overhead mentioned in AnnaBellaDB paper)
• What are similar options (open source and commercials)

To name a few:

• https://github.com/gedge-platform/gedge-platform
  • video
  • paper
• IPFS, used in OrbitDB
• Automerge
• EdgeFS
• https://github.com/ipfs/go-ds-crdt
• What's the security compliance mode (comparing with CDN KV stores)
• Possibility of extending it to cross cluster on edge

A few reference papers:

• "AnnaBellaDB- Key-Value Store Made Cloud Native"
• "The Design of Any-scale Serverless Infrastructure with Rich Consistency Guarantees"
• "Anna- A KVS For Any Scale"

Estimate time: ~ by 1/7

[pdgetrf]

possible similar solutions

• https://github.com/gedge-platform/gedge-platform
  • video
  • paper
• IPFS, used in OrbitDB
• Automerge
• https://github.com/ipfs/go-ds-crdt