Skip to main content

Amazon DynamoDB mock implementation

Project description

ddbmock – a DynamoDB mock implementation.

Presentation

DynamoDB is a minimalistic NoSQL engine provided by Amazon as a part of their AWS product.

DynamoDB allows you to store documents composed of unicode, number or binary data as well are sets. Each tables must define a hash_key and may define a range_key. All other fields are optional.

DynamoDB is really awesome but is terribly slooooow with managment tasks. This makes it completly unusable in test environements

ddbmock brings a nice, tiny, in-memory implementation of DynamoDB along with much better and detailed error messages. Among its niceties, it features a double entry point:

  • regular network based entry-point with 1:1 correspondance with stock DynamoDB

  • embeded entry-point with seamless boto intergration 1, ideal to avoid spinning yet another server.

What is/will ddbmock be useful for ?

  • running unit test FAST. DONE

  • running functional test FAST. DONE

  • experiment with DynamoDB API. DONE

  • plan Throughput usage. WIP (low level foundation done)

  • plan actual storage space requirements. DONE (describe table returns accurate size !)

  • perform simulations with accurate limitations. Even some undocumented “features” are accurate :)

Current status

ddbmock is an experimental project and is currently under heavy development. It also may be discontinued at any time.

  • support full table life-cycle

  • support full item life-cycle

  • support for all item limitations

  • accurate size and date reporting

  • preliminary support of Query, Scan and BatchGetItem

  • no limits on concurent table operations

  • no limits for request/response size nor item count in those

See http://ddbmock.readthedocs.org/en/latest/pages/status.html for detailed up-to-date status.

Example usage

Run as Regular client-server

Ideal for test environment. For stage and production I highly recommend using DynamoDB servers. ddbmock comes with no warranty and will loose your data(tm).

Launch the server

$ pserve development.ini # launch the server on 0.0.0.0:6543

Start the client

import boto
from ddbmock import connect_ddbmock

# Use the provided helper to connect your *own* endpoint
db = connect_ddbmock()

# Done ! just use it wherever in your project as usual.
db.list_tables() # get list of tables (empty at this stage)

Note: if you do not want to import ddbmock only for the helper, here is a reference implementation:

def connect_ddbmock(host='localhost', port=6543):
    import boto
    from boto.regioninfo import RegionInfo
    endpoint = '{}:{}'.format(host, port)
    region = RegionInfo(name='ddbmock', endpoint=endpoint)
    return boto.connect_dynamodb(region=region, port=port, is_secure=False)

Run as a standalone library

Ideal for unit testing or small scale automated functional tests. Nice to play around with boto DynamoDB API too :)

import boto
from ddbmock import connect_boto

# Wire-up boto and ddbmock together
db = connect_boto()

# Done ! just use it wherever in your project as usual.
db.list_tables() # get list of tables (empty at this stage)

Requirements

  • Python 2.7.x

  • Pyramid >= 1.3

  • Boto >= 2.5.0 (optional)

  • NO AWS account :)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ddbmock-0.3.1.tar.gz (42.1 kB view details)

Uploaded Source

File details

Details for the file ddbmock-0.3.1.tar.gz.

File metadata

  • Download URL: ddbmock-0.3.1.tar.gz
  • Upload date:
  • Size: 42.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for ddbmock-0.3.1.tar.gz
Algorithm Hash digest
SHA256 3bcc4f990f2e92f111e1f143772bac2578db9590b45ccfe57b3f2bd2de955806
MD5 b09b2da129d32163c6a86eabb36b866d
BLAKE2b-256 a10ed0ef6e3444c33c8afe7205766d313e711fe6435c0202ba65f8e35961a4e2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page