Skip to main content

File-based ORM for dataclasses.

Project description

Datafiles: A file-based ORM for Python dataclasses

Datafiles is a bidirectional serialization library for Python dataclasses to synchronize objects to the filesystem using type annotations. It supports a variety of file formats with round-trip preservation of formatting and comments, where possible. Object changes are automatically saved to disk and only include the minimum data needed to restore each object.

Travis CI AppVeyor Coveralls PyPI License PyPI Version PyPI Downloads Gitter

Some common use cases include:

  • Coercing user-editable files into the proper Python types
  • Storing program configuration and data in version control
  • Loading data fixtures for demonstration or testing purposes
  • Synchronizing application state using file sharing services
  • Prototyping data models agnostic of persistence backends

Watch my lightning talk for a demo of this in action!

Overview

Take an existing dataclass such as this example from the documentation:

from dataclasses import dataclass

@dataclass
class InventoryItem:
    """Class for keeping track of an item in inventory."""

    name: str
    unit_price: float
    quantity_on_hand: int = 0

    def total_cost(self) -> float:
        return self.unit_price * self.quantity_on_hand

and decorate it with a directory pattern to synchronize instances:

from datafiles import datafile

@datafile("inventory/items/{self.name}.yml")
class InventoryItem:
    ...

Then, work with instances of the class as normal:

>>> item = InventoryItem("widget", 3)
# inventory/items/widget.yml

unit_price: 3.0

Changes to the object are automatically saved to the filesystem:

>>> item.quantity_on_hand += 100
# inventory/items/widget.yml

unit_price: 3.0
quantity_on_hand: 100

Changes to the filesystem are automatically reflected in the object:

# inventory/items/widget.yml

unit_price: 2.5 # <= manually changed from "3.0"
quantity_on_hand: 100
>>> item.unit_price
2.5

Objects can also be restored from the filesystem:

>>> from datafiles import Missing
>>> item = InventoryItem("widget", Missing)
>>> item.unit_price
2.5
>>> item.quantity_on_hand
100

Installation

Because datafiles relies on dataclasses and type annotations, Python 3.7+ is required. Install this library directly into an activated virtual environment:

$ pip install datafiles

or add it to your Poetry project:

$ poetry add datafiles

Documentation

To see additional synchronization and formatting options, please consult the full documentation.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datafiles-1.4.1.tar.gz (24.1 kB view details)

Uploaded Source

Built Distribution

datafiles-1.4.1-py3-none-any.whl (30.6 kB view details)

Uploaded Python 3

File details

Details for the file datafiles-1.4.1.tar.gz.

File metadata

  • Download URL: datafiles-1.4.1.tar.gz
  • Upload date:
  • Size: 24.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.13 CPython/3.10.0 Darwin/21.6.0

File hashes

Hashes for datafiles-1.4.1.tar.gz
Algorithm Hash digest
SHA256 df2ec608856e2c4afe65100aa4d408851d7ce86b8c35edefba0f7ef90875b81d
MD5 a56b27a91a83616bc92456b9f9ea9898
BLAKE2b-256 088bde92c803ab78154532106bd18a012842412205c329277a94698fd3781a01

See more details on using hashes here.

File details

Details for the file datafiles-1.4.1-py3-none-any.whl.

File metadata

  • Download URL: datafiles-1.4.1-py3-none-any.whl
  • Upload date:
  • Size: 30.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.13 CPython/3.10.0 Darwin/21.6.0

File hashes

Hashes for datafiles-1.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 551e6b66d1c17c2be3ce9659ba0c7ee5627e30e54c119aa0865fefe903ed4d5c
MD5 b7d68e90ff9e2286425b795d37c149d9
BLAKE2b-256 211e8fd60b405f4d9f3719a53d41e87fe550c89f14f1442212486b306cbb45f6

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page