Skip to main content

Export asynchronously your data from your Django models

Project description

django-data-exporter is a simple Django application to export asynchronously your data from your models.

It’s based on Celery (>= 2.3) to use Chords and tablib to export your data in multiple formats.

Installation

  1. Either check out the package from GitHub or it pull from a release via PyPI

    pip install django-data-exporter
  2. Configure your Django project to use djcelery

  3. Add ‘data_exporter’ to your INSTALLED_APPS

    INSTALLED_APPS = (
        'data_exporter',
    )

Utilisation

django-data-exporter uses channels to discover your exports and to transfer them to celery. So let’s say you have the following model in a polls application

# polls/models.py
from django.db import models


class Poll(models.Model):
    question = models.CharField(max_length=200)
    pub_date = models.DateTimeField('date published')

    def __unicode__(self):
        return self.question

Now, you want to define your first exporter right? Create a exports.py file in your polls application and extend Export to build your own Exporter

# polls/exports.py
from data_exporter.base import Export

from polls.models import Poll


class PollExport(Export):
    filename = 'poll'
    columns = ('id', 'question')
    headers = ('id', 'question')
    directory = 'polls'

    def get_query(self, offset=None, limit=None):
        qs = Poll.objects.all()

        if offset and limit:
            return qs[offset:limit]

        if limit:
            return qs[:limit]

        if offset:
            return qs[offset:]

        return qs

    def get_count(self):
        return Poll.objects.count()

Final step is to register this exporter in DATA_EXPORTER_CHANNELS in your Django settings

DATA_EXPORTER_CHANNELS = {
    'polls': 'polls.exports.PollExport'
}

You can now use the celery tasks provided by django-data-exporter as so

from data_exporter.tasks import builder
builder.delay('polls', 'csv')

First parameter is the name of your channel and second parameter is the format wanted.

As said before, we use the beautiful tablib library to export your data, so as you may understood we support all formats provided by this library.

Configuration

DATA_EXPORTER_CHANNELS

All your registered channels.

DATA_EXPORTER_DIRECTORY

The directory used to export your data.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

django-data-exporter-0.1.2.tar.gz (5.7 kB view details)

Uploaded Source

File details

Details for the file django-data-exporter-0.1.2.tar.gz.

File metadata

File hashes

Hashes for django-data-exporter-0.1.2.tar.gz
Algorithm Hash digest
SHA256 c21a6da97d15bddf965a991cc31a74306a65fc79bbb6a6088df45a37992f50d9
MD5 a36ad9a96ea6439cbbe0af5ba5cc0297
BLAKE2b-256 cb5c0c73d246bc21c6f5bea29e7d1dba22d0395a976c619a2f069a65028a9efe

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page