Skip to main content

CKAN extension that adds a "Download all" button to a dataset

Project description

https://travis-ci.org/davidread/ckanext-downloadall.svg?branch=master https://coveralls.io/repos/davidread/ckanext-downloadall/badge.svg Downloads Latest Version Supported Python versions Development Status License

ckanext-downloadall

This CKAN extension adds a “Download all” button to datasets. This downloads a zip file containing all the resource files and a datapackage.json.

demo.png

The datapackage.json is a [Frictionless Data] standard, also known as a Data Package.

If the resource is pushed/xloaded to Datastore then the schema (column types) are included in the datapackage.json file.

This extension uses a CKAN background job to create the zip every time a dataset is created or updated. This suits CKANs where all files are uploaded - if the underlying data file changes without CKAN knowing about it, then the zip will not include the update.

(This extension is inspired by [ckanext-packagezip](https://github.com/datagovuk/ckanext-packagezip), but that is old and relied on ckanext-archiver and IPipe.)

Requirements

Designed to work with CKAN 2.7+

Installation

To install ckanext-downloadall:

  1. Activate your CKAN virtual environment, for example:

    . /usr/lib/ckan/default/bin/activate
  2. Install the ckanext-downloadall Python package into your virtual environment:

    pip install ckanext-downloadall
  3. Add downloadall to the ckan.plugins setting in your CKAN config file (by default the config file is located at /etc/ckan/default/production.ini).

  4. Restart CKAN. For example if you’ve deployed CKAN with Apache on Ubuntu:

    sudo service apache2 reload

Ensure the background job ‘worker’ process is running - see https://docs.ckan.org/en/2.8/maintaining/background-tasks.html#running-background-jobs

Config Settings

None at present

Development Installation

To install ckanext-downloadall for development, activate your CKAN virtualenv and do:

git clone https://github.com/davidread/ckanext-downloadall.git
cd ckanext-downloadall
python setup.py develop
pip install -r dev-requirements.txt

Remember to run the worker (in a separate terminal):

paster --plugin=ckan jobs worker --config=/etc/ckan/default/development.ini

Running the Tests

To run the tests, do:

nosetests --nologcapture --with-pylons=test.ini

To run the tests and produce a coverage report, first make sure you have coverage installed in your virtualenv (pip install coverage) then run:

nosetests --nologcapture --with-pylons=test.ini --with-coverage --cover-package=ckanext.downloadall --cover-inclusive --cover-erase --cover-tests

Registering ckanext-downloadall on PyPI

ckanext-downloadall should be availabe on PyPI as https://pypi-hypernode.com/pypi/ckanext-downloadall. If that link doesn’t work, then you can register the project on PyPI for the first time by following these steps:

  1. Create a source distribution of the project:

    python setup.py sdist
  2. Register the project:

    python setup.py register
  3. Upload the source distribution to PyPI:

    python setup.py sdist upload
  4. Tag the first release of the project on GitHub with the version number from the setup.py file. For example if the version number in setup.py is 0.0.1 then do:

    git tag 0.0.1
    git push --tags

Releasing a New Version of ckanext-downloadall

ckanext-downloadall is availabe on PyPI as https://pypi-hypernode.com/pypi/ckanext-downloadall. To publish a new version to PyPI follow these steps:

  1. Update the version number in the setup.py file. See PEP 440 for how to choose version numbers.

  2. Create a source distribution of the new version:

    python setup.py sdist
  3. Upload the source distribution to PyPI:

    python setup.py sdist upload
  4. Tag the new release of the project on GitHub with the version number from the setup.py file. For example if the version number in setup.py is 0.0.2 then do:

    git tag 0.0.2
    git push --tags

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ckanext-downloadall-0.0.1.tar.gz (24.8 kB view details)

Uploaded Source

Built Distribution

ckanext_downloadall-0.0.1-py2-none-any.whl (24.2 kB view details)

Uploaded Python 2

File details

Details for the file ckanext-downloadall-0.0.1.tar.gz.

File metadata

  • Download URL: ckanext-downloadall-0.0.1.tar.gz
  • Upload date:
  • Size: 24.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/2.7.12

File hashes

Hashes for ckanext-downloadall-0.0.1.tar.gz
Algorithm Hash digest
SHA256 1794577725da964940c6c5e82c0d6ec5be76632d9f0fc1d874db7ca84659ffb2
MD5 49e9214480fb48343074dccb2fd1e92b
BLAKE2b-256 83bc42435af4e4c384b2e19573da0b2e0f55f3de5a35b958de1747f6767429cb

See more details on using hashes here.

File details

Details for the file ckanext_downloadall-0.0.1-py2-none-any.whl.

File metadata

  • Download URL: ckanext_downloadall-0.0.1-py2-none-any.whl
  • Upload date:
  • Size: 24.2 kB
  • Tags: Python 2
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/2.7.12

File hashes

Hashes for ckanext_downloadall-0.0.1-py2-none-any.whl
Algorithm Hash digest
SHA256 69ef7907d7b06363cfc4fcd4390a1b008b9efba4476455eda266070f6f88fd79
MD5 86e6b7e048dd37b5fbce86b76ea2c395
BLAKE2b-256 92b505bc792f9801987b87d7ed8d816c602e1ec50ebcfa44735a23ccad98357e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page