Skip to main content

Data load and catalog system

Project description

Intake: A general interface for loading data

Logo

Build Status Documentation Status Join the chat at https://gitter.im/ContinuumIO/intake

Intake is a lightweight set of tools for loading and sharing data in data science projects. Intake helps you:

  • Load data from a variety of formats (see the current list of known plugins) into containers you already know, like Pandas dataframes, Python lists, NumPy arrays, and more.
  • Convert boilerplate data loading code into reusable Intake plugins
  • Describe data sets in catalog files for easy reuse and sharing between projects and with others.
  • Share catalog information (and data sets) over the network with the Intake server

Documentation is available at Read the Docs.

Status of intake and related packages is available at Status Dashboard

Weekly news about this repo and other related projects can be found on the wiki

Install

Recommended method using conda:

conda install -c conda-forge intake

You can also install using pip, in which case you have a choice as to how many of the optional dependencies you install, with the simplest having least requirements

pip install intake

and additional sections [server], [plot] and [dataframe], or to include everything:

pip install intake[complete]

Note that you may well need specific drivers and other plugins, which usually have additional dependencies of their own.

Development

  • Create development Python environment with the required dependencies, ideally with conda. The requirements can be found in the yml files in the scripts/ci/ directory of this repo.
    • e.g. conda env create -f scripts/ci/environment-py38.yml and then conda activate test_env
  • Install intake using pip install -e .[complete]
  • Use pytest to run tests.
  • Create a fork on github to be able to submit PRs.
  • We respect, but do not enforce, pep8 standards; all new code should be covered by tests.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

intake-0.6.6.tar.gz (127.8 kB view details)

Uploaded Source

Built Distribution

intake-0.6.6-py3-none-any.whl (1.5 MB view details)

Uploaded Python 3

File details

Details for the file intake-0.6.6.tar.gz.

File metadata

  • Download URL: intake-0.6.6.tar.gz
  • Upload date:
  • Size: 127.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.0 pkginfo/1.7.0 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.8.12

File hashes

Hashes for intake-0.6.6.tar.gz
Algorithm Hash digest
SHA256 99b31484dbaca0047098cb7bbfb72cea8d6fcb004dea9a5fe145731b1c65a2ca
MD5 3bf1c49509b22ca3107a4279b7dabe6d
BLAKE2b-256 829f4e81ab3a2f70fba62a2df829e7f115d1316b1a4088d5b80a691d12d22b6d

See more details on using hashes here.

Provenance

File details

Details for the file intake-0.6.6-py3-none-any.whl.

File metadata

  • Download URL: intake-0.6.6-py3-none-any.whl
  • Upload date:
  • Size: 1.5 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.10.0 pkginfo/1.7.0 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.8.12

File hashes

Hashes for intake-0.6.6-py3-none-any.whl
Algorithm Hash digest
SHA256 dd3d5e7cacdeabb00d2dba04c91112e6d27fcbc732bce4d300e19e34be706a43
MD5 54fd4467c6b953224c379123f0441749
BLAKE2b-256 f912562a398b9bf02579f8d8e3c7daa1ddd2b269aa41555f6dbec3cd8ba3c81c

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page