A Distributed DataFrame library for large scale complex data processing.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for jaychia from gravatar.com jaychia Avatar for samster25 from gravatar.com samster25

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache-2.0)
  • Author: Eventual Inc
  • Maintainer: Sammy Sidhu
  • Requires: Python >=3.7.1, <4.0.0
Classifiers

Reason this release was yanked:

Broken build for python 3.8 and 3.9

Project description

daft

Welcome to Daft

Daft is a fast, ergonomic and scalable open-source dataframe library: built for Python and Complex Data/Machine Learning workloads.

Daft is currently in its Alpha release phase - please expect bugs and rapid improvements to the project. We welcome user feedback/feature requests in our Discussions forums.

Frame 113

Installation

Install Daft with pip install getdaft.

Documentation

Learn more about Daft in our documentation.

Community

For questions about Daft, please post in our community hosted on GitHub Discussions. We look forward to meeting you there!

Why Daft?

Processing Complex Data such as images/audio/pointclouds often requires accelerated compute for geometric or machine learning algorithms, much of which leverages existing tooling from the Python/C++ ecosystem. However, many workloads such as analytics, model training data curation and data processing often also require relational query operations for loading/filtering/joining/aggregations.

Daft marries the two worlds with a Dataframe API, enabling you to run both large analytical queries and powerful Complex Data algorithms from the same interface.

  1. Python-first: Python and Jupyter notebooks are first-class citizens. Daft handles any Python libraries and datastructures natively - use any Python library such as Numpy, OpenCV and PyTorch for Complex Data processing.

  2. Laptop to Cloud: Daft is built to run as easily on your laptop for interactive development and on your own Ray cluster or Eventual deployment for terabyte-scale production workloads.

  3. Open Data Formats: Daft loads from and writes to open data formats such as Apache Parquet and Apache Iceberg. It also supports all major cloud vendors' object storage options, allowing you to easily integrate with your existing storage solutions.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for jaychia from gravatar.com jaychia Avatar for samster25 from gravatar.com samster25

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache-2.0)
  • Author: Eventual Inc
  • Maintainer: Sammy Sidhu
  • Requires: Python >=3.7.1, <4.0.0
Classifiers

Release history Release notifications | RSS feed

0.3.14

0.3.13

0.3.12 yanked

Reason this release was yanked:

daft.context.set_runner_ray is broken, which leads to a bad experience with using Daft on Ray

0.3.11 yanked

Reason this release was yanked:

daft.context.set_runner_ray is broken, which leads to a bad experience with using Daft on Ray

0.3.10

0.3.9

0.3.8

0.3.7

0.3.6

0.3.5

0.3.4

0.3.3

0.3.2

0.3.1

0.3.0

0.2.33

0.2.32 yanked

Reason this release was yanked:

This release is broken for Linux ARM machines because of a linking issue in the SIMD crate

0.2.31

0.2.30

0.2.29

0.2.28

0.2.27

0.2.26

0.2.25

0.2.24

0.2.23

0.2.22

0.2.21

0.2.20

0.2.19

0.2.18

0.2.17

0.2.16

0.2.15

0.2.14

0.2.13

0.2.12

0.2.11

0.2.10

0.2.9

0.2.8

0.2.7

0.2.6

0.2.5

0.2.4

0.2.3

0.2.2

0.2.1

0.2.0

0.1.20

0.1.19

0.1.18

0.1.17

0.1.16

0.1.15

0.1.14

0.1.13

0.1.12

0.1.11

0.1.10

0.1.9

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.24

0.0.23

0.0.22

0.0.21

0.0.20

0.0.19

0.0.18

0.0.17

0.0.16

This version

0.0.15 yanked

Reason this release was yanked:

Broken build for python 3.8 and 3.9

0.0.14

0.0.13

0.0.12 yanked

Reason this release was yanked:

Binary Wheel is built with wrong version of pyarrow (9.0 vs 6.0)

0.0.11

0.0.10

0.0.9

0.0.8

0.0.7

0.0.6

0.0.5 yanked

Reason this release was yanked:

nonvalid release

0.0.4 yanked

Reason this release was yanked:

nonvalid release

0.0.3 yanked

Reason this release was yanked:

nonvalid release

0.0.2 yanked

Reason this release was yanked:

nonvalid release

0.0.1 yanked

Reason this release was yanked:

nonvalid release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

getdaft-0.0.15.tar.gz (143.3 kB view details)

Uploaded Source

Built Distributions

getdaft-0.0.15-cp310-cp310-manylinux_2_17_x86_64.whl (1.7 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

getdaft-0.0.15-cp310-cp310-macosx_11_0_x86_64.whl (286.2 kB view details)

Uploaded CPython 3.10 macOS 11.0+ x86-64

getdaft-0.0.15-cp310-cp310-macosx_11_0_arm64.whl (272.9 kB view details)

Uploaded CPython 3.10 macOS 11.0+ ARM64

getdaft-0.0.15-cp39-cp39-manylinux_2_17_x86_64.whl (1.7 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

getdaft-0.0.15-cp39-cp39-macosx_11_0_x86_64.whl (286.6 kB view details)

Uploaded CPython 3.9 macOS 11.0+ x86-64

getdaft-0.0.15-cp39-cp39-macosx_11_0_arm64.whl (273.2 kB view details)

Uploaded CPython 3.9 macOS 11.0+ ARM64

getdaft-0.0.15-cp38-cp38-macosx_11_0_arm64.whl (273.1 kB view details)

Uploaded CPython 3.8 macOS 11.0+ ARM64

getdaft-0.0.15-cp38-cp38-macosx_10_16_x86_64.whl (286.7 kB view details)

Uploaded CPython 3.8 macOS 10.16+ x86-64

getdaft-0.0.15-cp37-cp37m-macosx_10_16_x86_64.whl (286.1 kB view details)

Uploaded CPython 3.7m macOS 10.16+ x86-64

File details

Details for the file getdaft-0.0.15.tar.gz.

File metadata

  • Download URL: getdaft-0.0.15.tar.gz
  • Upload date:
  • Size: 143.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.7

File hashes

Hashes for getdaft-0.0.15.tar.gz
Algorithm Hash digest
SHA256 97702f38f6b5d0bcabae8eef8b8022a108ca1644dbdc7ff9fdcfe9a0bc349849
MD5 886c450d0af7bf02f175b94b4e0f465d
BLAKE2b-256 eeefc6ef7bc31180246aaaf5533a37b4d9f0f99073060970105f5255160a7c0f

See more details on using hashes here.

File details

Details for the file getdaft-0.0.15-cp310-cp310-manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for getdaft-0.0.15-cp310-cp310-manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 821369f9c286380f64366b81bcef85bc3bd07205d337a8c533c9300de76ace98
MD5 84afd9f8667440ef362ef97cff2949c5
BLAKE2b-256 62c2841a40e63ab0428a7b61b94c16a7ec0f9bfcba8b69186dc78e444ccd1b44

See more details on using hashes here.

File details

Details for the file getdaft-0.0.15-cp310-cp310-macosx_11_0_x86_64.whl.

File metadata

File hashes

Hashes for getdaft-0.0.15-cp310-cp310-macosx_11_0_x86_64.whl
Algorithm Hash digest
SHA256 c87866bae2cd295eced7dcfb52afaa49da486b37b6e08fe859b87f7357d75947
MD5 00e4879ace04f2e2669efbd73bbbd734
BLAKE2b-256 95ae2aac20263b4c2dba001cecd67343c1767b3f805956523db9e22112523c37

See more details on using hashes here.

File details

Details for the file getdaft-0.0.15-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for getdaft-0.0.15-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 879d8cc8019d7b8ef634d9926e36f6879bd6107fe988948c594baba4f6a2775f
MD5 ec8181a7f9eda8ff00565ef2fb74f519
BLAKE2b-256 41d4d9d9511ef28c722d950f75ec45b493e98d22f1046750f39e9e311eabb078

See more details on using hashes here.

File details

Details for the file getdaft-0.0.15-cp39-cp39-manylinux_2_17_x86_64.whl.

File metadata

File hashes

Hashes for getdaft-0.0.15-cp39-cp39-manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 ef8343b70c8b45050874f689bdd95be0bc1ab0f4c68f07cb587a10e5f05992cb
MD5 897d9bc80ccdf590eb9cdd61065cb36f
BLAKE2b-256 f61dda6b77487c86efd28eebb2cd07420fe298a107feed15256704080bc1a081

See more details on using hashes here.

File details

Details for the file getdaft-0.0.15-cp39-cp39-macosx_11_0_x86_64.whl.

File metadata

File hashes

Hashes for getdaft-0.0.15-cp39-cp39-macosx_11_0_x86_64.whl
Algorithm Hash digest
SHA256 55c14cc16e532f263b3aae85655d317fc0758c10a2619e81f8049aa72682d563
MD5 c18ccf1af7993fce4ce58c96e4656212
BLAKE2b-256 f5f84b8e8e71c2494e34ada4337fef9146b8e1d3644ce25d88cb31006a519045

See more details on using hashes here.

File details

Details for the file getdaft-0.0.15-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for getdaft-0.0.15-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 b39287acdbc2991942c179ac488fa55b12098d22ac7df3c988b108e6e0764ac9
MD5 7e227697c5627fc6d7b604c9a8634f82
BLAKE2b-256 631f7f712ed9750be9c195c49305ff540369c69f84a330abe38a405972510997

See more details on using hashes here.

File details

Details for the file getdaft-0.0.15-cp38-cp38-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for getdaft-0.0.15-cp38-cp38-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 8f816b115c3d8c255bc4b521b70178efa826fc980f3d5083246c97b4349aa8fb
MD5 d7d7714fa0b75291cce7919325d62046
BLAKE2b-256 98df167636e3b8e107332396a1e123ffc1343f233bc74f7c9becb2937f57dc5c

See more details on using hashes here.

File details

Details for the file getdaft-0.0.15-cp38-cp38-macosx_10_16_x86_64.whl.

File metadata

File hashes

Hashes for getdaft-0.0.15-cp38-cp38-macosx_10_16_x86_64.whl
Algorithm Hash digest
SHA256 79ca0c2fdf8e82d0b53db0a5ce8ebfc4801b7860ac0807a9a321c482584ce5e8
MD5 29bc88b573111d4ab8cf9e1f3583789e
BLAKE2b-256 1850978519c72fa031929e7d51e685eba5fae37e425cac8b7302d839e87c5449

See more details on using hashes here.

File details

Details for the file getdaft-0.0.15-cp37-cp37m-macosx_10_16_x86_64.whl.

File metadata

File hashes

Hashes for getdaft-0.0.15-cp37-cp37m-macosx_10_16_x86_64.whl
Algorithm Hash digest
SHA256 0f686a7619995f2e5b7bd2aca002c2cd94e298b08e9a76dbece070ddd0b8f417
MD5 49e2852db7d29ec3d141e8dac2ae296a
BLAKE2b-256 8630ba9d5bf6a79ab8b88fc7d6ceee67a174b2e68b539bd5a6e42cb448b07a3b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page