Skip to main content

Dremio plugin for Intake

Project description

Intake-Dremio

Dremio Plugin for Intake based on pyarrow Flight

User Installation

To install the intake-dremio plugin, execute the following command

conda install -c conda-forge intake-dremio

or:

pip install intake-dremio

When installing from the pyviz channel and conda-forge conda channels, you must ensure that libarrow-flight is also installed:

conda install -c pyviz -c conda-forge intake-dremio libarrow-flight

This is because conda-forge has split up pyarrow into individual packages as of pyarrow 16.

Example

An Intake catalog referencing a Dremio dataset consists of the uri pointing to the Dremio instance along with a username and password and a SQL expression (sql_expr), e.g.:

sources:
  dremio_vds:
    driver: dremio 
    args:
        uri: grpc+tcp://{{ env(DREMIO_USER) }}:{{ env(DREMIO_PASSWORD) }}@x.x.x.x:32010  
        sql_expr: SELECT * FROM TABLE ORDER BY "timestamp" ASC

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

intake_dremio-0.2.5.tar.gz (28.0 kB view details)

Uploaded Source

Built Distribution

intake_dremio-0.2.5-py3-none-any.whl (9.5 kB view details)

Uploaded Python 3

File details

Details for the file intake_dremio-0.2.5.tar.gz.

File metadata

  • Download URL: intake_dremio-0.2.5.tar.gz
  • Upload date:
  • Size: 28.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.4

File hashes

Hashes for intake_dremio-0.2.5.tar.gz
Algorithm Hash digest
SHA256 02232073ca0df72e594a92edb1a5bf969e5f3f0d43feedf3e36f187507def98e
MD5 9418cc51d3a63cc35e32f4b97356381e
BLAKE2b-256 04dc64afb12bce125f33ab8ba728cbfa609e97d5bad0eced78b44b1716c15a3b

See more details on using hashes here.

Provenance

File details

Details for the file intake_dremio-0.2.5-py3-none-any.whl.

File metadata

File hashes

Hashes for intake_dremio-0.2.5-py3-none-any.whl
Algorithm Hash digest
SHA256 c4b2677b184dcd4cf8c7b1c48a5f44ccc5a68f0a6921e375f5dbe4116214f6f4
MD5 75f02547b328cf90f550ea8cd01de3b5
BLAKE2b-256 ac4d051cb866b8caf24636c1d49844789ef58fbf1f3971185f1bfd274281223a

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page