Skip to main content

Dremio plugin for Intake

Project description

Intake-Dremio

Dremio Plugin for Intake based on pyarrow Flight

User Installation

To install the intake-dremio plugin, execute the following command

conda install -c conda-forge intake-dremio

or:

pip install intake-dremio

Example

An Intake catalog referencing a Dremio dataset consists of the uri pointing to the Dremio instance along with a username and password and a SQL expression (sql_expr), e.g.:

sources:
  dremio_vds:
    driver: dremio 
    args:
        uri: grpc+tcp://{{ env(DREMIO_USER) }}:{{ env(DREMIO_PASSWORD) }}@x.x.x.x:32010  
        sql_expr: SELECT * FROM TABLE ORDER BY "timestamp" ASC

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

intake_dremio-0.2.4a1.tar.gz (24.7 kB view details)

Uploaded Source

Built Distribution

intake_dremio-0.2.4a1-py2.py3-none-any.whl (9.4 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file intake_dremio-0.2.4a1.tar.gz.

File metadata

  • Download URL: intake_dremio-0.2.4a1.tar.gz
  • Upload date:
  • Size: 24.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.10.14

File hashes

Hashes for intake_dremio-0.2.4a1.tar.gz
Algorithm Hash digest
SHA256 78a4c1ba2c4489e0dcd40b379e3d003296f60d631ecccf76dc03b795e5c1a3b8
MD5 632404e524dc893dd6ad6ffaa68020b1
BLAKE2b-256 23354443137769179d779f4d79ba2ec76911b4a637a519ebd5034cba1aef1f6f

See more details on using hashes here.

Provenance

File details

Details for the file intake_dremio-0.2.4a1-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for intake_dremio-0.2.4a1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 20b9160c2f70ebdb934f7314c23e2230e9048ea1ad937e17541722ac601316e4
MD5 30e13a430c5aa2be354367c33b243682
BLAKE2b-256 d393e6ff400d336e21c31b2b5bad65d53f4c1630c8f67dec3e9089ad3bca9162

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page