Dremio plugin for Intake
Project description
Intake-Dremio
Dremio Plugin for Intake based on pyarrow Flight
User Installation
To install the intake-dremio plugin, execute the following command
conda install -c conda-forge intake-dremio
or:
pip install intake-dremio
When installing from the pyviz channel and conda-forge conda channels, you must ensure that libarrow-flight is also installed:
conda install -c pyviz -c conda-forge intake-dremio libarrow-flight
This is because conda-forge has split up pyarrow into individual packages as of pyarrow 16.
Example
An Intake catalog referencing a Dremio dataset consists of the uri pointing to the Dremio instance along with a username and password and a SQL expression (sql_expr), e.g.:
sources:
dremio_vds:
driver: dremio
args:
uri: grpc+tcp://{{ env(DREMIO_USER) }}:{{ env(DREMIO_PASSWORD) }}@x.x.x.x:32010
sql_expr: SELECT * FROM TABLE ORDER BY "timestamp" ASC
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file intake_dremio-0.2.5a1.tar.gz.
File metadata
- Download URL: intake_dremio-0.2.5a1.tar.gz
- Upload date:
- Size: 28.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 516eef7b6ffc19e27398182a7fb9447429cf427add640df06ee6dc1063b1484a |
|
| MD5 | 67bbb36c0a0da32b9e5638edcafef013 |
|
| BLAKE2b-256 | 5b52f0893b7da070b98c029badadf74d0610aedb7830ca7397890a3cfba35299 |
Provenance
File details
Details for the file intake_dremio-0.2.5a1-py3-none-any.whl.
File metadata
- Download URL: intake_dremio-0.2.5a1-py3-none-any.whl
- Upload date:
- Size: 9.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3e098343fcedcb98f94dbc2a8964979ef6b387a85066bc7586f35c03676d350b |
|
| MD5 | b9861b1d1ec6cb4e30a1f2fb0edd47ad |
|
| BLAKE2b-256 | 3daa71af7e561638d3aef1c70fd3e27e29e14b7bcd7cec1cf968dd624e00c3e8 |
