Dremio plugin for Intake
Project description
Intake-Dremio
Dremio Plugin for Intake based on pyarrow Flight
User Installation
To install the intake-dremio plugin, execute the following command
conda install -c conda-forge intake-dremio
or:
pip install intake-dremio
When installing from the pyviz channel and conda-forge conda channels, you must ensure that libarrow-flight is also installed:
conda install -c pyviz -c conda-forge intake-dremio libarrow-flight
This is because conda-forge has split up pyarrow into individual packages as of pyarrow 16.
Example
An Intake catalog referencing a Dremio dataset consists of the uri pointing to the Dremio instance along with a username and password and a SQL expression (sql_expr), e.g.:
sources:
dremio_vds:
driver: dremio
args:
uri: grpc+tcp://{{ env(DREMIO_USER) }}:{{ env(DREMIO_PASSWORD) }}@x.x.x.x:32010
sql_expr: SELECT * FROM TABLE ORDER BY "timestamp" ASC
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
intake_dremio-0.2.5.tar.gz
(28.0 kB
view details)
Built Distribution
File details
Details for the file intake_dremio-0.2.5.tar.gz.
File metadata
- Download URL: intake_dremio-0.2.5.tar.gz
- Upload date:
- Size: 28.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 02232073ca0df72e594a92edb1a5bf969e5f3f0d43feedf3e36f187507def98e |
|
| MD5 | 9418cc51d3a63cc35e32f4b97356381e |
|
| BLAKE2b-256 | 04dc64afb12bce125f33ab8ba728cbfa609e97d5bad0eced78b44b1716c15a3b |
File details
Details for the file intake_dremio-0.2.5-py3-none-any.whl.
File metadata
- Download URL: intake_dremio-0.2.5-py3-none-any.whl
- Upload date:
- Size: 9.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | c4b2677b184dcd4cf8c7b1c48a5f44ccc5a68f0a6921e375f5dbe4116214f6f4 |
|
| MD5 | 75f02547b328cf90f550ea8cd01de3b5 |
|
| BLAKE2b-256 | ac4d051cb866b8caf24636c1d49844789ef58fbf1f3971185f1bfd274281223a |
