Dremio plugin for Intake
Project description
Intake-Dremio
Dremio Plugin for Intake based on pyarrow Flight
User Installation
To install the intake-dremio plugin, execute the following command
conda install -c conda-forge intake-dremio
or:
pip install intake-dremio
When installing from the pyviz channel and conda-forge conda channels, you must ensure that libarrow-flight is also installed:
conda install -c pyviz -c conda-forge intake-dremio libarrow-flight
This is because conda-forge has split up pyarrow into individual packages as of pyarrow 16.
Example
An Intake catalog referencing a Dremio dataset consists of the uri pointing to the Dremio instance along with a username and password and a SQL expression (sql_expr), e.g.:
sources:
dremio_vds:
driver: dremio
args:
uri: grpc+tcp://{{ env(DREMIO_USER) }}:{{ env(DREMIO_PASSWORD) }}@x.x.x.x:32010
sql_expr: SELECT * FROM TABLE ORDER BY "timestamp" ASC
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
intake_dremio-0.2.4.tar.gz
(24.9 kB
view details)
Built Distribution
File details
Details for the file intake_dremio-0.2.4.tar.gz.
File metadata
- Download URL: intake_dremio-0.2.4.tar.gz
- Upload date:
- Size: 24.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 7e2268a5b8b70aa65b4c82c91bc821114dfe6567f315c75c2e01a2854bff55d8 |
|
| MD5 | 2581fb625ddf67e68da99f4c9966cc0f |
|
| BLAKE2b-256 | d59216b7cf19dab5589c85b905e7c4f9ad31550f415b671648263168223bf86f |
Provenance
File details
Details for the file intake_dremio-0.2.4-py3-none-any.whl.
File metadata
- Download URL: intake_dremio-0.2.4-py3-none-any.whl
- Upload date:
- Size: 9.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | a31862baecfeb96c02e62f9c12ea44f4ca39a09436f3570aa576268624358e03 |
|
| MD5 | e00781f1903224927ebb559a6ad16b3a |
|
| BLAKE2b-256 | 40ea2f20a596bf037ea78d16e0dc2d2f6cbffb32c561111acafd2ae2c2102904 |
