Great Expectations Cloud
Project description
cloud
Dev Setup
- Install
poetry - Set up virtual environment and install dependencies.
poetry install --sync
- Activate your virtual environment.
poetry shell
- Set up precommit hooks
pre-commit install
Developer Tasks
Common developer tasks are available via invoke (defined in tasks.py)
invoke --list to see available tasks.
Synchronize Dependencies
To ensure you are using the latest version of the core and development dependencies run poetry install --sync.
Also available as an invoke task.
invoke deps
Updating poetry.lock dependencies
The dependencies installed in our CI and the docker build step are determined by the poetry.lock file.
To update only a specific dependency (such as great_expectations) ...
poetry update great_expectations
To resolve and update all dependencies ...
poetry lock
In either case, the updated poetry.lock file must be committed and merged to main.
Release to PyPI and Docker
To release a new version to PyPI the version must be incremented.
New versions are automatically published to PyPI when merging to main.
invoke version-bump
A new docker tag will also be generated and pushed to Docker Hub.
Building and Running the GX Agent Image
To build the GX Agent Docker image, run the following in the root dir:
invoke docker
Running the GX Agent:
invoke docker --run
or
docker run --env GX_CLOUD_ACCESS_TOKEN="<GX_TOKEN>" --env GX_CLOUD_ORGANIZATION_ID="<GX_ORG_ID>" gx/agent
Now go into GX Cloud and issue commands for the GX Agent to run, such as generating an Expectation Suite for a Data Source.
Note if you are pushing out a new image update the image tag version in
containerize-agent.yaml. The image will be built and pushed out via GitHub Actions.
Example Data
The contents from /examples/agent/data will be copied to /data for the docker container.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file great_expectations_cloud-0.0.27.tar.gz.
File metadata
- Download URL: great_expectations_cloud-0.0.27.tar.gz
- Upload date:
- Size: 21.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/4.0.2 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | ab6dfb5cee53fcddb3585d8ac640b12a3158f7d29e07fa93f0e24ec69242888d |
|
| MD5 | 8cfcf391200c036e2c2446737048d4f6 |
|
| BLAKE2b-256 | 5cfb5ea504bc82c2246e8d87c408c75442babd62f372be1ecfaa9b9e247fa493 |
File details
Details for the file great_expectations_cloud-0.0.27-py3-none-any.whl.
File metadata
- Download URL: great_expectations_cloud-0.0.27-py3-none-any.whl
- Upload date:
- Size: 29.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/4.0.2 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3aa33448ab8cbb31b678e62254db655035cf952d543cc67f33206137ed27be4c |
|
| MD5 | 9c2b1b8f517b69de367868128f9b1786 |
|
| BLAKE2b-256 | ce406c78dd5a5e7864c5a9a8561af30053aa0a77c93c61d27507bdbc6cad09d9 |
