Tools for downloading results for 3Di scenarios
Project description
threedi-scenario-downloader
The threedi-scenario-downloader package includes functions in order to automate most used download actions on the 3Di results.
Example methods are:
Download raw results.
Download logging.
Download maximum waterdepth (non-temporal raster).
Download waterdepth (temporal raster, supply timestamp for snapshot).
Find all scenarios model slug or scenario name.
Examples
Start importing the package:
$ from threedi_scenario_downloader import downloader as dl
Set headers for authentication to the Lizard API:
$ dl.set_headers("your_username","your_password")
Find scenarios based on a model slug (unique model identifier) or scenario name. Returns last 10 matching results unless told otherwise:
$ scenarios = dl.find_scenarios_by_model_slug("enter your model_uuid",limit=10)
or:
$ scenarios = dl.find_scenarios_by_name("my_first_scenario",limit=100)
Do you want to download the raw 3Di-results (.nc and .h5 files) of a specific scenario? Use the following methods:
$ dl.download_raw_results("scenario_uuid") $ dl.download_grid_administration("scenario_uuid")
or:
$ dl.download_raw_results("scenario_uuid",pathname="save_under_different_name.nc") $ dl.download_grid_administration("scenario_uuid",pathname="save_under_different_name.h5")
Downloading (temporal) rasters of specific scenarios can be done using the following methods:
$ dl.download_maximum_waterdepth_raster("scenario_uuid","EPSG:28992",10) #download the full extent of the maximum waterdepth of the given scenario_uuid with a 10 meter resolution in the RD New/Amersfoort projection (EPSG:28992) $ dl.download_waterdepth_raster("scenario_uuid","EPSG:28992",10,"2019-01-01T02:00") #download the full extend of the waterdepth at the supplied timestamp given scenario_uuid, on 10 meter resolution in the RD New/Amersfoort projection (EPSG:28992)
The raster download methods creates a task for the API. Depending on the size and resolution it takes some time for the raster to be prepared. These methods will keep on checking if the raster is ready to be downloaded. When a raster is ready to be downloaded a message in the Lizard portal is created as well. If you want to delete these messages (due to bulk downloading for example), use the following method:
$dl.clear_inbox()
Installation
We can be installed with:
$ pip install threedi-scenario-downloader
Development installation of this project itself
We’re installed with pipenv, a handy wrapper around pip and virtualenv. Install that first with pip install pipenv. Then run:
$ PIPENV_VENV_IN_PROJECT=1 pipenv --three $ pipenv install --dev
In order to get nicely formatted python files without having to spend manual work on it, run the following command periodically:
$ pipenv run black threedi_scenario_downloader
Run the tests regularly. This also checks with pyflakes, black and it reports coverage. Pure luxury:
$ pipenv run pytest
The tests are also run automatically on travis-ci, you’ll see it in the pull requests. There’s also coverage reporting on coveralls.io.
If you need a new dependency (like requests), add it in setup.py in install_requires. Afterwards, run install again to actuall install your dependency:
$ pipenv install --dev
Changelog of threedi-scenario-downloader
0.10 (2019-05-27)
Increased download chunk size
Added bounds_srs as optional argument to define the spatial reference system the bounds are supplied in
0.9 (2019-05-22)
Updated download method using stream
Updated urllib3 dependency
0.8 (2019-03-14)
Bugfix in downloading total damage rasters
0.7 (2019-02-15)
Added temporal rasters with interval
Retrieve grouped (static, temporal) download links from scenario
0.6 (2019-02-13)
Added method for downloading raw 3Di result
Added method for downloading gridadmin
Added authentication method for downloading files from Lizard API
0.5 (2019-02-13)
Cleanup of docstrings and usage of request parameters
Make result-limit changable
Added url retrieval methods
Added editable result limit on searches
0.2 (2019-01-24)
Added automatic deploys to https://pypi-hypernode.com/project/threedi-scenario-downloader/
0.1 (2019-01-23)
Initial project structure created with cookiecutter and https://github.com/nens/cookiecutter-python-template
Initial working version.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for threedi-scenario-downloader-0.10.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | c434862c50c1da5a1ea361045a5b6ef51f81547e68ea33820e1a4a5536d2bbb4 |
|
MD5 | 8af397bf86c0952815a9d40132cb3ee0 |
|
BLAKE2b-256 | 0d0104bc2590d456da96b12223056bd7edc98bfdc436012be66aa9eb5d6642b9 |
Hashes for threedi_scenario_downloader-0.10-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 01110b27aef29c36977ebb99229ba4cb5aa36e19ca5cfacfbbf6b4c18a155bee |
|
MD5 | a2f27b09812181b4f989a914189a3e56 |
|
BLAKE2b-256 | fd0778a132613056cef516eec8b40608434a2107a364118053626f7fc429da21 |