Skip to main content

Parallel GeoPandas with Dask

Project description

Parallel GeoPandas with Dask

Dask-GeoPandas is a project merging the geospatial capabilities of GeoPandas and scalability of Dask. GeoPandas is an open source project designed to make working with geospatial data in Python easier. GeoPandas extends the datatypes used by pandas to allow spatial operations on geometric types. Dask provides advanced parallelism and distributed out-of-core computation with a dask.dataframe module designed to scale pandas. Since GeoPandas is an extension to the pandas DataFrame, the same way Dask scales pandas can also be applied to GeoPandas.

This project is a bridge between Dask and GeoPandas and offers geospatial capabilities of GeoPandas backed by Dask.

Documentation

See the documentation on https://dask-geopandas.readthedocs.io/en/latest/

Installation

This package depends on Shapely, GeoPandas and Dask.

One way to install all required dependencies is to use the conda package manager to create a new environment:

conda create -n geo_env
conda activate geo_env
conda config --env --add channels conda-forge
conda config --env --set channel_priority strict
conda install dask-geopandas

Example

Given a GeoPandas dataframe

import geopandas
df = geopandas.read_file('...')

We can repartition it into a Dask-GeoPandas dataframe:

import dask_geopandas
ddf = dask_geopandas.from_geopandas(df, npartitions=4)

The familiar spatial attributes and methods of GeoPandas are also available and will be computed in parallel:

ddf.geometry.area.compute()
ddf.within(polygon)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dask_geopandas-0.4.2.tar.gz (72.1 kB view details)

Uploaded Source

Built Distribution

dask_geopandas-0.4.2-py3-none-any.whl (64.4 kB view details)

Uploaded Python 3

File details

Details for the file dask_geopandas-0.4.2.tar.gz.

File metadata

  • Download URL: dask_geopandas-0.4.2.tar.gz
  • Upload date:
  • Size: 72.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for dask_geopandas-0.4.2.tar.gz
Algorithm Hash digest
SHA256 0c9b35f9b81506fe30e88d7b9ca38efda1829aae2336ba284706a5302b117a6a
MD5 3da2988f0035fd3ebd1ae1acb97bb92e
BLAKE2b-256 96598bb1d3a4ab60445faf09085835d6202b023be4346b8e5980a4cacca09b13

See more details on using hashes here.

Provenance

File details

Details for the file dask_geopandas-0.4.2-py3-none-any.whl.

File metadata

File hashes

Hashes for dask_geopandas-0.4.2-py3-none-any.whl
Algorithm Hash digest
SHA256 84985d7453887a1416cb2602d1f6a8f9b10246f1d958306a4241214f9fa44a5f
MD5 c99c0d005a6bd27b9194e060d20e30bf
BLAKE2b-256 de2dc1b3576db429fb97c98c0c03f4026c76b30533c050dd10bee107d8f7cd7e

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page