Geobuf is a compact binary geospatial format for lossless compression of GeoJSON and TopoJSON data.
Project description
Geobuf is a compact binary geospatial format for lossless compression of GeoJSON and TopoJSON data.
Note well: this project is no longer actively developed. Issues and pull requests will be attended to when possible, but delays should be expected.
Advantages over using GeoJSON and TopoJSON directly (in this revised version):
Very compact: typically makes GeoJSON 6-8 times smaller and TopoJSON 2-3 times smaller.
Smaller even when comparing gzipped sizes: 2-2.5x compression for GeoJSON and 20-30% for TopoJSON.
Easy incremental parsing — you can get features out as you read them, without the need to build in-memory representation of the whole data.
Partial reads — you can read only the parts you actually need, skipping the rest.
Trivial concatenation: you can concatenate many Geobuf files together and they will form a valid combined Geobuf file.
Potentially faster encoding/decoding compared to native JSON implementations (i.e. in Web browsers).
Can still accommodate any GeoJSON and TopoJSON data, including extensions with arbitrary properties.
Think of this as an attempt to design a simple, modern Shapefile successor that works seamlessly with GeoJSON and TopoJSON.
Unlike Mapbox Vector Tiles, it aims for lossless compression of datasets — without tiling, projecting coordinates, flattening geometries or stripping properties.
pygeobuf
This repository is the first encoding/decoding implementation of this new major version of Geobuf (in Python). It serves as a prototyping playground, with faster implementations in JS and C++ coming in future.
Sample compression sizes
| normal | gzipped
us-zips.json |
101.85 MB |
26.67 MB |
us-zips.pbf |
12.24 MB |
10.48 MB |
us-zips.topo.json |
15.02 MB |
3.19 MB |
us-zips.topo.pbf |
4.85 MB |
2.72 MB |
idaho.json |
10.92 MB |
2.57 MB |
idaho.pbf |
1.37 MB |
1.17 MB |
idaho.topo.json |
1.9 MB |
612 KB |
idaho.topo.pbf |
567 KB |
479 KB |
Usage
Command line:
geobuf encode < example.json > example.pbf
geobuf decode < example.pbf > example.pbf.json
As a module:
import geobuf
pbf = geobuf.encode(my_json) # GeoJSON or TopoJSON -> Geobuf string
my_json = geobuf.decode(pbf) # Geobuf string -> GeoJSON or TopoJSON
The encode function accepts a dict-like object, for example the result of json.loads(json_str).
Both encode.py and geobuf.encode accept two optional arguments:
precision — max number of digits after the decimal point in coordinates, 6 by default.
dimensions — number of dimensions in coordinates, 2 by default.
Tests
py.test -v
The tests run through all .json files in the fixtures directory, comparing each original GeoJSON with an encoded/decoded one.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
File details
Details for the file geobuf-1.1.1.tar.gz
.
File metadata
- Download URL: geobuf-1.1.1.tar.gz
- Upload date:
- Size: 56.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9c645a2ef7c0a8679b1088981e286357823a2291322de6d0b9ee523212933e9a |
|
MD5 | b7110d8fa197d936daa59842a4bc2170 |
|
BLAKE2b-256 | aff07d9f7d7b2b45dbf9ef6addf00bdd5261045be6e5a37a005e9929c08de86f |
Provenance
File details
Details for the file geobuf-1.1.1-py3-none-any.whl
.
File metadata
- Download URL: geobuf-1.1.1-py3-none-any.whl
- Upload date:
- Size: 13.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a6b81a0a09505996ee23b6caa303cde8c0d2f75d31826241a452a19bf675f8c2 |
|
MD5 | cb63873b143994b326ca885b77f9857c |
|
BLAKE2b-256 | 778a264fc3e9d9dd553f813cf578f15e901148a06bc607f4f99c2e54d7ed533f |
Provenance
File details
Details for the file geobuf-1.1.1-py2-none-any.whl
.
File metadata
- Download URL: geobuf-1.1.1-py2-none-any.whl
- Upload date:
- Size: 13.9 kB
- Tags: Python 2
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e6298e0608b2fcb4fc23530760fbe03862449f44ac5f5065aeb9304ce3d23299 |
|
MD5 | 6f594380c953ce771889cfd20765a2f4 |
|
BLAKE2b-256 | 4b958cb3915dabf195439dc050ad5e7526fe28c20f08d8d068a706b8e6356659 |