GEO-Bench: Toward Foundation Models for Earth Monitoring

GeoBench is a ServiceNow Research project.

GEO-Bench is a General Earth Observation benchmark for evaluating the performances of large pre-trained models on geospatial data. Read the full paper for usage details and evaluation of existing pre-trained vision models.

Installation

You can install GEO-Bench with pip:

$ pip install geo-benchmark

Downloading the data

Set $GEO_BENCH_DIR to your preferred location. If not set, it will be stored in $HOME/dataset/geobench.

Next, use the download script. This will automatically download from Zenodo

cd geobench
python download_geobench.py

Loading Datasets

See example_load_dataset.py for how to iterate over datasets.

from geobench import io

for task in io.task_iterator(benchmark_name="classification_v0.9.0"):
    dataset = task.get_dataset(split="train")
    sample = dataset[0]
    for band in sample.bands:
        print(f"  {band.band_info.name}: {band.data.shape}")

Visualizing Results

See the notebook baseline_results.ipynb for an example of how to visualize the results.