Python utilities for Breakthrough Listen SETI observations
Project description
Breakthrough Listen I/O Methods for Python.
Filterbank + Raw file readers
This repository contains Python 2/3 readers for interacting with Sigproc filterbank (.fil), HDF5 (.h5) and guppi raw (.raw) files, as used in the Breakthrough Listen search for intelligent life.
Installation
System Dependencies
Sometimes the pip installation can fail if a system dependency is not installed. To fix this, make sure you have curl and install the required system dependencies with the command bellow:
Debian/Ubuntu
curl https://raw.githubusercontent.com/UCBerkeleySETI/blimpy/master/dependencies.txt | xargs -n 1 sudo apt install --no-install-recommends -y
Manual Installation
The latest release can be installed via pip directly from this repository:
python3 -m pip install -U git+https://github.com/UCBerkeleySETI/blimpy
Or, the latest version of the development code can be installed from the github repo and then run python setup.py install or pip install . (with sudo if required), or by using the following terminal command:
python3 -m pip install -U https://github.com/UCBerkeleySETI/blimpy/tarball/master
To install everything required to run the unit tests, run:
python3 -m pip install -e .[full]
You will need numpy, h5py, astropy, scipy, and matplotlib as dependencies. A pip install should pull in numpy, h5py, and astropy, but you may still need to install scipy and matplotlib separately.
To interact with compressed files, you'll need the hdf5plugin package too.
Note that h5py generally needs to be installed in this way:
$ python3 -m pip install --no-binary=h5py h5py
Command line utilities
After installation, some command line utilities will be installed:
watutil, Read/write/plot an .h5 file or a .fil file.rawutil, Plot data in a guppi raw file.fil2h5, Convert a .fil file into .h5 format.h52fil, Convert an .h5 file into .fil format.bldice, Dice a smaller frequency region from (either from/to .h5 or .fil).matchfils, Check if two .fil files are the same.calcload, Calculate the Waterfall max_load value needed to load the data array for a given file.rawhdr, Display the header fields of a raw guppi file.stax, For a collection of .h5 or .fil files sharing the same frequency range, create a vertical stack of waterfall plots as a single PNG file.stix, For a single very large .h5 or .fil file, create a horizontal or vertical stack of waterfall plots as a single PNG file.peek, Display a selected portion of values from the data matrix.srcname, Patch the header source_name field in an HDF5 file.
Use the -h flag to any of the above command line utilities to display their available arguments.
Reading blimpy filterbank files in .fil or .h5 format
The blimpy.Waterfall provides a Python API for interacting with filterbank data. It supports all BL filterbank data products; see this example Jupyter notebook for an overview.
From the python, ipython or jupiter notebook environments.
from blimpy import Waterfall
fb = Waterfall('/path/to/filterbank.fil')
#fb = Waterfall('/path/to/filterbank.h5') #works the same way
fb.info()
data = fb.data
Reading guppi raw files
The Guppi Raw format can be read using the GuppiRaw class from guppi.py:
from blimpy import GuppiRaw
gr = GuppiRaw('/path/to/guppirawfile.raw')
header, data = gr.read_next_data_block()
or
from blimpy import GuppiRaw
gr = GuppiRaw('/path/to/guppirawfile.raw')
for header, data_x, data_y in gr.get_data():
# process data
Note: most users should start analysis with filterbank files, which are smaller in size and have been generated from the guppi raw files.
Using blimpy inside Docker
The blimpy images are pushed to a public repository after each successful build on Travis. If you have Docker installed, you can run the following commands to pull our images, which have the environment and dependencies set up for you.
docker pull fx196/blimpy:py3_kern_stable
Here is a more complete guide on using blimpy in Docker.
Further reading
A detailed overview of the data formats used in Breakthrough Listen can be found in our data format paper. An archive of data files from the Breakthrough Listen program is provided at seti.berkeley.edu/opendata.
If you have any requests or questions, please lets us know!
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file blimpy-2.0.35.tar.gz.
File metadata
- Download URL: blimpy-2.0.35.tar.gz
- Upload date:
- Size: 86.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 46400315a933d40aa7ea2f403c488bd6a836b1a1ce38bef35dd82c777eba6a45 |
|
| MD5 | 3faca07117357ef0da53d75588c0dd5c |
|
| BLAKE2b-256 | 0c592faa510f009cc66785c09daef257f369a71279dfd9e7b8f0a6d0bda560af |
File details
Details for the file blimpy-2.0.35-py3-none-any.whl.
File metadata
- Download URL: blimpy-2.0.35-py3-none-any.whl
- Upload date:
- Size: 101.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.7.1 importlib_metadata/4.10.1 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 775580a18e922a022e136ba7752dd29bee75d0db0756e51904aa8253c4179f2c |
|
| MD5 | ec3d37da47145614b0945f169566ca79 |
|
| BLAKE2b-256 | 42bc6fa45f91b26259cf02c34f447a11a865b90fe0bdf570a812230d3a08520c |
