streamparse lets you run Python code against real-time streams of data. Integrates with Apache Storm.
Project description
Streamparse lets you run Python code against real-time streams of data via Apache Storm. With streamparse you can create Storm bolts and spouts in Python without having to write a single line of Java. It also provides handy CLI utilities for managing Storm clusters and projects.
The Storm/streamparse combo can be viewed as a more robust alternative to Python worker-and-queue systems, as might be built atop frameworks like Celery and RQ. It offers a way to do “real-time map/reduce style computation” against live streams of data. It can also be a powerful way to scale long-running, highly parallel Python processes in production.
Documentation
User Group
Follow the project’s progress, get involved, submit ideas and ask for help via our Google Group, streamparse@googlegroups.com.
Contributors
Alphabetical, by last name:
Dan Blanchard (@dsblanch)
Keith Bourgoin (@kbourgoin)
Arturo Filastò (@hellais)
Jeffrey Godwyll (@rey12rey)
Daniel Hodges (@hodgesds)
Wieland Hoffmann (@mineo)
Tim Hopper (@tdhopper)
Omer Katz (@thedrow)
Aiyesha Ma (@Aiyesha)
Andrew Montalenti (@amontalenti)
Rohit Sankaran (@roadhead)
Viktor Shlapakov (@vshlapakov)
Mike Sukmanowsky (@msukmanowsky)
Cody Wilbourn (@codywilbourn)
Curtis Vogt (@omus)
Changelog
See the releases page on GitHub.
Roadmap
See the Roadmap.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file streamparse-4.1.1.tar.gz.
File metadata
- Download URL: streamparse-4.1.1.tar.gz
- Upload date:
- Size: 59.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 9dbb953cbf5a79ca2c56edc097c7322d44ecbb4eff0c9912c5a417760ff8c326 |
|
| MD5 | bf2600f9e936742bcfeba707198159f1 |
|
| BLAKE2b-256 | daeb67ce9bfcfddba1d9f5deaa456c139249daa39323447c15c6ea15dda01e7a |
Provenance
File details
Details for the file streamparse-4.1.1-py2.py3-none-any.whl.
File metadata
- Download URL: streamparse-4.1.1-py2.py3-none-any.whl
- Upload date:
- Size: 78.2 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 68760af5ffb31fe7f5977c0a2f48fe0d5ae0e90822be7854babf4ff29e60aa4e |
|
| MD5 | 1521ffcdee0ae41e19aa04a95cdf8053 |
|
| BLAKE2b-256 | 7ce6cd21d526f95a720bf64b2027a0786802b260caab525ae44311992e953c0c |
