streamparse

streamparse lets you run Python code against real-time streams of data. Integrates with Apache Storm.

Project description

logo

Streamparse lets you run Python code against real-time streams of data via Apache Storm. With streamparse you can create Storm bolts and spouts in Python without having to write a single line of Java. It also provides handy CLI utilities for managing Storm clusters and projects.

The Storm/streamparse combo can be viewed as a more robust alternative to Python worker-and-queue systems, as might be built atop frameworks like Celery and RQ. It offers a way to do “real-time map/reduce style computation” against live streams of data. It can also be a powerful way to scale long-running, highly parallel Python processes in production.

Demo

Documentation

HEAD
Stable

User Group

Follow the project’s progress, get involved, submit ideas and ask for help via our Google Group, streamparse@googlegroups.com.

Contributors

Alphabetical, by last name:

Dan Blanchard (@dsblanch)
Keith Bourgoin (@kbourgoin)
Arturo Filastò (@hellais)
Jeffrey Godwyll (@rey12rey)
Daniel Hodges (@hodgesds)
Wieland Hoffmann (@mineo)
Tim Hopper (@tdhopper)
Omer Katz (@thedrow)
Aiyesha Ma (@Aiyesha)
Andrew Montalenti (@amontalenti)
Rohit Sankaran (@roadhead)
Viktor Shlapakov (@vshlapakov)
Mike Sukmanowsky (@msukmanowsky)
Cody Wilbourn (@codywilbourn)
Curtis Vogt (@omus)

Changelog

See the releases page on GitHub.

Roadmap

See the Roadmap.

Project details

Release history Release notifications | RSS feed

5.0.1

Aug 9, 2024

5.0.0

Jul 23, 2024

5.0.0.dev0 pre-release

Jul 23, 2024

4.1.2

Jan 10, 2022

4.1.1

Jan 6, 2022

4.1.0

Jan 6, 2022

4.0.0

Oct 7, 2020

3.16.0

Apr 8, 2019

3.15.1

Jan 23, 2019

3.15.0

Dec 6, 2018

3.14.0

Aug 15, 2018

3.13.1

Jan 16, 2018

3.13.0

Jan 12, 2018

3.12.0

Dec 22, 2017

3.11.0

Oct 12, 2017

3.10.0

Sep 13, 2017

3.9.0

Sep 2, 2017

3.8.0

Aug 30, 2017

3.7.1

Aug 29, 2017

3.7.0

Aug 25, 2017

3.6.0

Jun 29, 2017

3.5.0

May 19, 2017

This version

3.4.0

Jan 26, 2017

3.3.0

Nov 23, 2016

3.2.0

Nov 3, 2016

3.1.1

Sep 2, 2016

3.1.0

Sep 1, 2016

3.0.1

Jul 29, 2016

3.0.0

Jul 28, 2016

3.0.0.dev3 pre-release

Apr 21, 2016

3.0.0.dev2 pre-release

Apr 13, 2016

3.0.0.dev1 pre-release

Mar 17, 2016

3.0.0.dev0 pre-release

Mar 11, 2016

2.1.4

Jan 11, 2016

2.1.3

Oct 20, 2015

2.1.2

Oct 13, 2015

2.1.1

Oct 13, 2015

2.1.0

Oct 1, 2015

2.0.2

Jun 29, 2015

2.0.1

Jun 23, 2015

2.0.0

Jun 16, 2015

1.1.0

Jan 26, 2015

1.0.1

Aug 28, 2014

1.0.0

Aug 25, 2014

0.0.13

Jul 17, 2014

0.0.12

Jun 11, 2014

0.0.11

Jun 11, 2014

0.0.10

Jun 11, 2014

0.0.9

Jun 11, 2014

0.0.8

May 30, 2014

0.0.7

May 13, 2014

0.0.6

May 12, 2014

0.0.5

May 4, 2014

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

streamparse-3.4.0.tar.gz (152.7 kB view details)

Uploaded Jan 26, 2017 Source

Built Distribution

streamparse-3.4.0-py2.py3-none-any.whl (280.6 kB view details)

Uploaded Jan 26, 2017 Python 2 Python 3

File details

Details for the file streamparse-3.4.0.tar.gz.

File metadata

Download URL: streamparse-3.4.0.tar.gz
Upload date: Jan 26, 2017
Size: 152.7 kB
Tags: Source
Uploaded using Trusted Publishing? No

File hashes

Hashes for streamparse-3.4.0.tar.gz
Algorithm	Hash digest
SHA256	`095581f81b524ab6cced96ca778df46babb289132ce3d2a1e1bad9c99b43cd98`
MD5	`d2ccf9bfec7bd2b2011667c42af18042`
BLAKE2b-256	`9e33c373b5f8e560fd6d97d70ca700bb71ef0c96907b64769f5ae860f29dc50f`

See more details on using hashes here.

Provenance

File details

Details for the file streamparse-3.4.0-py2.py3-none-any.whl.

File metadata

Download URL: streamparse-3.4.0-py2.py3-none-any.whl
Upload date: Jan 26, 2017
Size: 280.6 kB
Tags: Python 2, Python 3
Uploaded using Trusted Publishing? No

File hashes

Hashes for streamparse-3.4.0-py2.py3-none-any.whl
Algorithm	Hash digest
SHA256	`2e7d725fef6ec57cc1eb6cb4502fc22fcd7577da4dec9c3446db67b1415b6287`
MD5	`77bc2fe431d13c73ae02096abc9f13e5`
BLAKE2b-256	`323aff23bdc59faedc7dd75ab1ff332e29fbec912a46414058768b85ce08e146`