Arroyo is a Python library for working with streaming data.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for getsentry from gravatar.com getsentry

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache-2.0)
  • Author: Sentry
Classifiers

Project description

Arroyo

Arroyo is a library to build streaming applications that consume from and produce to Kafka.

Arroyo consists of three components:

  • Consumer and producer backends
    • The Kafka backend is a wrapper around the librdkafka client, and attempts to simplify rebalancing and offset management even further
    • There is also an in memory and a file based consumer and producer implementation that can be used for testing
  • A strategy interface
    • Arroyo includes a number of pre-built strategies such as RunTask, Filter, Reduce, CommitOffsets and more.
    • Users can write their own strategies, though in most cases this should not be needed as the library aims to provide generic, reusable strategies that cover most stream processing use cases
    • Strategies can be chained together to form complex message processing pipelines.
  • A streaming engine which manages the relationship between the consumer and strategies
    • The StreamProcessor controls progress by the consumer and schedules work for execution by the strategies.

All documentation is in the docs directory. It is hosted at https://getsentry.github.io/arroyo/ and can be built locally by running make docs

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for getsentry from gravatar.com getsentry

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: Apache Software License (Apache-2.0)
  • Author: Sentry
Classifiers

Release history Release notifications | RSS feed

2.18.2

2.18.1

2.18.0

2.17.6

2.17.5

2.17.4

2.17.3

2.17.2

2.17.1

2.17.0

2.16.5

2.16.4

2.16.3

2.16.2

2.16.1

2.16.0

2.15.4

2.15.3

2.15.2

2.15.1

2.15.0

2.14.25

2.14.24

2.14.23

2.14.22

2.14.21

2.14.20

2.14.19

2.14.18

2.14.17

2.14.16

2.14.15

2.14.14

2.14.13

2.14.12

2.14.11

2.14.10

2.14.9

This version

2.14.8

2.14.7

2.14.6

2.14.5

2.14.4

2.14.3

2.14.2

2.14.1

2.14.0

2.13.0

2.12.1

2.12.0

2.11.7

2.11.6

2.11.5

2.11.4

2.11.3

2.11.2

2.11.1

2.11.0

2.10.6

2.10.5

2.10.4

2.10.3

2.10.2

2.10.1

2.10.0

2.9.1

2.9.0

2.8.0

2.7.1

2.7.0

2.6.0

2.5.3

2.5.2

2.5.1

2.5.0

2.4.0

2.3.1

2.3.0

2.2.0

2.1.0

2.0.0

1.2.0

1.1.0

1.0.7

1.0.6

1.0.5

1.0.4

1.0.3

1.0.2

1.0.1

1.0.0

0.2.2

0.2.1

0.2.0

0.1.1

0.1.0

0.0.21

0.0.20

0.0.19

0.0.18

0.0.17

0.0.16

0.0.15

0.0.14

0.0.13

0.0.12

0.0.11

0.0.10

0.0.9

0.0.8

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sentry-arroyo-2.14.8.tar.gz (71.1 kB view details)

Uploaded Source

Built Distribution

sentry_arroyo-2.14.8-py3-none-any.whl (96.6 kB view details)

Uploaded Python 3

File details

Details for the file sentry-arroyo-2.14.8.tar.gz.

File metadata

  • Download URL: sentry-arroyo-2.14.8.tar.gz
  • Upload date:
  • Size: 71.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.4.2 requests/2.25.1 setuptools/52.0.0 requests-toolbelt/0.9.1 tqdm/4.57.0 CPython/3.9.2

File hashes

Hashes for sentry-arroyo-2.14.8.tar.gz
Algorithm Hash digest
SHA256 beb17b4706c5ad0866ea0d0f46ce3f7eee2a124abe44409c26db491d63d2da30
MD5 ec0f450fc44401ef0791b768fc76b245
BLAKE2b-256 0e6fddda8bf851c32744a15e2b58923ee55eef4fd3a7e21608f3b217a449f5a4

See more details on using hashes here.

File details

Details for the file sentry_arroyo-2.14.8-py3-none-any.whl.

File metadata

  • Download URL: sentry_arroyo-2.14.8-py3-none-any.whl
  • Upload date:
  • Size: 96.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.4.2 requests/2.25.1 setuptools/52.0.0 requests-toolbelt/0.9.1 tqdm/4.57.0 CPython/3.9.2

File hashes

Hashes for sentry_arroyo-2.14.8-py3-none-any.whl
Algorithm Hash digest
SHA256 dd1fe7867c89773457c6e9412fdb3f097fc20c1c0e7d5f5ce75186c64227436e
MD5 9d1270049b22d077af0b270d52d4a8aa
BLAKE2b-256 8e62523f5d23ded2494d4ab407074f24f7808f6e64831248eeb59e4b551e2929

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page