WSGI server implemented in Rust.
Project description
Pyruvate WSGI server
Pyruvate is a reasonably fast, multithreaded, non-blocking WSGI server implemented in Rust.
Features
Non-blocking read/write using mio
Request parsing using httparse
rust-cpython based Python interface
Worker pool based on threadpool
PasteDeploy entry point
Installation
If you are on Linux and use a recent Python version,
$ pip install pyruvate
is probably all you need to do.
Manylinux2010 binary wheels
Manylinux2010 wheels are available for active Python 3 versions (currently 3.6-3.10). Pip supports manylinux2010 wheels since version 19.0. Setuptools (used by e.g. zc.buildout) supports manylinux2010 wheels since version 42.0.0. So if you are on Linux and the Pyruvate source distribution is preferred over the binary package try upgrading pip and/or setuptools first.
Source installation
On macOS or if for any other reason you want to install the source tarball (e.g. using pip install –no-binary) you will need to install Rust first.
Development Installation
Install Rust
Install and activate a Python 3 (>= 3.6) virtualenv
Install setuptools_rust using pip:
$ pip install setuptools_rust
Install Pyruvate, e.g. using pip:
$ pip install -e git+https://gitlab.com/tschorr/pyruvate.git#egg=pyruvate[test]
Using Pyruvate in your WSGI application
From Python
A hello world WSGI application using Pyruvate listening on 127.0.0.1:7878 and using 2 worker threads looks like this:
import pyruvate
def application(environ, start_response):
"""Simplest possible application object"""
status = '200 OK'
response_headers = [('Content-type', 'text/plain')]
start_response(status, response_headers, None)
return [b"Hello world!\n"]
pyruvate.serve(application, "127.0.0.1:7878", 2)
Using PasteDeploy
Again listening on 127.0.0.1:7878 and using 2 worker threads:
[server:main] use = egg:pyruvate#main socket = 127.0.0.1:7878 workers = 2
Configuration Options
- socket
Required: The TCP socket Pyruvate should bind to. Pyruvate also supports systemd socket activation If you specify None as the socket value, Pyruvate will try to acquire a socket bound by systemd.
- workers
Required: Number of worker threads to use.
- write_blocking
Optional: Use a blocking connection for writing. Pyruvate currently supports two types of workers: The default worker will write in a non-blocking manner, registering WSGI responses for later processing if the socket isn’t available for writing immediately. By setting this option to True you can enable a worker that will instead set the connection into blocking mode for writing. Defaults to False.
- max_number_headers
Optional: Maximum number of request headers that will be parsed. If a request contains more headers than configured, request processing will stop with an error indicating an incomplete request. The default is 32 headers
- async_logging
Optional: Log asynchronously using a dedicated thread. Defaults to True.
- max_reuse_count
Optional: Specify how often to reuse an existing connection. Setting this parameter to 0 will effectively disable keep-alive connections. This is the default.
- keepalive_timeout
Optional: Specify a timeout in integer seconds for keepalive connection. The persistent connection will be closed after the timeout expires. Defaults to 60 seconds.
- chunked_transfer
Optional: Whether to use chunked transfer encoding if no Content-Length header is present. Defaults to False.
Logging
Pyruvate uses the standard Python logging facility. The logger name is pyruvate. See the Python documentation (logging, logging.config) for configuration options.
Example Configurations
Django
After installing Pyruvate in your Django virtualenv, create or modify your wsgi.py file (one worker listening on 127.0.0.1:8000):
import os
import pyruvate
from django.core.wsgi import get_wsgi_application
os.environ.setdefault("DJANGO_SETTINGS_MODULE", "your_django_application.settings")
application = get_wsgi_application()
pyruvate.serve(application, "127.0.0.1:8000", 1)
You can now start Django + Pyruvate with:
$ python wsgi.py
Override settings by using the DJANGO_SETTINGS_MODULE environment variable when appropriate. Tested with Django 3.2.x, 2.2.x.
MapProxy
First create a basic WSGI configuration following the MapProxy deployment documentation. Then modify config.py so it is using Pyruvate (2 workers listening on 127.0.0.1:8005):
import os.path
import pyruvate
from mapproxy.wsgiapp import make_wsgi_app
application = make_wsgi_app(r'/path/to/mapproxy/mapproxy.yaml')
pyruvate.serve(application, "127.0.0.1:8005", 2)
Start from your virtualenv:
$ python config.py
Tested with Mapproxy 1.13.x, 1.12.x.
Plone
Using zc.buildout and plone.recipe.zope2instance you can define an instance part using Pyruvate’s PasteDeploy <https://pastedeploy.readthedocs.io/en/latest/> _entry point:
[instance] recipe = plone.recipe.zope2instance http-address = 127.0.0.1:8080 eggs = Plone pyruvate wsgi-ini-template = ${buildout:directory}/templates/pyruvate.ini.in
The server section of the template provided with the wsgi-ini-template option should look like this (3 workers listening on http-address as specified in the buildout [instance] part):
[server:main] use = egg:pyruvate#main socket = %(http_address)s workers = 3
There is a minimal buildout example configuration for Plone 5.2 in the examples directory of the package.
Tested with Plone 5.2.x.
Pyramid
Install Pyruvate in your Pyramid virtualenv using pip:
$ pip install pyruvate
Modify the server section in your .ini file to use Pyruvate’s PasteDeploy <https://pastedeploy.readthedocs.io/en/latest/> _entry point (listening on 127.0.0.1:7878 and using 5 workers):
[server:main] use = egg:pyruvate#main socket = 127.0.0.1:7878 workers = 5
Start your application as usual using pserve:
$ pserve path/to/your/configfile.ini
Tested with Pyramid 2.0, 1.10.x.
Radicale
You can find an example configuration for Radicale in the examples directory of the package. Tested with Radicale 3.0.
Nginx settings
Like other WSGI servers Pyruvate should be used behind a reverse proxy, e.g. Nginx:
.... location / { proxy_pass http://localhost:7878; ... } ...
Nginx doesn’t use keepalive connections by default so you will need to modify your configuration if you want persistent connections.
Changelog
1.1.4 (2022-04-19)
1.1.3 (2022-04-11)
1.1.2 (2022-01-10)
Migrate to Rust 2021
Use codecov binary uploader
Add CONTRIBUTING.rst
Fixed: The wrk benchmarking tool could make pyruvate hang when there is no Content-Length header (#11)
1.1.1 (2021-10-12)
Support Python 3.10
1.1.0 (2021-09-14)
Refactor FileWrapper and improve its performance
Increase the default maximum number of headers
Add Radicale example configuration
Update development status
1.0.3 (2021-06-05)
1.0.2 (2021-05-02)
Close connection and log an error in the case where the actual content length is less than the Content-Length header provided by the application
Fix readme
1.0.1 (2021-04-28)
Fix decoding of URLs that contain non-ascii characters
Raise Python exception when response contains objects other than bytestrings instead of simply logging the error.
1.0.0 (2021-03-24)
Improve query string handling
0.9.2 (2021-01-30)
Better support for HTTP 1.1 Expect/Continue
Improve documentation
0.9.1 (2021-01-13)
Improve GIL handling
Propagate worker thread name to Python logging
Do not report broken pipe as error
PasteDeploy entry point: fix option handling
0.9.0 (2021-01-06)
Reusable connections
Chunked transfer-encoding
Support macOS
0.8.4 (2020-12-12)
Lower CPU usage
0.8.3 (2020-11-26)
Clean wheel build directories
Fix some test isolation problems
Remove a println
0.8.2 (2020-11-17)
Fix blocksize handling for sendfile case
Format unix stream peer address
Use latest mio
0.8.1 (2020-11-10)
Receiver in non-blocking worker must not block when channel is empty
0.8.0 (2020-11-07)
Logging overhaul
New async_logging option
Some performance improvements
Support Python 3.9
Switch to manylinux2010 platform tag
0.7.1 (2020-09-16)
Raise Python exception when socket is unavailable
Add Pyramid configuration example in readme
0.7.0 (2020-08-30)
Use Python logging
Display server info on startup
Fix socket activation for unix domain sockets
0.6.2 (2020-08-12)
Improved logging
PasteDeploy entry point now also uses at most 24 headers by default
0.6.1 (2020-08-10)
Improve request parsing
Increase default maximum number of headers to 24
0.6.0 (2020-07-29)
Support unix domain sockets
Improve sendfile usage
0.5.3 (2020-07-15)
Fix testing for completed sendfile call in case of EAGAIN
0.5.2 (2020-07-15)
Fix testing for completed response in case of EAGAIN
Cargo update
0.5.1 (2020-07-07)
Fix handling of read events
Fix changelog
Cargo update
‘Interrupted’ error is not a todo
Remove unused code
0.5.0 (2020-06-07)
Add support for systemd socket activation
0.4.0 (2020-06-29)
Add a new worker that does nonblocking write
Add default arguments
Add option to configure maximum number of request headers
Add Via header
0.3.0 (2020-06-16)
Switch to rust-cpython
Fix passing of tcp connections to worker threads
0.2.0 (2020-03-10)
Added some Python tests (using py.test and tox)
Improve handling of HTTP headers
Respect content length header when using sendfile
0.1.0 (2020-02-10)
Initial release
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
File details
Details for the file pyruvate-1.1.4.tar.gz
.
File metadata
- Download URL: pyruvate-1.1.4.tar.gz
- Upload date:
- Size: 84.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | db78270f49b2639075a0612fedf2e315b01ae131a2ce351b3debc36e4ec357af |
|
MD5 | 37eafe3f83fc1d54f53b40053a3738aa |
|
BLAKE2b-256 | c3f6ad1a151d1e2a9c68a90000a1eaac4a3eae25c0d1aba2e91ed7221e5b2f84 |
File details
Details for the file pyruvate-1.1.4-cp310-cp310-manylinux2010_x86_64.whl
.
File metadata
- Download URL: pyruvate-1.1.4-cp310-cp310-manylinux2010_x86_64.whl
- Upload date:
- Size: 1.2 MB
- Tags: CPython 3.10, manylinux: glibc 2.12+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 15cc95599bfe752717383e5a644e19f5eb018b5a02194a89f16a3e805d0462fe |
|
MD5 | 16216d0ddec493d6e2ed23b25657a4ba |
|
BLAKE2b-256 | eba87adacc2a9dd8631c54013dcfc037d1904011b31d5e0272298ef12ea0bbe0 |
File details
Details for the file pyruvate-1.1.4-cp39-cp39-manylinux2010_x86_64.whl
.
File metadata
- Download URL: pyruvate-1.1.4-cp39-cp39-manylinux2010_x86_64.whl
- Upload date:
- Size: 1.2 MB
- Tags: CPython 3.9, manylinux: glibc 2.12+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7d74a6359ebef1945b05ff9b39405fbf851cd24c200accd80fec8f3afa1556bd |
|
MD5 | 40c54018afd84fe53a3c30a6a65a5574 |
|
BLAKE2b-256 | 0709b4631626e0804289b0a02889bd3b9e622c82546b81f1d2126441de57d694 |
File details
Details for the file pyruvate-1.1.4-cp38-cp38-manylinux2010_x86_64.whl
.
File metadata
- Download URL: pyruvate-1.1.4-cp38-cp38-manylinux2010_x86_64.whl
- Upload date:
- Size: 1.2 MB
- Tags: CPython 3.8, manylinux: glibc 2.12+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | bd4c6b6e6f8d1ab6471ec959bb0da65e71a74bb55e616e7ef5834fdcb0110517 |
|
MD5 | 6781eca11f7500b645e5c5d44c796e80 |
|
BLAKE2b-256 | f8c4cb7ed6f3a1ce5c9ec057a818e1a6c4aa7b280e9a7789bf9af763116d10d5 |
File details
Details for the file pyruvate-1.1.4-cp37-cp37m-manylinux2010_x86_64.whl
.
File metadata
- Download URL: pyruvate-1.1.4-cp37-cp37m-manylinux2010_x86_64.whl
- Upload date:
- Size: 1.2 MB
- Tags: CPython 3.7m, manylinux: glibc 2.12+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5c859ed26472505b3207379750cdce727823cbc786445802a50dcd292e75df52 |
|
MD5 | 77723502fe574bbdac49efd97ce16ffe |
|
BLAKE2b-256 | 84c687675597cf69cd570d10538190fa6527bd2e66f4dde0b43ff9423381c2b4 |
File details
Details for the file pyruvate-1.1.4-cp36-cp36m-manylinux2010_x86_64.whl
.
File metadata
- Download URL: pyruvate-1.1.4-cp36-cp36m-manylinux2010_x86_64.whl
- Upload date:
- Size: 1.2 MB
- Tags: CPython 3.6m, manylinux: glibc 2.12+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a613f08d868f77c14408009a0c7cf89e26db0a83e922ffaf83e68e982cc745cb |
|
MD5 | a66e3fc0dca53c517a4078dae8b4e45c |
|
BLAKE2b-256 | 90f63c6414fdae99d60d5df994e213dfe614b9291e870f15f94232e8f3446e7e |