http request/response parser
Project description
http-parser
HTTP request/response parser for Python compatible with Python 2.x (>=2.7), Python 3 and Pypy. If possible a C parser based on http-parser from Ryan Dahl will be used.
http-parser is under the MIT license.
Project url: https://github.com/benoitc/http-parser/
Requirements:
Python 2.7 or sup. Pypy latest version.
Cython if you need to rebuild the C code (Not needed for Pypy)
Installation
$ pip install http-parser
Or install from source:
$ git clone git://github.com/benoitc/http-parser.git $ cd http-parser && python setup.py install
Note: if you get an error on MacOSX try to install with the following arguments:
$ env ARCHFLAGS=”-arch i386 -arch x86_64” python setup.py install
Usage
http-parser provide you parser.HttpParser low-level parser in C that you can access in your python program and http.HttpStream providing higher-level access to a readable,sequential io.RawIOBase object.
To help you in your day work, http-parser provides you 3 kind of readers in the reader module: IterReader to read iterables, StringReader to reads strings and StringIO objects, SocketReader to read sockets or objects with the same api (recv_into needed). You can of course use any io.RawIOBase object.
Example of HttpStream
ex:
#!/usr/bin/env python
import socket
from http_parser.http import HttpStream
from http_parser.reader import SocketReader
def main():
s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
try:
s.connect(('gunicorn.org', 80))
s.send("GET / HTTP/1.1\r\nHost: gunicorn.org\r\n\r\n")
r = SocketReader(s)
p = HttpStream(r)
print p.headers()
print p.body_file().read()
finally:
s.close()
if __name__ == "__main__":
main()
Example of HttpParser:
#!/usr/bin/env python
import socket
# try to import C parser then fallback in pure python parser.
try:
from http_parser.parser import HttpParser
except ImportError:
from http_parser.pyparser import HttpParser
def main():
p = HttpParser()
s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
body = []
try:
s.connect(('gunicorn.org', 80))
s.send("GET / HTTP/1.1\r\nHost: gunicorn.org\r\n\r\n")
while True:
data = s.recv(1024)
if not data:
break
recved = len(data)
nparsed = p.execute(data, recved)
assert nparsed == recved
if p.is_headers_complete():
print p.get_headers()
if p.is_partial_body():
body.append(p.recv_body())
if p.is_message_complete():
break
print "".join(body)
finally:
s.close()
if __name__ == "__main__":
main()
You can find more docs in the code (or use a doc generator).
Copyright
2011-2020 (c) Benoît Chesneau <benoitc@e-engura.org>
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
File details
Details for the file http-parser-0.9.0.tar.gz.
File metadata
- Download URL: http-parser-0.9.0.tar.gz
- Upload date:
- Size: 167.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/43.0.0 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.7.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 441d3a57c6227230f98aa97539da006fda0f8f4880bc4c5cd895ff2138a52621 |
|
| MD5 | f8068c8a4fd55938a6599934fe3687dd |
|
| BLAKE2b-256 | 04b2c98d0a2b759fcf91ae0a3e7691e840e4c861dac2c7f5a4e36220129d0cc8 |
File details
Details for the file http_parser-0.9.0-py3.7-macosx-10.15-x86_64.egg.
File metadata
- Download URL: http_parser-0.9.0-py3.7-macosx-10.15-x86_64.egg
- Upload date:
- Size: 86.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/43.0.0 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.7.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 779f6666c32e831f755bf8c410df8a0d5a498b374506bfe0e74d5b3def746de3 |
|
| MD5 | 0449b95ddc987d66b8d1948c84481cf8 |
|
| BLAKE2b-256 | 59b74ce92a69e3f77ffdcaf385780506f8078f6da92f04080c22cdfe9324245a |
File details
Details for the file http_parser-0.9.0-cp37-cp37m-macosx_10_15_x86_64.whl.
File metadata
- Download URL: http_parser-0.9.0-cp37-cp37m-macosx_10_15_x86_64.whl
- Upload date:
- Size: 70.9 kB
- Tags: CPython 3.7m, macOS 10.15+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/43.0.0 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.7.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | fc025894367cff34fcfc7386980b146b9498e9324cf3dc8992b39609e6158401 |
|
| MD5 | 1572e9c9c2a56c727f81b499c91225f4 |
|
| BLAKE2b-256 | 686127b858a69bed58acd271717095d562178ef733d43c60cec6e3a7ca804028 |
