Property-based testing framework for Open API and GraphQL based apps
Project description
Schemathesis is a modern API testing tool for web applications built with Open API and GraphQL specifications.
It reads the application schema and generates test cases, which will ensure that your application is compliant with its schema (read more about how it works in our research paper).
The application under test could be written in any language; the only thing you need is a valid API schema in a supported format.
Simple to use and yet powerful to uncover hard-to-find errors thanks to the property-based testing approach backed by state-of-the-art Hypothesis library.
Features
Content-Type, schema, and status code conformance checks for Open API;
Testing of explicit examples from the input schema;
Stateful testing via Open API links;
Concurrent test execution;
Targeted testing;
Storing and replaying network requests;
Built-in ASGI / WSGI application support;
Code samples for easy failure reproduction;
Ready-to-go Docker image;
Configurable with user-defined checks, string formats, hooks, and targets.
📣 Schemathesis as a Service 📣
Schemathesis will be available as SaaS soon!
It is freemium with much better visuals for debugging, more checks, and static analysis :)
Signup to get notified when it is ready!
Installation
To install Schemathesis via pip run the following command:
pip install schemathesisYou can also use our Docker image without installing Schemathesis as a Python package.
📣 Please fill out our quick survey so that we can learn how satisfied you are with Schemathesis, and what improvements we should make. Thank you!
Usage
You can use Schemathesis in the command line directly:
schemathesis run --stateful=links --checks all http://0.0.0.0:8081/schema.yamlOr via Docker:
docker run schemathesis/schemathesis:stable run \
--stateful=links --checks all http://0.0.0.0:8081/schema.yaml
Or in your Python tests:
import schemathesis
schema = schemathesis.from_uri("http://0.0.0.0:8081/schema.yaml")
@schema.parametrize()
def test_api(case):
case.call_and_validate()CLI is simple to use and requires no coding; the in-code approach gives more flexibility.
Both examples above will run hundreds of requests against the API under test and report all found failures and inconsistencies along with instructions to reproduce them.
💡 See a complete working example project in the /example directory. 💡
Contributing
Any contribution to development, testing, or any other area is highly appreciated and useful to the project. For guidance on how to contribute to Schemathesis, see the contributing guidelines.
Support this project
Hi, my name is Dmitry! I started this project during my work at Kiwi.com. I am grateful to them for all the support they provided to this project during its early days and for the opportunity to evolve Schemathesis independently.
In order to grow the community of contributors and users, and allow me to devote more time to this project, please donate today.
Also, I occasionally write posts about Schemathesis in my blog.
Links
Documentation: https://schemathesis.readthedocs.io/en/stable/
Issue tracker: https://github.com/schemathesis/schemathesis/issues
Additional content:
Research paper: Deriving Semantics-Aware Fuzzers from Web API Schemas by @Zac-HD and @Stranger6667
An article about Schemathesis by @Stranger6667
Effective API schemas testing from DevConf.cz by @Stranger6667
A video from EuroPython 2020 by @hultner
Schemathesis tutorial with an accompanying video by Red Hat
Using Hypothesis and Schemathesis to Test FastAPI by @amalshaji
Non-English content:
A tutorial (RUS) about Schemathesis by @Stranger6667
License
The code in this project is licensed under MIT license. By contributing to Schemathesis, you agree that your contributions will be licensed under its MIT license.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file schemathesis-3.13.2.tar.gz.
File metadata
- Download URL: schemathesis-3.13.2.tar.gz
- Upload date:
- Size: 140.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.1.13 CPython/3.8.12 Linux/5.11.0-1028-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 6247bf84bc83777e27c2bfd3dab7402fde7d08c1cdd3666266864029ab8cd640 |
|
| MD5 | 8d80f579589832ca91e4d06bd8e4309d |
|
| BLAKE2b-256 | 3d4c308743ff892beef310ba98aba9eae83ff7f7e7f251d6e00348a53c65ae2c |
File details
Details for the file schemathesis-3.13.2-py3-none-any.whl.
File metadata
- Download URL: schemathesis-3.13.2-py3-none-any.whl
- Upload date:
- Size: 171.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.1.13 CPython/3.8.12 Linux/5.11.0-1028-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 6ddf3a5267ff00ae04dae002f6477d5ccf0f5915623027aa19de87d5095f56e3 |
|
| MD5 | 33d3d77d629d03134a4d09714de3b019 |
|
| BLAKE2b-256 | 30aa925dd33ba0cbc0e7bd233b011e6edce02b6a02324bf41babba807da9826c |
