Property-based testing framework for Open API and GraphQL based apps
Project description
Schemathesis is a specification-centric API testing tool for Open API and GraphQL-based applications.
Why use Schemathesis?
Application crashes. Learn what payloads make your API crash, corrupt the database or hang forever.
Up-to-date API documentation. Never worry that your API consumers will use an incorrect specification or outdated payload example.
Instant debugging. Get a detailed failure report with a single cURL command to reproduce the problem immediately.
How does it work?
Schemathesis reads the application schema and generates test cases, which will ensure that your application is compliant with its schema and never crashes.
The application under test could be written in any language; the only thing you need is a valid API schema in a supported format.
Read more about how it works in our research paper.
How do I start?
Schemathesis is available as a service, standalone CLI, or a Python library.
The service enables you to verify your API schema in a few clicks, CLI gives more control. Schemathesis.io has a free tier, so you can combine the CLI flexibility with rich visuals by uploading your test results there.
Features
Open API: Schema conformance, explicit examples, stateful testing;
GraphQL: queries generation;
Multi-worker test execution;
Storing and replaying tests;
ASGI / WSGI support;
Generated code samples (cURL, Python);
Docker image;
Customizable checks & test generation;
CLI installation
To install Schemathesis via pip run the following command:
python -m pip install schemathesisThis command installs the st entrypoint.
You can also use our Docker image without installing Schemathesis as a Python package.
GitHub Actions
If you use GitHub Actions, there is a native GitHub app that reports test results directly to your pull requests.
api-tests:
runs-on: ubuntu-20.04
steps:
# Runs Schemathesis tests with all checks enabled
- uses: schemathesis/action@v1
with:
# Your API schema location
schema: 'http://localhost:5000/api/openapi.json'
# OPTIONAL. Your Schemathesis.io token
token: ${{ secrets.SCHEMATHESIS_TOKEN }}Check our GitHub Action for more details.
Usage
You can use Schemathesis in the command line directly:
st run --checks all https://example.schemathesis.io/openapi.jsonOr via Docker:
docker run schemathesis/schemathesis:stable \
run --checks all https://example.schemathesis.io/openapi.json
Or in your Python tests:
import schemathesis
schema = schemathesis.from_uri("https://example.schemathesis.io/openapi.json")
@schema.parametrize()
def test_api(case):
case.call_and_validate()CLI is simple to use and requires no coding; the in-code approach gives more flexibility.
Both examples above will run hundreds of requests against the API under test and report all found failures and inconsistencies along with instructions to reproduce them.
💡 See a complete working example project in the /example directory. 💡
Support
If you want to integrate Schemathesis into your company workflows or improve its effectiveness, feel free to reach out to support@schemathesis.io.
Schemathesis.io also runs workshops about effective API testing. Signup here
Contributing
Any contribution to development, testing, or any other area is highly appreciated and useful to the project. For guidance on how to contribute to Schemathesis, see the contributing guidelines.
Links
Documentation: https://schemathesis.readthedocs.io/en/stable/
Issue tracker: https://github.com/schemathesis/schemathesis/issues
Additional content:
Research paper: Deriving Semantics-Aware Fuzzers from Web API Schemas by @Zac-HD and @Stranger6667
An article about Schemathesis by @Stranger6667
Effective API schemas testing from DevConf.cz by @Stranger6667
How to use Schemathesis to test Flask API in GitHub Actions by @lina-is-here
A video from EuroPython 2020 by @hultner
Schemathesis tutorial with an accompanying video by Red Hat
Using Hypothesis and Schemathesis to Test FastAPI by @amalshaji
Non-English content:
A tutorial (RUS) about Schemathesis by @Stranger6667
License
The code in this project is licensed under MIT license. By contributing to Schemathesis, you agree that your contributions will be licensed under its MIT license.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file schemathesis-3.18.1.tar.gz.
File metadata
- Download URL: schemathesis-3.18.1.tar.gz
- Upload date:
- Size: 1.3 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.11.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b936e504722d6fd4dfb8b32bb275f25b7a0eff2589b674b6a789d332b215790a |
|
| MD5 | 6ebb9f8637ca33c07c6b61d767ad7073 |
|
| BLAKE2b-256 | af0652c287f8948198d94bf89e8ef2ff9eec522aed8f84979eec11f296b20dcf |
File details
Details for the file schemathesis-3.18.1-py3-none-any.whl.
File metadata
- Download URL: schemathesis-3.18.1-py3-none-any.whl
- Upload date:
- Size: 203.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.11.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | c87f37db7e0f024b8c4f509f51b5cdc5c0a44f05b6be8946629c3ee98273bcb1 |
|
| MD5 | d83289cf80528f7500f35c2159cd9676 |
|
| BLAKE2b-256 | 06f44885e7ef5930df1d306c3e4ea53e7a3b0dfe8a23b2333df3fd21c99124ed |
