A pytest plugin that allows multiple failures per test.
Project description
pytest-check
A pytest plugin that allows multiple failures per test.
This pytest plugin was a rewrite and a rename of pytest-expect.
Installation
Note: Requires pytest 6.0 or above.
From PPI:
$ pip install pytest-check
Or from github.
$ pip install git+https://github.com/okken/pytest-check
Usage
Example using import:
import pytest_check as check
def test_example():
a = 1
b = 2
c = [2, 4, 6]
check.greater(a, b)
check.less_equal(b, a)
check.is_in(a, c, "Is 1 in the list")
check.is_not_in(b, c, "make sure 2 isn't in list")
Test results:
=================================== FAILURES ===================================
_________________________________ test_example _________________________________
FAILURE:
assert 1 > 2
test_check.py, line 14, in test_example() -> check.greater(a, b)
FAILURE:
assert 2 <= 1
test_check.py, line 15, in test_example() -> check.less_equal(b, a)
FAILURE: Is 1 in the list
assert 1 in [2, 4, 6]
test_check.py, line 16, in test_example() -> check.is_in(a, c, "Is 1 in the list")
FAILURE: make sure 2 isn't in list
assert 2 not in [2, 4, 6]
test_check.py, line 17, in test_example() -> check.is_not_in(b, c, "make sure 2 isn't in list")
------------------------------------------------------------
Failed Checks: 4
=========================== 1 failed in 0.11 seconds ===========================
Example using fixture:
def test_example(check):
a = 1
b = 2
c = [2, 4, 6]
check.greater(a, b)
check.less_equal(b, a)
check.is_in(a, c, "Is 1 in the list")
check.is_not_in(b, c, "make sure 2 isn't in list")
validation functions
- check.equal - a == b
- check.not_equal - a != b
- check.is_ - a is b
- check.is_not - a is not b
- check.is_true - bool(x) is True
- check.is_false - bool(x) is False
- check.is_none - x is None
- check.is_not_none - x is not None
- check.is_in - a in b
- check.is_not_in - a not in b
- check.is_instance - isinstance(a, b)
- check.is_not_instance - not isinstance(a, b)
- check.almost_equal - a == pytest.approx(b, rel, abs) see at: pytest.approx
- check.not_almost_equal - a != pytest.approx(b, rel, abs) see at: pytest.approx
- check.greater - a > b
- check.greater_equal - a >= b
- check.less - a < b
- check.less_equal - a <= b
Defining your own check functions
The @check_func decorator allows you to wrap any test helper that has an assert
statement in it to be a non-blocking assert function.
from pytest_check import check_func
@check_func
def is_four(a):
assert a == 4
def test_all_four():
is_four(1)
is_four(2)
is_four(3)
is_four(4)
The above will result in:
...
________________________________ test_all_four _________________________________
FAILURE: assert 1 == 4
test_fail.py, line 8, in test_all_four() -> is_four(1)
FAILURE: assert 2 == 4
test_fail.py, line 9, in test_all_four() -> is_four(2)
FAILURE: assert 3 == 4
test_fail.py, line 10, in test_all_four() -> is_four(3)
------------------------------------------------------------
Failed Checks: 3
=========================== 1 failed in 0.12 seconds ===========================
Using check as a context manager
You can use the check() context manager to wrap any assert that you want to continue after in a test.
from pytest_check import check
def test_context_manager():
with check:
x = 3
assert 1 < x < 4
Within any with check:, however, you still won't get past the assert statement,
so you will need to use multiple with check: blocks for multiple asserts:
def test_multiple_failures():
with check: assert 1 == 0
with check: assert 1 > 2
with check: assert 1 < 5 < 4
Contributing
Contributions are very welcome. Tests can be run with tox. Test coverage is now 100%. Please make sure to keep it at 100%. If you have an awesome pull request and need help with getting coverage back up, let me know.
License
Distributed under the terms of the MIT license, "pytest-check" is free and open source software
Issues
If you encounter any problems, please file an issue along with a detailed description.
Changelog
- 0.4.1
- Fix #43/#44 tests with failing checks and failing asserts now report all issues.
- 0.4.0
- added
is_()andis_not() - Requires pytest 6.0 or above. (Removed some cruft to support pytest 5.x)
- added
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file pytest_check-1.0.0.tar.gz.
File metadata
- Download URL: pytest_check-1.0.0.tar.gz
- Upload date:
- Size: 8.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.0.0 requests-toolbelt/0.9.1 tqdm/4.55.0 CPython/3.9.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 30666004825c0abeb89fa2b14f8db994bc9542ca182b99808b003dabdb313246 |
|
| MD5 | e68e7663b6ba7ebe08eca79fa7d35fe5 |
|
| BLAKE2b-256 | d58274336ad89e77a7e0a2724801395b64022dd3a3ebe3bcfcfd24783bf4ab4d |
File details
Details for the file pytest_check-1.0.0-py2.py3-none-any.whl.
File metadata
- Download URL: pytest_check-1.0.0-py2.py3-none-any.whl
- Upload date:
- Size: 6.0 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/51.0.0 requests-toolbelt/0.9.1 tqdm/4.55.0 CPython/3.9.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 7c5d070b84e53b306a7e299ec962cad0ab32426c76ed5e5bc0bdcbdaedcd8cd7 |
|
| MD5 | 254c78ffa05d3e5872f8150c4dfd40c1 |
|
| BLAKE2b-256 | 61586716b6e8d9ee7fbb1d3a61f644f404ce077922b750ae5d6d3cb1bf8e1cc3 |
