Skip to main content

Profiling plugin for py.test

Project description

Profiling plugin for pytest, with tabular and heat graph output.

Tests are profiled with cProfile and analysed with pstats; heat graphs are generated using gprof2dot and dot.

Installation

Install using your favourite package installer:

pip install pytest-profiling
# or
easy_install pytest-profiling

Enable the fixture explicitly in your tests or conftest.py (not required when using setuptools entry points):

pytest_plugins = ['pytest_profiling']

Usage

Once installed, the plugin provides extra options to pytest:

$ py.test --help
...
  Profiling:
    --profile           generate profiling information
    --profile-svg       generate profiling graph (using gprof2dot and dot
                        -Tsvg)

The --profile and profile-svg options can be combined with any other option:

$ py.test tests/unit/test_logging.py --profile
============================= test session starts ==============================
platform linux2 -- Python 2.6.2 -- pytest-2.2.3
collected 3 items

tests/unit/test_logging.py ...
Profiling (from prof/combined.prof):
Fri Oct 26 11:05:00 2012    prof/combined.prof

         289 function calls (278 primitive calls) in 0.001 CPU seconds

   Ordered by: cumulative time
   List reduced from 61 to 20 due to restriction <20>

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
        3    0.000    0.000    0.001    0.000 <string>:1(<module>)
      6/3    0.000    0.000    0.001    0.000 core.py:344(execute)
        3    0.000    0.000    0.001    0.000 python.py:63(pytest_pyfunc_call)
        1    0.000    0.000    0.001    0.001 test_logging.py:34(test_flushing)
        1    0.000    0.000    0.000    0.000 _startup.py:23(_flush)
        2    0.000    0.000    0.000    0.000 mock.py:979(__call__)
        2    0.000    0.000    0.000    0.000 mock.py:986(_mock_call)
        4    0.000    0.000    0.000    0.000 mock.py:923(_get_child_mock)
        6    0.000    0.000    0.000    0.000 mock.py:512(__new__)
        2    0.000    0.000    0.000    0.000 mock.py:601(__get_return_value)
        4    0.000    0.000    0.000    0.000 mock.py:695(__getattr__)
        6    0.000    0.000    0.000    0.000 mock.py:961(__init__)
    22/14    0.000    0.000    0.000    0.000 mock.py:794(__setattr__)
        6    0.000    0.000    0.000    0.000 core.py:356(getkwargs)
        6    0.000    0.000    0.000    0.000 mock.py:521(__init__)
        3    0.000    0.000    0.000    0.000 skipping.py:122(pytest_pyfunc_call)
        6    0.000    0.000    0.000    0.000 core.py:366(varnames)
        3    0.000    0.000    0.000    0.000 skipping.py:125(check_xfail_no_run)
        2    0.000    0.000    0.000    0.000 mock.py:866(assert_called_once_with)
        6    0.000    0.000    0.000    0.000 mock.py:645(__set_side_effect)


=========================== 3 passed in 0.13 seconds ===========================

pstats files (one per test item) are retained for later analysis in prof directory, along with a combined.prof file:

$ ls -1 prof/
combined.prof
test_app.prof
test_flushing.prof
test_import.prof

By default the pstats files are named after their corresponding test name, with illegal filesystem characters replaced by underscores. If the full path is longer that operating system allows then it will be renamed to first 4 bytes of an md5 hash of the test name:

$ ls -1 prof/
combined.prof
test_not_longer_than_max_allowed.prof
68b329da.prof

If the --profile-svg option is given, along with the prof files and tabular output a svg file will be generated:

$ py.test tests/unit/test_logging.py --profile-svg
...
SVG profile in prof/combined.svg.

This is best viewed with a good svg viewer e.g. Chrome.

Changelog

1.7.0

  • All: Support pytest >= 4.0.0

  • All: Support Python 3.7

  • pytest-server-fixtures: if host not defined on your machine, default to localhost

  • pytest-server-fixture: Pin to rethinkdb < 2.4.0 due to upstream API changes

  • pytest-verbose-parametrize: Add support for revamped marker infrastructure

  • pytest-verbose-parametrize: Fix integration tests to support pytest >= 4.1.0

  • pytest-virtualenv: Add virtualenv as install requirement. Fixes #122

  • pytest-webdriver: Fix RemovedInPytest4Warning using getfixturevalue

  • circleci: Fix checks by skipping coverall submission for developer without push access

  • wheels: Generate universal wheels installable with both python 2.x and 3.x

  • dist: Remove support for building and distributing *.egg files

  • VagrantFile: Install python 3.7 and initialize python 3.7 by default

  • Fix DeprecationWarning warnings using “logger.warning()” function

1.6.2 (2019-02-21)

  • pytest-server-fixtures: suppress stacktrace if kill() is called

  • pytest-server-fixtures: fix random port logic in TestServerV2

1.6.1 (2019-02-12)

  • pytest-server-fixtures: fix exception when attempting to access hostname while server is not started

1.6.0 (2019-02-12)

  • pytest-server-fixtures: added previously removed TestServerV2.kill() function

  • pytest-profiling: pin more-itertools==5.0.0 in integration tests, as that’s a PY3 only release

1.5.1 (2019-01-24)

  • pytest-verbose-parametrize: fixed unicode parameters when using @pytest.mark.parametrize

1.5.0 (2019-01-23)

  • pytest-server-fixtures: made postgres fixtures and its tests optional, like all other fixtures

  • pytest-server-fixtures: reverted a fix for pymongo deprecation warning, as this will break compatibility with pymongo 3.6.0

  • pytest-server-fixtures: dropped RHEL5 support in httpd

1.4.1 (2019-01-18)

  • pytest-server-fixtures: server fixture binary path specified in ENV now only affect server class ‘thread’

1.4.0 (2019-01-15)

  • Fixing python 3 compatibility in Simple HTTP Server fixture

  • Fixed broken tests in pytest-profiling

  • Pinned pytest<4.0.0 until all deprecation warnings are fixed.

  • pytest-webdriver: replaced deprecated phantomjs with headless Google Chrome.

  • Add Vagrantfile to project to make test environment portable.

  • Add .editorconfig file to project.

  • pytest-server-fixtures: add TestServerV2 with Docker and Kubernetes support.

  • pytest-server-fixtures: fix for an issue where MinioServer is not cleaned up after use.

  • pytest-server-fixtures: fix deprecation warnings when calling pymongo.

  • pytest-server-fixtures: close pymongo client on MongoTestServer teardown.

  • pytest-server-fixtures: upgrade Mongo, Redis and RethinkDB to TestServerV2.

  • coveralls: fix broken coveralls

1.3.1 (2018-06-28)

  • Use pymongo list_database_names() instead of the deprecated database_names(), added pymongo>=3.6.0 dependency

1.3.0 (2017-11-17)

  • Fixed workspace deletion when teardown is None

  • Fixed squash of root logger in pytest-listener

  • Added S3 Minio fixture (many thanks to Gavin Bisesi)

  • Added Postgres fixture (many thanks to Gavin Bisesi)

  • Use requests for server fixtures http gets as it handles redirects and proxies properly

1.2.12 (2017-8-1)

  • Fixed regression on cacheing ephemeral hostname, some clients were relying on this. This is now optional.

1.2.11 (2017-7-21)

  • Fix for OSX binding to illegal local IP range (Thanks to Gavin Bisesi)

  • Setup and Py3k fixes for pytest-profiling (Thanks to xoviat)

  • We no longer try and bind port 5000 when reserving a local IP host, as someone could have bound it to 0.0.0.0

  • Fix for #46 sourcing gprof2dot when the local venv has not been activated

1.2.10 (2017-2-23)

  • Handle custom Pytest test items in pytest-webdriver

1.2.9 (2017-2-23)

  • Add username into mongo server fixture tempdir path to stop collisions on shared multiuser filesystems

1.2.8 (2017-2-21)

  • Return function results in shutil.run.run_as_main

1.2.7 (2017-2-20)

  • More handling for older versions of path.py

  • Allow virtualenv argument passing in pytest-virtualenv

1.2.6 (2017-2-16 )

  • Updated devpi server server setup for devpi-server >= 2.0

  • Improvements for random port picking

  • HTTPD server now binds to 0.0.0.0 by default to aid Selenium-style testing

  • Updated mongodb server args for mongodb >= 3.2

  • Corrections for mongodb fixture config and improve startup logic

  • Added module-scoped mongodb fixture

  • Handling for older versions of path.py

  • Fix for #40 where tests that chdir break pytest-profiling

1.2.5 (2016-12-09)

  • Improvements for server runner host and port generation, now supports random local IPs

  • Bugfix for RethinkDB fixture config

1.2.4 (2016-11-14)

  • Bugfix for pymongo extra dependency

  • Windows compatibility fix for pytest-virtualenv (Thanks to Jean-Christophe Fillion-Robin for PR)

  • Fix symlink handling for pytest-shutil.cmdline.get_real_python_executable

1.2.3 (2016-11-7)

  • Improve resiliency of Mongo fixture startup checks

1.2.2 (2016-10-27)

  • Python 3 compatibility across most of the modules

  • Fixed deprecated Path.py imports (Thanks to Bryan Moscon)

  • Fixed deprecated multicall in pytest-profiling (Thanks to Paul van der Linden for PR)

  • Added devpi-server fixture to create an index per test function

  • Added missing licence file

  • Split up httpd server fixture config so child classes can override loaded modules easier

  • Added ‘preserve_sys_path’ argument to TestServer base class which exports the current python sys.path to subprocesses.

  • Updated httpd, redis and jenkins runtime args and paths to current Ubuntu spec

  • Ignore errors when tearing down workspaces to avoid race conditions in ‘shutil.rmtree’ implementation

1.2.1 (2016-3-1)

  • Fixed pytest-verbose-parametrize for latest version of py.test

1.2.0 (2016-2-19)

  • New plugin: git repository fixture

1.1.1 (2016-2-16)

  • pytest-profiling improvement: escape illegal characters in .prof files (Thanks to Aarni Koskela for the PR)

1.1.0 (2016-2-15)

  • New plugin: devpi server fixture

  • pytest-profiling improvement: overly-long .prof files are saved as the short hash of the test name (Thanks to Vladimir Lagunov for PR)

  • Changed default behavior of workspace.run() to not use a subshell for security reasons

  • Corrected virtualenv.run() method to handle arguments the same as the parent method workspace.run()

  • Removed deprecated ‘–distribute’ from virtualenv args

1.0.1 (2015-12-23)

  • Packaging bugfix

1.0.0 (2015-12-21)

  • Initial public release

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytest-profiling-1.7.0.tar.gz (31.0 kB view details)

Uploaded Source

Built Distributions

pytest_profiling-1.7.0-py3.6.egg (7.5 kB view details)

Uploaded Source

pytest_profiling-1.7.0-py2.py3-none-any.whl (8.3 kB view details)

Uploaded Python 2 Python 3

pytest_profiling-1.7.0-py2.7.egg (7.5 kB view details)

Uploaded Source

File details

Details for the file pytest-profiling-1.7.0.tar.gz.

File metadata

  • Download URL: pytest-profiling-1.7.0.tar.gz
  • Upload date:
  • Size: 31.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/2.7.13

File hashes

Hashes for pytest-profiling-1.7.0.tar.gz
Algorithm Hash digest
SHA256 93938f147662225d2b8bd5af89587b979652426a8a6ffd7e73ec4a23e24b7f29
MD5 30750522b506ab5e2d9487e6a273d105
BLAKE2b-256 397022a4b33739f07f1732a63e33bbfbf68e0fa58cfba9d200e76d01921eddbf

See more details on using hashes here.

File details

Details for the file pytest_profiling-1.7.0-py3.6.egg.

File metadata

  • Download URL: pytest_profiling-1.7.0-py3.6.egg
  • Upload date:
  • Size: 7.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/2.7.13

File hashes

Hashes for pytest_profiling-1.7.0-py3.6.egg
Algorithm Hash digest
SHA256 6bce4e2edc04409d2f3158c16750fab8074f62d404cc38eeb075dff7fcbb996c
MD5 2eaeb32ddb652614bb8764e662492b25
BLAKE2b-256 2be8a3726062af9e14c5eddf0f286eb71f1a3c83cbdb33a5ac54019aecddc469

See more details on using hashes here.

File details

Details for the file pytest_profiling-1.7.0-py2.py3-none-any.whl.

File metadata

  • Download URL: pytest_profiling-1.7.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 8.3 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/2.7.13

File hashes

Hashes for pytest_profiling-1.7.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 999cc9ac94f2e528e3f5d43465da277429984a1c237ae9818f8cfd0b06acb019
MD5 e15392c96b4266bd6b464faea6f9e88f
BLAKE2b-256 d971cdb746eaee0d3be65fd777b4ac821f5f051063f3084d4a200ecfd7f7ab40

See more details on using hashes here.

File details

Details for the file pytest_profiling-1.7.0-py2.7.egg.

File metadata

  • Download URL: pytest_profiling-1.7.0-py2.7.egg
  • Upload date:
  • Size: 7.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/2.7.13

File hashes

Hashes for pytest_profiling-1.7.0-py2.7.egg
Algorithm Hash digest
SHA256 3b255f9db36cb2dd7536a8e7e294c612c0be7f7850a7d30754878e4315d56600
MD5 0d6d3437b346d762c32082076f9f7289
BLAKE2b-256 3c958bedeca8a2a0dd9abecb5d38913c7709b17716422c76b3bbd473fce087ef

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page