Skip to main content

a Deferred-aware profiler for Twisted

Project description

https://travis-ci.org/flowroute/twisted-theseus.png

twisted-theseus

A Deferred-aware profiler for Python code.

While cProfile is a very useful utility, it is limited to recording synchronous execution time. A function that returns a Deferred will typically return very quickly, while the Deferred it returns might not fire for seconds or even minutes. This is where theseus comes in: any function that returns a Deferred will be tracked by theseus. The time from when the Deferred was returned to when it fired will be measured, and recorded along with the function’s call stack.

Usage

The public interface of theseus is a class called Tracer. To get started:

from theseus import Tracer
t = Tracer()
t.install()

This is enough to start tracing execution. Eventually, the statistics will have to be written to disk:

with open('callgrind.theseus', 'wb') as outfile:
  t.write_data(outfile)

The output is written in callgrind format, which means that standard tools can be used to interpret the results, such as kcachegrind.

If at any point the Tracer is no longer useful, it can be uninstalled to stop tracing:

t.uninstall()

Additionally, theseus is aware of inlineCallbacks, and will rewrite call stacks to make them look “correct”. For example, given this code:

from twisted.internet import defer, task

@defer.inlineCallbacks
def func(reactor):
  yield task.deferLater(reactor, 1, lambda: None)

task.react(func)

The call stack according to theseus will look like this (most recent call last):

__main__ in <module>
twisted.internet.task in react
__main__ in func

While theseus and cProfile both use a profile hook, as long as cProfile is installed first, both profilers can be used at the same time. In this case, calling uninstall() will restore cProfile.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

twisted-theseus-0.14.1.3.tar.gz (28.9 kB view details)

Uploaded Source

Built Distribution

File details

Details for the file twisted-theseus-0.14.1.3.tar.gz.

File metadata

File hashes

Hashes for twisted-theseus-0.14.1.3.tar.gz
Algorithm Hash digest
SHA256 3b512afe228ebd60bc25a2a37c45bef97dd998306ccb8d4afb954b5c50f3ff74
MD5 468a0f5244d914acf83ab08aa3633a28
BLAKE2b-256 5322ae90b006419b6d7a0503d98fa3d0be5e3677a2e8906089b737de48d66f9c

See more details on using hashes here.

Provenance

File details

Details for the file twisted_theseus-0.14.1.3-pp27-none-any.whl.

File metadata

File hashes

Hashes for twisted_theseus-0.14.1.3-pp27-none-any.whl
Algorithm Hash digest
SHA256 7edc3fb7e58d3707c51d786d8acb5b305b7bc3a11d3b00347608a30ee7b814a1
MD5 0d52f7274212df36fce6b5b322068b41
BLAKE2b-256 268cef08bbf40321616c7ca39f240d7d9d2187d7582fc95ed51da466a46afe45

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page