Skip to main content

GDB-like Python Debugger in the Trepan family

Project description

TravisCI CircleCI Pypi Installs License Supported Python Versions

packagestatus

Abstract

This is a gdb-like debugger for Python. It is a rewrite of pdb from the ground up. It is both a high-level debugger as well as a lower-level bytecode debugger. By lower-level debugger, I mean that it understands a lot about byte code and will try to make use of that in its normal higher-level instructions.

A command-line interface (CLI) is provided as well as an remote access interface over TCP/IP.

See the Tutorial for how to use. See ipython-trepan for using this in ipython or an ipython notebook.

This package is for Python 3.2 and above. See trepan2 for the same code modified to work with Python 2.

Features

Since this debugger is similar to other trepanning debuggers and gdb in general, knowledge gained by learning this is transferable to those debuggers and vice versa.

There’s a lot of cool stuff here that’s not in the stock Python debugger pdb, or in any other Python debugger that I know about.

More Exact location information

Python reports line information on the granularity of a line. To get more precise information, we can (de)parse into Python the byte code around a bytecode offset such as the place you are stopped at.

So far as I know, there is no other debugger that decompile code at runtime.

See the deparse command for details.

We use information in the line number table in byte to understand which lines are breakpointable, and in which module or function the line appears in. Use info line to see this information.

In the future we may allow specifiying an offset to indicate which offset to stop at when there are several choices for a given line number.

Debugging Python bytecode (no source available)

You can pass the debugger the name of Python bytecode and many times, the debugger will merrily proceed. This debugger tries very hard find the source code. Either by using the current executable search path (e.g. PATH) or for some by looking inside the bytecode for a filename in the main code object (co_filename) and applying that with a search path which takes into account directory where the bytecode lives.

Failing to find source code this way, and in other situations where source code can’t be found, the debugger will decompile the bytecode and use that for showing source test. This allows us to debug `eval`’d or `exec’’d code.

But if you happen to know where the source code is located, you can associate a file source code with the current name listed in the bytecode. See the set_substitute command for details here.

Source-code Syntax Colorization

Terminal source code is colorized via pygments . And with that you can set the pygments color style, e.g. “colorful”, “paraiso-dark”. See set_style . Furthermore, we make use of terminal bold and emphasized text in debugger output and help text. Of course, you can also turn this off. Starting with release 0.6.0, you can use your own pygments_style, provided you have a terminal that supports 256 colors. If your terminal supports the basic ANSI color sequences only, we support that too in both dark and light themes.

Command Completion

GNU readline command completion is available. Command completion is not just a simple static list, but varies depending on the context. For example, for frame-changing commands which take optional numbers, on the list of valid numbers is considered.

Terminal Handling

We can adjust debugger output depending on the line width of your terminal. If it changes, or you want to adjust it, see set_width .

Smart Eval

If you want to evaluate the current source line before it is run in the code, use eval. To evaluate text of a common fragment of line, such as the expression part of an if statement, you can do that with eval?. See eval for more information.

Function Breakpoints

Many Python debuggers only allow setting a breakpoint at a line event and functions are treated like line numbers. But functions and lines are fundamentally different. If I write:

def five(): return 5

this line means has three different kinds of things. First there is the code in Python that defines function five() for the first time. Then there is the function itself, and then there is some code inside that function.

In this debugger, you can give the name of a function by surrounding adding () at the end:

break five()

Also five could be a method of an object that is currently defined when the breakpoint command is given:

self.five()

More Stepping Control

Sometimes you want small steps, and sometimes large stepping.

This fundamental issue is handled in a couple ways:

Step Granularity

There are now step event and next event commands with aliases to s+, s> and so on. The plus-suffixed commands force a different line on a subsequent stop, the dash-suffixed commands don’t. Suffixes >, <, and ! specify call, return and exception events respectively. And without a suffix you get the default; this is set by the set different command.

Event Filtering and Tracing

By default the debugger stops at every event: call, return, line, exception, c-call, c-exception. If you just want to stop at line events (which is largely what you happens in pdb) you can. If however you just want to stop at calls and returns, that’s possible too. Or pick some combination.

In conjunction with handling all events by default, the event status is shown when stopped. The reason for stopping is also available via info program.

Event Tracing of Calls and Returns

I’m not sure why this was not done before. Probably because of the lack of the ability to set and move by different granularities, tracing calls and returns lead to too many uninteresting stops (such as at the same place you just were at). Also, stopping on function definitions probably also added to this tedium.

Because we’re really handling return events, we can show you the return value. (pdb has an “undocumented” retval command that doesn’t seem to work.)

Debugger Macros via Python Lambda expressions

There are debugger macros. In gdb, there is a macro debugger command to extend debugger commands.

However Python has its own rich programming language so it seems silly to recreate the macro language that is in gdb. Simpler and more powerful is just to use Python here. A debugger macro here is just a lambda expression which returns a string or a list of strings. Each string returned should be a debugger command.

We also have aliases for the extremely simple situation where you want to give an alias to an existing debugger command. But beware: some commands, like step inspect command suffixes and change their behavior accordingly.

We also envision a number of other ways to allow extension of this debugger either through additional modules, or user-supplied debugger command directories.

Byte-code Instruction Introspection

We do more in the way of looking at the byte codes to give better information. Through this we can provide:

  • a skip command. It is like the jump command, but you don’t have to deal with line numbers.

  • disassembly of code fragments. You can now disassemble relative to the stack frames you are currently stopped at.

  • Better interpretation of where you are when inside execfile or exec. (But really though this is probably a Python compiler misfeature.)

  • Check that breakpoints are set only where they make sense.

  • A more accurate determination of if you are at a function-defining def or class statements (because the caller instruction contains MAKE_FUNCTION or BUILD_CLASS.)

Even without “deparsing” mentioned above, the ability to disassemble where the PC is currently located (see info pc), by line number range or byte-offset range lets you tell exactly where you are and code is getting run.

Some Debugger Command Arguments can be Variables and Expressions

Commands that take integer arguments like up, list, or disassemble allow you to use a Python expression which may include local or global variables that evaluates to an integer. This eliminates the need in gdb for special “dollar” debugger variables. (Note however because of shlex parsing, expressions can’t have embedded blanks.)

Out-of-Process Debugging

You can now debug your program in a different process or even a different computer on a different network!

Related, is flexible support for remapping path names from file system, e.g. that inside a docker container or on a remote filesystem with locally-installed files. See subst for more information.

Egg, Wheel, and Tarballs

Can be installed via the usual pip or easy_install. There is a source tarball. How To Install has full instructions and installing from git and by other means.

Modularity

The Debugger plays nice with other trace hooks. You can have several debugger objects.

Many of the things listed below doesn’t directly effect end-users, but it does eventually by way of more robust and featureful code. And keeping developers happy is a good thing.(TM)

  • Commands and subcommands are individual classes now, not methods in a class. This means they now have properties like the context in which they can be run, minimum abbreviation name or alias names. To add a new command you basically add a file in a directory.

  • I/O is it’s own layer. This simplifies interactive readline behavior from reading commands over a TCP socket.

  • An interface is it’s own layer. Local debugging, remote debugging, running debugger commands from a file (source) are different interfaces. This means, for example, that we are able to give better error reporting if a debugger command file has an error.

  • There is an experimental Python-friendly interface for front-ends

  • more testable. Much more unit and functional tests. More of pydb’s integration test will eventually be added.

Documentation

Documentation: http://python3-trepan.readthedocs.org

See Also

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

trepan3k-1.2.6.tar.gz (515.8 kB view details)

Uploaded Source

Built Distributions

trepan3k-1.2.6-py3.9.egg (657.8 kB view details)

Uploaded Source

trepan3k-1.2.6-py3.8.egg (658.3 kB view details)

Uploaded Source

trepan3k-1.2.6-py3.7.egg (656.7 kB view details)

Uploaded Source

trepan3k-1.2.6-py3.6.egg (656.5 kB view details)

Uploaded Source

trepan3k-1.2.6-py3.5.egg (666.6 kB view details)

Uploaded Source

trepan3k-1.2.6-py3.4.egg (668.6 kB view details)

Uploaded Source

trepan3k-1.2.6-py3.3.egg (678.5 kB view details)

Uploaded Source

trepan3k-1.2.6-py3.2.egg (668.7 kB view details)

Uploaded Source

trepan3k-1.2.6-py2.py3-none-any.whl (347.3 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file trepan3k-1.2.6.tar.gz.

File metadata

  • Download URL: trepan3k-1.2.6.tar.gz
  • Upload date:
  • Size: 515.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.6

File hashes

Hashes for trepan3k-1.2.6.tar.gz
Algorithm Hash digest
SHA256 a147d4bb0d7a970546bdb41c9abf7e4c6c1235c8e0606d1777e7a1a6c4f86c14
MD5 a505307d28bf636469f5b892977fc179
BLAKE2b-256 395eaa273c2ac1d56fae487071c611a0a35929b5ef310b875606ff6f5f9320e1

See more details on using hashes here.

Provenance

File details

Details for the file trepan3k-1.2.6-py3.9.egg.

File metadata

  • Download URL: trepan3k-1.2.6-py3.9.egg
  • Upload date:
  • Size: 657.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.6

File hashes

Hashes for trepan3k-1.2.6-py3.9.egg
Algorithm Hash digest
SHA256 7dfd35864ff4f93f6dcf719ff5ca255b118aff2889b1cefe705aaab2640fce3d
MD5 6d984c8a4712153563ce1510d4a69abd
BLAKE2b-256 870ee8be9a01ef9edf8577574ddeea9fe10d83b5d4c54c8ba0b779f470d75c14

See more details on using hashes here.

Provenance

File details

Details for the file trepan3k-1.2.6-py3.8.egg.

File metadata

  • Download URL: trepan3k-1.2.6-py3.8.egg
  • Upload date:
  • Size: 658.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.6

File hashes

Hashes for trepan3k-1.2.6-py3.8.egg
Algorithm Hash digest
SHA256 e8a4764fcdc120fcc2d189534dec798102b7439631871af74bbee6b832174d7e
MD5 b2ff53f8f0e1d2f761d97d12cda9798a
BLAKE2b-256 ed86efc9c7bff13b436245c4e79b96e997ec5c852f042be7d52f3154f7e7f95f

See more details on using hashes here.

Provenance

File details

Details for the file trepan3k-1.2.6-py3.7.egg.

File metadata

  • Download URL: trepan3k-1.2.6-py3.7.egg
  • Upload date:
  • Size: 656.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.6

File hashes

Hashes for trepan3k-1.2.6-py3.7.egg
Algorithm Hash digest
SHA256 4390e5500de07548e49e88a7cf6af89752cd66693c2081c8d88460bca1eec7a0
MD5 6d5c5d6d9b6a8fd95c8924d3e4282d53
BLAKE2b-256 3888b6692a85b05a9d063fc7c16b86f3602a83b5ed4cf8f284cd67961ab24519

See more details on using hashes here.

Provenance

File details

Details for the file trepan3k-1.2.6-py3.6.egg.

File metadata

  • Download URL: trepan3k-1.2.6-py3.6.egg
  • Upload date:
  • Size: 656.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.6

File hashes

Hashes for trepan3k-1.2.6-py3.6.egg
Algorithm Hash digest
SHA256 7046ca43e7b9f0db2870ea4f01dd861ce6aec3aeb8dee6cdedf913db71e855f3
MD5 9c3daecd1475154f8f178e0567baa72d
BLAKE2b-256 2b2c2d695448d436d660a7511c1947387b837b21e1d261e99e12223e9801d9eb

See more details on using hashes here.

Provenance

File details

Details for the file trepan3k-1.2.6-py3.5.egg.

File metadata

  • Download URL: trepan3k-1.2.6-py3.5.egg
  • Upload date:
  • Size: 666.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.6

File hashes

Hashes for trepan3k-1.2.6-py3.5.egg
Algorithm Hash digest
SHA256 3114c3d80632db0c933ec751320cc74bd3498a3d3dd45a2239bcce894f3e7886
MD5 9f5404535b45b846ed6287381613ccff
BLAKE2b-256 8b4ad32d51f7a107c147d4c07c4f5b97e0a02e782c210111ff19147006a56b54

See more details on using hashes here.

Provenance

File details

Details for the file trepan3k-1.2.6-py3.4.egg.

File metadata

  • Download URL: trepan3k-1.2.6-py3.4.egg
  • Upload date:
  • Size: 668.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.6

File hashes

Hashes for trepan3k-1.2.6-py3.4.egg
Algorithm Hash digest
SHA256 6447626f6fcccfbe484418b770bf434761d9d5df9d9c0c667a0bea21a98977c7
MD5 9c668862fd697bf76b37e631c20fc4d2
BLAKE2b-256 086b0a5cb47b9fe3a413f403c4989f5f1f03e69e64935b9caf3ec009adb7b2c4

See more details on using hashes here.

Provenance

File details

Details for the file trepan3k-1.2.6-py3.3.egg.

File metadata

  • Download URL: trepan3k-1.2.6-py3.3.egg
  • Upload date:
  • Size: 678.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.6

File hashes

Hashes for trepan3k-1.2.6-py3.3.egg
Algorithm Hash digest
SHA256 5fdd184e78a407662c077954e96c5a25bd71b6f2a45023156751286718ea9a84
MD5 368fb157f837cd5e46e3aaa8f1763c46
BLAKE2b-256 882cd7a3549ec813aa96a57f82d3c37a580cc9979b745daee28498e97d161a40

See more details on using hashes here.

Provenance

File details

Details for the file trepan3k-1.2.6-py3.2.egg.

File metadata

  • Download URL: trepan3k-1.2.6-py3.2.egg
  • Upload date:
  • Size: 668.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.6

File hashes

Hashes for trepan3k-1.2.6-py3.2.egg
Algorithm Hash digest
SHA256 da2f860adaab22e7ea4e3f5ba1fc6e2095193adacd2a43d52b8922e8988e6c5c
MD5 7dd1a3b61e9ca8d2b1e16c0e3afded63
BLAKE2b-256 8499dd929161111147fb97567871c407c9a16fc1d54db7f02b29700c6f2fd781

See more details on using hashes here.

Provenance

File details

Details for the file trepan3k-1.2.6-py2.py3-none-any.whl.

File metadata

  • Download URL: trepan3k-1.2.6-py2.py3-none-any.whl
  • Upload date:
  • Size: 347.3 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/4.6.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.6

File hashes

Hashes for trepan3k-1.2.6-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 b551dfc9e7cc1a930accf974880d4becc5a182bc8ea01b27e722464c267fa494
MD5 a287450ddc2d423eb41fa8467b9f9bdf
BLAKE2b-256 c1cc9d98bff92147632e3e12e39a84a6b46007df605e5753246a3257d1386f36

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page