Skip to main content

An object-oriented API to test doctests using unittest runners.

Project description

An object-oriented API to test doctests using unittest runners.

Module providing classes which extend doctest module so as to achieve better integration with unittest.

It is different from the Pyhton 2.4 doctest unittest API because:

  • A new unitest.TestLoader descendant now allows to load instances of TestCases for doctests using unittest-style, supports building complex test suites in a more natural way, and eases the use of specialized instances of TestCase built out of doctest examples.

  • Other loaders allow users to extract TestCase instances out of TestCase descendants and doctests (and any other format) in a single step.

  • In this case unittest.TestResult instances report whether individual examples have been successfully executed, or otherwise have failed or raised an unexpected exception. Formerly TestResult objects contained the whole report outputted by doctest module.

  • Test analysis require no further parsing to retrieve detailed information about failures.

  • A whole new unittest API for doctest adds object orientation and eliminates functions with big signatures.

  • It is not necessary to use DocTestRunner output streams in order to collect test results.

  • A new hierarchy of doctest TestCases is now possible so for example, setUp and tearDown may be redefined across a hierarchy of TestCases instead of providing this methods as parameters to a function (breaking OOP philosophy and logic); or maybe even failures and errors can be represented in a custom way.

  • Allows to perform regression testing over tests written using doctest.

  • Fixes a minor bug related with specifying different verbosity levels from the command line to unittest.TestProgram (alias main).

  • Loads by default test cases for doctests plus those formerly loaded by unittest.TestLoader

It is similar to the Pyhton 2.4 doctest unittest API because:

  • Provides integration with TestProgram and unittest test runners.

  • Allows to parameterize doctest behavior via doctest options

A fuller explanation can be found in the following article:

“Doctest and unittest… now they’ll live happily together”, O. Lang (2008) The Python Papers, Volume 3, Issue 1, pp. 31:51

Note: The contents of this module were first implemented by the module oop.utils.testing contained in PyOOP package.

What’s new in version 0.2.3:

  • Implemented Suite Fixture Setup test pattern (i.e. set up a fixture once before all its interactive examples are run and clean up after they all have been run.

  • Module is hidden in tracebacks written to instances of TestResult when a failure or an error is detected.

  • Support for multiple pattern matching styles has been added in PackageTestLoader trough style parameter. By default standard regular expressions (i.e. style=REGEX) are used.

  • Unix filename pattern matching (fnmatch module) is available from now on while using PackageTestLoader. The only thing needed is to specify style=UNIX.

  • Multiple functions in previous versions contained arguments having mutable objects as default values. A message sent to TiP list about default args explains why this is really harmful. This has been fixed. Thanks to Scott David Daniels for reporting the issue with default args and Jesse Noller for the pointers about default args .

What’s new in version 0.2.2:

  • Bug fixed… The class PackageTestLoader loaded the tests defined in a packages’ children but not those specified in the top-level module. Now the tests specified in the module supplied in to loadTestsFromModule method are also included in the resulting test suite.

What’s new in version 0.2.1:

  • PackageTestLoader class added to dutest module. It loads all the tests found throughout a package hierarchy using another loader. The later is used for retrieving the tests contained inside every module matching a specified pattern.

  • DocTestLoader class in oop.utils.dutest does not raise ValueError exception if no doctests are found in a module. This is doctest behavior. It was assumed up to this point, but now it has proven to be a headache when these loaders are used together with instances of PackageTestLoader in order to retrieve all the tests defined across a package hierarchy.

What’s new in version 0.1.2:

  • Bug fixed… DocTestCase instances could not be instantiated because None was supplied in to the initializer as the test method name. This bug remained hidden somehow while executing the test using oop.test.check_oopdbc(), and even when importing oop.utils.dutest (which is actually the same implementation).

What’s new in version 0.1.1:

  • The class oop.utils.testing.VerboseTestProgram has been moved onto dutest module. Release 0.1.0 did not include it. Thanks to Michal Kwiatkowski for notifying me so [1].

  • Default test loader and runner have been added to this module as well. The default loader is an instance of MultiTestLoader that combines the suites loaded by unittest.TestLoader and dutest.DocTestLoader.

  • dutest.main is an alias for dutest.VerboseTestProgram. This class fixes a minor bug (… IMO) I found while specifying different verbosity levels from the command line to unittest.TestProgram. It also employs by default dutest.defaultTestLoader instead of unittest.defaultTestLoader.

What’s new in version 0.1.0:

doctest / unittest extensions:

  • A whole new unittest API to integrate doctest with unittest runners.

  • It allows to report the individual results of each and every interactive example executed during the test run. A separate entry is created in the corresponding TestResult instance containing the expected value and the actual result.

  • Since the match made for individual examples is reported one by one by instances of TestResult, it is quite easier to automate post-testing activities (e.g. automated test analysis). Formerly access to this information required extra work (i.e. the full report provided by doctest had to be parsed).

  • You do not need to use DocTestRunner output streams to collect test results.

  • A new hierarchy of TestCase descendants (extensions of DocTestCase class) is now possible so for example, setUp and tearDown may be redefined across a hierarchy of TestCase s instead of providing this methods as parameters to a function (breaking OOP philosophy and logic); or maybe even to represent failures and errors in a custom way.

  • A new TestLoader descendant now allows to load (using unittest-style) TestCase s which check the match made for doctests. It provides integration with TestProgram, supports building complex TestSuite s in a more natural way, and eases the use of specialized instances of TestCase s built out of doctest examples.

  • Allows to perform regression testing over tests written using doctest.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

dutest-0.2.4.zip (22.3 kB view details)

Uploaded Source

dutest-0.2.4.tar.gz (14.5 kB view details)

Uploaded Source

dutest-0.2.4.tar.bz2 (14.8 kB view details)

Uploaded Source

File details

Details for the file dutest-0.2.4.zip.

File metadata

  • Download URL: dutest-0.2.4.zip
  • Upload date:
  • Size: 22.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for dutest-0.2.4.zip
Algorithm Hash digest
SHA256 9c9a1ea6cb4ae6baf0c2be1a34eaa8b0ac56fb7e20b9ca705ca85327721a6b62
MD5 c89f47e733f134710b49f8c07f597a93
BLAKE2b-256 2c32e79ef0ef2958fc88904be6776f8171d35cfadbd2c77da9c3797249d268f0

See more details on using hashes here.

File details

Details for the file dutest-0.2.4.tar.gz.

File metadata

  • Download URL: dutest-0.2.4.tar.gz
  • Upload date:
  • Size: 14.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for dutest-0.2.4.tar.gz
Algorithm Hash digest
SHA256 7d7505f81cbb58195ad22ef8baf5a3834276370e38980282507790aec36d35d4
MD5 f4ea29161830386389633532f1461dff
BLAKE2b-256 0c9515ccbb199c73ab879e0c6183ae65010bdeab78559bbda5030ac0442f9c21

See more details on using hashes here.

File details

Details for the file dutest-0.2.4.tar.bz2.

File metadata

  • Download URL: dutest-0.2.4.tar.bz2
  • Upload date:
  • Size: 14.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for dutest-0.2.4.tar.bz2
Algorithm Hash digest
SHA256 5ba33794d264e50b70924418f0c11818ca17f42e0f3739bca3d8651904ca9512
MD5 e01373c76106005fcdb289324e930827
BLAKE2b-256 15b46947f49bc710e137cace6ee8a0b2ab38f7c723ad7ef46222b4db39ac7101

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page