collective.testcaselayer 1.3

Layers

The PloneTestCase test fixture can be set up and torn down as a layer.

>>> from collective.testcaselayer import ptc
>>> ptc.ptc_layer
<collective.testcaselayer.ptc.PTCLayer testMethod=layerOnly>

To test the effects of just this layer, set up the base layer separately. Because of the way PloneTestCase uses layers, we must first call the setupPloneSite() function.

>>> from zope.testing.testrunner import runner
>>> from Products.PloneTestCase import ptc as plone_ptc
>>> plonesite_layer, = ptc.ptc_layer.__bases__
>>> options = runner.get_options([], [])
>>> setup_layers = {}
>>> runner.setup_layer(options, plonesite_layer, setup_layers)
Set up...Products.PloneTestCase.layer.ZCML in ... seconds.
Set up Products.PloneTestCase.layer.PloneSite in ... seconds.

The PloneTestCase test fixture has not been set up.

>>> from Testing import ZopeTestCase
>>> app = ZopeTestCase.app()
>>> portal = getattr(app, plone_ptc.portal_name)
>>> portal.acl_users.getUserById(plone_ptc.default_user)
>>> ZopeTestCase.close(app)

Set up the PloneTestCase layer.

>>> runner.setup_layer(options, ptc.ptc_layer, setup_layers)
Set up collective.testcaselayer.ptc.PTCLayer in ... seconds.

The PloneTestCase test fixture has been set up.

>>> app = ZopeTestCase.app()
>>> portal = getattr(app, plone_ptc.portal_name)
>>> portal.acl_users.getUserById(plone_ptc.default_user)
<PloneUser 'test_user_1_'>
>>> ZopeTestCase.close(app)

Tear down the PloneTestCase layer.

>>> runner.tear_down_unneeded(
...     options,
...     [layer for layer in setup_layers
...      if layer is not ptc.ptc_layer],
...     setup_layers)
Tear down collective.testcaselayer.ptc.PTCLayer in ... seconds.

The PloneTestCase test fixture is no longer set up.

>>> app = ZopeTestCase.app()
>>> portal = getattr(app, plone_ptc.portal_name)
>>> portal.acl_users.getUserById(plone_ptc.default_user)
>>> ZopeTestCase.close(app)

Layer Base Classes

The PloneTestCase class facilities can also be used in layers that use the PloneTestCase layer base class.

>>> class FooLayer(ptc.BasePTCLayer):
...     def afterSetUp(self):
...         self.addProfile(
...             'Products.CMFDefault:sample_content')
...         self.addProduct('CollectiveTestCaseLayerTesting')
...         self.loginAsPortalOwner()

This layer depends on the profile and product added which are set up in a testing only layer.

>>> from collective.testcaselayer.testing import layer
>>> foo_layer = FooLayer([layer.product_layer, ptc.ptc_layer])

The FooLayer test fixture has not been set up.

>>> app = ZopeTestCase.app()
>>> portal = getattr(app, plone_ptc.portal_name)

>>> hasattr(portal, 'subfolder')
False
>>> hasattr(portal, 'foo')
False

>>> from AccessControl import SecurityManagement
>>> SecurityManagement.getSecurityManager().getUser()
<SpecialUser 'Anonymous User'>

>>> ZopeTestCase.close(app)

Set up the FooLayer.

>>> runner.setup_layer(options, foo_layer, setup_layers)
Set up collective.testcaselayer.testing.layer.ProductLayer
in ... seconds.
Set up FooLayer in ... seconds.

The FooLayer test fixture has been set up.

>>> app = ZopeTestCase.app()
>>> portal = getattr(app, plone_ptc.portal_name)

>>> portal.subfolder
<ATFolder at /plone/subfolder>
>>> portal.foo
'foo'

>>> from AccessControl import SecurityManagement
>>> SecurityManagement.getSecurityManager().getUser()
<PropertiedUser 'portal_owner'>

>>> ZopeTestCase.close(app)

Tear down the FooLayer.

>>> runner.tear_down_unneeded(
...     options,
...     [layer for layer in setup_layers
...      if layer is not foo_layer],
...     setup_layers)
Tear down FooLayer in ... seconds.

The FooLayer test fixture is no longer set up.

>>> app = ZopeTestCase.app()
>>> portal = getattr(app, plone_ptc.portal_name)

>>> hasattr(portal, 'subfolder')
False
>>> hasattr(portal, 'foo')
False

>>> from AccessControl import SecurityManagement
>>> SecurityManagement.getSecurityManager().getUser()
<SpecialUser 'Anonymous User'>

>>> ZopeTestCase.close(app)

Finish tearing down the rest of the layers.

>>> runner.tear_down_unneeded(options, [], setup_layers)
Tear down collective.testcaselayer.testing.layer.ProductLayer
in ... seconds.
Tear down Products.PloneTestCase.layer.PloneSite in ... seconds.
Tear down Products.PloneTestCase.layer.ZCML in ... seconds.

Layers

The collective.testcaselayer.ztc module provides sandboxed layers that set up the test fixtures for ZopeTestCase. Note that test case based layers still act like test cases with a special no-op layerOnly() test method to that they have functional str() and repr() values.

>>> from collective.testcaselayer import ztc
>>> ztc.ztc_layer
<collective.testcaselayer.ztc.ZTCLayer testMethod=layerOnly>

Before we set up ZopeTestCase as a layer, nothing has been set up.

>>> from AccessControl import SecurityManagement
>>> SecurityManagement.getSecurityManager().getUser()
<SpecialUser 'Anonymous User'>

>>> hasattr(ztc.ztc_layer, 'app')
False

>>> from Testing import ZopeTestCase
>>> app = ZopeTestCase.app()
>>> 'test_folder_1_' in app.objectIds()
False
>>> ZopeTestCase.close(app)

>>> from Testing.ZopeTestCase import connections
>>> connections.count()
0

Set up ZopeTestCase as a layer.

>>> from zope.testing.testrunner import runner
>>> options = runner.get_options([], [])
>>> setup_layers = {}
>>> runner.setup_layer(options, ztc.ztc_layer, setup_layers)
Set up collective.testcaselayer.ztc.ZTCLayer in ... seconds.

The ZopeTestCase test fixture has been set up, but there is no logged in user.

>>> SecurityManagement.getSecurityManager().getUser()
<SpecialUser 'Anonymous User'>

>>> 'test_folder_1_' in  ztc.ztc_layer.app.objectIds()
True

Also note that the app attribute of the layer represents an open connection to the ZODB.

>>> connections.count()
1

Tear down the ZopeTestCase layer.

>>> runner.tear_down_unneeded(options, [], setup_layers)
Tear down collective.testcaselayer.ztc.ZTCLayer in ... seconds.

Now everything is back to its previous state.

>>> SecurityManagement.getSecurityManager().getUser()
<SpecialUser 'Anonymous User'>

>>> hasattr(ztc.ztc_layer, 'app')
False

>>> from Testing import ZopeTestCase
>>> app = ZopeTestCase.app()
>>> 'test_folder_1_' in app.objectIds()
False
>>> ZopeTestCase.close(app)

>>> connections.count()
0

Layer Base Classes

The collective.testcaselayer.ztc module also provides base classes for sandboxed layers that don’t actually set up the test case fixtures but allow using the facilities provided by the test cases in the layer set up and tear down code.

Since layers can be nested, these layer base classes don’t do the actual ZopeTestCase test fixture set up unless a subclass explicitly sets _setup_fixture (or _configure_portal for PortalTestCase) to True. Best practice should be to instantiate any layers depending on the ZTC test fixture with the ZTCLayer as a base layer as above.

Create a layer class that subclasses the appropriate base layer class. This layer class overrides the afterSetUp() method just as with ZopeTestCase based test cases. The afterSetUp method here excercises the factilities provided by ZopeTestCase and an additional loadZCML() method for loading ZCML files with ZCML debug mode enabled.

>>> from collective.testcaselayer import testing
>>> class FooLayer(ztc.BaseZTCLayer):
...     def afterSetUp(self):
...         self.login()
...         self.setRoles(['Manager'])
...         self.loadZCML('loadzcml.zcml', package=testing)
>>> foo_layer = FooLayer([ztc.ztc_layer])

To test the effects of just this layer, set up the base layer separately.

>>> runner.setup_layer(options, ztc.ztc_layer, setup_layers)
Set up collective.testcaselayer.ztc.ZTCLayer in ... seconds.

Before setting up the new layer, only the ZopeTestCase fixture is set up.

>>> SecurityManagement.getSecurityManager().getUser()
<SpecialUser 'Anonymous User'>

>>> app = ZopeTestCase.app()
>>> user = getattr(app, ZopeTestCase.folder_name
...                ).acl_users.getUserById(ZopeTestCase.user_name)
>>> user.getRoles()
('test_role_1_', 'Authenticated')
>>> ZopeTestCase.close(app)

Set up the new layer.

>>> runner.setup_layer(options, foo_layer, setup_layers)
Set up FooLayer in ... seconds.

Now the changed made by afterSetUp() are reflected.

>>> authenticated = SecurityManagement.getSecurityManager(
...     ).getUser()
>>> authenticated
<User 'test_user_1_'>
>>> authenticated.getRoles()
('Manager', 'Authenticated')

Tear down just the new layer.

>>> runner.tear_down_unneeded(
...     options, [ztc.ztc_layer], setup_layers)
Tear down FooLayer in ... seconds.

Everything is restored to its previous state.

>>> SecurityManagement.getSecurityManager().getUser()
<SpecialUser 'Anonymous User'>

>>> app = ZopeTestCase.app()
>>> user = getattr(app, ZopeTestCase.folder_name
...                ).acl_users.getUserById(ZopeTestCase.user_name)
>>> user.getRoles()
('test_role_1_', 'Authenticated')
>>> ZopeTestCase.close(app)

Finish tearing down the rest of the layers.

>>> runner.tear_down_unneeded(options, [], setup_layers)
Tear down collective.testcaselayer.ztc.ZTCLayer in ... seconds.

Layer Classes

Use the collective.testcaselayer.layer.Layer class to create your own layer classes.

>>> class FooLayer(layer.Layer):
...     def setUp(self): print 'running FooLayer.setUp'

The instances of the class will be your actual zope.testing layer.

>>> foo_layer = FooLayer()

>>> from zope.testing.testrunner import runner
>>> options = runner.get_options([], [])
>>> runner.setup_layer(options, foo_layer, {})
Set up FooLayer running FooLayer.setUp
in ... seconds.

Beware that the Layer class itself or subclasses can be used themselves as layers without error but that is not how they’re intended to be used. For example, using the FooLayer class as a layer will treat the Layer base class as a layer itself and will set it up which is meaningless. Further, it will try to call the setUp method as a class method which will raise an error.

>>> runner.setup_layer(options, FooLayer, {})
Traceback (most recent call last):
TypeError: unbound method setUp() must be called with FooLayer instance as first argument (got nothing instead)

Base Layers

Base layers are designated by passing them into the layer class on instantiation.

Create another layer class.

>>> class BarLayer(layer.Layer):
...     def setUp(self): print 'running BarLayer.setUp'

Create the new layer that uses foo_layer as a base layer.

>>> bar_layer = BarLayer([foo_layer])

Set up the layers.

>>> runner.setup_layer(options, bar_layer, {})
Set up FooLayer running FooLayer.setUp
in ... seconds.
Set up BarLayer running BarLayer.setUp
in ... seconds.

Grouping Layers

If all that’s required from a layer is that it groups other layers as base layers, then the collective.testcaselayer.layer.Layer class can be used directly.

Create another layer.

>>> class BazLayer(layer.Layer):
...     def setUp(self): print 'running BazLayer.setUp'
>>> baz_layer = BazLayer()

Instantiate the Layer class with the base layers, a module, and a name.

>>> qux_layer = layer.Layer(
...     [bar_layer, baz_layer],
...     module='QuxModule', name='QuxLayer')

Set up the layers.

>>> runner.setup_layer(options, qux_layer, {})
Set up FooLayer running FooLayer.setUp
in ... seconds.
Set up BarLayer running BarLayer.setUp
in ... seconds.
Set up BazLayer running BazLayer.setUp
in ... seconds.
Set up QuxModule.QuxLayer in ... seconds.

By default, layers have the same module and name as their class. If you want the layer to have a different module or name than the class, then the both can be passed in as arguments. This is useful in this case and any time multiple instances of the same layer class will be used as layers.

Instantiating the Layer class directly without passing a name raises an error.

>>> layer.Layer([], module='QuxModule')
Traceback (most recent call last):
ValueError: The "name" argument is requied when instantiating
"Layer" directly

If the Layer class is instantiated directly without passing a module, the module name from the calling frame is used.

>>> __name__ = 'BahModule'
>>> quux_layer = layer.Layer([], name='QuuxLayer')
>>> runner.setup_layer(options, quux_layer, {})
Set up BahModule.QuuxLayer in ... seconds.

Data streamed to the response

Due to some behavior in Testing.ZopeTestCase.zopedoctest.functional, the testbrowser.contents was empty when data had been streamed directly into the response (as opposed to returning the data from the callable published). This made it difficult to do functional testing for code that needed to stream data to the response for performance, such as when the response data is very large and would consume too much memory.

Stream iterators

A patch taken from plone.app.blob is also included so that HTTP responses in the test environment support stream iterators. This allows functional testing of code that makes use of stream iterators.

HTTP_REFERRER

Due to bug #98437, “TestBrowser Referer: header set to ‘localhost’”, some testbrowser requests would raise NotFound. Two examples would be visiting the Plone login_form directly rather than following a link, or using the Plone content_status_history form.

Test the Patches

Add a document which renders the referer.

>>> folder.addDTMLDocument(
...     'index_html', file='''\
... <html><body>
... <dtml-var "REQUEST['HTTP_REFERER']">
... <form action="." method="post" id="post"></form>
... <form action="." method="get" id="get"></form>
... <a href=".">link</a>
... </html></body>
... ''')
''

Open a browser.

>>> from Products.Five.testbrowser import Browser
>>> browser = Browser()
>>> browser.handleErrors = False

Before patching, fresh requests have an invalid referer.

>>> browser.open(folder.index_html.absolute_url())
>>> print browser.contents
<html><body>
localhost
<form action="." method="post" id="post"></form>
<form action="." method="get" id="get"></form>
<a href=".">link</a>
</html></body>

Add a script that streams content to the response.

>>> from Products.PythonScripts import PythonScript
>>> PythonScript.manage_addPythonScript(folder, 'foo.txt')
''
>>> folder['foo.txt'].ZPythonScript_edit(params='', body='''\
... context.REQUEST.response.setHeader('Content-Type', 'text/plain')
... context.REQUEST.response.setHeader(
...     'Content-Disposition',
...     'attachment;filename=foo.txt')
... context.REQUEST.response.write('foo')''')

Before patching, data streamed to the response is not in the browser contents.

>>> browser.open(folder['foo.txt'].absolute_url())
>>> browser.isHtml
False
>>> print browser.contents

Add a script that returns a stream iterator.

>>> from Products.PythonScripts import PythonScript
>>> PythonScript.manage_addPythonScript(folder, 'bar.txt')
''
>>> folder['bar.txt'].ZPythonScript_edit(params='', body='''\
... from collective.testcaselayer.testing.iterator import (
...     StreamIterator)
... context.REQUEST.response.setHeader('Content-Type', 'text/plain')
... context.REQUEST.response.setHeader(
...     'Content-Disposition',
...     'attachment;filename=bar.txt')
... return StreamIterator(['bar', 'qux'])''')

>>> from AccessControl import allow_module
>>> allow_module('collective.testcaselayer.testing.iterator')

Stream iterators are not supported.

>>> browser.open(folder['bar.txt'].absolute_url())
>>> browser.isHtml
False
>>> print browser.contents
['bar', 'qux']

Apply the patches.

>>> from Products.Five import zcml
>>> from Products.Five import fiveconfigure
>>> from collective import testcaselayer
>>> fiveconfigure.debug_mode = True
>>> zcml.load_config('testing.zcml', package=testcaselayer)
>>> fiveconfigure.debug_mode = False

A fresh request should have no referer.

>>> browser.open(folder.index_html.absolute_url())
>>> print browser.contents
<html><body>
<form action="." method="post" id="post"></form>
<form action="." method="get" id="get"></form>
<a href=".">link</a>
</html></body>

Submitting a form via post should have no referer.

>>> browser.getForm('post').submit()
>>> print browser.contents
<html><body>
<form action="." method="post" id="post"></form>
<form action="." method="get" id="get"></form>
<a href=".">link</a>
</html></body>

Submitting a form via get should have no referer.

>>> browser.getForm('get').submit()
>>> print browser.contents
<html><body>
<form action="." method="post" id="post"></form>
<form action="." method="get" id="get"></form>
<a href=".">link</a>
</html></body>

Clicking a link should set the referer.

>>> browser.getLink('link').click()
>>> print browser.contents
<html><body>
http://nohost/test_folder_1_/...
<form action="." method="post" id="post"></form>
<form action="." method="get" id="get"></form>
<a href=".">link</a>
</html></body>

Data streamed to the response is now in the browser contents.

>>> browser.open(folder['foo.txt'].absolute_url())
>>> browser.isHtml
False
>>> print browser.contents
Status: 200 OK
X-Powered-By: Zope (www.zope.org), Python (www.python.org)
Content-Length: 0
Content-Type: text/plain
Content-Disposition: attachment;filename=foo.txt
foo

Stream iterators are now in the browser contents.

>>> browser.open(folder['bar.txt'].absolute_url())
>>> browser.isHtml
False
>>> print browser.contents
barqux

1.3 - 2010-02-09

• Add a loadZCML convenience method [rossp]

• Add a common layer with some useful test setup [rossp]

• Add a mock mail host layer [rossp]

1.2.2 - 2009-11-14

• Add functional testing support for stream iterator responses. Taken from witsch’s plone.app.blob testing patches. [rossp]

• Zope 2.10-2.12 compatibility [rossp, witsch]

• Fix Sandboxed replacement for Zope 2.12 / Plone 4. [witsch]

1.2.1 - 2009-10-11

• Move the ZTC functional doctest monkey patches to testing.zcml so that they don’t get picked up under auto-include. optilude reported this was breaking debug-mode.

1.2 - 2009-08-21

• Add a patch so that data streamed to the response is available in testbrowser.contents. [rossp]

• Add a patch for the HTTP_REFERER testbrowser bug. https://bugs.launchpad.net/bugs/98437 [rossp]

1.1 - 2009-07-29

• Fix release. Files were missing due to the setuptools interaction with SVN 1.6.

1.0 - 2009-07-29

• Tested against Plone 3.3rc4

• Add sample code for basic Plone test case layers

• Deprecate zope.testing<3.6 support

• The collective.testcaselayer.ptc module needs to call ptc.setupPloneSite() in order to make sure the plone site exists

0.2 - 2008-01-08

• Make the self.folder attribute available in PortalTestCase sub-layers

• Make tests compatible with zope.testing.testrunner refactoring

0.1 - 2008-05-23

• Initial release