Skip to main content

Behave library to integrate with Testrail API

Project description

Behave to TestRail Reporter

CircleCI branch Codacy grade Codacy branch coverage

This integration is used to add test results to TestRail automatically when Behave tests are executed.

Example of the generated report:

3 testrail test cases passed, 0 failed, 19 skipped, 2 untested
Took 0m6.349s

Install

Can install it using pipenv

$ pipenv install behave-testrail-reporter

or using pip

$ pip install behave-testrail-reporter

Setup

Add TestrailReporter to behave reporters in your /features/environment.py by adding this code in before_all()

from behave_testrail_reporter import TestrailReporter

def before_all(context):
    # ... all your other awesome code in here
    current_branch = os.environ.get('CIRCLE_BRANCH') # Change this to get the current build branch of your CI system
    testrail_reporter = TestrailReporter(current_branch)
    context.config.reporters.append(testrail_reporter)

Create a testrail.yml config file in the root of your project

Example structure:

projects:
  -
    name: 'Project Name'
    id: 123
    suite_id: 123
    allowed_branch_pattern: '^(master|release\/\d+([\.\d]+)?)$'
yaml key Description
name Project name
id Testrail project id
suite_id Testrail Suite id
allowed_branch_pattern Regular expression to restrict when a test run is executed

Environment variables required

Variable name Description
TESTRAIL_KEY TestRail user password
TESTRAIL_USER TestRail user email address

How to use

To get test cases marked as success or fail on TestRail we have to add tags with TestRail test case ID on each scenario.

Test case tag structure:

prefix + test case id

@testrail- + C1104

See example below:

Feature: Log in and out

    Background:
        Given I am logged out from Hub
        And I navigate to the home page

    @testrail-C1104
    @testrail-C45933
    Scenario: Admin can login
        When I enter the username admin
        And I enter the password admin
        And I click the Login button
        Then I see the admin's landing page

Note: some scenarios can cover multiple TestRail cases, for that you just need to add multiple tags.

How to run tests

tox

How to distribute

If you need to publish a new version of this package you can use this command:

python setup.py sdist bdist_wheel
twine upload dist/*

License

Licensed under MIT license. View license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

behave-testrail-reporter-0.2.0.tar.gz (7.6 kB view details)

Uploaded Source

Built Distribution

behave_testrail_reporter-0.2.0-py2.py3-none-any.whl (7.4 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file behave-testrail-reporter-0.2.0.tar.gz.

File metadata

File hashes

Hashes for behave-testrail-reporter-0.2.0.tar.gz
Algorithm Hash digest
SHA256 db67a24d04f018df40a84ed98447eb9569df9084e2a6210ee89ae06161b63f47
MD5 4eb6c1de9afd3fe1f9a244f9016a3d87
BLAKE2b-256 d7d8b3b96a9e6efe2502c15fa6960b2f3356bfa6cbf62e58bd7aae97a32d69d6

See more details on using hashes here.

File details

Details for the file behave_testrail_reporter-0.2.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for behave_testrail_reporter-0.2.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 c24b306148cb2d38eb00161b1deb19b9ab7d1ea1f80557bc017606702603d8d2
MD5 62488ca4274e8c131e3a76208e90c554
BLAKE2b-256 d0578c2c22b599c928f3d0c70ab4ab64f247f0c5c381ed9bc6d3d57b92bffd81

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page