Smoke Test tool
Project description
Smwogger (pronounced smoger) is a smoke test tool for Swagger.
Smwogger’s goal is to provide a quick and simple way to smoke test a service using its Swagger description.
To add a smoke test for you API, you have three options:
Add an x-smoke-test section in your Swagger spec, describing your smoke test scenario.
Have a specific file that contains the x-smoke-test section.
Use the API class which binds its methods to Swagger operations in your own Python script.
Example using x-smoke-test
You can run the test by pointing the Swagger spec URL (or path to a file):
$ smwogger smwogger/tests/shavar.yaml ..................
You can display the sequence that’s being executed with -v:
$ smwogger -v smwogger/tests/shavar.yaml Scanning spec... OK This is project 'Shavar Service' Mozilla's implementation of the Safe Browsing protocol Version 0.7.0 Running Scenario 1:getHeartbeat... OK 2:getDownloads... OK 3:getDownloads... OK
If you need to get more details about the requests and responses sent, you can increase verbosity with the -vv option:
$ smwogger -vv smwogger/tests/shavar.yaml Scanning spec... OK This is project 'Shavar Service' Mozilla's implementation of the Safe Browsing protocol Version 0.7.0 Running Scenario 1:getHeartbeat... GET https://shavar.somwehere.com/__heartbeat__ >>> HTTP/1.1 200 OK Content-Type: text/plain; charset=UTF-8 Date: Mon, 21 Nov 2016 14:03:19 GMT Content-Length: 2 Connection: keep-alive OK <<< OK 2:getDownloads... POST https://shavar.somwehere.com/downloads Content-Length: 30 moztestpub-track-digest256;a:1 >>> HTTP/1.1 200 OK Content-Type: application/octet-stream Date: Mon, 21 Nov 2016 14:03:23 GMT Content-Length: 118 Connection: keep-alive n:3600 i:moztestpub-track-digest256 ad:1 u:tracking-protection.somwehere.com/moztestpub-track-digest256/1469223014 <<< OK 3:getDownloads... POST https://shavar.somwehere.com/downloads Content-Length: 35 moztestpub-trackwhite-digest256;a:1 >>> HTTP/1.1 200 OK Content-Type: application/octet-stream Date: Mon, 21 Nov 2016 14:03:23 GMT Content-Length: 128 Connection: keep-alive n:3600 i:moztestpub-trackwhite-digest256 ad:1 u:tracking-protection.somwehere.com/moztestpub-trackwhite-digest256/1469551567 <<< OK
Describing your scenario
A scenario is described by providing a sequence of operations to perform, given their operationId.
For each operation, you can make some assertions on the response by providing values for the status code and some headers.
Example in YAML
x-smoke-test: scenario: - getSomething: request: params: foo: bar response: status: 200 headers: Content-Type: application/json - getSomethingElse response: status: 200 - getSomething response: status: 200
If a response does not match, an assertion error will be raised.
Posting data
When you are posting data, you can provide the request body content in the operation under the request key.
Example in YAML
x-smoke-test: scenario: - postSomething: request: body: This is the body I am sending. response: status: 200
Replacing Path variables
If some of your paths are using template variables, as defined by the swagger spec, you can use the path option:
x-smoke-test: scenario: - postSomething: request: body: This is the body I am sending. path: var1: ok var2: blah response: status: 200
You can also define global path values that will be looked up when formatting paths. In that case, variables have to be defined in a top-level path section:
x-smoke-test: path: var1: ok scenario: - postSomething: request: body: This is the body I am sending. path: var2: blah response: status: 200
Variables
You can extract values from responses, in order to reuse them in subsequential operations, wether it’s to replace variables in path templates, or create a body.
For example, if getSomething returns a JSON dict with a “foo” value, you can extract it by declaring it in a vars section inside the response key:
x-smoke-test: path: var1: ok scenario: - getSomething: request: body: This is the body I am sending. path: var2: blah response: status: 200 vars: foo: query: foo default: baz
Smwogger will use the query value to know where to look in the response body and extract the value. If the value is not found and default is provided, the variable will take that value.
Once the variable is set, it will be reused by Smwogger for subsequent operations, to replace variables in path templates, or to fill response data.
The path formatting is done automatically. Smwogger will look first at variables defined in operations, then at the path sections.
If you want to use a variable in a body, you need to use the ${formatting}:
x-smoke-test: path: var1: ok scenario: - getSomething: response: vars: foo: query: foo default: baz - doSomething: request: body: ${foo}
Using the API
If your scenario is too complex for fitting in the description, you can use a plain Python script in the –test option.
A Python script test is a module with a scenario function. The function will be executed and will get an instance of the API class and the arguments passed to the smwogger client.
The function needs to be a coroutine. Example:
from smwogger.cli import console async def scenario(api, args): with console('Getting something', verbose=args.verbose): resp = await api.getSomething() assert resp.status == 200
You can also use a plain Python script if you want to handle everything by yourself.
In the example below, the script prints out all the operation ids published:
import asyncio from smwogger import API async def print_operations(): async with API('http://petstore.swagger.io/v2/swagger.json') as api: print(api.operations) loop = asyncio.get_event_loop() try: loop.run_until_complete(print_operations()) finally: loop.close()
Contributors
Project created by Tarek Ziade <tarek_AT_ziade.org>
Contributors in order of appearance:
Lucas Cimon <lucas.cimon_AT_gmail.com>
Releases
1.0 2017-03-28
Initial Release.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.