KloudBuster is an open source tool that allows anybody to load any Neutron OpenStack cloud at massive data plane scale swiftly and effortlessly.
Project description
How good is your OpenStack data or storage plane under real heavy load?
KloudBuster is a tool that can load the data or storage plane of any OpenStack cloud at massive scale and can measure how well the cloud behaves under load.
Anybody with very basic knowledge of OpenStack, data plane and storage performance concepts can use the tool and get scale numbers for any OpenStack cloud straight off the box wth pre-defined default workloads.
Features
Neutron configuration agnostic (any encapsulation, any overlay, any plugin)
OpenStack Storage backend agnostic
User can specify any number of tenants, routers, networks, VM instances (only limited by cloud capacity) and KloudBuster will stage all these resources in a way that makes sense for operational usage
Real VM-level performance and scale numbers (not bare metal)
Punishing scale (thousands of VMs and enough load to fill even the fastest NIC cards or load any storage cluster with ease - if your cloud can even support that much)
- Data plane with HTTP traffic load:
Can load the data plane with one OpenStack cloud (single-cloud operations for L3 East-West scale) or 2 OpenStack clouds (dual-cloud operations with one cloud hosting the HTTP servers and the other loading HTTP traffic for L3 North-South scale testing)
Real HTTP servers (Nginx) running in real Linux images (Ubuntu 14.04)
Can specify any number of HTTP servers per tenant (as many as your cloud can handle)
High performance and highly scalable HTTP traffic generators to simulate huge number of HTTP users and TCP connections (hundreds of thousands to millions of concurrent and active connections)
Overall throughput aggegation and loss-less latency aggregation for every single HTTP request (typically millions per run) using the open source HdrHistogram library
Traffic shaping to specify on which links traffic should flow
Can support periodic reporting and aggregation of results
- Storage load:
VM-level Cinder volume file I/O using FIO running inside VMs (not bare metal)
Supports random amd sequential file access mode
Supports read, write and read/write mix
IOPs, bandwitdh and loss-less latency aggregation
User configurable storage workload profiles
Supports automated scale progressions (VM count series in any multiple increment)
Highly efficient and scalable metric aggregation
Automatic cleanup upon termination (can be disabled)
Manual cleanup script
KloudBuster Web Server with Web UI to drive scale test from your browser
KloudBuster REST Server allows external programs to drive scale automation using REST
Aggregated results provide an easy to understand way to assess the scale of the cloud under test
KloudBuster VM image pre-built and available from the OpenStack Community App Catalog (https://apps.openstack.org/)
Limitations
Requires Neutron networking (does not support Nova networking)
Only supports HTTP and storage traffic in this version
Contributions and Feedbacks
If you are interested in OpenStack Performance and Scale, contributions and feedbacks are welcome!
If you have any feedbacks or would like to make small or large contributions, simply send an email to openstack-dev@lists.openstack.org with a ‘[kloudbuster]’ tag in the subject.
Licensing
KloudBuster is licensed under the Apache License, Version 2.0 (the “License”). You may not use this tool except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
KloudBuster VM images contain multiple open source license components:
nginx: BSD License (http://nginx.org/LICENSE)
wrk2: Apache License 2.0 (https://raw.githubusercontent.com/giltene/wrk2/master/LICENSE)
Redis: BSD License (http://redis.io/topics/license)
FIO: GPL v2 (https://raw.githubusercontent.com/axboe/fio/master/MORAL-LICENSE)
Although the VM image includes a binary copy of the FIO code, it does not include the source code used to build it. In accordance to the GPL V2 license related to the inclusion of binary copies of FIO, the source code used to build the binary copy was not modified and can be found directly at https://github.com/axboe/fio.
Links
Documentation: http://kloudbuster.readthedocs.org
Supports/Bugs: http://launchpad.net/kloudbuster
Mailing List: kloudbuster-core@lists.launchpad.net
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for kloudbuster-0.6.0-py2-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 12c84d5c7b3527532dca232bb1defb02d5e1b9d0fbfc5c09c7a576a5d34fc7dc |
|
MD5 | 1e652c52a5b2be2d8dd85e712ce12c81 |
|
BLAKE2b-256 | 45a85285c426de6face9b3ba995243d63f40ae32e6ec52a6db421712071dbc99 |