Skip to main content

Moves metrics and alarm state transitions from the Message Queue to the Metrics and Alarms database.

Project description

Team and repository tags
========================

[![Team and repository tags](https://governance.openstack.org/badges/monasca-persister.svg)](https://governance.openstack.org/reference/tags/index.html)

<!-- Change things from this point on -->

monasca-persister
=============

The Monitoring Persister consumes metrics and alarm state transitions from the Message Queue and stores them in the Metrics and Alarms database.

Although the Persister isn't primarily a Web service it uses DropWizard, https://dropwizard.github.io/dropwizard/, which provides a nice Web application framework to expose an http endpoint that provides an interface through which metrics about the Persister can be queried as well as health status.

The basic design of the Persister is to have one Kafka consumer publish to a Disruptor, https://github.com/LMAX-Exchange/disruptor, that has output processors. The output processors use prepared batch statements to write to the Metrics and Alarms database.

The number of output processors/threads in the Persister can be specified to scale to more messages. To horizontally scale and provide fault-tolerance any number of Persisters can be started as consumers from the Message Queue.

# Build

Requires monasca-common from https://github.com/openstack/monasca-common. Download and build following instructions in its README.md. Then build monasca-persister by:

```
mvn clean package
```

# Configuration

A sample configuration file is available in java/src/deb/etc/persister-config.yml-sample.

A second configuration file is provided in java/src/main/resources/persister-config.yml for use with the [vagrant "mini-mon" development environment](https://github.com/openstack/monasca-vagrant/).

# TODO

* Purge metrics on shutdown
* Add more robust offset management in Kafka. Currently, the offset is advanced as each message is read. If the Persister stops after the metric has been read and prior to it being committed to the Metrics and Alarms database, the metric will be lost.
* Add better handling of SQL exceptions.
* Complete health check.
* Specify and document the names of the metrics that are available for monitoring of the Persister.
* Document the yaml configuration parameters.

# License

Copyright (c) 2014 Hewlett-Packard Development Company, L.P.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied.
See the License for the specific language governing permissions and
limitations under the License.



Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

monasca-persister-1.7.0.tar.gz (60.7 kB view details)

Uploaded Source

Built Distribution

monasca_persister-1.7.0-py2.py3-none-any.whl (42.4 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file monasca-persister-1.7.0.tar.gz.

File metadata

File hashes

Hashes for monasca-persister-1.7.0.tar.gz
Algorithm Hash digest
SHA256 900267df7c6a3ae01fc01a7bd53e0b099278dadb9d818947655a2db46aabe709
MD5 963e6ecca44221d01497957afc24eaec
BLAKE2b-256 1dd129b0cce527b2748f56cd6a59e1a691489c62c65e21cd9a9fd5c979a61fd3

See more details on using hashes here.

Provenance

File details

Details for the file monasca_persister-1.7.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for monasca_persister-1.7.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 b46c80146e6094c018b1522dfa7efd6a7d2d8835ecbd5055cf901be0bac99f2d
MD5 5cf2d51378e71a66f105139902b5ca55
BLAKE2b-256 bc64ed7ad1783431a281c46a064c84645f4a4f504184f724b763d175557e3358

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page