Skip to main content

Moves metrics and alarm state transitions from the Message Queue to the Metrics and Alarms database.

Project description

Team and repository tags
========================

[![Team and repository tags](http://governance.openstack.org/badges/monasca-persister.svg)](http://governance.openstack.org/reference/tags/index.html)

<!-- Change things from this point on -->

monasca-persister
=============

The Monitoring Persister consumes metrics and alarm state transitions from the Message Queue and stores them in the Metrics and Alarms database.

Although the Persister isn't primarily a Web service it uses DropWizard, https://dropwizard.github.io/dropwizard/, which provides a nice Web application framework to expose an http endpoint that provides an interface through which metrics about the Persister can be queried as well as health status.

The basic design of the Persister is to have one Kafka consumer publish to a Disruptor, https://github.com/LMAX-Exchange/disruptor, that has output processors. The output processors use prepared batch statements to write to the Metrics and Alarms database.

The number of output processors/threads in the Persister can be specified to scale to more messages. To horizontally scale and provide fault-tolerance any number of Persisters can be started as consumers from the Message Queue.

# Build

Requires monasca-common from https://github.com/openstack/monasca-common. Download and build following instructions in its README.md. Then build monasca-persister by:

```
mvn clean package
```

# Configuration

A sample configuration file is available in java/src/deb/etc/persister-config.yml-sample.

A second configuration file is provided in java/src/main/resources/persister-config.yml for use with the [vagrant "mini-mon" development environment](https://github.com/openstack/monasca-vagrant/).

# TODO

* Purge metrics on shutdown
* Add more robust offset management in Kafka. Currently, the offset is advanced as each message is read. If the Persister stops after the metric has been read and prior to it being committed to the Metrics and Alarms database, the metric will be lost.
* Add better handling of SQL exceptions.
* Complete health check.
* Specify and document the names of the metrics that are available for monitoring of the Persister.
* Document the yaml configuration parameters.

# License

Copyright (c) 2014 Hewlett-Packard Development Company, L.P.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied.
See the License for the specific language governing permissions and
limitations under the License.



Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

monasca-persister-1.4.0.tar.gz (55.0 kB view details)

Uploaded Source

Built Distribution

monasca_persister-1.4.0-py2.py3-none-any.whl (27.1 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file monasca-persister-1.4.0.tar.gz.

File metadata

File hashes

Hashes for monasca-persister-1.4.0.tar.gz
Algorithm Hash digest
SHA256 e61acdb3fc4c37e1a393de89e73c52d2cab8de9bae9afbc968ad954d4637ed51
MD5 0a30057a8bd748f861ded1706d9202c0
BLAKE2b-256 457612fc02de6089791a5f9db38d4ae97449ce52871fc8a14e758cf87f0095e6

See more details on using hashes here.

Provenance

File details

Details for the file monasca_persister-1.4.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for monasca_persister-1.4.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 8585c1cbf0b7ebb6e6e0c9ee84da6803c3ea69a03a9045b79bbf6b2ab24bf8d0
MD5 cad715342c442dffddf68b949d75acb9
BLAKE2b-256 e680dd60a7d1fb7d5ed901db11c74f3d429f9e2009005df62100ece7308612fa

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page