Skip to main content

No project description provided

Project description

monasca-persister
=============

The Monitoring Persister consumes metrics and alarm state transitions from the Message Queue and stores them in the Metrics and Alarms database.

Although the Persister isn't primarly a Web service it uses DropWizard, https://dropwizard.github.io/dropwizard/, which provides a nice Web appliction framework to expose an http endpoint that provides an interface through which metrics about the Persister can be queried as well as health status.

The basic design of the Persister is to have one Kafka consumer publish to a Disruptor, https://github.com/LMAX-Exchange/disruptor, that has output processors. The output processors use prepared batch statements to write to the Metrics and Alarms database.

The number of output processors/threads in the Persister can be specified to scale to more messages. To horizontally scale and provide fault-tolerance any number of Persisters can be started as consumers from the the Message Queue.

# Build

Requires monasca-common from https://github.com/stackforge/monasca-common. Download and build following instructions in its README.md. Then build monasca-persister by:

```
mvn clean package
```

# TODO

* Purge metrics on shutdown
* Add more robust offset management in Kafka. Currently, the offset is advanced as each message is read. If the Persister stops after the metric has been read and prior to it being committed to the Metrics and Alarms database, the metric will be lost.
* Add better handling of SQL exceptions.
* Complete health check.
* Specify and document the names of the metrics that are available for monitoring of the Persister.
* Document the yaml configuration parameters.

# License

Copyright (c) 2014 Hewlett-Packard Development Company, L.P.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied.
See the License for the specific language governing permissions and
limitations under the License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

monasca-persister-0.1.1.tar.gz (71.0 kB view details)

Uploaded Source

Built Distribution

monasca_persister-0.1.1-py2.py3-none-any.whl (64.3 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file monasca-persister-0.1.1.tar.gz.

File metadata

File hashes

Hashes for monasca-persister-0.1.1.tar.gz
Algorithm Hash digest
SHA256 da8e5997d69ba86a5dbfdddad177e44b4b693303a95efdee9fe14b1693c3ddc6
MD5 2fc73cf9ff957f552a0ced744c1a8f3e
BLAKE2b-256 6b29988ed6e51675c23e50b3ac20283d917674c6da3e40409f3271553db2d94c

See more details on using hashes here.

Provenance

File details

Details for the file monasca_persister-0.1.1-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for monasca_persister-0.1.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 5d264c74103a9e1cd517e80d983e299f575d3b6bd73237f8d9e3cdd31face737
MD5 ac1436799aad0fad0c4b40270a4f4662
BLAKE2b-256 57f492e70301caac29ac578a24c219c26b4ab39fca5eb11ec4551b98cafa6ba8

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page