Skip to main content

Python CloudWatch Logging

Project description

Watchtower: Python CloudWatch Logging
=====================================
Watchtower is a log handler for `Amazon Web Services CloudWatch Logs
<https://aws.amazon.com/blogs/aws/cloudwatch-log-service/>`_.

CloudWatch Logs is a log management service built into AWS. It is conceptually similar to services like Splunk and
Loggly, but is more lightweight, cheaper, and tightly integrated with the rest of AWS.

Watchtower, in turn, is a lightweight adapter between the `Python logging system
<https://docs.python.org/library/logging.html>`_ and CloudWatch Logs. It uses the `boto3 AWS SDK
<https://github.com/boto/boto3>`_, and lets you plug your application logging directly into CloudWatch without the need
to install a system-wide log collector. It aggregates logs into batches to avoid sending an API request per each log
message, while guaranteeing a delivery deadline (60 seconds by default).

Installation
~~~~~~~~~~~~
::

pip install watchtower

Synopsis
~~~~~~~~
Install `awscli <https://pypi-hypernode.com/pypi/awscli>`_ and set your AWS credentials (run ``aws configure``).

.. code-block:: python

import watchtower, logging
logging.basicConfig(level=logging.INFO)
logger = logging.getLogger(__name__)
logger.addHandler(watchtower.CloudWatchLogHandler())
logger.info("Hi")
logger.info(dict(foo="bar", details={}))

After running the example, you can see the log output in your `AWS console
<https://console.aws.amazon.com/cloudwatch/home>`_.

Example: Flask logging with Watchtower
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

.. code-block:: python

import watchtower, flask, logging

logging.basicConfig(level=logging.INFO)
app = flask.Flask("loggable")
handler = watchtower.CloudWatchLogHandler()
app.logger.addHandler(handler)
logging.getLogger("werkzeug").addHandler(handler)

@app.route('/')
def hello_world():
return 'Hello World!'

if __name__ == '__main__':
app.run()

(See also `http://flask.pocoo.org/docs/errorhandling/ <http://flask.pocoo.org/docs/errorhandling/>`_.)

Examples: Querying CloudWatch logs
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
This section is not specific to Watchtower. It demonstrates the use of `awscli <http://aws.amazon.com/cli/>`_ and
`jq <http://stedolan.github.io/jq/>`_ to read and search CloudWatch logs on the command line.

For the Flask example above, you can retrieve your application logs with the following two commands::

aws logs get-log-events --log-group-name watchtower --log-stream-name loggable | jq '.events[].message'
aws logs get-log-events --log-group-name watchtower --log-stream-name werkzeug | jq '.events[].message'

CloudWatch Logs supports alerting and dashboards based on `metric filters
<http://docs.aws.amazon.com/AmazonCloudWatch/latest/DeveloperGuide/FilterAndPatternSyntax.html>`_, which are pattern
rules that extract information from your logs and feed it to alarms and dashboard graphs. The following example shows
logging structured JSON data using Watchtower, setting up a metric filter to extract data from the log stream, a dashboard to
visualize it, and an alarm that sends an email::

TODO

Authors
-------
* Andrey Kislyuk

Links
-----
* `Project home page (GitHub) <https://github.com/kislyuk/watchtower>`_
* `Documentation (Read the Docs) <https://watchtower.readthedocs.org/en/latest/>`_
* `Package distribution (PyPI) <https://pypi-hypernode.com/pypi/watchtower>`_
* `Amazon CloudWatch <http://aws.amazon.com/cloudwatch/>`_

Bugs
~~~~
Please report bugs, issues, feature requests, etc. on `GitHub <https://github.com/kislyuk/watchtower/issues>`_.

License
-------
Licensed under the terms of the `Apache License, Version 2.0 <http://www.apache.org/licenses/LICENSE-2.0>`_.

.. image:: https://travis-ci.org/kislyuk/watchtower.svg
:target: https://travis-ci.org/kislyuk/watchtower
.. image:: https://coveralls.io/repos/kislyuk/watchtower/badge.svg?branch=master
:target: https://coveralls.io/r/kislyuk/watchtower?branch=master
.. image:: https://img.shields.io/pypi/v/watchtower.svg
:target: https://pypi-hypernode.com/pypi/watchtower
.. image:: https://img.shields.io/pypi/dm/watchtower.svg
:target: https://pypi-hypernode.com/pypi/watchtower
.. image:: https://img.shields.io/pypi/l/watchtower.svg
:target: https://pypi-hypernode.com/pypi/watchtower
.. image:: https://readthedocs.org/projects/watchtower/badge/?version=latest
:target: https://watchtower.readthedocs.org/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

watchtower-0.1.5.tar.gz (6.2 kB view details)

Uploaded Source

Built Distribution

watchtower-0.1.5-py2.py3-none-any.whl (8.1 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file watchtower-0.1.5.tar.gz.

File metadata

  • Download URL: watchtower-0.1.5.tar.gz
  • Upload date:
  • Size: 6.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for watchtower-0.1.5.tar.gz
Algorithm Hash digest
SHA256 834f072f8059ddcea46bfb20392d09d3d0028744e2126c5ed2e0be1d7ec208ed
MD5 68c85cf1fdae1b53f7c0a7b7d9ed2f95
BLAKE2b-256 b1599a343870ff54e1477c4076aa2c74ff2847e750676105b0ca56196a1b1b35

See more details on using hashes here.

File details

Details for the file watchtower-0.1.5-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for watchtower-0.1.5-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 66c1e03950015b650bbd46a0d38aa01eed5351d7ecbba98b5b488afff8d30fbf
MD5 ef42e302cce2994519915eedaa970eb5
BLAKE2b-256 efe0e7e8312bd3f576be02b34a5f02a779e3daede9c0444c34c76292e4565673

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page