Skip to main content

Helper functionality for obtaining secrets and credentials from Hashicorp Vault in a Django project

Project description

build license kit format

This is a helper library with the goal of making it easier to retrieve secrets from Hasicorp Vault from a Django project.

Installation

Install django-vault-helpers from pip.

$ pip install django-vault-helpers

Add the new packages to your installed apps.

INSTALLED_APPS = [
    ...
    'vaulthelpers',
    ...
]

Authenticating to Vault

Configure connection settings using environment variables to authenticate to Vault.

Environment Variable

Description

VAULT_URL

Required. The URL of the Vault API. For example, https://vault:8200/.

VAULT_CACERT

Optional. File path to the Vault CA certificate.

VAULT_SKIP_VERIFY

Optional. Set to disable validation of Vault’s SSL cert.

VAULT_DEBUG

Optional. Enable Vault debug logging.

In addition to the settings above, you must provide environment variables for one of the authentication methods below.

Environment Variable

Description

VAULT_TOKEN

Token for Vault Token authentication

VAULT_APPID, VAULT_USERID

App-ID authentication

VAULT_ROLEID, VAULT_SECRETID

App-Role authentication

VAULT_SSLCERT, VAULT_SSLKEY

SSL Client Cert authentication

Database Connection Secrets

To use Vault to load database connection configuration and credentials, configure the Vault database secret backend as described in the Database secret backend documentation. For example:

$ vault mount database
Successfully mounted 'database' at 'database'!
$ CONNECTION_NAME='myapplication'
$ CONNECTION_URL='postgresql://vaultuser:FOO@mydb:5432/myapplication'
$ PARENT_ROLE_NAME='myapplication'
$ vault write "database/config/$CONNECTION_NAME" \
        plugin_name="postgresql-database-plugin" \
        allowed_roles="$CONNECTION_NAME" \
        connection_url="$CONNECTION_URL"
$ vault write "database/roles/$CONNECTION_NAME" \
        db_name="$CONNECTION_NAME" \
        creation_statements="CREATE ROLE \"{{name}}\" WITH LOGIN ENCRYPTED PASSWORD '{{password}}' VALID UNTIL '{{expiration}}' IN ROLE \"${PARENT_ROLE_NAME}\" INHERIT NOCREATEROLE NOCREATEDB NOSUPERUSER NOREPLICATION;" \
        default_ttl="1h" \
        max_ttl="24h"

Next, add settings via the following environment variables.

Environment Variable

Description

VAULT_DATABASE_PATH

Vault path to read from when fetching database credentials. For example, database/creds/myapplication.

DATABASE_URL

Database connection string, sans the username and password. For example, postgres://mydb:5432/myapplication.

DATABASE_OWNERROLE

For PostgreSQL, the name of the role to assume after connecting using SET ROLE

Finally, edit your projects settings.py file to load database configuration using Vault.

import vaulthelpers

# Load database credentials from Vault
DATABASES = {
    'default': vaulthelpers.database.get_config(),
}

To add additional keys to the database configuration, pass in a dictionary to the get_config call. For example:

import vaulthelpers

# Load database credentials from Vault
DATABASES = {
    'default': vaulthelpers.database.get_config({
        'ATOMIC_REQUESTS': True,
        'CONN_MAX_AGE': 3600,
    }),
}

AWS Credentials

To use Vault to load IAM or STS credentials for AWS, configure the Vault AWS secret backend as described in the AWS secret backend documentation.

$ vault mount aws
Successfully mounted 'aws' at 'aws'!
$ vault write aws/config/root \
        access_key=AKIAJWVN5Z4FOFT7NLNA \
        secret_key=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 \
        region=us-east-1
$ vault write aws/roles/myapplication \
        arn=arn:aws:iam::ACCOUNT-ID-WITHOUT-HYPHENS:role/MyApplicationRoleName

Next, add settings via the following environment variables.

Environment Variable

Description

VAULT_AWS_PATH

Vault path to read from when fetching AWS credentials. For example, aws/sts/myapplication.

Finally, configure you Django project to load AWS credentials using Vault. To do this, edit the settings.py file to include the following line.

import vaulthelpers

# Load AWS credentials from Vault
vaulthelpers.aws.init_boto3_credentials()

This will override the credential resolve code in boto3 and botocore so that it will fetch credentials from Vault instead of the usual means, like environment variables or the EC2 metadata service.

Direct HVAC Client Access

To directly access the authentication hvac client connector, fetch it from the vaulthelpers.common module.

import vaulthelpers

vault_auth = vaulthelpers.common.get_vault_auth()
verify = vaulthelpers.common.VAULT_CACERT or vaulthelpers.common.VAULT_SSL_VERIFY
vcl = vault_auth.authenticated_client(vaulthelpers.common.VAULT_URL, verify=verify)
result = vcl.read('secret/data/apps/myaplication')
print(result)

Changelog

0.8.0

  • Add background daemon threads that attempt to automatically renew leases for the cached Vault token and the DB credential lease.

  • Add management command to revoke the cached Vault token.

0.7.0

  • Add support for AWS IAM and Kubernetes auth methods

  • Add more verbose logging to database module to help debug connection failures

0.6.0

  • Add support for Django 2.1

  • Add support for Python 3.7

  • Migrate from Sentry’s old SDK (raven) to their new SDK (sentry-sdk).

0.5.0

  • Cache database and AWS credentials on the file system so that a multi-threaded / multi-process system doesn’t need separate credentials for each process and thread.

  • Improve security by setting the file permissions of all cache files (vault token, AWS, database) to only be readable by the owner.

0.4.2

  • Fix Django 2.0 Deprecation warnings.

0.4.1

  • Fix bug with SET ROLE when using the PostGIS database wrapper.

0.4.0

  • Fix bug with Database credential fetch code when a lease appears to still be valid but isn’t, due to it’s parent token getting revoked.

  • Added tests for database and AWS components.

  • Dropped dependencies on 12factor-vault and django-postgresql-setrole. When upgrading to this version, it is recommended to uninstall these packages.

0.3.3

  • Fix bug in with passing url parameter to HVAC client in common.EnvironmentConfig

  • Improve testing.

  • Support Django 2.0

0.3.2

  • Prevent recycling TCP connections after forking a process.

0.3.1

  • Fixed TCP connection issue by caching VaultAuthenticator instance in thread local storage.

0.3.0

  • Add file system caching of vault tokens.

0.2.0

  • Add S3 storage backend based on storages.backends.s3boto3.S3Boto3Storage.

0.1.0

  • Initial release.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

django-vault-helpers-0.8.0b1.tar.gz (17.6 kB view details)

Uploaded Source

Built Distribution

django_vault_helpers-0.8.0b1-py3-none-any.whl (23.1 kB view details)

Uploaded Python 3

File details

Details for the file django-vault-helpers-0.8.0b1.tar.gz.

File metadata

  • Download URL: django-vault-helpers-0.8.0b1.tar.gz
  • Upload date:
  • Size: 17.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.21.0 setuptools/40.6.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.2

File hashes

Hashes for django-vault-helpers-0.8.0b1.tar.gz
Algorithm Hash digest
SHA256 95dfa7a593e29405ab1a2276dbb6679acbd2585e7645aeae08c62b6bc02eda0e
MD5 18e0fab6bf2a4e51e7c4950760b1d7bd
BLAKE2b-256 3c046bfbe9958ec779c2e65f1bd5b98971ff98452c7babfac6229ef877b9055a

See more details on using hashes here.

Provenance

File details

Details for the file django_vault_helpers-0.8.0b1-py3-none-any.whl.

File metadata

  • Download URL: django_vault_helpers-0.8.0b1-py3-none-any.whl
  • Upload date:
  • Size: 23.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.21.0 setuptools/40.6.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.2

File hashes

Hashes for django_vault_helpers-0.8.0b1-py3-none-any.whl
Algorithm Hash digest
SHA256 77d8a446dcd46b7c0113640f1c94073fb571c093731870304b4269ef3a0a02c6
MD5 ab17485a95790fbe942f889c601c1fec
BLAKE2b-256 0379059671cd148817e403da6b92d0a74c2fe07b2019aff61f05a5d55d95c7ce

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page