Skip to main content

Amazon Web Services Operator Interface

Project description

Aegea is a command line interface (CLI) that provides a set of essential commands and terminal dashboards for operators of Amazon Web Services (AWS) accounts. Aegea lets you build AMIs and Docker images using the cloud-init config management package, manage config roles, launch and monitor instances and services, and manage AWS resources including ELB, RDS, and AWS Batch. It is intended to be used in conjunction with the existing functionality of the AWS CLI and boto3.

Installation

Run make install in this directory to install Aegea. Before you do this, you will also need to install some system library dependencies:

OS

Python

Command

Ubuntu

Python 2

apt-get update; apt-get install build-essential python-pip python-dev python-cffi libffi-dev libssl-dev moreutils

Ubuntu

Python 3

apt-get update; apt-get install build-essential python3-{pip,dev,cffi} libffi-dev libssl-dev moreutils

Red Hat

Python 2

yum install python-devel python-cffi openssl-devel moreutils

Red Hat

Python 3

yum install python3-devel python3-cffi openssl-devel moreutils

OS X

Install Homebrew. Run brew install openssl moreutils && brew link --force openssl.

Run aws configure to configure IAM access credentials that will be used by the aws and aegea commands. You can create a new IAM key at https://console.aws.amazon.com/iam/home#/users.

Ubuntu 12.04: Use pip install cffi instead of apt-get install python-cffi. Update your Python packaging utilities: for p in six setuptools packaging pip setuptools; do pip install --upgrade $p; hash -r; done.

No root access; user-local install: Use make install_venv to install aegea in its own virtualenv. The last line of the output shows how to activate the virtualenv. The version of virtualenv packaged in Ubuntu 12.04 is too old; use pip install --upgrade --user virtualenv to upgrade it.

Configuration management

Aegea supports ingesting configuration from a configurable array of sources. Each source is a JSON or YAML file. Configuration sources that follow the first source update the configuration using recursive dictionary merging. Sources are enumerated in the following order (i.e., in order of increasing priority):

  • Site-wide configuration source, /etc/aegea/config.yml

  • User configuration source, ~/.config/aegea/config.yml

  • Any sources listed in the colon-delimited variable AEGEA_CONFIG_FILE

  • Command line options

Array merge operators: When loading a chain of configuration sources, Aegea uses recursive dictionary merging to combine the sources. Additionally, when the original config value is a list, Aegea supports array manipulation operators, which let you extend and modify arrays defined in underlying configurations. See https://github.com/kislyuk/tweak#array-merge-operators for a list of these operators.

Aegea Batch

The AWS Batch API currently requires you to use the us-east-1 region. You can use aws configure to select this region.

aegea/missions/docker-example/ is a root directory of an aegea mission - a configuration management role. It has a rootfs.skel and a config.yml, which has directives to install packages, etc. The example just installs the bwa APT package.

Run aegea-build-image-for-mission docker-example dex to build an ECR image called dex from the “docker-example” mission. You can list ECR images with aegea ecr ls, and delete them with e.g. aws ecr delete-repository dex.

Run aegea batch submit --ecs-image dex --command "bwa aln || true" "bwa mem || true" --memory 2048 --vcpus 4 --watch to run a Batch job that requires 2 GB RAM and 4 cores to be allocated to the Docker container, using the “dex” image, and executes two commands as listed after –command, using “bash -euo pipefail -c”.

You can also use aegea batch submit --execute FILE. This will slurp up FILE (any type of shell script or ELF executable) and execute it in the job’s Docker container.

The concurrency and cost of your Batch jobs is governed by the “Max vCPUs” setting in your compute environment. To change the capacity or other settings of your compute environment, go to https://console.aws.amazon.com/batch/home?region=us-east-1#/compute-environments, select “aegea_batch”, and click “Edit”.

AWS Batch launches and manages ECS host instances to execute your jobs. You can see the host instances by running aegea ls.

https://circleci.com/gh/kislyuk/aegea.svg?style=svg&circle-token=70d22b84025fad5d484ac5f3df1fc0a183c0f516 https://codecov.io/gh/kislyuk/aegea/branch/master/graph/badge.svg?token=a9suCNpECz

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aegea-1.9.0.tar.gz (170.6 kB view details)

Uploaded Source

Built Distribution

aegea-1.9.0-py2.py3-none-any.whl (237.0 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file aegea-1.9.0.tar.gz.

File metadata

  • Download URL: aegea-1.9.0.tar.gz
  • Upload date:
  • Size: 170.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for aegea-1.9.0.tar.gz
Algorithm Hash digest
SHA256 17c8820d39314eb8584be90b745db399a9acba935ea17565b2d9534c56a4e654
MD5 4b4a78616d542b6c37cf332ae5652578
BLAKE2b-256 3bbfdd1679ff8efa631546089020b886fe7ed1ba833845b294b743cc7edb95d2

See more details on using hashes here.

File details

Details for the file aegea-1.9.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for aegea-1.9.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 f3e64ede529c44a2c5a948ad8a329e0c01f7dbfe5f48555384f8a262e6e21b13
MD5 59443d190c3b3189b1626481a3c735ca
BLAKE2b-256 aab287d4530afb9c6747cbf91e899bd7cde6675a95e6f02164be4c4b15bb96eb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page