Skip to main content

Amazon Web Services Operator Interface

Project description

Aegea is a command line interface (CLI) that provides a set of essential commands and terminal dashboards for operators of Amazon Web Services (AWS) accounts. Aegea lets you build AMIs and Docker images using the cloud-init config management package, manage config roles, launch and monitor instances and services, and manage AWS resources including ELB, RDS, and AWS Batch. It is intended to be used in conjunction with the existing functionality of the AWS CLI and boto3.

Installation

pip3 install aegea

Before you do this, you will also need to install some system library dependencies:

OS

Command

Mac OS

Install Homebrew, then run brew install python.

Ubuntu

sudo apt-get update; sudo apt-get install build-essential python3-{pip,dev,cffi} libffi-dev libssl-dev moreutils

Red Hat

sudo yum install python3-devel python3-cffi openssl-devel moreutils

Run aws configure to configure IAM access credentials that will be used by the aws and aegea commands. You can create a new IAM key at https://console.aws.amazon.com/iam/home#/users. See the AWS CLI documentation for more details.

Aegea commands

Below are some highlights from Aegea’s suite of commands. Run aegea --help to see the full list of commands.

Command

Key functionality

aegea ls

List running EC2 instances

aegea launch

Launch EC2 instances and specify options such as spot tenancy, AMI, instance type, etc.

aegea ssh, aegea scp

Connect to running instances, transfer files using AWS Systems Manager or other options

aegea batch

Submit, manage and monitor AWS Batch jobs

aegea ecs

Monitor ECS clusters and run Fargate tasks

aegea build-ami

Build EC2 AMIs using cloud-init configuration scripts

aegea build-docker-image

Build AWS ECR docker images using Dockerfiles or cloud-init scripts

aegea logs

Download AWS CloudWatch Logs contents using S3 export

aegea grep

Query AWS CloudWatch Logs contents using CloudWatch Logs Insights

aegea cost

List AWS cost reports generated by AWS Cost Explorer

aegea secrets

List and manage secrets stored in AWS Secrets Manager

Aegea SSH

The aegea ssh command (and its variant aegea scp) is an SSH configuration wrapper that integrates with the AWS Systems Manager to provide SSH connectivity to your instances without opening any inbound ports (if your instance OS is not configured with SSM, use aegea ssh --no-ssm to open a direct connection). aegea ssh securely resolves instance addresses by name and pre-fetches their public keys without the Trust-On-First-Use requirement. It also optionally integrates with the Bless package using the blessclient configuration convention.

Aegea Launch

The aegea launch command launches EC2 instances. It has integrated support for Bless as well as DNS, runtime cloud-init configuration, automatic location of Aegea-built AMIs or up-to-date Ubuntu or Amazon Linux AMIs, automatic storage configuration, and other options.

Aegea Batch

The AWS Batch API lets you run non-interactive command line workflows in Docker containers, managing AWS ECS, Spot Fleet, and EC2 in your account on your behalf. Use the aegea batch family of commands to interact with AWS Batch. The key command is aegea batch submit to submit jobs.

Run aegea batch submit --command "echo 'hello world'" --memory 2048 --vcpus 4 --watch to run a Batch job that requires 2 GB RAM and 4 cores to be allocated to the Docker container, and executes the specified command.

You can also use aegea batch submit --execute FILE. This will slurp up FILE (any type of shell script or ELF executable) and execute it in the job’s Docker container.

The concurrency and cost of your Batch jobs is governed by the “Max vCPUs” setting in your compute environment. To change the capacity or other settings of your compute environment, go to https://console.aws.amazon.com/batch/home?region=us-east-1#/compute-environments, select “aegea_batch”, and click “Edit”.

AWS Batch launches and manages ECS host instances to execute your jobs. You can see the host instances by running aegea ls.

Aegea ECS Run

The ECS Fargate API is an interface to the AWS container-based virtualization platform, Firecracker. ECS Fargate allows you to run workloads in fully managed containers: no instances run in your account; you are billed by the second of container use, and containers usually start up within 20 seconds. Use the aegea ecs run command to interact with ECS Fargate. Most aegea batch semantics are applicable to aegea ecs, which interacts with ECS via the “one shot” ECS RunTask API.

Configuration management

Aegea supports ingesting configuration from a configurable array of sources. Each source is a JSON or YAML file. Configuration sources that follow the first source update the configuration using recursive dictionary merging. Sources are enumerated in the following order (i.e., in order of increasing priority):

  • Site-wide configuration source, /etc/aegea/config.yml

  • User configuration source, ~/.config/aegea/config.yml

  • Any sources listed in the colon-delimited variable AEGEA_CONFIG_FILE

  • Command line options

Array merge operators: When loading a chain of configuration sources, Aegea uses recursive dictionary merging to combine the sources. Additionally, when the original config value is a list, Aegea supports array manipulation operators, which let you extend and modify arrays defined in underlying configurations. See https://github.com/kislyuk/tweak#array-merge-operators for a list of these operators.

Building AMIs and Docker images

Aegea includes a lightweight configuration management system for building machine images based on cloud-init (both Docker images and AMIs are supported).

https://github.com/kislyuk/aegea/workflows/Tests/badge.svg https://img.shields.io/pypi/v/aegea.svg https://img.shields.io/pypi/l/aegea.svg https://codecov.io/gh/kislyuk/aegea/branch/master/graph/badge.svg

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aegea-3.6.44.tar.gz (208.9 kB view details)

Uploaded Source

Built Distribution

aegea-3.6.44-py2.py3-none-any.whl (279.2 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file aegea-3.6.44.tar.gz.

File metadata

  • Download URL: aegea-3.6.44.tar.gz
  • Upload date:
  • Size: 208.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/46.0.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.9

File hashes

Hashes for aegea-3.6.44.tar.gz
Algorithm Hash digest
SHA256 0d51592df2d3c2a8fe6f7ae3ddcc3d9002daa931fdb900780dc7f5b75b5dd49b
MD5 8020308d355b5b96d5664ea8b032b10d
BLAKE2b-256 bb1486b67b4e7af82a414e336049f9fbdf4c6f5d76ab3f4dd7287a6cd5f3cba5

See more details on using hashes here.

File details

Details for the file aegea-3.6.44-py2.py3-none-any.whl.

File metadata

  • Download URL: aegea-3.6.44-py2.py3-none-any.whl
  • Upload date:
  • Size: 279.2 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/46.0.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.9

File hashes

Hashes for aegea-3.6.44-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 fd859eaef8fc2427c50ec7dbc636988b7e5a1f187399c3a0931de6dffb1966eb
MD5 b0d85ebda25d1c253695c50421686c53
BLAKE2b-256 bbd88d8a713365a850926ac243bc48d089171058ff56f648b322f6206bd3e074

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page