Skip to main content

Lambdex turns pex files into aws lambda python functions.

Project description

lambdex

[!WARNING] Lambdex is no longer necessary and the 0.2.0 release of Lambdex is the last. Modern PEXes can be used directly as Lambda zips. See the the migration guide for details.

lambdex turns pex files into aws lambda functions.

pex is a tool that simplifies packaging python environments and is ideally suited for aws lambda. lambdex takes pex files and turns them into aws lambda functions, allowing you to more easily run complex applications in the cloud.

aws lambda documentation and concepts can be found here.

using the lambdex cli

The lambdex cli has two subcommands: build and test. build further has two possible modes of operation: by specifying an entry point that already exists within the pex file (-e) or by specifying an external script and handler to embed within the pex file (-s/-H).

step 1: package a pex file

First you must package a pex file. Assuming you already have the pex tool and a requirements.txt, you can simply run

pex -r requirements.txt -o lambda_function.pex

to produce a pex file containing the requirements. If you must build a pex file with platform-specific extensions, see the tips section below for more information about building Amazon Linux-specific extensions.

step 2: add lambdex handler

This can be done one of two ways, depending on where your code lives.

If you have a handler function named 'handler' in package 'mymodule.myapp' that is already contained within lambda_function.pex, then you can simply run

lambdex build -e mymodule.myapp:handler lambda_function.pex

If you have a script function.py with a lambda handler named my_handler, you would instead run

lambdex build -s function.py -H my_handler lambda_function.pex

This bundles function.py within the pex environment and instructs lambdex to call the python function my_handler when being invoked by AWS.

If you would like to build a GCP Cloud Function, you will need to specify the name of the entrypoint module to be main.py.

lambdex build -s example_http_function.py -M main.py lambda_function.zip

step 3 (optional): test your lambdex function

Once you have created a lambdex file, you can test it as if it were being invoked by Amazon using lambdex test. Given a lambdex package lambda_function.pex, you can either send it an empty json event using

lambdex test --empty lambda_function.pex

You can alternately supply a list of files containing json structs e.g.

lambdex test lambda_function.pex event1.json event2.json ...

Testing a GCP HTTP Cloud Function requires specifying the type.

lambdex test --type gcp-http lambda_function.zip

Note: In order to test GCP HTTP Cloud Functions, you must be using pex v1.6 or greater.

step 4: upload lambda function

You can create/update lambda functions via the AWS Console, or you can do it via the CLI using aws lambda create-function or aws lambda update-function-code respectively.

NOTE: When creating the function, you must specify the AWS Lambda handler as lambdex_handler.handler. Via the CLI, this is the --handler flag. This is the wrapper injected by lambdex that manages invocation of your code.

Do not confuse this with the -H option to lambdex build.

tips

building amazon linux pex files

Most simple dependencies have no platform-specific extensions and thus can be built anywhere. However there are a number of popular packages (e.g. numpy, scipy, matplotlib, PIL, ...) that require building C extensions that can prove tricky to get packaged correctly.

Amazon provides an amazonlinux docker image which can be useful for building platform-specific extensions to run on AWS Lambda. See documentation for information about that image.

The minimum Dockerfile to produce can environment that can build Amazon Linux-specific pex files can be found here

controlling runtime execution

To override the entry point that was specified at build time, you can use the LAMBDEX_ENTRY_POINT env var:

LAMBDEX_ENTRY_POINT=mymodule.myapp:other_handler ...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lambdex-0.2.0.tar.gz (17.8 kB view details)

Uploaded Source

Built Distribution

lambdex-0.2.0-py2.py3-none-any.whl (13.1 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file lambdex-0.2.0.tar.gz.

File metadata

  • Download URL: lambdex-0.2.0.tar.gz
  • Upload date:
  • Size: 17.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-requests/2.32.3

File hashes

Hashes for lambdex-0.2.0.tar.gz
Algorithm Hash digest
SHA256 1c602f66c9280aef601c967b0f4295cb8ce4ec7b3398bd6cfdc12fcc3d799d5a
MD5 12e194cd61888a111e6221c51739d6f7
BLAKE2b-256 bff0cc2bf7781012c53581bd120e9648996262aeb6e53601d9f17efe0d55ec35

See more details on using hashes here.

File details

Details for the file lambdex-0.2.0-py2.py3-none-any.whl.

File metadata

  • Download URL: lambdex-0.2.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 13.1 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-requests/2.32.3

File hashes

Hashes for lambdex-0.2.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 3a4ba9a75813c9e683fbeb75029327f5daf10312b362d32a512aba3147db5d33
MD5 fb52f225da86cf09c24f86227355d4a5
BLAKE2b-256 3b6e26f33bdc170687ed61303cc133cfb2b871835e790cdb5bdb5139cb9497ee

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page