Skip to main content

The PEX packaging toolchain.

Project description

PEX

https://travis-ci.org/pantsbuild/pex.svg?branch=master https://img.shields.io/pypi/l/pex.svg https://img.shields.io/pypi/v/pex.svg https://img.shields.io/pypi/pyversions/pex.svg https://img.shields.io/pypi/wheel/pex.svg

pex is a library for generating .pex (Python EXecutable) files which are executable Python environments in the spirit of virtualenvs. pex is an expansion upon the ideas outlined in PEP 441 and makes the deployment of Python applications as simple as cp. pex files may even include multiple platform-specific Python distributions, meaning that a single pex file can be portable across Linux and OS X.

pex files can be built using the pex tool. Build systems such as Pants, Buck, and {py}gradle also support building .pex files directly.

Still unsure about what pex does or how it works? Watch this quick lightning talk: WTF is PEX?.

pex is licensed under the Apache2 license.

Installation

To install pex, simply

$ pip install pex

You can also build pex in a git clone using tox:

$ tox -e package
$ cp dist/pex ~/bin

This builds a pex binary in dist/pex that can be copied onto your $PATH. The advantage to this approach is that it keeps your Python environment as empty as possible and is more in-line with what pex does philosophically.

Simple Examples

Launch an interpreter with requests, flask and psutil in the environment:

$ pex requests flask 'psutil>2,<3'

Or instead freeze your current virtualenv via requirements.txt and execute it anywhere:

$ pex -r <(pip freeze) -o my_virtualenv.pex
$ deactivate
$ ./my_virtualenv.pex

Run webserver.py in an environment containing flask as a quick way to experiment:

$ pex flask -- webserver.py

Launch Sphinx in an ephemeral pex environment using the Sphinx entry point sphinx:main:

$ pex sphinx -e sphinx:main -- --help

Build a standalone pex binary into pex.pex using the pex console_scripts entry point:

$ pex pex -c pex -o pex.pex

You can also build pex files that use a specific interpreter type:

$ pex pex -c pex --python=pypy -o pypy-pex.pex

Most pex options compose well with one another, so the above commands can be mixed and matched. For a full list of options, just type pex --help.

Integrating pex into your workflow

If you use tox (and you should!), a simple way to integrate pex into your workflow is to add a packaging test environment to your tox.ini:

[testenv:package]
deps = pex
commands = pex . -o dist/app.pex

Then tox -e package will produce a relocateable copy of your application that you can copy to staging or production environments.

Documentation

More documentation about Pex, building .pex files, and how .pex files work is available at https://pex.readthedocs.io.

Development

Pex uses tox for test and development automation. To run the test suite, just invoke tox:

$ tox

If you don’t have tox, you can generate a pex of tox:

$ pex tox -c tox -o ~/bin/tox

Tox provides many useful commands and options, explained at https://testrun.org/tox/en/latest/. Below, we provide some of the most commonly used commands used when working on Pex, but the docs are worth acquainting yourself with to better understand how Tox works and how to do more advanced commmands.

To run a specific environment, identify the name of the environment you’d like to invoke by running tox --listenvs-all, then invoke like this:

$ tox -e style

All of our tox test environments allow passthrough arguments, which can be helpful to run specific tests:

$ tox -e py37-integration -- -k test_reproducible_build

To run Pex from source, rather than through what is on your PATH, invoke via Python:

$ python -m pex

Contributing

To contribute, follow these instructions: http://pantsbuild.org/howto_contribute.html

Release Notes

2.0.0

Pex 2.0.0 is cut on the advent of a large, mostly internal change for typical use cases: it now uses vendored pip to perform resolves and wheel builds. This fixes a large number of compatibility and correctness bugs as well as gaining feature support from pip including handling manylinux2010 and manylinux2014 as well as VCS requirements and support for PEP-517 & PEP-518 builds.

API changes to be wary of:

  • The egg distribution format is no longer supported.

  • The deprecated --interpreter-cache-dir CLI option was removed.

  • The --cache-ttl CLI option and cache_ttl resolver API argument were removed.

  • The resolver API replaced fetchers with a list of indexes and a list of find_links repos.

  • The resolver API removed (http) context which is now automatically handled.

  • The resolver API removed precedence which is now pip default precedence: wheels when available and not ruled out via the --no-wheel CLI option or use_wheel=False API argument.

  • The --platform CLI option and platform resolver API argument now must be full platform strings that include platform, implementation, version and abi; e.g.: --platform=macosx-10.13-x86_64-cp-36-m.

  • The --manylinux CLI option and use_manylinux resolver API argument were removed. Instead, to resolve manylinux wheels for a foreign platform, specify the manylinux platform to target with an explicit --platform CLI flag or platform resolver API argument; e.g.: --platform=manylinux2010-x86_64-cp-36-m.

In addition, Pex 2.0.0 now builds reproduceable pexes by default; ie:

  • Python modules embedded in the pex are not pre-compiled (pass –compile if you want this).

  • The timestamps for Pex file zip entries default to midnight on January 1, 1980 (pass –use-system-time to change this).

This finishes off the effort tracked by Issue #716

Changes in this release:

  • Pex defaults to reproduceable builds. (#791) PR #791

  • Use pip for resolving and building distributions. (#788) PR #788

  • Bias selecting the current interpreter. (#783) PR #783

1.6.12

This release adds the –intransitive option to support pre-resolved requirements lists and allows for python binaries built under Gentoo naming conventions.

  • Add an –intransitive option. (#775) PR #775

  • PythonInterpreter: support python binary names with single letter suffixes (#769) PR #769

1.6.11

This release brings a consistency fix to requirement resolution and an isolation fix that scrubs all non-stdlib PYTHONPATH entries by default, only pre-pending or appending them to the sys.path if the corresponding –inherit-path=(prefer|fallback) is used.

  • Avoid reordering of equivalent packages from multiple fetchers (#762) PR #762

  • Include PYTHONPATH in –inherit-path logic. (#765) PR #765

1.6.10

This is a hotfix release for the bug detailed in #756 that was introduced by #752 in python 3.7 interpreters.

1.6.9

  • Fix sys.path scrubbing of pex extras modules. (#752) PR #752

  • Fix pkg resource early import (#750) PR #750

1.6.8

  • Fixup pex re-exec during bootstrap. (#741) PR #741

  • Fix resolution of setup.py project extras. (#739) PR #739

  • Tighten up namespace declaration logic. (#732) PR #732

  • Fixup import sorting. (#731) PR #731

1.6.7

We now support reproducible builds when creating a pex via pex -o foo.pex, meaning that if you were to run the command again with the same inputs, the two generated pexes would be byte-for-byte identical. To enable reproducible builds when building a pex, use the flags –no-use-system-time –no-compile, which will use a deterministic timestamp and not include .pyc files in the Pex.

In Pex 1.7.0, we will default to reproducible builds.

  • add delayed pkg_resources import fix from #713, with an integration test (#730) PR #730

  • Fix reproducible builds sdist test by properly requiring building the wheel (#727) PR #727

  • Fix reproducible build test improperly using the -c flag and add a new test for -c flag (#725) PR #725

  • Fix PexInfo requirements using a non-deterministic data structure (#723) PR #723

  • Add new –no-use-system-time flag to use a deterministic timestamp in built PEX (#722) PR #722

  • Add timeout when using requests. (#726) PR #726

  • Refactor reproducible build tests to assert that the original pex command succeeded (#724) PR #724

  • Introduce new –no-compile flag to not include .pyc in built pex due to its non-determinism (#718) PR #718

  • Document how Pex developers can run specific tests and run Pex from source (#720) PR #720

  • Remove unused bdist_pex.py helper function (#719) PR #719

  • Add failing acceptance tests for reproducible Pex builds (#717) PR #717

  • Make a copy of globals() before updating it. (#715) PR #715

  • Make sure PexInfo is isolated from os.environ. (#711) PR #711

  • Fix import sorting. (#712) PR #712

  • When iterating over Zipfiles, always use the Unix file separator to fix a Windows issue (#638) PR #638

  • Fix pex file looses the executable permissions of binary files (#703) PR #703

1.6.6

This is the first release including only a single PEX pex, which supports execution under all interpreters pex supports.

  • Fix pex bootstrap interpreter selection. (#701) PR #701

  • Switch releases to a single multi-pex. (#698) PR #698

1.6.5

This release fixes long-broken resolution of abi3 wheels.

  • Use all compatible versions when calculating tags. (#692) PR #692

1.6.4

This release un-breaks lambdex.

  • Restore pex.pex_bootstrapper.is_compressed API. (#685) PR #685

  • Add the version of pex used to build a pex to build_properties. (#687) PR #687

  • Honor interpreter constraints even when PEX_PYTHON and PEX_PYTHON_PATH not set (#668) PR #668

1.6.3

This release changes the behavior of the --interpreter-constraint option. Previously, interpreter constraints were ANDed, which made it impossible to express constraints like ‘>=2.7,<3’ OR ‘>=3.6,<4’; ie: either python 2.7 or else any python 3 release at or above 3.6. Now interpreter constraints are ORed, which is likely a breaking change if you have scripts that pass multiple interpreter constraints. To transition, use the native , AND operator in your constraint expression, as used in the example above.

  • Provide control over pex warning behavior. (#680) PR #680

  • OR interpreter constraints when multiple given (#678) Issue #655 PR #678

  • Pin isort version in CI (#679) PR #679

  • Honor PEX_IGNORE_RCFILES in to_python_interpreter() (#673) PR #673

  • Make run_pex_command more robust. (#670) PR #670

1.6.2

  • Support de-vendoring for installs. (#666) PR #666

  • Add User-Agent header when resolving via urllib (#663) PR #663

  • Fix interpreter finding (#662) PR #662

  • Add recipe to use PEX with requests module and proxies. (#659) PR #659

  • Allow pex to be invoked using runpy (python -m pex). (#637) PR #637

1.6.1

  • Make tox -evendor idempotent. (#651) PR #651

  • Fix invalid regex and escape sequences causing DeprecationWarning (#646) PR #646

  • Follow PEP 425 suggestions on distribution preference. (#640) PR #640

  • Setup interpreter extras in InstallerBase. (#635) PR #635

  • Ensure bootstrap demotion is complete. (#634) PR #634

1.6.0

  • Fix pex force local to handle PEP 420. (#613) PR #613

  • Vendor setuptools and wheel. (#624) PR #624

1.5.3

  • Fixup PEXEnvironment extras resolution. (#617) PR #617

  • Repair unhandled AttributeError during pex bootstrapping. (#599) PR #599

1.5.2

This release brings an exit code fix for pexes run via entrypoint as well as a fix for finding scripts when building pexes from wheels with dashes in their distribution name.

  • Update PyPI default URL to pypi.org (#610) PR #610

  • Pex exits with correct code when using entrypoint (#605) PR #605

  • Fix *_custom_setuptools_useable ITs. (#606) PR #606

  • Update pyenv if neccesary (#586) PR #586

  • Fix script search in wheels. (#600) PR #600

  • Small Docstring Fix (#595) PR #595

1.5.1

This release brings a fix to handle top-level requirements with environment markers, fully completing environment marker support.

  • Filter top-level requirements against env markers. (#592) PR #592

1.5.0

This release fixes pexes such that they fully support environment markers, the canonical use case being a python 2/3 pex that needs to conditionally load one or more python 2 backport libs when running under a python 2 interpreter only.

  • Revert “Revert “Support environment markers during pex activation. (#582)”” PR #582

1.4.9

This is a hotfix release for 1.4.8 that fixes a regression in interpreter setup that could lead to resolved distributions failing to build or install.

  • Cleanup PexInfo and PythonInterpreter. (#581) PR #581

  • Fix resolve regressions introduced by the 1.4.8. (#580) PR #580

  • Narrow the env marker test. (#578) PR #578

  • Documentation for #569 (#574) PR #574

1.4.8

This release adds support for -c and -m pexfile runtime options that emulate the behavior of the same arguments to python as well a fix for handling the non-standard platform reported by setuptools for Apple system interpreters in addition to several other bug fixes.

  • Fix PEXBuilder.clone. (#575) PR #575

  • Fix PEXEnvironment platform determination. (#568) PR #568

  • Apply more pinning to jupyter in IT. (#573) PR #573

  • Minimize interpreter bootstrapping in tests. (#571) PR #571

  • Introduce 3.7 to CI and release. (#567) PR #567

  • Add OSX shards. (#565) PR #565

  • Add support for -m and -c in interpreter mode. (#563) PR #563

  • Ignore concurrent-rename failures. (#558) PR #558

  • Fixup test_jupyter_appnope_env_markers. (#562) PR #562

1.4.7

This is a hotfix release for a regression in setuptools compatibility introduced by #542.

  • Fixup PEX.demote_bootstrap: fully unimport. (#554) PR #554

1.4.6

This release opens up setuptools support for more modern versions that support breaking changes in setup used in the wild.

  • Fix for super() usage on “old style class” ZipFile (#546) PR #546

  • Cleanup bootstrap dependencies before handoff. (#542) PR #542

  • Support -c for plat spec dists in multiplat pexes. (#545) PR #545

  • Support - when running as an interpreter. (#543) PR #543

  • Expand the range of supported setuptools. (#541) PR #541

  • Preserve perms of files copied to pex chroots. (#540) PR #540

  • Add more badges to README. (#535) PR #535

  • Fixup CHANGES PR links for 1.4.5.

1.4.5

This release adds support for validating pex entrypoints at build time in addition to several bugfixes.

  • Fix PEX environment setup. (#531) #531

  • Fix installers to be insensitive to extras iteration order. (#532) #532

  • Validate entry point at build time (#521) #521

  • Fix pex extraction perms. (#528) #528

  • Simplify .travis.yml. (#524) #524

  • Fix PythonInterpreter caching and ergonomics. (#518) #518

  • Add missing git dep. (#519) #519

  • Introduce a controlled env for pex testing. (#517) #517

  • Bump wheel version to latest. (#515) #515

  • Invoke test runner at a more granular level for pypy shard. (#513) #513

1.4.4

This release adds support for including sources and resources directly in a produced pex - without the need to use pants.

  • Add resource / source bundling to pex cli (#507) #507

1.4.3

Another bugfix release for the 1.4.x series.

  • Repair environmental marker platform setting. (#500) #500

  • Broaden abi selection for non-specified abi types. (#503) #503

1.4.2

This release repairs a tag matching regression for .egg dists that inadvertently went out in 1.4.1.

  • Improve tag generation for EggPackage. (#493) #493

1.4.1

A bugfix release for 1.4.x.

  • Repair abi prefixing for PyPy. (#483) #483

  • Repair .egg resolution for platform specific eggs. (#486) #486

  • Eliminate the python3.3 shard. (#488) #488

1.4.0

This release includes full Manylinux support, improvements to wheel resolution (including first class platform/abi tag targeting) and a handful of other improvements and bugfixes. Enjoy!

Special thanks to Dan Blanchard (@dan-blanchard) for seeding the initial PR for Manylinux support and wheel resolution improvements.

  • Complete manylinux support in pex. (#480) #480

  • Add manylinux wheel support and fix a few bugs along the way (#316) #316

  • Skip failing tests on pypy shard. (#478) #478

  • Bump travis image to Trusty. (#476) #476

  • Mock PATH for problematic interpreter selection test in CI (#474) #474

  • Skip two failing integration tests. (#472) #472

  • Better error handling for missing setuptools. (#471) #471

  • Add tracebacks to IntegResults. (#469) #469

  • Fix failing tests in master (#466) #466

  • Repair isort-check failure in master. (#465) #465

  • Repair style issues in master. (#464) #464

  • Fixup PATH handling in travis.yml. (#462) #462

1.3.2

  • Add blacklist handling for skipping requirements in pex resolver #457 #457

1.3.1

This is a bugfix release for a regression that inadvertently went out in 1.3.0.

  • scrub path when not inheriting (#449) #449

  • Fix up inherits_path tests to use new values (#450) #450

1.3.0

  • inherit_path allows ‘prefer’, ‘fallback’, ‘false’ (#444) #444

1.2.16

  • Change PEX re-exec variable from ENV to os.environ (#441) #441

1.2.15

  • Bugfix for entry point targeting + integration test (#435) #435

1.2.14

  • Add interpreter constraints option and use constraints to search for compatible interpreters at exec time (#427) #427

1.2.13

  • Fix handling of pre-release option. (#424) #424

  • Patch sys module using pex_path from PEX-INFO metadata (#421) #421

1.2.12

  • Create –pex-path argument for pex cli and load pex path into pex-info metadata (#417) #417

1.2.11

  • Leverage subprocess32 when available. (#411) #411

  • Kill support for python 2.6. (#408) #405 #408

1.2.10

  • Allow passing a preamble file to the CLI (#400) #400

1.2.9

  • Add first-class support for multi-interpreter and multi-platform pex construction. (#394) #394

1.2.8

  • Minimum setuptools version should be 20.3 (#391) #391

  • Improve wheel support in pex. (#388) #388

1.2.7

  • Sort keys in PEX-INFO file so the output is deterministic. (#384) #384

  • Pass platform for SourceTranslator (#386) #386

1.2.6

  • Fix for Ambiguous Resolvable bug in transitive dependency resolution (#367) #367

1.2.5

This release follows-up on 1.2.0 fixing bugs in the pre-release resolving code paths.

  • Resolving pre-release when explicitly requested (#372) #374

  • Pass allow_prerelease to other iterators (Static, Caching) (#373) #373

1.2.4

  • Fix bug in cached dependency resolution with exact resolvable. (#365) #365

  • Treat .pth injected paths as extras. (#370) #370

1.2.3

  • Follow redirects on HTTP requests (#361) #361

  • Fix corner case in cached dependency resolution (#362) #362

1.2.2

  • Fix CacheControl import. (#357) #357

1.2.1

This release is a quick fix for a bootstrapping bug that inadvertently went out in 1.2.0 (Issue #354).

  • Ensure packaging dependency is self-contained. (#355) #355 Fixes #354

1.2.0

This release changes pex requirement resolution behavior. Only stable requirements are resolved by default now. The previous behavior that included pre-releases can be retained by passing –pre on the pex command line or passing allow_prereleases=True via the API.

  • Upgrade dependencies to modern version ranges. (#352) #352

  • Add support for controlling prerelease resolution. (#350) #350 Fixes #28

1.1.20

  • Add dummy flush method for clean interpreter exit with python3.6 (#343) #343

1.1.19

  • Implement –constraints in pex (#335) #335

  • Make sure namespace packages (e.g. virtualenvwrapper) don’t break pex (#338) #338

1.1.18

  • Expose a PEX instance’s path. (#332) #332

  • Check for scripts directory in get_script_from_egg (#328) #328

1.1.17

  • Make PEX_PATH unify pex sources, as well as requirements. (#329) #329

1.1.16

  • Adjust FileFinder import to work with Python 3.6. (#318) #318

  • Kill zipmanifest monkeypatching. (#322) #322

  • Bump setuptools range to latest. (#323) #323

1.1.15

  • Fix #309 by deduplicating output of the distribution finder. (#310) #310

  • Update wheel dependency to >0.26.0. (#304) #304

1.1.14

  • Repair Executor error handling for other classes of IOError/OSError. (#292) #292

  • Fix bdist_pex –pex-args. (#285) #285

  • Inherit user site with –inherit-path. (#284) #284

1.1.13

  • Repair passing of stdio kwargs to PEX.run(). (#288) #288

1.1.12

  • Fix bdist_pex interpreter cache directory. (#286) #286

  • Normalize and edify subprocess execution. (#255) #255

  • Don’t ignore exit codes when using setuptools entry points. (#280) #280 Fixes #137

1.1.11

  • Update cache dir when bdist_pex.run is called directly. #278 Fixes #274

1.1.10

  • Improve failure modes for os.rename() as used in distribution caching. #271 Fixes #265

1.1.9

1.1.8

1.1.7

  • Add README and supported python versions to PyPI description. #258

  • Use open with utf-8 support. #231

  • Add –pex-root option. #206

1.1.6

This release is a quick fix for a regression that inadvertently went out in 1.1.5 (Issue #243).

  • Fix the bdist_pex setuptools command to work for python2. #246 Fixes #243

  • Upgrade pex dependencies on setuptools and wheel. #244 Fixes #238

1.1.5

  • Fix PEXBuilder.clone and thus bdist_pex --pex-args for --python and --python-shebang. #234 Fixes #233

  • Fix old pkg_resources egg version normalization. #227 Fixes #226

  • Fix the inherit_path handling. #224

  • Fix handling of bad distribution script names when used as the pex entrypoint. #221 Fixes #220

1.1.4

This release is a quick fix for a regression that inadvertently went out in 1.1.3 (Issue #216).

  • Add a test for the regression in FixedEggMetadata._zipinfo_name and revert the breaking commit. Fixes #216

1.1.3

This release includes an initial body of work towards Windows support, ABI tag support for CPython 2.x and a fix for version number normalization.

  • Add python 2.x abi tag support. #214 Fixes #213

  • Add .idea to .gitignore. #205

  • Don’t normalize version numbers as names. #204

  • More fixes for windows. #202

  • Fixes to get pex to work on windows. #198

1.1.2

  • Bump setuptools & wheel version pinning. #194

  • Unescape html in PageParser.href_match_to_url. #191

  • Memoize calls to Crawler.crawl() for performance win in find-links based resolution. #187

1.1.1

  • Fix infinite recursion when PEX_PYTHON points at a symlink. #182

  • Add /etc/pexrc to the list of pexrc locations to check. #183

  • Improve error messaging for platform constrained Untranslateable errors. #179

1.1.0

  • Add support for .pexrc files for influencing the pex environment. See the notes here. #128.

  • Bug fix: PEX_PROFILE_FILENAME and PEX_PROFILE_SORT were not respected. #154.

  • Adds the bdist_pex command to setuptools. #99.

  • Bug fix: We did not normalize package names in ResolvableSet, so it was possible to depend on sphinx and Sphinx-1.4a0.tar.gz and get two versions build and included into the pex. #147.

  • Adds a pex-identifying User-Agent. #101.

1.0.3

  • Bug fix: Accommodate OSX Python python binaries. Previously the OSX python distributions shipped with OSX, XCode and available via https://www.python.org/downloads/ could fail to be detected using the PythonInterpreter class. Fixes #144.

  • Bug fix: PEX_SCRIPT failed when the script was from a not-zip-safe egg. Original PR #139.

  • Bug fix: sys.exit called without arguments would cause None to be printed on stderr since pex 1.0.1. #143.

1.0.2

  • Bug fix: PEX-INFO values were overridden by environment Variables with default values that were not explicitly set in the environment. Fixes #135.

  • Bug fix: Since 69649c1 we have been unpatching the side-effects of sys.modules after PEX.execute. This takes all modules imported during the PEX lifecycle and sets all their attributes to None. Unfortunately, sys.excepthook, atexit and __del__ may still try to operate using these tainted modules, causing exceptions on interpreter teardown. This reverts just the sys unpatching so that the abovementioned teardown hooks behave more predictably. Fixes #141.

1.0.1

  • Allow PEXBuilder to optionally copy files into the PEX environment instead of hard-linking them.

  • Allow PEXBuilder to optionally skip precompilation of .py files into .pyc files.

  • Bug fix: PEXBuilder did not respect the target interpreter when compiling source to bytecode. Fixes #127.

  • Bug fix: Fix complex resolutions when using a cache. Fixes: #120.

1.0.0

The 1.0.0 release of pex introduces a few breaking changes: pex -r now takes requirements.txt files instead of requirement specs, pex -s has now been removed since source specs are accepted as arguments, and pex -p has been removed in favor of its alias pex -o.

The pex command line interface now adheres to semver insofar as backwards incompatible CLI changes will invoke a major version change. Any backwards incompatible changes to the PEX environment variable semantics will also result in a major version change. The pex API adheres to semver insofar as backwards incompatible API changes will invoke minor version changes.

For users of the PEX API, it is recommended to add minor version ranges, e.g. pex>=1.0,<1.1. For users of the PEX CLI, major version ranges such as pex>=1,<2 should be sufficient.

  • BREAKING CHANGE: Removes the -s option in favor of specifying directories directly as arguments to the pex command line.

  • BREAKING CHANGE: pex -r now takes requirements.txt filenames and not requirement specs. Requirement specs are now passed as arguments to the pex tool. Use -- to escape command line arguments passed to interpreters spawned by pex. Implements #5.

  • Adds a number of flag aliases to be more compatible with pip command lines: --no-index, -f, --find-links, --index-url, --no-use-wheel. Removes -p in favor of -o exclusively.

  • Adds --python-shebang option to the pex tool in order to set the #! shebang to an exact path. #53.

  • Adds support for PEX_PYTHON environment variable which will cause the pex file to reinvoke itself using the interpreter specified, e.g. PEX_PYTHON=python3.4 or PEX_PYTHON=/exact/path/to/interpreter. #27.

  • Adds support for PEX_PATH environment variable which allows merging of PEX environments at runtime. This can be used to inject plugins or entry_points or modules from one PEX into another without explicitly building them together. #30.

  • Consolidates documentation of PEX_ environment variables and adds the --help-variables option to the pex client. Partially addresses #13.

  • Adds helper method to dump a package subdirectory onto disk from within a zipped PEX file. This can be useful for applications that know they’re running within a PEX and would prefer some static assets dumped to disk instead of running as an unzipped PEX file. #12.

  • Now supports extras for static URLs and installable directories. #65.

  • Adds -m and --entry-point alias to the existing -e option for entry points in the pex tool to evoke the similarity to python -m.

  • Adds console script support via -c/--script/--console-script and PEX_SCRIPT. This allows you to reference the named entry point instead of the exact module:name pair. Also supports scripts defined in the scripts section of setup.py. #59.

  • Adds more debugging information when encountering unresolvable requirements. #79.

  • Bug fix: PEX_COVERAGE and PEX_PROFILE did not function correctly when SystemExit was raised. Fixes #81.

  • Bug fix: Fixes caching in the PEX tool since we don’t cache the source distributions of installable directories. #24.

0.9.0

This is the last release before the 1.0.0 development branch is started.

  • Change the setuptools range to >=2.2,<16 by handling EntryPoint changes as well as being flexible on whether pkg_resources is a package or a module. Fixes #55 and #34.

  • Adds option groups to the pex tool to make the help output slightly more readable.

  • Bug fix: Make pip install pex work better by removing extras_requires on the console_script entry point. Fixes #48

  • New feature: Adds an interpreter cache to the pex tool. If the user does not explicitly disable the wheel feature and attempts to build a pex with wheels but does not have the wheel package installed, pex will download it in order to make the feature work. Implements #47 in order to fix #48

0.8.6

  • Bug fix: Honor installed sys.excepthook in pex teardown. RB #1733

  • Bug fix: UrllibContext used replace as a keyword argument for bytes.decode but this only works on Python 3. Pull Request #46

0.8.5

  • Bug fix: Fixup string formatting in pex/bin/pex.py to support Python 2.6 Pull Request #40

0.8.4

  • Performance improvement: Speed up the best-case scenario of dependency resolution. RB #1685

  • Bug fix: Change from uuid4().get_hex() to uuid4().hex to maintain Python3 compatibility of pex.common. Pull Request #39

  • Bug fix: Actually cache the results of translation. Previously bdist translations would be created in a temporary directory even if a cache location was specified. RB #1666

  • Bug fix: Support all potential abi tag permutations when determining platform compatibility. Pull Request #33

0.8.3

  • Performance improvement: Don’t always write packages to disk if they’ve already been cached. This can significantly speed up launching PEX files with a large number of non-zip-safe dependencies. RB #1642

0.8.2

  • Bug fix: Allow pex 0.8.x to parse pex files produced by earlier versions of pex and twitter.common.python.

  • Pin pex to setuptools prior to 9.x until we have a chance to make changes related to PEP440 and the change of pkg_resources.py to a package.

0.8.1

  • Bug fix: Fix issue where it’d be possible to os.path.getmtime on a remote Link object Issue #29

0.8.0

  • API change: Decouple translation from package iteration. This removes the Obtainer construct entirely, which likely means if you’re using PEX as a library, you will need to change your code if you were doing anything nontrivial. This adds a couple new options to resolve but simplifies the story around how to cache packages. RB #785

  • Refactor http handling in pex to allow for alternate http implementations. Adds support for requests, improving both performance and security. For more information, read the commit notes at 91c7f32. RB #778

  • Improvements to API documentation throughout.

  • Renamed Tracer to TraceLogger to prevent nondeterministic isort ordering.

  • Refactor tox.ini to increase the number of environment combinations and improve coverage.

  • Adds HTTP retry support for the RequestsContext. RB #1303

  • Make pex –version correct. Issue #19

  • Bug fix: Fix over-aggressive sys.modules scrubbing for namespace packages. Under certain circumstances, namespace packages in site-packages could conflict with packages within a PEX, causing them to fail importing. RB #1378

  • Bug fix: Replace uses of os.unsetenv(...) with del os.environ[...] Pull Request #11

  • Bug fix: Scrub sys.path and sys.modules based upon both supplied path and realpath of files and directories. Newer versions of virtualenv on Linux symlink site-packages which caused those packages to not be removed from sys.path correctly. Issue #21

  • Bug fix: The pex -s option was not correctly pulling in transitive dependencies. Issue #22

  • Bug fix: Adds content method to HTTP contexts that does HTML content decoding, fixing an encoding issue only experienced when using Python 3. Issue #10

0.7.0

  • Rename twitter.common.python to pex and split out from the twitter/commons repo.

0.6.0

  • Change the interpretation of -i (and of PyPIFetcher’s pypi_base) to match pip’s -i. This is useful for compatibility with devpi.

0.5.10

  • Ensures that .egg/.whl distributions on disk have their mtime updated even though we no longer overwrite them. This gives them a new time lease against their ttl.

    Without this change, once a distribution aged past the ttl it would never be used again, and builds would re-create the same distributions in tmpdirs over and over again.

0.5.9

  • Fixes an issue where SourceTranslator would overwrite .egg/.whl distributions already on disk. Instead it should always check to see if a copy already exists and reuse if there.

    This ordinarily should not be a problem but the zipimporter caches metadata by filename instead of stat/sha, so if the underlying contents changed a runtime error would be thrown due to seemingly corrupt zip file offsets. RB #684

0.5.8

  • Adds -i/--index option to the pex tool.

0.5.7

  • Adds twitter.common.python.pex_bootstrap bootstrap_pex_env function in order to initialize a PEX environment from within a python interpreter. (Patch contributed by @kwlzn)

  • Adds stdin=,stdout=,stderr= keyword parameters to the PEX.run function. (Patch from @benjy)

0.5.6

  • The crawler now defaults to not follow links for security reasons. (Before the default behavior was to implicitly --follow-links for all requirements.) RB #293

0.5.5

  • Improves scrubbing of site-packages from PEX environments. RB #289

0.5.1 - 0.5.4

  • Silences exceptions reported during interpreter teardown (the exceptions resulting from incorrect atexit handler behavior) introduced by 0.4.3 RB #253 RB #249

  • Adds __hash__ to Link so that Packages are hashed correctly in twitter.common.python.resolver resolve

0.5.0

0.4.3

  • Adds twitter.common.python.finders which are additional finders for setuptools including: - find eggs within a .zip - find wheels within a directory - find wheels within a .zip RB #86

  • Adds a new Package abstraction by refactoring Link into Link and Package. RB #92

  • Adds support for PEP425 tagging necessary for wheel support. RB #87

  • Improves python environment isolation by correctly scrubbing namespace packages injected into module __path__ attributes by nspkg pth files. RB #116

  • Adds twitter.common.python.resolver resolve method that handles transitive dependency resolution better. This means that if the requirement futures==2.1.2 and an unqualified futures>=2 is pulled in transitively, our resolver will correctly resolve futures 2.1.2 instead of reporting a VersionConflict if any version newer than 2.1.2 is available. RB #129

  • Factors all twitter.common.python test helpers into twitter.common.python.testing RB #91

  • Bug fix: Fix OrderedSet atexit exceptions RB #147

  • Bug fix: Fix cross-device symlinking (patch from @benjy)

  • Bug fix: Raise a RuntimeError if we fail to write pkg_resources into a .pex RB #115

0.4.2

  • Upgrade to setuptools>=1

0.4.1

  • twitter.common.python is no longer a namespace package

0.4.0

  • Kill the egg distiller. We now delegate .egg generation to bdist_egg. RB #55

0.3.1

  • Short-circuit resolving a distribution if a local exact match is found. RB #47

  • Correctly patch the global pkg_resources WorkingSet for the lifetime of the Python interpreter. RB #52

  • Fixes a performance regression in setuptools build_zipmanifest Setuptools Issue #154 RB #53

0.3.0

  • Plumb through the --zip-safe, --always-write-cache, --ignore-errors and --inherit-path flags to the pex tool.

  • Delete the unused PythonDirWrapper code.

  • Split PEXEnvironment resolution into twitter.common.python.environment and deconflate WorkingSet/Environment state.

  • Removes the monkeypatched zipimporter in favor of keeping all eggs unzipped within PEX files. Refactors the PEX dependency cache in util.py

  • Adds interpreter detection for Jython and PyPy.

  • Dependency translation errors should be made uniform. (Patch from @johnsirois)

  • Adds PEX_PROFILE_ENTRIES to limit the number of entries reported when PEX_PROFILE is enabled. (Patch from @rgs_)

  • Bug fix: Several fixes to error handling in twitter.common.python.http (From Marc Abramowitz)

  • Bug fix: PEX should not always assume that $PATH was available. (Patch from @jamesbroadhead)

  • Bug fix: Filename should be part of the .pex cache key or else multiple identical versions will incorrectly resolve (Patch from @tc)

  • Bug fix: Executed entry points shouldn’t be forced to run in an environment with __future__ imports enabled. (Patch from @lawson_patrick)

  • Bug fix: Detect versionless egg links and fail fast. (Patch from @johnsirois.)

  • Bug fix: Handle setuptools>=2.1 correctly in the zipimport monkeypatch (Patch from @johnsirois.)

0.2.3

  • Bug fix: Fix handling of Fetchers with file:// urls.

0.2.2

  • Adds the pex tool as a standalone tool.

0.2.1

  • Bug fix: Bootstrapped twitter.common.python should declare twitter.common as a namespace package.

0.2.0

  • Make twitter.common.python fully standalone by consolidating external dependencies within twitter.common.python.common.

0.1.0

  • Initial published version of twitter.common.python.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pex-2.0.0.tar.gz (3.0 MB view details)

Uploaded Source

Built Distribution

pex-2.0.0-py2.py3-none-any.whl (2.2 MB view details)

Uploaded Python 2 Python 3

File details

Details for the file pex-2.0.0.tar.gz.

File metadata

  • Download URL: pex-2.0.0.tar.gz
  • Upload date:
  • Size: 3.0 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: Python-urllib/3.7

File hashes

Hashes for pex-2.0.0.tar.gz
Algorithm Hash digest
SHA256 003467e5aac1f2f49e7552a2a1170b17101a2b7036a87befed38ed96b2ba16e1
MD5 bc2bee88fa0cb454a03f2e38ef777fb8
BLAKE2b-256 8648250296c74ca7b5742b386474f1996570464645be2f3ee808bc92091eac26

See more details on using hashes here.

File details

Details for the file pex-2.0.0-py2.py3-none-any.whl.

File metadata

  • Download URL: pex-2.0.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 2.2 MB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: Python-urllib/3.7

File hashes

Hashes for pex-2.0.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 4797aa4cb6ce1a6c6ce2bb64c07e6b7819d09851faf123779e29c5294a7f30a7
MD5 95fe551519e127d75e354ac9935972c0
BLAKE2b-256 b79c3e3f9d10c2ebf2dd8314a0221cfb0499ce09bf0ee2a5bf104ff9d1d68731

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page