devpi-builder 5.1.0

Brandon by Example

Given a requirements.txt, we can upload all listed packages to the index opensource/Debian_7 on a local devpi using the following command:

$ devpi-builder requirements.txt http://localhost:3141/opensource/Debian_7

Example of such a requirements.txt:

progressbar==0.2.2
progressbar==0.2.1
PyYAML==3.11

Commandline Usage

usage: devpi-builder [-h] [--batch] [--user USER] [--password PASSWORD]
                    [--blacklist BLACKLIST] [--pure-index PURE_INDEX]
                    [--junit-xml JUNIT_XML] [--run-id RUN_ID] [--dry-run]
                    [--client-cert CLIENT_CERT]
                    requirements index

Create wheels for all given project versions and upload them to the given
index.

positional arguments:
requirements          requirements.txt style file specifying which project
                        versions to package.
index                 The index to upload the packaged software to.

optional arguments:
-h, --help            show this help message and exit
--batch               Batch mode. Do not prompt for credentials
--user USER           The user to log in as.
--password PASSWORD   Password of the user.
--blacklist BLACKLIST
                        Packages matched by this requirements.txt style file
                        will never be build.
--pure-index PURE_INDEX
                        The index to use for pure packages. Any non-pure
                        package will be uploaded to the index given as
                        positional argument. Packages already found in the
                        pure index will not be built, either.
--junit-xml JUNIT_XML
                        Write information about the build success / failure to
                        a JUnit-compatible XML file.
--run-id RUN_ID       Add the given string to all entries in the XML output,
                        allowing to distinguish output from multiple runs in a
                        merged XML.
--dry-run             Build missing wheels, but do not modify the state of
                        the devpi server.
--client-cert CLIENT_CERT
                        Client key to use to authenticate with the devpi
                        server.

The following environment variables can be used instead of command line arguments:

DEVPI_USER

The value of this environment variable will be used if --user is not given.

DEVPI_PASSWORD

The value of this environment variable will be used if --password is not given.

Features

• Read a requirements.txt style input file.

• Read user/pass from the environment (using DEVPI_USER and DEVPI_PASSWORD).

• Support multiple versions of a package in the same file.

• Only build packages not yet in the target index.

• Support a black-list for packages to never be built and uploaded (certain packages like numpy are fragile regarding their interdependency with other packages).

• Can use separate indices for plain python packages and those with binary contents.

• Can log build results to a JUnit compatible XML file, thus that it can be parsed by Jenkins.

License

New BSD

Version 5.1.0 — 2021-11-05

Added

• Provide compatibility with pip 21.3 and above which drops the –build-directory option. Pip has been using a temporary directory for builds since version 1.2 so manual handling of this directory should not be necessary anymore.

Version 5.0.1 – 2020-09-09

Fixed

• Adhere to case-insensivity when comparing package names. This will lead to blacklisting ‘cython’ vs. ‘Cython’ being the same thing.

Version 5.0.0 – 2020-04-24

Version 4.0.0 – 2018-11-02

Version 3.0.1 — 2017-11-21

Fixed

• Properly handle non-ASCII characters in the output of failed package builds. Previous versions used to crash in this case if a JUnit XML output file was requested.

Version 3.0.0 — 2017-06-16

Version 2.3.1 — 2017-05-19

Changed

• Improved performance if a blacklist is used.

Version 2.3.0 — 2017-04-07

Version 2.2.0 — 2016-05-23

Added

• Capture build errors for better output in case of build failures. Thanks Travis Mehlinger.

Version 2.1.0 — 2016-04-22

Added

• Support for client certificates. Thanks Hans Lawrenz.

Version 2.0.0 — 2016-01-20

Version 1.0.0 — 2015-05-22

Changed

• Use devpi-plumber instead of a custom devpi wrapper.

• Check the blacklist first when deciding whether to build a package.

Version 0.4.0 — 2015-09-13

Version 0.3.0 — 2015-08-15

Added

• Support for special-case handling of pure python wheels

• Optional support for reporting skipped packages in a JUnit-compatible XML

• Python 3 support

Version 0.2.1 — 2014-08-07

Fixed

• Fixed crash if a built wheel could cannot be found (because pip<=1.5.2 skipped it).

Version 0.2.0 — 2014-08-01

Version 0.1.0 — 2014-08-01

Added

• Build a list of packages and upload them to a Devpi index