stdeb 0.10.0

Python 3 support

As explained in more detail below, the heart of stdeb is the sdist_dsc distutils command. This command runs once to generate a Debian source package. This Debian source package can specify building packages for Python 2, Python 3, or both. Furthermore, this generation can be done with the Python 2 or Python 3 interpreter. By default, only packages are built for the version of Python being used. To override this, use --with-python2=True or --with-python3=True as an argument to the sdist_dsc distutils command (or use both to be sure). For example, to build only a Python 3 package using the Python 3 interpreter:

python3 setup.py --command-packages=stdeb.command bdist_deb

To build both Python 2 and Python 3 packages using the Python 3 interpreter (and only the Python3 package installs scripts):

python3 setup.py --command-packages=stdeb.command sdist_dsc --with-python2=True --with-python3=True --no-python2-scripts=True bdist_deb

News

• 2020-10-28: Version 0.10.0. See the download page.

• Bugfixes:

  • add sleep between PyPI API calls to avoid rate limit (#173)

• Improvements:

  • use SOURCE_DATE_EPOCH if set for timestamp in generated changelog to generate reproducbile artifacts (#166)

  • update debhelper compat version from 7 to 9 (#158)

  • added flag –with-dh-systemd (#162)

  • add support for DEBEMAIL envvar (#168)

  • use setuptools “url” field for “Homepage” field in debian/control (#169)

  • dh_virtualenv: specify Python version (#165)

  • added compat flag to modify Debian compatibility level (#163)

• Cosmetic: * remove excess newlines from debian/control and rules file (#167) * use flake8 to check style in Travis CI, update code to comply (#171)

• 2020-06-11: Version 0.9.1. See the download page.

• Bugfixes:

  • handle path with spaces in zip tarball (#150)

  • fix map() iterator issue in Python 3 (#152)

  • fix checking for python3-all (instead of python-all) when using only Python 3 (#154)

• Improvements:

  • get date in Python, avoiding requiring date on macOS (#115)

  • add configuration file option Python2-Depends-Name (#156)

  • add an option --with-dh-virtualenv (#155)

  • add an option named ignore-source-changes (#151)

• 2019-12-09: Version 0.9.0. See the download page.

• Bugfixes:

  • fix applying patch files under Python 3

• Improvements:

  • add --sign-results to sdist_dsc and bdist_deb command

  • add --debian-version to CLI program options

  • add support for Breaks / Breaks3 in debian/control

  • add support for Suite3 option

  • support zip files in pypi-install

• Breaking changes:

  • remove deprecated dh_desktop call

• 2015-02-18: Version 0.8.5. See the download page. Bugfixes: reverted change that installed into virtualenv when built in virtualenv. Improvements: Added –allow-virtualenv-install-location to allow installing into virtualenv location. Supports Debian Squeeze (6), Debian Wheezy (7), Ubuntu Precise (12.04), Ubuntu Trusty (14.04) and later releases.

• 2015-02-16: Version 0.8.4. See the download page. Bugfixes: works on Python 3.4 (e.g. Ubuntu Trusty) again. Improvements: Improved customization for Python 3 (Dirk Thomas added force-x-python3-version and X-Python3-Version and Louis for Recommends3, Suggests3, Provides3 and Replaces3 support. Supports Debian Squeeze (6), Debian Wheezy (7), Ubuntu Precise (12.04), Ubuntu Trusty (14.04) and later releases.

• 2015-02-14: Version 0.8.3. See the download page. This is a bugfix release which fixes several aspects of Unicode support. Tests pass on Debian Squeeze (6), Debian Wheezy (7), and Ubuntu Precise (12.04). Support for Python 3.4 (e.g. Ubuntu Trusty 14.04) was mistakenly broken and was fixed in the 0.8.3 release.

• 2014-8-14: Version 0.8.2. See the download page. This is a bugfix release fixing a serious issue that would cause a Python 2 package to be built if only a Python 3 package was requested in some circumstances.

• 2014-8-10: Version 0.8.1. See the download page. Due to bugs in 0.8.0, this release is the first announced from the 0.8 series. Highlights since 0.7.1:

  • Full support for Python 3. This includes being run from Python 3 and generating packages for Python 3. The default is to build Python 3 packages when run with Python 3 and to build Python 2 packages when run from Python 2. Command line options can be used to build packages for the other Python interpreter, too.

  • Build .changes file for source package. While this still must be signed for upload to a PPA, for example, it should still be useful in some cases.

  • Switch to Debian source format 3.0 (quilt). Practically speaking, the .diff.gz file that used to come with a source package is now replaced by a .debian.tar.gz file.

  • Verify SSL certificates when talking to PyPI using Requests. (Verification requires Requests >= 0.8.8.)

  • Many bugfixes.

• 2014-05-05: Version 0.7.1. See the download page. Highlights for this release (you may also wish to consult the full changelog). Due to bugs in 0.7.0, this release is the first announced from the 0.7 series. Highlights since 0.6.0:

  • New commands: pypi-download and pypi-install to directly download and install packages from PyPI, respectively. py2dsc-deb directly creates a .deb file from a source tarball.

  • New distutils command: install_deb lets you directly install a python package as a standard system package.

  • Many bugfixes, including the new URL for PyPI.

  • Automated runs of test suite, thanks to Travis CI

  • Thanks to many, especially Piotr Ożarowski for help with stdeb.

• 2010-06-18: Version 0.6.0. See the download page. Highlights for this release (you may also wish to consult the full changelog):

  • A new debianize command to build a debian/ directory alongside your setup.py file.

  • Bugfixes.

• 2010-01-09: Version 0.5.1. Bugfix release. See the download page, the changelog and release notes.

• 2009-12-30: Version 0.5.0. See the download page. Highlights for this release (you may also wish to consult the full changelog):

  • A new pypi-install script will automatically download, make a .deb, and install packages from the Python Package Index (PyPI).

  • Removal of the setuptools dependency.

  • New option (–guess-conflicts-provides-replaces) to query original Debian packages for Conflicts/Provides/Replaces information.

  • As a result of these changes and to fix a couple bugs/warts, some minor backwards incompatible changes and deprecations were made. Please check the release notes.

• 2009-12-28: Version 0.4.3 Released. See the download page. See the changelog and release notes.

• 2009-11-02: Version 0.4.2 Released. See the download page. See the changelog and release notes.

• 2009-10-04: Version 0.4.1 Released. See the download page. See the changelog and release notes.

• 2009-09-27: Version 0.4 Released. See the download page. This version switches to debhelper 7. See the Changelog for 0.4.

Releases up to and including 0.3.2 are compatible with Ubuntu Hardy.

• 2009-10-04: Version 0.3.2 Released. See the download page. See the Changelog for 0.3.2

• 2009-09-27: Version 0.3.1 Released. See the download page. See the Changelog for 0.3.1

• 2009-03-21: Version 0.3 Released. See the download page. See the Changelog for 0.3

• 2009-02-17: Version 0.2.3 Released. See the download page. See the Changelog for 0.2.3

• 2009-01-29: Version 0.2.2 Released. See the download page. See the Changelog for 0.2.2

• 2008-04-26: Version 0.2.1 Released. See the download page. See the Changelog for 0.2.1

• 2008-04-26: Version 0.2 Released. See the download page. See the Changelog for 0.2

• 2007-04-02: Version 0.2.a1 Released. See the old download page.

• 2006-06-19: Version 0.1 Released. See the old download page.

The commands

pypi-download [options] mypackage

pypi-install [options] mypackage

py2dsc [options] mypackage-0.1.tar.gz # uses pre-built Python source package

py2dsc-deb [options] mypackage-0.1.tar.gz # uses pre-built Python source package

python setup.py --command-packages=stdeb.command sdist_dsc

python setup.py --command-packages=stdeb.command bdist_deb

sudo python setup.py --command-packages=stdeb.command install_deb

python setup.py --command-packages=stdeb.command debianize

[global]
command-packages: stdeb.command

Examples

These all assume you have stdeb installed in your system Python path. stdeb also works from a non-system Python path (e.g. a virtualenv).

pypi-install mypackage

python setup.py --command-packages=stdeb.command bdist_deb

wget http://pypi.python.org/packages/source/R/Reindent/Reindent-0.1.0.tar.gz
py2dsc Reindent-0.1.0.tar.gz

cd deb_dist/reindent-0.1.0/
dpkg-buildpackage -rfakeroot -uc -us

cd ..
sudo dpkg -i python-reindent_0.1.0-1_all.deb

python setup.py --command-packages=stdeb.command install_deb

wget http://pypi.python.org/packages/source/R/Reindent/Reindent-0.1.0.tar.gz
tar xzf Reindent-0.1.0.tar.gz
cd Reindent-0.1.0

python setup.py --command-packages=stdeb.command sdist_dsc

cd deb_dist/reindent-0.1.0
dpkg-buildpackage -rfakeroot -uc -us

cd ..
sudo dpkg -i python-reindent_0.1.0-1_all.deb

Download

Files are available at the download page (for ancient releases, see the old download page).

The git repository is available at http://github.com/astraw/stdeb

Install (or, using stdeb to create an stdeb installer)

For a bit of fun, here’s how to install stdeb using stdeb. Note that stdeb is also in Debian and Ubuntu, so this recipe is only necessary to install a more recent stdeb.

STDEB_VERSION="0.10.0"

# Download stdeb
wget http://pypi.python.org/packages/source/s/stdeb/stdeb-$STDEB_VERSION.tar.gz

# Extract it
tar xzf stdeb-$STDEB_VERSION.tar.gz

# Enter extracted source package
cd stdeb-$STDEB_VERSION

# Build .deb (making use of stdeb package directory in sys.path).
python setup.py --command-packages=stdeb.command bdist_deb

# Install it
sudo dpkg -i deb_dist/python-stdeb_$STDEB_VERSION-1_all.deb

Background

For the average Python package, its source distribution (python_package.tar.gz created with python setup.py sdist) contains nearly everything necessary to make a Debian source package. This near-equivalence encouraged me to write this distutils extension, which executes the setup.py file to extract relevant information. setuptools may optionally be used.

I wrote this initially to Debianize several Python packages of my own, but I have the feeling it could be generally useful. It appears similar, at least in theory, to easydeb, Logilab’s Devtools, bdist_dpkg, bdist_deb, pkgme and dh-virtualenv.

Features

• Create a package for all Python versions supported by python-support. (Limiting this range is possible with the XS-Python-Version: config option.)

• Automatic conversion of Python package names into valid Debian package names.

• Attempt to automatically convert version numbers such that ordering is maintained. See also the config option Forced-Upstream-Version.

• Fine grained control of version numbers. (Debian-Version, Forced-Upstream-Version, Upstream-Version-Prefix, Upstream-Version-Suffix config options.)

• Install .desktop files. (MIME-Desktop-Files config option.)

• Install .mime and .sharedmimeinfo files. (MIME-File and Shared-MIME-File config options.)

• Install copyright files. (Copyright-File config option.)

• Apply patches to upstream sources. (Stdeb-Patch-File config option.)

• Pass environment variables to setup.py script. (Setup-Env-Vars config option.)

Customizing the produced Debian source package (config options)

stdeb will attempt to provide reasonable defaults, but these are only guesses.

There are two ways to customize the Debian source package produced by stdeb. First, you may provide options to the distutils commands. Second, you may provide an stdeb.cfg file.

python setup.py --command-packages=stdeb.command sdist_dsc --debian-version 0MyName1

[sdist_dsc]
debian-version: 0MyName1

python setup.py sdist_dsc --debian-version 0MyName1 bdist_deb

[DEFAULT]
Depends: python-numpy
XS-Python-Version: >= 2.6

Reproducible builds

By default stdeb uses the current time for the the timestamp in the generated changelog file. This results in a non-reproducible build since every invocation generates a different changelog / .deb. The environment variable SOURCE_DATE_EPOCH can be set to a fixed timestamp (e.g. when the version was tagged or of the last commit was made) which will be used in the changelog instead. This will ensure that the produced .deb is reproducible on repeated invocations.

For more information about reproducible builds and this specific environment variable please see https://reproducible-builds.org/docs/source-date-epoch/

Prerequisites

• Python 2.7 or Python 3.x

• Standard Debian utilities such as date, dpkg-source and Debhelper 7 (use stdeb 0.3.x if you need to support older distributions without dh7)

• If your setup.py uses the setuptools features setup_requires or install_requires, you must run apt-file update prior to running any stdeb command.

TODO

• Make output meet Debian Python Policy specifications or the new python policy. This will include several things, among which are:

  • the ability to make custom changelogs

  • the ability to include project-supplied documentation as a -doc package

  • include license information in debian/copyright

  • the ability to include project-supplied examples, tests, and data as a separate package

  • much more not listed

• Create (better) documentation

• Log output using standard distutils mechanisms

• Refactor the source code to have a simpler, more sane design

Call for volunteers

I don’t have a lot of time for this. This project stands a very real chance of being only a shadow of its potential self unless people step up and contribute. There are numerous ways in which people could help. In particular, I’d be interested in finding a co-maintainer or maintainer if the project generates any interest. Secondarily, I would appreciate advice from Debian developers or Ubuntu MOTUs about the arcane details of Python packaging.

Mailing list

Please address all questions to the distutils-SIG

License

MIT-style license. Copyright (c) 2006-2015 stdeb authors.

See the LICENSE.txt file provided with the source distribution for full details.

Authors

• Andrew Straw <strawman@astraw.com>

• Pedro Algarvio, aka, s0undt3ch <ufs@ufsoft.org>

• Gerry Reno (initial bdist_deb implementation)

Additional Credits

• Zooko O’Whielacronx for the autofind-depends patch.

• Brett (last name unknown) for the –ignore-install-requires patch.

• Ximin Luo for a bug fix.

• Alexander D. Sedov for bug fixes and suggestions.

• Michele Mattioni for bug fix.

• Alexander V. Nikolaev for the debhelper buildsystem specification.

• Roland Sommer for the description field bugfix.

• Barry Warsaw for suggesting the debianize command.

• Asheesh Laroia for updating the PyPI URL.

• Piotr Ożarowski for implementing dh_python2 support.

• Nikita Burtsev for unicode tests and fixes

• Mikołaj Siedlarek for a bugfix

• Dirk Thomas for –force-x-python3-version and X-Python3-Version

• Louis for Recommends3, Suggests3, Provides3 and Replaces3 support

• kzwin for interop with virtualenv

• GitHub for hosting services.

• WebFaction (aka python-hosting) for previous hosting services.

• TravisCI for continuous integration