Skip to main content

Virtual Python Environment builder

Project description

Status and License

virtualenv is a successor to workingenv, and an extension of virtual-python.

It is written by Ian Bicking, and sponsored by the Open Planning Project.

It is licensed under an MIT-style permissive license.

You can install it with easy_install virtualenv, or from the subversion repository with easy_install virtualenv==dev.

What It Does

virtualenv is a tool to create isolated Python environments.

The basic problem being addressed is one of dependencies and versions, and indirectly permissions. Imagine you have an application that needs version 1 of LibFoo, but another application requires version 2. How can you use both these applications? If you install everything into /usr/lib/python2.4/site-packages (or whatever your platform’s standard location is), it’s easy to end up in a situation where you unintentionally upgrade an application that shouldn’t be upgraded.

Or more generally, what if you want to install an application and leave it be? If an application works, any change in its libraries or the versions of those libraries can break the application.

Also, what if you can’t install packages into the global site-packages directory? For instance, on a shared host.

In all these cases, virtualenv can help you. It creates an environment that has its own installation directories, that doesn’t share libraries with other virtualenv environments (and optionally doesn’t use the globally installed libraries either).

The basic usage is:

$ python virtualenv.py ENV

This creates ENV/lib/python2.4/site-packages (or ENV/lib/python2.5/site-packages on Python 2.5, etc), where any libraries you install will go. It also creates ENV/bin/python, which is a Python interpreter that uses this environment. Anytime you use that interpreter (including when a script has #!/path/to/ENV/bin/python in it) the libraries in that environment will be used.

It also installs Setuptools for you, and if you use ENV/bin/easy_install the packages will be installed into the environment.

Creating Your Own Bootstrap Scripts

While this creates an environment, it doesn’t put anything into the environment. Developers may find it useful to distribute a script that sets up a particular environment, for example a script that installs a particular web application.

To create a script like this, call virtualenv.create_bootstrap_script(extra_text), and write the result to your new bootstrapping script. Here’s the documentation from the docstring:

Creates a bootstrap script, which is like this script but with extend_parser, adjust_options, and after_install hooks.

This returns a string that (written to disk of course) can be used as a bootstrap script with your own customizations. The script will be the standard virtualenv.py script, with your extra text added (your extra text should be Python code).

If you include these functions, they will be called:

extend_parser(optparse_parser):

You can add or remove options from the parser here.

adjust_options(options, args):

You can change options here, or change the args (if you accept different kinds of arguments, be sure you modify args so it is only [DEST_DIR]).

after_install(options, home_dir):

After everything is installed, this function is called. This is probably the function you are most likely to use. An example would be:

def after_install(options, home_dir):
    subprocess.call([join(home_dir, 'bin', 'easy_install'),
                     'MyPackage'])
    subprocess.call([join(home_dir, 'bin', 'my-package-script'),
                     'setup', home_dir])

This example immediately installs a package, and runs a setup script from that package.

Bootstrap Example

Here’s a more concrete example of how you could use this:

import virtualenv, textwrap
output = virtualenv.create_bootstrap_script(textwrap.dedent("""
import os, subprocess
def after_install(options, home_dir):
    etc = join(home_dir, 'etc')
    if not os.path.exists(etc):
        os.makedirs(etc)
    subprocess.call([join(home_dir, 'bin', 'easy_install'),
                     'BlogApplication'])
    subprocess.call([join(home_dir, 'bin', 'paster'),
                     'make-config', 'BlogApplication',
                     join(etc, 'blog.ini')])
    subprocess.call([join(home_dir, 'bin', 'paster'),
                     'setup-app', join(etc, 'blog.ini')])
"""))
f = open('blog-bootstrap.py', 'w').write(output)

Compare & Contrast with Alternatives

There are several alternatives that create isolated environments:

  • workingenv (which I do not suggest you use anymore if virtualenv works on your platform) is the predecessor to this library. It used the main Python interpreter, but relied on setting $PYTHONPATH to activate the environment. This causes problems when running Python scripts that aren’t part of the environment (e.g., a globally installed hg or bzr). It also conflicted a lot with Setuptools.

  • virtual-python is also a predecessor to this library. It uses only symlinks, so it couldn’t work on Windows. It also symlinks over the entire standard library and global site-packages. As a result, it won’t see new additions to the global site-packages.

    This script only symlinks a small portion of the standard library into the environment, and so Windows it is feasible to simply copy these files over. Also, it creates a new/empty site-packages and also adds the global site-packages to the path, so updates are tracked separately. This script also installs Setuptools automatically, saving a step and avoiding the need for network access.

  • zc.buildout doesn’t create an isolated Python environment in the same style, but achieves similar results through a declarative config file that sets up scripts with very particular packages. As a declarative system, it is somewhat easier to repeat and manage, but more difficult to experiment with. zc.buildout includes the ability to setup non-Python systems (e.g., a database server or an Apache instance).

I strongly recommend anyone doing application development or deployment use one of these tools.

Changes & News

0.9

  • Added lib-dynload and config to things that need to be copied over in an environment.

  • Copy over or symlink the include directory, so that you can build packages that need the C headers.

  • Include a distutils package, so you can locally update distutils.cfg (in lib/pythonX.Y/distutils/distutils.cfg).

  • Better avoid downloading Setuptools, and hitting PyPI on environment creation.

  • Fix a problem creating a lib64/ directory.

  • Should work on MacOSX Framework builds (the default Python installations on Mac). From Ronald Oussoren.

0.8.4

  • Windows installs would sometimes give errors about sys.prefix that were inaccurate.

  • Slightly prettier output.

0.8.3

  • Added support for Windows.

0.8.2

  • Give a better warning if you are on an unsupported platform (Mac Framework Pythons, and Windows).

  • Give error about running while inside a workingenv.

  • Give better error message about Python 2.3.

0.8.1

Fixed packaging of the library.

0.8

Initial release. Everything is changed and new!

Project details


Release history Release notifications | RSS feed

This version

0.9

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

virtualenv-0.9.tar.gz (677.5 kB view details)

Uploaded Source

Built Distributions

virtualenv-0.9-py2.5.egg (363.0 kB view details)

Uploaded Source

virtualenv-0.9-py2.4.egg (367.5 kB view details)

Uploaded Source

File details

Details for the file virtualenv-0.9.tar.gz.

File metadata

  • Download URL: virtualenv-0.9.tar.gz
  • Upload date:
  • Size: 677.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for virtualenv-0.9.tar.gz
Algorithm Hash digest
SHA256 f2a916c648cf705a68b7fc7a87c7803cb1c162bb0269aa7ca096783d3b26c69b
MD5 17a52f8801cbeb6805f4a4650dc89468
BLAKE2b-256 787550c0b8e087506bb737355e9b39812ea192c820bc5338cfdce6870480dddf

See more details on using hashes here.

Provenance

File details

Details for the file virtualenv-0.9-py2.5.egg.

File metadata

  • Download URL: virtualenv-0.9-py2.5.egg
  • Upload date:
  • Size: 363.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for virtualenv-0.9-py2.5.egg
Algorithm Hash digest
SHA256 352abf8575dc24516e51c67e756fcc197e67a42e2fe3990ccbaebc9df6f201d0
MD5 7c8e85680f1ede0844a496513366d7a5
BLAKE2b-256 0b790feb894d3e7e20f86eb0225e11f4ee91418c5d9cadd4c69b093908f0054f

See more details on using hashes here.

Provenance

File details

Details for the file virtualenv-0.9-py2.4.egg.

File metadata

  • Download URL: virtualenv-0.9-py2.4.egg
  • Upload date:
  • Size: 367.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for virtualenv-0.9-py2.4.egg
Algorithm Hash digest
SHA256 eb1fad4ca7be1c91b8a2627666f65421f1931f138e901bde40fb7ebdb050a7ec
MD5 12b34ae909f578910c293ecfe7c793e3
BLAKE2b-256 49da6f20ded5ca672531b4a0043bacc069920ba404861929063a9d442a76c96f

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page