mr.developer

A zc.buildout extension to ease the development of large projects with lots of packages.

These details have been verified by PyPI

Maintainers

fschulze maurits stefanholek tomster witsch

These details have not been verified by PyPI

Project links

Homepage

Project description

Introduction

http://www.netsight.co.uk/junk/xkcd-buildout.png — Let Mr. Developer help you win the everlasting buildout battle!

(Remixed by Matt Hamilton, original from http://xkcd.com/303)

mr.developer is a zc.buildout extension which makes it easier to work with buildouts containing lots of packages of which you only want to develop some. The basic idea for this comes from Wichert Akkerman’s plonenext effort.

Usage

You add mr.developer to the extensions option of your [buildout] section. Then you can add the following options to your [buildout] section:

sources-dir

This specifies the default directory where your development packages will be placed. Defaults to src.

sources

This specifies the name of a section which lists the repository information of your packages. Defaults to sources.

auto-checkout

This specifies the names of packages which should be checked out during buildout, packages already checked out are skipped. You can use * as a wild card for all packages in sources.

always-checkout

This defaults to false. If it’s true, then all packages specified by auto-checkout and currently in develop mode are updated during the buildout run. If set to force, then packages are updated even when they are dirty instead of asking interactively.

The format of the section with the repository information is:

<name> = <kind> [key=value] <url> [path] [key=value]

The different parts have the following meaning:

<name>

This is the package name.

<kind>

The kind of repository. Currently supported are one of svn (>= 1.5), hg, git, cvs or fs.

<url>

The location of the repository. This value is specific to the version control system used.

[path]

Important

This is replaced by path=PATH syntax.

The (optional) base directory where the package will be checked out.

The name of the package will be appended.

If it’s not set, then sources-dir will be used.

[key=value]

You can add options for each individual package with this. There are is no whitespace allowed in key, value and around the equal sign. For a description of the options see below.

The different repository kinds accept some specific options.

Common options

The path option allows you to set the base directory where the package will be checked out. The name of the package will be appended to the base path.

With full-path you can set the directory where the package will be checked out. This is the actual destination, nothing will be added.

The update option allows you to specify whether a package will be updated during buildout or not. If it’s true, then it will always be updated. If it’s false, then it will never be updated, even if the global always-checkout option is set.

The egg option makes it possible to manage packages which are not eggs with egg=false. All commands like update work as expected, but the package isn’t added to the develop buildout option and the activate and deactivate commands skip the package.

svn

The <url> is one of the urls supported by subversion.

You can specify a url with a revision pin, like http://example.com/trunk@123.

You can also set the rev or revision option, which is either a pin like with rev=123 or a minimum revision like rev=>123 or rev=>=123. When you set a minimum revision, the repository is updated when the current revision is lower.

git

Currently no additional options.

hg

Currently no additional options.

cvs

cvs_root option can be used to override the setting of the $CVSROOT environment variable. tag option force checkout/update of given tag instead of CVS HEAD.

fs

This allows you to add packages on the filesystem without a version control system, or with an unsupported one. You can activate and deactivate packages, but you don’t get status info and can’t update etc.

The <url> needs to be the same as the <name> of the package.

The following is an example of how your buildout.cfg may look like:

[buildout]
...
extensions = mr.developer
sources = sources
auto-checkout = my.package

[sources]
my.package = svn http://example.com/svn/my.package/trunk
some.other.package = git git://example.com/git/some.other.package.git

When you run buildout, you will get a script at bin/develop in your buildout directory. With that script you can perform various actions on the packages, like checking out the source code, without the need to know where the repository is located.

For help on what the script can do, run bin/develop help.

If you checked out the source code of a package, you need run buildout again. The package will automatically be marked as an develop egg and, if it’s listed in the section specified by the versions option in the [buildout] section, the version will be cleared, so the develop egg will actually be used. You can control the list of develop eggs explicitely with the activate and deactivate commands of bin/develop.

Troubleshooting

Dirty SVN

You get an error like:

ERROR: Can't switch package 'foo' from 'https://example.com/svn/foo/trunk/', because it's dirty.

If you have not modified the package files under src/foo, then you can check what’s going on with status -v. One common cause is a *.egg-info folder which gets generated every time you run buildout and this shows up as an untracked item in svn status.

You should add .egg-info to your global Subversion ignores in ~/.subversion/config, like this:

global-ignores = *.o *.lo *.la *.al .libs *.so *.so.[0-9]* *.a *.pyc *.pyo *.rej *~ #*# .#* .*.swp .DS_Store *.egg-info

HTTPS certificates

The best way to handle https certificates at the moment, is to accept them permanently when checking out the source manually.

Commands

The following is a list of all commands and their options.

activate (a)

Usage: develop activate [options] [<package-regexps>]

Add package to the list of development packages.
Options:
  -h, --help           show this help message and exit
  -a, --auto-checkout  Only considers packages declared by auto-checkout. If
                       you don't specify a <package-regexps> then all declared
                       packages are processed.
  -c, --checked-out    Only considers packages currently checked out. If you
                       don't specify a <package-regexps> then all checked out
                       packages are processed.
  -d, --develop        Only considers packages currently in development mode.
                       If you don't specify a <package-regexps> then all
                       develop packages are processed.

checkout (co)

Usage: develop checkout [options] <package-regexps>

Make a checkout of the packages matching the regular expressions and add them
to the list of development packages.
Options:
  -h, --help           show this help message and exit
  -a, --auto-checkout  Only considers packages declared by auto-checkout. If
                       you don't specify a <package-regexps> then all declared
                       packages are processed.
  -v, --verbose        Show output of VCS command.

deactivate (d)

Usage: develop deactivate [options] <package-regexps>

Remove package from the list of development packages.
Options:
  -h, --help           show this help message and exit
  -a, --auto-checkout  Only considers packages declared by auto-checkout. If
                       you don't specify a <package-regexps> then all declared
                       packages are processed.
  -c, --checked-out    Only considers packages currently checked out. If you
                       don't specify a <package-regexps> then all checked out
                       packages are processed.
  -d, --develop        Only considers packages currently in development mode.
                       If you don't specify a <package-regexps> then all
                       develop packages are processed.

help (h)

Usage: develop help [options] [<command>]

Show help on the given command or about the whole script if none given.
Options:
  -h, --help  show this help message and exit
  --rst       Print help for all commands in reStructuredText format.

info

Usage: develop info [options] [<package-regexps>]

Lists informations about packages, filtered if <package-regexps> is given.
Options:
  -h, --help           show this help message and exit
  -a, --auto-checkout  Only considers packages declared by auto-checkout. If
                       you don't specify a <package-regexps> then all declared
                       packages are processed.
  -c, --checked-out    Only considers packages currently checked out. If you
                       don't specify a <package-regexps> then all declared
                       packages are processed.
  -d, --develop        Only considers packages currently in development mode.
                       If you don't specify a <package-regexps> then all
                       declared packages are processed.

  Output options:
    The following options are used to print just the info you want, the order
    they are specified reflects the order in which the information will be
    printed.
    --name             Prints the name of the package.
    -p, --path         Prints the absolute path of the package.
    --type             Prints the repository type of the package.
    --url              Prints the URL of the package.

list (ls)

Usage: develop list [options] [<package-regexps>]

Lists tracked packages, filtered if <package-regexps> is given.
Options:
  -h, --help           show this help message and exit
  -a, --auto-checkout  Only show packages in auto-checkout list.
  -c, --checked-out    Only considers packages currently checked out. If you
                       don't specify a <package-regexps> then all checked out
                       packages are processed.
  -d, --develop        Only considers packages currently in development mode.
                       If you don't specify a <package-regexps> then all
                       develop packages are processed.
  -l, --long           Show URL and kind of package.
  -s, --status         Show checkout status.
                       The first column in the output shows the checkout
                       status:
                           '#' available for checkout
                           ' ' in auto-checkout list and checked out
                           '~' not in auto-checkout list, but checked out
                           '!' in auto-checkout list, but not checked out
                           'C' the repository URL doesn't match

purge

Usage: develop purge [options] [<package-regexps>]

Remove checked out packages which aren't active anymore.

Only 'svn' packages can be purged, because other repositories may contain
unrecoverable files even when not marked as 'dirty'.
Options:
  -h, --help     show this help message and exit
  -n, --dry-run  Don't actually remove anything, just print the paths which
                 would be removed.

rebuild (rb)

Usage: develop rebuild [options]

Run buildout with the last used arguments.
Options:
  -h, --help     show this help message and exit
  -n, --dry-run  Don't actually run buildout, just show the last used
                 arguments.

reset

Usage: develop reset [options] [<package-regexps>]

Resets the packages develop status. This is useful when switching to a new
buildout configuration.
Options:
  -h, --help           show this help message and exit
  -a, --auto-checkout  Only considers packages declared by auto-checkout. If
                       you don't specify a <package-regexps> then all declared
                       packages are processed.
  -c, --checked-out    Only considers packages currently checked out. If you
                       don't specify a <package-regexps> then all checked out
                       packages are processed.
  -d, --develop        Only considers packages currently in development mode.
                       If you don't specify a <package-regexps> then all
                       develop packages are processed.

status (stat, st)

Usage: develop status [options] [<package-regexps>]

Shows the status of tracked packages, filtered if <package-regexps> is given.
The first column in the output shows the checkout status:
    ' ' in auto-checkout list
    '~' not in auto-checkout list
    '!' in auto-checkout list, but not checked out
    'C' the repository URL doesn't match
The second column shows the working copy status:
    ' ' no changes
    'M' local modifications or untracked files
The third column shows the development status:
    ' ' activated
    '-' deactivated
    '!' deactivated, but the package is in the auto-checkout list
    'A' activated, but not in list of development packages (run buildout)
    'D' deactivated, but still in list of development packages (run buildout)
Options:
  -h, --help           show this help message and exit
  -a, --auto-checkout  Only considers packages declared by auto-checkout. If
                       you don't specify a <package-regexps> then all declared
                       packages are processed.
  -c, --checked-out    Only considers packages currently checked out. If you
                       don't specify a <package-regexps> then all checked out
                       packages are processed.
  -d, --develop        Only considers packages currently in development mode.
                       If you don't specify a <package-regexps> then all
                       develop packages are processed.
  -v, --verbose        Show output of VCS command.

update (up)

Usage: develop update [options] [<package-regexps>]

Updates all known packages currently checked out. If <package-regexps> are
given, then the set is limited to the matching packages.
Options:
  -h, --help           show this help message and exit
  -a, --auto-checkout  Only considers packages declared by auto-checkout. If
                       you don't specify a <package-regexps> then all declared
                       packages are processed.
  -d, --develop        Only considers packages currently in development mode.
                       If you don't specify a <package-regexps> then all
                       develop packages are processed.
  -f, --force          Force update even if the working copy is dirty.
  -v, --verbose        Show output of VCS command.

Changelog

1.10 - 2010-02-06

Don’t store the buildout options if they contain a command. [fschulze]
Basic support for buildout offline mode (-o). Not all cases are handled yet. [fschulze]
Added full-path package option. [fschulze]
Added egg package option (Issue #6). [fschulze]
By setting always-checkout = force, all packages will be updated without asking when dirty. [fschulze]
The [path] part of sources is replaced by path=PATH syntax and throws a warning when used. [fschulze]
Per package options are now allowed before the URL. [fschulze]
Check svn version and output helpful error messages if it’s too old or can’t be determined (Issue #13). [fschulze]
Error messages instead of tracebacks when source definitions are wrong. [fschulze]
Fix checkout of packages (Issues #9 and #11). [fschulze]
Possibility to checkout/update tags instead of HEAD in CVS [sargo]
Tests for CVS integration [sargo]
Better checking of CVS package purity. [sargo]

1.9 - 2010-01-11

Added dry-run option to purge command. [fschulze]
Fix purging on windows. [kleist]
Fix compatibility with Python < 2.6. [fschulze, vincentfretin]
Fix all answer for update command. [fschulze]

1.8 - 2010-01-10

Added threading for parallel checkouts. [fschulze, jensens]
Ask whether to update dirty packages during checkout. [fschulze]
When you answered yes when asked whether to update a dirty package, then all further questions had been answered with yes as well, this is now fixed. [fschulze]
Added all option when asked to update dirty packages. [fschulze]
Added help for all commands to PyPI description. [fschulze]
Added option to help command which outputs the help for all commands in reStructuredText format. [fschulze]
Don’t abort after user answered no on whether to update a package, just skip that package. [fschulze]

1.7 - 2009-11-26

Fix a problem where a package wasn’t added to the develop packages on auto checkout. [fschulze]

1.6 - 2009-11-21

Filter the packages gathered from buildout:develop to ones declared in sources, otherwise things like “develop = .” break. [fschulze]
Added support for Concurrent Versions System (CVS). [sargo]

1.5 - 2009-11-19

Added global always-checkout and a per source update option. [fschulze]
Added purge command. [fschulze]
Ask user how to proceed when package is dirty. [fschulze]
Refactored package matching and made the command options consistent. Now you can update only the packages currently in development with -d and similar possibilities. [fschulze]
Fix duplicate logging output. [fschulze]
Fix parsing of buildout arguments when -t was used. [fschulze]

1.4 - 2009-11-16

Allow to set a minimal revision for svn repositories. If the current revision is lower, then the package is updated. [fschulze]

1.3 - 2009-11-15

Read the cfg used by last buildout run. This prevents unexpected behaviour, if you change mr.developer options like source declarations and don’t run buildout. Such changes are now picked up immediately. [fschulze]
Added tests and a buildout to run them easily. [fschulze]

1.2 - 2009-11-12

If a package is removed from auto-checkout and wasn’t explicitly activated, then it will be removed from the develop packages automatically. In existing buildouts with an older mr.developer, you have to reset the packages first. [fschulze]
Added * wild card support for auto-checkout. [fschulze]
Don’t bail on subversion URLs ending in a slash or a revision marker. [fschulze]
Removed old way of specifying sources with sources-svn and sources-git. [fschulze]
Exit immediately when there are issues during checkout when running as extension. [fschulze]
Use verbosity from buildout when running as extension. [fschulze]
Fix buildout_dir in develop script, so it is properly escaped on Windows. [fschulze]
Changed the output of list -s to match the one from status. [fschulze]
Added troubleshooting section to readme. [miohtama, fschulze]
All commands have a -h and --help option now to show their help. [fschulze]

1.1 - 2009-08-07

Use relative paths from the buildout directory for the develop option if possible. This fixes issues if your buildout path contains a space. [fschulze]
Warn when trying to activate or deactivate a package which isn’t checked out. [fschulze]
Don’t depend on elementree on Python >= 2.5, because it’s builtin there. [fschulze]
When checking out a source it will automatically be activated. [fschulze]
Use ‘sources’ as the default section name for source information. [fschulze]
Added support for filesystem packages without version control with the ‘fs’ type. [fschulze]

1.0.1 - 2009-05-05

Fixed case sensitivity of package names for several commands. [fschulze]
SVN externals no longer cause a modified status. [fschulze]

1.0 - 2009-05-02

Added info command to print various informations about packages. [fschulze]
Added reset command to reset the develop state of packages. This is useful when switching to a new buildout configuration. During the next buildout run the develop state is determined the same way as in a clean buildout. [fschulze]
Got rid of deprecation warning in Python 2.6 by removing unnecessary call of __init__ in working copy implementations. [fschulze]

0.15 - 2009-04-17

Added reminder to run buildout after activating or deactivating packages. [fschulze]
Added rebuild command to rerun buildout with the last used arguments. [fschulze]

0.14 - 2009-04-16

Fixed verbose output of checkout command. [fschulze]
Added -f option to update command to force updates even if the working copy is dirty. [fschulze]

0.13 - 2009-04-14

Added -a option to update command to only update the packages declared in the auto-checkout list. [fschulze]
Added activate and deactivate commands. This allows to select which packages are added to the develop option of zc.buildout. Enhanced the status command to show the additional informations. [fschulze]
Switched the meaning of ~ and C in status command. [fschulze]

0.12 - 2009-04-14

Added support for Mercurial (hg). [mj]
Refactored working copy logic, so it’s easier to add support for other version control systems. [fschulze]
Added verbose flag to checkout and update commands. [fschulze]

0.11 - 2009-04-06

Removed the nice os.path.relpath usage, because it’s only been introduced with Python 2.6. [fschulze]

0.10 - 2009-04-06

Added verbose flag to status command. [fschulze]
Deprecated sources-svn and sources-git in favour of just sources which allows more flexibility. [fschulze]
Changed status command to only check known paths and not the whole sources-dir path. [fschulze]
Add possibility to filter packages in update and status commands. [fschulze]
Tell the user at the end of the buildout run whether there have been any errors during automatic checkout. [fschulze]
Install the develop script as the first part instead of the last, so it can be used to fix problems. [fschulze]

0.9 - 2009-03-30

When installed as just an egg, then the resulting develop script can be called from anywhere and will try to find the correct develop script from the current working directory and execute it. [fschulze]
Fixed help text formatting. [fschulze]

0.8 - 2009-03-25

Added authentication support to subversion commands. [fschulze]
Added -a option to checkout command to limit matching to the packages declared by the auto-checkout option. If no further argument is given, then all the packages from auto-checkout are processed. [fschulze]

0.7 - 2009-03-24

Added update command to checkout script. [fschulze]
Added status command to checkout script. [fschulze]
Added status flag to list command to indicate packages with wrong URL. [fschulze]
If the working copy is clean, then checkout automatically switches svn packages. [fschulze]
Skip on checkout errors during buildout, so the develop script is generated and you get a chance to inspect and fix the problems. [fschulze]
Check remote url and stop checkout if it differs. [fschulze]
Added various options to the list command. [fschulze]
Instead of the checkout script, there is now a develop script with various commands. [fschulze]

0.6 - 2009-03-24

Added custom logging formatter for nicer output in the checkout script. [fschulze]
Removed the ‘-e’ option, regular expression matching is the default now. [fschulze]
Made it possible to specify more than one regular expression without the need to use a pipe symbol and quotes. [fschulze]
Added help text for the checkout script to pypi page. [fschulze]
Add a warning to rerun buildout after checkout. [fschulze]

0.5 - 2009-03-23

Make sure that the updated versions are actually used. [fschulze]

0.4 - 2009-03-22

Fixed logging, which fixes the info message output. [fschulze]
Skip checkout of existing packages. [fschulze]

0.3 - 2009-03-22

Fixed source distribution by adding a MANIFEST.in. [fschulze]
Added -e and -l options to checkout script. [fschulze]

0.2 - 2009-03-22

Added auto-checkout option (only works with subversion at the moment). [fschulze]
Added support for git. [fschulze]
Throw error when trying to checkout unknown package. [fschulze]
Fixed target directory for checkouts. [fschulze]

0.1 - 2009-03-19

Initial release

Project details

These details have been verified by PyPI

Maintainers

fschulze maurits stefanholek tomster witsch

These details have not been verified by PyPI

Project links

Homepage

Release history Release notifications | RSS feed

2.0.2

Apr 24, 2024

2.0.1

Aug 19, 2020

2.0.0

Mar 4, 2019

1.38

Mar 17, 2017

1.37

Mar 4, 2017

1.37b1 pre-release

Mar 4, 2017

1.36

Mar 1, 2017

1.35

Feb 1, 2017

1.34

Sep 30, 2015

1.33

May 25, 2015

1.32

May 23, 2015

1.31

Oct 29, 2014

1.30

Mar 14, 2014

1.29

Mar 14, 2014

1.28

Jan 23, 2014

1.27

Jan 10, 2014

1.26

Sep 10, 2013

1.25

Mar 15, 2013

1.24

Jan 29, 2013

1.23

Nov 28, 2012

1.22

Oct 13, 2012

1.21

Apr 11, 2012

1.20

Feb 26, 2012

1.19

Sep 22, 2011

1.18

Aug 16, 2011

1.17

Jan 26, 2011

1.16

Sep 16, 2010

1.15

Jul 25, 2010

1.14

May 15, 2010

1.13

Apr 11, 2010

1.12

Mar 15, 2010

1.11

Mar 14, 2010

This version

1.10

Feb 6, 2010

1.9

Jan 11, 2010

1.8

Jan 10, 2010

1.7

Nov 26, 2009

1.6

Nov 21, 2009

1.5

Nov 19, 2009

1.4

Nov 16, 2009

1.3

Nov 15, 2009

1.2

Nov 12, 2009

1.1

Aug 7, 2009

1.0.1

May 5, 2009

1.0

May 2, 2009

0.15

Apr 17, 2009

0.14

Apr 16, 2009

0.13

Apr 14, 2009

0.12

Apr 14, 2009

0.11

Apr 6, 2009

0.10

Apr 6, 2009

0.9

Mar 30, 2009

0.8

Mar 25, 2009

0.7

Mar 24, 2009

0.6

Mar 24, 2009

0.5

Mar 23, 2009

0.4

Mar 22, 2009

0.3

Mar 22, 2009

0.2

Mar 22, 2009

0.1

Mar 19, 2009

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mr.developer-1.10.zip (50.2 kB view hashes)

Uploaded Feb 6, 2010 Source

Hashes for mr.developer-1.10.zip

Hashes for mr.developer-1.10.zip
Algorithm	Hash digest
SHA256	`1c0ccd27aa80217bac2ef66dedebaec3f0955352cc6bf4f9c015d31e93b50601`
MD5	`7c239aa37b05ba8c458fa148a97e07d2`
BLAKE2b-256	`9bd5187202dc7d22bf124cf1e2208a6bb27fdbe8ee450de516072e9c17d76e93`

mr.developer 1.10

Navigation

Verified details

Maintainers

Unverified details

Project links

Meta

Classifiers

Project description

Introduction

Usage

Troubleshooting

Dirty SVN

HTTPS certificates

Commands

activate (a)

checkout (co)

deactivate (d)

help (h)

info

list (ls)

purge

rebuild (rb)

reset

status (stat, st)

update (up)

Changelog

1.10 - 2010-02-06

1.9 - 2010-01-11

1.8 - 2010-01-10

1.7 - 2009-11-26

1.6 - 2009-11-21

1.5 - 2009-11-19

1.4 - 2009-11-16

1.3 - 2009-11-15

1.2 - 2009-11-12

1.1 - 2009-08-07

1.0.1 - 2009-05-05

1.0 - 2009-05-02

0.15 - 2009-04-17

0.14 - 2009-04-16

0.13 - 2009-04-14

0.12 - 2009-04-14

0.11 - 2009-04-06

0.10 - 2009-04-06

0.9 - 2009-03-30

0.8 - 2009-03-25

0.7 - 2009-03-24

0.6 - 2009-03-24

0.5 - 2009-03-23

0.4 - 2009-03-22

0.3 - 2009-03-22

0.2 - 2009-03-22

0.1 - 2009-03-19

Project details

Verified details

Maintainers

Unverified details

Project links

Meta

Classifiers

Release history Release notifications | RSS feed

Download files

Source Distribution