Skip to main content

A plugin manager based on setuptools entry points mechanism

Project description

https://travis-ci.org/DropD/reentry.svg?branch=master https://coveralls.io/repos/github/DropD/reentry/badge.svg

Reentry

A plugin manager based on setuptools entry points with 10x the speed

Quickstart

Use the following in your plugins’s setup.py:

setup(
   ...
   setup_requires=['reentry'],
   reentry_register=True,
   entry_points={
      'my_plugins': ['this_plugin = this_package.subpackage:member'],
      ...
   }

And iterate over installed plugin from the host package:

from reentry import manager
available_plugins = manager.iter_entry_points(group='my_plugins')
for plugin in available_plugins:
   plugin_object = plugin.load()
   plugin_object.use()

Note that the syntax is consistent with setuptools’s pkg_resources, so you may use it as a fallback:

try:
   from reentry import manager as entry_pt_manager
except:
   import pkg_resources as entry_pt_manager

entry_pt_manager.iter_entry_points(...)
...

If your host package should search for entrypoints that were not installed using reentry_register:

# in host's setup.py
setup(
   ...
   reentry_scan=['my_plugins', 'other_type_of_plugins']
   ...
)

What for?

To make entry points usable for plugins in time-critical situations (like commandline interfaces)!

Setuptool’s entry point system is convenient to use for plugin based python applications. It allows separate python packaes to act as plugins to a host package, making it easy for the host to find and iterate over the relevant data structures from plugins.

However simply importing setuptools scales badly with the number of installed distributions and can be very slow for moderately complex environments (~ 0.5 s). Finding and loading of plugins on the other hand is time-critical in cases like commandline tools loading subcommands, where 100 ms are a noticeable delay.

Setuptools’s pkg_resources is slow, because it verifies dependencies are installed correctly for all distributions present in the environment on import. This allows entry points to have additional requirements.

Reentry forgoes this dependency check for entry points without such ‘extras’ dependencies and thereby manages to be fast and scale better, with the amount of installed plugins, not installed python packages in general.

Standalone Manager Usage

Sometimes it might be necessary to update the cached entry points, for example

  • after uninstalling a plugin (there are no uninstall hooks by setuptools atm)

  • after installing a plugin that does not use install hooks

  • while developping a plugin / plugin host

for those cases reentry has a commandline interface:

$ reentry --help
Usage: reentry [OPTIONS] COMMAND [ARGS]...

  manage your reentry python entry point cache

Options:
  --help  Show this message and exit.

Commands:
  map
  scan  Scan for python entry points to cache for...
$ reentry scan --help
Usage: reentry scan [OPTIONS] PATTERN

   Scan for python entry points to cache for faster loading.

   Scan only for specific PATTERNs or leave empty to scan all

Options:
   -r, --regex  Treat PATTERNs as regular expresions
   --help       Show this message and exit.
$ reentry map --help
Usage: reentry map [OPTIONS]

Options:
  --dist TEXT   limit map to a distribution
  --group TEXT  limit map to an entry point group
  --name TEXT   limit map to entrypoints that match NAME
  --help        Show this message and exit.

CLI Example

Reentry provides a drop-in replacement for iter_entry_points:

import click
from click_plugins import with_plugins
from reentry.manager import iter_entry_points

@with_plugins(iter_entry_points('cli_plugins'))
@click.group()
def cli():
   """
   command with subcommands loaded from plugin entry points
   """

For this to work, reentry has to be installed and must have been used to scan for entry points in the ‘cli_plugins’ group once.

Features

  • finding plugins: reentry keeps a map of entry points in a file

  • speed: reentry provides an EntryPoint implementation that trades extras for search and load speed

  • automatic registering: reentry provides setup() keyword args to register and scan for entry points on install

  • flexible: entry points with extras dependencies still work trying to load them will lead to loading pkg_resources

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

reentry-1.2.0a2.tar.gz (14.5 kB view details)

Uploaded Source

Built Distribution

reentry-1.2.0a2-py2.py3-none-any.whl (19.7 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file reentry-1.2.0a2.tar.gz.

File metadata

  • Download URL: reentry-1.2.0a2.tar.gz
  • Upload date:
  • Size: 14.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for reentry-1.2.0a2.tar.gz
Algorithm Hash digest
SHA256 d3d90f96dd5f085f55d99370433143708b1108796d4d381ed0beb445763ccb90
MD5 077b3684db8beba528de85a4ec45938c
BLAKE2b-256 782dd1c10e9fc53f5a87fcf4ea85114a067d2f0c40c9b57ec4476eda411b1b89

See more details on using hashes here.

File details

Details for the file reentry-1.2.0a2-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for reentry-1.2.0a2-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 b9c4d88b60d695dab8894a5a937c4cbfe08c010f473b843dae77ef7831dc5fc6
MD5 7ef9a71b874c3bcb9f87750d74add44e
BLAKE2b-256 be2b377350fe84d5cc0d39dd195242a71b5685d5426b58148eea43b89cd84dc0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page