Skip to main content

Asyncio plugins, components, dependency injection and configs

Project description

This is heavily inspired by Pyramid and my daily needs to fastly create and maintain microservice like applications.

a plugin mechanic

  • plugin may depend on other plugins

  • plugins yield tasks to run

  • a registry serves as a store for application components created by plugins

  • a dependency injection creates intermediate components

  • a config source is mapped to plugin specific needs

  • structlog boilerplate for json/tty logging

You bootstrap like following:

from buvar import plugin

plugin.stage("some.module.with.plugin.function")
# some.module.with.plugin.function
from buvar import context, plugin

class Foo:
    ...


async def task():
    asyncio.sleep(1)


async def server():
    my_component = context.get(Foo)
    await asyncio.Future()


# you may omit include in arguments
async def prepare(load: plugin.Loader):
    await load('.another.plugin')

    # create some long lasting components
    my_component = context.add(Foo())

    # you may run simple tasks
    yield task()

    # you may run server tasks
    yield server()

a components and dependency injection solution

Dependency injection relies on registered adapters, which may be a function, a method, a class, a classmethod or a generic classmthod.

Dependencies are looked up in components or may be provided via, arguments.

from buvar import di

class Bar:
    pass

class Foo:
    def __init__(self, bar: Bar = None):
        self.bar = bar

    @classmethod
    async def adapt(cls, baz: str) -> Foo:
        return Foo()

async def adapt(bar: Bar) -> Foo
    foo = Foo(bar)
    return foo


async def task():
    foo = await di.nject(Foo, baz="baz")
    assert foo.bar is None

    bar = Bar()
    foo = await di.nject(Foo, bar=bar)
    assert foo.bar is bar

async def prepare():
    di.register(Foo.adapt)
    di.register(adapt)

a config source

buvar.config.ConfigSource is just a dict, which merges arbitrary dicts into one. It serves a the single source of truth for application variability.

You can load a section of config values into your custom attrs class instance. ConfigSource will override values by environment variables if present.

config.toml

log_level = "DEBUG"
show_warnings = "yes"

[foobar]
some = "value"
export APP_FOOBAR_SOME=thing
import attr
import toml

from buvar import config

@attr.s(auto_attribs=True)
class GeneralConfig:
    log_level: str = "INFO"
    show_warnings: bool = config.bool_var(False)


@attr.s(auto_attribs=True)
class FoobarConfig:
   some: str


source = config.ConfigSource(toml.load('config.toml'), env_prefix="APP")

general_config = source.load(GeneralConfig)
assert general_config == GeneralConfig(log_level="DEBUG", show_warnings=True)

foobar_config = source.load(FoobarConfig, 'foobar')
assert foobar_config.some == "thing"

There is a shortcut to the above approach provided by buvar.config.Config, which requires to be subclassed from it with a distinct section attribute. If one adds a buvar.config.ConfigSource component, he will receive the mapped config in one call.

from buvar import config, plugin


@attr.s(auto_attribs=True)
class GeneralConfig(config.Config):
    log_level: str = "INFO"
    show_warnings: bool = config.bool_var(False)


@attr.s(auto_attribs=True)
class FoobarConfig(config.Config, section="foobar"):
    some: str


async def prepare(load: plugin.Loader):
    # this would by typically placed in the main entry point
    source = context.add(config.ConfigSource(toml.load('config.toml'), env_prefix="APP"))

    # to provide the adapter to di, which could also be done inthe main entry point
    await load(config)
    foobar_config = await di.nject(FoobarConfig)

a structlog

Just structlog boilerplate.

import sys

from buvar import log

log.setup_logging(sys.stdout.isatty(), general_config.log_level)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

buvar-0.41.4.tar.gz (127.8 kB view details)

Uploaded Source

Built Distributions

buvar-0.41.4-cp39-cp39-manylinux2014_x86_64.whl (557.9 kB view details)

Uploaded CPython 3.9

buvar-0.41.4-cp38-cp38-manylinux2014_x86_64.whl (578.1 kB view details)

Uploaded CPython 3.8

buvar-0.41.4-cp37-cp37m-manylinux2014_x86_64.whl (513.3 kB view details)

Uploaded CPython 3.7m

File details

Details for the file buvar-0.41.4.tar.gz.

File metadata

  • Download URL: buvar-0.41.4.tar.gz
  • Upload date:
  • Size: 127.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.8.2

File hashes

Hashes for buvar-0.41.4.tar.gz
Algorithm Hash digest
SHA256 1a26a62f084429c1685364aa36ce7397f2e4afef1bc16875b591a707f45c46f7
MD5 060add85b7b234879d8b09b3584d376b
BLAKE2b-256 bde689a960a74175813ead16db20828ea8d96b972e69ff6a186a240c1d3be52f

See more details on using hashes here.

File details

Details for the file buvar-0.41.4-cp39-cp39-manylinux2014_x86_64.whl.

File metadata

  • Download URL: buvar-0.41.4-cp39-cp39-manylinux2014_x86_64.whl
  • Upload date:
  • Size: 557.9 kB
  • Tags: CPython 3.9
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.8.2

File hashes

Hashes for buvar-0.41.4-cp39-cp39-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a29216e42bf33ae661864c1a1f06fd1484ababc50d11c975d071039235930913
MD5 f2e2541dd327f299cc77a9b5081bd536
BLAKE2b-256 08d892e6d8298faf5becd627c93a4b1510f7f0137d415c54b0a1e2dd7fa9cd24

See more details on using hashes here.

File details

Details for the file buvar-0.41.4-cp38-cp38-manylinux2014_x86_64.whl.

File metadata

  • Download URL: buvar-0.41.4-cp38-cp38-manylinux2014_x86_64.whl
  • Upload date:
  • Size: 578.1 kB
  • Tags: CPython 3.8
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.8.2

File hashes

Hashes for buvar-0.41.4-cp38-cp38-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 4f00a28192473fa89af615dcd11df9b969bbaec0d0847306149ed1674602297d
MD5 ecb1b42ea733c7b875a148015028f77e
BLAKE2b-256 63ae867cc2c0b7a34a5b446c60fb2ab2f8b27de85da86fb50cc2c04d2d9017b8

See more details on using hashes here.

File details

Details for the file buvar-0.41.4-cp37-cp37m-manylinux2014_x86_64.whl.

File metadata

  • Download URL: buvar-0.41.4-cp37-cp37m-manylinux2014_x86_64.whl
  • Upload date:
  • Size: 513.3 kB
  • Tags: CPython 3.7m
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.8.2

File hashes

Hashes for buvar-0.41.4-cp37-cp37m-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 e7bcb541cd87364c5481b6d9e011b5738a75f15b05ab21d143e7b6a74ce49fe2
MD5 78d3ce2f1db15d10adb44cde62a2ee86
BLAKE2b-256 84c19968a516be41cff2c96a987c51c788a0ebfa7439a762b782adf5eb7356b4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page