Skip to main content

Asyncio plugins, components, dependency injection and configs

Project description

This is heavily inspired by Pyramid and my daily needs to fastly create and maintain microservice like applications.

a plugin mechanic

  • plugin may depend on other plugins

  • plugins yield tasks to run

  • a context registry serves as a store for application components created by plugins

  • a dependency injection creates intermediate components

  • a config source is mapped to plugin specific configuration and may be fully overridden by environment vars

  • structlog boilerplate for json/tty logging

You bootstrap like following:

from buvar import plugin

plugin.stage("some.module.with.prepare")
# some.module.with.prepare
from buvar import context, plugin

class Foo:
    ...


async def task():
    asyncio.sleep(1)


async def server():
    my_component = context.get(Foo)
    await asyncio.Future()


# there is also plugin.Teardown and plugin.Cancel
async def prepare(load: plugin.Loader):
    await load('.another.plugin')

    # create some long lasting components
    my_component = context.add(Foo())

    # you may run simple tasks
    yield task()

    # you may run server tasks
    yield server()

a components and dependency injection solution

Dependency injection relies on registered adapters, which may be a function, a method, a class, a classmethod or a generic classmthod.

Dependencies are looked up in components or may be provided via kwargs.

from buvar import di

class Bar:
    pass

class Foo:
    def __init__(self, bar: Bar = None):
        self.bar = bar

    @classmethod
    async def adapt(cls, baz: str) -> Foo:
        return Foo()

async def adapt(bar: Bar) -> Foo
    foo = Foo(bar)
    return foo


async def task():
    foo = await di.nject(Foo, baz="baz")
    assert foo.bar is None

    bar = Bar()
    foo = await di.nject(Foo, bar=bar)
    assert foo.bar is bar

async def prepare():
    di.register(Foo.adapt)
    di.register(adapt)

    yield task()

a config source

buvar.config.ConfigSource is just a dict, which merges arbitrary dicts into one. It serves as the single source of truth for application variability.

You can load a section of config values into your custom attrs class instance. ConfigSource will override values by environment variables if present.

config.toml

log_level = "DEBUG"
show_warnings = "yes"

[foobar]
some = "value"
export APP_FOOBAR_SOME=thing
import attr
import toml

from buvar import config

@attr.s(auto_attribs=True)
class GeneralConfig:
    log_level: str = "INFO"
    show_warnings: bool = config.bool_var(False)


@attr.s(auto_attribs=True)
class FoobarConfig:
   some: str


source = config.ConfigSource(toml.load('config.toml'), env_prefix="APP")

general_config = source.load(GeneralConfig)
assert general_config == GeneralConfig(log_level="DEBUG", show_warnings=True)

foobar_config = source.load(FoobarConfig, 'foobar')
assert foobar_config.some == "thing"

There is a shortcut to the above approach provided by buvar.config.Config, which requires to be subclassed from it with a distinct section attribute. If one adds a buvar.config.ConfigSource component, he will receive the mapped config in one call.

from buvar import config, plugin


@attr.s(auto_attribs=True)
class GeneralConfig(config.Config):
    log_level: str = "INFO"
    show_warnings: bool = config.bool_var(False)


@attr.s(auto_attribs=True)
class FoobarConfig(config.Config, section="foobar"):
    some: str


async def prepare(load: plugin.Loader):
    # this would by typically placed in the main CLI entry point
    source = context.add(config.ConfigSource(toml.load('config.toml'), env_prefix="APP"))

    # to provide the adapter to di, which could also be done in the main entry point
    await load(config)
    foobar_config = await di.nject(FoobarConfig)

a structlog

Just structlog boilerplate.

import sys

from buvar import log

log_config = log.LogConfig(tty=sys.stdout.isatty(), level="DEBUG")
log_config.setup()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

buvar-0.41.5.tar.gz (128.8 kB view details)

Uploaded Source

Built Distributions

buvar-0.41.5-cp39-cp39-manylinux2014_x86_64.whl (557.3 kB view details)

Uploaded CPython 3.9

buvar-0.41.5-cp38-cp38-manylinux2014_x86_64.whl (575.1 kB view details)

Uploaded CPython 3.8

buvar-0.41.5-cp37-cp37m-manylinux2014_x86_64.whl (512.2 kB view details)

Uploaded CPython 3.7m

File details

Details for the file buvar-0.41.5.tar.gz.

File metadata

  • Download URL: buvar-0.41.5.tar.gz
  • Upload date:
  • Size: 128.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.8.2

File hashes

Hashes for buvar-0.41.5.tar.gz
Algorithm Hash digest
SHA256 eb2a947ffc209f711af53c271a220c47e054d775de5bbdf44910c1ae83d0828a
MD5 a2d01a7ca6bf1116762b30398cd6b196
BLAKE2b-256 ffc5627057f0d9e19969c4d6ba0823c76a9b505770d13ab36070ec4628550b24

See more details on using hashes here.

File details

Details for the file buvar-0.41.5-cp39-cp39-manylinux2014_x86_64.whl.

File metadata

  • Download URL: buvar-0.41.5-cp39-cp39-manylinux2014_x86_64.whl
  • Upload date:
  • Size: 557.3 kB
  • Tags: CPython 3.9
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.8.2

File hashes

Hashes for buvar-0.41.5-cp39-cp39-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 0bc5296580cf863ec7edb72ee8910c75718b3a6e39f6ef598681ca616d05d5ba
MD5 abd79cd305d068d7ace982c20ab6a7e9
BLAKE2b-256 f90ea2ac2a95a5868e3cd0ea2daec0bbca38445c63393d45bacfcc0eeeeec3c8

See more details on using hashes here.

File details

Details for the file buvar-0.41.5-cp38-cp38-manylinux2014_x86_64.whl.

File metadata

  • Download URL: buvar-0.41.5-cp38-cp38-manylinux2014_x86_64.whl
  • Upload date:
  • Size: 575.1 kB
  • Tags: CPython 3.8
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.8.2

File hashes

Hashes for buvar-0.41.5-cp38-cp38-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 aadf8e8797be40ca8d15f5b0c991381779936440b9c5a3e630958d8bb34c0e33
MD5 db8901c3d3281efcfaa0500d198dab77
BLAKE2b-256 97c1b6484c0e0b8aaab0c1a0cd58ce6e8c79e49deb2745855e368b4175833041

See more details on using hashes here.

File details

Details for the file buvar-0.41.5-cp37-cp37m-manylinux2014_x86_64.whl.

File metadata

  • Download URL: buvar-0.41.5-cp37-cp37m-manylinux2014_x86_64.whl
  • Upload date:
  • Size: 512.2 kB
  • Tags: CPython 3.7m
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.8.2

File hashes

Hashes for buvar-0.41.5-cp37-cp37m-manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 701ffef1bdfe7ce6dc115f5393a272456770170870112a7542f8f9f480e3c55e
MD5 fc70a95e85009134197788410aa0489d
BLAKE2b-256 2d1e63ce26782f916f5b83cbd424417446d45f12c3eb3ee9ef79018ee54f1ed0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page