The pymsbuild build backend.
Project description
pymsbuild
This is a PEP 517 backend for building packages via MSBuild.
Configuration file
The file is named _msbuild.py
, and is executed by running python -m pymsbuild
.
The package definition specifies all the files that end up in the released packages.
from pymsbuild import *
METADATA = {
"Metadata-Version": "2.1",
"Name": "package",
"Version": "1.0.0",
"Author": "My Name",
"Author-email": "myemail@example.com",
"Description": File("README.md"),
"Description-Content-Type": "text/markdown",
"Classifier": [
"Development Status :: 3 - Alpha",
"Intended Audience :: Developers",
"Programming Language :: Python :: 3.9",
],
}
PACKAGE = Package(
"my_package",
PyFile(r"my_package\*.py"),
PydFile(
"_accelerator",
CSourceFile(r"win32\*.c"),
CHeaderFile(r"win32\*.h"),
),
Package(
"subpackage",
PyFile(r"subpackage\*.py"),
),
)
Usage
Rebuild the current project in-place.
python -m pymsbuild
Interactively generate the _msbuild.py
file with project spec.
(Or at least, it will, once implemented.)
python -m pymsbuild init
Build the project and output an sdist
python -m pymsbuild sdist
Build the project and output a wheel
python -m pymsbuild wheel
Clean any recent builds
python -m pymsbuild clean
Advanced Examples
Dynamic METADATA
Metadata may be dynamically generated, either on import or with the
init_METADATA
function. This function is called and must either
return the metadata dict to use, or update METADATA
directly.
However, if a PKG-INFO
file is found adjacent to the configuration
file, it will be used verbatim. Sdist generation adds this file, so all
metadata is static from that point onward. init_METADATA
is not
called in this case.
from pymsbuild import *
METADATA = {
"Metadata-Version": "2.1",
"Name": "package",
"Version": os.getenv("VERSION", "1.0.0"),
"Author": "My Name",
"Author-email": "myemail@example.com",
"Description": File("README.md"),
"Description-Content-Type": "text/markdown",
"Classifier": [
"Development Status :: 3 - Alpha",
"Intended Audience :: Developers",
"Programming Language :: Python :: 3.9",
],
}
def init_METADATA():
if os.getenv("BUILD_BUILDNUMBER"):
METADATA["Version"] = f"1.0.{os.getenv('BUILD_BUILDNUMBER', '')}"
# Updated METADATA directly, so no need to return anything
Separate packages
Packages are just Python objects, so they may be kept in variables and
used later. They also expose a members
attribute, which is a list, so
that members can be added or inserted later.
After the entire module is executed, the package in PACKAGE
is the
only one used to generate output.
P1 = Package(
"submodule",
PyFile(r"src\submodule\__init__.py")
)
P2 = Package(
"submodule_2",
PyFile(r"src\submodule_2\__init__.py")
)
PACKAGE = Package("my_package", P1)
PACKAGE.members.append(P2)
Dynamic packages
After import, if an init_PACKAGE(tag=None)
function exists it will be
called with the intended platform tag. It must modify or return
PACKAGE
. This function is called for in-place, sdist and wheel
generation, however, for sdists (and any scenario that should not
generate binaries), tag
will be None
. Otherwise, it will be a
string like cp38-cp38-win32
.
X64_ACCELERATOR = PydFile(
"_my_package",
CSourceFile(r"win32\*.c"),
IncludeFile(r"win32\*.h"),
)
PACKAGE = Package(
"my_package",
PyFile(r"my_package\*.py"),
)
def init_PACKAGE(tag=None):
if tag.endswith("-win_amd64"):
PACKAGE.members.append(X64_ACCELERATOR)
Source offsets
If you keep your source in a src
folder (recommended), provide the
root=
argument to Package
in order to properly offset filenames.
Because it is a named argument, it must be provided last.
This is important for sdist generation and in-place builds, which need to match package layout with source layout. Simply prefixing filename patterns with the additional directory is not always sufficient.
Note that this will also offset subpackages, and that subpackages may
include additional root
arguments. However, it only affects sources,
while the package name (the first argument) determines where in the
output the package will be located. In-place builds will create new
folders in your source tree if it does not match the final structure.
PACKAGE = Package(
"my_package",
PyFile(r"my_package\__init__.py"),
root="src",
)
Project file override
Both Package
and PydFile
types generate MSBuild project files and
execute them as part of build, including sdists. For highly customised
builds, this generation may be overridden completely by specifying the
project_file
named argument. All members are then ignored.
By doing this, you take full responsibility for a valid build, including providing a number of undocumented and unsupported targets.
Recommendations:
- lock your
pymsbuild
dependency to a specific version inpyproject.toml
- generate project files first and modify, rather than create new ones
- read the
pymsbuild
source code, especially thetargets
folder - consider contributing/requesting your feature
PACKAGE = Package(
"my_package",
PydFile("_accelerator", project_file=r"src\accelerator.vcxproj")
)
Compiler/linker arguments
Rather than overriding the entire project file, there are a number of ways to inject arbitrary values into a project. These require familiarity with MSBuild files and the toolsets you are building with.
The Property
element inserts a <PropertyGroup>
with the value you
specifiy at the position in the project the element appears.
PYD = PydFile(
"module",
Property("WindowsSdkVersion", "10.0.18363.0"),
...
)
The ItemDefinition
element inserts an <ItemDefinitionGroup>
with
the type and metadata you specify at the position in the project the
element appears.
PYD = PydFile(
"module",
ItemDefinition("ClCompile", PreprocessorDefinitions="Py_LIMITED_API"),
...
)
The ConditionalValue
item may wrap any element value to add
conditions or concatenate the value. This may also be used on source
arguments for file elements.
...
Property("Arch", ConditionalValue("x86", condition="$(Platform) == 'Win32'")),
Property("Arch", ConditionalValue("x64", if_empty=True)),
...
ItemDefinition(
"ClCompile",
AdditionalIncludeDirectories=
ConditionalValue(INCLUDES + ";", prepend=True),
ProprocessorDefinitions=
ConditionalValue(";Py_LIMETED_API", append=True),
),
...
ConditionalValue
may also be used to dynamically update values in the
init_PACKAGE
function, allowing you to keep the structure mostly
static but insert values from the current METADATA
(which is fully
evaluated by the time init_PACKAGE
is called).
VER = ConditionalValue("1.0.0")
PYD = PydFile(
"module",
Property("Version", VER),
CSourceFile(r"src\*.c"),
IncludeFile(r"src\*.h"),
)
def init_PACKAGE(tag):
VER.value = METADATA["Version"]
As a last resort, the LiteralXml
element inserts plain text directly
into the generated file. It will be inserted as a child of the
top-level Project
element.
...
LiteralXml("<Import Project='my_props.props' />"),
...
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for pymsbuild-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 85955097a4af6f89f338a3a7fd5ac5047f6a6530cd86297c67cb69e4e0beb2a2 |
|
MD5 | 5205478b2e427277ce475c8e0c81a5ce |
|
BLAKE2b-256 | d531afe707946850c1bb66a1093ddf9e0bd3fe003cd6e28f1d5331a87cce6a0f |