Skip to main content

I/O facility for Idefix/Pluto configuration files

Project description

inifix

PyPI PyPI codecov pre-commit.ci status Code style: black

inifix in a small Python library with I/O methods to read and write Pluto/Idefix inifiles as Python dictionaries.

Its primary goal is to support Idefix's model (which is intended as identical to Pluto's), though the following file format specification is intended as a superset of the one used in Pluto and Idefix. Namely, while Pluto and Idefix require that each and every (key, value) pair be part of a section, inifix supports section-free definitions.

File format specifications

  • parameter names are strings
  • names and values are separated by non-newline white spaces
  • values are represented in unicode characters
  • all values are considered numbers if possible (e.g., 1e3 is read as 1000)
  • number values are read as integers if no loss of precision ensues, and floats otherwise
  • true and false are cast as booleans (case-insensitive)
  • values that can't be read as number or booleans are read as strings.
  • string delimiters " and ' can be used to force string type for values that would otherwise be read as numbers and booleans.
  • a parameter can be associated to a single value or a list of whitespace-separated values
  • sections titles start with [ and end with ]
  • comments start with # and are ignored

Using the following Python's typing notations

from typing import Union, Mapping
Scalar = Union[str, float, bool, int]
InifixConf = Mapping[str, Union[Scalar, Mapping[str, Scalar]]

A configuration file is considered valid if it can be parsed as an InifixConf object.

Examples

The following content is considered valid

# My awesome experiment
[Grid]
x   1 2 u 10    # a comment
y   4 5 l 100
[Time Integrator]
CFL  1e-3
tstop 1E3

and maps to

{
    "Grid": {
        "x": [1, 2, "u", 10],
        "y": [4, 5, "l", 100]
    },
    "Time Integrator": {
        "CFL": 0.001,
        "tstop": 1000
    }
}

The following section-less format doesn't comply to Pluto/Idefix's specifications, but it is considered valid for inifix. This is the one intentional differences in specifications, which makes inifix format a superset of Pluto's inifile format.

mode   fargo

# Time integrator
CFL    1e-3
tstop  1e3

and maps to

{
    "mode": "fargo",
    "CFL": 0.001,
    "tstop": 1000
}

Note that strings using e-notation (e.g. 1e-3 or 1E3 here) are decoded as numbers. They are cast to int if no precision loss ensues, and float otherwise. Reversly, when writing files, numbers are re-encoded using e-notation if it leads to a more compact representation. For instance, 100000 is encoded as 1e5, but 10 is left unchanged because 1e1 is longer. In cases where both reprensations are equally compact (e.g. 100 VS 1e2), e-notation is prefered in encoding.

While decoding, e can be lower or upper case, but they are always encoded as lower case.

Installation

$ pip install inifix

Usage

The Python API is similar to that of toml and stdlib json, though intentionally simplified, and consists in two main user-facing functions: inifix.load and inifix.dump.

import inifix

# read
conf = inifix.load("pluto.ini")

# patch
conf["Time"]["CFL"] = 0.1

# write back
inifix.dump(conf, "pluto-mod.ini")

inifix.load supports loading from an open file

with open("pluto.ini") as fh:
    conf = inifix.load(fh)

or from a str/os.PathLike object representing a file.

Schema Validation

inifix.validate_inifile_schema can be used to validate an arbitrary dictionary as writable to an inifile, following Pluto/Idefix's format. This will raise an exception (ValueError) if the dictionnary data is invalid.

inifix.validate_inifile_schema(data)

CLI

Command line tool are shipped with the package to validate or format compatible inifiles.

Validation

This checks that your inifiles can be loaded with inifix.load from the command line

$ inifix-validate pluto.ini
Validated pluto.ini

This simple validator can be used as a hook for pre-commit. Simply add the following to your project's .pre-commit-config.yaml

  - repo: https://github.com/neutrinoceros/inifix.git
    rev: v0.10.0
    hooks:
      - id: inifix-validate

Formatting

To format a file in place, use

$ inifix-format pluto.ini

Options

Note that comments are preserved in all cases.

  • To print a diff patch to stdout instead, pass the --diff flag
$ inifix-format pluto.ini --diff
  • Use --name-column-size <n> to specify the length of the first column (including right padding). Names longer this value will not be aligned, but whitespace separating them from values will be minimised.

This program also doubles as pre-commit hook

  - repo: https://github.com/neutrinoceros/inifix.git
    rev: v0.10.0
    hooks:
      - id: inifix-format

Contribution guidelines

We use the pre-commit framework to automatically lint for code style and common pitfalls.

Before you commit to your local copy of the repo, please run this from the top level

$ python3 -m pip install -u -e .[dev]
$ pre-commit install

Testing

We use the pytest framework to test inifix. The test suite can be run from the top level with a simple pytest invocation.

$ pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

inifix-0.11.0.tar.gz (10.2 kB view details)

Uploaded Source

Built Distribution

inifix-0.11.0-py3-none-any.whl (24.5 kB view details)

Uploaded Python 3

File details

Details for the file inifix-0.11.0.tar.gz.

File metadata

  • Download URL: inifix-0.11.0.tar.gz
  • Upload date:
  • Size: 10.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.27.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for inifix-0.11.0.tar.gz
Algorithm Hash digest
SHA256 523fa1b17dbb15fdca7051f388b693fc7a3af593a4c160d9825ac73b1a099fdd
MD5 2f632bc0c19b9410fa1071905c69eeff
BLAKE2b-256 0085d0bd91e4c2db598e62ce54a738a738388db30154dce56b52f5ab4c54f93e

See more details on using hashes here.

File details

Details for the file inifix-0.11.0-py3-none-any.whl.

File metadata

  • Download URL: inifix-0.11.0-py3-none-any.whl
  • Upload date:
  • Size: 24.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.27.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9

File hashes

Hashes for inifix-0.11.0-py3-none-any.whl
Algorithm Hash digest
SHA256 37cbe291cc4cb2b3fe571a483e4dcb08d16a167f69c8aaa584cf45331ed22c87
MD5 2924b4f11ade5b8c13ef5f8f9e8f3e89
BLAKE2b-256 5dffe553d55a60afdbf8ee501a396b9d8d46ec815d26a7951de3d4a325561cf2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page