Skip to main content

Control pymmcore (micro-manager) in another process

Project description

pymmcore-plus

License PyPI Python Version CI codecov

🧪🧪 pre-alpha software: work in progress! 🧪🧪

pymmcore-plus aims to extend pymmcore (python bindings for the C++ micro-manager core) with a number of features designed to facilitate working with Micro-manager in pure python/C environments.

  • pymmcore_plus.CMMCorePlus is a subclass of pymmcore.CMMCore that provides additional convenience functions beyond the standard CMMCore API.

    from pymmcore_plus import CMMCorePlus
    
  • CMMCorePlus includes a run_mda method (name may change) "acquisition engine" that drives micro-manager for conventional multi-dimensional experiments. It accepts an MDASequence from useq-schema for experiment design/declaration.

  • Adds a callback system that adapts the CMMCore callback object to an existing python event loop (such as Qt, or perhaps asyncio/etc...)

  • Includes a Pyro5-based client/server that allows one to create and control and CMMCorePlus instance running in another process, or (conceivably) another computer. This is particularly useful for integration in an existing event loop (without choking the main python thread).

    from pymmcore_plus import RemoteMMCore
    
    with RemoteMMCore() as mmcore:
        mmcore.loadSystemConfiguration("demo")
        print(mmcore.getLoadedDevices())
    

Why does this exist?

pymmcore is (and should probably remain) a pure SWIG wrapper for the C++ code at the core of the Micro-Manager project. It is sufficient to control micromanager via python, but lacks some "niceties" that python users are accustomed to. This library can extend the core object, add additional methods, docstrings, type hints, etc... and generally feel more pythonic (note however, camelCase method names from the CMMCore API are not converted to snake_case.)

pycro-manager is an excellent library designed to make it easier to work with and control Micro-manager using python. It's core acquisition engine, however, is written in Java, requiring java to be installed and running in the background (either via the micro-manager GUI application directly, or via a headless process). The python half communicates with the Java half using ZeroMQ messaging.

Among other things, this package aims to provide a pure python / C++ implementation of a MMCore acquisition engine, with no Java dependency (see CMMCorePlus.run_mda... it's minimal at the moment and lacks acquisition hooks). To circumvent issues with the GIL, this library also provides a pymmcore_plus.RemoteMMCore proxy object (via Pyro5) that provides a server/client interface for inter-process communication (this serves the same role as the ZMQ server in pycro-manager... but in this case it's communicating with another python process instead of a Java process).

side-note: the useq.MDASequence object that this library uses to define experiments can also generate events consumable by pycro-manager. So if you prefer the pycro-manager approach, but also like the MDASequence schema, you can use both.

Finally, the CMMCorePlus class here adds a callback mechanism that makes it easier to adapt the native MMCore callback system to multiple listeners, across multiple process, which makes it easier to incorporate pymmcore-plus into existing event loops (like a Qt event loop). See napari-micromanager for a nascent project that adds Qt-based GUI interface on top of an interprocess RemoteMMCore.

Quickstart

install

# from pip
pip install pymmcore-plus

# or from source
git clone https://github.com/tlambert03/pymmcore-plus.git
cd pymmcore-plus
pip install -e .

device adapters

In most cases you will want the Micro-manager device adapter libraries. These can be downloaded and installed the usual way from the Micro-manager website (use version 2.0-gamma), or, you can use the included installation script to install to the pymmcore-plus install folder:

python -m pymmcore_plus.install

By default, pymmcore-plus will look first for the Micro-Manager device adapters installed using the above command (i.e. in the current or pymmcore_plus folders), and will then look in your Applications or Program Files directory. To override these default device adapter search path, set the MICROMANAGER_PATH environment variable.

Important: The device interface version must match between pymmcore and the Micro-Manager device adapters.

The device interface version of a given pymmcore version is the fourth part in the version number, and can also be with the following command:

python -c "print(__import__('pymmcore').CMMCore().getAPIVersionInfo())"

The device interface version of a given Micro-Manager installation can be viewed in Help > About Micro-Manager. Or you can look at the MMDevice.h file for the corresponding date, roughly here

Examples

You can find for some basic examples in the examples directory.

run a basic MDASequence from useq-schema

create MMCore in the main thread.

python examples/run_mda.py
from pymmcore_plus import CMMCorePlus
from useq import MDASequence

# see
sequence = MDASequence(
    channels=["DAPI", {"config": "FITC", "exposure": 50}],
    time_plan={"interval": 2, "loops": 5},
    z_plan={"range": 4, "step": 0.5},
    axis_order="tpcz",
)

mmc = CMMCorePlus()
# this will load the `MMConfig_demo.cfg` in your micromanager path
mmc.loadSystemConfiguration("demo")
mmc.run_mda(sequence)

attach to or start a remote CMMCorePlus server

python examples/basic_client.py
from pymmcore_plus import RemoteMMCore

with RemoteMMCore() as mmcore:
    mmcore.loadSystemConfiguration("demo")
    print("loaded:", mmcore.getLoadedDevices())
    ...

use with an event loop

see qt_integration for a slightly more 'realistic' example that drives an experiment in another process using a RemoteMMCore proxy, while receiving feedback in a Qt event loop in the main python thread.

python examples/qt_integration.py

note: you'll need to pip install qtpy pyqt5 (or pyside2) for this to work

Contributing

Contributions welcome. Please fork this library, then clone locally, then install with extras

pip install -e .[testing]

Run pre-commit install to add pre-commit hooks (black, flake8, mypy, etc...) Run tests with pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pymmcore_plus-0.2.1.tar.gz (37.5 kB view details)

Uploaded Source

Built Distribution

pymmcore_plus-0.2.1-py3-none-any.whl (31.0 kB view details)

Uploaded Python 3

File details

Details for the file pymmcore_plus-0.2.1.tar.gz.

File metadata

  • Download URL: pymmcore_plus-0.2.1.tar.gz
  • Upload date:
  • Size: 37.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.11.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.10.2

File hashes

Hashes for pymmcore_plus-0.2.1.tar.gz
Algorithm Hash digest
SHA256 d83c133847bd8a086a831d5df55d16f5726f2d7ce4fb2fb594e2b6cd6adaf70f
MD5 9b30155be1c5f047881a05ab161b9524
BLAKE2b-256 3cd32e43f48bd19c1cb3ca058fc69c93023f2b60d79511cc4200fce829b6e5e9

See more details on using hashes here.

File details

Details for the file pymmcore_plus-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: pymmcore_plus-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 31.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.11.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.10.2

File hashes

Hashes for pymmcore_plus-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 15482f583d43b4e432ef5c389205c9a8216eb4ce99b2836637a782b28fa20a05
MD5 535d81957a8c3a6636c855389c234862
BLAKE2b-256 28a8e75d14aca2910b9844c60f85491d7590c09ab411f78c5d20112c3a122c0a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page