tool to convert Tolias Lab matlab intracellular electrophysiology data into NWB:N format
Project description
tolias-lab-to-nwb
Code for converting Tolias Lab data to NWB. The text metadata is stored in a YAML file, and must be edited with the correct fields to be added to the NWB file.
author: Ben Dichter, ben.dichter@gmail.com
This software was put together in collaboration with the Tolias and Berens labs under the DANDI project.
Installation
pip install tolias-lab-to-nwb
Usage
Convert all in python:
from tolias_lab_to_nwb.convert import convert_all
convert_all(data_dir='/Volumes/easystore5T/data/Tolias/ephys',
metafile_fpath='metafile.yml',
out_dir='/Volumes/easystore5T/data/Tolias/nwb',
meta_csv_file='/Volumes/easystore5T/data/Tolias/ephys/mini-atlas-meta-data.csv')
Convert single session in python:
import os
from dateutil import parser
from ruamel import yaml
from scipy.io import loadmat
from tolias_lab_to_nwb.convert import ToliasNWBConverter
from tolias_lab_to_nwb.data_prep import data_preparation
input_fpath = '/path/to/08 01 2019 sample 1.mat'
output_fpath = 'path/to/dest.nwb'
metafile_fpath = 'path/to/metafile.yml'
fpath_base, fname = os.path.split(input_fpath)
session_id = os.path.splitext(fname)[0]
with open(metafile_fpath) as f:
metadata = yaml.safe_load(f)
metadata['NWBFile']['session_start_time'] = parser.parse(session_id[:10])
metadata['NWBFile']['session_id'] = session_id
tolias_converter = ToliasNWBConverter(metadata)
data = loadmat(input_fpath)
time, current, voltage, curr_index_0 = data_preparation(data)
tolias_converter.add_icephys_data(current, voltage, rate=25e3)
tolias_converter.save(output_fpath)
in command line:
usage: convert.py [-h] [-o OUTPUT_FPATH] [-m METAFILE] input_fpath
convert .mat file to NWB
positional arguments:
input_fpath path of .mat file to convert
optional arguments:
-h, --help show this help message and exit
-o OUTPUT_FPATH, --output_fpath OUTPUT_FPATH
path to save NWB file. If not provided, file will
output as input_fname.nwb in the same directory
as the input data.
-m METAFILE, --metafile METAFILE
YAML file that contains metadata for experiment.
If not provided, will look for metafile.yml in the
same directory as the input data.
example usage:
python -m tolias_lab_to_nwb.convert '/path/to/08 01 2019 sample 1.mat'
python -m tolias_lab_to_nwb.convert '/path/to/08 01 2019 sample 1.mat' -m path/to/metafile.yml
python -m tolias_lab_to_nwb.convert '/path/to/08 01 2019 sample 1.mat' -m path/to/metafile.yml -o path/to/dest.nwb
Reading the resulting NWB files in python
from pynwb import NWBHDF5IO
import numpy as np
import matplotlib.pyplot as plt
fpath = 'path/to/08 01 2019 sample 1.nwb'
io = NWBHDF5IO(fpath, 'r')
nwb = io.read()
def plot_sweep(sweep, ax=None):
if ax is None:
_, ax = plt.subplots()
dat = sweep.data[:]
yy = dat * sweep.conversion
xx = np.arange(len(dat))/sweep.rate
ax.plot(xx, yy)
ax.set_ylabel(sweep.unit)
ax.set_xlabel('time (s)')
def get_stim_and_response(nwb, stim_name):
stimulus = nwb.stimulus[stim_name]
df = nwb.sweep_table.to_dataframe()
stim_select = df['series'].apply(lambda x: x[0].object_id) == stimulus.object_id
sweep_number = df['sweep_number'][stim_select].values[0]
resp_select = df['sweep_number'] == sweep_number - stim_select
response = df['series'][resp_select].values[0][0]
return stimulus, response
stimulus, response = get_stim_and_response(nwb, 'CurrentClampStimulusSeries002')
fig, axs = plt.subplots(2,1, sharex=True)
plot_sweep(stimulus, ax=axs[0])
plot_sweep(response, ax=axs[1])
_ = axs[0].set_xlabel('')
reading data in MATLAB
%% read
fpath = '/Volumes/easystore5T/data/Tolias/08 01 2019 sample 1.nwb';
nwb = nwbRead(fpath);
stim_name = 'CurrentClampStimulusSeries002';
stimulus = nwb.stimulus_presentation.get(stim_name);
sweep_table = nwb.general_intracellular_ephys_sweep_table;
sweep_numbers = sweep_table.sweep_number.data.load;
for i = 1:length(sweep_table.series.data)
obj = sweep_table.series.data(i);
if obj.refresh(nwb) == stimulus
sweep_number = sweep_numbers(i);
break;
end
end
ind = find(sweep_numbers == sweep_number);
ind = ind(ind ~= i); % remove stim ind
response = sweep_table.series.data(ind).refresh(nwb);
%% plot
yy = stimulus.data.load * stimulus.data_conversion;
xx = (1:length(yy)) / stimulus.starting_time_rate;
subplot(2,1,1)
plot(xx,yy)
ylabel(stimulus.data_unit)
yy = response.data.load * response.data_conversion;
xx = (1:length(yy)) / response.starting_time_rate;
subplot(2,1,2)
plot(xx,yy)
ylabel(response.data_unit)
xlabel('time (s)')
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tolias_lab_to_nwb-0.3.0.tar.gz
(32.4 kB
view details)
Built Distribution
File details
Details for the file tolias_lab_to_nwb-0.3.0.tar.gz
.
File metadata
- Download URL: tolias_lab_to_nwb-0.3.0.tar.gz
- Upload date:
- Size: 32.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.42.0 CPython/3.8.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f06396df1580c6ac4a47b8f77bad260662a0266985e5d30b3a3bc26484725daf |
|
MD5 | 69225455114b9e6d42fcde1eb211d987 |
|
BLAKE2b-256 | da0161cd4dc3476ecb2ee4c7fb5401823d4d124463c6818ceaddfc312501644c |
File details
Details for the file tolias_lab_to_nwb-0.3.0-py3-none-any.whl
.
File metadata
- Download URL: tolias_lab_to_nwb-0.3.0-py3-none-any.whl
- Upload date:
- Size: 32.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.42.0 CPython/3.8.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 409d3f48bc11c1f088778924ba14cb69a83272a2e734732547d974a19c665739 |
|
MD5 | d2ebbb38c4132121dd77a2d3b95c502d |
|
BLAKE2b-256 | 397f893c1a9a40f245fe67411af34b055f77cccebb18a14ae2c5cc63ba9272e9 |