nerblackbox 0.0.15

Resources

• Source Code: https://github.com/flxst/nerblackbox

• Documentation: https://flxst.github.io/nerblackbox

• PyPI: https://pypi-hypernode.com/project/nerblackbox

Installation

pip install nerblackbox

About

Take a dataset from one of many available sources. Then train, evaluate and apply a language model in a few simple steps.

dataset = Dataset("conll2003",  source="HF")  # HuggingFace
dataset = Dataset("my_dataset", source="LF")  # Local Filesystem
dataset = Dataset("swe_nerc",   source="BI")  # Built-in

dataset.set_up()

experiment = Experiment("my_experiment", model="bert-base-cased", dataset="conll2003")

experiment.run()
experiment.get_result(metric="f1", level="entity", phase="test")
# 0.9045

model = Model.from_experiment("my_experiment")

evaluation_dict = model.evaluate_on_dataset("ehealth_kd", "jsonl", phase="test")
evaluation_dict["micro"]["entity"]["f1"]
# 0.9045

model = Model.from_experiment("my_experiment")

model.predict("The United Nations has never recognised Jakarta's move.")
# [[
#  {'char_start': '4', 'char_end': '18', 'token': 'United Nations', 'tag': 'ORG'},
#  {'char_start': '40', 'char_end': '47', 'token': 'Jakarta', 'tag': 'LOC'}
# ]]

Features

Data

• Integration of Datasets from Multiple Sources (HuggingFace, Annotation Tools, ..)

• Support for Multiple Dataset Types (Standard, Pretokenized)

• Support for Multiple Annotation Schemes (IO, BIO, BILOU)

• Text Encoding

Training

• Adaptive Fine-tuning

• Hyperparameter Search

• Multiple Runs with Different Random Seeds

• Detailed Analysis of Training Results

Evaluation

• Evaluation of Any Model on Any Dataset

Inference

• Versatile Model Inference (Entity/Word Level, Probabilities, ..)

Other

• Full Compatibility with HuggingFace

• GPU Support

• Language Agnosticism

See the documentation for details.

Citation

@misc{nerblackbox,
  author = {Stollenwerk, Felix},
  title  = {nerblackbox: a python package to fine-tune transformer-based language models for named entity recognition},
  year   = {2021},
  url    = {https://github.com/flxst/nerblackbox},
}