Skip to main content

fine-tune transformer-based language models for named entity recognition

Project description

A python package to fine-tune transformer-based language models for named entity recognition (NER).

PyPI PyPI - Python Version CI https://coveralls.io/repos/github/flxst/nerblackbox/badge.svg?branch=master https://img.shields.io/badge/code%20style-black-000000.svg PyPI - License

Resources

About

Transformer-based language models like BERT have had a game-changing impact on Natural Language Processing.

In order to utilize Hugging Face’s publicly accessible pretrained models for Named Entity Recognition, one needs to retrain (or “fine-tune”) them using labeled text.

nerblackbox makes this easy.

https://raw.githubusercontent.com/flxst/nerblackbox/master/docs/docs/images/nerblackbox.png

You give it

  • a Dataset (labeled text)

  • a Pretrained Model (transformers)

and you get

  • the best Fine-tuned Model

  • its Performance on the dataset

Installation

pip install nerblackbox

Usage

see documentation: https://flxst.github.io/nerblackbox

Citation

@misc{nerblackbox,
  author = {Stollenwerk, Felix},
  title  = {nerblackbox: a python package to fine-tune transformer-based language models for named entity recognition},
  year   = {2021},
  url    = {https://github.com/flxst/nerblackbox},
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nerblackbox-0.0.13.tar.gz (109.1 kB view details)

Uploaded Source

Built Distribution

nerblackbox-0.0.13-py3-none-any.whl (158.7 kB view details)

Uploaded Python 3

File details

Details for the file nerblackbox-0.0.13.tar.gz.

File metadata

  • Download URL: nerblackbox-0.0.13.tar.gz
  • Upload date:
  • Size: 109.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/59.5.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.7

File hashes

Hashes for nerblackbox-0.0.13.tar.gz
Algorithm Hash digest
SHA256 309124414a5fbe9b72553283f7143740089d3aef5b5ba0bfa3e77cb3d54a5547
MD5 3787f2bc148803db00f1c520e0253c67
BLAKE2b-256 ee6314722a094b90528cdb07d2f6aeac8fea518322644773ed2235a91a9a1608

See more details on using hashes here.

File details

Details for the file nerblackbox-0.0.13-py3-none-any.whl.

File metadata

  • Download URL: nerblackbox-0.0.13-py3-none-any.whl
  • Upload date:
  • Size: 158.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/59.5.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.7

File hashes

Hashes for nerblackbox-0.0.13-py3-none-any.whl
Algorithm Hash digest
SHA256 6f89828300efec68d069d4a596d155cd8cd36ffae9b7d91b1fd2e84c23e3f251
MD5 c174f421e4fcfb298714eee53497728b
BLAKE2b-256 c4566a59e8724e362a7393e08b06e8f290fec7bef93ff9d5b2e35fe94dd59d17

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page