Skip to main content

fine-tune transformer-based language models for named entity recognition

Project description

A python package to fine-tune transformer-based language models for named entity recognition (NER).

PyPI PyPI - Python Version Travis CI https://coveralls.io/repos/github/af-ai-center/nerblackbox/badge.svg?branch=master https://img.shields.io/badge/code%20style-black-000000.svg PyPI - License

Resources

About

Transformer-based language models like BERT have had a game-changing impact on Natural Language Processing.

In order to utilize Hugging Face’s publicly accessible pretrained models for Named Entity Recognition, one needs to retrain (or “fine-tune”) them using labeled text.

nerblackbox makes this easy.

https://raw.githubusercontent.com/af-ai-center/nerblackbox/master/docs/docs/images/nerblackbox.png

You give it

  • a Dataset (labeled text)

  • a Pretrained Model (transformers)

and you get

  • the best Fine-tuned Model

  • its Performance on the dataset

Installation

pip install nerblackbox

Usage

see documentation: https://af-ai-center.github.io/nerblackbox

Citation

@misc{nerblackbox,
  author = {Stollenwerk, Felix},
  title  = {nerblackbox: a python package to fine-tune transformer-based language models for named entity recognition},
  year   = {2021},
  url    = {https://github.com/af-ai-center/nerblackbox},
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nerblackbox-0.0.11.tar.gz (66.1 kB view details)

Uploaded Source

Built Distribution

nerblackbox-0.0.11-py3-none-any.whl (90.2 kB view details)

Uploaded Python 3

File details

Details for the file nerblackbox-0.0.11.tar.gz.

File metadata

  • Download URL: nerblackbox-0.0.11.tar.gz
  • Upload date:
  • Size: 66.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/47.3.2 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.7.7

File hashes

Hashes for nerblackbox-0.0.11.tar.gz
Algorithm Hash digest
SHA256 d3e5cde8e71f1690fd29770bc5d4cfe3e73264bb92a7752f59d6f0f8813e58b5
MD5 a064bead3a99f00be82917e4e7156f42
BLAKE2b-256 e972d93298eed3b84c2fbf00241e7788c8f15eae6756e1058695fd94ef6bd3ff

See more details on using hashes here.

File details

Details for the file nerblackbox-0.0.11-py3-none-any.whl.

File metadata

  • Download URL: nerblackbox-0.0.11-py3-none-any.whl
  • Upload date:
  • Size: 90.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/47.3.2 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.7.7

File hashes

Hashes for nerblackbox-0.0.11-py3-none-any.whl
Algorithm Hash digest
SHA256 ff04c7b064c45bac4226d031b94684c8bae6c0af64195844f3c4d4f0b08f26da
MD5 4f3590ec3a49e325229df6b431d8fa30
BLAKE2b-256 e9a56e3442dbd551ca3c6a2ce204a4a1b9ad6c0f1a3be2f4d1c9620ee26e7b71

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page