Skip to main content

fine-tune transformer-based language models for named entity recognition

Project description

A python package to fine-tune transformer-based language models for named entity recognition (NER).

PyPI PyPI - Python Version CI https://coveralls.io/repos/github/flxst/nerblackbox/badge.svg?branch=master https://img.shields.io/badge/code%20style-black-000000.svg PyPI - License

Resources

About

Transformer-based language models like BERT have had a game-changing impact on Natural Language Processing.

In order to utilize Hugging Face’s publicly accessible pretrained models for Named Entity Recognition, one needs to retrain (or “fine-tune”) them using labeled text.

nerblackbox makes this easy.

https://raw.githubusercontent.com/flxst/nerblackbox/master/docs/docs/images/nerblackbox.png

You give it

  • a Dataset (labeled text)

  • a Pretrained Model (transformers)

and you get

  • the best Fine-tuned Model

  • its Performance on the dataset

Installation

pip install nerblackbox

Usage

see documentation: https://flxst.github.io/nerblackbox

Citation

@misc{nerblackbox,
  author = {Stollenwerk, Felix},
  title  = {nerblackbox: a python package to fine-tune transformer-based language models for named entity recognition},
  year   = {2021},
  url    = {https://github.com/flxst/nerblackbox},
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nerblackbox-0.0.12.tar.gz (93.1 kB view details)

Uploaded Source

Built Distribution

nerblackbox-0.0.12-py3-none-any.whl (142.2 kB view details)

Uploaded Python 3

File details

Details for the file nerblackbox-0.0.12.tar.gz.

File metadata

  • Download URL: nerblackbox-0.0.12.tar.gz
  • Upload date:
  • Size: 93.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/47.3.2 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.7

File hashes

Hashes for nerblackbox-0.0.12.tar.gz
Algorithm Hash digest
SHA256 94d0b8dbdb728bbcd2897201e3b3216178bc4d287b75a2a1becc474010a731bc
MD5 6f2c6419784edbc21ec6f7731578794e
BLAKE2b-256 4feba6304cabefa105ae4d8d10ed33dc97c25f1f1df7b6334f66f5b2b726c9a4

See more details on using hashes here.

File details

Details for the file nerblackbox-0.0.12-py3-none-any.whl.

File metadata

  • Download URL: nerblackbox-0.0.12-py3-none-any.whl
  • Upload date:
  • Size: 142.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/47.3.2 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.7

File hashes

Hashes for nerblackbox-0.0.12-py3-none-any.whl
Algorithm Hash digest
SHA256 b66139e7b36c8ccd97d683b49fa365da134801e5e3ce24beacb70ce2692ff7d6
MD5 0a358a5fd56a4466331b4fbcf255b7d2
BLAKE2b-256 8fcaa8d5b0e26043cde9e101d83eaef3e465fed98ee2e48bace0d8f17b68e775

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page