Skip to main content

Language Interpretability Tool.

Project description

Language Interpretability Tool (LIT)

The Language Interpretability Tool (LIT) is a visual, interactive model-understanding tool for NLP models.

LIT is built to answer questions such as:

  • What kind of examples does my model perform poorly on?
  • Why did my model make this prediction? Can this prediction be attributed to adversarial behavior, or to undesirable priors in the training set?
  • Does my model behave consistently if I change things like textual style, verb tense, or pronoun gender?

LIT supports a variety of debugging workflows through a browser-based UI. Features include:

  • Local explanations via salience maps, attention, and rich visualization of model predictions.
  • Aggregate analysis including custom metrics, slicing and binning, and visualization of embedding spaces.
  • Counterfactual generation via manual edits or generator plug-ins to dynamically create and evaluate new examples.
  • Side-by-side mode to compare two or more models, or one model on a pair of examples.
  • Highly extensible to new model types, including classification, regression, span labeling, seq2seq, and language modeling. Supports multi-head models and multiple input features out of the box.
  • Framework-agnostic and compatible with TensorFlow, PyTorch, and more.

The source code and documentation can be found at https://github.com/pair-code/lit.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

lit_nlp-0.4.1-py3-none-any.whl (746.0 kB view details)

Uploaded Python 3

File details

Details for the file lit_nlp-0.4.1-py3-none-any.whl.

File metadata

  • Download URL: lit_nlp-0.4.1-py3-none-any.whl
  • Upload date:
  • Size: 746.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.8.1 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7

File hashes

Hashes for lit_nlp-0.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 02989f6a0767036a1b577063d46ecb1953d286def191ae0eb7aba3a64adfc754
MD5 a7a2a5ca70c96bd68d66e2f935c755ff
BLAKE2b-256 9409cffdbee9e6641e4eb40b86fc81cc12bc263e2f7cc0397d3a00cb78198c9c

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page