Language Interpretability Tool.
Project description
Language Interpretability Tool (LIT)
The Language Interpretability Tool (LIT) is a visual, interactive model-understanding tool for NLP models.
LIT is built to answer questions such as:
- What kind of examples does my model perform poorly on?
- Why did my model make this prediction? Can this prediction be attributed to adversarial behavior, or to undesirable priors in the training set?
- Does my model behave consistently if I change things like textual style, verb tense, or pronoun gender?
LIT supports a variety of debugging workflows through a browser-based UI. Features include:
- Local explanations via salience maps, attention, and rich visualization of model predictions.
- Aggregate analysis including custom metrics, slicing and binning, and visualization of embedding spaces.
- Counterfactual generation via manual edits or generator plug-ins to dynamically create and evaluate new examples.
- Side-by-side mode to compare two or more models, or one model on a pair of examples.
- Highly extensible to new model types, including classification, regression, span labeling, seq2seq, and language modeling. Supports multi-head models and multiple input features out of the box.
- Framework-agnostic and compatible with TensorFlow, PyTorch, and more.
The source code and documentation can be found at https://github.com/pair-code/lit.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
lit_nlp-0.3-py3-none-any.whl
(599.4 kB
view details)
File details
Details for the file lit_nlp-0.3-py3-none-any.whl
.
File metadata
- Download URL: lit_nlp-0.3-py3-none-any.whl
- Upload date:
- Size: 599.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/3.7.3 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.7.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e099975a639267a89e1a22dd90c4c1a459bb22ad4ec385d0b4d02bcf5a301250 |
|
MD5 | 7508326e421a1be8392f95883ec1a381 |
|
BLAKE2b-256 | 0db4b96454c9435756212cfa91ec8db3d7a2eeb818fb95cf8dda9100eef40bd9 |