A set of utilities for generating quality scores for MediaWiki revisions
Project description
Revision Scoring
A generic, machine learning-based revision scoring system designed to be used to automatically differentiate damage from productive contributory behavior on Wikipedia.
Example
Using a scorer_model to score a revision:
>>> import mwapi >>> from revscoring import ScorerModel >>> from revscoring.extractors import APIExtractor >>> >>> with open("models/enwiki.damaging.linear_svc.model") as f: ... scorer_model = ScorerModel.load(f) ... >>> extractor = APIExtractor(mwapi.Session(host="https://en.wikipedia.org", ... user_agent="revscoring demo")) >>> >>> feature_values = extractor.extract(123456789, scorer_model.features) >>> >>> print(scorer_model.score(feature_values)) {'prediction': True, 'probability': {False: 0.4694409344514984, True: 0.5305590655485017}}
Installation
The easiest way to install revscoring is via the Python package installer (pip).
pip install revscoring
You may find that some of revscorings dependencies fail to compile (namely scipy, numpy and sklearn). In that case, you’ll need to install some dependencies in your operating system.
- Ubuntu & Debian:
Run sudo apt-get install python3-dev g++ gfortran liblapack-dev libopenblas-dev
- Windows:
‘TODO’
- MacOS:
‘TODO’
Finally, in order to make use of language features, you’ll need to download some NLTK data. The following command will get the necessary corpus.
python -m nltk.downloader stopwords
You’ll also need to install enchant compatible dictionaries of the languages you’d like to use. We recommend the following:
languages.arabic: aspell-ar
languages.dutch: myspell-nl
languages.english: myspell-en-us myspell-en-gb myspell-en-au
languages.estonian: myspell-et
languages.french: myspell-fr
languages.german: myspell-de-at myspell-de-ch myspell-de-de
languages.indonesian: aspell-id
languages.italian: myspell-it
languages.hebrew: myspell-he
languages.persian: myspell-fa
languages.polish: aspell-pl
languages.portuguese: myspell-pt
languages.spanish: myspell-es
languages.ukrainian: myspell-uk
languages.vietnamese: hunspell-vi
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file revscoring-1.0.1.tar.gz
.
File metadata
- Download URL: revscoring-1.0.1.tar.gz
- Upload date:
- Size: 132.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | bdb155d59d27bcc14530f49962cd2a4c46ea9a81b6cda69e24493f5dd861ea0d |
|
MD5 | 23890ec47bb351add246a71e70355d73 |
|
BLAKE2b-256 | 1f579b1cc4c1a863e0e10b75c7f8cc5ed9185955c51d540c17c276d81e903ed5 |
File details
Details for the file revscoring-1.0.1-py2.py3-none-any.whl
.
File metadata
- Download URL: revscoring-1.0.1-py2.py3-none-any.whl
- Upload date:
- Size: 312.4 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0223c691e80e3c1e1c06293b84d7c0561d6ad79acf9dd68aafb2132c8f46df52 |
|
MD5 | cc443089bdb9f8ae2da6566ecb0ea617 |
|
BLAKE2b-256 | 90e200336df94dc9b9254f85f7ee8162a15e32da24eb237b5449efb9302517f4 |