SimulEval: A Flexible Toolkit for Automated Machine Translation Evaluation
Project description
SimulEval
SimulEval is a general evaluation framework for simultaneous translation on text and speech. Full documentation can be found here.
Installation
git clone https://github.com/facebookresearch/SimulEval.git
cd SimulEval
pip install -e .
Quick Start
Following is the evaluation of a dummy agent which operates wait-k (k = 3) policy and generates random words until the length of the generated words is the same as the number of all the source words.
cd examples/quick_start
simuleval --source source.txt --target target.txt --agent first_agent.py
License
SimulEval is licensed under Creative Commons BY-SA 4.0.
Citation
Please cite as:
@inproceedings{simuleval2020,
title = {Simuleval: An evaluation toolkit for simultaneous translation},
author = {Xutai Ma, Mohammad Javad Dousti, Changhan Wang, Jiatao Gu, Juan Pino},
booktitle = {Proceedings of the EMNLP},
year = {2020},
}
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
simuleval-1.1.4.tar.gz
(582.6 kB
view details)
Built Distribution
simuleval-1.1.4-py3-none-any.whl
(47.3 kB
view details)
File details
Details for the file simuleval-1.1.4.tar.gz
.
File metadata
- Download URL: simuleval-1.1.4.tar.gz
- Upload date:
- Size: 582.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/4.0.2 CPython/3.11.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e8fc17c217cf61044d6190e8f9b88d9b35f59edb4d2309a7a253c6cf32a78e08 |
|
MD5 | 9397641ef8a074839b3586af9026f905 |
|
BLAKE2b-256 | ba11ddaec370a420450589334a5ad3f2804823ec537100e540d58eb5e50886d3 |
Provenance
File details
Details for the file simuleval-1.1.4-py3-none-any.whl
.
File metadata
- Download URL: simuleval-1.1.4-py3-none-any.whl
- Upload date:
- Size: 47.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/4.0.2 CPython/3.11.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6cdfae20a5cd2a7a1ca5879a23a448ee4c54aeee442fa30ad6e41f5313a36808 |
|
MD5 | 4863a0d9b50755e354a1e7a58a890a5c |
|
BLAKE2b-256 | 040ef04e3cbc4542f4527848e2f77875af9f62b6cab0626eb7814caa89e8ec0a |