PO2Dataset

po2dataset is a python tool to extract sentences from po files and create language datasets for NLP machine learning and neural machine translation.

This command line tool is intended to create dataset packages suitable for Argos Train.

How to install

From pip

pip install po2dataset

Manual installation

Create a virtual environment using virtualenv

git clone https://github.com/urtzai/po2dataset.git
virtualenv po2dataset
cd po2dataset
source ./bin/activate

Quick start guide

Create Argos Train suitable dataset

po2dataset <path_to_po_file> --name <project_name> --source_code <source_lang_code> --target_code <target_lang_code> --ref "Some reference information of the project"

Where:

• name: The name of the project
• source_code: Source language code (ISO 639)
• target_code: Target language code (ISO 639)
• ref: Some reference information of the project

Optional arguments:

• format: Extension name of the zip file (default argosdata)
• license: License to add into the package (default CC0)

Support

Should you experience any issues do not hesistate to post an issue or contribute in this project pulling requests.