Multi-label Text Classification Toolkit
Project description
<h1 align="center">Caver</h1>
<p align="center">Rising a torch in the cave to see the words on the wall, tag your short text in 3 lines. Caver uses Facebook's <a href="https://pytorch.org/">PyTorch</a> project to make the implementation easier.</p>
<p align="center">
<a href="https://pypi-hypernode.com/project/caver/">
<img src="https://img.shields.io/pypi/v/caver.svg?colorB=brightgreen"
alt="Pypi package">
</a>
<a href="https://github.com/guokr/caver/releases">
<img src="https://img.shields.io/github/release/guokr/caver.svg"
alt="GitHub release">
</a>
<a href="https://github.com/guokr/caver/issues">
<img src="https://img.shields.io/github/issues/guokr/caver.svg"
alt="GitHub issues">
</a>
<a href="https://travis-ci.org/guokr/Caver/">
<img src="https://travis-ci.org/guokr/Caver.svg"
alt="Travis CI">
</a>
</p>
<p align="center">
<a href="#quick-demo">Demo</a> •
<a href="#requirements">Requirements</a> •
<a href="#install">Install</a> •
<a href="#did-you-guys-have-some-pre-trained-models">Pre-trained models</a> •
<a href="#how-to-train-on-your-own-dataset">Train</a> •
<a href="#more-examples">Examples</a> •
<a href="https://guokr.github.io/Caver/">Document</a>
</p>
<p align="center">
<img src=".github/demo.gif?raw=true" width="700">
</p>
<h2 align="center">Quick Demo</h2>
```python
from caver import CaverModel
model = CaverModel("./checkpoint_path")
sentence = ["看 英 语 学 美 剧 靠 谱 吗", "科 比 携 手 姚 明 出 任 2019 篮 球 世 界 杯 全 球 大 使"]
model.predict(sentence[0], top_k=3)
>>> ['英语学习', '英语', '美剧']
model.predict(sentence[1], top_k=10)
>>> ['篮球', 'NBA', '体育', 'NBA 球员', '运动']
```
<h2 align="center">Requirements</h2>
* PyTorch
* tqdm
* torchtext
* numpy
* Python3
<h2 align="center">Install</h2>
```bash
$ pip install caver --user
```
<h2 align="center">Did you guys have some pre-trained models</h2>
Yes, we have released two pre-trained models on Zhihu NLPCC2018 [opendataset](http://tcci.ccf.org.cn/conference/2018/taskdata.php).
If you want to use the pre-trained model for performing text tagging, you can download it (along with other important inference material) from the Caver releases page. Alternatively, you can run the following command to download and unzip the files in your current directory:
```bash
$ wget -O - https://github.com/guokr/Caver/releases/download/0.1/checkpoints_char_cnn.tar.gz | tar zxvf -
$ wget -O - https://github.com/guokr/Caver/releases/download/0.1/checkpoints_char_lstm.tar.gz | tar zxvf -
```
<h2 align="center">How to train on your own dataset</h2>
```bash
$ python3 train.py --input_data_dir {path to your origin dataset}
--output_data_dir {path to store the preprocessed dataset}
--train_filename train.tsv
--valid_filename valid.tsv
--checkpoint_dir {path to save the checkpoints}
--model {fastText/CNN/LSTM}
--batch_size {16, you can modify this for you own}
--epoch {10}
```
<h2 align="center">More Examples</h2>
It's updating, but basically you can check [examples](https://github.com/guokr/Caver/tree/master/examples).
<p align="center">Rising a torch in the cave to see the words on the wall, tag your short text in 3 lines. Caver uses Facebook's <a href="https://pytorch.org/">PyTorch</a> project to make the implementation easier.</p>
<p align="center">
<a href="https://pypi-hypernode.com/project/caver/">
<img src="https://img.shields.io/pypi/v/caver.svg?colorB=brightgreen"
alt="Pypi package">
</a>
<a href="https://github.com/guokr/caver/releases">
<img src="https://img.shields.io/github/release/guokr/caver.svg"
alt="GitHub release">
</a>
<a href="https://github.com/guokr/caver/issues">
<img src="https://img.shields.io/github/issues/guokr/caver.svg"
alt="GitHub issues">
</a>
<a href="https://travis-ci.org/guokr/Caver/">
<img src="https://travis-ci.org/guokr/Caver.svg"
alt="Travis CI">
</a>
</p>
<p align="center">
<a href="#quick-demo">Demo</a> •
<a href="#requirements">Requirements</a> •
<a href="#install">Install</a> •
<a href="#did-you-guys-have-some-pre-trained-models">Pre-trained models</a> •
<a href="#how-to-train-on-your-own-dataset">Train</a> •
<a href="#more-examples">Examples</a> •
<a href="https://guokr.github.io/Caver/">Document</a>
</p>
<p align="center">
<img src=".github/demo.gif?raw=true" width="700">
</p>
<h2 align="center">Quick Demo</h2>
```python
from caver import CaverModel
model = CaverModel("./checkpoint_path")
sentence = ["看 英 语 学 美 剧 靠 谱 吗", "科 比 携 手 姚 明 出 任 2019 篮 球 世 界 杯 全 球 大 使"]
model.predict(sentence[0], top_k=3)
>>> ['英语学习', '英语', '美剧']
model.predict(sentence[1], top_k=10)
>>> ['篮球', 'NBA', '体育', 'NBA 球员', '运动']
```
<h2 align="center">Requirements</h2>
* PyTorch
* tqdm
* torchtext
* numpy
* Python3
<h2 align="center">Install</h2>
```bash
$ pip install caver --user
```
<h2 align="center">Did you guys have some pre-trained models</h2>
Yes, we have released two pre-trained models on Zhihu NLPCC2018 [opendataset](http://tcci.ccf.org.cn/conference/2018/taskdata.php).
If you want to use the pre-trained model for performing text tagging, you can download it (along with other important inference material) from the Caver releases page. Alternatively, you can run the following command to download and unzip the files in your current directory:
```bash
$ wget -O - https://github.com/guokr/Caver/releases/download/0.1/checkpoints_char_cnn.tar.gz | tar zxvf -
$ wget -O - https://github.com/guokr/Caver/releases/download/0.1/checkpoints_char_lstm.tar.gz | tar zxvf -
```
<h2 align="center">How to train on your own dataset</h2>
```bash
$ python3 train.py --input_data_dir {path to your origin dataset}
--output_data_dir {path to store the preprocessed dataset}
--train_filename train.tsv
--valid_filename valid.tsv
--checkpoint_dir {path to save the checkpoints}
--model {fastText/CNN/LSTM}
--batch_size {16, you can modify this for you own}
--epoch {10}
```
<h2 align="center">More Examples</h2>
It's updating, but basically you can check [examples](https://github.com/guokr/Caver/tree/master/examples).
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
caver-0.1.tar.gz
(14.5 kB
view details)
File details
Details for the file caver-0.1.tar.gz
.
File metadata
- Download URL: caver-0.1.tar.gz
- Upload date:
- Size: 14.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/39.1.0 requests-toolbelt/0.8.0 tqdm/4.23.4 CPython/3.5.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5064ef5077eca27773f3c815efd3353045c9d44ace822cfccaa3e647d3a48e01 |
|
MD5 | 5501923d05f3056c446eccbeeb1b6426 |
|
BLAKE2b-256 | a2a3a7d0084938682dbdabd1cb42b4466c8ead9c49b3a227c412d886f1e7808c |