Rago is a lightweight framework for RAG
Project description
Rago
Rago is a lightweight framework for RAG.
- Software License: BSD 3 Clause
- Documentation: https://osl-incubator.github.io/rago
Features
- Support for Hugging Face
- Support for llama
Installation
If you want to install it for cpu only, you can run:
$ pip install rago[cpu]
But, if you want to install it for gpu (cuda), you can run:
$ pip install rago[gpu]
Setup
Llama 3
In order to use a llama model, visit its page on huggingface and request your access in its form, for example: https://huggingface.co/meta-llama/Llama-3.2-1B.
After you are granted access to the desired model, you will be able to use it with Rago.
you will also need to provide a hugging face token in order to download the models locally, for example:
rag = Rago(
retrieval=StringRet(animals_data),
augmented=SentenceTransformerAug(top_k=3),
generation=LlamaGen(apikey=HF_TOKEN),
)
rag.prompt('Is there any animals larger than a dinosaur?')
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
rago-0.9.0.tar.gz
(11.4 kB
view details)
Built Distribution
rago-0.9.0-py3-none-any.whl
(19.3 kB
view details)
File details
Details for the file rago-0.9.0.tar.gz.
File metadata
- Download URL: rago-0.9.0.tar.gz
- Upload date:
- Size: 11.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.4 CPython/3.11.10 Linux/6.5.0-1025-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 6e7dab9c24784703b9d646af98da48a40d87ea6dbfd4c2a851de6964a92850de |
|
| MD5 | a71c90346132e4ce87d8d9ac936458db |
|
| BLAKE2b-256 | 9fed733a793595c83f95e2d6e4c8cccf8dfa74aad621779eea82ddfdbd5d263d |
File details
Details for the file rago-0.9.0-py3-none-any.whl.
File metadata
- Download URL: rago-0.9.0-py3-none-any.whl
- Upload date:
- Size: 19.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.4 CPython/3.11.10 Linux/6.5.0-1025-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 0474b6ae30409558c8db704aca8d03f9f32aa39893fd9833bef33724a6d0d7d4 |
|
| MD5 | 6b4eaedc93d547cf96028cd8b22af0aa |
|
| BLAKE2b-256 | dc36493eb85ca703ef4b8029bc0921073e0d1b146ca84ab64bdde58297e3af97 |
