Contains Retrieval Augmented Generation related utilities for Azure Machine Learning and OSS interoperability.
Project description
# AzureML Retrieval Augmented Generation Utilities
This package is in alpha stage at the moment, use at risk of breaking changes and unstable behavior.
It contains utilities for:
Processing text documents into chunks appropriate for use in LLM prompts, with metadata such is source url.
Embedding chunks with OpenAI or HuggingFace embeddings models, including the ability to update a set of embeddings over time.
Create MLINdex artifacts from embeddings, a yaml file capturing metadata needed to deserialize different kinds of Vector Indexes for use in langchain. Supported Index types: - FAISS index (via langchain) - Azure Cognitive Search index
## Getting started
You can install AzurrML RAG package via pip.
`bash pip install azureml-rag `
## Documentation
TBA
# Changelog
## 0.1.2 (2023-05-05)
Refactored document chunking to allow insertion of custom processing logic
## 0.0.1 (2023-04-25)
### Features Added - Introduced package - langchain Retriever for Azure Cognitive Search
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
File details
Details for the file azureml_rag-0.1.2-py3-none-any.whl.
File metadata
- Download URL: azureml_rag-0.1.2-py3-none-any.whl
- Upload date:
- Size: 163.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.9.6 requests/2.30.0 setuptools/50.3.2 requests-toolbelt/1.0.0 tqdm/4.65.0 CPython/3.8.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b172577761bf6542769ac00e687f71c1401e0c69f6b115c05c09cb352bab4374 |
|
| MD5 | f5c02c691a5829fade0af83c08410cc9 |
|
| BLAKE2b-256 | dfbe4dc18a991e774ebba44b68436663e1c880e740aac51a5fce1182058dea60 |
