Comet logger for LLM
Project description
With cometLLM, effortlessly track and visualize your LLM prompts and chains. Identify effective strategies, troubleshoot efficiently, and ensure reproducible workflows. Streamline your processes and unleash the full potential of your Large Language Models today.
⚡️ Quickstart
Install comet_llm Python library with pip:
pip install comet_llm
If you don't have already, create your free Comet account and grab your API Key from the account settings page.
Now you are all set to log your first prompt and response:
import comet_llm
comet_llm.log_prompt(
prompt="What is your name?",
output=" My name is Alex.",
api_key="<YOUR_COMET_API_KEY>",
)
🎯 Features
- Log your prompts and responses, including prompt template, variables, timestamps and duration and any metadata that you need.
- Visualize your prompts and responses in the UI.
- Log your chain execution down to the level of granularity that you need.
- Visualize your chain execution in the UI.
- Diff your prompts and chain execution in the UI.
👀 Examples
Log a full prompt and response
import comet_llm
comet_llm.log_prompt(
prompt="Answer the question and if the question can't be answered, say \"I don't know\"\n\n---\n\nQuestion: What is your name?\nAnswer:",
prompt_template="Answer the question and if the question can't be answered, say \"I don't know\"\n\n---\n\nQuestion: {{question}}?\nAnswer:",
prompt_template_variables={"question": "What is your name?"},
metadata= {
"usage.prompt_tokens": 7,
"usage.completion_tokens": 5,
"usage.total_tokens": 12,
},
output=" My name is Alex.",
duration=16.598,
)
⚙️ Configuration
You can configure your Comet credentials and where you are logging data to:
| Name | Python parameter name | Environment variable name |
|---|---|---|
| Comet API KEY | api_key | COMET_API_KEY |
| Comet Workspace name | workspace | COMET_WORKSPACE |
| Comet Project name | project_name | COMET_PROJECT_NAME |
📝 License
Copyright (c) Comet 2023-present. cometLLM is free and open-source software licensed under the MIT License.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file comet_llm-1.0.0.tar.gz.
File metadata
- Download URL: comet_llm-1.0.0.tar.gz
- Upload date:
- Size: 9.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b4336977d2ccd71975e076f077776577b47000062fccee65b26539a633df8b65 |
|
| MD5 | 490ea5eac215530d08af7957d72f0b09 |
|
| BLAKE2b-256 | 3a9ccf265136031751a4853c97581dffa14e93b4b0cfdeb73ace31fc22fc30f9 |
File details
Details for the file comet_llm-1.0.0-py3-none-any.whl.
File metadata
- Download URL: comet_llm-1.0.0-py3-none-any.whl
- Upload date:
- Size: 13.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.1 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5b70afc4881a271fe5875d04ada18bfa2c990ae5be066761f36fdb08b4ef8905 |
|
| MD5 | 06c37a9f324e8d7f15c19e6600b24f7b |
|
| BLAKE2b-256 | b937b20fbdf0034bc831e11bd736837976652b1517042a272df72a9e122163c8 |
