Cycls SDK
Project description
cycls.py
pip install cycls
sync app
from cycls import Cycls, Message, Text
push = Cycls()
@push("cake")
def app(m: Message):
return Text(m.content)
https://cycls.com/@cake
async app
from cycls import Cycls, Message, Text
push = Cycls()
@push("her")
async def app(m: Message):
return Text(m.content)
https://cycls.com/@her
debug
push = Cycls(debug=True)
groq app
from cycls import Cycls, Message, Text
from groq import AsyncGroq
push = Cycls()
groq = AsyncGroq(api_key="YOUR_KEY")
async def llm(content):
stream = await groq.chat.completions.create(
messages=[
{"role": "system", "content": "you are a helpful assistant."},
{"role": "user", "content": content}
],
model="llama3-70b-8192",
temperature=0.5, max_tokens=1024, top_p=1, stop=None,
stream=True,
)
async def event_stream():
async for chunk in stream:
yield f"{chunk.choices[0].delta.content}"
return event_stream()
@push("groq-app")
async def app(x:Message):
stream = await llm(x.content)
return Text(stream)
https://cycls.com/@groq-app
history
@push("cake")
def app(m:Message):
print(m.history)
return Text(m.content)
groq app with history
from cycls import Cycls, Message, Text
from groq import AsyncGroq
push = Cycls()
groq = AsyncGroq(api_key="YOUR_KEY")
async def llm(messages):
stream = await groq.chat.completions.create(
messages=messages,
model="llama3-70b-8192",
temperature=0.5, max_tokens=1024, top_p=1, stop=None,
stream=True,
)
async def event_stream():
async for chunk in stream:
yield f"{chunk.choices[0].delta.content}"
return event_stream()
@push("groq-app")
async def app(m:Message):
x = [{"role": "system", "content": "you are a helpful assistant."}]
x += m.history
x += [{"role": "user", "content": m.content}]
stream = await llm(x)
return Text(stream)
Known issues
- Dev mode doesn't work on Windows machines
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cycls-0.0.2.9.tar.gz
(3.7 kB
view details)
Built Distribution
File details
Details for the file cycls-0.0.2.9.tar.gz.
File metadata
- Download URL: cycls-0.0.2.9.tar.gz
- Upload date:
- Size: 3.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.10.13 Linux/6.5.0-1021-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 52041e8605e6ac0cdb4abafb1b36a9730fb849746b1c9aaff2f0318b5e9082b8 |
|
| MD5 | 6da1b6dfe20de70c7b8bbc1456caf43b |
|
| BLAKE2b-256 | f8adf55fdfa3d634cd84f84b963938a6efed9b784a75c6fbad65dd0f17fe02a4 |
File details
Details for the file cycls-0.0.2.9-py3-none-any.whl.
File metadata
- Download URL: cycls-0.0.2.9-py3-none-any.whl
- Upload date:
- Size: 4.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.10.13 Linux/6.5.0-1021-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | e8b71728a18896c85d82f13a0198d1afce4d0c3696b3887a96cacf3921e2a082 |
|
| MD5 | f388e52aaf9174d628099328299fa5c6 |
|
| BLAKE2b-256 | 252f378a5151e6f7c51f6daed9e294676a35cd3a5721893895cad2c4ad367736 |
