From ad5a526124301bffcac6a1743a9ea5a94ad46531 Mon Sep 17 00:00:00 2001 From: retoor Date: Sun, 24 Nov 2024 17:11:38 +0100 Subject: [PATCH] Update readme --- README.md | 31 +++++++++++++++++++++++++++++++ 1 file changed, 31 insertions(+) create mode 100644 README.md diff --git a/README.md b/README.md new file mode 100644 index 0000000..a523dd6 --- /dev/null +++ b/README.md @@ -0,0 +1,31 @@ +# Yura LLM Client for Katya server + +Part of project with as target replacing the native ollama protocol. This protocol supports streaming and is usable trough https and it is possible to directly attach a web client to the backend. + +## Install +```bash +pip install -e . +``` + +## Build +```bash +make build +``` + +## Command line usage +```bash +yura ws://[host]:[port]/[path]/ +``` + +## Python +```python +import asyncio +from yura.client import AsyncClient + +async def communicate(): + client = AsyncClient("ws://[host]:[port]/[path]/") + async for response in client.chat("Your prompt"): + print(response) + +asyncio.run(communicate()) +```