retoor
Repositories
29
 Projects
5
 Packages Public Activity Starred Repositories
1

yura (14.3.8)

Published 2024-11-28 02:50:52 +00:00 by retoor in retoor/yura

Installation

pip install --index-url  yura

About this package

Yura async AI client

Yura LLM Client for Katya server

Part of project with as target replacing the native ollama protocol. This protocol supports streaming and is usable trough https and it is possible to directly attach a web client to the backend.

Install

pip install -e .

Build

make build

Command line usage

yura ws://[host]:[port]/[path]/

Python

import asyncio
from yura.client import AsyncClient

async def communicate():
    client = AsyncClient("ws://[host]:[port]/[path]/")
    async for response in client.chat("Your prompt"):
         print(response)

asyncio.run(communicate())

Requirements

Requires Python: >=3.7
Details
PyPI
retoor/yura
2024-11-28 02:50:52 +00:00
12
retoor
MIT
4.0 KiB
Assets (2)
yura-14.3.8-py3-none-any.whl 1.6 KiB
yura-14.3.8.tar.gz 2.4 KiB
Versions (3) View all
14.3.9 2024-11-28
14.3.8 2024-11-28
14.3.7 2024-11-28
Issues