EvilFreelancer / docker-llama.cpp-rpc
Данный проект основан на llama.cpp и компилирует только RPC-сервер, а так же вспомогательные утилиты, работающие в режиме RPC-клиента, необходимые для реализации распределённого инференса конвертированных в GGUF формат Больших Языковых Моделей (БЯМ) и Эмбеддинговых Моделей.
☆17Updated last month
Alternatives and similar repositories for docker-llama.cpp-rpc:
Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below
- A set of scripts and configurations for pretraining of Large Language Models (LLM)☆28Updated last month
- whisper.cpp HTTP transcription server with OpenAI-like API in Docker☆16Updated last month
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆39Updated 2 weeks ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆16Updated 7 months ago
- ☆31Updated 6 months ago
- ☆26Updated this week
- A TypeScript library for building orchestrated framework-agnostic multi-agent AI systems☆18Updated this week
- best llms in russian☆55Updated 10 months ago
- Hector RAG is a modular RAG framework built on PostgreSQL, offering advanced retrieval methods and fusion techniques for AI-driven applic…☆46Updated last month
- Swap your face in real-time☆69Updated last week
- A tool for summarizing dialogues from videos or audio☆82Updated last year
- Dialoqbase Lite is a Chrome extension that offers a web-based UI and a side panel, Copilot, designed specifically for almost all AI provi…☆40Updated 10 months ago
- Thin wrapper around OpenAI Whisper API with streaming support☆89Updated 2 months ago
- Fine tuning of the base model from OpenAI Whisper in Russian language on the dataset Sber-golos☆38Updated 2 years ago
- ☆39Updated last week
- ☆45Updated 3 weeks ago
- Universal LLM Telegram chatbot in Python☆16Updated 7 months ago
- Silero TTS web UI☆13Updated last year
- Screen complete is a proof of concept universal screenshot-based text completion tool.☆16Updated 6 months ago
- ExplainitAll — это библиотека для интерпретируемого ИИ, предназначенная для интерпретации генеративных моделей ( GPT-like), и векторизато…☆18Updated 5 months ago
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆12Updated last year
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆23Updated last year
- 🐝 Create powerful, collaborative AI applications.☆63Updated 4 months ago
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆25Updated 2 months ago
- ☆35Updated 6 months ago
- Forces DeepSeek R1 models to engage in extended reasoning by intercepting early termination tokens.☆19Updated last month
- Every word counts - Vocab second brain☆10Updated this week
- GPT prepping certificates of translation☆10Updated last year
- Useful tools and links for Llama 2.☆49Updated last year
- Work with your business data using natural language☆12Updated 4 months ago