EvilFreelancer / docker-llama.cpp-rpc
Данный проект основан на llama.cpp и компилирует только RPC-сервер, а так же вспомогательные утилиты, работающие в режиме RPC-клиента, необходимые для реализации распределённого инференса конвертированных в GGUF формат Больших Языковых Моделей (БЯМ) и Эмбеддинговых Моделей.
☆17Updated 2 months ago
Alternatives and similar repositories for docker-llama.cpp-rpc:
Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below
- ndt-deep-researcher by langsmith studio☆12Updated 2 months ago
- whisper.cpp HTTP transcription server with OpenAI-like API in Docker☆17Updated 3 weeks ago
- Screen complete is a proof of concept universal screenshot-based text completion tool.☆17Updated 6 months ago
- Work with your business data using natural language☆12Updated 5 months ago
- Testing LLM reasoning abilities with lineage relationship quizzes.☆26Updated last month
- A lightweight proxy for filtering `<think>` tags from any OpenAI-compatible API endpoint. Designed for chain-of-thought language models t…☆37Updated 2 months ago
- Hector RAG is a modular RAG framework built on PostgreSQL, offering advanced retrieval methods and fusion techniques for AI-driven applic…☆46Updated 2 months ago
- best llms in russian☆53Updated 11 months ago
- Dialoqbase Lite is a Chrome extension that offers a web-based UI and a side panel, Copilot, designed specifically for almost all AI provi…☆40Updated 11 months ago
- Fine tuning of the base model from OpenAI Whisper in Russian language on the dataset Sber-golos☆38Updated 2 years ago
- ☆26Updated 2 weeks ago
- Swap your face in real-time☆72Updated last month
- Python client for txtai☆14Updated this week
- ☆31Updated 7 months ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆42Updated last month
- GPT-2 small trained on phi-like data☆66Updated last year
- GPT prepping certificates of translation☆10Updated last year
- Useful tools and links for Llama 2.☆49Updated last year
- Top ML papers of the week.☆30Updated this week
- ☆13Updated 2 years ago
- Умный ассистент в формате Telegram-бота☆12Updated last year
- a browser gui for nvidia smi☆18Updated last month
- An example of running local models with GGML☆39Updated last year
- Talk to YouTube☆41Updated last year
- 100% Local Document deep search with LLMs☆26Updated 7 months ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆16Updated 7 months ago
- Sentence Transformers API: An OpenAI compatible embedding API server☆54Updated 7 months ago
- ☆47Updated this week
- Trim and timestamp audio, in the terminal☆14Updated 6 months ago
- An interface that features barely zero external dependencies beyond the Ollama API itself, making it lightweight and portable to easily i…☆12Updated last month