EvilFreelancer / docker-llama.cpp-rpcLinks
Данный проект основан на llama.cpp и компилирует только RPC-сервер, а так же вспомогательные утилиты, работающие в режиме RPC-клиента, необходимые для реализации распределённого инференса конвертированных в GGUF формат Больших Языковых Моделей (БЯМ) и Эмбеддинговы х Моделей.
☆19Updated 2 months ago
Alternatives and similar repositories for docker-llama.cpp-rpc
Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below
Sorting:
- whisper.cpp HTTP transcription server with OpenAI-like API in Docker☆23Updated last week
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆43Updated 4 months ago
- Tools and agents for automated research.☆34Updated this week
- ☆48Updated last month
- Dialoqbase Lite is a Chrome extension that offers a web-based UI and a side panel, Copilot, designed specifically for almost all AI provi…☆44Updated 3 months ago
- Thin wrapper around OpenAI Whisper API with streaming support☆89Updated 6 months ago
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆49Updated 2 months ago
- XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning☆14Updated last year
- ☆159Updated 5 months ago
- OpenAPI-like API-server for voice generation (TTS) based on fish-speech-1.5 model.☆22Updated 2 months ago
- AI agent to automatically check grammar and spelling on documentation files☆90Updated 3 weeks ago
- Sentence Transformers API: An OpenAI compatible embedding API server☆64Updated 11 months ago
- best llms in russian☆59Updated last year
- ☆31Updated 10 months ago
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆129Updated 2 years ago
- LangChain-compatible integrations with YandexGPT and YandexGPT Embeddings☆43Updated 3 months ago
- Telegram bot for different language models. Supports system prompts and images☆59Updated last month
- An AI Vision Language Model System for extracting structured knowledge graph information(JSON) from images of process diagrams☆28Updated 4 months ago
- A TypeScript library for building orchestrated framework-agnostic multi-agent AI systems☆28Updated last week
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…☆28Updated 4 months ago
- Documentation site for fast-agent☆16Updated last week
- A set of scripts and configurations for pretraining of Large Language Models (LLM)☆31Updated 5 months ago
- Top ML papers of the week.☆38Updated this week
- Self-hosted huggingface mirror service. 自建huggingface镜像服务。☆184Updated 3 weeks ago
- Download models from the Ollama library, without Ollama☆91Updated 8 months ago
- Useful tools and links for Llama 2.☆49Updated 2 years ago
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆17Updated 4 months ago
- Effective LLM Alignment Toolkit☆139Updated last month
- A tool for summarizing dialogues from videos or audio☆82Updated last year
- This project provides a Flask-based API for generating high-quality text-to-speech (TTS) audio using F5-TTS, a flexible and powerful TTS …☆14Updated this week