EvilFreelancer / docker-llama.cpp-rpcLinks
Данный проект основан на llama.cpp и компилирует только RPC-сервер, а так же вспомогательные утилиты, работающие в режиме RPC-клиента, необходимые для реализации распределённого инференса конвертированных в GGUF формат Больших Языковых Моделей (БЯМ) и Эмбеддинговых Моделей.
☆18Updated last month
Alternatives and similar repositories for docker-llama.cpp-rpc
Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below
Sorting:
- ndt-deep-researcher by langsmith studio☆12Updated 4 months ago
- whisper.cpp HTTP transcription server with OpenAI-like API in Docker☆19Updated 2 months ago
- OpenAPI-like API-server for voice generation (TTS) based on fish-speech-1.5 model.☆19Updated last month
- Dialoqbase Lite is a Chrome extension that offers a web-based UI and a side panel, Copilot, designed specifically for almost all AI provi…☆41Updated 2 months ago
- Swap your face in real-time☆73Updated 3 months ago
- ☆48Updated this week
- Flux and Stable Diffusion WebUI with MCP☆27Updated last month
- A tool for summarizing dialogues from videos or audio☆82Updated last year
- GPT prepping certificates of translation☆11Updated last year
- Talk to YouTube☆41Updated last year
- Hector RAG is a modular RAG framework built on PostgreSQL, offering advanced retrieval methods and fusion techniques for AI-driven applic…☆57Updated 4 months ago
- A demo of cluade computer use playing minecraft☆22Updated 8 months ago
- Work with your business data using natural language☆14Updated 7 months ago
- Telegram LLM bot backed by OpenAI, Whisper, Beam, LLaMA, Weaviate, MinIO and MongoDB☆103Updated last year
- Every word counts - Vocab second brain☆10Updated 2 months ago
- 🐝 Create powerful, collaborative AI applications.☆64Updated 7 months ago
- Trim and timestamp audio, in the terminal☆15Updated 8 months ago
- best llms in russian☆56Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- Thin wrapper around OpenAI Whisper API with streaming support☆89Updated 5 months ago
- 2D Positional Embeddings for Webpage Structural Understanding 🦙👀☆95Updated 9 months ago
- Useful tools and links for Llama 2.☆49Updated last year
- ☆12Updated last month
- ☆40Updated last year
- This application implements the Best-of-N Jailbreaking (BoN) method, which focuses on exploiting vulnerabilities in AI models.☆30Updated 4 months ago
- A feature-rich Python-based Telegram bot for OpenAI API & Perplexity API☆29Updated 2 months ago
- A Multi-Agentic AI Assistant/Builder☆14Updated this week
- VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for cor…☆72Updated 3 months ago
- Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.☆12Updated 7 months ago
- Silero TTS web UI☆14Updated last year