EvilFreelancer / docker-llama.cpp-rpcLinks
Данный проект основан на llama.cpp и компилирует только RPC-сервер, а так же вспомогательные утилиты, работающие в режиме RPC-клиента, необходимые для реализации распределённого инференса конвертированных в GGUF формат Больших Языковых Моделей (БЯМ) и Эмбеддинговых Моделей.
☆18Updated last month
Alternatives and similar repositories for docker-llama.cpp-rpc
Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below
Sorting:
- whisper.cpp HTTP transcription server with OpenAI-like API in Docker☆20Updated 3 months ago
- Tools and agents for automated research.☆32Updated 3 weeks ago
- best llms in russian☆59Updated last year
- Dialoqbase Lite is a Chrome extension that offers a web-based UI and a side panel, Copilot, designed specifically for almost all AI provi…☆42Updated 2 months ago
- ☆48Updated 2 weeks ago
- AI agent to automatically check grammar and spelling on documentation files☆88Updated 9 months ago
- Hector RAG is a modular RAG framework built on PostgreSQL, offering advanced retrieval methods and fusion techniques for AI-driven applic…☆57Updated 4 months ago
- OpenAPI-like API-server for voice generation (TTS) based on fish-speech-1.5 model.☆21Updated last month
- ☆157Updated 5 months ago
- Thin wrapper around OpenAI Whisper API with streaming support☆89Updated 5 months ago
- A tool for summarizing dialogues from videos or audio☆82Updated last year
- Self-hosted huggingface mirror service. 自建huggingface镜像服务。☆176Updated 2 months ago
- 2D Positional Embeddings for Webpage Structural Understanding 🦙👀☆95Updated 10 months ago
- ☆20Updated last year
- ☆31Updated 9 months ago
- a browser gui for nvidia smi☆20Updated 4 months ago
- Useful tools and links for Llama 2.☆49Updated last year
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆42Updated last year
- ☆100Updated 4 months ago
- Flux and Stable Diffusion WebUI with MCP☆32Updated last month
- LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.☆128Updated 2 years ago
- A tool for an analysis of LLM generations.☆40Updated last month
- Бенчмарк для оценки способности языковых моделей решать математические и физические задачи на русском языке☆12Updated 2 months ago
- XmodelLM☆39Updated 8 months ago
- ☆57Updated 5 months ago
- Telegram LLM bot backed by OpenAI, Whisper, Beam, LLaMA, Weaviate, MinIO and MongoDB☆104Updated last year
- Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of your data and conversations …☆296Updated 10 months ago
- Swap your face in real-time☆75Updated 3 months ago
- Download models from the Ollama library, without Ollama☆89Updated 8 months ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆16Updated 10 months ago