EvilFreelancer / docker-llama.cpp-rpcLinks
Данный проект основан на llama.cpp и компилирует только RPC-сервер, а так же вспомогательные утилиты, работающие в режиме RPC-клиента, необходимые для реализации распределённого инференса конвертированных в GGUF формат Больших Языковых Моделей (БЯМ) и Эмбеддинговых Моделей.
☆17Updated last week
Alternatives and similar repositories for docker-llama.cpp-rpc
Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below
Sorting:
- ndt-deep-researcher by langsmith studio☆11Updated 3 months ago
- whisper.cpp HTTP transcription server with OpenAI-like API in Docker☆19Updated 2 months ago
- ☆26Updated this week
- ☆31Updated 8 months ago
- OpenAPI-like API-server for voice generation (TTS) based on fish-speech-1.5 model.☆17Updated last week
- ☆46Updated last month
- Dialoqbase Lite is a Chrome extension that offers a web-based UI and a side panel, Copilot, designed specifically for almost all AI provi…☆41Updated last month
- Screen complete is a proof of concept universal screenshot-based text completion tool.☆18Updated 8 months ago
- a browser gui for nvidia smi☆19Updated 2 months ago
- A set of scripts and configurations for pretraining of Large Language Models (LLM)☆29Updated 3 months ago
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆47Updated 2 weeks ago
- Thin wrapper around OpenAI Whisper API with streaming support☆89Updated 4 months ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆42Updated 2 months ago
- Every word counts - Vocab second brain☆10Updated last month
- XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning☆14Updated 11 months ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆15Updated 9 months ago
- Work with your business data using natural language☆14Updated 6 months ago
- GPT prepping certificates of translation☆11Updated last year
- A TypeScript library for building orchestrated framework-agnostic multi-agent AI systems☆23Updated this week
- VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for cor…☆72Updated 3 months ago
- Talk to YouTube☆41Updated last year
- По возможности актуальная информация по ИИ + ресерчи от ChatGPT☆19Updated this week
- Convert MUSE from TensorFlow to PyTorch and ONNX☆11Updated last year
- Swap your face in real-time☆71Updated 2 months ago
- Fine tuning of the base model from OpenAI Whisper in Russian language on the dataset Sber-golos☆39Updated 2 years ago
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…