EvilFreelancer / docker-llama.cpp-rpcLinks
Данный проект основан на llama.cpp и компилирует только RPC-сервер, а так же вспомогательные утилиты, работающие в режиме RPC-клиента, необходимые для реализации распределённого инференса конвертированных в GGUF формат Больших Языковых Моделе й (БЯМ) и Эмбеддинговых Моделей.
☆21Updated 4 months ago
Alternatives and similar repositories for docker-llama.cpp-rpc
Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below
Sorting:
- whisper.cpp HTTP transcription server with OpenAI-like API in Docker☆24Updated 2 months ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆45Updated 6 months ago
- ☆48Updated 3 months ago
- XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning☆14Updated last year
- best llms in russian☆59Updated last year
- Tools and agents for automated research.☆38Updated this week
- ☆163Updated 7 months ago
- ☆31Updated last year
- Telegram bot for different language models. Supports system prompts and images☆60Updated 3 months ago
- Top ML papers of the week.☆40Updated last week
- OpenAPI-like API-server for voice generation (TTS) based on fish-speech-1.5 model.☆26Updated 4 months ago
- Dialoqbase Lite is a Chrome extension that offers a web-based UI and a side panel, Copilot, designed specifically for almost all AI provi…☆43Updated 5 months ago
- LangChain-compatible integrations with YandexGPT and YandexGPT Embeddings☆44Updated 5 months ago
- Hector RAG is a modular RAG framework built on PostgreSQL, offering advanced retrieval methods and fusion techniques for AI-driven applic…☆59Updated 7 months ago
- A tool for summarizing dialogues from videos or audio☆83Updated 2 years ago
- Effective LLM Alignment Toolkit☆144Updated 3 months ago
- Telegram LLM bot backed by OpenAI, Whisper, Beam, LLaMA, Weaviate, MinIO and MongoDB☆109Updated last year
- A set of scripts and configurations for pretraining of Large Language Models (LLM)☆34Updated 7 months ago
- Бенчмарк для оценки способности языковых моделей решать математические и физические задачи на русском языке☆21Updated 5 months ago
- A TypeScript library for building orchestrated framework-agnostic multi-agent AI systems☆28Updated last week
- ☆17Updated 2 years ago
- Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat☆60Updated 2 years ago
- По возможности актуальная информация по ИИ + ресерчи от ChatGPT☆22Updated 3 months ago
- OmniFusion — a multimodal model to communicate using text and images☆233Updated last year
- Useful tools and links for Llama 2.☆49Updated 2 years ago
- Простой нормализатор текстов перед синтезом речи☆40Updated last year
- Lightweight & fast AI inference proxy for self-hosted LLMs backends like Ollama, LM Studio and others. Designed for speed, simplicity and…☆92Updated last week
- Thin wrapper around OpenAI Whisper API with streaming support☆89Updated 8 months ago
- An AI Vision Language Model System for extracting structured knowledge graph information(JSON) from images of process diagrams☆31Updated 6 months ago
- AI agent to automatically check grammar and spelling on documentation files☆93Updated 2 months ago