EvilFreelancer / docker-llama.cpp-rpcLinks
Данный проект основан на llama.cpp и компилирует только RPC-сервер, а так же вспомогательные утилиты, работающие в режиме RPC-клиента, необходимые для реализации распределённого инференса конвертированных в GGUF формат Больших Языковых Моделей (БЯМ) и Эмбеддинговых Моделей.
☆22Updated 6 months ago
Alternatives and similar repositories for docker-llama.cpp-rpc
Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below
Sorting:
- whisper.cpp HTTP transcription server with OpenAI-like API in Docker☆26Updated 4 months ago
- Training and data processing code for Saiga☆53Updated 5 months ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆45Updated 8 months ago
- Tools and agents for automated research.☆46Updated last month
- OpenAPI-like API-server for voice generation (TTS) based on fish-speech-1.5 model.☆27Updated 6 months ago
- best llms in russian☆61Updated last year
- A set of scripts and configurations for pretraining of Large Language Models (LLM)☆34Updated 9 months ago
- ☆31Updated last year
- ☆17Updated 2 years ago
- ☆163Updated 9 months ago
- ExplainitAll — это библиотека для интерпретируемого ИИ, предназначенная для интерпретации генеративных моделей ( GPT-like), и векторизато…☆19Updated last year
- Top ML papers of the week.☆41Updated last month
- AI agent to automatically check grammar and spelling on documentation files☆93Updated 2 weeks ago
- Telegram bot for different language models. Supports system prompts and images☆63Updated 5 months ago
- Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat☆61Updated 2 years ago
- Dialoqbase Lite is a Chrome extension that offers a web-based UI and a side panel, Copilot, designed specifically for almost all AI provi…☆43Updated 7 months ago
- Бенчмарк для оценки способности языковых моделей решать математические и физические задачи на русском языке☆22Updated 3 weeks ago
- This book is a comprehensive manual designed to empower professionals to harness the potential of AI technologies responsibly and innovat…☆60Updated 3 months ago
- ☆21Updated last year
- Effective LLM Alignment Toolkit☆150Updated 5 months ago
- Telegram chat bot semantic search with the content and database☆24Updated last year
- Hector RAG is a modular RAG framework built on PostgreSQL, offering advanced retrieval methods and fusion techniques for AI-driven applic…☆59Updated 9 months ago
- LangChain-compatible integrations with YandexGPT and YandexGPT Embeddings☆44Updated 7 months ago
- XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning☆14Updated last year
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…☆37Updated 2 months ago
- 2D Positional Embeddings for Webpage Structural Understanding 🦙👀☆95Updated last year
- ☆60Updated 2 weeks ago
- T5-based (russian) text normalization☆24Updated last year
- A TypeScript library for building orchestrated framework-agnostic multi-agent AI systems☆33Updated 3 weeks ago
- Fine tuning of the base model from OpenAI Whisper in Russian language on the dataset Sber-golos☆41Updated 3 years ago