EvilFreelancer / docker-llama.cpp-rpcLinks
Данный проект основан на llama.cpp и компилирует только RPC-сервер, а так же вспомогательные утилиты, работающие в режиме RPC-клиента, необходимые для реализации распределённого инференса конвертированных в GGUF формат Больших Языковых Моделей (БЯМ) и Эмбеддинговых Моделей.
☆21Updated 3 months ago
Alternatives and similar repositories for docker-llama.cpp-rpc
Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below
Sorting:
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆43Updated 5 months ago
- Tools and agents for automated research.☆35Updated last week
- whisper.cpp HTTP transcription server with OpenAI-like API in Docker☆23Updated last month
- OpenAPI-like API-server for voice generation (TTS) based on fish-speech-1.5 model.☆23Updated 3 months ago
- ☆31Updated 11 months ago
- A set of scripts and configurations for pretraining of Large Language Models (LLM)☆33Updated 6 months ago
- LangChain-compatible integrations with YandexGPT and YandexGPT Embeddings☆43Updated 4 months ago
- Hybrid Schema-Guided Reasoning (SGR) has agentic system design create by neuraldeep community Creator of SGR concept: https://abdullin.c…☆264Updated this week
- Effective LLM Alignment Toolkit☆141Updated 2 months ago
- Telegram bot for different language models. Supports system prompts and images☆59Updated 2 months ago
- XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning☆14Updated last year
- Бенчмарк для оценки способности языковых моделей решать математические и физические задачи на русском языке☆14Updated 4 months ago
- ☆48Updated 2 months ago
- ☆161Updated 6 months ago
- ExplainitAll — это библиотека для интерпретируемого ИИ, предназначенная для интерпретации генеративных моделей ( GPT-like), и векторизато…☆19Updated 10 months ago
- best llms in russian☆59Updated last year
- MERA (Multimodal Evaluation for Russian-language Architectures) is a new open benchmark for the Russian language for evaluating SOTA mode…☆30Updated last week
- This project provides a Flask-based API for generating high-quality text-to-speech (TTS) audio using F5-TTS, a flexible and powerful TTS …☆14Updated 3 weeks ago
- AI agent to automatically check grammar and spelling on documentation files☆90Updated last month
- Thin wrapper around OpenAI Whisper API with streaming support☆89Updated 7 months ago
- Fine tuning of the base model from OpenAI Whisper in Russian language on the dataset Sber-golos☆40Updated 2 years ago
- Простой нормализатор текстов перед синтезом речи☆38Updated last year
- Top ML papers of the week.☆39Updated this week
- Бенчмарк сравнивает русские аналоги ChatGPT: Saiga, YandexGPT, Gigachat☆60Updated last year
- Toxic Comments Detection in Russian.☆29Updated 4 years ago
- По возможности актуальная информация по ИИ + ресерчи от ChatGPT☆21Updated 2 months ago
- ☆20Updated last month
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆42Updated last year
- LLM-based meme generator with templates☆13Updated 5 months ago
- Lightweight & fast AI inference proxy for self-hosted LLMs backends like Ollama, LM Studio and others. Designed for speed, simplicity and…☆81Updated last week