Данный проект основан на llama.cpp и компилирует только RPC-сервер, а так же вспомогательные утилиты, работающие в режиме RPC-клиента, необходимые для реализации распределённого инференса конвертированных в GGUF формат Больших Языковых Моделей (БЯМ) и Эмбеддинговых Моделей.
☆24May 25, 2025Updated last year
Alternatives and similar repositories for docker-llama.cpp-rpc
Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- whisper.cpp HTTP transcription server with OpenAI-like API in Docker☆32Apr 5, 2026Updated 2 months ago
- Reinforcement learning on dynamic knowledge graphs☆30Jan 15, 2025Updated last year
- Build NCCL-Tests and configure SSHD in PyTorch container to help you test NCCL faster!☆13Aug 28, 2025Updated 9 months ago
- ☆12Dec 19, 2024Updated last year
- ☆31Sep 23, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- LillyMol Public Code☆17Updated this week
- The MolE pre-training framework to learn general molecular representations from unlabeled structures☆12May 26, 2025Updated last year
- No-nonsense Revolt library for nodejs and deno.☆13Jul 19, 2022Updated 3 years ago
- Copilot with deepseek and more...☆13Mar 7, 2025Updated last year
- ☆14Sep 24, 2024Updated last year
- ☆17Sep 4, 2023Updated 2 years ago
- ☆19May 16, 2026Updated 3 weeks ago
- A PyTorch native library for large model training☆30Apr 1, 2026Updated 2 months ago
- Serializing molecule 3D structures☆14Nov 27, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Discord bot that will transcribe audio using OpenAI Whisper☆12Jun 6, 2023Updated 3 years ago
- cursor logs with gpt-4o using litellm proxy☆14Sep 9, 2025Updated 9 months ago
- Using MolE pre-trained representation to predict novel antimicrobial compounds☆11Aug 28, 2025Updated 9 months ago
- An attempt to migrate Karpathy's llm.c to safe rust.☆13Jun 4, 2024Updated 2 years ago
- A curated collection of OpenClaw resources: GCP installation guide, best practices, and use cases☆21Jun 4, 2026Updated last week
- Quickly build your full stack deployable development project.☆22Jun 2, 2026Updated last week
- Fast, cross-browser automation in node.js☆66May 28, 2014Updated 12 years ago
- MTK MT7621 U-Boot With Web Failsafe☆16Jan 28, 2022Updated 4 years ago
- A simple GUI for Kathara, designed to run as a Flatpak☆12Mar 30, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- telegram-chat-summariser☆10Nov 24, 2024Updated last year
- Official library of images for the SIGIR 2019 Open-Source IR Replicability Challenge (OSIRRC 2019)☆13Jul 7, 2019Updated 6 years ago
- Molecular Reinforcement Learning☆14Mar 29, 2023Updated 3 years ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆47Mar 20, 2025Updated last year
- Run steam in a container.☆20Updated this week
- ☆21Feb 26, 2026Updated 3 months ago
- parKVFinder: thread-level parallel KVFinder☆16May 9, 2025Updated last year
- Project on how to integrate django with data science libraries (i.e. pandas, matplotlib, numpy)☆14Jul 6, 2023Updated 2 years ago
- ☆14Mar 18, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆14Mar 6, 2024Updated 2 years ago
- This repository contains a ready-to-use boilerplate for quickly setting up and working with crewai. It provides essential configurations …☆11Sep 11, 2024Updated last year
- EasySeats multiseat GUI configuration tool executables☆12Sep 5, 2020Updated 5 years ago
- ☆16Jan 23, 2025Updated last year
- A simple Python + Tkinter + Tesseract-based GUI image-to-text copypaste pad application☆10Sep 14, 2023Updated 2 years ago
- Repository mirror of GitLab: https://gitlab.com/rosarior/awesome-django http://awesome-django.com☆16Feb 22, 2018Updated 8 years ago
- Repo for "Centaur: Robust Multimodal Fusion for Human Activity Recognition"☆10Jan 9, 2024Updated 2 years ago