Run GGML models with Kubernetes.
☆177Dec 17, 2023Updated 2 years ago
Alternatives and similar repositories for ggml-k8s
Users that are interested in ggml-k8s are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆126Dec 18, 2024Updated last year
- Just a bunch of benchmark logs for different LLMs☆130Jul 28, 2024Updated 2 years ago
- A collection of text embedding experiments☆55Feb 27, 2023Updated 3 years ago
- A single notebook for fine-tuning GPT-3.5 turbo☆31Aug 16, 2024Updated 2 years ago
- TEVO: evolve LM motifs cheaply, then validate them in downstream train.py loops.☆19Apr 18, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆67Dec 8, 2023Updated 2 years ago
- Port of Facebook's LLaMA model in C/C++☆16Jul 3, 2023Updated 3 years ago
- ☆55Mar 7, 2023Updated 3 years ago
- Let's make sand talk☆587Oct 17, 2023Updated 2 years ago
- LLM plugin for interacting with llama-server models☆32May 28, 2025Updated last year
- Raspberry-based E-Paper Smart Home Display Project☆21Apr 13, 2026Updated 4 months ago
- Simplex Random Feature attention, in PyTorch☆76Oct 10, 2023Updated 2 years ago
- Full finetuning of large language models without large memory requirements☆92Sep 22, 2025Updated 11 months ago
- ☆337Dec 20, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆51Jan 31, 2024Updated 2 years ago
- ☆10Oct 24, 2024Updated last year
- ☆3,347Feb 25, 2024Updated 2 years ago
- Seamless Voice Interactions with LLMs☆12Oct 28, 2023Updated 2 years ago
- Implementation of the paper: "Audio Mamba: Bidirectional State Space Model for Audio Representation Learning" in pytorch☆15Updated this week
- ☆28Aug 21, 2026Updated 2 weeks ago
- LLM-based code completion engine☆194Jan 23, 2025Updated last year
- ☆867Dec 8, 2023Updated 2 years ago
- batched loras☆352Sep 6, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆278Nov 3, 2023Updated 2 years ago
- Chrome Extension for YouTube. Acts as an assistant for the YouTube video you are watching☆22Apr 26, 2023Updated 3 years ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆64Dec 4, 2023Updated 2 years ago
- ☆13Oct 12, 2023Updated 2 years ago
- A really tiny autograd engine☆98May 26, 2025Updated last year
- Task management for AI agents☆16Jun 25, 2025Updated last year
- A Python package to dynamically load functions for OpenAI Assistant☆55Dec 6, 2023Updated 2 years ago
- ☆46Oct 13, 2023Updated 2 years ago
- Simple speculative decoding technique, integrated in vLLM and transformers☆616Aug 23, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Chatbot for The Carbon Almanac book or a climate change related topic☆16Mar 6, 2023Updated 3 years ago
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆33May 23, 2024Updated 2 years ago
- ☆35Apr 8, 2023Updated 3 years ago
- Ingest any document type and query☆13May 31, 2023Updated 3 years ago
- 🔓 The open-source autonomous agent LLM initiative 🔓☆91Feb 12, 2024Updated 2 years ago
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- An open-source non-official community implementation of the model from the paper: Surgical Robot Transformer (SRT): Imitation Learning fo…☆13Aug 28, 2026Updated last week