Runs 405B LLMs on 8GB VRAM
☆3,089Nov 2, 2026Updated this week
Alternatives and similar repositories for airllm
Users that are interested in airllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, a…☆13,755Updated this week
- AirLLM 2.8T LLM inference with single 4GB GPU☆41,525Updated this week
- Official inference framework for 1-bit LLMs☆41,441Jul 27, 2026Updated 3 months ago
- Hundreds of models & providers. One command to find what runs on your hardware.☆38,538Updated this week
- Examples, end-2-end tutorials and apps built using Liquid AI Foundational Models (LFM) and the LEAP SDK☆2,738Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A high-quality rapid TTS voice cloning model that reaches speeds of 150x realtime.☆5,512Jun 5, 2026Updated 4 months ago
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,455Oct 7, 2026Updated 3 weeks ago
- 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG☆39,937Updated this week
- A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive vi…☆39,223Updated this week
- Agent Skills as a Memory Layer☆3,698Oct 24, 2026Updated last week
- The absolute trainer to light up AI agents.☆18,873Updated this week
- Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval…☆17,344Jul 14, 2026Updated 3 months ago
- list of awesome platforms, tools, and resources run for LLMs locally☆1,204Jun 10, 2026Updated 4 months ago
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆78,910Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- OCR model that handles complex tables, forms, handwriting with full layout.☆12,667Oct 22, 2026Updated last week
- A lightweight, lightning-fast, in-process vector database☆16,176Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆56,072Updated this week
- 🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https:/…☆92,839Updated this week
- Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.☆13,757Sep 9, 2026Updated last month
- High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.☆10,538Updated this week
- Tiny, Fast, and Deployable anywhere — automate the mundane, unleash your creativity☆30,083Updated this week
- Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows. Used by 100,000+ builders.☆29,954Updated this week
- 🤖 A minimal and customizable Docker image running the Android emulator as a service.☆7,390May 7, 2026Updated 5 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- The open-source AI voice studio. Clone, dictate, create.☆59,191Oct 7, 2026Updated 3 weeks ago
- The headless browser for AI agents and web scraping☆29,937Updated this week
- Secure, Fast, and Extensible Sandbox runtime for AI agents.☆16,392Updated this week
- Face Recognition, Face Liveness Detection, Face Anti-Spoofing, Face Detection, Face Landmarks, Face Compare, Face Matching, Face Pose, Fa…☆3,086Oct 2, 2026Updated last month
- SoTA open-source TTS☆27,512Jul 21, 2026Updated 3 months ago
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,253Updated this week
- Lightpanda: the headless browser designed for AI and automation☆40,829Updated this week
- Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost …☆27,597Oct 22, 2026Updated last week
- PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.☆30,156Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Vane is an AI-powered answering engine.☆37,968Sep 1, 2026Updated 2 months ago
- Open-Source Frontier Voice AI☆55,089Oct 8, 2026Updated 3 weeks ago
- AI coworker with memory and collaboration☆18,125Updated this week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆52May 27, 2025Updated last year
- Parlant is an open platform for building customer-facing chat agents with AI. Describe how the agent should behave, and your coding agent…☆18,318Updated this week
- A TTS that fits in your CPU (and pocket)☆10,167Updated this week
- VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning☆40,975Oct 8, 2026Updated 3 weeks ago