Runs 405B LLMs on 8GB VRAM
☆3,061Sep 20, 2026Updated this week
Alternatives and similar repositories for airllm
Users that are interested in airllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, a…☆12,945Updated this week
- AirLLM 70B inference with single 4GB GPU☆34,593Updated this week
- Official inference framework for 1-bit LLMs☆40,285Jul 27, 2026Updated last month
- Hundreds of models & providers. One command to find what runs on your hardware.☆36,871Updated this week
- Examples, end-2-end tutorials and apps built using Liquid AI Foundational Models (LFM) and the LEAP SDK☆2,500Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A high-quality rapid TTS voice cloning model that reaches speeds of 150x realtime.☆5,408Jun 5, 2026Updated 3 months ago
- The absolute trainer to light up AI agents.☆18,408Updated this week
- A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive vi…☆38,624Updated this week
- Agent Skills as a Memory Layer☆3,691Jul 14, 2026Updated 2 months ago
- 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG☆35,771Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,209Sep 13, 2026Updated last week
- list of awesome platforms, tools, and resources run for LLMs locally☆1,190Jun 10, 2026Updated 3 months ago
- Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval…☆16,550Jul 14, 2026Updated 2 months ago
- A lightweight, lightning-fast, in-process vector database☆15,976Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆54,497Updated this week
- 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: http…☆82,578Updated this week
- OCR model that handles complex tables, forms, handwriting with full layout.☆12,302Jun 26, 2026Updated 2 months ago
- Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.☆13,787Sep 9, 2026Updated last week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆76,481Updated this week
- High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.☆10,275Updated this week
- Tiny, Fast, and Deployable anywhere — automate the mundane, unleash your creativity☆30,005Updated this week
- 🤖 A minimal and customizable Docker image running the Android emulator as a service.☆7,284May 7, 2026Updated 4 months ago
- The open-source AI voice studio. Clone, dictate, create.☆55,269Aug 9, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows. Used by 100,000+ builders.☆29,684Updated this week
- AI video production in the browser — text-to-video, image-to-video, lip sync, 100+ models. Google Veo 3.1, FLUX, Gemini, Imagen 4. Free, …☆1,256Updated this week
- SoTA open-source TTS☆26,496Jul 21, 2026Updated last month
- Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost …☆27,260Sep 13, 2026Updated last week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆11,875Updated this week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆53May 27, 2025Updated last year
- Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictab…☆18,287Jul 12, 2026Updated 2 months ago
- Open-Source Frontier Voice AI☆54,429Sep 3, 2026Updated 2 weeks ago
- PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.☆29,323Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Multilingual Document Layout Parsing in a Single Vision-Language Model☆9,125Mar 24, 2026Updated 5 months ago
- AI coworker with memory and collaboration☆17,928Updated this week
- "AutoAgent: Fully-Automated and Zero-Code LLM Agent Framework"☆9,796Oct 16, 2025Updated 11 months ago
- Vane is an AI-powered answering engine.☆36,882Sep 1, 2026Updated 2 weeks ago
- An local, offline (after initial setup), portable OCR software that can process images and PDF files, using DeepSeek-OCR-2 AI (running di…☆875Jul 5, 2026Updated 2 months ago
- The headless browser for AI agents and web scraping☆27,424Updated this week
- TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecast…☆33,333Updated this week