AirLLM 2.8T LLM inference with single 4GB GPU
☆41,712Nov 4, 2026Updated this week
Alternatives and similar repositories for airllm
Users that are interested in airllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from…☆47,604Updated this week
- VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription…☆100,993Updated this week
- Reverse engineer anything with agents, from app behavior down to native binaries.☆430,855Updated this week
- Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, …☆84,470Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆78,910Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cu…☆142,259Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,456Oct 7, 2026Updated 3 weeks ago
- Hundreds of models & providers. One command to find what runs on your hardware.☆38,644Updated this week
- Official inference framework for 1-bit LLMs☆41,454Jul 27, 2026Updated 3 months ago
- The agent that grows with you☆260,472Updated this week
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for…☆78,829Updated this week
- 🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build conversational AI syste…☆80,850Updated this week
- Open-source AI penetration testing tool to find and fix your app’s vulnerabilities.☆73,706Updated this week
- High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows☆21,472Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The open-source AI voice studio. Clone, dictate, create.☆59,398Oct 7, 2026Updated 3 weeks ago
- World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledg…☆76,526Updated this week
- Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero…☆108,700Updated this week
- Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.☆184,294Oct 29, 2026Updated last week
- 🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https:/…☆96,522Updated this week
- TencentDB Agent Memory is a team-level memory hub for AI Agents — turning conversations, docs, and code into four reusable memory assets …☆30,437Updated this week
- The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, C…☆296,996Updated this week
- π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a …☆102,357Updated this week
- The open-source app everyone uses to manage agents at work☆111,028Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Use Claude Code, Codex, Antigravity, VSCode, Pi, and OpenCode (and 6 other harnesses) for free (1.3B+ free tokens) from your terminal, ap…☆66,353Updated this week
- Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables,…☆14,468Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆56,174Updated this week
- Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and inj…☆112,843Updated this week
- 7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compat…☆47,407Updated this week
- Write HTML. Render video. Built for agents.☆78,944Updated this week
- A spy satellite simulator in your browser, except the data is real. Live open source spatial intelligence on a photorealistic 3D globe.☆62,688Updated this week
- Editorial diagram design for Claude Code, Codex, GitHub Copilot, Cursor, Factory Droid, Qoder, and Pi. 45 diagram types. Self-contained H…☆64,930Updated this week
- Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more☆39,251Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.☆143,880Oct 22, 2026Updated last week
- The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.☆42,521Updated this week
- A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.☆10,286Oct 2, 2026Updated last month
- FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.☆16,574Updated this week
- A Simple and Universal Swarm Intelligence Engine, Predicting Anything. 简洁通用的群体智能引擎，预测万物☆83,955Oct 16, 2026Updated 2 weeks ago
- Secure, fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, pre…☆49,421Updated this week
- TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecast…☆35,170Sep 29, 2026Updated last month