AirLLM 70B inference with single 4GB GPU
☆17Jun 27, 2025Updated 8 months ago
Alternatives and similar repositories for airllm
Users that are interested in airllm are comparing it to the libraries listed below
Sorting:
- JotItNow is a AI Voice Notes App☆24Mar 6, 2025Updated 11 months ago
- codebase for "MELTing Point: Mobile Evaluation of Language Transformers"☆18Jul 19, 2024Updated last year
- *NIX SHELL with Local AI/LLM integration☆24Feb 26, 2025Updated last year
- Light WebUI for lm.rs☆24Oct 14, 2024Updated last year
- Powerful LLM Query Framework with YAML Prompt Templates. Made for Automation☆34Sep 20, 2025Updated 5 months ago
- Open source LLM UI, compatible with all local LLM providers.☆177Sep 20, 2024Updated last year
- AdaLLM is an NVFP4-first inference runtime for Ada Lovelace (RTX 4090) with FP8 KV cache and custom decode kernels. This repo targets NVF…☆94Feb 15, 2026Updated 2 weeks ago
- Lightweight CLI note tracker in Golang with SQLite. A changelog for your mind all within the terminal!☆11Jan 16, 2025Updated last year
- A comprehensive WebUI Toolkit for Resemble-AI's Chatterbox☆23Jun 7, 2025Updated 8 months ago
- A python library to interact with AI-Horde's free generative AI APIs☆37Updated this week
- A zero-dependency prompt manager/catalog/library in a single HTML file. Everything is stored locally in your browser. Meow. 😼☆64Aug 14, 2025Updated 6 months ago
- Winning Solution for the M5 Competition for Uncertainty Forecasting☆10May 25, 2023Updated 2 years ago
- A python script to walk the directory tree of a C/C++ project of embedded system to generate CMakeLists.txt files for building the execut…☆10May 6, 2022Updated 3 years ago
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆31May 1, 2025Updated 10 months ago
- Text to audio with Tik-Tok Voices☆13Apr 6, 2023Updated 2 years ago
- A real-time shared memory layer for multi-agent LLM systems.☆55Jan 12, 2026Updated last month
- Simple and powerful extension for searching web and viewing website content.☆11Apr 11, 2025Updated 10 months ago
- Text & sentiment analysis of WhatsApp chat data.☆10Feb 3, 2020Updated 6 years ago
- WorldPalette is a Maya plugin based on the 2015 SIGGRAPH paper, WorldBrush: Interactive Example-based Synthesis of Procedural Virtual Wor…☆11May 10, 2021Updated 4 years ago
- Vocal Prism — Privacy-first, local AI audio transcription for macOS (Whisper → CoreML, Apple Silicon‑optimized).☆27Jan 15, 2026Updated last month
- ☆22Jan 25, 2026Updated last month
- Next-Gen Builder☆20May 6, 2024Updated last year
- ☆10Dec 8, 2024Updated last year
- MVP for updated PEP 543 proposal☆14Feb 13, 2026Updated 2 weeks ago
- A companion application to use SiYuan note as a knowledge base with OpenAI APIs☆15Sep 26, 2025Updated 5 months ago
- A server management bot fore TeamTalk5☆10Apr 4, 2023Updated 2 years ago
- Runtime type information for JavaScript and TypeScript programs☆10Jun 16, 2024Updated last year
- Fully Local Push-to-Transcribe☆18Nov 6, 2025Updated 3 months ago
- برنامج قرآني بواجهة بسيطة وبميزات خرافية مع قواعد بيانات كبيرة للقرآن الكريم وتفسيره☆10Apr 1, 2023Updated 2 years ago
- keep files☆13Sep 22, 2017Updated 8 years ago
- Maven plugin that talks to docker-compose command-line interface☆13Feb 5, 2023Updated 3 years ago
- ☆10Sep 29, 2024Updated last year
- A demo and tutorial for Council that implements a research writing assistant.☆10Nov 10, 2023Updated 2 years ago
- Home server set up☆13Oct 5, 2025Updated 4 months ago
- Copilot with deepseek and more...☆13Mar 7, 2025Updated 11 months ago
- Processing 100 天速写☆13Feb 7, 2025Updated last year
- Jsonified Ini Notation☆14Mar 29, 2025Updated 11 months ago
- A Prompt Enhancer for flux.1 in ComfyUI☆12Jan 11, 2026Updated last month
- Custom Engineered Agents and Tools for Vibe Coders | Agents for TRAE.AI, Smart MCPs, GLM Models integration and more...☆22Dec 24, 2025Updated 2 months ago