AirLLM 70B inference with single 4GB GPU
☆21Jun 27, 2025Updated last year
Alternatives and similar repositories for airllm
Users that are interested in airllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- *NIX SHELL with Local AI/LLM integration☆26Feb 26, 2025Updated last year
- Powerful LLM Query Framework with YAML Prompt Templates. Made for Automation☆36Sep 20, 2025Updated last year
- Distributed multi-agent framework for event-driven, graph-based computation. Elixir/Python, NATS event streaming, modular operator/XCS ar…☆14Mar 25, 2026Updated 6 months ago
- A graph database library for iOS and MacOS.☆14Mar 4, 2018Updated 8 years ago
- A bot that checks your grammar and phrasing using LLM of choice☆34Feb 6, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- BAT file to quick installation git-versions "ComfyUI" & "SUPIR" v.2 (NVIDIA)☆10Apr 16, 2024Updated 2 years ago
- Cognito: Supercharge your Chrome browser with AI. Guide, query, and control everything using natural language.☆57Updated this week
- show me the code (for an npm package)☆12May 12, 2015Updated 11 years ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆36Aug 14, 2024Updated 2 years ago
- Ulauncher Extension that provides shortcuts for accessing status pages for popular services like GitHub, AWS and more.☆15Feb 9, 2025Updated last year
- ☆11Nov 10, 2024Updated last year
- Local-first RAG application for technical documentation and research papers☆28Jun 26, 2026Updated 3 months ago
- Speculative Decoding Meets Quantization: Compatibility Evaluation and Hierarchical Framework Design☆26May 29, 2025Updated last year
- Showing how to use CUDA on google colab☆13Feb 24, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- `cc` for english or: the english to anything transpiler☆16Jan 29, 2026Updated 8 months ago
- ☆13Apr 16, 2025Updated last year
- Declarative GUI Layout based on WxPython☆13Jul 20, 2026Updated 2 months ago
- Context Hub Runtime Environment (CHRE)☆11Mar 13, 2026Updated 6 months ago
- A demo and tutorial for Council that implements a research writing assistant.☆11Nov 10, 2023Updated 2 years ago
- keep files☆14Sep 22, 2017Updated 9 years ago
- ☆14Jun 21, 2026Updated 3 months ago
- code related to "UNSURE: Unknown Noise level Stein's Unbiased Risk Estimator" by Tachella, Davies and Jacques☆13Nov 21, 2025Updated 10 months ago
- A collection of resources that showcase the intersection of simulation and LLM-agents.☆53Feb 1, 2026Updated 8 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Uses AI to pick stocks.☆12Dec 30, 2024Updated last year
- ☆18Apr 22, 2023Updated 3 years ago
- codebase for "MELTing Point: Mobile Evaluation of Language Transformers"☆21Jul 19, 2024Updated 2 years ago
- The meta meme☆18Sep 10, 2026Updated last month
- Raytracing & Flutter☆25May 24, 2021Updated 5 years ago
- Efficient retrieval head analysis with triton flash attention that supports topK probability☆13Jun 15, 2024Updated 2 years ago
- CLI util: Poor man's rpath for Windows executables.☆12Dec 16, 2018Updated 7 years ago
- LLMProxy is an intelligent large language model backend routing proxy service.☆29Dec 6, 2025Updated 10 months ago
- Seamless Numpy-UBlas interoperability☆13Aug 6, 2018Updated 8 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This CoinGecko Python library provides convenient access to CoinGecko API.☆16Apr 29, 2025Updated last year
- ☆19May 31, 2019Updated 7 years ago
- Simple PDF Viewer Using Pyside6 that can be run standalone or included in a larger program.☆17Mar 6, 2025Updated last year
- Call any function with command-like syntax at runtime (with automatic argument management). No dependencies, no boilerplate code, no macr…☆12Dec 25, 2022Updated 3 years ago
- Create Linux commands from natural language, in the shell.☆134Feb 25, 2026Updated 7 months ago
- [TMLR 2025] When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models☆126Mar 6, 2026Updated 7 months ago
- The most simplified react state management library.☆18Apr 19, 2022Updated 4 years ago