AirLLM 70B inference with single 4GB GPU
☆21Jun 27, 2025Updated last year
Alternatives and similar repositories for airllm
Users that are interested in airllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Light WebUI for lm.rs☆24Oct 14, 2024Updated last year
- Powerful LLM Query Framework with YAML Prompt Templates. Made for Automation☆36Sep 20, 2025Updated 10 months ago
- Distributed multi-agent framework for event-driven, graph-based computation. Elixir/Python, NATS event streaming, modular operator/XCS ar…☆14Mar 25, 2026Updated 4 months ago
- A graph database library for iOS and MacOS.☆14Mar 4, 2018Updated 8 years ago
- A bot that checks your grammar and phrasing using LLM of choice☆35Feb 6, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Open source LLM UI, compatible with all local LLM providers.☆177Sep 20, 2024Updated last year
- Mirror repository, PRs are not watched, please use Xfce's GitLab☆14Updated this week
- LLamaHTML is a simple html file to communicate with a running llamacpp llama-server☆25Aug 5, 2025Updated last year
- Cognito: Supercharge your Chrome browser with AI. Guide, query, and control everything using natural language.☆57Updated this week
- 🎙️ Local voice-to-text for macOS. 100% offline☆36May 14, 2026Updated 2 months ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆37Aug 14, 2024Updated last year
- Ulauncher Extension that provides shortcuts for accessing status pages for popular services like GitHub, AWS and more.☆16Feb 9, 2025Updated last year
- Uses AI to pick stocks.☆12Dec 30, 2024Updated last year
- ☆11Nov 10, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- dbt-databend adapter plugin☆10May 30, 2024Updated 2 years ago
- Local-first RAG application for technical documentation and research papers☆28Jun 26, 2026Updated last month
- Speculative Decoding Meets Quantization: Compatibility Evaluation and Hierarchical Framework Design☆26May 29, 2025Updated last year
- Showing how to use CUDA on google colab☆13Feb 24, 2025Updated last year
- `cc` for english or: the english to anything transpiler☆16Jan 29, 2026Updated 6 months ago
- A mod that injects MGL and patches Minecraft to work with it.☆12Apr 10, 2024Updated 2 years ago
- RAIL wireless applications. Go to https://github.com/SiliconLabs/application_examples☆13Jul 24, 2026Updated 2 weeks ago
- Declarative GUI Layout based on WxPython☆12Jul 20, 2026Updated 3 weeks ago
- Node.js implementation binding for the RWKV.cpp module☆22Aug 2, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- keep files☆13Sep 22, 2017Updated 8 years ago
- ☆18Apr 22, 2023Updated 3 years ago
- The meta meme☆16Jul 30, 2026Updated last week
- Introduction to Dask for PyTorch Workflows☆13Mar 3, 2021Updated 5 years ago
- ☆35Jan 30, 2025Updated last year
- [ACCV 2024] Official code of our paper "Joint Image Super-resolution and Low-light Enhancement in the Dark"☆14Jun 23, 2025Updated last year
- Efficient retrieval head analysis with triton flash attention that supports topK probability☆13Jun 15, 2024Updated 2 years ago
- CLI util: Poor man's rpath for Windows executables.☆12Dec 16, 2018Updated 7 years ago
- برنامج قرآني بواجهة بسيطة وبميزات خرافية مع قواعد بيانات كبيرة للقرآن الكريم وتفسيره☆10Apr 1, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- LLMProxy is an intelligent large language model backend routing proxy service.☆29Dec 6, 2025Updated 8 months ago
- Seamless Numpy-UBlas interoperability☆12Aug 6, 2018Updated 8 years ago
- This CoinGecko Python library provides convenient access to CoinGecko API.☆16Apr 29, 2025Updated last year
- Examples for using the Daft data engine☆15Jul 10, 2026Updated last month
- Call any function with command-like syntax at runtime (with automatic argument management). No dependencies, no boilerplate code, no macr…☆12Dec 25, 2022Updated 3 years ago
- Create Linux commands from natural language, in the shell.☆133Feb 25, 2026Updated 5 months ago
- [TMLR 2025] When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models☆126Mar 6, 2026Updated 5 months ago