Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.
☆37Oct 25, 2026Updated 2 weeks ago
Alternatives and similar repositories for local-llm-autotune
Users that are interested in local-llm-autotune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TurboQuant-powered agentic AI framework for long-context LLMs on consumer hardware☆11Apr 27, 2026Updated 6 months ago
- rclip is a remote clipboard for CLI applications.☆16Mar 5, 2023Updated 3 years ago
- ☆12Sep 30, 2026Updated last month
- Make your specs actually comprehensive. Pair your specs with tests to make your coding agent stop improvising bad code☆24Oct 12, 2026Updated last month
- xuniq is a blazing-fast utility to remove duplicate lines from input☆26Apr 12, 2026Updated 7 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Danny Ma's 8 Week SQL Challenge Best Solutions on the Internet☆17Sep 20, 2024Updated 2 years ago
- AI editor docx☆16May 28, 2026Updated 5 months ago
- Rank-LLMs is a CLI tool for evaluating local LLMs via Ollama.☆11Jul 5, 2026Updated 4 months ago
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆25Jun 23, 2026Updated 4 months ago
- Memory system for LLMs that remembers everything you teach it during conversation. No reindexing, no context window limits. CPU by defaul…☆13May 2, 2026Updated 6 months ago
- Deterministic agent runtime with explicit plans, typed tools, permissions, and replay. Implements Google DeepMind's Intelligent AI Delega…☆12Mar 21, 2026Updated 7 months ago
- Advanced Hybrid Router & Interceptor for OpenWebUI — semantic routing + vision proxy + citation enforcement☆17Sep 3, 2026Updated 2 months ago
- Qwen3.8-Flash-Next-FP8 (48-layer MoE, 512 experts) on one RTX 3070 Ti plus 24 Maxwell GPUs from six Tesla M10 cards. PCIe multicast, GPU …☆40Nov 7, 2026Updated last week
- Code for the manuscript "A self-supervised multi-layer network of Rectified Spectral Units (ReSUs)" submitted to NeurIPS☆26Apr 6, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A Collaborative Todo List application and MCP server using CRDTs and Multicast☆15Feb 14, 2026Updated 9 months ago
- Creation OS - Cognitive Architecture☆44Jun 24, 2026Updated 4 months ago
- function for agents in OpenWebUI☆17Jun 15, 2025Updated last year
- An interactive dependency graph of human knowledge☆24Jul 25, 2026Updated 3 months ago
- Tools made for Open WebUI to enhance functionality☆21Oct 25, 2026Updated 2 weeks ago
- High-Performance Hyperbolic Sparse Autoencoders for Mechanistic Interpretability☆13Aug 15, 2026Updated 2 months ago
- Open-source LLM observability and evaluation platform☆16Jul 13, 2026Updated 4 months ago
- 34 открытых AI-скилла для малого бизнеса РФ: налоги УСН, деньги, проверка контрагента по ИНН. Числа считаются кодом, данные из реальных р…☆34Sep 29, 2026Updated last month
- OpenUI Generative UI tool for Open WebUI - renders interactive charts, forms, tables, and cards in chat via OpenUI Lang.☆79May 25, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A local memory of everything you have seen, said or heard while you work at your computer.☆30Aug 28, 2026Updated 2 months ago
- Automatically identify, retrieve and store memories from user conversations in Open WebUI.☆20Sep 25, 2025Updated last year
- Catch code issues before they catch you.☆38Sep 20, 2026Updated last month
- Boilerplate flet dev app with multiple pages and basic functionalities like login and sign up and home page☆18Sep 28, 2025Updated last year
- Fork of github.com/UCSBarchlab/OpenTPU for the TGPTPU project☆14Jun 1, 2025Updated last year
- Predictive Incident Management analyses large data sets to identify risk patterns, predict outcomes, and guide teams on effective decisio…☆16Nov 25, 2022Updated 3 years ago
- Validated, private, shareable knowledge-graph memory for AI — per-tenant, write-gated, PostgreSQL-authoritative, served over MCP.☆20Updated this week
- ☆11Dec 15, 2024Updated last year
- SHADOW 50M Instruct: a proof of concept. 44M ternary parameters, exact circuits inside the model, memory on disk, 19.8 MB, offline on a C…☆36Oct 19, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Perfect memory. Exact reasoning. Complete history for AI agents.☆15Oct 25, 2026Updated 2 weeks ago
- A new search paradigm where documents have gravity, queries converge into basins, and multi-signal scoring uses interference instead of l…☆37Apr 4, 2026Updated 7 months ago
- ☆16Apr 26, 2026Updated 6 months ago
- WebAMS is an Open Source web application for reporting and resolving incidents or tickets☆10Dec 11, 2022Updated 3 years ago
- ☆10Jun 20, 2026Updated 4 months ago
- High-performance, Hardware-First Vector Database engine built in Zig and Go. Sub-millisecond HNSW search with 64-bit metadata filtering a…☆23Sep 21, 2026Updated last month
- Performant animations using React and mobx☆12Mar 29, 2025Updated last year
Are these results useful?