[NeurIPS 2026 Spotlight] Fast, lossless LLM inference via dual-view diffusion decoding.
☆483Aug 12, 2026Updated 2 months ago
Alternatives and similar repositories for orthrus
Users that are interested in orthrus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. …☆513Jun 22, 2026Updated 4 months ago
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆1,179Updated this week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,970Updated this week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,210Aug 18, 2026Updated 2 months ago
- Qwen 3.8 Flash NVFP4 with PLE NVFP4 quantized to run on a single DGX Spark☆15Aug 28, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows☆2,265Updated this week
- ☆18May 16, 2026Updated 5 months ago
- Coding Agent singularly focused efficiency and context curation. Reduces API costs by 50-80% vs other agent AND improves the code quality…☆1,548Oct 26, 2026Updated last week
- lowfat - slim your command output. strips noise, saves tokens.☆582Oct 9, 2026Updated 3 weeks ago
- Optimized Qwen3.8-27B inference on NVIDIA DGX Spark☆16Sep 1, 2026Updated 2 months ago
- ☆184Apr 27, 2026Updated 6 months ago
- [ICML 2026] Set Diffusion: Interpolating Token Orderings between Autoregression and Diffusion for Fast and Flexible Decoding☆27Aug 9, 2026Updated 2 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆3,364Updated this week
- I replicated Ng's RYS method and found that duplicating 3 specific layers in Qwen2.5-32B boosts reasoning by 17% and duplicating layers 1…☆244Mar 20, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆22Sep 3, 2024Updated 2 years ago
- Verified multi-source distribution for local LLM weights☆16Oct 20, 2026Updated 2 weeks ago
- Jeeves – Reasoning improves Jev-like decision models☆432Oct 16, 2026Updated 2 weeks ago
- BROKEN REPO. DO NOT USE UNDER ANY CIRCUMSTANCES☆20Oct 13, 2026Updated 3 weeks ago
- A local-first web search agent☆30Jun 20, 2026Updated 4 months ago
- Adaptive Test-time Learning and Autonomous Specialization☆2,110Updated this week
- A browser-based generative music sequencer built with JavaScript and Tone.js, designed for live performance and composition.☆26May 16, 2026Updated 5 months ago
- Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware☆525Oct 25, 2026Updated last week
- Self-hosted, open-source financial data MCP server for AI agents — SEC filings, XBRL financials, 13F holdings, insider & congressional tr…☆240Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆1,783Updated this week
- Run the full 2.78-trillion-parameter Kimi K3 model, DeepSeek V4.1 Flash or GLM-5.3-Flash beyond available RAM by streaming activated weig…☆2,530Sep 18, 2026Updated last month
- One Must Fall 2097, remastered: the 1994 robot fighting classic rebuilt in TypeScript and WebGL2, playing the original game files. HD art…☆39Oct 25, 2026Updated last week
- ☆17Jul 12, 2026Updated 3 months ago
- chad: a coding agent for your macbook pro☆143Updated this week
- Run models too big for your Mac's memory☆669Oct 3, 2026Updated 3 weeks ago
- demonically compacting (up to 15%) lossless Vorbis/Opus recompressor☆92Oct 26, 2026Updated last week
- Multi-vector latent space steering adapter module for language models☆20Nov 22, 2025Updated 11 months ago
- A novel hybrid AI architecture leveraging Titan's-like memory and HRM-like reasoning☆26Aug 28, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- State machine guardrails for AI agents☆511Updated this week
- Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic…☆23Mar 6, 2026Updated 7 months ago
- [ICLR 2025 Oral] Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆1,039Jul 10, 2025Updated last year
- Agent CLI Framework: self-describing command-line tools for AI agents, built on oclif☆20Oct 24, 2026Updated last week
- RL-training an AI agent to RL-train AI agents.☆243Jul 14, 2026Updated 3 months ago
- Code for the manuscript "A self-supervised multi-layer network of Rectified Spectral Units (ReSUs)" submitted to NeurIPS☆26Apr 6, 2026Updated 6 months ago
- HRM-Text is a 1B text generation model based on the HRM architecture, strengthened by task completion and latent space reasoning.☆2,261Sep 21, 2026Updated last month