☆109Nov 9, 2026Updated this week
Alternatives and similar repositories for tqllm
Users that are interested in tqllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM serving engines that SkyDiscover builds on the fly for specific AI models and hardware: Qwen3.6-35B-A3B, Qwen3.8-Flash-Next and Flint…☆39Updated this week
- Self-hosted live telemetry, alerts and benchmarks for NVIDIA DGX Spark (GB10) clusters☆11Updated this week
- llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ to…☆302Updated this week
- Run GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- …☆2,727Updated this week
- Easily run LLMs locally using llama.cpp directly, without overhead.☆21Aug 15, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Qwen3.8 Flash-Next (NVFP4) on NVIDIA Flare for one DGX Spark / ASUS GX10: greedy, 8-agent speculative decoding, mixed prefill☆14Updated this week
- Source-available C++/CUDA inference engine for Qwen3.8-27B INT4 on 3x RTX 3090☆44Updated this week
- SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding☆182Nov 3, 2026Updated last week
- Code for Latent Sparse Attention: Towards Subquadratic Ultra-Long Context Attention☆450Updated this week
- One serving daemon for local LLM inference — across runtimes and machines.☆22Updated this week
- Convierte una carpeta de juego de Switch 2 en un archivo .nup - App para macOS y Windows☆24Updated this week
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆60Oct 20, 2026Updated 3 weeks ago
- DSV4.1-Flash-1017 SAGE EXL3 (1.62 bpw) on one DGX Spark with vLLM: DSpark MTP, cold-expert ATS alias, tile-K 16 MoE, memory guard, measur…☆40Updated this week
- Always-on, low-overhead GPU and CUDA performance tracing SDK for AI workloads. C++ client APIs, CLI tools, open data model, Perfetto expo…☆70Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Deployment kit: Qwen3.8-27B EXL3 3.5bpw target + DFlash2 EXL3 5.0bpw speculative draft — launcher, config, model cards☆233Sep 1, 2026Updated 2 months ago
- Qwen3.6/3.8-27B on one RTX 5090: 576K pooled context across 12 sessions at FP8-level quality from 5.75 bpw. EXL3 trellis weights, 4-bit t…☆30Oct 23, 2026Updated 2 weeks ago
- Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell☆822Updated this week
- PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-the…☆160Updated this week
- WeVisCut is a 9B tool-using agent that turns knowledge articles and narration scripts into multi-minute videos through planning, asset re…☆86Oct 30, 2026Updated last week
- A custom fork for frontier-scale mixture-of-experts inference on an RTX 3060 with 12 GB VRAM, 16 GB system RAM and local NVMe.** Betelge…☆122Updated this week
- ☆183Updated this week
- Your favorite Terminal Coding Agent, now in Rust & a Breakdown of the Claude Code leak & discoveries☆14Apr 1, 2026Updated 7 months ago
- ☆16Jun 28, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Bonsai 2 27B: 262k context (trained max) on 12 GB, 54 to 97 tok/s decode, 2x prefill, q8_0 KV recipe, grammar tool calls 9/9. Same ternar…☆100Updated this week
- One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, pa…☆367Sep 26, 2026Updated last month
- Fast local transcription for large lectures with NVIDIA Parakeet ONNX☆23Updated this week
- DSpark-style speculative decoding draft head for Qwen3.6-27B AEON: training recipe, paired eval harness, vLLM patches. +11% serve tok/s v…☆14Jul 2, 2026Updated 4 months ago
- Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when …☆2,631Updated this week
- GLM-5.3-Flash EXL3 2.05 on one DGX Spark — TP1 vLLM, DFlash2 K5, concurrency, 262K context, and published fidelity measurements☆57Sep 22, 2026Updated last month
- progressive-resolution autoregressive audio-video generation model☆25Nov 3, 2026Updated last week
- Qwen3.8 Flash Next on one DGX Spark (TensorFold)☆390Oct 30, 2026Updated last week
- ☆58Oct 24, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Give GeForce cards (Turing and later) a BAR1 at least as large as their VRAM on Linux, without flashing.☆22Updated this week
- Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe and measured evidence for one NVIDIA DGX Spark☆21Sep 10, 2026Updated 2 months ago
- 8s of H3 video in 2m54s warm delivery on two DGX Sparks. Scene-specific LTX refinement, original-voice restoration, measured sync, clips …☆24Sep 12, 2026Updated last month
- ☆28Nov 3, 2026Updated last week
- Simple 2-channel virtual oscilloscope (soundcard signal) - SDL, RtAudio, FFTW3☆12Mar 25, 2017Updated 9 years ago
- Official implementation of "AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers"☆158Oct 30, 2026Updated last week
- Local-first, LLM-agnostic memory system — hybrid retrieval (vector + lexical + graph), multi-signal ranking. Runs on 4GB RAM, CPU-only, n…☆18Oct 8, 2026Updated last month
Are these results useful?