A physics-grounded, cost-aware optimization loop for vLLM
☆67Aug 22, 2026Updated 2 months ago
Alternatives and similar repositories for profile
Users that are interested in profile are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ModSleuth builds evidence-grounded dependency graphs for LLM releases from public artifacts such as model cards, dataset cards, technical…☆17Jun 15, 2026Updated 4 months ago
- ☆27Jun 17, 2026Updated 4 months ago
- vLLM GGUF plugin fork — Qwen3.5/3.6 hybrid (GDN) serving: iq4_xs mmvq perf, MTP speculative decode, MoE draft support☆12Updated this week
- Proxima lets existing GPUs serve 4x more concurrent requests☆26Aug 19, 2026Updated 2 months ago
- The world leaderboard ranking for AI usages.☆16Oct 7, 2026Updated 3 weeks ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Answer-aware memory for Markdown notes: hybrid search + pluggable passage reranker, as a Claude Code plugin☆12Oct 15, 2026Updated 2 weeks ago
- 3D-navigable latent space of Vital synth presets — VAE + CLAP + wavetable galaxy + drag-any-audio→export-as-.vital☆18Jul 16, 2026Updated 3 months ago
- 💜 The slightly more compromising Python code formatter☆11Feb 26, 2021Updated 5 years ago
- SGLang Docker image for AMD Strix Halo (gfx1151 / Radeon 8060S)☆42Sep 17, 2026Updated last month
- Multi-GPU prefill acceleration for llama.cpp☆15Oct 23, 2026Updated last week
- The code implementation of HyGRAG, accepted by WWW'26.☆17May 31, 2026Updated 4 months ago
- Pure Triton kernels for Qwen3.5-27B inference on NVIDIA B200☆124Feb 28, 2026Updated 8 months ago
- ☆14Updated this week
- Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives☆13Apr 8, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Kubernetes controller and webhook implementation that enables safe, staged rollouts of DaemonSets☆16Jul 31, 2025Updated last year
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆27Aug 17, 2026Updated 2 months ago
- A lightweight, standalone Go microservice for streaming ZIP archives on-the-fly from S3-compatible storage or local filesystems.☆13Nov 30, 2025Updated 11 months ago
- How much of your code is written by agents?☆24Apr 24, 2026Updated 6 months ago
- Interactive 3D model of NVIDIA Vera Rubin hardware (superchip, NVL72 compute tray, HGX NVL8) with connection tracing and a guided tour☆16Oct 1, 2026Updated 3 weeks ago
- a Python library that uses Reinforcement Learning (RL) to train LLMs.☆43Jul 12, 2026Updated 3 months ago
- High-performance Rust benchmark client for vLLM serving endpoints.☆52Aug 3, 2026Updated 2 months ago
- bandwidth limiting middleware plugin for Traefik that provides fine-grained control over data transfer rates. This plugin supports per-ba…☆16Oct 22, 2026Updated last week
- Run on TWO-DGX-Spark - vLLm-0.24.0 dual cache optimized DSV4F+DSpark+NVFP4 KV (Concurrency 12 with 1.5M context/3M KV token Pool) >0.58-0…☆21Aug 17, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11May 12, 2026Updated 5 months ago
- CLI coding agents for everyone — checkpoints, preview, plugin/skill/MCP management, AI teams.☆11Oct 13, 2026Updated 2 weeks ago
- Open-source MCP server — progressive tool discovery, code execution, intelligent routing & token optimization across 50+ tools☆17Jun 25, 2026Updated 4 months ago
- Modern Memory Bandwidth and Latency Benchmarks☆18Aug 27, 2026Updated 2 months ago
- ☆12May 26, 2025Updated last year
- A high-throughput LLM serving engine with non-uniform KV cache compression, built on vLLM☆16Sep 9, 2026Updated last month
- Track GitHub files, directories, commits, pull requests, and agent skills like dependencies.☆31Jul 7, 2026Updated 3 months ago
- Implemented and benchmarked KV cache compression methods for LLM inference in Triton. Optimized kernels for KIVI and TurboQuant with Flas…☆18Jun 19, 2026Updated 4 months ago
- Doc Thinker: All-in-One RAG - document parsing, graph RAG, and evaluation☆33Oct 21, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Session replay for Laravel, built on rrweb: a recorder with privacy defaults, token-signed ingest, recordings on your own disk and databa…☆46Updated this week
- A book about observability in practice☆20Feb 25, 2023Updated 3 years ago
- ☆27Jul 8, 2024Updated 2 years ago
- vLLM fork with Marlin W4A8 SM121 patches + TMA module☆15Mar 23, 2026Updated 7 months ago
- vLLM Qwen3.5-122B NVFP4 on DGX Spark (SM121) — full Docker build with 15 patches☆17Mar 17, 2026Updated 7 months ago
- Object storage benchmark: S3, R2, Railway Buckets, Backblaze B2, Neon, and UploadThing through one SDK, from six locations☆13Oct 17, 2026Updated 2 weeks ago
- ☆13Feb 11, 2025Updated last year