FlashInfer: Kernel Library for LLM Serving (Windows build & kernels)
☆20Oct 13, 2026Updated 2 weeks ago
Alternatives and similar repositories for flashinfer-windows
Users that are interested in flashinfer-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pynini for Windows☆27Apr 11, 2025Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)☆678Oct 22, 2026Updated last week
- Runtime ASI patches for PC games, one plugin per game from a shared hooking core. Fixes for ultrawide, FPS unlock, FOV, UI scaling and la…☆24Oct 13, 2026Updated 2 weeks ago
- ☆11May 2, 2022Updated 4 years ago
- A graphical tool to simplify building and installing DeepSpeed 0.15.x or later on Windows systems.☆21Apr 26, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- LMUnit: Fine-grained Evaluation with Natural Language Unit Tests☆12Jul 22, 2025Updated last year
- MEQA: A Benchmark for Multi-hop Event-centric Question Answering with Explanations☆14Apr 19, 2025Updated last year
- 在原始Apollo代码基础上修改了训练集格式以及训练过程 Improve the training set production process and the training process☆12May 30, 2025Updated last year
- BEAVER: A Training-Free Hierarchical Prompt Compression Method via Structure-Aware Page Selection☆17Mar 30, 2026Updated 7 months ago
- A minimal, hackable coding agent harness in Rust☆14Apr 24, 2026Updated 6 months ago
- Fermion Research fork of llama.cpp: FV5/FV5B five-value ternary types for Neutrino GGUF packs (CPU + CUDA)☆14Sep 29, 2026Updated last month
- Director WebUI for MiniMax H3 long-form workflows with ComfyUI☆40Aug 25, 2026Updated 2 months ago
- Natural-language constraints for JEPA world-model planning, judged by a decision model instead of an LLM.☆13Sep 24, 2026Updated last month
- LLM inference in C/C++☆16Aug 28, 2026Updated 2 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆11Oct 13, 2026Updated 2 weeks ago
- Fugusashi — Federated Learning of LLM Routing with Human-Interpretable Decisions. Open-source alternative to Sakana AI Fugu.☆23Aug 6, 2026Updated 2 months ago
- Evaluation framework for Medical Note generation by LLMs☆14Jun 23, 2026Updated 4 months ago
- ☆12Aug 28, 2024Updated 2 years ago
- Give your agent access to your GitHub, Hugging Face and other accounts safely☆22Oct 23, 2026Updated last week
- The agent that grows with you☆14Oct 14, 2026Updated 2 weeks ago
- High-performance ASR tool using Faster Whisper, supporting custom models, multi-language transcription, and real-time processing feedback…☆10Sep 17, 2025Updated last year
- ☆13Aug 31, 2026Updated last month
- Customized Seed-VC implementation☆14Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Slightly modified branch of aider.chat, focused on creating a more autonomous agentic version.☆25Mar 19, 2025Updated last year
- Improved RAG retrieval by adding context to the chunks and performing Hybrid Search (Vector Semantic Search + BM25 Keyword Search) and Re…☆11Dec 23, 2024Updated last year
- Port of NVIDIA's Parakeet TDT 0.6B V2 model in raw WebGPU + SIMD WASM☆19Aug 15, 2026Updated 2 months ago
- The Quine research project☆10Oct 14, 2026Updated 2 weeks ago
- ☆17Jan 24, 2026Updated 9 months ago
- Tiny-MoE is a lightweight Mixture-of-Experts language model built entirely from scratch in native PyTorch and trained end-to-end on Kaggl…☆21Sep 24, 2026Updated last month
- ISONGraph is a multi-language property graph library designed specifically for LLM and AI applications. It provides the most token-effici…☆18Sep 5, 2026Updated last month
- 可能是全网唯一的 C# 版又拍云 SDK，封装全部已知的又拍云 OpenAPI，包含又拍云云存储服务（USS）、又拍云短信服务（SMS）、又拍云一键登录服务（SIM）、又拍云服务管理后台等模块，可跨平台，持续随官方更新。☆11Aug 8, 2024Updated 2 years ago
- DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code☆10Mar 8, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Thireus's fork of llama.cpp with Cuda 12.8 and 13.4 release builds and Windows patch for loading more .gguf shards + llama-sweep-bench☆30Oct 19, 2026Updated last week
- 99.156% Accuracy from Agentic Document Extraction DPT-2 model on DocVQA val split☆15Nov 20, 2025Updated 11 months ago
- Local-first Maildir-inspired work mailstore for software agents☆25Sep 28, 2026Updated last month
- [ECCV 2026] Implementation of "CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation"☆33Jun 25, 2026Updated 4 months ago
- ☆10Feb 11, 2026Updated 8 months ago
- [TrustNLP@NAACL 2025] BiasEdit: Debiasing Stereotyped Language Models via Model Editing☆18Sep 30, 2025Updated last year
- A minimal AI agent that gives an LLM a handful of tools, then gets out of the way.☆12Updated this week