Lynn 原生 LLM 推理引擎 · W4A8/NVFP4 量化 · 自写 CUDA/Triton kernel · MoE · 投机解码 | Lynn-native LLM inference engine for NVIDIA Blackwell
☆28Jun 8, 2026Updated 4 months ago
Alternatives and similar repositories for lynn-engine
Users that are interested in lynn-engine are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆26Jun 16, 2026Updated 4 months ago
- wrapper for Hunyuan-PromptEnhancer☆14Oct 10, 2025Updated last year
- [MIA 2025]: A New Dataset and Versatile Multi-Task Surgical Workflow Analysis Framework for Thoracoscopic Mitral Valvuloplasty☆14Aug 11, 2025Updated last year
- 一个轻量化的大模型推理框架☆23May 26, 2025Updated last year
- Qwen and DeepSeek low-VRAM LoRA training with GGUF base model, compatible with Transformers and PEFT☆22Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A case study of quantitative modeling for beginners.☆26Jan 26, 2026Updated 8 months ago
- Windows本地bonsai模型部署启动器☆34Updated this week
- 循序渐进学习LLM：基础篇入门原理，进阶篇源码解析☆14Nov 9, 2025Updated 11 months ago
- [IEEE RA-L&ICRA2025] Think Step by Step: Chain-of-Gesture Prompting for Error Detection in Robotic Surgical Videos☆15Aug 26, 2025Updated last year
- Claude Code agent skills for writing optimized Triton GPU kernels☆15Mar 6, 2026Updated 7 months ago
- fused MoE kernel in Candle backend☆14Feb 3, 2026Updated 8 months ago
- ☆17Nov 28, 2024Updated last year
- 基于 C++23 的模块化 LLM 推理框架，原生解析 GGUF 格式。☆51Jun 19, 2026Updated 4 months ago
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆29Oct 8, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Nano vLLM Triton☆14Aug 27, 2025Updated last year
- A Rust compiler backend and runtime that compiles Rust kernels to many NPU/GPU accelerators via MLIR — vendor-agnostic (Ascend, Trainium,…☆20Updated this week
- ☆11Jan 11, 2024Updated 2 years ago
- [Accepted to SOSP 2026] Fast Deterministic LLM Inference☆32Updated this week
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- ☆17Nov 19, 2020Updated 5 years ago
- Phi-Bench (Φ-Bench): 85 open-source LLM-infrastructure engineering tasks for frontier LLMs & coding agents (KFC/LH/E2E). Self-contained p…☆69Oct 13, 2026Updated last week
- Common template for pytorch project. Easy to extent and modify for new project.☆13Dec 13, 2022Updated 3 years ago
- A directory of benchmarks for the components and complete systems used to build voice agents.☆35Sep 26, 2026Updated 3 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This repository is the official implementation of FLUX-CustomID. It is capable of generating images based on your face image at a level e…☆25Nov 13, 2024Updated last year
- cpp rotation album，基于cpp eigen实现的3d旋转相册，GAMES101复现内容☆12Jul 25, 2022Updated 4 years ago
- ☆20Oct 5, 2025Updated last year
- A Feishu/Lark AI agent bot☆16Feb 27, 2026Updated 7 months ago
- This adds partial support of AVX2 and AVX-512 to gem5.☆15Dec 19, 2023Updated 2 years ago
- Sampling techniques for Candle.☆21Apr 3, 2024Updated 2 years ago
- A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches☆15Jun 21, 2019Updated 7 years ago
- ☆11Nov 7, 2024Updated last year
- TensorRT half precision inference routine on a API-based TensorRT model☆12Jul 3, 2018Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official repository for VARestorer: One-Step VAR Distillation for Real-World Image Super-Resolution (ICLR2026))☆27Jul 25, 2026Updated 2 months ago
- The Bytepiece Tokenizer Implemented in Rust.☆15Nov 28, 2023Updated 2 years ago
- A straightforward (complete) sample of how to implement AES-GCM by using Linux crypto API at kernel side☆13Oct 6, 2022Updated 4 years ago
- ☆12Jun 11, 2021Updated 5 years ago
- ☆20May 27, 2025Updated last year
- ☆12Jul 2, 2024Updated 2 years ago
- 🚀 精选 Claude Skills、Agent Skills、LLM Skills 及 AI 智能体开发资源列表（中文）。A curated list of awesome Claude / Agent / LLM Skills.☆59Oct 15, 2026Updated last week