Lynn 原生 LLM 推理引擎 · W4A8/NVFP4 量化 · 自写 CUDA/Triton kernel · MoE · 投机解码 | Lynn-native LLM inference engine for NVIDIA Blackwell
☆22Jun 8, 2026Updated last month
Alternatives and similar repositories for lynn-engine
Users that are interested in lynn-engine are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [Accepted to SOSP 2026] Fast Deterministic LLM Inference☆21Updated this week
- ☆20Oct 5, 2025Updated 9 months ago
- A Rust-based, SenseVoiceSmall☆37Apr 27, 2026Updated 2 months ago
- 基于 C++23 的模块化 LLM 推理框架，原生解析 GGUF 格式。☆39Jun 19, 2026Updated 3 weeks ago
- Running LLaMA 3 with Rust.☆10May 21, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- Sampling techniques for Candle.☆21Apr 3, 2024Updated 2 years ago
- Common template for pytorch project. Easy to extent and modify for new project.☆13Dec 13, 2022Updated 3 years ago
- The Bytepiece Tokenizer Implemented in Rust.☆15Nov 28, 2023Updated 2 years ago
- Java-like Language with Static Information Flow Types☆14May 5, 2025Updated last year
- a personal knowledge management system that collects and retrieves knowledge from files, webpages, papers, emails, and notes. It features…☆74Jun 6, 2026Updated last month
- ☆12Mar 22, 2022Updated 4 years ago
- ☆12Jun 11, 2021Updated 5 years ago
- poorman's ar-dit tts☆45Dec 31, 2025Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This adds partial support of AVX2 and AVX-512 to gem5.☆15Dec 19, 2023Updated 2 years ago
- ☆15Aug 4, 2021Updated 4 years ago
- A straightforward (complete) sample of how to implement AES-GCM by using Linux crypto API at kernel side☆13Oct 6, 2022Updated 3 years ago
- A streaming audio reader, processor, and writer built on top of soundfile, and PyAV (bindings for FFmpeg)☆39Mar 31, 2026Updated 3 months ago
- An attempt to migrate Karpathy's llm.c to safe rust.☆13Jun 4, 2024Updated 2 years ago
- 高性能短序列稀疏Mask Attention CUDA算子，针对<1K序列+75%稀疏度优化☆79Mar 18, 2026Updated 3 months ago
- Evaluation code for confidential virtual machines (AMD SEV-SNP / Intel TDX)☆17Mar 12, 2026Updated 4 months ago
- 不围棋c语言实现，大一大作业，关键算法是判断围棋中的气☆10Aug 14, 2020Updated 5 years ago
- Simulator of a memory controller to connect DRAMSim and FlashDIMMSim into one unified memory☆18Apr 4, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆16Feb 27, 2022Updated 4 years ago
- TensorRT half precision inference routine on a API-based TensorRT model☆12Jul 3, 2018Updated 8 years ago
- ☆14Jan 12, 2022Updated 4 years ago
- A generative speech model for daily dialogue.☆16Aug 21, 2025Updated 10 months ago
- Keep a journal of things I want to share☆12Aug 23, 2022Updated 3 years ago
- ☆14Mar 7, 2025Updated last year
- GoPTX: Fine-grained GPU Kernel Fusion by PTX-level Instruction Flow Weaving☆21Jul 30, 2025Updated 11 months ago
- Rust standalone inference of Namo-500M series models. Extremly tiny, runing VLM on CPU.☆24Mar 12, 2025Updated last year
- ☆13Oct 6, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A small rust-based data loader☆36Feb 20, 2026Updated 4 months ago
- Rust语言编写的阿里云OSS的SDK，依据官网文档并参考了其他语言的实现☆14Aug 31, 2025Updated 10 months ago
- Streaming Text to Speech Web UI☆22May 6, 2024Updated 2 years ago
- GPU Power Modelling Tool☆14Nov 15, 2019Updated 6 years ago
- Candle Pipelines provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered …☆23Jan 5, 2026Updated 6 months ago
- NVIDIA cuTile learn☆168Dec 9, 2025Updated 7 months ago
- ☆17May 22, 2023Updated 3 years ago