手写 Triton kernel 实现的 Qwen3.5-0.8B 纯文本推理引擎(batch=1, BF16, greedy)
☆12Sep 10, 2026Updated 2 months ago
Alternatives and similar repositories for qwen3_5-triton-inference-engine
Users that are interested in qwen3_5-triton-inference-engine are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Dec 22, 2024Updated last year
- 【CoG2020】Multi-source Data Multi-task Learning for Profiling Players in Online Games☆15Mar 29, 2022Updated 4 years ago
- Toolkit for ARP and RARP using Raw sockets in Rust☆19Jul 30, 2023Updated 3 years ago
- A vector field rendering library☆17Jul 31, 2019Updated 7 years ago
- ☆48Nov 1, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆11Aug 25, 2026Updated 2 months ago
- Mirror from https://bitbucket.org/VictorEijkhout/hpc-book-and-course/ by https://githgmirror.com/☆10Aug 18, 2020Updated 6 years ago
- ☆18Updated this week
- DeepSeek V4 Flash DSpark DGX Spark TP4 Ring 生产调优与算子工程归档 (LuZ0.4.5)☆17Sep 11, 2026Updated 2 months ago
- A compiler for darklang☆12Oct 26, 2026Updated 3 weeks ago
- Fused multilayer transformer kernels on Trainium 2/3☆12Aug 17, 2026Updated 3 months ago
- NVSHMEM skills for Claude Code☆25Aug 4, 2026Updated 3 months ago
- CuTeDSL tutorials, tools, autotuner, profiler, etc.☆47Jun 27, 2026Updated 4 months ago
- Memory-efficient multi layer perceptron implementation in OpenAI Triton.☆13Jan 24, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆30Oct 8, 2026Updated last month
- https://github.com/wozulong/fuclaude☆11Jul 27, 2024Updated 2 years ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆15Aug 31, 2023Updated 3 years ago
- 🚀 Transformer学习项目 - 从零实现Transformer模型,包含文本分类示例、注意力可视化和详细教程☆10Jul 1, 2026Updated 4 months ago
- A Zero-dependency GEMM library for RTX 50 series (SM120). 100% cuBLAS performance.☆19Aug 31, 2026Updated 2 months ago
- Make your Turtlebot2 run on ROS Melodic (Ubuntu 18.04).☆10Jul 2, 2021Updated 5 years ago
- 降低 AIGC 检测率的文本改写 Agent Skill。本技能的改写策略和 Prompt 设计衍生自 BypassAIGC 项目(作者 Yan Wenxin)☆14Apr 17, 2026Updated 7 months ago
- AI-Inference-Managed-by-AI: Go binary for managing AI inference on edge devices☆19Sep 1, 2026Updated 2 months ago
- Fast SGEMM emulation on Tensor Cores☆16Feb 16, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches☆15Jun 21, 2019Updated 7 years ago
- Memory-safe L4 Switch for Userspace Network Stacks☆20Feb 28, 2021Updated 5 years ago
- Socket library for Rust using smoltcp as userspace network stack☆20Feb 28, 2021Updated 5 years ago
- ☆12Mar 13, 2025Updated last year
- flash attention 优化日志☆34Aug 28, 2026Updated 2 months ago
- ☆17Oct 28, 2026Updated 3 weeks ago
- This is the proof-of-concept CPU implementation of ASPEN used for the NeurIPS'23 paper ASPEN: Breaking Operator Barriers for Efficient Pa…☆13Apr 4, 2024Updated 2 years ago
- The LaTeX template of thesis of HDU☆14Feb 19, 2019Updated 7 years ago
- MCP Server providing interactive popup dialogs for AI Agents☆13Dec 20, 2025Updated 11 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 2014: Variational Monte Carlo for the harmonic oscillator, helium, hydrogen and H2 - IPython notebook and FORTRAN90☆14Jun 23, 2016Updated 10 years ago
- SmartNIC☆14Dec 13, 2018Updated 7 years ago
- Virtual I/O acceleration technologies for KVM☆15Sep 17, 2013Updated 13 years ago
- ☆12Sep 1, 2021Updated 5 years ago
- Specification compiler to marshal/unmarshal binary protocols in OCaml☆13Sep 14, 2011Updated 15 years ago
- Stochastic Series Expansion (SSE) for a isotropic S=1/2 antiferromagnetic quantum Heisenberg model in 1D, 2D or 3D lattice . Every lattic…☆14Jan 23, 2021Updated 5 years ago
- ☆24Oct 15, 2021Updated 5 years ago
Are these results useful?