aws-neuron / nki-llamaLinks
Project showing how to develop NKI kernels for Llama 3.2 1B inference
☆20Updated 8 months ago
Alternatives and similar repositories for nki-llama
Users that are interested in nki-llama are comparing it to the libraries listed below
Sorting:
- ☆58Updated last week
- ☆17Updated this week
- ☆64Updated last month
- A schedule language for large model training☆152Updated 5 months ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25Updated 8 months ago
- ☆84Updated 3 years ago
- ☆159Updated last year
- Perplexity GPU Kernels☆560Updated 3 months ago
- AccelOpt: Self-improving Agents for AI Accelerator Kernel Optimization☆20Updated last week
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆262Updated this week
- Synthesizer for optimal collective communication algorithms☆124Updated last year
- This repository contains companion software for the Colfax Research paper "Categorical Foundations for CuTe Layouts".☆103Updated 4 months ago
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆36Updated 5 months ago
- Github mirror of trition-lang/triton repo.☆128Updated this week
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆168Updated this week
- ☆18Updated last year
- PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…☆156Updated this week
- DietCode Code Release☆65Updated 3 years ago
- Building the Virtuous Cycle for AI-driven LLM Systems☆151Updated last week
- Microsoft Collective Communication Library☆66Updated last year
- Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar…☆96Updated last month
- Compiler for Dynamic Neural Networks☆45Updated 2 years ago
- ☆23Updated 5 months ago
- ☆60Updated this week
- LLM serving cluster simulator☆135Updated last year
- Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.☆55Updated 3 years ago
- FlashInfer Bench @ MLSys 2026: Building AI agents to write high performance GPU kernels☆84Updated 2 weeks ago
- ☆48Updated last year
- WaferLLM: Large Language Model Inference at Wafer Scale☆88Updated last month
- ☆259Updated last year