Project showing how to develop NKI kernels for Llama 3.2 1B inference
☆21May 29, 2025Updated 9 months ago
Alternatives and similar repositories for nki-llama
Users that are interested in nki-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆59Feb 10, 2026Updated last month
- Notebooks and sample code for Build On Trainium☆47Jan 14, 2026Updated 2 months ago
- The ASPLOS 2025 / EuroSys 2025 Contest Track☆40Aug 7, 2025Updated 7 months ago
- Autocomp: AI-Driven Code Optimizer for Tensor Accelerators☆89Updated this week
- ☆12Dec 20, 2025Updated 3 months ago
- ☆18May 9, 2024Updated last year
- ☆32Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆25Mar 5, 2026Updated 2 weeks ago
- Accelerator Zoo☆20Oct 14, 2025Updated 5 months ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated 10 months ago
- This repository features Amazon SageMaker Ground Truth and explains how to ingest raw 3D point cloud data, label it, train a 3D object de…☆13Jun 23, 2022Updated 3 years ago
- ☆14May 29, 2024Updated last year
- MLSys competition for the best MOE NKI kernels☆39Updated this week
- An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.☆21Nov 28, 2022Updated 3 years ago
- The repository guides you through generating a synthetic dataset for a QA-RAG application using the Bedrock API, Python and Langchain.☆20Sep 17, 2024Updated last year
- ☆13Dec 19, 2025Updated 3 months ago
- This repository will soon contain all scripts and links to the annotated corpora of Tibetan.☆14Feb 4, 2025Updated last year
- Parallel framework for training and fine-tuning deep neural networks☆72Nov 10, 2025Updated 4 months ago
- AutoQASM is an experimental module offering a quantum-imperative programming experience in Python for developing quantum programs.☆22Mar 16, 2026Updated last week
- Samoyeds: Accelerating MoE Models with Structured Sparsity Leveraging Sparse Tensor Cores (EuroSys'25)☆15Jul 17, 2025Updated 8 months ago
- A hardware-agnostic (NVIDIA's GPUs and AWS Inferentia accelerators) deployment of computer-vision models (e.g., YOLO, ViT), generate tex…☆27Jul 1, 2025Updated 8 months ago
- ☆27Jan 22, 2026Updated 2 months ago
- ☆14Dec 20, 2023Updated 2 years ago
- (current) A NGS analysis framework for WGS data, which automates the entire process of spinning up AWS EC2 spot instances and processing …☆23Mar 11, 2026Updated last week
- ☆32Jan 30, 2026Updated last month
- Slides and other materials for club meetings☆17Jun 26, 2022Updated 3 years ago
- ☆20Apr 24, 2022Updated 3 years ago
- ☆25Mar 6, 2026Updated 2 weeks ago
- Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service☆29Dec 3, 2024Updated last year
- Some crazy experiments☆35Sep 3, 2025Updated 6 months ago
- Drug effect prediction using neural network☆24Sep 14, 2020Updated 5 years ago
- ☆27Dec 27, 2023Updated 2 years ago
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆38Aug 29, 2025Updated 6 months ago
- ☆29May 3, 2024Updated last year
- ☆13Dec 17, 2025Updated 3 months ago
- An MLIR-based compiler from C/C++ to AMD-Xilinx Versal AIE☆17Aug 5, 2022Updated 3 years ago
- An LLVM pass to prove that an II works for the given loop for Vitis HLS☆11Aug 22, 2021Updated 4 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago
- [FCCM 2023] PASTA: Programming and Automation Support for Scalable Task-Parallel HLS Programs on Modern Multi-Die FPGAs☆14Jun 26, 2025Updated 8 months ago