Project showing how to develop NKI kernels for Llama 3.2 1B inference
☆21May 29, 2025Updated last year
Alternatives and similar repositories for nki-llama
Users that are interested in nki-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Jun 25, 2026Updated last week
- ☆68Jun 22, 2026Updated last week
- Notebooks and sample code for Build On Trainium☆48Jan 14, 2026Updated 5 months ago
- The ASPLOS 2025 / EuroSys 2025 Contest Track☆41Jun 4, 2026Updated last month
- ☆13Dec 20, 2025Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Autocomp: Optimize any AI kernel, anywhere.☆139Jun 25, 2026Updated last week
- ☆18May 9, 2024Updated 2 years ago
- ☆38May 14, 2026Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆26Jun 9, 2026Updated 3 weeks ago
- Accelerator Zoo☆20Oct 14, 2025Updated 8 months ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated last year
- ☆18Oct 3, 2025Updated 9 months ago
- ☆43Jan 29, 2026Updated 5 months ago
- ☆15Apr 13, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This repository features Amazon SageMaker Ground Truth and explains how to ingest raw 3D point cloud data, label it, train a 3D object de…☆13Jun 23, 2022Updated 4 years ago
- MLSys competition for the best MOE NKI kernels☆46May 29, 2026Updated last month
- ☆25Oct 30, 2024Updated last year
- An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.☆21Nov 28, 2022Updated 3 years ago
- The repository guides you through generating a synthetic dataset for a QA-RAG application using the Bedrock API, Python and Langchain.☆20Sep 17, 2024Updated last year
- some mixture of experts architecture implementations☆27Mar 22, 2024Updated 2 years ago
- paris - world's first decentralized trained open-weight diffusion model☆57Oct 7, 2025Updated 8 months ago
- This repository will soon contain all scripts and links to the annotated corpora of Tibetan.☆14Feb 4, 2025Updated last year
- Parallel framework for training and fine-tuning deep neural networks☆74Apr 28, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AutoQASM is an experimental module offering a quantum-imperative programming experience in Python for developing quantum programs.☆22Jun 23, 2026Updated last week
- A high-performance acceleration library dedicated to large-scale model training on AMD GPUs☆66Updated this week
- ☆27Jan 22, 2026Updated 5 months ago
- A hardware-agnostic (NVIDIA's GPUs and AWS Inferentia accelerators) deployment of computer-vision models (e.g., YOLO, ViT), generate tex…☆27Jul 1, 2025Updated last year
- ☆27Oct 25, 2023Updated 2 years ago
- 🔥 API for warframe market, implemented in Python.☆47Apr 19, 2026Updated 2 months ago
- ☆24Jun 4, 2026Updated last month
- Some crazy experiments☆35Sep 3, 2025Updated 10 months ago
- Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service☆31Mar 26, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Drug effect prediction using neural network☆26Sep 14, 2020Updated 5 years ago
- Data set of Finnish grey literature, containing curated Dublin Core style metadata and links to original PDF publications☆34Mar 27, 2026Updated 3 months ago
- ☆26Dec 27, 2023Updated 2 years ago
- ☆13Dec 17, 2025Updated 6 months ago
- An MLIR-based compiler from C/C++ to AMD-Xilinx Versal AIE☆17Aug 5, 2022Updated 3 years ago
- An LLVM pass to prove that an II works for the given loop for Vitis HLS☆11Aug 22, 2021Updated 4 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago