Alternatives and similar repositories for nki-samples

Users that are interested in nki-samples are comparing it to the libraries listed below

• aws-neuron / neuronx-distributed
  ☆59Updated 2 weeks ago
• aws-neuron / nki-llama
  Project showing how to develop NKI kernels for Llama 3.2 1B inference
  ☆16Updated last month
• awslabs / nki-autotune
  ☆14Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆87Updated 3 months ago
• aws-neuron / neuronx-nemo-megatron
  ☆38Updated 6 months ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆148Updated last month
• awslabs / slapo
  A schedule language for large model training
  ☆149Updated last year
• aws-neuron / transformers-neuronx
  ☆111Updated 6 months ago
• triton-lang / kernels
  ☆83Updated 8 months ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆113Updated 2 years ago
• Jokeren / triton-samples
  ☆28Updated 6 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆205Updated last week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆136Updated 3 months ago
• stanford-futuredata / stk
  ☆106Updated 10 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆225Updated this week
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆166Updated last week
• openxla / shardy
  MLIR-based partitioning system
  ☆103Updated this week
• pytorch-labs / helion
  A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
  ☆187Updated this week
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆99Updated this week
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆23Updated last year
• axonn-ai / axonn
  A parallel framework for training deep neural networks
  ☆61Updated 4 months ago
• awslabs / ratex
  ☆23Updated 7 months ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆40Updated 2 years ago
• yanring / Megatron-MoE-ModelZoo
  Best practices for testing advanced Mixtral, DeepSeek, and Qwen series MoE models using Megatron Core MoE.
  ☆29Updated last month
• awslabs / lorien
  ☆43Updated last year
• ScalingIntelligence / hydragen
  Hydragen: High-Throughput LLM Inference with Shared Prefixes
  ☆41Updated last year
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆187Updated last week
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆80Updated 10 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆144Updated 8 months ago
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆218Updated 7 months ago