Alternatives and similar repositories for nki-samples:

Users that are interested in nki-samples are comparing it to the libraries listed below

• aws-samples / nki-llama
  ☆13Updated last month
• aws-neuron / neuronx-distributed
  ☆55Updated last month
• awslabs / nki-autotune
  ☆14Updated this week
• aws-neuron / neuronx-nemo-megatron
  ☆35Updated 4 months ago
• RulinShao / FastCkpt
  Python package for rematerialization-aware gradient checkpointing
  ☆24Updated last year
• cchan / tccl
  extensible collectives library in triton
  ☆86Updated last month
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆24Updated last year
• awslabs / slapo
  A schedule language for large model training
  ☆146Updated 10 months ago
• triton-lang / kernels
  ☆79Updated 6 months ago
• zhisbug / Cavs
  Cavs: An Efficient Runtime System for Dynamic Neural Networks
  ☆14Updated 4 years ago
• awslabs / ratex
  ☆23Updated 5 months ago
• Jokeren / triton-samples
  ☆27Updated 3 months ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆38Updated 2 years ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆143Updated last week
• awslabs / lorien
  ☆43Updated last year
• zhuohan123 / terapipe
  ☆72Updated 4 years ago
• aws-neuron / upstreaming-to-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆15Updated last week
• awslabs / Lancet-Accelerating-MoE-Training-via-Whole-Graph-Computation-Communication-Overlapping
  Official implementation for the paper Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapp…
  ☆11Updated 7 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• aws-neuron / transformers-neuronx
  ☆107Updated 3 months ago
• stanford-cs149 / asst4-trainium
  ☆27Updated 5 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆65Updated last month
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆88Updated last week
• simveit / effective_transpose
  Effective transpose on Hopper GPU
  ☆17Updated last week
• aws-samples / aws-efa-nccl-baseami-pipeline
  EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
  ☆43Updated last year
• google / iopddl
  Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning
  ☆23Updated 4 months ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆113Updated 2 years ago
• saareliad / FTPipe
  FTPipe and related pipeline model parallelism research.
  ☆41Updated last year
• argonne-lcf / LLM-Inference-Bench
  LLM-Inference-Bench
  ☆40Updated 4 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆194Updated this week