Alternatives and similar repositories for nki-reasoning

Users that are interested in nki-reasoning are comparing it to the libraries listed below

• aws-neuron / nki-samples
  ☆37Updated 3 weeks ago
• awslabs / nki-autotune
  ☆14Updated last week
• aws-neuron / neuronx-distributed
  ☆58Updated last month
• awslabs / Lancet-Accelerating-MoE-Training-via-Whole-Graph-Computation-Communication-Overlapping
  Official implementation for the paper Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapp…
  ☆12Updated 9 months ago
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆179Updated 2 weeks ago
• aws-samples / awsome-inference
  ☆47Updated last month
• Azure / msccl
  Microsoft Collective Communication Library
  ☆64Updated 7 months ago
• uccl-project / uccl
  Ultra and Unified CCL
  ☆165Updated this week
• guqiqi / Samoyeds
  Samoyeds: Accelerating MoE Models with Structured Sparsity Leveraging Sparse Tensor Cores (EuroSys'25)
  ☆11Updated 3 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆86Updated 2 months ago
• awslabs / slapo
  A schedule language for large model training
  ☆149Updated last year
• aws-neuron / upstreaming-to-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆18Updated this week
• aws-neuron / neuronx-distributed-training
  ☆11Updated last month
• hao-ai-lab / MuxServe
  ☆62Updated last year
• yifuwang / symm-mem-recipes
  ☆90Updated 5 months ago
• triton-lang / kernels
  ☆81Updated 7 months ago
• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆106Updated last year
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆149Updated 2 weeks ago
• openxla / shardy
  MLIR-based partitioning system
  ☆97Updated this week
• asplos-contest / 2025
  The ASPLOS 2025 / EuroSys 2025 Contest Track
  ☆37Updated last month
• snowflakedb / ArcticInference
  ☆159Updated this week
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆42Updated last month
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆176Updated this week
• ParCIS / Chimera
  Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.
  ☆67Updated 3 months ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆177Updated 8 months ago
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆144Updated last week
• ppl-ai / libfabric-efa-demo
  ☆62Updated 4 months ago
• tbd-ai / tbd-suite
  ☆47Updated 2 years ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• stanford-cs149 / asst4-trainium
  ☆27Updated 6 months ago