Alternatives and similar repositories for NeMo-Run:

Users that are interested in NeMo-Run are comparing it to the libraries listed below

• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆234Updated this week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆104Updated 2 months ago
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆271Updated last week
• NVIDIA / Megatron-Energon
  Megatron's multi-modal data loader
  ☆183Updated this week
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆222Updated 8 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆107Updated last week
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆231Updated this week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆251Updated last week
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆55Updated this week
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆190Updated this week
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆202Updated 8 months ago
• apple / ml-recurrent-drafter
  ☆204Updated 2 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆275Updated this week
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆262Updated 5 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆253Updated 8 months ago
• run-ai / runai-model-streamer
  ☆176Updated this week
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆131Updated last week
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆209Updated 4 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆151Updated this week
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• NVIDIA / NeMo-Skills
  A project to improve skills of large language models
  ☆260Updated this week
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆177Updated this week
• stanford-futuredata / stk
  ☆102Updated 7 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆128Updated 5 months ago
• triton-inference-server / vllm_backend
  ☆238Updated this week
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆92Updated last year
• neuralmagic / AutoFP8
  ☆184Updated 6 months ago
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆331Updated 4 months ago
• huggingface / picotron_tutorial
  ☆158Updated last month
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆181Updated this week