NVIDIA / NeMo-Run
A tool to configure, launch and manage your machine learning experiments.
☆146Updated this week
Alternatives and similar repositories for NeMo-Run
Users that are interested in NeMo-Run are comparing it to the libraries listed below
Sorting:
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆245Updated this week
- PyTorch per step fault tolerance (actively under development)☆300Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆263Updated 7 months ago
- Scalable and Performant Data Loading☆258Updated this week
- Load compute kernels from the Hub☆119Updated last week
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆186Updated this week
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆195Updated this week
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆159Updated this week
- Google TPU optimizations for transformers models☆109Updated 3 months ago
- Easy and Efficient Quantization for Transformers☆197Updated 3 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆256Updated 10 months ago
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆60Updated last month
- This repository contains the experimental PyTorch native float8 training UX☆224Updated 9 months ago
- Megatron's multi-modal data loader☆197Updated last week
- A family of compressed models obtained via pruning and knowledge distillation☆336Updated 6 months ago
- Applied AI experiments and examples for PyTorch☆265Updated 2 weeks ago
- ☆209Updated 3 months ago
- Fast low-bit matmul kernels in Triton☆299Updated this week
- Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research☆195Updated this week
- Efficient LLM Inference over Long Sequences☆373Updated 2 weeks ago
- ☆255Updated last week
- The Triton backend for the PyTorch TorchScript models.☆150Updated last week
- ☆117Updated last year
- Inference server benchmarking tool☆59Updated 3 weeks ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆109Updated last week
- Scalable toolkit for efficient model alignment☆794Updated 2 weeks ago
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆325Updated this week
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆229Updated this week
- ☆190Updated last week
- ☆138Updated 2 weeks ago