NVIDIA / NeMo-Framework-LauncherLinks
Provides end-to-end model development pipelines for LLMs and Multimodal models that can be launched on-prem or cloud-native.
β507Updated 4 months ago
Alternatives and similar repositories for NeMo-Framework-Launcher
Users that are interested in NeMo-Framework-Launcher are comparing it to the libraries listed below
Sorting:
- The Triton TensorRT-LLM Backendβ881Updated last week
- ποΈ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Oβ¦β310Updated last week
- Scalable toolkit for efficient model alignmentβ837Updated 3 weeks ago
- β291Updated 3 weeks ago
- Large Context Attentionβ729Updated 7 months ago
- Microsoft Automatic Mixed Precision Libraryβ616Updated 10 months ago
- A tool to configure, launch and manage your machine learning experiments.β183Updated this week
- Easy and lightning fast training of π€ Transformers on Habana Gaudi processor (HPU)β193Updated this week
- Pipeline Parallelism for PyTorchβ775Updated last year
- β412Updated last year
- Fast Inference Solutions for BLOOMβ564Updated 10 months ago
- Scalable data pre processing and curation toolkit for LLMsβ1,082Updated this week
- Serving multiple LoRA finetuned LLM as oneβ1,083Updated last year
- π Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.β208Updated 2 weeks ago
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welβ¦β371Updated 2 months ago
- FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.β886Updated 11 months ago
- Zero Bubble Pipeline Parallelismβ421Updated 3 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMsβ80Updated this week
- Easy and Efficient Quantization for Transformersβ201Updated 2 months ago
- π Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flashβ¦β261Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMsβ266Updated 10 months ago
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Servβ¦β484Updated 3 weeks ago
- β120Updated last year
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Blaβ¦β2,666Updated this week
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decodingβ1,272Updated 5 months ago
- GPTQ inference Triton kernelβ306Updated 2 years ago
- This repository contains tutorials and examples for Triton Inference Serverβ758Updated 3 weeks ago
- Latency and Memory Analysis of Transformer Models for Training and Inferenceβ449Updated 4 months ago
- Applied AI experiments and examples for PyTorchβ291Updated this week
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.β816Updated 2 weeks ago