Alternatives and similar repositories for NeMo

Users that are interested in NeMo are comparing it to the libraries listed below

• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆14,493Updated this week
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆9,377Updated this week
• deepspeedai / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆40,961Updated this week
• speechbrain / speechbrain
  A PyTorch-based Speech Toolkit
  ☆10,915Updated last week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,693Updated this week
• NVIDIA / TensorRT-LLM
  TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…
  ☆12,385Updated this week
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆21,067Updated this week
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,365Updated last year
• espnet / espnet
  End-to-End Speech Processing Toolkit
  ☆9,632Updated this week
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆7,801Updated last week
• sgl-project / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆21,166Updated this week
• facebookresearch / xformers
  Hackable and optimized Transformers building blocks, supporting a composable construction.
  ☆10,184Updated this week
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆16,638Updated this week
• facebookresearch / metaseq
  Repo for external large-scale work
  ☆6,548Updated last year
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆10,581Updated 3 weeks ago
• OpenNMT / CTranslate2
  Fast inference engine for Transformer models
  ☆4,179Updated last week
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆20,268Updated this week
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,388Updated 7 months ago
• EleutherAI / gpt-neox
  An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
  ☆7,347Updated 2 months ago
• meta-pytorch / torchtune
  PyTorch native post-training library
  ☆5,615Updated this week
• EleutherAI / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆10,920Updated this week
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆39,307Updated 6 months ago
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆13,032Updated 11 months ago
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆65,334Updated this week
• google / sentencepiece
  Unsupervised text tokenizer for Neural Network-based text generation.
  ☆11,490Updated last week
• deepspeedai / DeepSpeedExamples
  Example models using DeepSpeed
  ☆6,747Updated 2 months ago
• google-research / t5x
  ☆2,915Updated 3 weeks ago
• huggingface / optimum
  🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…
  ☆3,203Updated last week
• NVIDIA / apex
  A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
  ☆8,872Updated this week
• Lightning-AI / pytorch-lightning
  Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
  ☆30,561Updated this week