Alternatives and similar repositories for NeMo

Users that are interested in NeMo are comparing it to the libraries listed below

• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆15,016Updated this week
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆9,461Updated last week
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆21,773Updated this week
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆7,912Updated this week
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆17,115Updated this week
• facebookresearch / fairseq
  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
  ☆32,111Updated 3 months ago
• speechbrain / speechbrain
  A PyTorch-based Speech Toolkit
  ☆11,077Updated 3 weeks ago
• google / sentencepiece
  Unsupervised text tokenizer for Neural Network-based text generation.
  ☆11,600Updated this week
• triton-lang / triton
  Development repository for the Triton language and compiler
  ☆18,237Updated this week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,822Updated last year
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,739Updated 2 weeks ago
• Lightning-AI / pytorch-lightning
  Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
  ☆30,737Updated last week
• karpathy / minGPT
  A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
  ☆23,341Updated last year
• facebookresearch / metaseq
  Repo for external large-scale work
  ☆6,542Updated last year
• facebookresearch / xformers
  Hackable and optimized Transformers building blocks, supporting a composable construction.
  ☆10,291Updated 2 weeks ago
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,384Updated last year
• triton-inference-server / server
  The Triton Inference Server provides an optimized cloud and edge inferencing solution.
  ☆10,270Updated this week
• NVIDIA / TensorRT-LLM
  TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…
  ☆12,705Updated this week
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆20,502Updated this week
• espnet / espnet
  End-to-End Speech Processing Toolkit
  ☆9,703Updated this week
• EleutherAI / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆11,246Updated last week
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆13,199Updated last year
• pyannote / pyannote-audio
  Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker…
  ☆9,035Updated 2 weeks ago
• google-research / t5x
  ☆2,938Updated last week
• huggingface / tokenizers
  💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
  ☆10,407Updated last week
• jax-ml / jax
  Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
  ☆34,660Updated this week
• EleutherAI / gpt-neox
  An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
  ☆7,371Updated last month
• gradio-app / gradio
  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
  ☆41,415Updated this week
• nebuly-ai / optimate
  A collection of libraries to optimise AI model performances
  ☆8,354Updated last year
• google-research / google-research
  Google Research
  ☆37,141Updated this week