NVIDIA / NeMo

Related projects ⓘ

Alternatives and complementary repositories for NeMo

• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆10,595Updated this week
• facebookresearch / fairseq
  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
  ☆30,552Updated last month
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆7,958Updated this week
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆14,279Updated this week
• EleutherAI / gpt-neox
  An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
  ☆6,947Updated this week
• microsoft / unilm
  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  ☆20,194Updated last week
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆16,471Updated this week
• facebookresearch / xformers
  Hackable and optimized Transformers building blocks, supporting a composable construction.
  ☆8,660Updated this week
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆6,299Updated this week
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆5,890Updated 7 months ago
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆10,086Updated this week
• FMInference / FlexLLMGen
  Running large language models on a single GPU for throughput-oriented scenarios.
  ☆9,198Updated 3 weeks ago
• espnet / espnet
  End-to-End Speech Processing Toolkit
  ☆8,510Updated this week
• NVIDIA / DeepLearningExamples
  State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enter…
  ☆13,580Updated 3 months ago
• triton-lang / triton
  Development repository for the Triton language and compiler
  ☆13,443Updated this week
• ggerganov / ggml
  Tensor library for machine learning
  ☆11,233Updated this week
• huggingface / tokenizers
  💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
  ☆9,052Updated this week
• openai / tiktoken
  tiktoken is a fast BPE tokeniser for use with OpenAI's models.
  ☆12,427Updated last month
• gradio-app / gradio
  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
  ☆34,030Updated this week
• google / sentencepiece
  Unsupervised text tokenizer for Neural Network-based text generation.
  ☆10,295Updated 2 weeks ago
• EleutherAI / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆6,990Updated this week
• huggingface / diffusers
  🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
  ☆26,242Updated this week
• microsoft / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆35,508Updated this week
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆10,776Updated 3 months ago
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆30,423Updated this week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,059Updated 5 months ago
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,195Updated last week
• OpenNMT / CTranslate2
  Fast inference engine for Transformer models
  ☆3,411Updated this week
• NVIDIA / TensorRT-LLM
  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain…
  ☆8,681Updated last week
• triton-inference-server / server
  The Triton Inference Server provides an optimized cloud and edge inferencing solution.
  ☆8,348Updated this week