Alternatives and similar repositories for lightseq:

Users that are interested in lightseq are comparing it to the libraries listed below

• Tencent / TurboTransformers
  a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
  ☆1,521Updated last month
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,309Updated last week
• NVIDIA / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆6,147Updated last year
• laekov / fastmoe
  A fast MoE impl for PyTorch
  ☆1,713Updated 2 months ago
• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆12,261Updated this week
• Tencent / PatrickStar
  PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.
  ☆761Updated 2 years ago
• huawei-noah / Pretrained-Language-Model
  Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
  ☆3,086Updated last year
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆8,673Updated this week
• BaguaSys / bagua
  Bagua Speeds up PyTorch
  ☆882Updated 9 months ago
• Jittor / jittor
  Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.
  ☆3,149Updated 2 weeks ago
• alibaba / AliceMind
  ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab
  ☆2,044Updated last year
• pytorch / serve
  Serve, optimize and scale PyTorch models in production
  ☆4,317Updated last week
• ELS-RD / transformer-deploy
  Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
  ☆1,683Updated 6 months ago
• bytedance / byteps
  A high performance and generic framework for distributed DNN training
  ☆3,677Updated last year
• alibaba / EasyNLP
  EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
  ☆2,127Updated 5 months ago
• deepspeedai / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆2,064Updated last month
• kimiyoung / transformer-xl
  ☆3,645Updated 2 years ago
• NVIDIA / TransformerEngine
  A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…
  ☆2,393Updated this week
• google-research / text-to-text-transfer-transformer
  Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
  ☆6,343Updated last week
• microsoft / torchscale
  Foundation Architecture for (M)LLMs
  ☆3,073Updated last year
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,386Updated last year
• lucidrains / reformer-pytorch
  Reformer, the efficient Transformer, in Pytorch
  ☆2,164Updated last year
• PaddlePaddle / Research
  novel deep learning research works with PaddlePaddle
  ☆1,737Updated 8 months ago
• dbiir / UER-py
  Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo
  ☆3,063Updated 11 months ago
• allenai / longformer
  Longformer: The Long-Document Transformer
  ☆2,118Updated 2 years ago
• airaria / TextBrewer
  A PyTorch-based knowledge distillation toolkit for natural language processing
  ☆1,656Updated 2 years ago
• pytorch / TensorRT
  PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
  ☆2,742Updated this week
• alibaba / EasyTransfer
  EasyTransfer is designed to make the development of transfer learning in NLP applications easier.
  ☆861Updated 2 years ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆471Updated 3 years ago
• pytorch / xla
  Enabling PyTorch on XLA Devices (e.g. Google TPU)
  ☆2,596Updated this week