bytedance / lightseq
LightSeq: A High Performance Library for Sequence Processing and Generation
☆3,169Updated last year
Related projects: ⓘ
- a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.☆1,466Updated last year
- Transformer related optimization, including BERT, GPT☆5,773Updated 5 months ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,016Updated 7 months ago
- A fast MoE impl for PyTorch☆1,520Updated 2 months ago
- OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.☆5,864Updated last week
- ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab☆1,967Updated 6 months ago
- EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit☆2,029Updated 6 months ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆1,830Updated 2 weeks ago
- Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.☆3,070Updated 2 weeks ago
- Ongoing research training transformer models at scale☆9,949Updated this week
- PyTorch extensions for high performance and large scale training.☆3,149Updated 2 weeks ago
- Bagua Speeds up PyTorch☆872Updated last month
- A high performance and generic framework for distributed DNN training☆3,616Updated 11 months ago
- [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821☆3,366Updated 2 months ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,586Updated last year
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆7,687Updated this week
- PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.☆747Updated last year
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆2,321Updated 5 months ago
- An Open-Source Framework for Prompt-Learning.☆4,302Updated 2 months ago
- Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo☆2,973Updated 4 months ago
- Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimo…☆6,287Updated 2 weeks ago
- Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence L…☆2,396Updated 4 months ago
- Fast and memory-efficient exact attention☆13,401Updated this week
- EasyTransfer is designed to make the development of transfer learning in NLP applications easier.☆852Updated 2 years ago
- Google AI 2018 BERT pytorch implementation☆6,163Updated last year
- Foundation Architecture for (M)LLMs☆3,003Updated 5 months ago
- real Transformer TeraFLOPS on various GPUs☆859Updated 8 months ago
- Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"☆6,110Updated 2 months ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆1,811Updated this week
- ☆3,600Updated last year