bytedance / lightseqLinks
LightSeq: A High Performance Library for Sequence Processing and Generation
☆3,296Updated 2 years ago
Alternatives and similar repositories for lightseq
Users that are interested in lightseq are comparing it to the libraries listed below
Sorting:
- a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.☆1,532Updated 3 months ago
- Transformer related optimization, including BERT, GPT☆6,326Updated last year
- PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.☆766Updated 2 years ago
- A fast MoE impl for PyTorch☆1,806Updated 8 months ago
- A high performance and generic framework for distributed DNN training☆3,707Updated 2 years ago
- Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.☆3,140Updated last year
- A primitive library for neural network☆1,363Updated 10 months ago
- PyTorch extensions for high performance and large scale training.☆3,380Updated 5 months ago
- Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.☆3,214Updated 2 months ago
- Bagua Speeds up PyTorch☆883Updated last year
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆2,169Updated 2 months ago
- OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.☆9,363Updated 2 months ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆1,422Updated last year
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,680Updated 2 years ago
- EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit☆2,171Updated 10 months ago
- Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀☆1,689Updated 11 months ago
- ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab☆2,043Updated last year
- EasyTransfer is designed to make the development of transfer learning in NLP applications easier.☆859Updated 3 years ago
- Several simple examples for popular neural network toolkits calling custom CUDA operators.☆1,513Updated 4 years ago
- real Transformer TeraFLOPS on various GPUs☆917Updated last year
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆899Updated 9 months ago
- LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training☆407Updated 2 months ago
- Serve, optimize and scale PyTorch models in production☆4,347Updated 2 months ago
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆952Updated 6 months ago
- A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch☆8,824Updated 2 weeks ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…☆2,799Updated last week
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆9,211Updated last week
- 飞桨大模型开发套件,提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。☆474Updated last year
- Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL☆546Updated 4 years ago
- Running BERT without Padding☆475Updated 3 years ago