Tencent / PatrickStar
PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.
☆757Updated last year
Alternatives and similar repositories for PatrickStar:
Users that are interested in PatrickStar are comparing it to the libraries listed below
- LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training☆397Updated 2 months ago
- Large-scale model inference.☆628Updated last year
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆850Updated 2 months ago
- a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.☆1,514Updated last year
- LightSeq: A High Performance Library for Sequence Processing and Generation☆3,259Updated last year
- Running BERT without Padding☆472Updated 3 years ago
- ☆214Updated last year
- Bagua Speeds up PyTorch☆879Updated 7 months ago
- Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackab…☆1,559Updated last year
- Tutel MoE: An Optimized Mixture-of-Experts Implementation☆784Updated this week
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆471Updated last year
- Library for 8-bit optimizers and quantization routines.☆718Updated 2 years ago
- Examples of training models with hybrid parallelism using ColossalAI☆338Updated last year
- DeepLearning Framework Performance Profiling Toolkit☆285Updated 2 years ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆979Updated 6 months ago
- Models and examples built with OneFlow☆96Updated 5 months ago
- ☆411Updated last year
- Microsoft Automatic Mixed Precision Library☆579Updated 5 months ago
- High performance distributed framework for training deep learning recommendation models based on PyTorch.☆402Updated this week
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,035Updated 11 months ago
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆267Updated last year
- Efficient Inference for Big Models☆580Updated 2 years ago
- A primitive library for neural network☆1,324Updated 3 months ago
- Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL☆543Updated 4 years ago
- Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀☆1,680Updated 4 months ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆201Updated 2 years ago
- Scalable PaLM implementation of PyTorch☆191Updated 2 years ago
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆780Updated this week
- An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…☆432Updated 2 years ago
- ☆604Updated 9 months ago