mli / transformers-benchmarksLinks
real Transformer TeraFLOPS on various GPUs
☆899Updated last year
Alternatives and similar repositories for transformers-benchmarks
Users that are interested in transformers-benchmarks are comparing it to the libraries listed below
Sorting:
- Several simple examples for popular neural network toolkits calling custom CUDA operators.☆1,475Updated 4 years ago
- LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training☆404Updated 2 weeks ago
- 更纯粹、更高压缩率的Tokenizer☆481Updated 6 months ago
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆153Updated 7 months ago
- Efficient Training (including pre-training and fine-tuning) for Big Models☆592Updated this week
- How to use wandb?☆648Updated last year
- pytorch distribute tutorials☆135Updated last week
- Rotary Transformer☆959Updated 3 years ago
- Cool Papers - Immersive Paper Discovery☆543Updated 2 weeks ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆2,078Updated 2 months ago
- Efficient Inference for Big Models☆584Updated 2 years ago
- ☆607Updated 11 months ago
- Best practice for training LLaMA models in Megatron-LM☆654Updated last year
- PyTorch Project Specification.☆679Updated 3 years ago
- huggingface mirror download☆580Updated last month
- 整理 pytorch 单机多 GPU 训练方法与原理☆831Updated 3 years ago
- Collaborative Training of Large Language Models in an Efficient Way☆415Updated 9 months ago
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,106Updated this week
- ☆257Updated 2 months ago
- Train a 1B LLM with 1T tokens from scratch by personal☆663Updated last month
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)☆1,028Updated 8 months ago
- Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch☆369Updated this week
- Tutel MoE: Optimized Mixture-of-Experts Library, Support DeepSeek FP8/FP4☆824Updated this week
- SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.☆1,079Updated 5 months ago
- LLMs interview notes and answers:该仓库主要记录大模型(LLMs)算法工程师相关的面试题和参考答案☆1,243Updated last year
- A quickstart and benchmark for pytorch distributed training.☆1,666Updated 10 months ago
- Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.☆1,000Updated last year
- A fast MoE impl for PyTorch☆1,729Updated 3 months ago
- An easy/swift-to-adapt PyTorch-Lighting template. 套壳模板,简单易用,稍改原来Pytorch代码,即可适配Lightning。You can translate your previous Pytorch code much…☆1,461Updated last year
- RoFormer V1 & V2 pytorch☆498Updated 3 years ago