zhihu / cuBERT
Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL
☆528Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for cuBERT
- Running BERT without Padding☆460Updated 2 years ago
- a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.☆1,484Updated last year
- Feel free to fine tune large BERT models with Multi-GPU and FP16 support.☆192Updated 4 years ago
- C++ model train&inference framework☆223Updated 4 years ago
- TensorFlow code and pre-trained models for BERT☆114Updated 4 years ago
- The score code of FastBERT (ACL2020)☆604Updated 3 years ago
- multi-gpu pre-training in one machine for BERT from scratch without horovod (Data Parallelism)☆173Updated last month
- A Fast Muti-processing BERT-Inference System☆100Updated 2 years ago
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆312Updated last year
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆120Updated 4 years ago
- ☆165Updated 2 years ago
- ParaGen is a PyTorch deep learning framework for parallel sequence generation.☆186Updated 2 years ago
- DeepLearning Framework Performance Profiling Toolkit☆277Updated 2 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆309Updated 4 years ago
- EasyTransfer is designed to make the development of transfer learning in NLP applications easier.☆855Updated 2 years ago
- ☆209Updated last year
- A Lite Bert For Self-Supervised Learning Language Representations☆710Updated 4 years ago
- Papers I have read, mainly about NLP. Welcome everyone to supplement in issue.☆256Updated 3 years ago
- Easy and Efficient Transformer : Scalable Inference Solution For Large NLP model☆261Updated 3 months ago
- BERT for Multitask Learning☆546Updated last year
- An open-source neural machine translation toolkit developed by Tsinghua Natural Language Processing Group☆705Updated 2 years ago
- ☆444Updated 2 years ago
- OneFlow models for benchmarking.☆104Updated 3 months ago
- A library for high performance deep learning inference on NVIDIA GPUs.☆547Updated 2 years ago
- A Span-Extraction Dataset for Chinese Machine Reading Comprehension (CMRC 2018)☆417Updated 2 years ago
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆191Updated 2 years ago
- export bert model for serving☆142Updated 5 years ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,601Updated last year
- 通用深度学习推理工具,可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。☆407Updated 2 years ago
- BERT 源码阅读☆232Updated 5 years ago