A Fast Muti-processing BERT-Inference System
☆102Oct 20, 2022Updated 3 years ago
Alternatives and similar repositories for cudaBERT
Users that are interested in cudaBERT are comparing it to the libraries listed below
Sorting:
- Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL☆548Nov 18, 2020Updated 5 years ago
- Fast CUDA Kernels for ResNet Inference.☆182May 26, 2019Updated 6 years ago
- Keras implement of Lazy optimizer☆20Nov 24, 2019Updated 6 years ago
- implementation of factorization machine, support classification.☆20Jun 7, 2018Updated 7 years ago
- ☆61Nov 14, 2019Updated 6 years ago
- My solutions to the assignments of dlsys course (CSE599G1: Deep Learning System Spring 2017)☆10Jul 1, 2017Updated 8 years ago
- ☆13Jun 20, 2019Updated 6 years ago
- A Translation Task using TurboTransformers☆10Dec 17, 2020Updated 5 years ago
- AutodiffEngine☆13Apr 1, 2019Updated 6 years ago
- Analyze network performance in distributed training☆20Oct 20, 2020Updated 5 years ago
- a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.☆1,542Jul 18, 2025Updated 8 months ago
- Easy Data Augmentation for NLP on Chinese☆16Aug 3, 2019Updated 6 years ago
- Conversational Word Embedding for Retrieval-based Dialog System (ACL2020)☆30Sep 2, 2020Updated 5 years ago
- High-performance LLM operator library built on TileLang.☆93Updated this week
- Open Language Pre-trained Model Zoo☆1,005Nov 18, 2021Updated 4 years ago
- Sequence-to-Sequence Generative Model for Sequential Recommender System☆18Mar 25, 2024Updated last year
- Unassisted clustering algorithms and data structures in Rust☆13Dec 9, 2019Updated 6 years ago
- 离线端阅读理解应用 QA for mobile, Android & iPhone☆60Oct 6, 2022Updated 3 years ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆1,003Sep 19, 2024Updated last year
- Why Low-Precision Transformer Training Fails: An Analysis on Flash Attention☆51Oct 16, 2025Updated 5 months ago
- Kaldi extended by Kaituo XU with new features in nnet1.☆12Dec 16, 2018Updated 7 years ago
- Use https://github.com/huggingface/transformers to do Chinese NER☆11Dec 29, 2021Updated 4 years ago
- TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.☆19May 12, 2024Updated last year
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- ESIM for Multi-turn Response Selection Task☆584Sep 9, 2019Updated 6 years ago
- this is roberta wwm base distilled model which was distilled from roberta wwm by roberta wwm large☆66Mar 30, 2020Updated 5 years ago
- 夸夸机器人☆20Dec 23, 2021Updated 4 years ago
- Distributed Ledger for the people ✊☆13Nov 24, 2019Updated 6 years ago
- Sample Codes using NVSHMEM on Multi-GPU☆30Jan 22, 2023Updated 3 years ago
- Oral presentation at KDD Cup Workshop @ KDD 2022☆21Aug 23, 2022Updated 3 years ago
- Inference with state-of-the-art models (pre-trained by LD-Net / AutoNER / VanillaNER / ...)☆118Dec 15, 2018Updated 7 years ago
- ☆29Feb 11, 2021Updated 5 years ago
- ☆18Oct 15, 2020Updated 5 years ago
- The score code of FastBERT (ACL2020)☆609Oct 29, 2021Updated 4 years ago
- Accelerating CNN's convolution operation on GPUs by using memory-efficient data access patterns.☆14Dec 8, 2017Updated 8 years ago
- GVProf: A Value Profiler for GPU-based Clusters☆53Mar 24, 2024Updated last year
- Running BERT without Padding☆480Mar 18, 2022Updated 4 years ago
- ☆84Dec 2, 2022Updated 3 years ago
- RAdam optimizer for keras☆71Oct 14, 2019Updated 6 years ago