Alternatives and similar repositories for cudaBERT:

Users that are interested in cudaBERT are comparing it to the libraries listed below

• Oneflow-Inc / OneFlow-Benchmark
  OneFlow models for benchmarking.
  ☆105Updated 7 months ago
• chncwang / InsNet
  InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
  ☆66Updated 3 years ago
• keithyin / read-pytorch-source-code
  pytorch源码阅读 0.2.0 版本
  ☆90Updated 5 years ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• tvmai / meetup-slides
  Place for meetup slides
  ☆140Updated 4 years ago
• Oneflow-Inc / oneflow-documentation
  oneflow documentation
  ☆68Updated 8 months ago
• HadXu / Thunder
  A small deep-learning framework with C++/Python/CUDA
  ☆53Updated 6 years ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆285Updated 2 years ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆472Updated 3 years ago
• zhihu / cuBERT
  Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL
  ☆543Updated 4 years ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated last year
• volcengine / veGiantModel
  ☆214Updated last year
• Tencent / WeChat-TFCC
  ☆125Updated 3 years ago
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆108Updated last year
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆190Updated 6 years ago
• zakheav / automatic-differentiation-framework
  an automatic differentiation framework with dynamic graph/支持动态图的自动求导框架
  ☆101Updated 5 years ago
• yuxianzhi / Top-K
  A way to use cuda to accelerate top k algorithm
  ☆29Updated 7 years ago
• triton-inference-server / hugectr_backend
  ☆51Updated last year
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆267Updated last year
• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆157Updated 11 months ago
• OpenPPL / ppl.nn.llm
  ☆139Updated 11 months ago
• dlsys-course / tinyflow
  Tutorial code on how to build your own Deep Learning System in 2k Lines
  ☆125Updated 7 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆133Updated last year
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆92Updated last year
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆35Updated 3 weeks ago
• HPDL-Group / Merak
  ☆79Updated 3 months ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• OpenPPL / ppl.llm.serving
  ☆127Updated 2 months ago
• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆44Updated last month
• abditag2 / bert
  TensorFlow code and pre-trained models for BERT
  ☆24Updated 5 years ago