Alternatives and similar repositories for cudaBERT:

Users that are interested in cudaBERT are comparing it to the libraries listed below

• tvmai / meetup-slides
  Place for meetup slides
  ☆140Updated 4 years ago
• Oneflow-Inc / OneFlow-Benchmark
  OneFlow models for benchmarking.
  ☆104Updated 8 months ago
• Oneflow-Inc / oneflow-documentation
  oneflow documentation
  ☆68Updated 9 months ago
• keithyin / read-pytorch-source-code
  pytorch源码阅读 0.2.0 版本
  ☆90Updated 5 years ago
• chncwang / InsNet
  InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
  ☆66Updated 3 years ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆285Updated 3 years ago
• dlsys-course / tinyflow
  Tutorial code on how to build your own Deep Learning System in 2k Lines
  ☆125Updated 8 years ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated last year
• simtony / tf_multigpu
  Multi-gpu/distributed training script in Tensorflow 1.x.
  ☆17Updated 5 years ago
• HadXu / Thunder
  A small deep-learning framework with C++/Python/CUDA
  ☆53Updated 6 years ago
• mrcat2018 / AutodiffEngine
  AutodiffEngine
  ☆13Updated 6 years ago
• triton-inference-server / hugectr_backend
  ☆52Updated last year
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆190Updated 6 years ago
• linnanwang / superneurons-release
  this is the release repository of superneurons
  ☆52Updated 4 years ago
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆97Updated 6 months ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆471Updated 3 years ago
• volcengine / veGiantModel
  ☆214Updated last year
• Tencent / WeChat-TFCC
  ☆127Updated 3 years ago
• yuxianzhi / Top-K
  A way to use cuda to accelerate top k algorithm
  ☆29Updated 7 years ago
• zhihu / cuBERT
  Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL
  ☆544Updated 4 years ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆35Updated last month
• OpenPPL / ppl.llm.serving
  ☆127Updated 3 months ago
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆110Updated last year
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆132Updated last year
• anilshanbhag / gpu-topk
  Efficient Top-K implementation on the GPU
  ☆175Updated 6 years ago
• dlsys-course / assignment2-2018
  (Spring 2018) Assignment 2: Graph Executor with TVM
  ☆124Updated 6 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• OpenPPL / ppl.nn.llm
  ☆139Updated 11 months ago
• aliyun / alibabacloud-aiacc-demo
  alibabacloud-aiacc-demo
  ☆43Updated last year