Alternatives and similar repositories for BERTCpp:

Users that are interested in BERTCpp are comparing it to the libraries listed below

• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆39Updated 3 years ago
• dhpollack / huggingface_libtorch
  Minimal example of using a traced huggingface transformers model with libtorch
  ☆35Updated 4 years ago
• Peter-Chou / transformer_cpp_tokenizers
  transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)
  ☆17Updated 3 years ago
• ericperfect / libtorch_tokenizer
  BERT Tokenizer in C++
  ☆76Updated 4 years ago
• sunbelbd / mobius
  Möbius Transformation for Fast Inner Product Search on Graph
  ☆23Updated 3 years ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆47Updated last year
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• wangguojim / LargeScale
  ☆19Updated 11 months ago
• chncwang / InsNet
  InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
  ☆66Updated 3 years ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated last year
• dingyuqing05 / trt2022_wenet
  ☆71Updated 2 years ago
• qsyao / cudaBERT
  A Fast Muti-processing BERT-Inference System
  ☆101Updated 2 years ago
• zejunwang1 / easytokenizer
  高性能文本 Tokenizer 库
  ☆28Updated last year
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• LydiaXiaohongLi / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆19Updated last year
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆67Updated 4 years ago
• renatoviolin / BERT-cpp-inference
  ☆52Updated 3 years ago
• huismiling / wenet_trt8
  ☆75Updated 2 years ago
• OpenBMB / cpm_kernels
  ☆23Updated last year
• Oneflow-Inc / one-glm
  A more efficient GLM implementation!
  ☆55Updated 2 years ago
• luchangli03 / onnxsim_large_model
  simplify >2GB large onnx model
  ☆56Updated 5 months ago
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆66Updated 2 years ago
• jack-willturner / pytorch-onnx-tvm
  PyTorch -> ONNX -> TVM for autotuning
  ☆24Updated 5 years ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• DataXujing / Bert_TensorRT
  Bert TensorRT模型加速部署
  ☆9Updated 3 years ago
• JieRen98 / SGEMM-SASS-Annotation
  ☆21Updated 4 years ago
• leoluopy / autotvm_tutorial
  autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码，　最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of …
  ☆27Updated 4 years ago