Alternatives and similar repositories for BERTCpp

Users that are interested in BERTCpp are comparing it to the libraries listed below

• ericperfect / libtorch_tokenizer
  BERT Tokenizer in C++
  ☆79Updated 4 years ago
• dhpollack / huggingface_libtorch
  Minimal example of using a traced huggingface transformers model with libtorch
  ☆35Updated 5 years ago
• sunbelbd / mobius
  Möbius Transformation for Fast Inner Product Search on Graph
  ☆22Updated 4 years ago
• Peter-Chou / transformer_cpp_tokenizers
  transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)
  ☆18Updated 3 years ago
• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆39Updated 4 years ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆51Updated 2 years ago
• DataXujing / Bert_TensorRT
  Bert TensorRT模型加速部署
  ☆10Updated 3 years ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• LieluoboAi / radish
  C++ model train&inference framework
  ☆222Updated 5 years ago
• Peter-Chou / libtorch_grpc_serving
  pytorch during training, libtorch during serving via gRPC
  ☆21Updated 6 years ago
• lonePatient / MobileBert_PyTorch
  MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
  ☆71Updated 5 years ago
• chncwang / InsNet
  InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
  ☆67Updated 4 years ago
• Tlntin / ChatGLM2-6B-TensorRT
  ☆90Updated 2 years ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated 2 years ago
• renatoviolin / BERT-cpp-inference
  ☆52Updated 4 years ago
• ymcui / Chinese-MobileBERT
  Chinese MobileBERT（中文MobileBERT模型）
  ☆97Updated 3 years ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆16Updated 2 years ago
• CLUEbenchmark / MobileQA
  离线端阅读理解应用 QA for mobile, Android & iPhone
  ☆60Updated 3 years ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 3 years ago
• miemie2013 / Pure_Python_Deep_Learning
  纯Python实现的深度学习框架，帮助你理解底层细节斩获offer
  ☆21Updated 3 years ago
• qsyao / cudaBERT
  A Fast Muti-processing BERT-Inference System
  ☆101Updated 3 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆43Updated 2 years ago
• dingyuqing05 / trt2022_wenet
  ☆71Updated 3 years ago
• seanzhang-zhichen / baichuan-Dynamic-NTK-ALiBi
  百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本
  ☆49Updated 2 years ago
• xiangyangkan / faster-bert-as-service
  Using TensorRT and Triton Server to build BERT model as a service
  ☆13Updated 3 years ago
• wangguojim / LargeScale
  ☆19Updated last year
• zejunwang1 / darmatch
  一个非常高效的字符串匹配工具，支持正向/反向最大匹配分词和多模式字符串精确匹配
  ☆16Updated 2 years ago
• Oneflow-Inc / one-glm
  A more efficient GLM implementation!
  ☆54Updated 2 years ago
• netease-youdao / EMLL
  Edge Machine Learning Library
  ☆197Updated 3 years ago
• drcut / NN_transform
  Trans different platform's network to International Representation(IR)
  ☆44Updated 7 years ago