Alternatives and similar repositories for BERTCpp:

Users that are interested in BERTCpp are comparing it to the libraries listed below

• ericperfect / libtorch_tokenizer
  BERT Tokenizer in C++
  ☆75Updated 4 years ago
• dhpollack / huggingface_libtorch
  Minimal example of using a traced huggingface transformers model with libtorch
  ☆35Updated 4 years ago
• sunbelbd / mobius
  Möbius Transformation for Fast Inner Product Search on Graph
  ☆23Updated 3 years ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• wangguojim / LargeScale
  ☆19Updated 10 months ago
• chncwang / InsNet
  InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.
  ☆66Updated 3 years ago
• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆39Updated 3 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated last year
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆46Updated last year
• ProjectD-AI / LLaMA-Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆69Updated last year
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆35Updated 3 weeks ago
• zejunwang1 / easytokenizer
  高性能文本 Tokenizer 库
  ☆28Updated last year
• Oneflow-Inc / oneflow-xrt
  ☆23Updated last year
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆42Updated last year
• qsyao / cudaBERT
  A Fast Muti-processing BERT-Inference System
  ☆101Updated 2 years ago
• jack-willturner / pytorch-onnx-tvm
  PyTorch -> ONNX -> TVM for autotuning
  ☆23Updated 5 years ago
• THUDM / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆39Updated 2 years ago
• renatoviolin / BERT-cpp-inference
  ☆52Updated 3 years ago
• daquexian / faster-rwkv
  ☆124Updated last year
• Adlik / smoothquantplus
  [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
  ☆22Updated last year
• OpenPPL / ppl.llm.serving
  ☆127Updated 2 months ago
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆85Updated 6 years ago
• Adlik / model_zoo
  ☆11Updated last year
• drcut / NN_transform
  Trans different platform's network to International Representation(IR)
  ☆44Updated 6 years ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆31Updated 5 months ago
• OpenPPL / ppl.nn.llm
  ☆139Updated 10 months ago
• dingyuqing05 / trt2022_wenet
  ☆71Updated 2 years ago
• OpenBMB / cpm_kernels
  ☆23Updated last year