Alternatives and similar repositories for faster-bert-as-service

Users that are interested in faster-bert-as-service are comparing it to the libraries listed below

• dhpollack / huggingface_libtorch
  Minimal example of using a traced huggingface transformers model with libtorch
  ☆36Updated 5 years ago
• pogevip / BERT4TensorRT
  TensorRT
  ☆11Updated 5 years ago
• howl-anderson / rasa_chinese_service
  rasa_chinese 的服务 package
  ☆18Updated 4 years ago
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 5 years ago
• renatoviolin / BERT-cpp-inference
  ☆52Updated 4 years ago
• DataXujing / Bert_TensorRT
  Bert TensorRT模型加速部署
  ☆10Updated 3 years ago
• KuaiSearchPERKS / PERKS
  KuaiSearch PERKS
  ☆12Updated 3 years ago
• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆40Updated 4 years ago
• ericperfect / libtorch_tokenizer
  BERT Tokenizer in C++
  ☆78Updated 4 years ago
• renjunxiang / oqmrc_2018
  AI Challenger 2018 阅读理解赛道代码分享
  ☆21Updated 6 years ago
• Vincent131499 / NerAdapter
  针对NER领域提供从线下训练到线上部署的一整套闭环流程
  ☆14Updated 4 years ago
• liuhuanyong / Seq2seqAttGeneration
  Seq2seqAttGeneration, an basic implementation of text generation that using seq2seq attention model to generate poem series. this project…
  ☆18Updated 4 years ago
• Vincent131499 / Language_Understanding_based_BERT
  基于BERT的预训练语言模型实现，分为两步：预训练和微调。目前已包括BERT、Roberta、ALbert三个模型，且皆可支持Whole Word Mask模式。
  ☆17Updated 5 years ago
• Fisher87 / pyfaiss_api
  Facebook faiss相关的python接口
  ☆15Updated 5 years ago
• BAAI-WuDao / GLM
  GLM (General Language Model)
  ☆24Updated 3 years ago
• BAAI-WuDao / P-tuning
  Finetune CPM-1
  ☆24Updated 4 years ago
• seanzhang-zhichen / baichuan-Dynamic-NTK-ALiBi
  百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本
  ☆49Updated 2 years ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆50Updated last year
• chiehpower / Setup-deeplearning-tools
  Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NV…
  ☆43Updated 2 years ago
• renjunxiang / daguan_2019
  2019达观杯实体识别
  ☆19Updated 6 years ago
• MachineLP / QDServing
  ml模型分布式服务部署：grpc，flask；docker
  ☆76Updated 4 years ago
• livingmagic / nmt-with-bert-tf2
  NMT model with BERT in tensorflow 2.0
  ☆20Updated 6 years ago
• JunnYu / ChineseBert_pytorch
  huggingface ChineseBert Tokenizer
  ☆16Updated 3 years ago
• yann168 / boshi-sample-solution
  ☆15Updated last year
• lonePatient / MobileBert_PyTorch
  MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
  ☆69Updated 5 years ago
• lonePatient / ERNIE-text-classification-pytorch
  This repo contains a PyTorch implementation of a pretrained ERNIE model for text classification.
  ☆59Updated 2 years ago
• Peter-Chou / libtorch_grpc_serving
  pytorch during training, libtorch during serving via gRPC
  ☆21Updated 6 years ago
• triton-inference-server / paddlepaddle_backend
  ☆36Updated last year
• JovenChu / FasterTransformer_Bert
  Using FasterTransformer for accelerating the predict speed of bert and roberta
  ☆14Updated 6 years ago
• yanwii / machine-translation
  在tensor2tensor中使用自己的语料实现中英文翻译
  ☆23Updated 6 years ago