Alternatives and similar repositories for huggingface_libtorch

Users that are interested in huggingface_libtorch are comparing it to the libraries listed below

• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 5 years ago
• Peter-Chou / libtorch_grpc_serving
  pytorch during training, libtorch during serving via gRPC
  ☆21Updated 6 years ago
• ericperfect / libtorch_tokenizer
  BERT Tokenizer in C++
  ☆78Updated 4 years ago
• Peter-Chou / transformer_cpp_tokenizers
  transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)
  ☆17Updated 3 years ago
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆68Updated 2 years ago
• xiangyangkan / faster-bert-as-service
  Using TensorRT and Triton Server to build BERT model as a service
  ☆13Updated 3 years ago
• renatoviolin / BERT-cpp-inference
  ☆52Updated 4 years ago
• sunbelbd / mobius
  Möbius Transformation for Fast Inner Product Search on Graph
  ☆22Updated 4 years ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆16Updated 2 years ago
• notAI-tech / fastDeploy
  Deploy DL/ ML inference pipelines with minimal extra code.
  ☆99Updated 10 months ago
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆47Updated last year
• LieluoboAi / radish
  C++ model train&inference framework
  ☆223Updated 5 years ago
• wangguojim / LargeScale
  ☆19Updated last year
• Sorrow321 / huggingface_tokenizer_cpp
  HuggingFace Transformers WordPiece Tokenizer in C++
  ☆17Updated 6 months ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 3 years ago
• zejunwang1 / fastMatch
  Large-scale exact string matching tool
  ☆17Updated 6 months ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆50Updated last year
• TurboNLP / Translate-Demo
  A Translation Task using TurboTransformers
  ☆11Updated 4 years ago
• daquexian / faster-rwkv
  ☆125Updated last year
• venkatacrc / PyTorchCppFrontEnd
  PyTorch 1.5 C++ frontend API
  ☆20Updated 5 years ago
• THUDM / Multilingual-GLM
  The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective
  ☆62Updated 2 years ago
• CLUEbenchmark / MobileQA
  离线端阅读理解应用 QA for mobile, Android & iPhone
  ☆60Updated 2 years ago
• lonePatient / MobileBert_PyTorch
  MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
  ☆69Updated 5 years ago
• huismiling / wenet_trt8
  ☆76Updated 3 years ago
• yingyuankai / AiSpace
  AiSpace: Better practices for deep learning model development and deployment For Tensorflow 2.0
  ☆27Updated 2 years ago
• Tlntin / ChatGLM2-6B-TensorRT
  ☆90Updated 2 years ago
• BAAI-WuDao / P-tuning
  Finetune CPM-1
  ☆24Updated 4 years ago
• DayBreak-u / seq2seq_ncnn
  the C++ version of Seq2Seq with ncnn
  ☆23Updated 4 years ago
• ymcui / Chinese-MobileBERT
  Chinese MobileBERT（中文MobileBERT模型）
  ☆95Updated 3 years ago
• zejunwang1 / darmatch
  一个非常高效的字符串匹配工具，支持正向/反向最大匹配分词和多模式字符串精确匹配
  ☆17Updated 2 years ago