Alternatives and similar repositories for tokenizers

Users that are interested in tokenizers are comparing it to the libraries listed below

• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated last month
• onnx / neural-compressor
  Model compression for ONNX
  ☆99Updated last year
• OAID / TengineInferPipe
  ☆24Updated 3 years ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆48Updated last year
• jimmy-evo / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆24Updated 2 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆43Updated 2 years ago
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆70Updated 2 years ago
• Adlik / model_zoo
  ☆11Updated 2 weeks ago
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆36Updated 3 years ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆162Updated 2 months ago
• daquexian / faster-rwkv
  ☆125Updated 2 years ago
• AXERA-TECH / CLIP-ONNX-AX650-CPP
  ☆27Updated 6 months ago
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆95Updated last year
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 3 years ago
• deepglint / eq-ncnn
  ☆42Updated 5 years ago
• tpoisonooo / tengine-pipe
  Tengine 管子是用来快速生产 demo 的辅助工具
  ☆13Updated 4 years ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated last year
• BBuf / tensorrt-llm-moe
  ☆33Updated 11 months ago
• atanmarko / ncnn-with-cuda
  Tencent NCNN with added CUDA support
  ☆71Updated 4 years ago
• triple-mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆41Updated 3 years ago
• Libraries-Openly-Fused / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆54Updated last month
• OpenPPL / ppl.common
  Common libraries for PPL projects
  ☆30Updated 10 months ago
• daquexian / web-model-converter
  ☆43Updated 3 years ago
• EdVince / llm-cpp
  ☆33Updated last year
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆17Updated 2 years ago
• ModelTC / pyvlova
  Yet another Polyhedra Compiler for DeepLearning
  ☆19Updated 2 years ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆113Updated last year
• mlbo / Insightface-NPU
  ☆25Updated 4 years ago
• DeepLink-org / CVFusion
  CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.
  ☆33Updated 3 years ago
• Oneflow-Inc / OneFlow-Pruning
  [CVPR-2023] Towards Any Structural Pruning
  ☆17Updated 2 years ago