Alternatives and similar repositories for tokenizers

Users that are interested in tokenizers are comparing it to the libraries listed below

• Adlik / model_zoo
  ☆11Updated last week
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 9 months ago
• tpoisonooo / tengine-pipe
  Tengine 管子是用来快速生产 demo 的辅助工具
  ☆13Updated 4 years ago
• OAID / TengineInferPipe
  ☆24Updated 2 years ago
• AXERA-TECH / CLIP-ONNX-AX650-CPP
  ☆27Updated last month
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 2 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• deepglint / eq-ncnn
  ☆42Updated 5 years ago
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆70Updated 2 years ago
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated 6 months ago
• EdVince / llm-cpp
  ☆32Updated last year
• daquexian / web-model-converter
  ☆41Updated 2 years ago
• ChenShisen / ncnnqat
  quantize aware training package for NCNN on pytorch
  ☆69Updated 4 years ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆16Updated last year
• mlbo / Insightface-NPU
  ☆24Updated 3 years ago
• DayBreak-u / thundernet_ncnn
  the C++ version of thundernet with ncnn
  ☆14Updated 4 years ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆43Updated 2 years ago
• ModelTC / pyvlova
  Yet another Polyhedra Compiler for DeepLearning
  ☆19Updated 2 years ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆97Updated 8 months ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆25Updated 3 years ago
• Oneflow-Inc / oneflow-lite
  ☆18Updated last year
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆94Updated 9 months ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆77Updated this week
• BBuf / oneflow-cifar
  ☆13Updated 2 years ago
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆66Updated 5 years ago
• daquexian / faster-rwkv
  ☆124Updated last year
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆157Updated last year
• tunmx / mnn-scrfd
  SCRFD face detection based on MNN inference framework
  ☆17Updated 3 years ago
• caijixueIT / CUDA_Learning_for_Freshman
  ☆11Updated 5 months ago