Alternatives and similar repositories for tokenizers:

Users that are interested in tokenizers are comparing it to the libraries listed below

• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 2 years ago
• AXERA-TECH / CLIP-ONNX-AX650-CPP
  ☆25Updated 4 months ago
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• wangzhaode / mnn-asr
  mnn asr demo.
  ☆16Updated last month
• Adlik / model_zoo
  ☆11Updated last year
• daquexian / web-model-converter
  ☆40Updated 2 years ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 6 months ago
• OAID / TengineInferPipe
  ☆24Updated 2 years ago
• ModelTC / pyvlova
  Yet another Polyhedra Compiler for DeepLearning
  ☆19Updated 2 years ago
• BBuf / oneflow-cifar
  ☆13Updated 2 years ago
• mlbo / Insightface-NPU
  ☆24Updated 3 years ago
• DayBreak-u / seq2seq_ncnn
  the C++ version of Seq2Seq with ncnn
  ☆23Updated 3 years ago
• tpoisonooo / tengine-pipe
  Tengine 管子是用来快速生产 demo 的辅助工具
  ☆13Updated 3 years ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆36Updated 7 months ago
• lucasjinreal / wnnx_models
  Various test models in WNNX format. It can view with `pip install wnetron && wnetron`
  ☆12Updated 2 years ago
• deepglint / eq-ncnn
  ☆42Updated 4 years ago
• erickingxu / pyBridge
  This a bridge for converting torch,and other AI training framework to C++ speed up infer library,like NCNN and ect
  ☆20Updated 6 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• futz12 / uie_ncnn_windows
  UIE(Universal Information Extraction) infer by ncnn
  ☆12Updated 7 months ago
• caijixueIT / CUDA_Learning_for_Freshman
  ☆11Updated 2 months ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆25Updated 3 years ago
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆31Updated last week
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆16Updated 3 weeks ago
• PINTO0309 / sne4onnx
  A very simple tool for situations where optimization with onnx-simplifier would exceed the Protocol Buffers upper file size limit of 2GB,…
  ☆16Updated last year
• tunmx / mnn-scrfd
  SCRFD face detection based on MNN inference framework
  ☆17Updated 3 years ago
• triton-inference-server / developer_tools
  ☆18Updated 3 weeks ago
• Oneflow-Inc / OneFlow-Pruning
  [CVPR-2023] Towards Any Structural Pruning
  ☆16Updated 2 years ago
• ChenShisen / ncnnqat
  quantize aware training package for NCNN on pytorch
  ☆70Updated 3 years ago