Alternatives and similar repositories for tokenizers

Users that are interested in tokenizers are comparing it to the libraries listed below

• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆16Updated last year
• ModelTC / pyvlova
  Yet another Polyhedra Compiler for DeepLearning
  ☆19Updated 2 years ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 8 months ago
• Adlik / model_zoo
  ☆11Updated last year
• deepglint / eq-ncnn
  ☆42Updated 5 years ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 2 years ago
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• tpoisonooo / tengine-pipe
  Tengine 管子是用来快速生产 demo 的辅助工具
  ☆13Updated 3 years ago
• BBuf / oneflow-cifar
  ☆13Updated 2 years ago
• OAID / TengineInferPipe
  ☆24Updated 2 years ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆25Updated 3 years ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆43Updated 2 years ago
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆17Updated last week
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• onnx / neural-compressor
  Model compression for ONNX
  ☆96Updated 7 months ago
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• BBuf / tensorrt-llm-moe
  ☆29Updated 4 months ago
• lucasjinreal / wnnx_models
  Various test models in WNNX format. It can view with `pip install wnetron && wnetron`
  ☆12Updated 3 years ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆72Updated last week
• masahi / torchscript-to-tvm
  ☆69Updated 2 years ago
• yas-sim / openvino-ep-enabled-onnxruntime
  Describing How to Enable OpenVINO Execution Provider for ONNX Runtime
  ☆20Updated 4 years ago
• microsoft / Analysis-Framework-for-TVM
  Static analysis framework for analyzing programs written in TVM's Relay IR.
  ☆28Updated 5 years ago
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated last year
• triton-inference-server / developer_tools
  ☆18Updated 2 weeks ago
• mlbo / Insightface-NPU
  ☆24Updated 3 years ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• AXERA-TECH / CLIP-ONNX-AX650-CPP
  ☆27Updated last week
• megvii-research / Arch-Net
  Arch-Net: Model Distillation for Architecture Agnostic Model Deployment
  ☆22Updated 3 years ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆110Updated 9 months ago
• ChenShisen / ncnnqat
  quantize aware training package for NCNN on pytorch
  ☆70Updated 3 years ago