meta-pytorch / tokenizersLinks
C++ implementations for various tokenizers (sentencepiece, tiktoken etc).
☆48Updated this week
Alternatives and similar repositories for tokenizers
Users that are interested in tokenizers are comparing it to the libraries listed below
Sorting:
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Updated 2 years ago
- Large Language Model Onnx Inference Framework☆36Updated 2 months ago
- Model compression for ONNX☆98Updated last year
- ☆11Updated last month
- ☆24Updated 3 years ago
- Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…☆37Updated 3 years ago
- MegEngine到其他框架的转换器☆70Updated 2 years ago
- ☆28Updated 7 months ago
- ☆68Updated 2 years ago
- ☆34Updated last year
- llm deploy project based onnx.☆49Updated last year
- Standalone Flash Attention v2 kernel without libtorch dependency☆114Updated last year
- ☆125Updated 2 years ago
- ☆14Updated 3 months ago
- This is a demo how to write a high performance convolution run on apple silicon☆57Updated 4 years ago
- edge/mobile transformer based Vision DNN inference benchmark☆16Updated 5 months ago
- Wanwu models release, code will be released soon☆24Updated 3 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Updated 2 years ago
- Common libraries for PPL projects☆31Updated 10 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆90Updated this week
- A Toolkit to Help Optimize Large Onnx Model☆163Updated 3 months ago
- ☆18Updated 2 years ago
- Yet another Polyhedra Compiler for DeepLearning☆19Updated 2 years ago
- OneFlow->ONNX☆43Updated 2 years ago
- Count number of parameters / MACs / FLOPS for ONNX models.☆95Updated last year
- Sandbox for TVM and playing around!☆22Updated 3 years ago
- Inference of quantization aware trained networks using TensorRT☆83Updated 3 years ago
- SGEMM optimization with cuda step by step☆21Updated last year
- ☆18Updated 2 years ago
- CUDA 6大并行计算模式 代码与笔记☆61Updated 5 years ago