Alternatives and similar repositories for tvm-cn:

Users that are interested in tvm-cn are comparing it to the libraries listed below

• zhihu / ZhiLight
  A highly optimized LLM inference acceleration engine for Llama and its variants.
  ☆873Updated this week
• bytedance / ABQ-LLM
  An acceleration library that supports arbitrary bit-width combinatorial quantization operations
  ☆216Updated 5 months ago
• OAID / AutoKernel
  AutoKernel 是一个简单易用，低门槛的自动算子优化工具，提高深度学习算法部署效率。
  ☆736Updated 2 years ago
• Zefan-Cai / KVCache-Factory
  Unified KV Cache Compression Methods for Auto-Regressive Models
  ☆932Updated 2 months ago
• GreenBitAI / bitorch-engine
  A toolkit enhances PyTorch with specialized functions for low-bit quantized neural networks.
  ☆197Updated 8 months ago
• OpenCSGs / csghub-server
  csghub-server is the backend server for CSGHub which helps user to manage datasets, modes, and also run Model Inference, Finetune and App…
  ☆592Updated this week
• Langboat / Mengzi3
  ☆1,381Updated 5 months ago
• data-infra / cube-studio
  cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，标注平台，自动化标注，大模型微调，vllm大模型推…
  ☆1,602Updated last week
• AlgRUC / JittorGeometric
  JittorGeometric is a Jittor-based graph machine learning library.
  ☆150Updated last month
• NetEase-Media / grps
  Deep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming mo…
  ☆156Updated last week
• MegEngine / MegPeak
  ☆244Updated last year
• FlagOpen / FlagPerf
  FlagPerf is an open-source software platform for benchmarking AI chips.
  ☆324Updated last month
• meta-soul / MetaSpore
  A unified end-to-end machine intelligence platform
  ☆531Updated 6 months ago
• wuji3 / Doraemon
  A powerful baseline for image classification, face recognition and image retrieval with Pytorch
  ☆516Updated this week
• aliyun / SimAI
  ☆425Updated last week
• clevercool / TileSparsity
  ☆107Updated 4 years ago
• Phoenix8215 / A-White-Paper-on-Neural-Network-Deployment
  模型部署白皮书(CUDA|ONNX|TensorRT|C++)🚀🚀🚀
  ☆184Updated 5 months ago
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆480Updated 4 months ago
• Qihoo360 / 360-LLaMA-Factory
  adds Sequence Parallelism into LLaMA-Factory
  ☆399Updated this week
• Hawkeye-FineGrained / Hawkeye
  Open source deep learning based fine-grained image recognition toolbox built on PyTorch🔥
  ☆454Updated 9 months ago
• Windsander / ADI-Stable-Diffusion
  Accelerate your Stable Diffusion inference with the library's universal C/C++ framework design, powered by ONNXRuntime & across platforms…
  ☆446Updated 6 months ago
• virgo777 / lmchain
  A large chinese freelanguage chain tools,you can get free API from:open.bigmodel.cn
  ☆80Updated last year
• yewentao256 / MicroTorch
  A Tiny structure of pytorch for learning;
  ☆56Updated 8 months ago
• NetEase-Media / grps_trtllm
  Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+…
  ☆114Updated this week
• sophgo / tpu-mlir
  Machine learning compiler based on MLIR for Sophgo TPU.
  ☆684Updated last week
• tensorlayer / TensorLayerX
  TensorLayerX: A Unified Deep Learning and Reinforcement Learning Framework for All Hardwares, Backends and OS.
  ☆525Updated 3 months ago
• TinyDataML / Tiny3D
  Tiny3D is a next generation of 3D AI service production system.
  ☆445Updated last year
• gdswcxzljj / ai_paper
  🔥🔥🔥AI论文生成、AI论文写作，一键论文生成，AI写毕业论文、开题报告、文献综述、课程论文，AI写报告、写方案、降AIGC率
  ☆293Updated last week