Alternatives and similar repositories for python-lib-starter:

Users that are interested in python-lib-starter are comparing it to the libraries listed below

• PFCCLab / Camp
  飞桨护航计划集训营
  ☆19Updated last week
• BBuf / megatron-lm-parallel-group-playground
  ☆16Updated last year
• xlite-dev / netron-vscode-extension
  ☕️ A vscode extension for netron, support *.pdmodel, *.nb, *.onnx, *.pb, *.h5, *.tflite, *.pth, *.pt, *.mnn, *.param, etc.
  ☆13Updated last year
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆48Updated 4 months ago
• GuoYiFantastic / IMelodist
  Music large model based on InternLM2-chat.
  ☆22Updated 3 months ago
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆16Updated last week
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆41Updated last year
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆72Updated last month
• PFCCLab / paddlefx
  An experimental project for paddle python IR.
  ☆15Updated last year
• daquexian / faster-rwkv
  ☆124Updated last year
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆62Updated 2 months ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆42Updated last year
• ironartisan / awesome-compression1
  模型压缩的小白入门教程
  ☆22Updated 8 months ago
• corleonechensiyu / tinyCNN
  将MNN拆解的简易前向推理框架(for study!)
  ☆22Updated 4 years ago
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• MegEngine / examples
  A set of examples around MegEngine
  ☆31Updated last year
• Qingrenn / mmdeploy-summer-camp
  🐱 ncnn int8 模型量化评估
  ☆14Updated 2 years ago
• Oneflow-Inc / oneflow-yolo-doc
  https://start.oneflow.org/oneflow-yolo-doc
  ☆22Updated 2 years ago
• DataXujing / TensorRT-LLM-ChatGLM3
  大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM
  ☆26Updated last year
• ling0322 / libllm
  Efficient inference of large language models.
  ☆146Updated 3 months ago
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated 10 months ago
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated 3 months ago
• PaddlePaddle / PaDiff
  Paddle Automatically Diff Precision Toolkits.
  ☆49Updated 11 months ago
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆35Updated 3 weeks ago
• tpoisonooo / cpp-syntactic-sugar
  cpp syntactic sugar
  ☆9Updated 6 months ago
• StudyingLover / ggml-tutorial
  ☆30Updated 6 months ago
• PaddlePaddle / PaConvert
  PaddlePaddle Code Convert Toolkit. 『飞桨』深度学习代码转换工具
  ☆95Updated this week
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆49Updated last year
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆103Updated 3 weeks ago