Alternatives and similar repositories for DeepLearningSystem

Users that are interested in DeepLearningSystem are comparing it to the libraries listed below

• Tlntin / Qwen-TensorRT-LLM
  ☆611Updated 10 months ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆96Updated last week
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆128Updated last week
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆71Updated 2 months ago
• pprp / ultrascale-playbook-zh
  UltraScale Playbook 中文版
  ☆43Updated 3 months ago
• datawhalechina / awesome-compression
  模型压缩的小白入门教程，PDF下载地址 https://github.com/datawhalechina/awesome-compression/releases
  ☆297Updated last week
• zkkli / RepQ-ViT
  [ICCV 2023] RepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision Transformers
  ☆128Updated last year
• alipay / PainlessInferenceAcceleration
  Accelerate inference without tears
  ☆318Updated 3 months ago
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆57Updated 7 months ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆100Updated last year
• mindspore-lab / mindformers
  ☆168Updated this week
• zjhellofss / KuiperLLama
  校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
  ☆369Updated this week
• sunkx109 / GPUs-Specs
  Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM
  ☆46Updated 3 months ago
• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆146Updated 5 months ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆130Updated last year
• FelixFu520 / README
  A pupil in the computer world.(Felix Fu)
  ☆238Updated last year
• BBuf / how-to-learn-deep-learning-framework
  how to learn PyTorch and OneFlow
  ☆435Updated last year
• Tencent / KsanaLLM
  ☆336Updated this week
• liguodongiot / ai-system
  LLM/MLOps/LLMOps
  ☆92Updated last month
• ZonePG / cs-notes
  my cs notes
  ☆51Updated 8 months ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆307Updated this week
• DeepLink-org / dlinfer
  ☆51Updated last week
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆256Updated 3 weeks ago
• FreedomIntelligence / RAG-Instruct
  RAG-Instruct: Boosting LLMs with Diverse Retrieval-Augmented Instructions
  ☆138Updated 2 months ago
• zjhellofss / triton_course
  ☆28Updated last month
• Ascend / AscendSpeed
  ☆79Updated last year
• liguodongiot / llm-resource
  LLM全栈优质资源汇总
  ☆572Updated 7 months ago
• sunkx109 / llama
  Inference code for LLaMA models
  ☆121Updated last year
• chenweiphd / DeepSeek-MoE-ResourceMap
  ☆133Updated 4 months ago
• mindspore-lab / mindpet
  ☆45Updated last year