Alternatives and similar repositories for DeepLearningSystem:

Users that are interested in DeepLearningSystem are comparing it to the libraries listed below

• Tlntin / Qwen-TensorRT-LLM
  ☆592Updated 5 months ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆75Updated 2 weeks ago
• zkkli / RepQ-ViT
  [ICCV 2023] RepQ-ViT: Scale Reparameterization for Post-Training Quantization of Vision Transformers
  ☆119Updated last year
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆208Updated last week
• alipay / PainlessInferenceAcceleration
  ☆300Updated 6 months ago
• pcg-mlp / KsanaLLM
  ☆308Updated this week
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆52Updated last week
• ifromeast / cuda_learning
  learning how CUDA works
  ☆189Updated 5 months ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆126Updated last year
• KylinC / ChatFinance
  金融财报问答大模型LLM
  ☆197Updated 10 months ago
• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆126Updated 2 months ago
• zkkli / I-ViT
  [ICCV 2023] I-ViT: Integer-only Quantization for Efficient Vision Transformer Inference
  ☆161Updated 4 months ago
• Ascend / AscendSpeed
  ☆76Updated last year
• FreedomIntelligence / RAG-Instruct
  RAG-Instruct: Boosting LLMs with Diverse Retrieval-Augmented Instructions
  ☆42Updated last week
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆213Updated this week
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆88Updated 10 months ago
• harleyszhang / llm_note
  LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
  ☆393Updated last week
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆121Updated 5 months ago
• sunkx109 / llama
  Inference code for LLaMA models
  ☆114Updated last year
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆419Updated last month
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆468Updated 10 months ago
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆216Updated last week
• OpenPPL / ppl.nn.llm
  ☆140Updated 8 months ago
• BBuf / how-to-learn-deep-learning-framework
  how to learn PyTorch and OneFlow
  ☆382Updated 9 months ago
• zjhellofss / KuiperLLama
  校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
  ☆265Updated last week
• mlc-ai / mlc-zh
  ☆597Updated 7 months ago
• chenzomi12 / chenzomi12.github.io
  ☆235Updated last month
• DeepLink-org / deeplink.framework
  ☆62Updated 2 months ago
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆78Updated last week
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆23Updated last week