Alternatives and similar repositories for MIT6.5940_TinyML:

Users that are interested in MIT6.5940_TinyML are comparing it to the libraries listed below

• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆67Updated last month
• HarryWu99 / llm_kvcache_sparsity
  Implement some method of LLM KV Cache Sparsity
  ☆30Updated 7 months ago
• CalebDu / Awesome-Cute
  ☆26Updated last week
• DefTruth / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆47Updated this week
• XiaoSong9905 / HPC-Notes
  Personal Notes for Learning HPC & Parallel Computation [Active Adding New Content]
  ☆61Updated 2 years ago
• TreeAI-Lab / Awesome-KV-Cache-Management
  ☆45Updated 3 weeks ago
• DefTruth / ffpa-attn-mma
  📚[WIP] FFPA: Yet antother Faster Flash Prefill Attention with O(1)⚡️GPU SRAM complexity for headdim > 256, 1.8x~3x↑🎉faster vs SDPA EA.
  ☆73Updated this week
• XiaoSong9905 / dgemm-knl
  DGEMM on KNL, achieve 75% MKL
  ☆16Updated 2 years ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.
  ☆27Updated 2 months ago
• madsys-dev / deepseekv2-profile
  ☆73Updated 6 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆34Updated 2 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆133Updated 6 months ago
• InfiniTensor / InfiniTensor
  ☆210Updated this week
• mit-han-lab / tinychat-tutorial
  ☆59Updated 2 months ago
• Sunt-ing / stick
  A PyTorch-like deep learning framework. Just for fun.
  ☆143Updated last year
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆44Updated 2 months ago
• microsoft / TileFusion
  TileFusion is a highly efficient kernel template library designed to elevate the level of abstraction in CUDA C for processing tiles.
  ☆43Updated this week
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆70Updated last month
• zhang-tlgg / HPC-Lab
  HPC-Lab for High Performance Computing course, 2023 Spring , Tsinghua Universit. 高性能计算导论 @ THU.
  ☆19Updated last year
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆156Updated 3 weeks ago
• LeiWang1999 / Stream-k.tvm
  ☆19Updated 4 months ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆197Updated last month
• interestingLSY / CUDA-From-Correctness-To-Performance-Code
  Codes & examples for "CUDA - From Correctness to Performance"
  ☆78Updated 3 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆136Updated 4 months ago
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆39Updated 3 months ago
• ZonePG / cs-notes
  my cs notes
  ☆28Updated 3 months ago
• KuangjuX / TileGraph
  TileGraph is an experimental DNN compiler that utilizes static code generation and kernel fusion techniques.
  ☆12Updated 4 months ago
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆207Updated last month
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆33Updated 6 months ago
• xgqdut2016 / cuda_code
  easy cuda code
  ☆54Updated last month