Alternatives and similar repositories for mit6.5940-2023

Users that are interested in mit6.5940-2023 are comparing it to the libraries listed below

• yifanlu0227 / MIT-6.5940
  All Homeworks for TinyML and Efficient Deep Learning Computing 6.5940 • Fall • 2023 • https://efficientml.ai
  ☆175Updated last year
• hahnyuan / LLM-Viewer
  Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…
  ☆509Updated 10 months ago
• yifanlu0227 / LLaMA2-7B-on-laptop
  Lab 5 project of MIT-6.5940, deploying LLaMA2-7B-chat on one's laptop with TinyChatEngine.
  ☆17Updated last year
• Zhen-Dong / Awesome-Quantization-Papers
  List of papers related to neural network quantization in recent AI conferences and journals.
  ☆669Updated 3 months ago
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆416Updated 7 months ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆365Updated 9 months ago
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆381Updated 2 months ago
• DefTruth / CUDA-Learn-Notes
  📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
  ☆31Updated 2 months ago
• ifromeast / cuda_learning
  learning how CUDA works
  ☆283Updated 4 months ago
• Cambricon / triton-linalg
  Development repository for the Triton-Linalg conversion
  ☆190Updated 5 months ago
• goliaro / specinfer-ae
  ☆23Updated last year
• mit-han-lab / parallel-computing-tutorial
  ☆172Updated last year
• byungsoo-oh / ml-systems-papers
  Curated collection of papers in machine learning systems
  ☆384Updated last month
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆206Updated 2 weeks ago
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆210Updated 5 months ago
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆439Updated 10 months ago
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in the Triton Language.
  ☆628Updated this week
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆316Updated 3 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆84Updated last month
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆259Updated 4 months ago
• mit-han-lab / omniserve
  [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Se…
  ☆717Updated 4 months ago
• SJTU-ReArch-Group / Paper-Reading-List
  ☆113Updated 2 weeks ago
• ModelTC / LightCompress
  [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a V…
  ☆512Updated this week
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆484Updated 3 weeks ago
• StiphyJay / MQuant
  [ACM MM2025]: MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantization
  ☆12Updated last week
• Guangxuan-Xiao / torch-int
  This repository contains integer operators on GPUs for PyTorch.
  ☆206Updated last year
• JackonYang / hands-on-tvm
  hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.
  ☆49Updated 2 years ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆98Updated last week
• reed-lau / cute-gemm
  ☆125Updated 7 months ago
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆402Updated last month