Alternatives and similar repositories for LLaMA2-7B-on-laptop:

Users that are interested in LLaMA2-7B-on-laptop are comparing it to the libraries listed below

• JackonYang / hands-on-tvm
  hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.
  ☆45Updated last year
• goliaro / specinfer-ae
  ☆19Updated last year
• Ther-nullptr / circult-eda-mlsys-tinyml-arxiv-daily
  🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)
  ☆10Updated this week
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆66Updated this week
• mit-han-lab / tinychat-tutorial
  ☆61Updated 4 months ago
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆49Updated 10 months ago
• snu-comparch / Tender
  Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)
  ☆13Updated 8 months ago
• yifanlu0227 / MIT-6.5940
  All Homeworks for TinyML and Efficient Deep Learning Computing 6.5940 • Fall • 2023 • https://efficientml.ai
  ☆162Updated last year
• clevercool / ANT-Quantization
  ☆94Updated last year
• naver-aics / lut-gemm
  ☆53Updated 11 months ago
• DD-DuDa / BitDistiller
  [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.
  ☆109Updated 10 months ago
• iclementine / optimize_softmax
  Optimize softmax in triton in many cases
  ☆20Updated 6 months ago
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆23Updated this week
• guanrenyang / Programming-Massively-Parallel-Processors
  Solution of Programming Massively Parallel Processors
  ☆42Updated last year
• SJTU-ReArch-Group / Paper-Reading-List
  ☆100Updated 3 weeks ago
• pku-liang / ArkVale
  ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)
  ☆32Updated 3 months ago
• PrincetonUniversity / LLMCompass
  ☆129Updated 8 months ago
• abhibambhaniya / GenZ-LLM-Analyzer
  LLM Inference analyzer for different hardware platforms
  ☆54Updated last week
• CalebDu / Awesome-Cute
  ☆48Updated 2 months ago
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆148Updated last month
• DD-DuDa / awesome-vit-quantization-acceleration
  List of papers related to Vision Transformers quantization and hardware acceleration in recent AI conferences and journals.
  ☆78Updated 9 months ago
• UDC-GAC / venom
  A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
  ☆50Updated last year
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆119Updated 8 months ago
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆100Updated 3 months ago
• LeiWang1999 / TVM.CMakeExtend
  Tutorials of Extending and importing TVM with CMAKE Include dependency.
  ☆13Updated 5 months ago
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆74Updated 3 months ago
• mit-han-lab / parallel-computing-tutorial
  ☆160Updated last year
• gty111 / GEMM_MMA
  Optimize GEMM with tensorcore step by step
  ☆24Updated last year
• sBobHuang / mlir-tutorial
  Hands-On Practical MLIR Tutorial
  ☆20Updated 8 months ago
• ParCIS / Magicube
  Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.
  ☆86Updated 2 years ago