yifanlu0227 / LLaMA2-7B-on-laptopLinks
Lab 5 project of MIT-6.5940, deploying LLaMA2-7B-chat on one's laptop with TinyChatEngine.
☆18Updated last year
Alternatives and similar repositories for LLaMA2-7B-on-laptop
Users that are interested in LLaMA2-7B-on-laptop are comparing it to the libraries listed below
Sorting:
- All Homeworks for TinyML and Efficient Deep Learning Computing 6.5940 • Fall • 2023 • https://efficientml.ai☆181Updated last year
- Summary of some awesome work for optimizing LLM inference☆110Updated 3 months ago
- ☆172Updated 2 years ago
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆50Updated 2 years ago
- 🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)☆10Updated this week
- Code release for AdapMoE accepted by ICCAD 2024☆33Updated 4 months ago
- Curated collection of papers in MoE model inference☆265Updated last week
- ☆24Updated last year
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆57Updated 6 months ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆107Updated 2 months ago
- Solution of Programming Massively Parallel Processors☆47Updated last year
- Examples of CUDA implementations by Cutlass CuTe☆233Updated 2 months ago
- ☆123Updated this week
- Hands-On Practical MLIR Tutorial☆31Updated last month
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆270Updated 6 months ago
- Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)☆57Updated 5 months ago
- A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆59Updated 3 weeks ago
- ☆72Updated 10 months ago
- A Easy-to-understand TensorOp Matmul Tutorial☆378Updated last year
- This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…☆205Updated last month
- ☆52Updated last year
- ☆106Updated 4 months ago
- List of papers related to Vision Transformers quantization and hardware acceleration in recent AI conferences and journals.☆95Updated last year
- [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitt…☆75Updated 5 months ago
- Optimize softmax in triton in many cases☆21Updated last year
- ☆187Updated last year
- 使用 cutlass 实现 flash-attention 精简版,具有教学意义☆48Updated last year
- ☆71Updated last year
- This is a repository of Binary General Matrix Multiply (BGEMM) by customized CUDA kernel. Thank FP6-LLM for the wheels!☆17Updated last year
- [ICML 2025] Official PyTorch implementation of "FlatQuant: Flatness Matters for LLM Quantization"☆163Updated 2 months ago