yifanlu0227 / LLaMA2-7B-on-laptopLinks
Lab 5 project of MIT-6.5940, deploying LLaMA2-7B-chat on one's laptop with TinyChatEngine.
☆17Updated last year
Alternatives and similar repositories for LLaMA2-7B-on-laptop
Users that are interested in LLaMA2-7B-on-laptop are comparing it to the libraries listed below
Sorting:
- 🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)☆10Updated this week
- All Homeworks for TinyML and Efficient Deep Learning Computing 6.5940 • Fall • 2023 • https://efficientml.ai☆175Updated last year
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆49Updated 2 years ago
- Code release for AdapMoE accepted by ICCAD 2024☆26Updated 2 months ago
- ☆23Updated last year
- ☆172Updated last year
- Summary of some awesome work for optimizing LLM inference☆84Updated last month
- ☆168Updated last year
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆98Updated last week
- ☆103Updated last year
- This repo contains the Assignments from Cornell Tech's ECE 5545 - Machine Learning Hardware and Systems offered in Spring 2023☆32Updated 2 years ago
- ☆113Updated 2 weeks ago
- Solution of Programming Massively Parallel Processors☆47Updated last year
- Curated collection of papers in MoE model inference☆210Updated 5 months ago
- Penn CIS 5650 (GPU Programming and Architecture) Final Project☆35Updated last year
- [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs☆111Updated 2 weeks ago
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆50Updated 3 months ago
- Examples of CUDA implementations by Cutlass CuTe☆206Updated 2 weeks ago
- ☆48Updated last year
- ☆61Updated last year
- List of papers related to Vision Transformers quantization and hardware acceleration in recent AI conferences and journals.☆92Updated last year
- ☆31Updated 2 months ago
- Optimize softmax in triton in many cases☆21Updated 10 months ago
- [DAC 2024] EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive La…☆59Updated last year
- [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitt…☆68Updated 3 months ago
- Code Repository of Evaluating Quantized Large Language Models☆130Updated 10 months ago
- Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…☆63Updated last year
- Hands-On Practical MLIR Tutorial☆28Updated 11 months ago
- ☆149Updated 11 months ago
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆17Updated last year