Lab 5 project of MIT-6.5940, deploying LLaMA2-7B-chat on one's laptop with TinyChatEngine.
☆17Dec 1, 2023Updated 2 years ago
Alternatives and similar repositories for LLaMA2-7B-on-laptop
Users that are interested in LLaMA2-7B-on-laptop are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- All Homeworks for TinyML and Efficient Deep Learning Computing 6.5940 • Fall • 2023 • https://efficientml.ai☆200Dec 2, 2023Updated 2 years ago
- 模型加速/模型压缩（已完成所有Lab）☆11Dec 24, 2023Updated 2 years ago
- DGEMM on KNL, achieve 75% MKL☆18May 19, 2022Updated 4 years ago
- ☆79Nov 5, 2024Updated last year
- [NeurIPS 2024] Implementation of paper - D-LLM: A Token Adaptive Computing Resource Allocation Strategy for Large Language Models☆26Apr 9, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Lock-free ARENA allocator and a set of lock-free data structures based on the ARENA allocator.☆17Mar 14, 2026Updated 7 months ago
- Structured Pruning Adapters in PyTorch☆20Aug 30, 2023Updated 3 years ago
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Jul 24, 2024Updated 2 years ago
- ☆179Aug 9, 2023Updated 3 years ago
- An implementation of Distortion-Free Wide-Angle Portraits on Camera Phones☆10Dec 24, 2019Updated 6 years ago
- ☆13Jun 12, 2025Updated last year
- A basic deep learning library, comparable to a very minimal version of PyTorch.☆20Mar 1, 2023Updated 3 years ago
- The LLVM Project is a collection of modular and reusable compiler and toolchain technologies. Note: the repository does not accept github…☆12Updated this week
- TinyML and Efficient Deep Learning Computing☆20Apr 26, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆10Oct 8, 2021Updated 5 years ago
- This repo contains the Assignments from Cornell Tech's ECE 5545 - Machine Learning Hardware and Systems offered in Spring 2023☆46May 31, 2023Updated 3 years ago
- [ICLR 2023] PyTorch code for DFPC: Data flow driven pruning of coupled channels without data.☆15Aug 25, 2023Updated 3 years ago
- ☆10Nov 14, 2023Updated 2 years ago
- Asynchronous Rust bindings for SPDK.☆18Nov 1, 2022Updated 3 years ago
- A docker image for One Student One Chip's debug exam☆10Sep 22, 2023Updated 3 years ago
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…☆22Sep 10, 2024Updated 2 years ago
- Leaderboard implementations for datasets produced by the Mosaic Team.☆20Jul 6, 2023Updated 3 years ago
- A Valgrind extension for CUDA, unofficial mirror for https://www.hlrs.de/organization/av/spmt/research/cudagrind/☆10Aug 5, 2015Updated 11 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14Oct 9, 2023Updated 3 years ago
- an implementation of parallel skills like amp, ddp, pp, tp for learning purposes☆14Nov 18, 2023Updated 2 years ago
- A PyTorch-like deep learning framework. Just for fun.☆158Oct 9, 2023Updated 3 years ago
- ☆48Nov 1, 2025Updated 11 months ago
- ☆12Nov 22, 2022Updated 3 years ago
- a student trainning project for HLS and transformer☆11Oct 19, 2022Updated 4 years ago
- ☆14Jun 22, 2022Updated 4 years ago
- 🦙🦙.🦀☆28Sep 24, 2023Updated 3 years ago
- Effective C++: 55 Specific Ways to Improve Your Programs and Designs (Ver.3) Reading Notes☆14Feb 21, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！☆41Aug 26, 2024Updated 2 years ago
- LLVM OpenCL C compiler suite for ventus GPGPU☆64Oct 10, 2026Updated last week
- Practical Jupyter notebooks from Andrew Ng and Giskard team's "Red Teaming LLM Applications" course on DeepLearning.AI.☆24Apr 8, 2024Updated 2 years ago
- LLM inference in Fortran☆68May 30, 2024Updated 2 years ago
- [NeurIPS 2024] "AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment" by Yonggan Fu, Zhongzhi Yu,…☆19Dec 13, 2024Updated last year
- A lightweight code for calculations of muon fluxes and intensities.☆19May 25, 2025Updated last year
- A cycle-accurate RISC-V CPU simulator + RTL modeling library in pure Python.☆20Aug 14, 2026Updated 2 months ago