A curated list for Efficient Large Language Models
☆11Mar 25, 2024Updated 2 years ago
Alternatives and similar repositories for Awesome-Efficient-LLM
Users that are interested in Awesome-Efficient-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Apr 27, 2022Updated 4 years ago
- Open Source Projects from Pallas Lab☆21Oct 10, 2021Updated 5 years ago
- SGEMM optimization with cuda step by step☆24Mar 23, 2024Updated 2 years ago
- ☆11Mar 29, 2020Updated 6 years ago
- triton ops☆15Aug 18, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A high-throughput and memory-efficient inference and serving engine for LLMs☆10Jul 22, 2023Updated 3 years ago
- ☆13Mar 28, 2025Updated last year
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆51Jun 15, 2023Updated 3 years ago
- Optimizing Tensor Computation Graphs with Equality Saturation and Monte Carlo Tree Search☆15Aug 9, 2024Updated 2 years ago
- This repository is an official code base for our paper, Randomly Removing 50% of Dimensions in Text Embeddings has Minimal Impact on Retr…☆12Oct 15, 2025Updated last year
- [NeurIPS 2024] BLAST: Block Level Adaptive Structured Matrix for Efficient Deep Neural Network Inference☆19Nov 6, 2024Updated 2 years ago
- ☆19May 9, 2025Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆11Nov 29, 2023Updated 2 years ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆48Jun 11, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14Jun 10, 2025Updated last year
- NVDLA small config implementation on Zynq ZCU104 (evaluation)☆24Mar 25, 2019Updated 7 years ago
- ☆15Jun 26, 2024Updated 2 years ago
- 面向多平台编译优化的深度学习中间表示☆10Oct 28, 2024Updated 2 years ago
- Diagram-first LLM architecture, memory, hardware-fit, throughput, and verified cloud-cost explorer.☆22Aug 24, 2026Updated 2 months ago
- raytracer☆10Jul 18, 2022Updated 4 years ago
- Testing and analysis for OMEGA, MPAS-Ocean, MALI and MPAS-Seaice☆11Updated this week
- ☆10Oct 17, 2021Updated 5 years ago
- MATLAB/Octave generator of Hamming ECC coding. Output format is Verilog HDL.☆12Dec 27, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Abstract Constraint Transformation☆19Updated this week
- Fuzz testing for Kubernetes CustomResourceDefinition schemas☆12Jun 6, 2025Updated last year
- The code used to train and run inference with the ColQwen3 model. Welcome to follow and star! ⭐️⭐️⭐️ https://huggingface.co/goodman2001/…☆16Aug 16, 2026Updated 2 months ago
- 基于Vue+Element-ui+axios开发的一套电商平台前端模板☆21Oct 24, 2020Updated 6 years ago
- Fortran 90 subprograms to be used for interpolating between nearly all grids used at NCEP.☆10Oct 27, 2026Updated last week
- ☆19Mar 4, 2025Updated last year
- A unified programming framework for high and portable performance across FPGAs and GPUs☆12Mar 23, 2025Updated last year
- PolyG: Adaptive Graph Traversal for Diverse GraphRAG Questions☆14Apr 6, 2026Updated 7 months ago
- 🌏 Teddy is a tiny but scalable http server based on Java NIO, inspired by netty.☆11Dec 26, 2019Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A telegram bot that sends you a message when the GPU is in use☆11May 27, 2024Updated 2 years ago
- Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.☆13Nov 3, 2023Updated 3 years ago
- ASKAP Benchmark Packages☆13Nov 3, 2023Updated 3 years ago
- ☆16Mar 1, 2026Updated 8 months ago
- CLI that uses DSPy to interact with MCP servers.☆24Mar 10, 2025Updated last year
- GEMM and Winograd based convolutions using CUTLASS☆29Jul 15, 2020Updated 6 years ago
- ☆14Jun 25, 2025Updated last year