☆173Feb 15, 2025Updated last year
Alternatives and similar repositories for TEAL
Users that are interested in TEAL are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆33Nov 11, 2024Updated 2 years ago
- [ICLR'25] R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference☆21Apr 28, 2025Updated last year
- ☆39Aug 27, 2024Updated 2 years ago
- ☆365Apr 2, 2024Updated 2 years ago
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆70Mar 25, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference☆59Nov 20, 2024Updated last year
- GPU operators for sparse tensor operations☆37Mar 11, 2024Updated 2 years ago
- [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models☆192Jan 1, 2025Updated last year
- [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models☆80Jan 6, 2024Updated 2 years ago
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆81Jul 7, 2025Updated last year
- An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization☆178Nov 26, 2025Updated 11 months ago
- A simple and effective LLM pruning approach.☆882Aug 9, 2024Updated 2 years ago
- [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference☆414Jul 10, 2025Updated last year
- [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Se…☆869Mar 6, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆207Dec 5, 2024Updated last year
- Fast Matrix Multiplications for Lookup Table-Quantized LLMs☆397Apr 13, 2025Updated last year
- [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving☆351Jul 2, 2024Updated 2 years ago
- The codes for training sparsity predictor on LLaMA.☆18May 12, 2024Updated 2 years ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆102Sep 4, 2024Updated 2 years ago
- ☆146Jul 21, 2024Updated 2 years ago
- ☆11Oct 9, 2023Updated 3 years ago
- ☆166Jul 22, 2024Updated 2 years ago
- 16-fold memory access reduction with nearly no loss☆107Mar 26, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fast low-bit matmul kernels in Triton☆493Oct 1, 2026Updated last month
- BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.☆772Aug 6, 2025Updated last year
- Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference☆51Jun 19, 2024Updated 2 years ago
- [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.☆142May 16, 2024Updated 2 years ago
- Fast Hadamard transform in CUDA, with a PyTorch interface☆358Mar 10, 2026Updated 8 months ago
- Official implementation for LaCo (EMNLP 2024 Findings)☆22Oct 3, 2024Updated 2 years ago
- Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.☆542Nov 26, 2024Updated last year
- Efficient 2:4 sparse training algorithms and implementations☆63Dec 8, 2024Updated last year
- A sparse attention kernel supporting mix sparse patterns☆566Jan 18, 2026Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.☆1,178Sep 4, 2024Updated 2 years ago
- [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache☆441Nov 20, 2025Updated 11 months ago
- ☆23Nov 26, 2024Updated last year
- ☆20Dec 24, 2024Updated last year
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆280Aug 31, 2024Updated 2 years ago
- GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM☆186Jul 12, 2024Updated 2 years ago
- LLM Inference with Microscaling Format☆35Nov 12, 2024Updated 2 years ago
Are these results useful?