SqueezeAILab / open_source_projectsLinks
Open Source Projects from Pallas Lab
☆21Updated 4 years ago
Alternatives and similar repositories for open_source_projects
Users that are interested in open_source_projects are comparing it to the libraries listed below
Sorting:
- ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization☆112Updated last year
- The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…☆49Updated 3 years ago
- Flexible simulator for mixed precision and format simulation of LLMs and vision transformers.☆51Updated 2 years ago
- ☆40Updated last year
- A collection of research papers on efficient training of DNNs☆70Updated 3 years ago
- [TCAD 2021] Block Convolution: Towards Memory-Efficient Inference of Large-Scale CNNs on FPGA☆17Updated 3 years ago
- LLM Inference with Microscaling Format☆34Updated last year
- ☆170Updated 2 years ago
- The official implementation of the DAC 2024 paper GQA-LUT☆20Updated last year
- Repository for CPU Kernel Generation for LLM Inference☆27Updated 2 years ago
- A framework to compare low-bit integer and float-point formats☆61Updated 3 months ago
- ACL 2023☆39Updated 2 years ago
- ☆15Updated 3 years ago
- ☆84Updated last year
- KVTuner: Sensitivity-Aware Layer-wise Mixed Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference☆26Updated 8 months ago
- BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.☆58Updated 2 years ago
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆20Updated last year
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆46Updated 7 months ago
- A curated list for Efficient Large Language Models☆11Updated last year
- QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX☆173Updated last week
- Nsight Systems In Docker☆21Updated 2 years ago
- ☆84Updated last year
- Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…☆50Updated 2 years ago
- llama INT4 cuda inference with AWQ☆55Updated last year
- Torch2Chip (MLSys, 2024)☆55Updated 9 months ago
- ☆33Updated 10 months ago
- FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation☆50Updated 5 months ago
- ☆75Updated last month
- ☆77Updated last year
- QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference☆119Updated last year