MILVLG / mlc-impLinks
Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
☆13Updated last year
Alternatives and similar repositories for mlc-imp
Users that are interested in mlc-imp are comparing it to the libraries listed below
Sorting:
- FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation☆51Updated 5 months ago
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated 2 years ago
- MobileLLM-R1☆75Updated 4 months ago
- Multi-Layer Key-Value sharing experiments on Pythia models☆34Updated last year
- Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).☆25Updated 6 months ago
- Official Pytorch Implementation of Self-emerging Token Labeling☆35Updated last year
- CATransformers is a framework for joint neural network and hardware architecture search.☆20Updated 9 months ago
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Updated last year
- Description and applications of OpenAI's paper about DALL-E (2021) and implementation of other (CLIP-guided) zero-shot text-to-image gene…☆33Updated 3 years ago
- Experimental scripts for researching data adaptive learning rate scheduling.☆22Updated 2 years ago
- ☆34Updated 7 months ago
- ☆32Updated last year
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆40Updated last year
- ☆42Updated 4 months ago
- This is a simple torch implementation of the high performance Multi-Query Attention☆16Updated 2 years ago
- The official repo of continuous speculative decoding☆31Updated 10 months ago
- The official implementation of the paper "Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation"☆21Updated last year
- Simple Implementation of TinyGPTV in super simple Zeta lego blocks☆16Updated last year
- [ICML24] Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs☆98Updated last year
- This repository contains papers for a comprehensive survey on accelerated generation techniques in Large Language Models (LLMs).☆11Updated last year
- EfficientSAM + YOLO World base model for use with Autodistill.☆10Updated last year
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆35Updated last year
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆102Updated last year
- [ICML2025] KVTuner: Sensitivity-Aware Layer-wise Mixed Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference☆26Updated 2 weeks ago
- DPO, but faster 🚀☆47Updated last year
- FlexAttention w/ FlashAttention3 Support☆27Updated last year
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆23Updated last year
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆21Updated last month
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆31Updated last year
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆98Updated last year