[NeurIPS 2023] Token-Scaled Logit Distillation for Ternary Weight Generative Language Models
☆18Dec 6, 2023Updated 2 years ago
Alternatives and similar repositories for TSLD
Users that are interested in TSLD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TernGEMM: General Matrix Multiply Library with Ternary Weights for Fast DNN Inference☆14Feb 22, 2022Updated 4 years ago
- ☆10Nov 4, 2022Updated 4 years ago
- Layer-wise Pruning of Transformer Heads for Efficient Language Modeling☆22Feb 22, 2022Updated 4 years ago
- [NeurIPS 2023] SiT Dataset: Socially Interactive Pedestrian Trajectory Dataset for Social Navigation Robots☆86Oct 17, 2024Updated 2 years ago
- LLM Inference with Microscaling Format☆35Nov 12, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- AFPQ code implementation☆23Nov 6, 2023Updated 2 years ago
- A high-throughput LLM serving engine with non-uniform KV cache compression, built on vLLM☆16Sep 9, 2026Updated last month
- The official repository for QWHA☆13Sep 17, 2025Updated last year
- ☆14Mar 20, 2026Updated 7 months ago
- [ICCV 2025] QuantCache：Adaptive Importance-Guided Quantization with Hierarchical Latent and Layer Caching for Video Generation☆18Sep 26, 2025Updated last year
- BESA is a differentiable weight pruning technique for large language models.☆17Mar 4, 2024Updated 2 years ago
- [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.☆141May 16, 2024Updated 2 years ago
- super-resolution; post-training quantization; model compression☆14Nov 10, 2023Updated 2 years ago
- ☆22Oct 19, 2026Updated 2 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- LLM fine-tuning with LoRA + NVFP4/MXFP8 on NVIDIA DGX Spark (Blackwell GB10)☆22Dec 22, 2025Updated 10 months ago
- Harness-Delta Attribution: Dissecting Gains From Harness Evolution☆14Oct 19, 2026Updated 2 weeks ago
- PB-LLM: Partially Binarized Large Language Models☆159Nov 20, 2023Updated 2 years ago
- ☆14Nov 5, 2024Updated last year
- ☆11May 24, 2024Updated 2 years ago
- ☆129Mar 18, 2026Updated 7 months ago
- HKUST(GZ) Marpit Template for Presentation☆10Nov 21, 2022Updated 3 years ago
- maum-ai.github.io☆15Sep 8, 2026Updated last month
- ☆30Sep 11, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code to reproduce the experiments of the ICLR24-paper: "Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging"☆12Oct 14, 2025Updated last year
- Hessian Null Space Continuation (HNC): traversing the solution space of neural networks☆12Sep 30, 2026Updated last month
- ☆13Jun 5, 2025Updated last year
- ☆36Dec 22, 2025Updated 10 months ago
- [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer☆31Dec 6, 2023Updated 2 years ago
- SIGIR 2024, Sequential recommendation, Attribute-Opinions, Fine-grained User and Item Representation.☆13Sep 5, 2024Updated 2 years ago
- To mitigate position bias in LLMs, especially in long-context scenarios, we scale only one dimension of LLMs, reducing position bias and …☆13Jun 18, 2024Updated 2 years ago
- [ACL Findings 2026] Official Implementation of "FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acc…☆34Apr 14, 2026Updated 6 months ago
- ☆17May 29, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Memora: A Long-Term Memory Benchmark for Personalized Agents☆19Jul 22, 2026Updated 3 months ago
- [COLM 2025] Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"☆78Jul 8, 2025Updated last year
- More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression（EMNLP 2025）☆12Jan 15, 2025Updated last year
- Official implementation of LRAgent: Efficient KV Cache Sharing for Multi-LoRA LLM Agents☆34Oct 23, 2026Updated last week
- ☆13Jan 28, 2026Updated 9 months ago
- The official implementation of "ICDPO: Effectively Borrowing Alignment Capability of Others via In-context Direct Preference Optimization…☆16Feb 15, 2024Updated 2 years ago
- ☆14Oct 3, 2024Updated 2 years ago