NoakLiu / MT2STLinks
Accelerating Multitask Training Trough Adaptive Transition [Efficient ML Model]
☆11Updated last month
Alternatives and similar repositories for MT2ST
Users that are interested in MT2ST are comparing it to the libraries listed below
Sorting:
- Adaptive Topology Reconstruction for Robust Graph Representation Learning [Efficient ML Model]☆10Updated 5 months ago
- Efficient Foundation Model Design: A Perspective From Model and System Co-Design [Efficient ML System & Model]☆25Updated 4 months ago
- GraphSnapShot: Caching Local Structure for Fast Graph Learning [Efficient ML System]☆33Updated last month
- The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference☆84Updated 3 weeks ago
- Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Princ…☆23Updated last week
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…☆74Updated 3 weeks ago
- Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models☆45Updated 8 months ago
- ☆54Updated 7 months ago
- LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification☆60Updated this week
- Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference☆42Updated last year
- ☆45Updated 2 years ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆40Updated 3 months ago
- ☆13Updated 4 months ago
- ☆43Updated 7 months ago
- Accepted LLM Papers in NeurIPS 2024☆37Updated 9 months ago
- Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…☆80Updated 4 months ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆93Updated 3 months ago
- ☆71Updated 9 months ago
- This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…☆164Updated 3 weeks ago
- ☆13Updated 4 years ago
- PoC for "SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning" [arXiv '25]☆41Updated last week
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆50Updated 8 months ago
- [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling☆36Updated this week
- PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".☆89Updated 2 years ago
- ☆21Updated 4 months ago
- Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation, ICML 2024☆22Updated last year
- The official implementation of "Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization"☆16Updated last year
- [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆86Updated 3 weeks ago
- Code repo for efficient quantized MoE inference with mixture of low-rank compensators☆20Updated 3 months ago
- 16-fold memory access reduction with nearly no loss☆102Updated 3 months ago