bigai-nlco / TokenSwiftLinks
[ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
☆121Updated 8 months ago
Alternatives and similar repositories for TokenSwift
Users that are interested in TokenSwift are comparing it to the libraries listed below
Sorting:
- ☆82Updated 10 months ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆204Updated 2 months ago
- ☆182Updated 9 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆139Updated last year