UbiquitousLearning / SLM_SurveyLinks
☆95Updated 10 months ago
Alternatives and similar repositories for SLM_Survey
Users that are interested in SLM_Survey are comparing it to the libraries listed below
Sorting:
- a curated list of the role of small models in the LLM era☆103Updated 10 months ago
- ☆38Updated 9 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆160Updated 3 months ago
- Simple extension on vLLM to help you speed up reasoning model without training.☆172Updated 2 months ago
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆47Updated 3 months ago
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆116Updated last year
- ☆83Updated 6 months ago
- FuseAI Project☆87Updated 6 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆56Updated last week
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Updated last year
- ☆127Updated last year
- ☆75Updated 3 months ago
- Unofficial implementation of https://arxiv.org/pdf/2407.14679☆48Updated 11 months ago
- [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization☆38Updated 5 months ago
- Verifiers for LLM Reinforcement Learning☆68Updated 3 months ago
- ☆42Updated last year
- Code for "Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free"☆76Updated 9 months ago
- [ICLR 2024] Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation☆174Updated last year
- This is the official repository for Inheritune.☆112Updated 5 months ago
- Efficient Infinite Context Transformers with Infini-attention Pytorch Implementation + QwenMoE Implementation + Training Script + 1M cont…☆83Updated last year
- ☆40Updated 3 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆61Updated 9 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated 2 weeks ago
- ☆48Updated 11 months ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆174Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 11 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆131Updated last year
- Self-host LLMs with LMDeploy and BentoML☆22Updated last month
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆99Updated last month
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆59Updated last year