FairyFali / SLMs-Survey
Survey of Small Language Models from Penn State, ...
☆175Updated 3 months ago
Alternatives and similar repositories for SLMs-Survey:
Users that are interested in SLMs-Survey are comparing it to the libraries listed below
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆176Updated 3 weeks ago
- a curated list of the role of small models in the LLM era☆99Updated 7 months ago
- ☆100Updated last month
- Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models☆350Updated last week
- A Comprehensive Survey on Long Context Language Modeling☆138Updated last month
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆242Updated 2 weeks ago
- Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models☆104Updated last month
- awesome llm plaza: daily tracking all sorts of awesome topics of llm, e.g. llm for coding, robotics, reasoning, multimod etc.☆195Updated last week
- ☆95Updated last month
- ☆102Updated 5 months ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆195Updated last month
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆136Updated last month
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆119Updated 6 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆149Updated 8 months ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆42Updated 10 months ago
- [ACM Computing Surveys 2025] This repository collects awesome survey, resource, and paper for Lifelong Learning with Large Language Model…☆124Updated 3 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆141Updated 2 weeks ago
- [ICLR 2025] Benchmarking Agentic Workflow Generation☆85Updated 2 months ago
- This is the reading list for the survey "A Survey on the Optimization of LLM-based Agents ". We will keep adding papers and improving the…☆91Updated 3 weeks ago
- Code implementation of synthetic continued pretraining☆107Updated 4 months ago
- [Neurips2024] Source code for xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token☆135Updated 10 months ago
- Fantastic Data Engineering for Large Language Models☆87Updated 4 months ago
- 😎 A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond☆205Updated last week
- ☆93Updated 2 months ago
- ☆162Updated last month
- [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales☆90Updated 3 months ago
- [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement☆181Updated last year
- ☆91Updated 7 months ago
- ☆115Updated last week
- A Survey on Data Selection for Language Models☆228Updated last week