FairyFali / SLMs-Survey
Survey of Small Language Models from Penn State, ...
☆164Updated last month
Alternatives and similar repositories for SLMs-Survey:
Users that are interested in SLMs-Survey are comparing it to the libraries listed below
- ☆253Updated last week
- ☆262Updated 7 months ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆159Updated this week
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆226Updated 3 weeks ago
- ☆101Updated 3 months ago
- ☆131Updated last month
- A series of technical report on Slow Thinking with LLM☆536Updated this week
- awesome llm plaza: daily tracking all sorts of awesome topics of llm, e.g. llm for coding, robotics, reasoning, multimod etc.☆190Updated this week
- [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA☆114Updated 4 months ago
- [Neurips2024] Source code for xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token☆127Updated 8 months ago
- Project for the paper entitled `Instruction Tuning for Large Language Models: A Survey`☆165Updated 3 months ago
- ☆78Updated this week
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆144Updated 6 months ago
- A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks☆259Updated 7 months ago
- This is the code repo for our paper "Autonomously Knowledge Assimilation and Accommodation through Retrieval-Augmented Agents".☆104Updated 4 months ago
- OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning☆114Updated 2 months ago
- Code implementation of synthetic continued pretraining☆93Updated 2 months ago
- [NeurIPS 2024] Agent Planning with World Knowledge Model☆116Updated 2 months ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆41Updated 8 months ago
- LLM hallucination paper list☆309Updated last year
- ☆253Updated last year
- ☆87Updated 2 weeks ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆115Updated 4 months ago
- A Survey on Data Selection for Language Models☆218Updated 5 months ago