Alternatives and similar repositories for S2FT:

Users that are interested in S2FT are comparing it to the libraries listed below

• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 6 months ago
• bethgelab / sober-reasoning
  Code for "A Sober Look at Progress in Language Model Reasoning" paper
  ☆33Updated this week
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆51Updated 3 weeks ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆25Updated 5 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆29Updated last month
• open-compass / GPassK
  Official Repository of Are Your LLMs Capable of Stable Reasoning?
  ☆25Updated last month
• uservan / ThinkPO
  ☆20Updated last month
• LAMDASZ-ML / Self-Backtracking
  ☆45Updated 2 months ago
• IST-DASLab / RoSA
  Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)
  ☆40Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆38Updated last month
• zjunlp / unlearn
  Knowledge Unlearning for Large Language Models
  ☆25Updated 2 weeks ago
• SalesforceAIResearch / GemFilter
  ☆76Updated 3 months ago
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆23Updated 9 months ago
• yale-nlp / refdpo
  ☆16Updated 8 months ago
• zhijie-group / SIFT
  SIFT: Grounding LLM Reasoning in Contexts via Stickers
  ☆56Updated last month
• hkust-nlp / PreSelect
  ☆45Updated last month
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆68Updated 3 weeks ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆54Updated 2 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆26Updated 4 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆44Updated 9 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆53Updated 7 months ago
• efficientscaling / Z1
  Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆53Updated last week
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆36Updated 10 months ago
• dvlab-research / Q-LLM
  This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
  ☆48Updated 9 months ago
• tianyi-lab / R2-T2
  Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆15Updated last month
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆42Updated 8 months ago
• alessiodevoto / l2compress
  Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."
  ☆11Updated 4 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆82Updated 6 months ago
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆19Updated 4 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 7 months ago