Alternatives and similar repositories for Synthetic_Continued_Pretraining:

Users that are interested in Synthetic_Continued_Pretraining are comparing it to the libraries listed below

• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆46Updated 8 months ago
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆89Updated last month
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆158Updated 9 months ago
• NumberChiffre / mcts-llm
  ☆91Updated 3 months ago
• yyDing1 / ScaleQuest
  We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆60Updated 4 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆136Updated 4 months ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆102Updated 3 months ago
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆115Updated 5 months ago
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆108Updated 8 months ago
• QwenLM / ProcessBench
  ☆143Updated 3 months ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆101Updated this week
• MozerWang / Loong
  [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
  ☆116Updated 4 months ago
• yegcjs / mixinglaws
  ☆98Updated 5 months ago
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆147Updated 6 months ago
• weizhepei / InstructRAG
  [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales
  ☆78Updated last month
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆66Updated 3 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆153Updated 9 months ago
• RUCKBReasoning / CoT-based-Synthesizer
  The code of arxiv paper: "CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis"
  ☆23Updated 2 months ago
• shizhediao / Post-Training-Data-Flywheel
  We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.
  ☆53Updated 5 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆45Updated 2 months ago
• yuleiqin / fantastic-data-engineering
  Fantastic Data Engineering for Large Language Models
  ☆83Updated 2 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆121Updated 8 months ago
• pldlgb / nuggets
  ☆80Updated last year
• Reason-Wang / NAT
  The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agen…
  ☆24Updated last year
• OrangeInSouth / DeePEn
  A method of ensemble learning for heterogeneous large language models.
  ☆41Updated 7 months ago
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆54Updated 3 months ago
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆73Updated 2 months ago