Alternatives and similar repositories for sailor-llm:

Users that are interested in sailor-llm are comparing it to the libraries listed below

• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆88Updated 2 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆221Updated 5 months ago
• DAMO-NLP-SG / DAMO-SeaLLMs
  [ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia
  ☆166Updated 8 months ago
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆115Updated 7 months ago
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆42Updated 2 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆205Updated 11 months ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆63Updated last year
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆135Updated 9 months ago
• LLM360 / MegaMath
  An Open Math Pre-trainng Dataset with 370B Tokens.
  ☆72Updated 3 weeks ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆161Updated this week
• yegcjs / mixinglaws
  ☆98Updated 6 months ago
• GAIR-NLP / AIME-Preview
  ☆57Updated last month
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆134Updated 5 months ago
• sail-sg / regmix
  [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)
  ☆129Updated 2 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆148Updated 7 months ago
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆168Updated 10 months ago
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆90Updated last year
• krystalan / DRT
  Deep Reasoning Translation via Reinforcement Learning (arXiv preprint 2025); DRT: Deep Reasoning Translation via Long Chain-of-Thought (a…
  ☆215Updated last week
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆154Updated 10 months ago
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆90Updated last year
• SalesforceAIResearch / GemFilter
  ☆77Updated 3 months ago
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆236Updated last week
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆139Updated 6 months ago
• wuhy68 / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆142Updated 7 months ago
• shizhediao / Post-Training-Data-Flywheel
  We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.
  ☆54Updated 6 months ago
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆80Updated 2 months ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆459Updated last year
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆22Updated 5 months ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year