Alternatives and similar repositories for opc_data_filtering

Users that are interested in opc_data_filtering are comparing it to the libraries listed below

• sail-sg / regmix
  [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)
  ☆151Updated 4 months ago
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆162Updated 2 weeks ago
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆99Updated 11 months ago
• yegcjs / mixinglaws
  ☆102Updated 9 months ago
• yuleiqin / fantastic-data-engineering
  Fantastic Data Engineering for Large Language Models
  ☆89Updated 6 months ago
• YJiangcm / FollowBench
  [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
  ☆107Updated last month
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆87Updated 4 months ago
• OFA-Sys / InsTag
  InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning
  ☆263Updated last year
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆178Updated last year
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆155Updated last year
• Spico197 / Humpback
  🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.
  ☆140Updated 2 months ago
• THUDM / LongAlign
  [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs
  ☆250Updated 6 months ago
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆117Updated 6 months ago
• QwenLM / AutoIF
  ☆294Updated 11 months ago
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆92Updated 8 months ago
• yyDing1 / ScaleQuest
  [ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆63Updated 8 months ago
• PKU-Baichuan-MLSystemLab / CFBench
  CFBench: A Comprehensive Constraints-Following Benchmark for LLMs
  ☆36Updated 10 months ago
• QwenLM / online_merging_optimizers
  Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
  ☆75Updated last year
• a-m-team / a-m-models
  a-m-team's exploration in large language modeling
  ☆173Updated last month
• bigai-nlco / LooGLE
  ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
  ☆184Updated 9 months ago
• THUDM / NaturalCodeBench
  NaturalCodeBench (Findings of ACL 2024)
  ☆67Updated 9 months ago
• OFA-Sys / gsm8k-ScRel
  Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models
  ☆265Updated 10 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆36Updated 10 months ago
• IronBeliever / CaR
  Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
  ☆85Updated 8 months ago
• PlusLabNLP / Active-IT
  Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"
  ☆24Updated last year
• modelscope / Trinity-RFT
  Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…
  ☆136Updated this week
• pldlgb / nuggets
  ☆84Updated last year
• SparkJiao / llama-pipeline-parallel
  A prototype repo for hybrid training of pipeline parallel and distributed data parallel with comments on core code snippets. Feel free to…
  ☆56Updated 2 years ago
• shizhediao / Post-Training-Data-Flywheel
  We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.
  ☆57Updated 9 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆50Updated last year