OpenCoder-llm / opc_data_filtering
Heuristic filtering framework for RefineCode
β60Updated last month
Alternatives and similar repositories for opc_data_filtering:
Users that are interested in opc_data_filtering are comparing it to the libraries listed below
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuningβ149Updated 8 months ago
- [ICLR 2025] 𧬠RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)β131Updated 2 months ago
- β98Updated 7 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Modelsβ169Updated 10 months ago
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)β81Updated 2 months ago
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialoguesβ85Updated 9 months ago
- On Memorization of Large Language Models in Logical Reasoningβ65Updated last month
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMsβ249Updated 4 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodingsβ154Updated 10 months ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.β42Updated 10 months ago
- β140Updated last year
- β143Updated 10 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Modelsβ40Updated last year
- [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Modelsβ98Updated 2 weeks ago
- Code implementation of synthetic continued pretrainingβ107Updated 4 months ago
- code for Scaling Laws of RoPE-based Extrapolationβ73Updated last year
- Collection of papers for scalable automated alignment.β89Updated 6 months ago
- β276Updated 9 months ago
- β63Updated 5 months ago
- β150Updated 4 months ago
- π An unofficial implementation of Self-Alignment with Instruction Backtranslation.β139Updated 10 months ago
- β192Updated 2 months ago
- Fantastic Data Engineering for Large Language Modelsβ87Updated 4 months ago
- β45Updated 2 months ago
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.β62Updated 6 months ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuningβ256Updated last year
- Codes for the paper "βBench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718β323Updated 7 months ago
- β39Updated 4 months ago
- A Comprehensive Survey on Long Context Language Modelingβ138Updated last month
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"β125Updated 11 months ago