yiyepiaoling0715 / codellm-data-preprocess-pipeline
代码大模型 预训练&微调&DPO 数据处理 业界处理pipeline sota
☆33Updated 6 months ago
Alternatives and similar repositories for codellm-data-preprocess-pipeline:
Users that are interested in codellm-data-preprocess-pipeline are comparing it to the libraries listed below
- ☆139Updated 7 months ago
- ☆96Updated 10 months ago
- NaturalCodeBench (Findings of ACL 2024)☆62Updated 4 months ago
- ☆36Updated 9 months ago
- ☆17Updated last month
- SuperCLUE-Agent: 基于中文原生任务的Agent智能体核心能力测评基准☆80Updated last year
- ☆45Updated 8 months ago
- ☆93Updated last year
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆38Updated 11 months ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆41Updated 7 months ago
- Imitate OpenAI with Local Models☆85Updated 5 months ago
- ☆81Updated 9 months ago
- 怎么训练一个LLM分词器☆138Updated last year
- Hammer: Robust Function-Calling for On-Device Language Models via Function Masking☆55Updated last month
- ☆129Updated 10 months ago
- CodeRAG-Bench: Can Retrieval Augment Code Generation?☆108Updated 3 months ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆65Updated 2 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆241Updated 2 months ago
- ☆48Updated 11 months ago
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆74Updated 3 months ago
- ☆28Updated 5 months ago
- An open-source conversational language model developed by the Knowledge Works Research Laboratory at Fudan University.☆64Updated last year
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆55Updated 9 months ago
- Official Repository for SIGIR2024 Demo Paper "An Integrated Data Processing Framework for Pretraining Foundation Models"☆68Updated 5 months ago
- ☆42Updated last month
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆32Updated last month
- code for Scaling Laws of RoPE-based Extrapolation☆70Updated last year
- ☆62Updated last year
- Collection of papers for scalable automated alignment.☆82Updated 3 months ago
- LLaMA Factory Document☆94Updated last month