OpenLLMAI / OpenLLMDE
OpenLLMDE: An open source data engineering framework for LLMs
☆16Updated last year
Related projects ⓘ
Alternatives and complementary repositories for OpenLLMDE
- 百川Dynamic NTK-ALiBi的代码实现:无需微调即可推理更长文本☆46Updated last year
- 1.4B sLLM for Chinese and English - HammerLLM🔨☆43Updated 7 months ago
- ☆27Updated last year
- Finetune CPM-1☆24Updated 3 years ago
- An Experiment on Dynamic NTK Scaling RoPE☆61Updated 11 months ago
- code for Scaling Laws of RoPE-based Extrapolation☆70Updated last year
- ☆31Updated 7 months ago
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆52Updated 7 months ago
- Source code for ACL 2023 paper Decoder Tuning: Efficient Language Understanding as Decoding☆48Updated last year
- ☆35Updated 2 months ago
- A Bilingual Role Evaluation Benchmark for Large Language Models☆34Updated 10 months ago
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆27Updated 3 months ago
- code for paper 《RankingGPT: Empowering Large Language Models in Text Ranking with Progressive Enhancement》☆29Updated 10 months ago
- ROUGE for multilingual Summarization☆23Updated 3 years ago
- ☆88Updated last month
- Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"☆22Updated last year
- SuperCLUE-Math6:新一代中文原生多轮多步数学推理数据集的探索之旅☆46Updated 9 months ago
- The code of paper "Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation" published at NeurIPS 202…☆42Updated 2 years ago
- ☆40Updated 5 months ago
- Awesome Reinforcement Learning from Human Feedback, the secret behind ChatGPT XD☆22Updated last year
- ☆22Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆36Updated 8 months ago
- Unofficial implementation of Chain of Hindsight (https://arxiv.org/abs/2302.02676) using pytorch and huggingface Trainers.☆11Updated last year
- realize the reinforcement learning training for gpt2 llama bloom and so on llm model☆26Updated last year
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆60Updated last year
- A Python implementation of Toolformer using Huggingface Transformers☆15Updated last year
- dpo算法实现☆17Updated 5 months ago
- machine translation data process tools☆10Updated 6 months ago
- NTK scaled version of ALiBi position encoding in Transformer.☆67Updated last year
- [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues☆51Updated 3 months ago