Miraclemarvel55 / LLaMA-MOSS-RLHF-LoRA
用RLHF可选LoRA对LLaMA和MOSS进行训练|Training LLaMA or MOSS with RLHF [LoRA]
☆20Updated last year
Related projects: ⓘ
- Official completion of “Training on the Benchmark Is Not All You Need”.☆18Updated last week
- A Chinese National Medical Licensing Examination dataset and large languge model benchmarks☆43Updated 9 months ago
- SuperCLUE-Math6：新一代中文原生多轮多步数学推理数据集的探索之旅☆38Updated 7 months ago
- code for paper 《RankingGPT: Empowering Large Language Models in Text Ranking with Progressive Enhancement》☆28Updated 8 months ago
- Plug-and-Play Document Modules for Pre-trained Models☆25Updated last year
- NTK scaled version of ALiBi position encoding in Transformer.☆64Updated last year
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆128Updated 2 months ago
- OpenLLMDE: An open source data engineering framework for LLMs☆16Updated last year
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆30Updated last year
- ☆87Updated 4 months ago
- 中文大语言模型评测第二期☆68Updated 10 months ago
- ☆59Updated last year
- MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING☆86Updated 5 months ago
- 1.4B sLLM for Chinese and English - HammerLLM🔨☆43Updated 5 months ago
- ☆124Updated 2 months ago
- 百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本☆45Updated last year
- A Bilingual Role Evaluation Benchmark for Large Language Models☆33Updated 8 months ago
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆51Updated 5 months ago
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆58Updated last year
- ☆34Updated 2 weeks ago
- Code for ACL2024 paper - Adversarial Preference Optimization (APO).☆49Updated 3 months ago
- 零样本学习测评基准，中文版☆54Updated 3 years ago
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"☆105Updated 3 months ago
- 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training☆79Updated this week
- Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"☆22Updated last year
- realize the reinforcement learning training for gpt2 llama bloom and so on llm model☆26Updated last year
- Chinese Generation Evaluation☆12Updated last year
- ☆90Updated 6 months ago
- Source code for ACL 2023 paper Decoder Tuning: Efficient Language Understanding as Decoding☆47Updated last year
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆61Updated 4 months ago