suu990901 / LLaMA-MiLe-Loss
Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
☆53Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for LLaMA-MiLe-Loss
- ☆71Updated 10 months ago
- ☆120Updated 7 months ago
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆67Updated last week
- 怎么训练一个LLM分词器☆129Updated last year
- 基于DPO算法微调语言大模型，简单好上手。☆28Updated 4 months ago
- Fantastic Data Engineering for Large Language Models☆50Updated 3 months ago
- MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING☆87Updated 7 months ago
- [SIGIR'24] The official implementation code of MOELoRA.☆127Updated 3 months ago
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆27Updated 3 months ago
- ☆53Updated 4 months ago
- 大语言模型应用：RAG、NL2SQL、聊天机器人、预训练、MOE混合专家模型、微调训练、强化学习、天池数据竞赛☆48Updated 5 months ago
- ☆63Updated last year
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆106Updated last year
- 欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆269Updated 4 months ago
- ☆158Updated last year
- llama，chatglm 等模型的微调☆82Updated 4 months ago
- ☆82Updated last year
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆60Updated last year
- NTK scaled version of ALiBi position encoding in Transformer.☆67Updated last year
- ☆93Updated 8 months ago
- ☆40Updated 5 months ago
- ChatGPT相关资源汇总☆53Updated last year
- ☆59Updated last year
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆70Updated 9 months ago
- 大语言模型指令调优工具（支持 FlashAttention）☆166Updated 10 months ago
- ☆129Updated 4 months ago
- 中文 Instruction tuning datasets☆118Updated 7 months ago
- A Massive Multi-Level Multi-Subject Knowledge Evaluation benchmark☆99Updated last year
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"☆109Updated 5 months ago
- ☆91Updated 11 months ago