YueZhengMeng / MyLlamaLinks
手搓Llama,个人学习用
☆14Updated last year
Alternatives and similar repositories for MyLlama
Users that are interested in MyLlama are comparing it to the libraries listed below
Sorting:
- 基于DPO算法微调语言大模型,简单好上手。☆39Updated 11 months ago
- ☆70Updated last year
- 使用 Qwen2ForSequenceClassification 简单实现文本分类任务。☆67Updated last year
- ☆10Updated 2 years ago
- 使用单个24G显卡,从0开始训练LLM☆56Updated last month
- Inference code for LLaMA models☆121Updated last year
- ☆84Updated last year
- Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models☆63Updated 4 months ago
- NTK scaled version of ALiBi position encoding in Transformer.☆68Updated last year
- This repository open-sources our GEC system submitted by THU KELab (sz) in the CCL2023-CLTC Track 1: Multidimensional Chinese Learner Tex…☆15Updated last year
- 怎么训练一个LLM分词器☆150Updated last year
- SuperCLUE-Math6:新一代中文原生多轮多步数学推理数据集的探索之旅☆56Updated last year
- stay tuned.☆16Updated last week
- ☆112Updated 11 months ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆19Updated last year
- ☆52Updated last year
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆81Updated 7 months ago
- 基于T5模型的中文文本纠错☆30Updated 7 months ago
- 使用sentencepiece中BPE训练中文词表,并在transformers中进行使用。☆118Updated 2 years ago
- 天池算法比赛《BetterMixture - 大模型数据混合挑战赛》的第一名top1解决方案☆31Updated 11 months ago
- 中文 Instruction tuning datasets☆132Updated last year
- 格物-多语言和中文大规模预训练模型-轻量版,涵盖纯中文、知识增强、113个语种多语言,采用主流Roberta架构,适用于NLU和NLG任务, 支持pytorch、tensorflow、uer、huggingface等框架。 Multilingual and Chinese …☆29Updated 2 years ago
- 记录NLP、CV、搜索、推荐等AI岗位最新情况。☆29Updated 2 years ago
- A repo for update and debug Mixtral-7x8B、MOE、ChatGLM3、LLaMa2、 BaChuan、Qwen an other LLM models include new models mixtral, mixtral 8x7b, …☆46Updated last week
- ChatGLM-6B添加了RLHF的实现,以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成,以及指定context推荐的RLHF的实现☆86Updated last year
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆66Updated 2 years ago
- 多轮共情对话模型PICA☆95Updated last year
- ☆18Updated 10 months ago
- Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理☆63Updated last year
- learn jiu wan shier l☆52Updated 3 years ago