taishan1994 / pytorch-distributed-NLPLinks
pytorch分布式训练
☆66Updated last year
Alternatives and similar repositories for pytorch-distributed-NLP
Users that are interested in pytorch-distributed-NLP are comparing it to the libraries listed below
Sorting:
- Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models☆62Updated 3 months ago
- ☆69Updated last year
- ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现☆85Updated last year
- 怎么训练一个LLM分词器☆149Updated last year
- 阿里天池: 2023全球智能汽车AI挑战赛——赛道一：AI大模型检索问答 baseline 80+☆105Updated last year
- ☆110Updated 11 months ago
- easy-bert是一个中文NLP工具，提供诸多bert变体调用和调参方法，极速上手；清晰的设计和代码注释，也很适合学习☆78Updated 2 years ago
- basic framework for rag(retrieval augment generation)☆84Updated last year
- baichuan LLM surpervised finetune by lora☆63Updated last year
- 使用单个24G显卡，从0开始训练LLM☆54Updated last week
- ☆43Updated 9 months ago
- 2023全球智能汽车AI挑战赛——赛道一：AI大模型检索问答， 75+ baseline☆57Updated last year
- deepspeed+trainer简单高效实现多卡微调大模型☆125Updated 2 years ago
- ChatGLM2-6B微调, SFT/LoRA, instruction finetune☆108Updated last year
- 阿里通义千问(Qwen-7B-Chat/Qwen-7B), 微调/LORA/推理☆104Updated last year
- BLOOM 模型的指令微调☆24Updated last year
- 大语言模型指令调优工具（支持 FlashAttention）☆173Updated last year
- 1st Solution For Conversational Multi-Doc QA Workshop & International Challenge @ WSDM'24 - Xiaohongshu.Inc☆160Updated last year
- ChatGLM2-6B-Explained☆35Updated last year
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆153Updated 7 months ago
- leetcode Study☆29Updated 2 years ago
- llama，chatglm 等模型的微调☆89Updated 10 months ago
- LLM for NER☆73Updated 10 months ago
- ☆34Updated 2 years ago
- qwen models finetuning☆98Updated 2 months ago
- Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理☆61Updated last year
- GoGPT:基于Llama/Llama 2训练的中英文增强大模型|Chinese-Llama2☆78Updated last year
- ☆71Updated last week
- ChatGPT相关资源汇总☆55Updated 2 years ago
- 一套代码指令微调大模型☆39Updated last year