taishan1994 / pytorch-distributed-NLP
pytorch分布式训练
☆64Updated last year
Alternatives and similar repositories for pytorch-distributed-NLP:
Users that are interested in pytorch-distributed-NLP are comparing it to the libraries listed below
- ☆104Updated 8 months ago
- Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models☆62Updated last month
- llama，chatglm 等模型的微调☆86Updated 8 months ago
- 使用单个24G显卡，从0开始训练LLM☆50Updated 4 months ago
- 怎么训练一个LLM分词器☆142Updated last year
- baichuan LLM surpervised finetune by lora☆62Updated last year
- ☆40Updated 7 months ago
- 阿里天池: 2023全球智能汽车AI挑战赛——赛道一：AI大模型检索问答 baseline 80+☆92Updated last year
- easy-bert是一个中文NLP工具，提供诸多bert变体调用和调参方法，极速上手；清晰的设计和代码注释，也很适合学习☆77Updated 2 years ago
- BLOOM 模型的指令微调☆24Updated last year
- 天池算法比赛《BetterMixture - 大模型数据混合挑战赛》的第一名top1解决方案☆27Updated 8 months ago
- 大语言模型指令调优工具（支持 FlashAttention）☆171Updated last year
- ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现☆82Updated last year
- 2023全球智能汽车AI挑战赛——赛道一：AI大模型检索问答， 75+ baseline☆56Updated last year
- basic framework for rag(retrieval augment generation)☆82Updated last year
- 通义千问的DPO训练☆40Updated 6 months ago
- 包含程序员面试大厂面试题和面试经验☆123Updated 2 months ago
- ☆66Updated last year
- Baichuan2代码的逐行解析版本，适合小白☆212Updated last year
- ChatGLM2-6B-Explained☆35Updated last year
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆151Updated 5 months ago
- deepspeed+trainer简单高效实现多卡微调大模型☆123Updated last year
- Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理☆54Updated 10 months ago
- 大模型基础学习和面试八股文☆98Updated 11 months ago
- 使用 Qwen2ForSequenceClassification 简单实现文本分类任务。☆59Updated 9 months ago
- ☆67Updated 3 weeks ago
- 基于 LoRA 和 P-Tuning v2 的 ChatGLM-6B 高效参数微调☆54Updated last year
- 一些 LLM 方面的从零复现笔记☆175Updated 6 months ago
- LLM for NER☆66Updated 7 months ago
- Inference code for LLaMA models☆117Updated last year