owenliang / bpe-tokenizerLinks
LLM Tokenizer with BPE algorithm
☆31Updated last year
Alternatives and similar repositories for bpe-tokenizer
Users that are interested in bpe-tokenizer are comparing it to the libraries listed below
Sorting:
- 通义千问的DPO训练☆48Updated 8 months ago
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆59Updated 8 months ago
- ☆76Updated 8 months ago
- DeepSpeed Tutorial☆97Updated 9 months ago
- ☆110Updated 11 months ago
- simple decoder-only GTP model in pytorch☆41Updated last year
- ☆43Updated 9 months ago
- ☆41Updated 2 months ago
- ☆69Updated last year
- 一些大语言模型和多模态模型的应用,主要包括小模型,Agent,跨模态搜索,OCR、RAG、ChatBot等等☆171Updated 2 weeks ago
- Build a simple basic multimodal large model from scratch. 从零搭建一个简单的基础多模态大模型🤖☆39Updated 11 months ago
- This is a detailed code demo on how to conduct Full-Param Supervised Fine-tuning (SFT) and DPO (Direct Preference Optimization)☆14Updated 4 months ago
- Inference code for LLaMA models☆121Updated last year
- ☆71Updated last week
- from MHA, MQA, GQA to MLA by 苏剑林, with code☆19Updated 3 months ago
- 基于DPO算法微调语言大模型,简单好上手。☆39Updated 11 months ago
- LLM+RAG for QA☆22Updated last year
- In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or…☆58Updated this week
- 基于大语言模型的检索增强生成RAG示例☆149Updated 3 weeks ago
- A simple deep learning framework inspired by Dezero and PyTorch☆29Updated 4 months ago
- Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理☆61Updated last year
- 该仓库主要记录 大模型(LLMs) 算法工程师相关的面试题与我写的答案☆23Updated last year
- LLM101n: Let's build a Storyteller 中文版☆131Updated 9 months ago
- ThinkLLM:🚀 轻量、高效的大语言模型算法实现☆65Updated 2 weeks ago
- 这是个人关于llm的学习归纳,把我学到的知识分享给大家,让大家也能系统和简单学习llm理论及应用实战☆8Updated 11 months ago
- 天池算法比赛《BetterMixture - 大模型数据混合挑战赛》的第一名top1解决方案☆31Updated 10 months ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆123Updated 6 months ago
- 使用单个24G显卡,从0开始训练LLM☆54Updated last week
- A simple, easy-to-hack GraphRAG implementation☆13Updated 8 months ago
- ☆83Updated last month