Azure99 / BlossomData
A fluent, scalable, and easy-to-use LLM data processing framework.
☆17Updated last week
Alternatives and similar repositories for BlossomData:
Users that are interested in BlossomData are comparing it to the libraries listed below
- SUS-Chat: Instruction tuning done right☆48Updated last year
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated last year
- Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …☆18Updated last year
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆41Updated last year
- Imitate OpenAI with Local Models☆88Updated 7 months ago
- Generate multi-round conversation roleplay data based on self-instruct and evol-instruct.☆125Updated 3 months ago
- 文本去重☆70Updated 10 months ago
- ☆36Updated 7 months ago
- ☆46Updated 10 months ago
- 本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作☆61Updated 6 months ago
- 使用langchain进行任务规划，构建子任务的会话场景资源，通过MCTS任务执行器，来让每个子任务通过在上下文中资源，通过自身反思探索来获取自身对问题的最优答案；这种方式依赖模型的对齐偏好，我们在每种偏好上设计了一个工程框架，来完成自我对不同答案的奖励进行采样策略☆29Updated last week
- Just for debug☆56Updated last year
- Light local website for displaying performances from different chat models.☆86Updated last year
- the newest version of llama3，source code explained line by line using Chinese☆22Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆134Updated 4 months ago
- XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.☆139Updated last year
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆56Updated last year
- ☆38Updated 11 months ago
- ☆143Updated 9 months ago
- ☆168Updated last year
- LongQLoRA: Extent Context Length of LLMs Efficiently☆164Updated last year
- ☆16Updated 9 months ago
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆78Updated 5 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆131Updated 9 months ago
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆65Updated 2 years ago
- （撰写ing..)本仓库偏教程性质，以「模型中文化」为一个典型的模型训练问题切入场景，指导读者上手学习LLM二次微调训练。☆33Updated 8 months ago
- Reformatted Alignment☆115Updated 6 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆131Updated 10 months ago
- FuseAI Project☆85Updated 2 months ago
- This repository provides an implementation of the paper "A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Co…☆67Updated last month