beichao1314 / Open-Llama
The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
☆62Updated last year
Related projects ⓘ
Alternatives and complementary repositories for Open-Llama
- 百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本☆46Updated last year
- Summarize all open source Large Languages Models and low-cost replication methods for Chatgpt.☆135Updated last year
- NTK scaled version of ALiBi position encoding in Transformer.☆67Updated last year
- 文本去重☆67Updated 6 months ago
- code for Scaling Laws of RoPE-based Extrapolation☆70Updated last year
- ☆125Updated last year
- ☆173Updated last year
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆38Updated 8 months ago
- 中文 Instruction tuning datasets☆118Updated 7 months ago
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆67Updated last week
- ☆62Updated last year
- make LLM easier to use☆58Updated last year
- 怎么训练一个LLM分词器☆130Updated last year
- ☆120Updated 7 months ago
- MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING☆87Updated 8 months ago
- moss chat finetuning☆50Updated 7 months ago
- ☆82Updated last year
- ☆40Updated 5 months ago
- deep learning☆149Updated 5 months ago
- ☆93Updated 8 months ago
- ☆129Updated 4 months ago
- 中文大语言模型评测第二期☆70Updated last year
- 本项目旨在对大量文本文件进行快速编码检测和转换以辅助mnbvc语料集项目的数据清洗工作☆56Updated last month
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆19Updated last year
- 大语言模型指令调优工具（支持 FlashAttention）☆166Updated 10 months ago
- [EMNLP 2023 Demo] CLEVA: Chinese Language Models EVAluation Platform☆57Updated 11 months ago
- ☆157Updated last year
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆52Updated 7 months ago
- Source code for ACL 2023 paper Decoder Tuning: Efficient Language Understanding as Decoding☆48Updated last year