modelscope / evalscope
A streamlined and customizable framework for efficient large model evaluation and performance benchmarking
☆647Updated this week
Alternatives and similar repositories for evalscope:
Users that are interested in evalscope are comparing it to the libraries listed below
- 通义千问VLLM推理部署DEMO☆550Updated 11 months ago
- Train a 1B LLM with 1T tokens from scratch by personal☆583Updated 2 weeks ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆410Updated 11 months ago
- Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.☆753Updated last week
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆946Updated this week
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2 中文小模型,支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆537Updated 8 months ago
- 开源SFT数据集整理,随时补充☆500Updated last year
- 大模型多维度中文对齐评测基准 (ACL 2024)☆367Updated 7 months ago
- ☆806Updated this week
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆302Updated 8 months ago
- ☆312Updated 9 months ago
- Easy-to-Use RAG Framework; CCF AIOps International Challenge 2024 Top3 Solution; CCF AIOps 国际挑战赛 2024 季军方案☆374Updated 4 months ago
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆618Updated last week
- ☆930Updated last month
- GAOKAO-Bench is an evaluation framework that utilizes GAOKAO questions as a dataset to evaluate large language models.☆619Updated 2 months ago
- LLM Inference benchmark☆404Updated 8 months ago
- Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs…☆503Updated 4 months ago
- CMMLU: Measuring massive multitask language understanding in Chinese☆748Updated 3 months ago
- 本项目是针对RAG中的Retrieve阶段的召回技术及算法效果所做评估实验。使用主体框架为LlamaIndex.☆229Updated 3 months ago
- 从0开始,将chatgpt的技术路线跑一遍。☆225Updated 6 months ago
- Awesome-RAG: Collect typical RAG papers and systems.☆335Updated 2 months ago
- TinyRAG☆279Updated 4 months ago
- 中文Mixtral-8x7B(Chinese-Mixtral-8x7B)☆648Updated 7 months ago
- A flexible and efficient training framework for large-scale alignment tasks☆333Updated last month
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆187Updated 10 months ago