Alternatives and similar repositories for evalscope:

Users that are interested in evalscope are comparing it to the libraries listed below

• vllm-project / vllm-ascend
  Community maintained hardware plugin for vLLM on Ascend
  ☆569Updated this week
• modelscope / modelscope-classroom
  ☆884Updated last month
• owenliang / qwen-vllm
  通义千问VLLM推理部署DEMO
  ☆571Updated last year
• zhanshijinwat / Steel-LLM
  Train a 1B LLM with 1T tokens from scratch by personal
  ☆627Updated last week
• NovaSearch-Team / RAG-Retrieval
  Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.
  ☆831Updated this week
• chaoswork / sft_datasets
  开源SFT数据集整理,随时补充
  ☆509Updated last year
• FlagOpen / FlagData
  ☆323Updated 10 months ago
• hiyouga / EasyR1
  EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
  ☆2,258Updated this week
• THUDM / AlignBench
  大模型多维度中文对齐评测基准 (ACL 2024)
  ☆382Updated 8 months ago
• alibaba / Pai-Megatron-Patch
  The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
  ☆1,033Updated this week
• netease-youdao / BCEmbedding
  Netease Youdao's open-source embedding and reranker models for RAG products.
  ☆1,722Updated 3 months ago
• BUAADreamer / EasyRAG
  Easy-to-Use RAG Framework; CCF AIOps International Challenge 2024 Top3 Solution; CCF AIOps 国际挑战赛 2024 季军方案
  ☆428Updated 5 months ago
• SpursGoZmy / Tabular-LLM
  本项目旨在收集开源的表格智能任务数据集（比如表格问答、表格-文本生成等），将原始数据整理为指令微调格式的数据并微调LLM，进而增强LLM对于表格数据的理解，最终构建出专门面向表格智能任务的大型语言模型。
  ☆568Updated last year
• dhcode-cpp / X-R1
  minimal-cost for training 0.5B R1-Zero
  ☆714Updated last week
• charent / Phi2-mini-Chinese
  Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.
  ☆550Updated 9 months ago
• qiufengqijun / mini_qwen
  这是一个从头训练大语言模型的项目，包括预训练、微调和直接偏好优化，模型拥有1B参数，支持中英文。
  ☆379Updated 2 months ago
• IAAR-Shanghai / CRUD_RAG
  CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models
  ☆302Updated 6 months ago
• jiahe7ay / MINI_LLM
  This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.
  ☆426Updated this week
• wangyuxinwhy / uniem
  unified embedding model
  ☆854Updated last year
• haonan-li / CMMLU
  CMMLU: Measuring massive multitask language understanding in Chinese
  ☆755Updated 5 months ago
• inclusionAI / AReaL
  Distributed RL System for LLM Reasoning
  ☆1,205Updated last week
• Qihoo360 / Light-R1
  ☆679Updated 3 weeks ago
• flageval-baai / FlagEval
  FlagEval is an evaluation toolkit for AI large foundation models.
  ☆335Updated last week
• onejune2018 / Awesome-LLM-Eval
  Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs…
  ☆522Updated 6 months ago
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,110Updated this week
• THUDM / LongBench
  LongBench v2 and LongBench (ACL 2024)
  ☆861Updated 3 months ago
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆715Updated 3 months ago
• multimodal-art-projection / MAP-NEO
  ☆937Updated 2 months ago
• percent4 / embedding_rerank_retrieval
  本项目是针对RAG中的Retrieve阶段的召回技术及算法效果所做评估实验。使用主体框架为LlamaIndex.
  ☆247Updated 4 months ago
• naginoa / LLMs_interview_notes
  LLMs interview notes and answers:该仓库主要记录大模型（LLMs）算法工程师相关的面试题和参考答案
  ☆526Updated last year