Alternatives and similar repositories for evalverse

Users that are interested in evalverse are comparing it to the libraries listed below

• UpstageAI / dataverse
  The Universe of Data. All about data, data science, and data engineering
  ☆550Updated 9 months ago
• lcw99 / evolve-instruct
  evolve llm training instruction, from english instruction to any language.
  ☆117Updated last year
• davidkim205 / kollm_evaluation
  자체 구축한 한국어 평가 데이터셋을 이용한 한국어 모델 평가
  ☆31Updated 11 months ago
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆61Updated last year
• Marker-Inc-Korea / KO-Platypus
  [KO-Platy🥮] Korean-Open-platypus를 활용하여 llama-2-ko를 fine-tuning한 KO-platypus model
  ☆75Updated last year
• daje0601 / CoT-Reasoning_without_Prompting
  구글에서 발표한 Chain-of-Thought Reasoning without Prompting을 코드로 구현한 레포입니다.
  ☆65Updated 7 months ago
• Beomi / ko-lm-evaluation-harness
  Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc
  ☆76Updated last year
• Marker-Inc-Korea / KoLLM_Eval
  한국어 벤치마크 평가 코드 통합본(?)
  ☆17Updated 6 months ago
• LG-AI-EXAONE / KoMT-Bench
  Official repository for KoMT-Bench built by LG AI Research
  ☆62Updated 9 months ago
• J-Seo / KoCommonGEN-V2
  KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models
  ☆25Updated 8 months ago
• EleutherAI / dps
  Data processing system for polyglot
  ☆91Updated last year
• DopeorNope-Lee / Ko-Fine-tuning_DataGen
  ☆68Updated last year
• chanmuzi / NLP-Paper-News
  The list of NLP paper and news I've checked. There might be short description of them (abstract) in Korean.
  ☆24Updated this week
• HAE-RAE / haerae-evaluation-toolkit
  The most modern LLM evaluation toolkit
  ☆57Updated 2 weeks ago
• workdd / LLM_Foreign_Block
  LLM 모델의 외국어 토큰 생성을 막는 코드 구현
  ☆72Updated last month
• wandb / llm-kr-eval
  ☆19Updated 9 months ago
• Marker-Inc-Korea / AutoRAG-example-korean-embedding-benchmark
  AutoRAG example about benchmarking Korean embeddings.
  ☆38Updated 7 months ago
• kakao / FunctionChat-Bench
  ☆91Updated 5 months ago
• instructkr / LogicKor
  한국어 언어모델 다분야 사고력 벤치마크
  ☆189Updated 7 months ago
• metterian / korean_bert_score
  BERT score for text generation
  ☆11Updated 4 months ago
• Marker-Inc-Korea / K-G-OAT
  IA3방식으로 KoAlpaca를 fine tuning한 한국어 LLM모델
  ☆68Updated last year
• Beomi / Gemma-EasyLM
  Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)
  ☆47Updated last year
• instructkr / reranker-simple-benchmark
  Make running benchmark simple yet maintainable, again. Now only supports Korean-based cross-encoder.
  ☆18Updated 3 weeks ago
• teamreboott / data-modori
  ☆41Updated last year
• nlpai-lab / KURE
  KURE: 고려대학교에서 개발한, 한국어 검색에 특화된 임베딩 모델
  ☆161Updated 2 months ago
• ssisOneTeam / Korean-Embedding-Model-Performance-Benchmark-for-Retriever
  Korean Sentence Embedding Model Performance Benchmark for RAG
  ☆48Updated 3 months ago
• daekeun-ml / evaluate-llm-on-korean-dataset
  Performs benchmarking on two Korean datasets with minimal time and effort.
  ☆40Updated last month
• gyunggyung / MLLMArxivTalk
  [Google Meet] MLLM Arxiv Casual Talk
  ☆52Updated 2 years ago
• Marker-Inc-Korea / RAGchain
  Extension of Langchain for RAG. Easy benchmarking, multiple retrievals, reranker, time-aware RAG, and so on...
  ☆282Updated last year
• prometheus-eval / prometheus
  [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…
  ☆302Updated last year