Alternatives and similar repositories for eval-analysis-public:

Users that are interested in eval-analysis-public are comparing it to the libraries listed below

• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated last month
• benediktstroebl / agent-evals
  ☆15Updated 6 months ago
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆56Updated last week
• arcee-ai / DAM
  ☆48Updated 4 months ago
• ibm-granite / granite-guardian
  The Granite Guardian models are designed to detect risks in prompts and responses.
  ☆72Updated last week
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 7 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆63Updated 3 months ago
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆25Updated 9 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆27Updated 4 months ago
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 4 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated last month
• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆19Updated 3 weeks ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 6 months ago
• sujitpal / llm-rag-eval
  Large Language Model (LLM) powered evaluator for Retrieval Augmented Generation (RAG) pipelines.
  ☆25Updated 11 months ago
• hamelsmu / replicate-examples
  ☆22Updated 11 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• pacman100 / peft-codegen-25
  ☆24Updated last year
• axolotl-ai-cloud / axolotl-cookbook
  ☆26Updated 3 weeks ago
• thomasnormal / fewshot
  ☆28Updated 6 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated 8 months ago
• lancedb / ragged
  ☆19Updated 5 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆87Updated 2 months ago
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated last month
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 4 months ago
• google-deepmind / mishax
  ☆124Updated last week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆81Updated 3 weeks ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆38Updated last month
• pgasawa / BARE
  Combining Base and Instruction-Tuned Language Models for Better Synthetic Data Generation
  ☆26Updated last month
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆15Updated this week