Alternatives and similar repositories for lou-eval:

Users that are interested in lou-eval are comparing it to the libraries listed below

• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 6 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆100Updated 2 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆100Updated 10 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆36Updated 6 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated 11 months ago
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆88Updated 11 months ago
• arcee-ai / DAM
  ☆48Updated 3 months ago
• aymeric-roucher / LongContext_vs_RAG_NeedleInAHaystack
  Comparing retrieval abilities from GPT4-Turbo and a RAG system on a toy example for various context lengths
  ☆35Updated last year
• shoggoth13 / agents-deconstructed
  ☆57Updated last year
• DataCTE / Camel-Coder
  Camel-Coder: Collaborative task completion with multiple agents. Role-based prompts, intervention mechanism, and thoughtful suggestions
  ☆33Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆89Updated 3 weeks ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 7 months ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆48Updated 2 weeks ago
• CarperAI / treasure_trove
  ☆22Updated last year
• OpenAgentLLM / OpenAgent
  🔓 The open-source autonomous agent LLM initiative 🔓
  ☆91Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆101Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• geronimi73 / phi2-finetune
  ☆87Updated last year
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆54Updated last year
• Tebmer / Rereading-LLM-Reasoning
  EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…
  ☆24Updated 2 months ago
• BerriAI / bettertest
  ☆75Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• jamesmurdza / agenteval
  Automated testing and benchmarking for code generation agents.
  ☆18Updated last year
• EdwardDali / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 3 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆82Updated 4 months ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year