Alternatives and similar repositories for lou-eval

Users that are interested in lou-eval are comparing it to the libraries listed below

• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆112Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆70Updated 2 years ago
• geronimi73 / phi2-finetune
  ☆86Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆84Updated 2 years ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆107Updated 4 months ago
• arcee-ai / DAM
  ☆55Updated last year
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated 2 years ago
• aymeric-roucher / LongContext_vs_RAG_NeedleInAHaystack
  Comparing retrieval abilities from GPT4-Turbo and a RAG system on a toy example for various context lengths
  ☆35Updated 2 years ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 3 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 11 months ago
• CarperAI / treasure_trove
  ☆22Updated 2 years ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆82Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆93Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated 2 years ago
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 9 months ago
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆55Updated 2 years ago
• rosewang2008 / backtracing
  Backtracing: Retrieving the Cause of the Query, EACL 2024 Long Paper, Findings.
  ☆92Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆46Updated last year
• NousResearch / StripedHyenaTrainer
  ☆62Updated 2 years ago
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆82Updated last year
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆69Updated last year
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆43Updated 2 years ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• allenai / clin
  ☆87Updated 2 years ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated 2 years ago
• catid / lllm
  Latent Large Language Models
  ☆19Updated last year