Alternatives and similar repositories for llm-eval-sweep

Users that are interested in llm-eval-sweep are comparing it to the libraries listed below

• amsterdata / ragbooster
  ☆30Updated last year
• castorini / ragnarok
  Retrieval-Augmented Generation battle!
  ☆50Updated 5 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆58Updated last year
• kmswin1 / Syntriever
  "Syntriever: How to Train Your Retriever with Synthetic Data from LLMs" the Nations of the Americas Chapter of the Association for Comput…
  ☆25Updated 2 months ago
• LeonEricsson / llmjudge
  Exploring limitations of LLM-as-a-judge
  ☆16Updated 9 months ago
• alexa / places
  This is the code for our paper: PLACES: Prompting Language Models for Social Conversation Synthesis
  ☆11Updated 2 years ago
• psunlpgroup / GreaterPrompt
  GreaterPrompt: A Python Toolkit for Prompt Optimization
  ☆17Updated last month
• unicamp-dl / ExaRanker
  ☆29Updated last year
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆76Updated 6 months ago
• nlp-uoregon / ullme
  ☆19Updated last month
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 3 months ago
• allenai / CommaQA
  Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents
  ☆24Updated 2 years ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆48Updated last week
• h2oai / h2o-LLM-eval
  Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
  ☆52Updated 6 months ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆27Updated 2 weeks ago
• RUCAIBox / ChainLM
  ☆28Updated last year
• Zefty / rag-end2end-retriever
  ☆20Updated 3 years ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆45Updated 7 months ago
• awslabs / rag-qa-arena
  ☆45Updated 9 months ago
• oceanumeric / EnteRAG
  A RAG that can scale 🧑🏻‍💻
  ☆11Updated 11 months ago
• gauss5930 / iDUS
  An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.
  ☆12Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 7 months ago
• thakur-nandan / income
  INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.
  ☆24Updated last year
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆46Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆50Updated last month
• awslabs / robustqa-acl23
  ☆18Updated last year
• gersteinlab / Struc-Bench
  ☆52Updated 10 months ago
• LLM360 / Analysis360
  Open Implementations of LLM Analyses
  ☆103Updated 7 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆76Updated 6 months ago
• ielab / llm-qlm
  Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Ranking
  ☆17Updated last year