Alternatives and similar repositories for benchmark_agents

Users that are interested in benchmark_agents are comparing it to the libraries listed below

• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆103Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆76Updated 6 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆61Updated last year
• azharlabs / large-models
  ☆16Updated last year
• githubpradeep / notebooks
  ☆52Updated 3 months ago
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆84Updated last year
• ibm-self-serve-assets / SuperKnowa
  Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…
  ☆109Updated 9 months ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• Pleias / RL-Reasoning
  Collection of resources for RL and Reasoning
  ☆25Updated 3 months ago
• explodinggradients / nemesis
  Reward Model framework for LLM RLHF
  ☆61Updated last year
• Zefty / rag-end2end-retriever
  ☆20Updated 3 years ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated last year
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆167Updated last year
• arcee-ai / DAM
  ☆48Updated 6 months ago
• Tebmer / Rereading-LLM-Reasoning
  EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…
  ☆25Updated 5 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 11 months ago
• boschresearch / switchprompt
  Resources related to EACL 2023 paper "SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domain…
  ☆52Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 6 months ago
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆23Updated last month
• pacman100 / peft-codegen-25
  ☆24Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 7 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆75Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆162Updated last year
• CVxTz / llm-serve-tutorial
  ☆20Updated last year
• geronimi73 / 3090_shorts
  minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆38Updated last month
• marklysze / LangChain-RAG-Linux
  Examples of RAG using LangChain with local LLMs - Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆38Updated last year
• jjovalle99 / raft-well-architected
  ☆20Updated last year