aws-samples / evaluating-large-language-models-using-llm-as-a-judge

Related projects ⓘ

Alternatives and complementary repositories for evaluating-large-language-models-using-llm-as-a-judge

• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆23Updated last week
• cyzus / thoughtsculpt
  ☆11Updated 3 weeks ago
• philschmid / text-generation-inference-tests
  ☆20Updated 10 months ago
• siftly-ai / airdot-deployer
  Tool to take your ML model from local to production with one-line of code.
  ☆23Updated 9 months ago
• aniket-work / AI_Powered_Dev_Search_Engine
  AI_Powered_Dev_Search_Engine
  ☆12Updated 8 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆28Updated last month
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆16Updated 4 months ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆15Updated last month
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆49Updated last week
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆25Updated last year
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated 5 months ago
• withmartian / leaderboard-backend
  Open sourced backend for Martian's LLM Inference Provider Leaderboard
  ☆17Updated 3 months ago
• arcee-ai / DAM
  ☆40Updated last week
• codestoryai / swe_bench_traces
  Contains the model patches and the eval logs from the passing swe-bench-lite run.
  ☆10Updated 4 months ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆41Updated last month
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆40Updated 8 months ago
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆36Updated 7 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• gangiswag / infogent
  ☆12Updated last week
• huggingface / roots-search-tool
  Scripts supporting the development and serving the Roots Search Tool - https://hf.co/spaces/bigscience-data/roots-search
  ☆10Updated last year
• Watchfulio / dataset-generator
  A new way to generate large quantities of high quality synthetic data (on par with GPT-4), with better controllability, at a fraction of …
  ☆21Updated last month
• lancedb / ragged
  ☆15Updated 3 weeks ago
• awslabs / extending-the-context-length-of-open-source-llms
  ☆48Updated last week
• aniketmaurya / agents
  Build Agentic workflows with function calling
  ☆20Updated last week
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• hwchase17 / chain-of-verification
  ☆30Updated last year
• v-prgmr / mergekit
  Tools for merging pretrained large language models.
  ☆19Updated 5 months ago
• xamat / Xavibot
  Fullstack chatbot application
  ☆11Updated 3 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 4 months ago
• capjamesg / sam-clip
  Use Grounding DINO, Segment Anything, and CLIP to label objects in images.
  ☆23Updated 10 months ago