Alternatives and similar repositories for evaluating-large-language-models-using-llm-as-a-judge:

Users that are interested in evaluating-large-language-models-using-llm-as-a-judge are comparing it to the libraries listed below

• lancedb / ragged
  ☆18Updated 3 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆23Updated 2 months ago
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated last year
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆10Updated 3 months ago
• logikon-ai / cot-eval
  A framework for evaluating the effectiveness of chain-of-thought reasoning in language models.
  ☆12Updated 3 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆26Updated last year
• siftly-ai / airdot-deployer
  Tool to take your ML model from local to production with one-line of code.
  ☆25Updated 11 months ago
• Zipstack / unstract-adapters
  Unstract's interface to LLMs, Embeddings and VectorDBs.
  ☆18Updated 5 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆29Updated 3 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆28Updated 2 weeks ago
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated last year
• aniket-work / AI_Powered_Dev_Search_Engine
  AI_Powered_Dev_Search_Engine
  ☆12Updated 10 months ago
• ashvardanian / usearch-binary
  Binary vector search example using Unum's USearch engine and pre-computed Wikipedia embeddings from Co:here and MixedBread
  ☆18Updated 9 months ago
• xamat / Xavibot
  Fullstack chatbot application
  ☆11Updated 5 months ago
• nlp-uoregon / ullme
  ☆19Updated 2 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆16Updated last month
• g-aggarwal / mlx-hub
  A python command-line tool to download & manage MLX AI models from Hugging Face.
  ☆16Updated 4 months ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• likenneth / persona_drift
  Measuring and Controlling Persona Drift in Language Model Dialogs
  ☆15Updated 10 months ago
• All-Hands-AI / openhands-aci
  Agent computer interface for AI software engineer.
  ☆22Updated this week
• stanfordnlp / multi-distribution-retrieval
  Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval
  ☆14Updated last year
• replicate / cog-vllm
  Run LLMs on Replicate with vLLM
  ☆15Updated 3 months ago
• miralab-ai / autoreason
  ☆39Updated last month
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆46Updated 9 months ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆34Updated last year
• saifulhaq95 / DSPy-Indic
  This repository implements DSPy programs to tasks in Indian Languages
  ☆11Updated last year
• google / rag-playground
  ☆17Updated 3 weeks ago
• v-prgmr / mergekit
  Tools for merging pretrained large language models.
  ☆19Updated 7 months ago
• minimaxir / langchain-problems
  Demos of some issues with LangChain.
  ☆31Updated last year
• amzn / extremely-efficient-query-encoder
  efficient query encoding for dense retrieval
  ☆11Updated 5 months ago