Automation Framework using LLM-as-a-judge to evaluate of Agentic AI, RAG, Text2SQL at scale; that is a good proxy for human judgement.
☆35Oct 9, 2025Updated 7 months ago
Alternatives and similar repositories for JudgeIt-LLM-as-a-Judge
Users that are interested in JudgeIt-LLM-as-a-Judge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Agentic RAG for open domain text-to-query☆16Aug 28, 2025Updated 9 months ago
- ☆13Apr 5, 2026Updated last month
- Code for Retrieval augmented text-to-SQL generation for epidemiological question answering using electronic health records☆24May 15, 2024Updated 2 years ago
- Text2SQL Engine with advanced RAG☆62May 1, 2026Updated 3 weeks ago
- Các thí nghiệm liên quan tới LLMs cho tiếng Việt (insprised by Physics of LLMs Series)☆11Oct 21, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Full-stack LangGraph real-estate agent for lead intake, property search, Google Calendar scheduling, chat, SMS, and voice workflows☆25May 21, 2026Updated last week
- [ACL 2025] Uncovering the Impact of Chain-of-Thought Reasoning for Direct Preference Optimization: Lessons from Text-to-SQL☆16Oct 9, 2025Updated 7 months ago
- End-to-end ELT pipeline for 160K+ Skytrax airline reviews: Airflow orchestration, BeautifulSoup scraping, S3 staging, Snowflake wareho…☆12Mar 16, 2026Updated 2 months ago
- ☆12Oct 6, 2024Updated last year
- Code for ACL paper "Zero-Shot Text Classification via Self-Supervised Tuning"☆28Sep 25, 2023Updated 2 years ago
- This is the code repo for the paper "RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rewards".☆24Oct 28, 2024Updated last year
- Evaluate language models using multiple choice items☆13Mar 6, 2026Updated 2 months ago
- PyTorch implementation for MRL☆23Feb 22, 2024Updated 2 years ago
- pdf to markdown with Python3☆11Oct 30, 2019Updated 6 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code and experiments for the paper "A recipe for building a compliant real estate chatbot"☆18Mar 21, 2025Updated last year
- Source code for Jordan Boyd-Graber's academic webpage.☆12Updated this week
- Stencils and guidance for creating IBM Cloud diagrams.☆20Mar 18, 2025Updated last year
- Ensemble topic modeling with matrix factorization☆24May 10, 2018Updated 8 years ago
- Open Source Tool To Preemptively Test Ad Creatives Against Synthetic Target Audiences☆15Jan 3, 2025Updated last year
- ☆14Apr 16, 2024Updated 2 years ago
- Binding Affinity Prediction using Deep learning models☆12Jun 9, 2021Updated 4 years ago
- Deep Research through Multi-Agents, using GraphRAG☆87Aug 21, 2025Updated 9 months ago
- Implementation of the winning solution for the Media Analytics Challenge 2023.☆25Jan 31, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- PyLate efficient inference engine☆84Jan 7, 2026Updated 4 months ago
- Granite Kitchen -- "appliances" for use by the Granite Cookbooks such as inference platforms☆29May 21, 2026Updated last week
- [ACL 2026] R-Search: Empowering LLM Reasoning with Search via Multi-Reward Reinforcement Learning☆31Jan 4, 2026Updated 4 months ago
- A minimal event loop implementation☆13Nov 27, 2023Updated 2 years ago
- Precision Knowledge Editing (PKE): A novel method to reduce toxicity in LLMs while preserving performance, with robust evaluations and ha…☆11Nov 26, 2024Updated last year
- ADENINE: A Data ExploratioN PipelINE☆15Jul 30, 2018Updated 7 years ago
- Learning Protein-Ligand Properties with Atomic Environment Vectors☆10Apr 19, 2024Updated 2 years ago
- ☆11Oct 3, 2021Updated 4 years ago
- Implementation of AdaCQR(COLING 2025)☆15Dec 30, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Example of Langchain-Elasticsearch integrations & RAG.☆12Sep 20, 2024Updated last year
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- Build RAG for free with local LLMs using Ollama☆13Apr 22, 2024Updated 2 years ago
- Water Network-Augmented Two-State model for Protein−Ligand Binding Affinity Prediction☆12Jun 10, 2023Updated 2 years ago
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆11Jan 9, 2024Updated 2 years ago
- Exploring advanced prompting tools to query SQL database with multiple tables in natural language using LLMs☆16Aug 23, 2024Updated last year
- EPOCH Input System Version 2☆10Jun 5, 2020Updated 5 years ago