rajshah4 / LLM-Evaluation
Sample notebooks and prompts for LLM evaluation
☆114Updated this week
Related projects ⓘ
Alternatives and complementary repositories for LLM-Evaluation
- An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!☆50Updated this week
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆110Updated 3 months ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆66Updated this week
- This playlab encompasses a multitude of projects crafted through the utilization of Large Language Models, showcasing the versatility and…☆76Updated last month
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆96Updated 7 months ago
- ☆49Updated last month
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆118Updated last year
- ☆191Updated 9 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆93Updated last month
- Resources relating to the DLAI event: https://www.youtube.com/watch?v=eTieetk2dSw☆181Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆100Updated 2 months ago
- ☆131Updated 4 months ago
- Mistral + Haystack: build RAG pipelines that rock 🤘☆100Updated 9 months ago
- ☆87Updated last year
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆128Updated 3 weeks ago
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆162Updated 6 months ago
- Domain Adapted Language Modeling Toolkit - E2E RAG☆311Updated last week
- This repo is the central repo for all the RAG Evaluation reference material and partner workshop☆50Updated last month
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆133Updated last month
- ☆179Updated last year
- A collection of fine-tuning notebooks!☆25Updated last year
- End-to-End LLM Guide☆97Updated 4 months ago
- wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk☆275Updated 2 weeks ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 4 months ago
- This repository will contain the presentation and python jupyter notebooks for the DataHack Summit 2024 conference talk, Improving Real-w…☆87Updated last month
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated last year
- Fine-Tuning Embedding for RAG with Synthetic Data☆469Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆97Updated 7 months ago
- ☆75Updated 5 months ago
- Fiddler Auditor is a tool to evaluate language models.☆171Updated 8 months ago