philschmid / evaluate-llmsLinks
Includes examples on how to evaluate LLMs
☆23Updated 9 months ago
Alternatives and similar repositories for evaluate-llms
Users that are interested in evaluate-llms are comparing it to the libraries listed below
Sorting:
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 2 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…☆83Updated last year
- Mistral + Haystack: build RAG pipelines that rock 🤘☆105Updated last year
- Sample notebooks and prompts for LLM evaluation☆138Updated last month
- An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!☆78Updated this week
- ☆15Updated last year
- ☆79Updated last year
- ☆145Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 10 months ago
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆113Updated last year
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆173Updated 10 months ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆111Updated 4 months ago
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆113Updated last week
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆130Updated this week
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆120Updated last week
- Data extraction with LLM on CPU☆113Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated 10 months ago
- Examples of using Evidently to evaluate, test and monitor ML models.☆35Updated this week
- This repository will contain the presentation and python jupyter notebooks for the DataHack Summit 2024 conference talk, Improving Real-w…☆118Updated 10 months ago
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆168Updated last year
- GenAI Experimentation☆57Updated 3 weeks ago
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆313Updated 3 weeks ago
- Material for the series of seminars on Large Language Models☆34Updated last year
- Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.☆48Updated last year
- Learn to build and customize multi-agent systems using the AutoGen. The course teaches you to implement complex AI applications through a…☆96Updated last year
- ☆20Updated last year
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆11Updated last year
- Optimized Large Language Models for Financial Applications – Efficient, Scalable, and Domain-Specific AI for Finance.☆50Updated last month
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆102Updated last year