anyscale / factuality-eval
Library for iPython notebooks for evaluating factuality.
☆50Updated last year
Alternatives and similar repositories for factuality-eval:
Users that are interested in factuality-eval are comparing it to the libraries listed below
- Leverage your LangChain trace data for fine tuning☆41Updated 8 months ago
- ☆78Updated 10 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated last year
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆30Updated 8 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- ☆77Updated 10 months ago
- ☆78Updated 2 years ago
- ☆88Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆37Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆35Updated last year
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆100Updated last year
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆102Updated 3 weeks ago
- ☆47Updated last year
- ☆53Updated 4 months ago
- Sample notebooks and prompts for LLM evaluation☆124Updated this week
- Writing Blog Posts with Generative Feedback Loops!☆47Updated last year
- Research notes and extra resources for all the work at explodinggradients.com☆23Updated last month
- Framework for building and maintaining self-updating prompts for LLMs☆61Updated 10 months ago
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆108Updated last week
- Notebooks for training universal 0-shot classifiers on many different tasks☆124Updated 3 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 9 months ago
- 📚 Datasets and models for instruction-tuning☆238Updated last year
- ☆24Updated last year
- This is the repo for the container that holds the models for the text2vec-transformers module☆51Updated 3 weeks ago
- Web UI & Backend for Data Annotations in Aya☆27Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆107Updated 7 months ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆114Updated last week
- Retrieval Augmented Generation applications☆26Updated last year
- Pinecone text client library☆61Updated last month
- A framework for simulating e-commerce data and interactions that can be used to build recommendation systems☆10Updated last year