openai / evalsLinks
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
☆16,390Updated 6 months ago
Alternatives and similar repositories for evals
Users that are interested in evals are comparing it to the libraries listed below
Sorting:
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,500Updated last year
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆42,374Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,165Updated this week
- JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf☆24,182Updated 8 months ago
- A guidance language for controlling large language models.☆20,336Updated this week
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆14,829Updated 3 months ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆38,731Updated 2 weeks ago
- ☆21,571Updated 7 months ago
- Instruct-tune LLaMA on consumer hardware☆18,917Updated 10 months ago
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆17,490Updated this week
- The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.☆21,195Updated 11 months ago
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,073Updated 9 months ago
- 🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.☆34,365Updated last month
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,421Updated 2 weeks ago
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,498Updated last year
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,040Updated 11 months ago
- Structured Text Generation☆11,843Updated this week
- Large Language Model Text Generation Inference☆10,236Updated this week
- StableLM: Stability AI Language Models☆15,828Updated last year
- Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)☆25,685Updated 9 months ago
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,595Updated 9 months ago
- AI chat for any model.☆31,557Updated 10 months ago
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆22,795Updated 10 months ago
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆8,410Updated last month
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆18,774Updated last week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆41,856Updated 6 months ago
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆11,525Updated this week
- Home of StarCoder: fine-tuning & inference!☆7,422Updated last year
- An LLM playground you can run on your laptop☆6,349Updated last month
- Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …☆4,504Updated 7 months ago