Alternatives and similar repositories for evals

Users that are interested in evals are comparing it to the libraries listed below

• openai / chatgpt-retrieval-plugin
  The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.
  ☆21,193Updated last year
• yoheinakajima / babyagi
  ☆21,622Updated 8 months ago
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆38,825Updated last month
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆42,937Updated this week
• tatsu-lab / stanford_alpaca
  Code and documentation to train Stanford's Alpaca models, and generate the data.
  ☆30,065Updated 11 months ago
• guidance-ai / guidance
  A guidance language for controlling large language models.
  ☆20,425Updated last week
• openai / tiktoken
  tiktoken is a fast BPE tokeniser for use with OpenAI's models.
  ☆15,055Updated 3 months ago
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,921Updated 11 months ago
• chroma-core / chroma
  the AI-native open-source embedding database
  ☆20,896Updated this week
• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,505Updated last year
• microsoft / JARVIS
  JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
  ☆24,223Updated 9 months ago
• hwchase17 / langchain-hub
  ☆3,346Updated last year
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,618Updated 9 months ago
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,311Updated this week
• NVIDIA / NeMo-Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆4,872Updated this week
• kyegomez / tree-of-thoughts
  Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …
  ☆4,512Updated 8 months ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,428Updated last month
• bigcode-project / starcoder
  Home of StarCoder: fine-tuning & inference!
  ☆7,426Updated last year
• togethercomputer / RedPajama-Data
  The RedPajama-Data repository contains code for preparing large datasets for training large language models.
  ☆4,765Updated 7 months ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,532Updated last year
• togethercomputer / OpenChatKit
  ☆9,010Updated last year
• mayooear / ai-pdf-chatbot-langchain
  AI PDF chatbot agent built with LangChain & LangGraph
  ☆15,661Updated 4 months ago
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,071Updated last week
• lucidrains / PaLM-rlhf-pytorch
  Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
  ☆7,855Updated 2 months ago
• Stability-AI / StableLM
  StableLM: Stability AI Language Models
  ☆15,824Updated last year
• hwchase17 / notion-qa
  ☆2,156Updated 10 months ago
• promptslab / Promptify
  Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…
  ☆3,960Updated 4 months ago
• langchain-ai / chat-langchain
  ☆5,973Updated 2 weeks ago
• gkamradt / langchain-tutorials
  Overview and tutorial of the LangChain Library
  ☆7,144Updated 11 months ago
• run-llama / llama-hub
  A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
  ☆3,475Updated last year