Alternatives and similar repositories for llm-autoeval

Users that are interested in llm-autoeval are comparing it to the libraries listed below

• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆952Updated last month
• huggingface / cosmopedia
  ☆520Updated 7 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆276Updated 11 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆282Updated 7 months ago
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆482Updated 9 months ago
• stanfordnlp / pyreft
  Stanford NLP Python library for Representation Finetuning (ReFT)
  ☆1,490Updated 4 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆329Updated this week
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆698Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆455Updated last year
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆322Updated 7 months ago
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆553Updated last year
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆303Updated last year
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,629Updated this week
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆187Updated last year
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆426Updated last year
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆239Updated last year
• BatsResearch / bonito
  A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.
  ☆778Updated 3 months ago
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆500Updated last year
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆429Updated 2 weeks ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,757Updated last week
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year
• mistralai-sf24 / hackathon
  ☆447Updated last year
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆602Updated last month
• jondurbin / bagel
  A bagel, with everything.
  ☆321Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆714Updated last year
• jquesnelle / yarn
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,497Updated last year
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆492Updated last month
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆306Updated 2 months ago
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆609Updated 2 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆259Updated 6 months ago