Alternatives and similar repositories for llm-autoeval:

Users that are interested in llm-autoeval are comparing it to the libraries listed below

• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆873Updated last month
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆261Updated 3 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆270Updated 7 months ago
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆442Updated 5 months ago
• BatsResearch / bonito
  A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.
  ☆739Updated last week
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆567Updated 5 months ago
• huggingface / cosmopedia
  ☆496Updated 3 months ago
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆495Updated last year
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆496Updated last month
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆262Updated 2 weeks ago
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆222Updated this week
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆687Updated 10 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆437Updated 8 months ago
• apoorvumang / prompt-lookup-decoding
  ☆502Updated 5 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,160Updated this week
• NousResearch / Hermes-Function-Calling
  ☆806Updated 5 months ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆713Updated 6 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆296Updated last year
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆640Updated 8 months ago
• potsawee / selfcheckgpt
  SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
  ☆492Updated 7 months ago
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆406Updated last year
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆313Updated 3 months ago
• allenai / lumos
  Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"
  ☆462Updated 11 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆203Updated 3 months ago
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆476Updated last year
• jondurbin / bagel
  A bagel, with everything.
  ☆316Updated 10 months ago
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆295Updated this week
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆233Updated 8 months ago
• EQ-bench / EQ-Bench
  A benchmark for emotional intelligence in large language models
  ☆223Updated 6 months ago
• mistralai-sf24 / hackathon
  ☆446Updated 10 months ago