Alternatives and similar repositories for llm-autoeval:

Users that are interested in llm-autoeval are comparing it to the libraries listed below

• huggingface / cosmopedia
  ☆515Updated 5 months ago
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆930Updated last week
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆472Updated 8 months ago
• mistralai-sf24 / hackathon
  ☆444Updated last year
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆273Updated 9 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆278Updated 6 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆320Updated last year
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆586Updated this week
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,482Updated this week
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆528Updated last year
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆437Updated 7 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆237Updated 11 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆276Updated 2 months ago
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆304Updated last month
• xfactlab / orpo
  Official repository for ORPO
  ☆450Updated 11 months ago
• apoorvumang / prompt-lookup-decoding
  ☆529Updated 8 months ago
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆498Updated last year
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆301Updated last year
• NousResearch / Hermes-Function-Calling
  ☆863Updated 7 months ago
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆711Updated last year
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆235Updated 2 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆530Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆254Updated 9 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆215Updated 6 months ago
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆186Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆238Updated 5 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 6 months ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,671Updated last week
• anyscale / llm-router
  Tutorial for building LLM router
  ☆198Updated 9 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆320Updated 5 months ago