Alternatives and similar repositories for llm-autoeval:

Users that are interested in llm-autoeval are comparing it to the libraries listed below

• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆970Updated this week
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆426Updated 4 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆425Updated last week
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆841Updated last week
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆492Updated last year
• huggingface / cosmopedia
  ☆484Updated last month
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆253Updated 2 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆315Updated 9 months ago
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆555Updated 4 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆684Updated 9 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆430Updated 7 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆170Updated 5 months ago
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆424Updated 11 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆259Updated last week
• apoorvumang / prompt-lookup-decoding
  ☆493Updated 4 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆268Updated 6 months ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆1,879Updated this week
• mistralai-sf24 / hackathon
  ☆446Updated 9 months ago
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆634Updated 7 months ago
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆294Updated last month
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆183Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆279Updated last month
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆313Updated 2 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆488Updated 9 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆99Updated 3 months ago
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆477Updated last year
• BatsResearch / bonito
  A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.
  ☆728Updated 4 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆247Updated 6 months ago
• allenai / lumos
  Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"
  ☆459Updated 9 months ago