Alternatives and similar repositories for llm-autoeval:

Users that are interested in llm-autoeval are comparing it to the libraries listed below

• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆883Updated this week
• xfactlab / orpo
  Official repository for ORPO
  ☆445Updated 9 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,313Updated this week
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆265Updated 4 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆691Updated 11 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆272Updated 8 months ago
• huggingface / cosmopedia
  ☆501Updated 4 months ago
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆506Updated last year
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆498Updated last year
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆414Updated last year
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆562Updated 4 months ago
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆454Updated 6 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆298Updated last year
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆265Updated 2 weeks ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆316Updated 4 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆544Updated 2 months ago
• SkunkworksAI / hydra-moe
  ☆412Updated last year
• jondurbin / bagel
  A bagel, with everything.
  ☆317Updated 11 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆230Updated 4 months ago
• SalesforceAIResearch / xLAM
  ☆374Updated 2 months ago
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆489Updated last year
• NousResearch / Hermes-Function-Calling
  ☆838Updated 6 months ago
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆709Updated last year
• allenai / dolma
  Data and tools for generating and inspecting OLMo pre-training data.
  ☆1,162Updated last week
• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆646Updated 9 months ago
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆334Updated this week
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆185Updated last year
• apoorvumang / prompt-lookup-decoding
  ☆512Updated 7 months ago
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆302Updated last month
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆257Updated 3 months ago