Alternatives and similar repositories for llm-autoeval

Users that are interested in llm-autoeval are comparing it to the libraries listed below

• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆489Updated 11 months ago
• deep-diver / llamaduo
  [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs
  ☆313Updated 3 weeks ago
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆978Updated 3 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆284Updated 4 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆276Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆291Updated 3 weeks ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆325Updated 8 months ago
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆387Updated last year
• mistralai-sf24 / hackathon
  ☆447Updated last year
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆613Updated 2 months ago
• philschmid / easyllm
  ☆461Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆320Updated 3 months ago
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆568Updated last year
• huggingface / huggingface-llama-recipes
  ☆677Updated 3 months ago
• huggingface / cosmopedia
  ☆525Updated 8 months ago
• datadreamer-dev / DataDreamer
  DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤
  ☆1,040Updated 6 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆367Updated this week
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆125Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆461Updated last year
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆558Updated last year
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆702Updated last year
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆501Updated last year
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆187Updated last year
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆433Updated last year
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆698Updated 3 weeks ago
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆505Updated 2 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆323Updated last year
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆504Updated last year
• QuixiAI / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆239Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆229Updated 9 months ago