mlabonne / llm-autoeval

Related projects ⓘ

Alternatives and complementary repositories for llm-autoeval

• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆811Updated this week
• huggingface / cosmopedia
  ☆451Updated 3 weeks ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆242Updated 3 weeks ago
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆408Updated 2 months ago
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆797Updated 2 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆356Updated 2 months ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆1,634Updated this week
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆488Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆262Updated last month
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆311Updated last week
• SqueezeAILab / TinyAgent
  [EMNLP 2024 Demo] TinyAgent: Function Calling at the Edge!
  ☆313Updated 2 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆675Updated 7 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆421Updated 5 months ago
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆397Updated 9 months ago
• allenai / lumos
  Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"
  ☆448Updated 8 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆312Updated 7 months ago
• IntelLabs / RAG-FiT
  Framework for enhancing LLMs for RAG tasks using fine-tuning.
  ☆504Updated this week
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆282Updated last month
• apoorvumang / prompt-lookup-decoding
  ☆470Updated 2 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆261Updated 4 months ago
• NousResearch / Hermes-Function-Calling
  ☆718Updated 2 months ago
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆534Updated 2 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆205Updated this week
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆385Updated 9 months ago
• vllm-project / llm-compressor
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
  ☆685Updated this week
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆293Updated 11 months ago
• philschmid / easyllm
  ☆433Updated 10 months ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆651Updated 3 months ago
• agent-husky / Husky-v1
  Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …
  ☆328Updated 5 months ago