Alternatives and similar repositories for yet-another-applied-llm-benchmark:

Users that are interested in yet-another-applied-llm-benchmark are comparing it to the libraries listed below

• vgel / repeng
  A library for making RepE control vectors
  ☆583Updated 4 months ago
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆620Updated last year
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆788Updated last week
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆711Updated last year
• mistralai / mistral-common
  ☆713Updated last month
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆828Updated last month
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆498Updated last year
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆930Updated 2 weeks ago
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,373Updated this week
• mistralai-sf24 / hackathon
  ☆444Updated last year
• apoorvumang / prompt-lookup-decoding
  ☆529Updated 8 months ago
• vec2text / vec2text
  utilities for decoding deep representations (like sentence embeddings) back to text
  ☆797Updated 3 weeks ago
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆418Updated 11 months ago
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆867Updated last week
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆437Updated 7 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,500Updated this week
• SkunkworksAI / hydra-moe
  ☆412Updated last year
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated 3 weeks ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,836Updated this week
• stanfordnlp / pyreft
  Stanford NLP Python library for Representation Finetuning (ReFT)
  ☆1,465Updated 3 months ago
• SqueezeAILab / LLMCompiler
  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
  ☆1,676Updated 9 months ago
• UKGovernmentBEIS / inspect_ai
  Inspect: A framework for large language model evaluations
  ☆922Updated this week
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆587Updated this week
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆1,843Updated 8 months ago
• sierra-research / tau-bench
  Code and Data for Tau-Bench
  ☆472Updated 3 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,191Updated 5 months ago
• huggingface / cosmopedia
  ☆515Updated 5 months ago
• lapisrocks / LanguageAgentTreeSearch
  [ICML 2024] Official repository for "Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models"
  ☆751Updated 9 months ago
• ray-project / llmperf-leaderboard
  ☆457Updated last year
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆532Updated last year