Alternatives and similar repositories for yet-another-applied-llm-benchmark:

Users that are interested in yet-another-applied-llm-benchmark are comparing it to the libraries listed below

• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆794Updated 2 weeks ago
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,230Updated last week
• NousResearch / Hermes-Function-Calling
  ☆806Updated 5 months ago
• UKGovernmentBEIS / inspect_ai
  Inspect: A framework for large language model evaluations
  ☆783Updated this week
• vgel / repeng
  A library for making RepE control vectors
  ☆551Updated last month
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆705Updated last year
• microsoft / Samba
  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
  ☆841Updated this week
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆1,712Updated 6 months ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆772Updated this week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,483Updated this week
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆411Updated 4 months ago
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆590Updated 9 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,160Updated this week
• mistralai / mistral-common
  ☆679Updated 2 weeks ago
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆495Updated last year
• modal-labs / llm-finetuning
  Guide for fine-tuning Llama/Mistral/CodeLlama models and more
  ☆567Updated 5 months ago
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆873Updated last month
• apoorvumang / prompt-lookup-decoding
  ☆502Updated 5 months ago
• zou-group / textgrad
  TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.
  ☆2,085Updated 3 weeks ago
• huggingface / evaluation-guidebook
  Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…
  ☆1,019Updated last month
• codelion / optillm
  Optimizing inference proxy for LLMs
  ☆2,040Updated this week
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆476Updated last year
• mistralai-sf24 / hackathon
  ☆446Updated 10 months ago
• huggingface / cosmopedia
  ☆496Updated 3 months ago
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,002Updated last month
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,704Updated this week
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,448Updated this week
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆604Updated 2 months ago
• jquesnelle / yarn
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,421Updated 10 months ago