Alternatives and similar repositories for MixEval:

Users that are interested in MixEval are comparing it to the libraries listed below

• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 4 months ago
• arcee-ai / DAM
  ☆48Updated 5 months ago
• benediktstroebl / agent-evals
  ☆16Updated 6 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 2 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 2 months ago
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆21Updated last week
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆23Updated 2 months ago
• allenai / olmo-cookbook
  OLMost every training recipe you need to perform data interventions with the OLMo family of models.
  ☆21Updated this week
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 11 months ago
• lancedb / ragged
  ☆19Updated 6 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆40Updated 2 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 5 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆46Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 7 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆88Updated 2 months ago
• mistralai / mistral-evals
  ☆68Updated 3 weeks ago
• ZihanWang314 / coeCheck
  ☆16Updated last month
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated 10 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last week
• catid / lllm
  Latent Large Language Models
  ☆17Updated 7 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆15Updated last week
• AtakanTekparmak / agento
  Very minimal (and stateless) agent framework
  ☆41Updated 3 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 2 weeks ago
• ivanleomk / modal-grpo
  ☆18Updated 3 weeks ago
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆62Updated 8 months ago
• SqueezeAILab / Tool2Vec
  Efficient and Scalable Estimation of Tool Representations in Vector Space
  ☆23Updated 7 months ago
• g-aggarwal / mlx-hub
  A python command-line tool to download & manage MLX AI models from Hugging Face.
  ☆17Updated 7 months ago
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆17Updated 9 months ago