Alternatives and similar repositories for MixEval

Users that are interested in MixEval are comparing it to the libraries listed below

• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 7 months ago
• lancedb / ragged
  ☆20Updated 11 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆95Updated last week
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆103Updated 5 months ago
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆75Updated 9 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated 2 months ago
• arcee-ai / DAM
  ☆54Updated 10 months ago
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 5 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆132Updated 3 months ago
• mistralai / mistral-evals
  ☆77Updated last month
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆55Updated 4 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 10 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆34Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆29Updated 9 months ago
• axolotl-ai-cloud / axolotl-cookbook
  ☆34Updated last month
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆24Updated last week
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆140Updated last year
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 5 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 7 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆111Updated 4 months ago
• XiaoduoAILab / XmodelLM
  XmodelLM
  ☆39Updated 10 months ago
• UpstageAI / evalverse-IFEval
  Submodule of evalverse forked from [google-research/instruction_following_eval](https://github.com/google-research/google-research/tree/m…
  ☆14Updated last year
• benediktstroebl / agent-evals
  ☆25Updated 3 months ago
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated 2 months ago
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆87Updated this week
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆116Updated last month
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 5 months ago
• epoch-research / training-cost-trends
  ☆19Updated last month