Alternatives and similar repositories for MixEval

Users that are interested in MixEval are comparing it to the libraries listed below

• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 2 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆30Updated last year
• lancedb / ragged
  ☆21Updated last year
• arcee-ai / DAM
  ☆55Updated last year
• allenai / olmo-cookbook
  OLMost every training recipe you need to perform data interventions with the OLMo family of models.
  ☆63Updated this week
• epoch-research / training-cost-trends
  ☆20Updated 3 weeks ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆29Updated 2 months ago
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆61Updated 8 months ago
• areu01or00 / Tensor-Slayer
  Tensor-Slayer : Manipulate weights and tensors of LLMs to achieve performance upgrades and introduce a novel inferenceless mechanistic in…
  ☆27Updated 7 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆137Updated 7 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆111Updated 8 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 9 months ago
• mistralai / mistral-evals
  ☆82Updated last month
• facebookresearch / MultiModalExplorer
  Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…
  ☆27Updated last year
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆76Updated last year
• brendanhogan / picoDeepResearch
  ☆68Updated 7 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 9 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆26Updated 3 weeks ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 11 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆38Updated last year
• thomasnormal / fewshot
  ☆29Updated 2 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆47Updated 11 months ago
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated 5 months ago
• axolotl-ai-cloud / axolotl-cookbook
  ☆36Updated 5 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆250Updated this week
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆32Updated last year