philschmid / MixEvalLinks
The official evaluation suite and dynamic data release for MixEval.
☆11Updated last year
Alternatives and similar repositories for MixEval
Users that are interested in MixEval are comparing it to the libraries listed below
Sorting:
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 7 months ago
- ☆20Updated 11 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆95Updated last week
- Source code for the collaborative reasoner research project at Meta FAIR.☆103Updated 5 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆75Updated 9 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated 2 months ago
- ☆54Updated 10 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 5 months ago
- Train, tune, and infer Bamba model☆132Updated 3 months ago
- ☆77Updated last month
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆55Updated 4 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 10 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year
- Nexusflow function call, tool use, and agent benchmarks.☆29Updated 9 months ago
- ☆34Updated last month
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated last week
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆140Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 5 months ago
- ☆80Updated last year
- ☆49Updated 7 months ago
- accompanying material for sleep-time compute paper☆111Updated 4 months ago
- XmodelLM☆39Updated 10 months ago
- Submodule of evalverse forked from [google-research/instruction_following_eval](https://github.com/google-research/google-research/tree/m…☆14Updated last year
- ☆25Updated 3 months ago
- Supercharge huggingface transformers with model parallelism.☆77Updated 2 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆87Updated this week
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆116Updated last month
- Using modal.com to process FineWeb-edu data☆20Updated 5 months ago
- ☆19Updated last month