tcapelle / mistral_wandbLinks
A full fledged mistral+wandb
☆13Updated last year
Alternatives and similar repositories for mistral_wandb
Users that are interested in mistral_wandb are comparing it to the libraries listed below
Sorting:
- A small library of LLM judges☆308Updated 4 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆173Updated 2 weeks ago
- ☆80Updated last year
- Sample notebooks and prompts for LLM evaluation☆156Updated last month
- Official codebase for "Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions" (Matrenok …☆28Updated last week
- Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models☆26Updated 6 months ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆162Updated 2 weeks ago
- ☆79Updated last year
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆26Updated 4 months ago
- ☆202Updated 2 weeks ago
- This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data☆68Updated last year
- Includes examples on how to evaluate LLMs☆23Updated last year
- ☆148Updated last year
- Inference-time scaling for LLMs-as-a-judge.☆316Updated last month
- Official Repo for CRMArena and CRMArena-Pro☆126Updated last month
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆189Updated 9 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆71Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- A method for steering llms to better follow instructions☆66Updated 4 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆76Updated last year
- awesome synthetic (text) datasets☆314Updated last month
- Let's build better datasets, together!☆265Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago
- Notebooks for training universal 0-shot classifiers on many different tasks☆137Updated 11 months ago
- Attribute (or cite) statements generated by LLMs back to in-context information.☆308Updated last year
- [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets☆218Updated last year
- Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI m…☆224Updated 2 years ago
- ☆49Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆107Updated 3 months ago