tcapelle / mistral_wandbLinks
A full fledged mistral+wandb
☆13Updated last year
Alternatives and similar repositories for mistral_wandb
Users that are interested in mistral_wandb are comparing it to the libraries listed below
Sorting:
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆143Updated this week
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- A small library of LLM judges☆294Updated 2 months ago
- Official codebase for "Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions" (Matrenok …☆27Updated 3 months ago
- ☆77Updated last year
- ☆43Updated last year
- Includes examples on how to evaluate LLMs☆23Updated 11 months ago
- ☆80Updated last year
- [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets☆218Updated last year
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆169Updated this week
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆24Updated 2 months ago
- This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data☆68Updated last year
- Attribute (or cite) statements generated by LLMs back to in-context information.☆291Updated last year
- awesome synthetic (text) datasets☆302Updated 3 months ago
- Notebooks for training universal 0-shot classifiers on many different tasks☆136Updated 9 months ago
- Sample notebooks and prompts for LLM evaluation☆151Updated this week
- Let's build better datasets, together!☆262Updated 9 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆104Updated last month
- ☆146Updated last year
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆187Updated 7 months ago
- ☆138Updated last week
- Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI m…☆223Updated 2 years ago
- Inference-time scaling for LLMs-as-a-judge.☆302Updated 2 weeks ago
- ☆88Updated last year
- Extending Conformal Prediction to LLMs☆68Updated last year
- Evaluating LLMs with fewer examples☆163Updated last year
- ☆128Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆50Updated last year
- ☆23Updated 2 years ago
- LangChain, Llama2-Chat, and zero- and few-shot prompting are used to generate synthetic datasets for IR and RAG system evaluation☆37Updated last year