Weyaxi / scrape-open-llm-leaderboard
Scrape and export data from the Open LLM Leaderboard.
☆43Updated 2 months ago
Alternatives and similar repositories for scrape-open-llm-leaderboard:
Users that are interested in scrape-open-llm-leaderboard are comparing it to the libraries listed below
- Just a bunch of benchmark logs for different LLMs☆119Updated 7 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆102Updated 3 months ago
- Evaluating LLMs with CommonGen-Lite☆89Updated 11 months ago
- ☆20Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆58Updated last year
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- ☆48Updated last year
- ☆87Updated last year
- ☆113Updated 5 months ago
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆72Updated 5 months ago
- ☆48Updated 4 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated 11 months ago
- Codebase accompanying the Summary of a Haystack paper.☆75Updated 5 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆100Updated last year
- Let's create synthetic textbooks together :)☆73Updated last year
- ☆73Updated last year
- ☆65Updated 9 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- ☆57Updated 5 months ago
- Functional Benchmarks and the Reasoning Gap☆84Updated 5 months ago
- Evaluating LLMs with fewer examples☆147Updated 11 months ago
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆80Updated 11 months ago
- ☆110Updated 6 months ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆175Updated 2 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆73Updated 4 months ago
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆227Updated 3 weeks ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆125Updated 11 months ago
- Small and Efficient Mathematical Reasoning LLMs☆71Updated last year
- A framework for evaluating function calls made by LLMs☆37Updated 7 months ago