Weyaxi / scrape-open-llm-leaderboard
Scrape and export data from the Open LLM Leaderboard.
☆44Updated 4 months ago
Alternatives and similar repositories for scrape-open-llm-leaderboard:
Users that are interested in scrape-open-llm-leaderboard are comparing it to the libraries listed below
- Just a bunch of benchmark logs for different LLMs☆119Updated 9 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- ☆20Updated last year
- ☆48Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated last year
- Evaluating LLMs with CommonGen-Lite☆89Updated last year
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆100Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆76Updated 6 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆61Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆104Updated 4 months ago
- ☆48Updated 5 months ago
- Small and Efficient Mathematical Reasoning LLMs☆71Updated last year
- ☆66Updated 11 months ago
- ☆73Updated last year
- A framework for evaluating function calls made by LLMs☆37Updated 9 months ago
- A set of utilities for running few-shot prompting experiments on large-language models☆118Updated last year
- Evaluating LLMs with fewer examples☆151Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆173Updated 11 months ago
- 🚢 Data Toolkit for Sailor Language Models☆88Updated 2 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆78Updated last year
- ☆117Updated 8 months ago
- ☆75Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆255Updated 9 months ago
- Functional Benchmarks and the Reasoning Gap☆85Updated 6 months ago
- An introduction to LLM Sampling☆77Updated 4 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆139Updated 2 months ago
- ☆120Updated 6 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 9 months ago
- Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning☆46Updated last year
- A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments☆77Updated 6 months ago