Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.
☆41Aug 10, 2026Updated this week
Alternatives and similar repositories for eval-framework
Users that are interested in eval-framework are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆66Nov 18, 2025Updated 8 months ago
- Preprocessing and analysis for training SNOMED-CT concept embeddings from CORD-19 corpus☆16Aug 4, 2023Updated 3 years ago
- Tooling for exact and MinHash deduplication of large-scale text datasets☆93Mar 24, 2026Updated 4 months ago
- Code and dataset for tracing semantic changes in Russian adjectives☆13Nov 26, 2019Updated 6 years ago
- Complete set of English dialect transformation rules and evaluation code☆16Jun 7, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Code for the paper "Greed is All You Need: An Evaluation of Tokenizer Inference Methods"☆15Nov 26, 2024Updated last year
- Code for Preventing Language Models From Hiding Their Reasoning, which evaluates defenses against LLM steganography.☆25Jan 26, 2024Updated 2 years ago
- Sentiment Corpus for Swedish 🇸🇪 Norwegian 🇳🇴 Danish 🇩🇰 Finnish 🇫🇮 (and English 🏴)☆15May 3, 2021Updated 5 years ago
- Data mapping framework for rust stuff☆56Mar 25, 2026Updated 4 months ago
- ☆14Dec 1, 2025Updated 8 months ago
- Split bib files for anthology bibliography for overleaf☆11Aug 25, 2024Updated last year
- 1st place solution for GramEval-2020☆14Jan 13, 2023Updated 3 years ago
- ACL 2021 paper "Style is NOT a single variable: Case Studies for Cross-Style Language Understanding " by Dongyeop Kang and Eduard Hovy☆15Jul 19, 2021Updated 5 years ago
- Hugging Face on Microsoft Azure (documentation, examples and more)☆16Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A comprehensive and extensible Wiktionary parsing framework.☆24Sep 5, 2024Updated last year
- Datasets for the task of tracing diachronic semantic shifts in Russian for two large-scale time period pairs (from pre-Soviet to Soviet t…☆14Feb 21, 2025Updated last year
- This is the repository for MorphScore, a tokenizer evaluation framework for morphological alignment.☆18Jul 10, 2025Updated last year
- ShareLM is a Chrome extension that lets you share your open-source conversations☆15Jun 15, 2026Updated last month
- Lexical semantic change detection shared task at SemEval 2020: UiO-UVA team☆16Jan 10, 2023Updated 3 years ago
- Reproducible, flexible LLM evaluations☆391Mar 24, 2026Updated 4 months ago
- It's a cooler way to store simple linear models.☆26Jul 15, 2024Updated 2 years ago
- SkinAI is an AI-powered web application designed to analyze skin conditions and provide immediate insights.☆14May 31, 2025Updated last year
- Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.☆29Jun 12, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- decontamination☆36Mar 4, 2026Updated 5 months ago
- Code for TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddings, EMNLP 2024 Findings☆33Nov 18, 2024Updated last year
- Expose HuggingFace datasets as Apache Iceberg tables☆30Jul 14, 2026Updated 3 weeks ago
- Mini-library for producing graph visualizations from embedding models☆28Sep 10, 2020Updated 5 years ago
- Convert datasets from Hugging Face to FiftyOne for Visualization☆11Mar 15, 2024Updated 2 years ago
- ☆22Oct 30, 2024Updated last year
- Python Teaching, Seminars for 2nd year students of School of Linguistics NRU HSE☆29Sep 22, 2017Updated 8 years ago
- A complete framework for training Large Language Models from scratch☆23Jan 8, 2026Updated 7 months ago
- A framework for evaluating function calls made by LLMs☆41Jul 23, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- AI-powered browser extension to chat with any webpage☆10Aug 12, 2025Updated 11 months ago
- Includes examples on how to evaluate LLMs☆23Nov 4, 2024Updated last year
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.☆47Sep 5, 2024Updated last year
- ☆43Oct 3, 2024Updated last year
- MUX-PLMs: Pretraining LMs with Data Multiplexing☆15Jan 29, 2023Updated 3 years ago
- Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis☆15May 28, 2025Updated last year
- ☆41May 26, 2026Updated 2 months ago