☆35Jul 11, 2024Updated 2 years ago
Alternatives and similar repositories for AutoBencher
Users that are interested in AutoBencher are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository includes the code implementation of the paper Improving Pacing in Long-Form Story Planning by Yichen Wang, Kevin Yang, Xi…☆18Nov 19, 2024Updated last year
- [ICLR'25] DataGen: Unified Synthetic Dataset Generation via Large Language Models☆69Mar 8, 2025Updated last year
- Code for "FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge". EMNLP 2023.☆20Dec 25, 2023Updated 2 years ago
- [ICLR'26, NAACL'25 Demo] Toolkit & Benchmark for evaluating the trustworthiness of generative foundation models.☆136Oct 20, 2026Updated 2 weeks ago
- Implementation for VPBench proposed in paper Visually Prompted Benchmarks Are Surprisingly Fragile☆11Jan 14, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Aug 25, 2023Updated 3 years ago
- [CICAI2026] Efficiently creating diverse multi-turn Text-to-SQL training samples in 3 steps! 🚀☆15Oct 7, 2026Updated 3 weeks ago
- The implementation of <Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation> in PyTorch.☆17Nov 11, 2021Updated 4 years ago
- ☆24Mar 8, 2024Updated 2 years ago
- [ICLR 25 Spotlight] A testbed for agents and environments that can automatically improve models through data generation.☆36Mar 4, 2025Updated last year
- playing with gpt4☆13Mar 17, 2023Updated 3 years ago
- Sample-Efficient Parametric Learning from Natural Language☆13Feb 5, 2026Updated 8 months ago
- ☆10Sep 23, 2024Updated 2 years ago
- Exploring limitations of LLM-as-a-judge☆20Aug 17, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Calibrate-Then-Act: Cost-Aware Exploration in LLM Agents☆12Feb 23, 2026Updated 8 months ago
- ☆12Apr 29, 2024Updated 2 years ago
- Code for Paper (Preserving Diversity in Supervised Fine-tuning of Large Language Models)☆62May 12, 2025Updated last year
- The offical code for paper "What Constitutes a Faithful Summary? Preserving Author Perspectives in News Summarization"☆10Jun 23, 2024Updated 2 years ago
- ☆13Aug 14, 2022Updated 4 years ago
- ☆14May 17, 2025Updated last year
- Codebase for Instruction Following without Instruction Tuning☆36Sep 24, 2024Updated 2 years ago
- Explaining neural decisions contrastively to alternative decisions.☆24Mar 18, 2021Updated 5 years ago
- A tool for calling (and calling out to) large language models.☆16Aug 13, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation☆14Aug 19, 2025Updated last year
- ☆15Oct 7, 2024Updated 2 years ago
- Official repository for SMDD-Bench☆17May 22, 2026Updated 5 months ago
- The repository for papaer "Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs"☆14Dec 16, 2024Updated last year
- ☆22Sep 20, 2022Updated 4 years ago
- ☆38Nov 16, 2025Updated 11 months ago
- ☆12May 13, 2023Updated 3 years ago
- ☆45Oct 7, 2024Updated 2 years ago
- Simple phoenix setup for padded window management☆13Apr 25, 2018Updated 8 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- [IJCNN2025] MMSQL: Multi-turn Multi-type text-to-SQL test suit. Repository contains scripts, code, datasets in the paper "Evaluating and …☆21Oct 7, 2026Updated 3 weeks ago
- Code for the paper "Computational Language Acquisition with Theory of Mind" (ICLR 2023).☆15Apr 27, 2023Updated 3 years ago
- The official repository of 'Unnatural Language Are Not Bugs but Features for LLMs'☆25May 20, 2025Updated last year
- Official Codebase for .☆18Oct 25, 2026Updated last week
- Benchmarking of 1D pattern classification networks☆11Jul 19, 2023Updated 3 years ago
- This repository contains code for the paper "Better Estimation of the KL Divergence Between Language Models"☆20May 30, 2025Updated last year
- Fine-grained attention in hierarchical transformers for tabular time-series.☆12Updated this week