Small, simple agent task environments for training and evaluation
☆20Nov 1, 2024Updated last year
Alternatives and similar repositories for SmallBench
Users that are interested in SmallBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.☆46Feb 15, 2024Updated 2 years ago
- Repository for tw.org site☆14Updated this week
- A Collection of Pydantic Models to Abstract IRL☆40Dec 10, 2025Updated 8 months ago
- Jason Meridth's blog☆14Updated this week
- Evals meant to evaluate language models' ability to reason over long contexts.☆10Sep 12, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official PyTorch Implementation for Meaning Representations from Trajectories in Autoregressive Models (ICLR 2024)☆22May 14, 2024Updated 2 years ago
- vLLM with support for span semantics☆26Feb 27, 2026Updated 5 months ago
- Code for Columbia University COMS 3997 – LLM Ethics and Foundations☆16Jan 7, 2025Updated last year
- Solving data for LLMs - Create quality synthetic datasets!☆152Jan 20, 2025Updated last year
- Code of CropMix: Sampling a Rich Input Distribution via Multi-Scale Cropping☆17Oct 8, 2022Updated 3 years ago
- Short for Orchestrator☆16Updated this week
- An attribution library for LLMs☆46Sep 17, 2024Updated last year
- ☆31Jan 18, 2025Updated last year
- 🛠️ Terminal tools, written from scratch.☆26Apr 26, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆53Sep 18, 2024Updated last year
- ☆66Sep 13, 2025Updated 10 months ago
- LobotoMl is a set of scripts and tools to assess production deployments of ML services☆10May 16, 2022Updated 4 years ago
- Explore and Control with Adversarial Surprise☆10Jul 20, 2021Updated 5 years ago
- API and CLI tool to fetch and query Chome DevTools heap snapshots (Python & Playwright)☆16May 16, 2024Updated 2 years ago
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆63Apr 10, 2024Updated 2 years ago
- ☆15Sep 30, 2022Updated 3 years ago
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆30Dec 10, 2024Updated last year
- A flat container abstraction for Rust☆17Nov 24, 2025Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆27Feb 26, 2026Updated 5 months ago
- Replication package for evaluation of code generation metrics☆17Nov 24, 2025Updated 8 months ago
- ☆15Apr 26, 2025Updated last year
- ☆23Oct 22, 2025Updated 9 months ago
- BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution☆61Oct 13, 2025Updated 9 months ago
- 🔔🧠 Easily experiment with popular language agents across diverse reasoning/decision-making benchmarks!☆54Jul 9, 2025Updated last year
- ☆18May 6, 2023Updated 3 years ago
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆29Mar 6, 2024Updated 2 years ago
- End-to-end Generative Optimization for AI Agents☆752Jun 17, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- TRITONCACHE implementation of a Redis cache☆18Updated this week
- List of papers on Self-Correction of LLMs.☆82May 19, 2026Updated 2 months ago
- ☆137Jun 30, 2026Updated last month
- ☆13Jul 14, 2024Updated 2 years ago
- BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions☆26Aug 8, 2024Updated 2 years ago
- A Data Source for Reasoning Embodied Agents☆20Sep 18, 2023Updated 2 years ago
- [NAACL 2024] CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions☆13May 7, 2024Updated 2 years ago