JevBench by Benchmark Heaven: benchmark and leaderboard for AI decision models, measuring typed decision accuracy, calibration, latency and cost.
☆347Oct 15, 2026Updated last month
Alternatives and similar repositories for jevbench
Users that are interested in jevbench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Decision Index: reproduce the Jev decision-model benchmark suite locally or as one HF Job☆100Oct 20, 2026Updated 3 weeks ago
- Semantic ifs from open models, on a 3090 at home. Independent; not affiliated with Jev or TypeSafe.☆4,964Sep 23, 2026Updated last month
- A family of System One-style models fine-tuned from Qwen3.5, designed for one-pass typed decisions with calibrated probabilities.☆1,054Oct 20, 2026Updated 3 weeks ago
- Jev-compatible API endpoint based on open models (prefill-only)☆334Oct 1, 2026Updated last month
- Jev-like family of decision models built on top of Qwen3.5/3.8 you can train and run on your own☆10,035Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Python client for the Open eXecution Protocol (OXP)☆18May 16, 2025Updated last year
- /goal port from codex to arbitrary agents and harnesses, opencode, claude code, etc☆12Oct 29, 2026Updated 2 weeks ago
- mini-Jev: what a Jev-style typed-decision interface looks like on a frozen Qwen3-4B — read the option letter's logits instead of generati…☆64Sep 18, 2026Updated 2 months ago
- ☆1,371Sep 16, 2026Updated 2 months ago
- Turn any open model into a classifier/jev endpoint☆659Nov 11, 2026Updated last week
- Fast and simple server to host state-of-the-art retrieval models☆15Jun 4, 2026Updated 5 months ago
- Python SDK for Modaic☆28Nov 11, 2026Updated last week
- A simulation of civilizations. http://stewart-taylor.github.io/MediSim/☆13Mar 22, 2016Updated 10 years ago
- ☆14Oct 27, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Local typed decisions, contrastive data curation, and model evaluation.☆2,311Updated this week
- Large-language Model Evaluation framework with Elo Leaderboard and A-B testing☆52Oct 24, 2024Updated 2 years ago
- CD20200004 from 01/01/2021 to 31/12/2023 - LIG UGA - Python Notebook and Models for the MT Lab @ ALPS 2022☆13Apr 1, 2024Updated 2 years ago
- Typed-decision models (noul / choice / score) trained by a self-improving loop of AI agents — checkpoints, the code that produced them, a…☆139Updated this week
- Contrastive Language Models (CLMs) are a new class of System One model trained with a contrastive learning objective that connects states…☆3,208Oct 5, 2026Updated last month
- Plot Writing From Pre-Trained Language Models (INLG 2022) [code+data]☆10Jun 29, 2022Updated 4 years ago
- StochKit is an extensible tool for stochastic simulation tool with stochastic and multiscale algorithms.☆17Jun 9, 2020Updated 6 years ago
- Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"☆24Feb 16, 2024Updated 2 years ago
- ☆27Aug 24, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- GLM 5.3 Flash for 2x RTX 6000, Full Mixed EXL3 Support, Code C1 >220tps☆22Oct 25, 2026Updated 3 weeks ago
- Faster inference backend for Open-Jev-27B: fused CUDA kernels, prefix tree, CUDA Graphs (B300, bf16)☆92Sep 28, 2026Updated last month
- Let coding agents ask you for secrets in a floating macOS prompt instead of in chat☆15Oct 27, 2026Updated 3 weeks ago
- Nexusflow function call, tool use, and agent benchmarks.☆28Dec 13, 2024Updated last year
- Code for Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers☆13May 31, 2026Updated 5 months ago
- An implementation of event-driven workflows in Go☆14Aug 12, 2025Updated last year
- Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and…☆1,619Oct 21, 2026Updated 3 weeks ago
- Aligning Model-Generated Rubrics with Human Standards☆42Mar 3, 2026Updated 8 months ago
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆960Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Reproducible benchmark for measuring Jev reranking quality, latency, and cost in RAG☆20Oct 29, 2026Updated 2 weeks ago
- Amazon DynamoDB storage backend for the Strands Agents SDK (TypeScript and Python): sessions, agent memory, semantic search over DynamoDB…☆17Updated this week
- This is the official repository for the paper From Failed Trajectories to Reliable LLM Agents: Diagnosing and Repairing Harness Flaws☆28Jul 2, 2026Updated 4 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆62Apr 18, 2026Updated 7 months ago
- [Tech Report, NeurIPS 2026] Expanded Hyper-Connections☆78Nov 8, 2026Updated last week
- Korean stereoypte detector with TUNiB-Electra and K-StereoSet☆13Oct 15, 2021Updated 5 years ago
- ☆29May 6, 2024Updated 2 years ago
Are these results useful?