CosineAI / experimentsLinks
Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
☆15Updated last year
Alternatives and similar repositories for experiments
Users that are interested in experiments are comparing it to the libraries listed below
Sorting:
- ☆19Updated last month
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆19Updated last year
- Public repository containing METR's DVC pipeline for eval data analysis☆108Updated 5 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆39Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆12Updated 2 months ago
- ☆19Updated last year
- Example implementation of Iteration of Tought - Gives a star if you like the project☆43Updated 8 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆92Updated 7 months ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆75Updated 9 months ago
- ☆25Updated 3 months ago
- Analysis code for paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆51Updated last month
- ☆54Updated 10 months ago
- ☆56Updated 2 months ago
- ☆39Updated last year
- alternative way to calculating self attention☆18Updated last year
- UQ: Assessing Language Models on Unsolved Questions☆27Updated 3 weeks ago
- ☆23Updated 4 months ago
- OLMost every training recipe you need to perform data interventions with the OLMo family of models.☆48Updated this week
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 4 months ago
- Interactive Textbook Demo☆45Updated last year
- LLM reads a paper and produce a working prototype☆57Updated 5 months ago
- Nexusflow function call, tool use, and agent benchmarks.☆29Updated 9 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆33Updated 5 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Very minimal (and stateless) agent framework☆45Updated 8 months ago
- Graph-Aware Attention for Adaptive Dynamics in Transformers☆63Updated 8 months ago
- The world's first fully automated VC fund.☆23Updated this week
- ☆34Updated last month
- Repository to create traveling waves integrate special information through time☆55Updated last month
- ☆11Updated 10 months ago