CosineAI / experimentsLinks
Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
☆15Updated last year
Alternatives and similar repositories for experiments
Users that are interested in experiments are comparing it to the libraries listed below
Sorting:
- ☆19Updated last week
- UQ: Assessing Language Models on Unsolved Questions☆27Updated 2 months ago
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆23Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆97Updated last week
- ☆19Updated last year
- ☆40Updated last year
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated 10 months ago
- ☆19Updated 7 months ago
- OLMost every training recipe you need to perform data interventions with the OLMo family of models.☆52Updated this week
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 6 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆58Updated 4 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆11Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆12Updated 3 months ago
- you.com's framework for evaluating deep research systems.☆48Updated 5 months ago
- ☆25Updated 5 months ago
- Training hybrid models for dummies.☆27Updated last week
- LLM reads a paper and produce a working prototype☆57Updated 6 months ago
- Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆53Updated 2 months ago
- ☆36Updated 2 months ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆12Updated 11 months ago
- Public repository containing METR's DVC pipeline for eval data analysis☆124Updated 6 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆110Updated 6 months ago
- Everything for the Paper: 'Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing'☆17Updated last year
- The world's first fully automated VC fund.☆24Updated this week
- alternative way to calculating self attention☆18Updated last year
- Source code for the collaborative reasoner research project at Meta FAIR.☆103Updated 6 months ago
- ☆55Updated 11 months ago
- CLaMR: Contextualized Late-Interaction for Multimodal Content Retrieval☆20Updated 4 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 9 months ago