CosineAI / experimentsLinks
Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
☆15Updated 11 months ago
Alternatives and similar repositories for experiments
Users that are interested in experiments are comparing it to the libraries listed below
Sorting:
- ☆18Updated last week
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆17Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆81Updated this week
- Public repository containing METR's DVC pipeline for eval data analysis☆86Updated 4 months ago
- Analysis code for paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆45Updated last month
- OLMost every training recipe you need to perform data interventions with the OLMo family of models.☆37Updated this week
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- ☆40Updated 7 months ago
- ☆18Updated last year
- ☆54Updated last month
- Example implementation of Iteration of Tought - Gives a star if you like the project☆42Updated 7 months ago
- The world's first fully automated VC fund.☆24Updated 2 weeks ago
- Interactive Textbook Demo☆45Updated last year
- ☆23Updated 2 months ago
- A framework for few-shot evaluation of autoregressive language models.☆11Updated 3 weeks ago
- Train, tune, and infer Bamba model☆130Updated 2 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 6 months ago
- The Open-Source Implementation of Cognition AI's Automated Software Engineer, Devin.☆14Updated last year
- ☆38Updated last year
- alternative way to calculating self attention☆18Updated last year
- Amplify your coding capabilities with AI - your smart co-pilot for an elevated coding experience.☆13Updated 5 months ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated 8 months ago
- A forest of autonomous agents.☆19Updated 6 months ago
- ☆34Updated this week
- Streamlit app for recommending eval functions using prompt diffs☆29Updated last year
- Training hybrid models for dummies.☆25Updated 6 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated 3 months ago
- ☆41Updated last year
- ☆56Updated last month
- LLM reads a paper and produce a working prototype☆58Updated 3 months ago