CosineAI / experimentsLinks
Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
☆15Updated 10 months ago
Alternatives and similar repositories for experiments
Users that are interested in experiments are comparing it to the libraries listed below
Sorting:
- ☆16Updated last week
- Analysis code for paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆42Updated 2 weeks ago
- ☆22Updated last month
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆17Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆11Updated this week
- Fullstack chatbot application☆11Updated last week
- ☆40Updated 7 months ago
- LLM reads a paper and produce a working prototype☆58Updated 3 months ago
- Public repository containing METR's DVC pipeline for eval data analysis☆78Updated 3 months ago
- ☆51Updated 3 weeks ago
- ☆23Updated 2 months ago
- Paper dataset for "Factored Verification: Detecting and Reducing Hallucination in Summaries of Academic Papers"☆13Updated 8 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated 3 months ago
- ☆18Updated 11 months ago
- ☆52Updated 8 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆23Updated 3 months ago
- ☆20Updated 4 months ago
- ☆47Updated 9 months ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated 8 months ago
- ☆26Updated 3 months ago
- Interactive Textbook Demo☆45Updated last year
- ☆40Updated last year
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆35Updated last year
- The world's first fully automated VC fund.☆23Updated 2 weeks ago
- Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…☆22Updated 2 months ago
- ☆17Updated last month
- Train, tune, and infer Bamba model☆130Updated last month
- Verifiers for LLM Reinforcement Learning☆65Updated 3 months ago
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆73Updated 2 weeks ago
- ☆55Updated 3 weeks ago