CosineAI / experimentsLinks
Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
☆15Updated last year
Alternatives and similar repositories for experiments
Users that are interested in experiments are comparing it to the libraries listed below
Sorting:
- ☆20Updated last week
- UQ: Assessing Language Models on Unsolved Questions☆29Updated 3 months ago
- Everything for the Paper: 'Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing'☆19Updated 2 years ago
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆23Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 7 months ago
- The world's first fully automated VC fund.☆25Updated last week
- ☆88Updated last month
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 7 months ago
- ☆25Updated 6 months ago
- Public repository containing METR's DVC pipeline for eval data analysis☆143Updated 8 months ago
- Automatic Prompt Optimization☆48Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆12Updated 4 months ago
- CLaMR: Contextualized Late-Interaction for Multimodal Content Retrieval☆22Updated 5 months ago
- ☆77Updated 2 months ago
- ☆28Updated 8 months ago
- code for Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive Princip…☆23Updated 4 months ago
- A repository of projects and datasets under active development by Alignment Lab AI☆22Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 10 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆11Updated 2 years ago
- Interactive Textbook Demo☆50Updated last month
- ☆36Updated 4 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆32Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆225Updated last week
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated last year
- Example implementation of Iteration of Tought - Gives a star if you like the project☆41Updated 11 months ago
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆61Updated 7 months ago
- ☆19Updated 8 months ago
- Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆55Updated 4 months ago
- ☆55Updated last year