CosineAI / experimentsLinks
Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
☆15Updated last year
Alternatives and similar repositories for experiments
Users that are interested in experiments are comparing it to the libraries listed below
Sorting:
- ☆20Updated last month
- ☆25Updated 7 months ago
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆24Updated last year
- Everything for the Paper: 'Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing'☆19Updated 2 years ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated last year
- The world's first fully automated VC fund.☆27Updated last week
- Fluid Language Model Benchmarking☆25Updated 4 months ago
- Graph-Aware Attention for Adaptive Dynamics in Transformers☆68Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆12Updated 6 months ago
- Inference examples☆65Updated 4 months ago
- ☆14Updated 2 years ago
- Code and data for the paper "Why think step by step? Reasoning emerges from the locality of experience"☆63Updated 9 months ago
- Tools for merging pretrained large language models.☆19Updated last year
- The application is a end-user training and evaluation system for standard knowledge graph embedding models. It was developed to optimise …☆18Updated 7 months ago
- UQ: Assessing Language Models on Unsolved Questions☆29Updated 4 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 9 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 9 months ago
- ☆55Updated last year
- Public repository containing METR's DVC pipeline for eval data analysis☆183Updated last week
- Tasks and tutorials using Graphore's IPU with Hugging Face. Originally at https://github.com/gradient-ai/Graphcore-HuggingFace☆16Updated last year
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated last year
- Automatic Prompt Optimization☆48Updated last year
- OLMost every training recipe you need to perform data interventions with the OLMo family of models.☆64Updated this week
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆43Updated 2 years ago
- Chaiverse: the Chai AI developer platform.☆190Updated last year
- Interactive Textbook Demo☆52Updated 2 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated 2 years ago
- ☆61Updated 6 months ago
- ☆94Updated this week