Qurrent-AI / RES-QLinks
RES-Q: Evaluating the Code-Editing Capability of Large Language Model Systems at the Repository Scale
☆26Updated last year
Alternatives and similar repositories for RES-Q
Users that are interested in RES-Q are comparing it to the libraries listed below
Sorting:
- ☆141Updated 2 weeks ago
- ☆101Updated 5 months ago
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆64Updated 10 months ago
- Website for hosting the Open Foundation Models Cheat Sheet.☆267Updated 3 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆309Updated last year
- Repository for the paper Stream of Search: Learning to Search in Language☆150Updated 7 months ago
- r2e: turn any github repository into a programming agent environment☆130Updated 4 months ago
- Just a bunch of benchmark logs for different LLMs☆120Updated last year
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆109Updated last week
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆223Updated last year
- A toolkit for describing model features and intervening on those features to steer behavior.☆198Updated 9 months ago
- Evaluation of LLMs on latest math competitions☆161Updated 3 weeks ago
- Open source interpretability artefacts for R1.☆157Updated 4 months ago
- Functional Benchmarks and the Reasoning Gap☆88Updated 11 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆172Updated 7 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆182Updated 5 months ago
- ☆122Updated 3 weeks ago
- Red-Teaming Language Models with DSPy☆211Updated 6 months ago
- ☆57Updated last month
- A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…☆76Updated 8 months ago
- ☆133Updated 5 months ago
- Sphynx Hallucination Induction☆53Updated 7 months ago
- ⚖️ Awesome LLM Judges ⚖️☆128Updated 4 months ago
- METR Task Standard☆159Updated 7 months ago
- ☆201Updated 5 months ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆243Updated 6 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆229Updated last month
- Can Language Models Solve Olympiad Programming?☆119Updated 7 months ago
- Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions☆47Updated this week
- ☆90Updated 8 months ago