olly-styles / WorkBench
WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting.
☆40Updated 8 months ago
Alternatives and similar repositories for WorkBench:
Users that are interested in WorkBench are comparing it to the libraries listed below
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆106Updated 7 months ago
- Codebase accompanying the Summary of a Haystack paper.☆77Updated 6 months ago
- Evaluating LLMs with fewer examples☆150Updated last year
- Complex Function Calling Benchmark.☆92Updated 2 months ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆99Updated last year
- ☆74Updated 3 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆126Updated last year
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆80Updated last year
- ☆35Updated 9 months ago
- Mixing Language Models with Self-Verification and Meta-Verification☆103Updated 4 months ago
- A set of utilities for running few-shot prompting experiments on large-language models☆118Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆254Updated 9 months ago
- Google Deepmind's PromptBreeder for automated prompt engineering implemented in langchain expression language.☆101Updated 8 months ago
- [SIGIR 2024 (Demo)] CoSearchAgent: A Lightweight Collborative Search Agent with Large Language Models☆23Updated last year
- Evaluating LLMs with CommonGen-Lite☆89Updated last year
- ☆164Updated 8 months ago
- Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models☆96Updated last year
- ☆119Updated 6 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆76Updated 5 months ago
- Functional Benchmarks and the Reasoning Gap☆85Updated 6 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 8 months ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆149Updated 10 months ago
- LangCode - Improving alignment and reasoning of large language models (LLMs) with natural language embedded program (NLEP).☆42Updated last year
- Implementation of "SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models"☆27Updated 2 months ago
- ReLM is a Regular Expression engine for Language Models☆103Updated last year
- Reward Model framework for LLM RLHF☆61Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆72Updated 8 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆80Updated 4 months ago
- ☆39Updated 8 months ago
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆94Updated 5 months ago