OpenGenerativeAI / llm-colosseumLinks
Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM
☆1,455Updated 9 months ago
Alternatives and similar repositories for llm-colosseum
Users that are interested in llm-colosseum are comparing it to the libraries listed below
Sorting:
- Llama-3 agents that can browse the web by following instructions and talking to you☆1,408Updated last year
- An self-improving embodied conversational agent seamlessly integrated into the operating system to automate our daily tasks.☆1,713Updated last year
- Fine-tune LLM agents with online reinforcement learning☆1,248Updated last year
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,406Updated last year
- Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""☆3,911Updated last year
- ☆446Updated last year
- [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling☆1,806Updated last year
- We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 …☆853Updated last year
- [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments☆2,411Updated this week
- Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models☆2,842Updated 11 months ago
- Open-source tool to visualise your RAG 🔮☆1,199Updated 11 months ago
- Reaching LLaMA2 Performance with 0.1M Dollars☆988Updated last year
- OpenCodeInterpreter is a suite of open-source code generation systems aimed at bridging the gap between large language models and sophist…☆1,691Updated last year
- Deploy your agentic worfklows to production☆2,065Updated 2 weeks ago
- ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting wit…☆1,108Updated last year
- [IJCAI 2024] Generate different roles for GPTs to form a collaborative entity for complex tasks.☆1,449Updated 3 months ago
- The first open-source Artificial Narrow Intelligence generalist agentic framework Computer-Using-Agent that fully operates graphical-user…☆1,318Updated 10 months ago
- prompt2model - Generate Deployable Models from Natural Language Instructions☆2,006Updated 11 months ago
- Code for Quiet-STaR☆742Updated last year
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆3,155Updated this week
- AGI has been achieved externally☆22Updated last year
- 🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide…☆1,477Updated 5 months ago
- Run Mixtral-8x7B models in Colab or consumer desktops☆2,327Updated last year
- [ICLR 2025] Automated Design of Agentic Systems☆1,477Updated 10 months ago
- [ICML 2024] Official repository for "Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models"☆810Updated last year
- A project structure aware autonomous software engineer aiming for autonomous program improvement. Resolved 37.3% tasks (pass@1) in SWE-be…☆3,044Updated 8 months ago
- [ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct☆2,073Updated last year
- A principled instruction benchmark on formulating effective queries and prompts for large language models (LLMs). Our paper: https://arxi…☆979Updated last year
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,986Updated last year
- AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.☆1,099Updated last month