reka-ai / reka-vibe-evalLinks
Multimodal language model benchmark, featuring challenging examples
☆176Updated 9 months ago
Alternatives and similar repositories for reka-vibe-eval
Users that are interested in reka-vibe-eval are comparing it to the libraries listed below
Sorting:
- This repository is maintained to release dataset and models for multimodal puzzle reasoning.☆104Updated 7 months ago
- M4 experiment logbook☆58Updated 2 years ago
- LL3M: Large Language and Multi-Modal Model in Jax☆74Updated last year
- Self-Alignment with Principle-Following Reward Models☆166Updated 2 weeks ago
- Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…☆206Updated last year
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆213Updated 3 weeks ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆241Updated 11 months ago
- Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding☆53Updated 9 months ago
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆180Updated 3 months ago
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆131Updated last year
- ☆100Updated last year
- ☆77Updated 2 weeks ago
- ☆150Updated last year
- ☆105Updated last year
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆143Updated 10 months ago
- ☆192Updated 5 months ago
- This is the official repository for Inheritune.☆113Updated 7 months ago
- Evaluating LLMs with fewer examples☆161Updated last year
- 🚢 Data Toolkit for Sailor Language Models☆94Updated 7 months ago
- ☆123Updated 7 months ago
- Public Inflection Benchmarks☆68Updated last year
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆105Updated 6 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆48Updated last year
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"☆54Updated 4 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆141Updated last year
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆116Updated last month
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆148Updated 11 months ago
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆65Updated 7 months ago
- ☆136Updated 10 months ago