hgaurav2k / JEEBench
Repository for the code and dataset for the paper: "Have LLMs Advanced enough? Towards Harder Problem Solving Benchmarks For Large Language Models"
☆39Updated last year
Alternatives and similar repositories for JEEBench:
Users that are interested in JEEBench are comparing it to the libraries listed below
- ☆31Updated last year
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- ☆48Updated last year
- ☆28Updated last year
- ☆26Updated last year
- ☆34Updated 10 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- ☆44Updated 3 months ago
- Google Research☆46Updated 2 years ago
- ☆17Updated 4 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆65Updated 6 months ago
- ☆26Updated last month
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Updated last week
- Repository for Skill Set Optimization☆12Updated 6 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆52Updated 10 months ago
- A framework for few-shot evaluation of autoregressive language models.☆24Updated last year
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆25Updated 10 months ago
- Efficient Scaling laws and collaborative pretraining.☆14Updated 3 weeks ago
- ☆18Updated 8 months ago
- A library to create and manage configuration files, especially for machine learning projects.☆76Updated 2 years ago
- Minimum Description Length probing for neural network representations☆18Updated 3 weeks ago
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 2 years ago
- ☆72Updated 9 months ago
- Utilities for Training Very Large Models☆57Updated 4 months ago
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆69Updated last year
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆41Updated last year
- ☆80Updated 11 months ago