hgaurav2k / JEEBench
Repository for the code and dataset for the paper: "Have LLMs Advanced enough? Towards Harder Problem Solving Benchmarks For Large Language Models"
☆39Updated last year
Alternatives and similar repositories for JEEBench:
Users that are interested in JEEBench are comparing it to the libraries listed below
- Minimum Description Length probing for neural network representations☆18Updated last week
- ☆48Updated 11 months ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆47Updated 2 years ago
- ☆44Updated last year
- Google Research☆46Updated 2 years ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆64Updated 5 months ago
- Using FlexAttention to compute attention with different masking patterns☆40Updated 3 months ago
- ☆18Updated 7 months ago
- Few-shot Learning with Auxiliary Data☆26Updated last year
- ☆26Updated 6 months ago
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 2 years ago
- ☆39Updated 2 years ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- ☆46Updated 2 months ago
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆35Updated last year
- NeurIPS 2024 tutorial on LLM Inference☆37Updated last month
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆25Updated 9 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- ☆29Updated last year
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆16Updated last month
- ☆17Updated 3 months ago
- ☆32Updated last year
- ☆26Updated last year
- ☆47Updated 6 months ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆21Updated 4 months ago
- On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability☆36Updated 2 months ago
- ☆28Updated 3 years ago
- PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022)☆71Updated 2 years ago
- ☆80Updated 3 months ago