neulab / gemini-benchmark
☆149Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for gemini-benchmark
- Benchmarking LLMs with Challenging Tasks from Real Users☆194Updated last week
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆106Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆72Updated 3 months ago
- ☆111Updated last month
- Scaling Data-Constrained Language Models☆321Updated last month
- Self-Alignment with Principle-Following Reward Models☆148Updated 8 months ago
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆211Updated last year
- LOFT: A 1 Million+ Token Long-Context Benchmark☆142Updated 2 weeks ago
- ☆124Updated 6 months ago
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆216Updated 7 months ago
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆109Updated last year
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆200Updated 5 months ago
- Codebase accompanying the Summary of a Haystack paper.☆71Updated last month
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".☆156Updated 6 months ago
- ☆116Updated 5 months ago
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.☆302Updated 6 months ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆153Updated 3 months ago
- Multimodal language model benchmark, featuring challenging examples☆148Updated 2 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆124Updated 2 weeks ago
- PASTA: Post-hoc Attention Steering for LLMs☆107Updated 2 months ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆114Updated this week
- 🚢 Data Toolkit for Sailor Language Models☆81Updated 4 months ago
- This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Aji…☆207Updated last year
- ☆266Updated 11 months ago
- ☆89Updated 4 months ago
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆102Updated 6 months ago
- A pipeline to improve skills of large language models☆187Updated this week
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆57Updated 7 months ago
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆106Updated 2 weeks ago
- Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is al…☆110Updated last year