cohere-ai / magikarpLinks
Code for the paper "Fishing for Magikarp"
☆157Updated 2 months ago
Alternatives and similar repositories for magikarp
Users that are interested in magikarp are comparing it to the libraries listed below
Sorting:
- Functional Benchmarks and the Reasoning Gap☆88Updated 9 months ago
- Code for Zero-Shot Tokenizer Transfer☆133Updated 6 months ago
- Evaluating LLMs with fewer examples☆160Updated last year
- RuLES: a benchmark for evaluating rule-following in language models☆227Updated 4 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆206Updated last month
- ☆134Updated 3 months ago
- The official evaluation suite and dynamic data release for MixEval.☆242Updated 8 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆229Updated 8 months ago
- A simple unified framework for evaluating LLMs☆225Updated 3 months ago
- Replicating O1 inference-time scaling laws☆89Updated 7 months ago
- ☆117Updated 4 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆306Updated last year
- Reproducible, flexible LLM evaluations☆219Updated this week
- Manage scalable open LLM inference endpoints in Slurm clusters☆265Updated last year
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆138Updated 8 months ago
- code for training & evaluating Contextual Document Embedding models☆194Updated 2 months ago
- A toolkit for describing model features and intervening on those features to steer behavior.☆193Updated 8 months ago
- Language models scale reliably with over-training and on downstream tasks☆97Updated last year
- ☆99Updated last year
- Extract full next-token probabilities via language model APIs☆246Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆184Updated last week
- Code repository for the c-BTM paper☆106Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆90Updated 8 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆223Updated 7 months ago
- ☆66Updated last year
- ☆124Updated 9 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 11 months ago
- PyTorch library for Active Fine-Tuning☆87Updated 5 months ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆221Updated 8 months ago
- ☆75Updated last year