cohere-ai / magikarp

Related projects: ⓘ

• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆182Updated last month
• allenai / bff
  ☆38Updated 5 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆109Updated 2 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆107Updated 2 weeks ago
• da03 / Internalize_CoT_Step_by_Step
  ☆77Updated last month
• yuchenlin / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆121Updated this week
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated 11 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆91Updated 5 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆131Updated 5 months ago
• SALT-NLP / demonstrated-feedback
  ☆105Updated this week
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆217Updated 2 months ago
• google-deepmind / mishax
  ☆91Updated last month
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web"
  ☆106Updated last week
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆76Updated 3 weeks ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆141Updated 4 months ago
• architsharma97 / dpo-rlaif
  ☆87Updated 2 months ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆144Updated 6 months ago
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆209Updated this week
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆39Updated 7 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆81Updated last month
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆52Updated 2 months ago
• dwzhu-pku / LongEmbed
  Official implementation for the paper "LongEmbed: Extending Embedding Models for Long Context Retrieval"
  ☆108Updated 4 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆31Updated 3 weeks ago
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆105Updated last year
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆82Updated 6 months ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆96Updated last week
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆109Updated 11 months ago
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆170Updated last month
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆82Updated last month
• jakespringer / echo-embeddings
  ☆118Updated 5 months ago