Alternatives and similar repositories for loft:

Users that are interested in loft are comparing it to the libraries listed below

• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆218Updated 4 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆102Updated 3 weeks ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆136Updated 4 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆194Updated this week
• zorazrw / awesome-tool-llm
  ☆214Updated 6 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆202Updated this week
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆521Updated 2 weeks ago
• bigai-nlco / LooGLE
  ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
  ☆177Updated 5 months ago
• QwenLM / ProcessBench
  ☆143Updated 2 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆130Updated 4 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆115Updated 9 months ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆156Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆172Updated 3 months ago
• nightdessert / Retrieval_Head
  open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality
  ☆178Updated 7 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆153Updated this week
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆157Updated 10 months ago
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆163Updated last week
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆232Updated 4 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆79Updated 7 months ago
• SALT-NLP / demonstrated-feedback
  ☆119Updated 5 months ago
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆294Updated 6 months ago
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆204Updated 9 months ago
• openai / safety-rbr-code-and-data
  Code and example data for the paper: Rule Based Rewards for Language Model Safety
  ☆180Updated 7 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆147Updated 11 months ago
• SuperBruceJia / Awesome-LLM-Self-Consistency
  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models
  ☆91Updated 7 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆155Updated 3 months ago
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆130Updated 5 months ago
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆114Updated 5 months ago
• MozerWang / Loong
  [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
  ☆114Updated 4 months ago