Alternatives and similar repositories for StructTest

Users that are interested in StructTest are comparing it to the libraries listed below

• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆35Updated 9 months ago
• kaistAI / factual-knowledge-acquisition
  ☆21Updated 2 months ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆47Updated 6 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated 10 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆46Updated 4 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆33Updated 4 months ago
• nuochenpku / LLaMA_Analysis
  This is official project in our paper: Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers
  ☆30Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 6 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆56Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated 11 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆43Updated last year
• scandukuri / assistant-gate
  ☆26Updated last year
• googleinterns / localizing-paragraph-memorization
  ☆14Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• SALT-NLP / demonstrated-feedback
  ☆124Updated 9 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated last year
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆45Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• OSU-NLP-Group / reversal-curse-binding
  ☆23Updated 3 months ago
• neulab / data-agora
  [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆33Updated 7 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆45Updated 7 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆86Updated last year
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆29Updated last year
• allenai / super-benchmark
  ☆45Updated 3 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 5 months ago
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆31Updated 5 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆90Updated 8 months ago
• google-deepmind / bbeh
  ☆83Updated 2 months ago
• psunlpgroup / ReaLMistake
  This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".
  ☆30Updated 11 months ago
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year