HannahKirk / prism-alignment

Related projects ⓘ

Alternatives and complementary repositories for prism-alignment

• BunsenFeng / AbstainQA
  AbstainQA, ACL 2024
  ☆19Updated last month
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆108Updated last year
• tatsu-lab / opinions_qa
  ☆94Updated 6 months ago
• BunsenFeng / PoliLean
  Code for "From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Mod…
  ☆29Updated 8 months ago
• tsor13 / kaleido
  ☆21Updated 8 months ago
• edenbiran / HoppingTooLate
  Exploring the Limitations of Large Language Models on Multi-Hop Queries
  ☆16Updated 4 months ago
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆30Updated 8 months ago
• ZhaofengWu / counterfactual-evaluation
  ☆46Updated 10 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆49Updated 9 months ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆63Updated last year
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 2 months ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆18Updated 4 months ago
• princeton-nlp / LM-Science-Tutor
  ☆36Updated 3 months ago
• Tiiiger / benchmark_llm_summarization
  ☆33Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated last year
• salesforce / creativity_eval
  ☆25Updated last week
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆55Updated last year
• NoviScl / GPT3-Reliability
  ☆76Updated last year
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆61Updated 7 months ago
• ntunlp / LLMSanitize
  An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
  ☆43Updated 3 months ago
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆107Updated last month
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆31Updated 3 months ago
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; arXiv preprint arXiv:2403.…
  ☆37Updated 4 months ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆40Updated 11 months ago
• jmerullo / lm_vector_arithmetic
  ☆28Updated last year
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆53Updated last year
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆54Updated 10 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆85Updated 3 years ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆78Updated 3 months ago
• fc2869 / lo-fit
  LoFiT: Localized Fine-tuning on LLM Representations
  ☆21Updated 4 months ago