Alternatives and similar repositories for llm-uncertainty-head

Users that are interested in llm-uncertainty-head are comparing it to the libraries listed below

• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆225Updated last year
• IINemo / lm-polygraph
  ☆414Updated this week
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆236Updated 4 months ago
• lyy1994 / awesome-data-contamination
  The Paper List on Data Contamination for Large Language Models Evaluation.
  ☆108Updated last month
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆222Updated 3 weeks ago
• nyu-mll / quality
  ☆145Updated 11 months ago
• Shangyint / langProBe
  ☆25Updated 6 months ago
• tatsu-lab / opinions_qa
  ☆116Updated last year
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆189Updated 6 months ago
• AlexTMallen / adaptive-retrieval
  ☆188Updated 6 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆145Updated last year
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆248Updated last year
• Saibo-creator / Awesome-LLM-Constrained-Decoding
  A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.
  ☆312Updated 2 months ago
• huggingface / ioi
  ☆41Updated 9 months ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆82Updated last year
• yuxiaw / Factcheck-GPT
  Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.
  ☆110Updated 2 years ago
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆323Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆170Updated last year
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆51Updated last year
• castorini / ragnarok
  Retrieval-Augmented Generation battle!
  ☆61Updated 5 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆137Updated last year
• schen149 / sub-sentence-encoder
  The official code repo for "Sub-Sentence Encoder: Contrastive Learning of Propositional Semantic Representations".
  ☆85Updated last year
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆148Updated last year
• dmg-illc / JUDGE-BENCH
  ☆37Updated 5 months ago
• neulab / knn-transformers
  PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…
  ☆285Updated 3 years ago
• ntunlp / LLMSanitize
  An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
  ☆58Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆316Updated last month
• inseq-team / inseq
  Interpretability for sequence generation models 🐛 🔍
  ☆451Updated last week
• benlipkin / decoding
  Composable inference algorithms with LLMs and programmable logic
  ☆69Updated last year
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆128Updated last year