Alternatives and similar repositories for lmppl:

Users that are interested in lmppl are comparing it to the libraries listed below

• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆115Updated 4 months ago
• jinlanfu / GPTScore
  Source Code of Paper "GPTScore: Evaluate as You Desire"
  ☆238Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆200Updated 2 months ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated last year
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆87Updated 2 weeks ago
• google-research / longt5
  ☆182Updated last year
• mkshing / Prompt-Tuning
  Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"
  ☆164Updated 3 years ago
• AlexTMallen / adaptive-retrieval
  ☆173Updated last year
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆119Updated 10 months ago
• neulab / BARTScore
  BARTScore: Evaluating Generated Text as Text Generation
  ☆337Updated 2 years ago
• neulab / knn-transformers
  PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…
  ☆271Updated 2 years ago
• XiangLi1999 / ContrastiveDecoding
  contrastive decoding
  ☆190Updated 2 years ago
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆74Updated 8 months ago
• nyu-mll / quality
  ☆124Updated this week
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• maszhongming / UniEval
  Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation
  ☆195Updated 11 months ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆179Updated 2 years ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆273Updated last year
• kasnerz / tabgenie
  A multi-purpose toolkit for table-to-text generation: web interface, Python bindings, CLI commands.
  ☆55Updated 8 months ago
• faridlazuarda / cultural-llm-papers
  A curated list of research papers and resources on Cultural LLM.
  ☆32Updated 3 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆93Updated last year
• ielab / llm-rankers
  Zero-shot Document Ranking with Large Language Models.
  ☆102Updated 6 months ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆99Updated 8 months ago
• alon-albalak / data-selection-survey
  A Survey on Data Selection for Language Models
  ☆202Updated 3 months ago
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆96Updated last month
• salesforce / factCC
  Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper
  ☆290Updated last year
• DevSinghSachan / unsupervised-passage-reranking
  Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"
  ☆99Updated 2 years ago
• nlpyang / geval
  Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
  ☆280Updated 11 months ago
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆314Updated 8 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆102Updated last year