asahi417 / lmppl
Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
☆137Updated last month
Related projects ⓘ
Alternatives and complementary repositories for lmppl
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆231Updated last year
- Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"☆161Updated 3 years ago
- ☆167Updated last year
- Multilingual Large Language Models Evaluation Benchmark☆107Updated 3 months ago
- A Survey on Data Selection for Language Models☆182Updated last month
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆193Updated 9 months ago
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆292Updated 6 months ago
- BARTScore: Evaluating Generated Text as Text Generation☆325Updated 2 years ago
- Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"☆262Updated 9 months ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆177Updated 2 years ago
- ☆265Updated 11 months ago
- contrastive decoding☆181Updated 2 years ago
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆412Updated 9 months ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆54Updated 10 months ago
- Token-level Reference-free Hallucination Detection☆93Updated last year
- RARR: Researching and Revising What Language Models Say, Using Language Models☆43Updated last year
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆278Updated 2 months ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆191Updated this week
- A Multilingual Replicable Instruction-Following Model☆94Updated last year
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆160Updated last year
- Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"☆96Updated last year
- Scaling Sentence Embeddings with Large Language Models☆98Updated 8 months ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆91Updated last year
- Code for the paper Code for the paper InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning☆97Updated last year
- On Transferability of Prompt Tuning for Natural Language Processing☆97Updated 6 months ago
- ☆68Updated 9 months ago
- This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Aji…☆208Updated last year
- ☆122Updated 2 months ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆429Updated 6 months ago
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆67Updated 3 years ago