asahi417 / lmppl
Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
☆150Updated 4 months ago
Alternatives and similar repositories for lmppl:
Users that are interested in lmppl are comparing it to the libraries listed below
- Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"☆164Updated 3 years ago
- ☆174Updated 2 years ago
- ☆271Updated last year
- Multilingual Large Language Models Evaluation Benchmark☆117Updated 6 months ago
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆238Updated 2 years ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆195Updated last year
- BARTScore: Evaluating Generated Text as Text Generation☆341Updated 2 years ago
- contrastive decoding☆193Updated 2 years ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆179Updated 2 years ago
- Finetune mistral-7b-instruct for sentence embeddings☆78Updated 9 months ago
- Token-level Reference-free Hallucination Detection☆94Updated last year
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆71Updated 3 years ago
- Zero-shot Document Ranking with Large Language Models.☆109Updated 7 months ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆206Updated 3 months ago
- A framework for few-shot evaluation of autoregressive language models.☆102Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆99Updated 10 months ago
- Text classification with Foundation Language Model LLaMA☆114Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆125Updated 11 months ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆92Updated last year
- Codebase, data and models for the SummaC paper in TACL☆87Updated 3 weeks ago
- Scalable training for dense retrieval models.☆275Updated last year
- A Multilingual Replicable Instruction-Following Model☆94Updated last year
- Efficient Attention for Long Sequence Processing☆92Updated last year
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"☆293Updated last year
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆121Updated 11 months ago
- PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…☆271Updated 2 years ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆83Updated 6 months ago
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆131Updated 2 months ago
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆333Updated last year