asahi417 / lmppl
Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
☆153Updated 5 months ago
Alternatives and similar repositories for lmppl:
Users that are interested in lmppl are comparing it to the libraries listed below
- Multilingual Large Language Models Evaluation Benchmark☆119Updated 7 months ago
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆242Updated 2 years ago
- Codebase, data and models for the SummaC paper in TACL☆89Updated 2 months ago
- Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"☆164Updated 3 years ago
- ☆175Updated 2 years ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆214Updated 4 months ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆198Updated last year
- PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…☆270Updated 2 years ago
- Token-level Reference-free Hallucination Detection☆94Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆176Updated 2 months ago
- ☆277Updated last year
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆100Updated 11 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆126Updated last year
- contrastive decoding☆197Updated 2 years ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆476Updated 2 months ago
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆161Updated 3 months ago
- RARR: Researching and Revising What Language Models Say, Using Language Models☆46Updated last year
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆453Updated last year
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆124Updated last year
- Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.☆89Updated last year
- ☆73Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆103Updated last year
- A Multilingual Replicable Instruction-Following Model☆93Updated last year
- ☆129Updated 2 months ago
- AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark☆133Updated 3 months ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆179Updated 2 years ago
- Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"☆30Updated 5 months ago
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆230Updated 9 months ago
- Code for Editing Factual Knowledge in Language Models☆136Updated 3 years ago