asahi417 / lmpplLinks
Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
☆157Updated 8 months ago
Alternatives and similar repositories for lmppl
Users that are interested in lmppl are comparing it to the libraries listed below
Sorting:
- ☆177Updated 2 years ago
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆249Updated 2 years ago
- Multilingual Large Language Models Evaluation Benchmark☆122Updated 9 months ago
- Codebase, data and models for the SummaC paper in TACL☆94Updated 4 months ago
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆128Updated last year
- Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"☆167Updated 3 years ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆221Updated 6 months ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆200Updated last year
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆108Updated 2 months ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- ☆75Updated 5 months ago
- ☆75Updated last year
- ☆134Updated 4 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆101Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆128Updated last year
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆476Updated last year
- Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.☆98Updated last year
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).☆57Updated 9 months ago
- Finetune mistral-7b-instruct for sentence embeddings☆82Updated last year
- A Survey of Attributions for Large Language Models☆202Updated 9 months ago
- ☆106Updated last year
- An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi☆263Updated 2 years ago
- Token-level Reference-free Hallucination Detection☆94Updated last year
- contrastive decoding☆201Updated 2 years ago
- RARR: Researching and Revising What Language Models Say, Using Language Models☆47Updated last year
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆180Updated 6 months ago
- A multi-purpose toolkit for table-to-text generation: web interface, Python bindings, CLI commands.☆55Updated last year
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆96Updated last year
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆59Updated last year
- Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"☆101Updated 2 years ago