asahi417 / lmpplLinks
Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
☆163Updated 3 months ago
Alternatives and similar repositories for lmppl
Users that are interested in lmppl are comparing it to the libraries listed below
Sorting:
- ☆186Updated 2 months ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆210Updated last year
- Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"☆167Updated 4 years ago
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆256Updated 2 years ago
- Token-level Reference-free Hallucination Detection☆96Updated 2 years ago
- Multilingual Large Language Models Evaluation Benchmark☆131Updated last year
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆163Updated last year
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆197Updated 9 months ago
- Finetune mistral-7b-instruct for sentence embeddings☆86Updated last year
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆224Updated 10 months ago
- RARR: Researching and Revising What Language Models Say, Using Language Models☆48Updated 2 years ago
- ☆78Updated last year
- BARTScore: Evaluating Generated Text as Text Generation☆357Updated 3 years ago
- ☆287Updated last year
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆138Updated last year
- contrastive decoding☆203Updated 2 years ago
- A Multilingual Replicable Instruction-Following Model☆95Updated 2 years ago
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆510Updated last year
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆70Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆94Updated 2 years ago
- On Transferability of Prompt Tuning for Natural Language Processing☆100Updated last year
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆182Updated 2 years ago
- Long Document Summarization Papers☆149Updated 2 years ago
- DSIR large-scale data selection framework for language model training☆258Updated last year
- Scaling Sentence Embeddings with Large Language Models☆111Updated last year
- Text classification with Foundation Language Model LLaMA☆114Updated 2 years ago
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆359Updated last year
- Repo for "On Learning to Summarize with Large Language Models as References"☆43Updated 2 years ago
- A Survey of Attributions for Large Language Models☆213Updated last year
- PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…☆279Updated 2 years ago