asahi417 / lmpplLinks
Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
☆164Updated 5 months ago
Alternatives and similar repositories for lmppl
Users that are interested in lmppl are comparing it to the libraries listed below
Sorting:
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆214Updated last year
- ☆189Updated 5 months ago
- Multilingual Large Language Models Evaluation Benchmark☆133Updated last year
- Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"☆168Updated 4 years ago
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆257Updated 2 years ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆224Updated last year
- Token-level Reference-free Hallucination Detection☆97Updated 2 years ago
- Scaling Sentence Embeddings with Large Language Models☆109Updated last year
- A Multilingual Replicable Instruction-Following Model☆95Updated 2 years ago
- Finetune mistral-7b-instruct for sentence embeddings☆88Updated last year
- BARTScore: Evaluating Generated Text as Text Generation☆365Updated 3 years ago
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆215Updated last year
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆146Updated last year
- Codebase, data and models for the SummaC paper in TACL☆105Updated 10 months ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆182Updated 3 years ago
- ☆83Updated this week
- A Survey of Attributions for Large Language Models☆220Updated last year
- A curated list of research papers and resources on Cultural LLM.☆52Updated last year
- Long Document Summarization Papers☆154Updated 2 years ago
- Datasets for Instruction Tuning of Large Language Models☆259Updated 2 years ago
- ☆252Updated last year
- Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"☆100Updated 3 years ago
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆81Updated last week
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆94Updated 2 years ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆135Updated last year
- A Simple but Powerful SOTA NER Model | Official Code For Label Supervised LLaMA Finetuning☆154Updated last year
- contrastive decoding☆204Updated 3 years ago
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆189Updated 10 months ago
- Scalable training for dense retrieval models.☆298Updated 6 months ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆165Updated 2 years ago