asahi417 / lmpplLinks
Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
☆166Updated 7 months ago
Alternatives and similar repositories for lmppl
Users that are interested in lmppl are comparing it to the libraries listed below
Sorting:
- Multilingual Large Language Models Evaluation Benchmark☆133Updated last year
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆214Updated 2 years ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆227Updated last year
- Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"☆167Updated 4 years ago
- ☆187Updated 7 months ago
- Token-level Reference-free Hallucination Detection☆98Updated 2 years ago
- GEMBA — GPT Estimation Metric Based Assessment☆145Updated last month
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆258Updated 2 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆367Updated 3 years ago
- A curated list of research papers and resources on Cultural LLM.☆53Updated last year
- ☆254Updated last year
- A Multilingual Replicable Instruction-Following Model☆96Updated 2 years ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆107Updated last year
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆225Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆136Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆95Updated 2 years ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆96Updated 2 years ago
- ☆84Updated this week
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆150Updated last year
- ☆294Updated 2 years ago
- Finetune mistral-7b-instruct for sentence embeddings☆88Updated last year
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆415Updated 10 months ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆183Updated 3 years ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆165Updated 2 years ago
- Codebase, data and models for the SummaC paper in TACL☆108Updated last year
- Reverse Instructions to generate instruction tuning data with corpus examples☆215Updated last year
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆552Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆106Updated 2 years ago
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆72Updated last year
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆373Updated 2 years ago