asahi417 / lmpplLinks
Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
☆159Updated last week
Alternatives and similar repositories for lmppl
Users that are interested in lmppl are comparing it to the libraries listed below
Sorting:
- Codebase, data and models for the SummaC paper in TACL☆96Updated 4 months ago
- Token-level Reference-free Hallucination Detection☆94Updated last year
- Multilingual Large Language Models Evaluation Benchmark☆124Updated 10 months ago
- ☆179Updated 2 weeks ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆221Updated 7 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆103Updated last year
- A Multilingual Replicable Instruction-Following Model☆93Updated 2 years ago
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆252Updated 2 years ago
- Code for Multilingual Eval of Generative AI paper published at EMNLP 2023☆69Updated last year
- ☆75Updated last year
- ☆135Updated 5 months ago
- contrastive decoding☆201Updated 2 years ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆180Updated 2 years ago
- Wrapper to easily generate the chat template for Llama2☆65Updated last year
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).☆57Updated 10 months ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆202Updated last year
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆81Updated last week
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆80Updated 4 years ago
- Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"☆167Updated 3 years ago
- Text classification with Foundation Language Model LLaMA☆114Updated 2 years ago
- A curated list of research papers and resources on Cultural LLM.☆44Updated 9 months ago
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆138Updated 6 months ago
- ☆176Updated 11 months ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆109Updated 3 months ago
- Repository for research in the field of Responsible NLP at Meta.☆199Updated last month
- ☆75Updated 6 months ago
- A Survey of Attributions for Large Language Models☆203Updated 10 months ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆91Updated last year
- Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"☆101Updated 2 years ago