jackbandy / bookcorpus-datasheet
Documentation effort for the BookCorpus dataset
☆34Updated 3 years ago
Alternatives and similar repositories for bookcorpus-datasheet
Users that are interested in bookcorpus-datasheet are comparing it to the libraries listed below
Sorting:
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆22Updated 2 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆41Updated 3 years ago
- ☆14Updated 7 months ago
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆14Updated last year
- Ranking of fine-tuned HF models as base models.☆35Updated last week
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆33Updated 11 months ago
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated 4 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Source code and data for Like a Good Nearest Neighbor☆28Updated 4 months ago
- ☆44Updated 6 months ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆31Updated last year
- Finding semantically meaningful and accurate prompts.☆46Updated last year
- ☆27Updated 2 months ago
- 🌾 Universal, customizable and deployable fine-grained evaluation for text generation.☆23Updated last year
- ☆27Updated 4 years ago
- ☆22Updated 3 years ago
- Apps built using Inspired Cognition's Critique.☆58Updated 2 years ago
- ☆29Updated last year
- Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021☆29Updated 2 years ago
- Using short models to classify long texts☆21Updated 2 years ago
- Embedding Recycling for Language models☆38Updated last year
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆48Updated last week
- ☆72Updated last year
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 3 years ago
- Code for SaGe subword tokenizer (EACL 2023)☆24Updated 5 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 7 months ago
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.☆44Updated last year
- ☆25Updated 2 years ago
- Library for fast text representation and classification.☆28Updated last year