allenai / smashed
SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.
☆31Updated 7 months ago
Alternatives and similar repositories for smashed:
Users that are interested in smashed are comparing it to the libraries listed below
- Embedding Recycling for Language models☆38Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆17Updated 3 months ago
- Ranking of fine-tuned HF models as base models.☆35Updated last year
- ☆14Updated 3 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆45Updated last year
- Code for "Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking" (https://arxiv.org/abs/2…☆12Updated last year
- Few-shot Learning with Auxiliary Data☆26Updated last year
- Code for SaGe subword tokenizer (EACL 2023)☆22Updated last month
- 🌾 Universal, customizable and deployable fine-grained evaluation for text generation.☆22Updated last year
- Large-scale query-focused multi-document Summarization dataset☆10Updated 3 years ago
- FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction☆24Updated 2 years ago
- Repository for Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts, EMNLP22☆18Updated last year
- Pre-train Static Word Embeddings☆32Updated this week
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Updated last year
- The corresponding code for our paper: "Exploring the Challenges of Open Domain Multi-Document Summarization". Do not hesitate to open an …☆31Updated last year
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 2 years ago
- CCQA A New Web-Scale Question Answering Dataset for Model Pre-Training☆32Updated 2 years ago
- Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021☆29Updated last year
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- ☆18Updated 2 years ago
- ☆12Updated 5 months ago
- Exploring Few-Shot Adaptation of Language Models with Tables☆23Updated 2 years ago
- Combining encoder-based language models☆11Updated 3 years ago
- Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents☆23Updated 2 years ago
- Source code and data for Like a Good Nearest Neighbor☆28Updated this week
- ☆22Updated 2 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- ZS4IE: A Toolkit for Zero-Shot Information Extraction with Simple Verbalizations☆26Updated 2 years ago
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.☆44Updated 8 months ago
- Using short models to classify long texts☆21Updated last year