allenai / smashed
SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.
☆33Updated 11 months ago
Alternatives and similar repositories for smashed:
Users that are interested in smashed are comparing it to the libraries listed below
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆19Updated 3 months ago
- Embedding Recycling for Language models☆38Updated last year
- ☆14Updated 7 months ago
- Ranking of fine-tuned HF models as base models.☆35Updated last year
- Using Huggingface to generate relation expressions☆15Updated 4 years ago
- Code for SaGe subword tokenizer (EACL 2023)☆24Updated 5 months ago
- Large-scale query-focused multi-document Summarization dataset☆10Updated 3 years ago
- The corresponding code for our paper: "Exploring the Challenges of Open Domain Multi-Document Summarization". Do not hesitate to open an …☆32Updated last year
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- ☆8Updated 9 months ago
- Code release for Type-Aware Bi-Encoders for Open-Domain Entity Retrieval☆19Updated 2 years ago
- Few-shot Learning with Auxiliary Data☆27Updated last year
- Source code and data for Like a Good Nearest Neighbor☆28Updated 3 months ago
- Data Programming by Demonstration (DPBD) for Document Classification☆35Updated 3 years ago
- Code for the paper SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts (AKBC 2021). https://openreview.net/forum?id=OF…☆29Updated 3 years ago
- Exploring Few-Shot Adaptation of Language Models with Tables☆23Updated 2 years ago
- Code for "Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking" (https://arxiv.org/abs/2…☆14Updated 2 years ago
- ☆11Updated 4 months ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆31Updated last year
- Repository for Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts, EMNLP22☆19Updated last year
- FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction☆24Updated 2 years ago
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.☆44Updated 11 months ago
- Code for Stage-wise Fine-tuning for Graph-to-Text Generation☆26Updated 2 years ago
- CCQA A New Web-Scale Question Answering Dataset for Model Pre-Training☆32Updated 2 years ago
- ☆44Updated 5 months ago
- Multimodal extreme classification☆20Updated last year
- ☆14Updated 5 years ago
- ☆23Updated 3 months ago
- Pretraining summarization models using a corpus of nonsense☆13Updated 3 years ago
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 3 years ago