allenai / smashedLinks
SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.
☆33Updated last year
Alternatives and similar repositories for smashed
Users that are interested in smashed are comparing it to the libraries listed below
Sorting:
- ☆14Updated 8 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆21Updated 4 months ago
- Exploring Few-Shot Adaptation of Language Models with Tables☆23Updated 2 years ago
- Embedding Recycling for Language models☆38Updated last year
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 3 years ago
- The corresponding code for our paper: "Exploring the Challenges of Open Domain Multi-Document Summarization". Do not hesitate to open an …☆32Updated last year
- Repository for Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts, EMNLP22☆19Updated 2 years ago
- Ranking of fine-tuned HF models as base models.☆35Updated last month
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval☆29Updated 2 years ago
- Code and pre-trained models for "ReasonBert: Pre-trained to Reason with Distant Supervision", EMNLP'2021☆29Updated 2 years ago
- ☆19Updated 3 years ago
- Large-scale query-focused multi-document Summarization dataset☆10Updated 3 years ago
- Code for SaGe subword tokenizer (EACL 2023)☆25Updated 6 months ago
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.☆44Updated last year
- Code release for Type-Aware Bi-Encoders for Open-Domain Entity Retrieval☆19Updated 2 years ago
- CCQA A New Web-Scale Question Answering Dataset for Model Pre-Training☆32Updated 2 years ago
- Using Huggingface to generate relation expressions☆15Updated 4 years ago
- Code for co-training large language models (e.g. T0) with smaller ones (e.g. BERT) to boost few-shot performance☆17Updated 2 years ago
- Few-shot Learning with Auxiliary Data☆28Updated last year
- Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents☆24Updated 3 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Code for the paper SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts (AKBC 2021). https://openreview.net/forum?id=OF…☆29Updated 3 years ago
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Updated 2 years ago
- Weakly Supervised Text-to-SQL Parsing through Question Decomposition☆22Updated last year
- Source code and data for Like a Good Nearest Neighbor☆29Updated 5 months ago
- Data Programming by Demonstration (DPBD) for Document Classification☆35Updated 4 years ago
- Tokenization across languages. Useful as preprocessing for subword tokenization.☆22Updated 2 years ago
- ☆12Updated 6 months ago
- ☆44Updated 7 months ago
- ☆11Updated 2 years ago