sileod / tasknet
Easy multi-task learning with HuggingFace Datasets and Trainer
☆56Updated 3 months ago
Alternatives and similar repositories for tasknet:
Users that are interested in tasknet are comparing it to the libraries listed below
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆180Updated 3 months ago
- This repository contains the code for the paper 'PARM: Paragraph Aggregation Retrieval Model for Dense Document-to-Document Retrieval' pu…☆40Updated 3 years ago
- No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval☆29Updated 2 years ago
- ☆54Updated 2 years ago
- A curated list of research papers and resources on Cultural LLM.☆42Updated 7 months ago
- Multi-task modelling extensions for huggingface transformers☆20Updated 2 years ago
- ☆28Updated last year
- ☆34Updated 6 months ago
- ☆33Updated last year
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆55Updated 2 years ago
- 🌏 Modular retrievers for zero-shot multilingual IR.☆27Updated last year
- A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.☆71Updated 8 months ago
- The autoregressive information extraction system GenIE (Generative Information Extraction) implemented in PyTorch.☆102Updated 2 years ago
- This repository contains materials for the SIGIR 2022 tutorial on opinion summarization.☆34Updated 2 years ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆100Updated last year
- ☆22Updated 3 years ago
- ☆39Updated 4 months ago
- ☆46Updated last year
- Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"☆48Updated 2 years ago
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Updated 2 years ago
- Open source library for few shot NLP☆78Updated last year
- Tools for managing datasets for governance and training.☆85Updated 2 months ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆57Updated 10 months ago
- [ACL 2023] Few-shot Reranking for Multi-hop QA via Language Model Prompting☆27Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆19Updated 2 months ago
- ☆29Updated last year
- ☆38Updated 2 years ago
- ☆68Updated 3 years ago