r2llab / wranglLinks
Parallel data preprocessing for NLP and ML.
☆34Updated 7 months ago
Alternatives and similar repositories for wrangl
Users that are interested in wrangl are comparing it to the libraries listed below
Sorting:
- Shared code for training sentence embeddings with Flax / JAX☆27Updated 3 years ago
- Embedding Recycling for Language models☆38Updated last year
- ☆67Updated 2 years ago
- A library to create and manage configuration files, especially for machine learning projects.☆78Updated 3 years ago
- A diff tool for language models☆42Updated last year
- Execute arbitrary SQL queries on 🤗 Datasets☆32Updated last year
- This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…☆26Updated 2 years ago
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated 4 months ago
- ☆54Updated last year
- Exploring Few-Shot Adaptation of Language Models with Tables☆23Updated 2 years ago
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆33Updated last year
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- ☆19Updated last year
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 3 years ago
- Dense Passage Retrieval using tensorflow-keras on TPU☆15Updated 3 years ago
- ☆76Updated 3 years ago
- RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!☆41Updated 2 years ago
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆83Updated 6 months ago
- The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…☆67Updated 2 years ago
- A case study of efficient training of large language models using commodity hardware.☆69Updated 2 years ago
- ☆13Updated last year
- ☆21Updated 3 years ago
- CCQA A New Web-Scale Question Answering Dataset for Model Pre-Training☆32Updated 2 years ago
- ☆13Updated 6 years ago
- This repository contains example code to build models on TPUs☆30Updated 2 years ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆16Updated 3 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Repository collecting resources and best practices to improve experimental rigour in deep learning research.☆27Updated 2 years ago
- ☆31Updated last month
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆61Updated last year