Tools for managing datasets for governance and training.
☆90Mar 16, 2026Updated 3 weeks ago
Alternatives and similar repositories for data_tooling
Users that are interested in data_tooling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆318Mar 20, 2023Updated 3 years ago
- ☆13Aug 23, 2024Updated last year
- Personal information identification standard☆21Jan 24, 2024Updated 2 years ago
- Submission for AIviVN sentiment analysis contest https://www.aivivn.com/contests/1☆15Oct 12, 2021Updated 4 years ago
- All-in-one text de-duplication☆750Mar 9, 2026Updated last month
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- Library for fast text representation and classification.☆31Jan 9, 2024Updated 2 years ago
- Code and Data for Evaluation WG☆42May 4, 2022Updated 3 years ago
- Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.☆1,010Jul 29, 2024Updated last year
- machine translation data process tools☆10Apr 29, 2024Updated last year
- a ducttape workflow for neural machine translation☆14Mar 23, 2021Updated 5 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆74Mar 2, 2024Updated 2 years ago
- I-SHEEP: Iterative Self-enHancEmEnt Paradigm of LLMs through Self-Instruct and Self-Assessment☆17Jan 16, 2025Updated last year
- Pre-training script for BART in JAX/Flax☆38Aug 4, 2022Updated 3 years ago
- Tools for curating biomedical training data for large-scale language modeling☆496Dec 9, 2024Updated last year
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Semeval-2021 Multilingual and Cross-lingual Word-in-Context Task☆18May 27, 2021Updated 4 years ago
- Converting irregularly spaced time series, such as eletronic health records, into dataframes for tabular classification.☆19Jun 17, 2025Updated 9 months ago
- 청와대 국민청원 데이터 아카이브☆15Aug 29, 2020Updated 5 years ago
- Pipeline for pulling and processing online language model pretraining data from the web☆178Jul 31, 2023Updated 2 years ago
- ☆12Dec 9, 2015Updated 10 years ago
- Viewer for text datasets in formats like HuggingFace, JSONL, etc.☆15Feb 25, 2025Updated last year
- a compact audio-to-phoneme aligner for singing voice☆12Jan 17, 2024Updated 2 years ago
- QLoRA with Enhanced Multi GPU Support☆38Aug 8, 2023Updated 2 years ago
- ☆12Dec 15, 2022Updated 3 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- UFSAC is a resource containing all WordNet Sense Annotated Corpora, and a Java library for manipulating them☆38May 17, 2022Updated 3 years ago
- Official implementation of ECCV24 paper: POA☆24Aug 8, 2024Updated last year
- ☆12Oct 22, 2019Updated 6 years ago
- An ensemble system with a search engine for relevant document retrieval and a deep learning model (BERT) for machine comprehension in Vie…☆14Oct 17, 2019Updated 6 years ago
- The pipeline for the OSCAR corpus☆176Nov 9, 2025Updated 5 months ago
- NLP Affective Computing - text-based emotion recognition with Deep Learning and LLMs☆16Nov 10, 2025Updated 5 months ago
- ☆12Updated this week
- Machine Reading Comprehension special for the Vietnamese language☆41Mar 13, 2022Updated 4 years ago
- Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"☆26Jun 3, 2025Updated 10 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆1,266Jul 30, 2024Updated last year
- Anh - LAION's multilingual assistant datasets and models☆28Apr 5, 2023Updated 3 years ago
- 56 language, 1 model Multilingual ASR☆24Jul 25, 2021Updated 4 years ago
- kogpt를 oslo로 파인튜닝하는 예제.☆23Aug 26, 2022Updated 3 years ago
- ☆95Jul 16, 2022Updated 3 years ago
- A library for squeakily cleaning and filtering language datasets.☆50Jul 10, 2023Updated 2 years ago
- Diapositivas, notebooks y material de charlas, talleres y el grupo de estudio☆11Apr 24, 2024Updated last year