Tools for managing datasets for governance and training.
☆91Oct 12, 2026Updated 3 weeks ago
Alternatives and similar repositories for data_tooling
Users that are interested in data_tooling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆318Mar 20, 2023Updated 3 years ago
- Personal information identification standard☆21Jan 24, 2024Updated 2 years ago
- ☆13Aug 23, 2024Updated 2 years ago
- Generate BERT vocabularies and pretraining examples from Wikipedias☆17May 11, 2020Updated 6 years ago
- Submission for AIviVN sentiment analysis contest https://www.aivivn.com/contests/1☆15Oct 12, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- All-in-one text de-duplication☆765Mar 9, 2026Updated 7 months ago
- The pipeline for the OSCAR corpus☆178Nov 9, 2025Updated 11 months ago
- generative language model training on top of the JAX and Huggingface 🤗☆10May 11, 2022Updated 4 years ago
- Thử nghiệm gần đây mô hình MLP-Mixer trên bài toán nhận diện cảm xúc (Sentiment sentiment analysis)☆13Jul 9, 2021Updated 5 years ago
- Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.☆1,020Jul 29, 2024Updated 2 years ago
- machine translation data process tools☆10Apr 29, 2024Updated 2 years ago
- Code and Data for Evaluation WG☆42May 4, 2022Updated 4 years ago
- ☆35Apr 18, 2021Updated 5 years ago
- Multilingual bert retrained on news + squad2 for vietnamese☆23Feb 16, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Pre-training script for BART in JAX/Flax☆37Aug 4, 2022Updated 4 years ago
- Library for fast text representation and classification.☆31Jan 9, 2024Updated 2 years ago
- Pipeline for pulling and processing online language model pretraining data from the web☆180Jul 31, 2023Updated 3 years ago
- I-SHEEP: Iterative Self-enHancEmEnt Paradigm of LLMs through Self-Instruct and Self-Assessment☆17Jan 16, 2025Updated last year
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆75Mar 2, 2024Updated 2 years ago
- a ducttape workflow for neural machine translation☆14Mar 23, 2021Updated 5 years ago
- ☆78Dec 7, 2023Updated 2 years ago
- ☆1,274Jul 30, 2024Updated 2 years ago
- Publicly released data: sense anaphora annotations.☆10Mar 31, 2016Updated 10 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- CMU Linguistic Annotation Backend☆15Sep 22, 2025Updated last year
- Remove duplicates and near-duplicates from text corpora, no matter the scale.☆13Nov 24, 2023Updated 2 years ago
- A utility for storing and reading files for Korean LM training 💾☆35Jul 18, 2026Updated 3 months ago
- a compact audio-to-phoneme aligner for singing voice☆12Jan 17, 2024Updated 2 years ago
- QLoRA with Enhanced Multi GPU Support☆38Aug 8, 2023Updated 3 years ago
- MTet: Multi-domain Translation for English and Vietnamese☆201Feb 7, 2023Updated 3 years ago
- ☆12Oct 22, 2019Updated 7 years ago
- 청와대 국민청원 데이터 아카이브☆16Aug 29, 2020Updated 6 years ago
- ☆12Apr 3, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆12Dec 9, 2015Updated 10 years ago
- Code for EMNLP2021 paper "Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training"☆20Nov 12, 2021Updated 4 years ago
- ☆16Aug 14, 2026Updated 2 months ago
- Extracts plain text, language identification and more metadata from WARC records☆22Apr 16, 2026Updated 6 months ago
- Diapositivas, notebooks y material de charlas, talleres y el grupo de estudio☆12Apr 24, 2024Updated 2 years ago
- ☆502Aug 15, 2024Updated 2 years ago
- Here you can read the documentation for the AI Human.☆11Sep 29, 2026Updated last month