Common tools for data processing
☆22Dec 8, 2025Updated 3 months ago
Alternatives and similar repositories for datatools
Users that are interested in datatools are comparing it to the libraries listed below
Sorting:
- ☆20Nov 28, 2024Updated last year
- ☆12Nov 13, 2024Updated last year
- 🫧 Code for Holistic Reasoning with Long-Context LMs: A Benchmark for Database Operations on Massive Textual Data (Maekawa*, Iso* et al.…☆12Feb 25, 2025Updated last year
- Generalized Data Augmentation for Low-Resource Translation☆12Jul 30, 2019Updated 6 years ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆247Sep 12, 2025Updated 6 months ago
- ☆14Feb 9, 2022Updated 4 years ago
- This script automates the process of unlocking Apple ID accounts by solving captcha challenges, verifying account details, and resetting …☆14Jan 24, 2026Updated last month
- A mcp server that uses the Osmosis-Apply-1.7B model to apply code merges☆53Jul 3, 2025Updated 8 months ago
- [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf☆25Nov 14, 2023Updated 2 years ago
- Revisiting End-to-End Speech-to-Text Translation From Scratch☆13Feb 21, 2023Updated 3 years ago
- ☆10Dec 11, 2025Updated 3 months ago
- This repository contains additional reference translations for the WMT'14 En-De (newstest2014) and WMT'19 En-Ru (newstest2019) test sets …☆15Aug 31, 2021Updated 4 years ago
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆11Mar 18, 2023Updated 3 years ago
- LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation☆33Feb 26, 2026Updated 3 weeks ago
- ☆20Apr 24, 2024Updated last year
- Create synthetic datasets from scratch using AI-powered generation. Define topics, customize prompts, and generate high-quality reasoning…☆29Updated this week
- Progetto per la prova finale di Ingegneria del Software 2023-2024 al Politecnico di Milano☆10Oct 19, 2024Updated last year
- Code for the preprint "Cache Me If You Can: How Many KVs Do You Need for Effective Long-Context LMs?"☆48Jul 29, 2025Updated 7 months ago
- Urban Generative Intelligence (UGI): A Foundational Platform for Embodied Agent and Future City☆12Dec 17, 2023Updated 2 years ago
- Code for the ACL 2024 paper "PLUG: Leveraging Pivot Language in Cross-Lingual Instruction Tuning"☆14Aug 13, 2025Updated 7 months ago
- LVCS@Tesla.com☆12Jan 16, 2026Updated 2 months ago
- NestJS project template, configured with prisma and ejs☆12Dec 1, 2024Updated last year
- A Dataset for Direct Quotation Extraction and Attribution in News Articles.☆14Sep 28, 2021Updated 4 years ago
- ☆29Sep 17, 2024Updated last year
- splits videos into scenes with gpt-4o-mini and saves them separately☆12Dec 19, 2024Updated last year
- Code for "Towards Revealing the Mystery behind Chain of Thought: a Theoretical Perspective"☆22Jul 16, 2023Updated 2 years ago
- ☆15Sep 10, 2024Updated last year
- View Apache Parquet Files In Your Terminal☆20Mar 31, 2025Updated 11 months ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆18Jul 24, 2025Updated 7 months ago
- ☆28Jan 22, 2025Updated last year
- Small string compression using smaz compression algorithm. Fast, because it's in C. Supports Python 3+☆13Oct 18, 2025Updated 5 months ago
- ☆19Sep 16, 2025Updated 6 months ago
- Tiny TeX distribution built on Web2C and LuaTeX.☆10Oct 2, 2025Updated 5 months ago
- Multilingual Large Language Models Evaluation Benchmark☆132Aug 21, 2024Updated last year
- code for paper "Accessing higher dimensions for unsupervised word translation"☆22Jun 26, 2023Updated 2 years ago
- ☆13Dec 11, 2020Updated 5 years ago
- This is an implementation of paper "End-to-end Speech Translation via Cross-modal Progressive Training" (Interspeech2021)☆19May 1, 2022Updated 3 years ago
- Heatmap of multiclass confusion matrix☆10Sep 11, 2019Updated 6 years ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆48Jan 17, 2024Updated 2 years ago