☆23Aug 7, 2023Updated 3 years ago
Alternatives and similar repositories for Oasis
Users that are interested in Oasis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pile Deduplication Code☆18May 15, 2023Updated 3 years ago
- Collection of training data management explorations for large language models☆343Aug 2, 2024Updated 2 years ago
- ☆65Apr 9, 2024Updated 2 years ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆203Dec 8, 2025Updated 11 months ago
- ☆10Dec 30, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese…☆137Jun 7, 2023Updated 3 years ago
- Rough codebase for exploring initialization strategies for new word embeddings in pretrained LMs☆19Dec 10, 2021Updated 4 years ago
- Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…☆14Aug 8, 2025Updated last year
- Multi-GPU supported kmeans clustering for cluser-clip☆14Jun 3, 2024Updated 2 years ago
- arXiv 2024 | ZIP: entropy-law data selection for efficient LLM alignment.☆28Jun 10, 2026Updated 5 months ago
- Official implementation of ECCV24 paper: POA☆24Aug 8, 2024Updated 2 years ago
- [EMNLP 2022] This is the code repo for our EMNLP‘22 paper "Dimension Reduction for Efficient Dense Retrieval via Conditional Autoencoder"…☆12Oct 20, 2022Updated 4 years ago
- Reinforcement Learning within Computers Enhances Generalization☆12Aug 22, 2026Updated 3 months ago
- "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)☆15Jul 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Codebase for ICML submission "DOGE: Domain Reweighting with Generalization Estimation"☆21Feb 29, 2024Updated 2 years ago
- [ACL 2026] This is the repo of Data Darwinism.☆28Apr 16, 2026Updated 7 months ago
- ☆14Feb 5, 2022Updated 4 years ago
- Train toy models using multi-token prediction objective☆14Apr 18, 2026Updated 7 months ago
- PLM: Efficient Peripheral Language Models Hardware-Co-Designed for Ubiquitous Computing☆21Mar 18, 2025Updated last year
- ☆18Dec 11, 2024Updated last year
- the data download script of the-stack-v2, which is the training data of StarCoder2.☆10May 10, 2024Updated 2 years ago
- The Code and Script of "David's Slingshot: A Strategic Coordination Framework of Small LLMs Matches Large LLMs in Data Synthesis"☆34Jun 13, 2025Updated last year
- ☆12May 17, 2022Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 中译名著多译本翻译转述语料。语料仅限于用于科研教学活动。文本著作权归原著者。☆13Jul 26, 2018Updated 8 years ago
- 实现moss int8的finetune和优化源moss项目模型保存问题☆17Jun 1, 2023Updated 3 years ago
- 根据维基百科历史编辑数据提取纠错语料。☆12Apr 6, 2022Updated 4 years ago
- Chinese Generation Evaluation☆13Aug 14, 2023Updated 3 years ago
- ☆18Feb 20, 2024Updated 2 years ago
- [EACL] This is the code repo for our paper "Enhancing Knowledge Integration and Utilization of Large Language Models via Constructivist C…☆111Oct 9, 2025Updated last year
- [ACL 2025 Findings] Autonomous Data Selection with Zero-shot Generative Classifiers for Mathematical Texts (https://huggingface.co/papers…☆94Nov 23, 2025Updated 11 months ago
- Code for "The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training"☆11Feb 4, 2026Updated 9 months ago
- Code for COLING22 paper, DPTDR: Deep Prompt Tuning for Dense Passage Retrieval☆26Aug 7, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- RGraph is an RDMA-assisted asynchronous distributed graph processing system. RGraph distributes edges into two parts to isolate master an…☆14Apr 13, 2021Updated 5 years ago
- Training code repo of the paper "DeepDance: Music-to-Dance Motion Choreography with Adversarial Learning"☆12May 18, 2021Updated 5 years ago
- 🧭 SailCompass: Towards Reproducible and Robust Evaluation for Southeast Asian Languages☆13Feb 12, 2025Updated last year
- ☆10Oct 28, 2019Updated 7 years ago
- WIKIGENBENCH: Exploring Full-length Wikipedia Generation under Real-World Scenario (COLING 2025)☆13Jan 5, 2025Updated last year
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆74May 13, 2025Updated last year
- NusaWrites is an in-depth analysis of corpora collection strategy and a comprehensive language modeling benchmark for underrepresented an…☆30Sep 27, 2024Updated 2 years ago
Are these results useful?