A scalable data preprocessing framework built on PySpark for LLM training
☆34Dec 9, 2025Updated 10 months ago
Alternatives and similar repositories for Kaiyuan-Spark
Users that are interested in Kaiyuan-Spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Megatron-LM adapted for Puro-2B☆108Aug 30, 2026Updated 2 months ago
- ☆10Mar 18, 2025Updated last year
- SAS and Python code examples for use with SAS Viya Workbench.☆10Jun 26, 2024Updated 2 years ago
- ☆10Jun 22, 2019Updated 7 years ago
- 清华大学研究生社会实践系统爬虫☆18Jun 4, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Python interface and preprocessing pipeline for the BBBC021 dataset of cellular images☆14Sep 19, 2021Updated 5 years ago
- UMM-Discovery is a fully unsupervised deep learning method to cluster cellular images with similar phenotypes together, solely based on t…☆12Nov 4, 2020Updated 6 years ago
- Curated Public Repository of LLM (Pre-)Training Data☆16Oct 25, 2026Updated last week
- Here is the code for experiments related to the NIS+ framework.☆16Dec 15, 2025Updated 10 months ago
- 《PaddlePaddle从入门到实战》源码☆25Mar 5, 2021Updated 5 years ago
- ☆17Jul 4, 2025Updated last year
- Filter RSS Feed with GPT-4☆16May 22, 2023Updated 3 years ago
- 독자 파운데이션 모델 관련 코드☆15Aug 30, 2026Updated 2 months ago
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆16Nov 11, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 来自我要自学网的VBA基础教程笔记☆13Dec 29, 2018Updated 7 years ago
- SystemVerilog implementation of a Dynamically Weighted Round Robin arbiter☆14Mar 21, 2017Updated 9 years ago
- Unix Philosophy 2020☆16May 14, 2021Updated 5 years ago
- Optimizing the Cell Painting assay for image-based profiling☆21Aug 11, 2025Updated last year
- Modified Score-Entropy-Discrete-Diffusion to do a character level ml model and integrate with Oxen☆22Apr 26, 2024Updated 2 years ago
- The official implementation of the AAAI 2024 paper Bi-ViT.☆13Dec 18, 2023Updated 2 years ago
- Materials and exercises for SICP☆15Feb 13, 2017Updated 9 years ago
- WS-DINO: a novel framework to use weak label information in a self-supervised setting to learn phenotypic representations from high-conte…☆24Mar 28, 2023Updated 3 years ago
- An open-source implementation of Scaling Laws for Neural Language Models using nanoGPT☆60Dec 8, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- CUDA+PTX Microbenchmark for RTX 4070 GPU☆11Mar 9, 2026Updated 7 months ago
- AI assistant for full-text arXiv search & citation-backed Q&A—dive past abstracts into equations, methods, and results.☆12Jun 28, 2025Updated last year
- Awesome-RL-Reasoning☆17Aug 26, 2026Updated 2 months ago
- ☆14Jul 7, 2021Updated 5 years ago
- The implementation of Text Classification with Negative Supervision (ACL, 2020)☆10Oct 8, 2020Updated 6 years ago
- This repo contains a demo of adversarial strings poisoning vector database and forching specific hallucinations on RAG chatbot.☆10May 2, 2024Updated 2 years ago
- SWE-Bench-plus-plus☆26Feb 5, 2026Updated 9 months ago
- ☆17Apr 23, 2026Updated 6 months ago
- ☆14Aug 25, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Full Marks | Auditing CS61B Data Structures, Spring 2021☆14Jul 31, 2023Updated 3 years ago
- ☆12Feb 11, 2025Updated last year
- Megatron-LM-FL is a fork of Megatron-LM that introduces a plugin-based architecture for supporting diverse AI chips, built on top of Flag…☆20Updated this week
- 为知笔记批量导出☆11Oct 12, 2026Updated 3 weeks ago
- UniRobot is an embodied intelligent software framework that integrates the robot brain (data, models, model training) with the robot body…☆18Nov 8, 2025Updated last year
- Who's gonna be 被割？☆33Aug 28, 2026Updated 2 months ago
- L1 Data, L1 Instruction and L2 Unified Cache Design☆16Aug 21, 2026Updated 2 months ago