Pretraining data reconstruction scripts for Apertus
☆167Oct 27, 2025Updated last year
Alternatives and similar repositories for pretrain-data
Users that are interested in pretrain-data are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pretraining codebase for Apertus models, based on Megatron-LM☆23Oct 2, 2026Updated last month
- ☆19Feb 25, 2024Updated 2 years ago
- ☆17Nov 26, 2024Updated last year
- Structured Primitives for Efficient Architecture Research☆21Dec 22, 2025Updated 10 months ago
- ACL24☆11Jun 7, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14May 16, 2024Updated 2 years ago
- A library for activation patching based on nnsight.☆12May 27, 2025Updated last year
- The Conceptual Coverage Across Languages Benchmark for Text-to-Image Models☆12Oct 28, 2024Updated 2 years ago
- ☆10Dec 19, 2022Updated 3 years ago
- ☆12Dec 24, 2025Updated 10 months ago
- This API provides authentication and CRUD operations for data used by the Chronas application☆14Updated this week
- Decomposing and measuring evaluation awareness in existing benchmarks and our proposed EvalAwareBench.☆21Sep 29, 2026Updated last month
- ☆22Sep 27, 2026Updated last month
- Get plain text from Wikipedia pages☆11Jul 2, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆20Oct 2, 2026Updated last month
- ☆41Dec 19, 2024Updated last year
- Data mapping framework for rust stuff☆61Mar 25, 2026Updated 7 months ago
- Training codebase for K2-V2☆22Dec 17, 2025Updated 10 months ago
- Forcing Diffuse Distributions out of Language Models☆18Sep 10, 2024Updated 2 years ago
- Create synthetic datasets from scratch using AI-powered generation. Define topics, customize prompts, and generate high-quality reasoning…☆32Jul 23, 2026Updated 3 months ago
- Code for "Merging Text Transformers from Different Initializations"☆20Feb 2, 2025Updated last year
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆36May 11, 2026Updated 5 months ago
- Merge of megatron-train, autoexperiment and oellm_pretrain.☆18Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆21May 2, 2024Updated 2 years ago
- Klexikon: A German Dataset for Joint Summarization and Simplification☆17Oct 5, 2022Updated 4 years ago
- Light language model with modern technologies☆15Mar 24, 2025Updated last year
- UNLP 2025 Shared Task on Detecting Social Media Manipulation☆23Aug 4, 2025Updated last year
- ☆13Dec 12, 2025Updated 10 months ago
- Muon fsdp 2☆65Aug 8, 2025Updated last year
- A tool for detecting moral values in social discourse☆19Apr 24, 2025Updated last year
- PyTorch building blocks for the OLMo ecosystem☆1,772Updated this week
- Reproducible, flexible LLM evaluations☆403Mar 24, 2026Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Named Entity Recognition☆19Feb 13, 2026Updated 8 months ago
- Code and data to explore neural scaling laws of xLSTM and Transformer models.☆24Apr 8, 2026Updated 6 months ago
- ☆82Feb 16, 2025Updated last year
- FuseLIP: Multimodal Embeddings via Early Fusion of Discrete Tokens☆19Sep 8, 2025Updated last year
- A lightweight, user-friendly data-plane for LLM training.☆43Sep 10, 2025Updated last year
- German Parliamentary Corpus (GerParCor)☆32Oct 26, 2026Updated last week
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆20Jul 4, 2025Updated last year