Pretraining codebase for Apertus models, based on Megatron-LM
☆23Nov 4, 2026Updated 2 weeks ago
Alternatives and similar repositories for pretrain-code
Users that are interested in pretrain-code are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for "The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training"☆11Feb 4, 2026Updated 9 months ago
- CFR implementation of a poker bot.☆12Feb 17, 2023Updated 3 years ago
- ☆18Aug 18, 2026Updated 3 months ago
- MixtureVitae: A Permissive, High-Performance, Open-Access Pretraining Dataset☆10Jun 6, 2026Updated 5 months ago
- Fast, lightweight, self-improving AI that runs on any machine☆12Jun 13, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11May 29, 2026Updated 5 months ago
- nanoGPT-like codebase for LLM training☆120Nov 7, 2025Updated last year
- ☆16Oct 25, 2026Updated 3 weeks ago
- Julia package interfacing the Fortran code MPBNGC.☆12Jun 28, 2025Updated last year
- Tech Report of the Apertus LLM☆144Mar 9, 2026Updated 8 months ago
- Pretraining data reconstruction scripts for Apertus☆170Nov 4, 2026Updated 2 weeks ago
- MIMIR Artificial Intelligence Platform is a framework for ingesting and processing your data sources to AI models as well as generating o…☆18Jul 9, 2025Updated last year
- 249M-param MoE transformer built from scratch in PyTorch. GQA, RoPE, SwiGLU, sparse MoE with 3 aux losses, AMP training loop no Trainer a…☆19May 22, 2026Updated 5 months ago
- ☆12Dec 24, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An implementation of LassoNet for arbitrary network architectures☆14Nov 4, 2022Updated 4 years ago
- Experimental Chrome side-panel browser agent with LangGraph.js, MCP/WebMCP, local models, and semantic browser automation.☆20May 18, 2026Updated 6 months ago
- A Python Package for Portfolio Optimization using the Critical Line Algorithm☆27Aug 1, 2023Updated 3 years ago
- Glow-TTS with Stochastic Duration Predictor and Stochastic Pitch Predictor☆20Jun 5, 2023Updated 3 years ago
- Official code for StochasTok: Improving Fine-Grained Subword Understanding in LLMs☆14Mar 28, 2026Updated 7 months ago
- MoMo: Momentum Models for Adaptive Learning Rates☆19Jun 12, 2024Updated 2 years ago
- a fast and lightweight distributed background task processing framework with seamless scheduling.☆15Mar 30, 2026Updated 7 months ago
- Architected a distributed notebook execution environment simulating Kaggle Kernels. Utilized the Kubernetes K8s API for dynamic pod orche…☆20May 3, 2026Updated 6 months ago
- Python implementation of Mercer Features for Efficient Combinatorial Bayesian Optimization☆10Jun 14, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.☆27Sep 29, 2024Updated 2 years ago
- Cycles agroecosystem model☆13Jun 11, 2026Updated 5 months ago
- Get a room already!☆12Aug 1, 2025Updated last year
- DOS/32 Advanced DOS Extender - Advanced Wave Effects Edition☆11Jul 2, 2022Updated 4 years ago
- Visualize any repo or codebase into diagram or animation☆24Oct 14, 2024Updated 2 years ago
- Eurostat Big Data Hackathon 2021☆15Jan 15, 2026Updated 10 months ago
- Spatial reconstruction of dissociated single-cell data☆20Jan 12, 2024Updated 2 years ago
- pip install patchelf. patchelf Python wheel for PyPI.☆13Updated this week
- sectpmctl - Secure Boot and TPM2 backed LUKS full disk encryption☆13Jul 10, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Reproducibility study of the paper: "InPars Toolkit: A Unified and Reproducible Synthetic Data Generation Pipeline for Neural Information…☆12Feb 11, 2025Updated last year
- Exam summary for Computational Intelligence Lab, ETH Zurich, SS15☆13Aug 16, 2017Updated 9 years ago
- open source turbomolecular pump controller using a STM32F103 and some additional parts.☆13Apr 26, 2018Updated 8 years ago
- openSUSE patterns☆13May 15, 2020Updated 6 years ago
- A small, local-first AI chat workspace for any OpenAI-compatible model. Cache-efficient conversations, MCP tools, web search and persiste…☆40Nov 12, 2026Updated last week
- Minimal pretraining script for language modeling in PyTorch. Supporting torch compilation and DDP. It includes a model implementation and…☆52Apr 27, 2026Updated 6 months ago
- Hokushin CD8010P Hard Drive ROMs and other information☆10Jan 10, 2023Updated 3 years ago
Are these results useful?