Pretraining codebase for Apertus models, based on Megatron-LM
☆23Oct 2, 2026Updated 3 weeks ago
Alternatives and similar repositories for pretrain-code
Users that are interested in pretrain-code are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ongoing research training transformer models at scale☆53Sep 20, 2026Updated last month
- CFR implementation of a poker bot.☆12Feb 17, 2023Updated 3 years ago
- ☆11May 29, 2026Updated 5 months ago
- ☆15Jun 21, 2026Updated 4 months ago
- ☆12May 11, 2021Updated 5 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- The open source workflow agent.☆11Oct 10, 2026Updated 2 weeks ago
- Pretraining data reconstruction scripts for Apertus☆167Oct 27, 2025Updated last year
- Algorithms Lab @ ETH Zurich, Fall 21☆23Feb 10, 2022Updated 4 years ago
- MIMIR Artificial Intelligence Platform is a framework for ingesting and processing your data sources to AI models as well as generating o…☆18Jul 9, 2025Updated last year
- 249M-param MoE transformer built from scratch in PyTorch. GQA, RoPE, SwiGLU, sparse MoE with 3 aux losses, AMP training loop no Trainer a…☆19May 22, 2026Updated 5 months ago
- ☆12Oct 10, 2026Updated 2 weeks ago
- VPN-over-WebSocket☆14Dec 31, 2018Updated 7 years ago
- CVE-2023-28121 - WooCommerce Payments < 5.6.2 - Unauthenticated Privilege Escalation [ Mass Add Admin User ]☆11Jul 14, 2023Updated 3 years ago
- Abliterates models quickly and efficently, Qwen2.5-7B: 95%→2% refusal at 0.095 KL☆37Oct 2, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- a fast and lightweight distributed background task processing framework with seamless scheduling.☆15Mar 30, 2026Updated 7 months ago
- Architected a distributed notebook execution environment simulating Kaggle Kernels. Utilized the Kubernetes K8s API for dynamic pod orche…☆20May 3, 2026Updated 5 months ago
- Python implementation of Mercer Features for Efficient Combinatorial Bayesian Optimization☆10Jun 14, 2021Updated 5 years ago
- Visualize any repo or codebase into diagram or animation☆24Oct 14, 2024Updated 2 years ago
- A project-based curriculum that teaches PyTorch by rebuilding it from scratch. Start with scalar backpropagation, create a reverse-mode a…☆70Jul 11, 2026Updated 3 months ago
- Cycles agroecosystem model☆13Jun 11, 2026Updated 4 months ago
- Linear Mode Connectivity in Multitask and Continual Learning: https://arxiv.org/abs/2010.04495☆13Oct 12, 2020Updated 6 years ago
- Mirror of lvqcl's CLI WMA encoder for Windows☆10Sep 27, 2020Updated 6 years ago
- Open CC BY 4.0 dataset: which local LLMs (Ollama) fit which hardware — params, quantization, RAM/VRAM. Powered by modelfit.io☆24Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A high-performance PyTorch toolkit for pre-training modern, Llama-style language models. Based on nanoGPT with significant architectural …☆14Jan 30, 2026Updated 9 months ago
- sectpmctl - Secure Boot and TPM2 backed LUKS full disk encryption☆13Jul 10, 2024Updated 2 years ago
- Git signing and SSH for agents, with expressive policies and keys that never leave Turnkey.☆13Updated this week
- Reproducibility study of the paper: "InPars Toolkit: A Unified and Reproducible Synthetic Data Generation Pipeline for Neural Information…☆12Feb 11, 2025Updated last year
- Exam summary for Computational Intelligence Lab, ETH Zurich, SS15☆13Aug 16, 2017Updated 9 years ago
- 2D tron game using HTML5 Canvas and vanilla JavaScript☆10Nov 13, 2020Updated 5 years ago
- ☆11Mar 13, 2023Updated 3 years ago
- Minimal Approaches to solving ARC 1 and ARC 2☆14Oct 23, 2026Updated last week
- Implementation of "Scaling Latent Reasoning via Looped Language Models" aka LoopLM☆33Apr 28, 2026Updated 6 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Analyzing the Voynich Manuscript with computer vision☆12Sep 4, 2024Updated 2 years ago
- PREF-SHAP☆10May 26, 2022Updated 4 years ago
- lets build claude code from scratch☆36May 13, 2026Updated 5 months ago
- Pytorch optimizers implementing Hilbert Constrained Gradient Descent☆19May 9, 2019Updated 7 years ago
- Code for "Few-Shot Learning by Dimensionality Reduction in Gradient Space"☆14Jan 27, 2023Updated 3 years ago
- This script checks the WOKO website for student accommodation in Zurich for new room entries every 6 to 12 min and sends you an email ale…☆12Apr 24, 2024Updated 2 years ago
- Feasible trust Region Bayesian Optimization (FuRBO)☆12Oct 17, 2025Updated last year