MixtureVitae: A Permissive, High-Performance, Open-Access Pretraining Dataset
☆10Jun 6, 2026Updated 5 months ago
Alternatives and similar repositories for mixturevitae
Users that are interested in mixturevitae are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Merge of megatron-train, autoexperiment and oellm_pretrain.☆19Updated this week
- A CLI to run reproducible evaluation across EuroHPC clusters☆23Updated this week
- ☆12Oct 10, 2026Updated last month
- Un-*** 50 billions multimodality dataset☆24Sep 14, 2022Updated 4 years ago
- ☆24May 12, 2026Updated 6 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training …☆19May 29, 2022Updated 4 years ago
- Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Trans…☆12Nov 9, 2026Updated last week
- ☆21Nov 4, 2025Updated last year
- The official code of "PixelWorld: Towards Perceiving Everything as Pixels" [TMLR25]☆15Sep 12, 2025Updated last year
- Code for Retrofitting Large Language Models with Dynamic Tokenization.☆14Jul 22, 2025Updated last year
- Fast code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆13Dec 5, 2024Updated last year
- Megatron-LM setup in the smol-cluster☆12Aug 26, 2024Updated 2 years ago
- ☆21Dec 5, 2022Updated 3 years ago
- [NAACL 2024] A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretraining☆18Nov 26, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A PyTorch native platform for training generative AI models☆17Jun 30, 2026Updated 4 months ago
- Evaluating LLM with swappable judges: local, remote, openrouter on multiple benchmarks.☆20Updated this week
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆33Mar 21, 2023Updated 3 years ago
- [NeurIPS 2024] 🕸 GlotCC Dataset and Pipline☆21Apr 6, 2025Updated last year
- 🍨 Gelato — From Data Curation to Reinforcement Learning: Building a Strong Grounding Model for Computer-Use Agents☆46Dec 22, 2025Updated 10 months ago
- This repository contains code for the paper "Learning Decision Trees as Amortized Structure Inference"☆17Mar 25, 2025Updated last year
- ☆21Jul 1, 2021Updated 5 years ago
- ☆18Aug 18, 2026Updated 2 months ago
- Training a model similar to OpenAI DALL-E with volunteers from all over the Internet using hivemind and dalle-pytorch (NeurIPS 2021 demo)☆27May 29, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆27Jul 3, 2026Updated 4 months ago
- Pretraining codebase for Apertus models, based on Megatron-LM☆23Nov 4, 2026Updated last week
- Eurostat Big Data Hackathon 2021☆15Jan 15, 2026Updated 10 months ago
- ☆13Feb 3, 2025Updated last year
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆39Jun 11, 2025Updated last year
- Working repo to support the Alliance's Open Trusted Data Initiative☆20Oct 19, 2026Updated 3 weeks ago
- GPU controlled Hetzner Cloud workers swarm for Crawling@Home project☆57Oct 9, 2022Updated 4 years ago
- ☆65Oct 4, 2023Updated 3 years ago
- Reproducibility study of the paper: "InPars Toolkit: A Unified and Reproducible Synthetic Data Generation Pipeline for Neural Information…☆12Feb 11, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official implementation of BitMamba-2. A scalable 1.58-bit State Space Model (Mamba-2 + BitNet) trained from scratch on 150B tokens. Incl…☆26Feb 4, 2026Updated 9 months ago
- ☆35Jan 28, 2025Updated last year
- Code for the Avey-B paper (https://arxiv.org/abs/2602.15814)☆33Feb 21, 2026Updated 8 months ago
- Experiments on content generation & machine "intelligence"☆15Dec 28, 2016Updated 9 years ago
- [ACL 2024] 💬 MaskLID: Code-Switching Language Identification through Iterative Masking☆13Nov 6, 2026Updated last week
- ☆11Apr 14, 2020Updated 6 years ago
- ☆10Oct 2, 2024Updated 2 years ago
Are these results useful?