A byte-level decoder architecture that matches the performance of tokenized Transformers.
☆69Apr 24, 2024Updated 2 years ago
Alternatives and similar repositories for spacebyte
Users that are interested in spacebyte are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."☆59Sep 25, 2025Updated last year
- Code for Retrofitting Large Language Models with Dynamic Tokenization.☆14Jul 22, 2025Updated last year
- ☆136Sep 29, 2026Updated last month
- ☆13Dec 12, 2023Updated 2 years ago
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆22Feb 14, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A simple way to convert and manage files in vector storage.☆12Apr 25, 2025Updated last year
- Code for Bolmo: Byteifying the Next Generation of Language Models☆149Oct 7, 2026Updated 3 weeks ago
- [NeurIPS 2026] Official implementaion for Flash-dLLM: IO-Aware KV Caching and Parallel Decoding for Fast, Memory-Efficient Diffusion LLMs☆18Oct 7, 2026Updated 3 weeks ago
- new optimizer☆20Aug 4, 2024Updated 2 years ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆39Jan 27, 2025Updated last year
- Code for the paper "BPE stays on SCRIPT", "Which Pieces Does Unigram Tokenization Really Need?" and MinGram☆22Oct 21, 2026Updated last week
- [TMLR 2025] When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models☆126Mar 6, 2026Updated 7 months ago
- ☆25Jan 22, 2024Updated 2 years ago
- Code for BLT research paper☆2,069Nov 3, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Rates [WIP]☆25Jul 5, 2022Updated 4 years ago
- A curated list of papers and resources on byte-based large language models (LLMs) — models that operate directly on raw bytes.☆26Jul 12, 2025Updated last year
- Official implementation of "GPT or BERT: why not both?"☆65Jul 28, 2025Updated last year
- Implementation of PSGD optimizer in JAX☆41Dec 31, 2024Updated last year
- Beyond Language Models: Byte Models are Digital World Simulators☆335Jun 6, 2024Updated 2 years ago
- A GPT with self-similar nested properties☆20Mar 19, 2024Updated 2 years ago
- An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'☆56Aug 19, 2024Updated 2 years ago
- CNER: Concept and Named Entity Recognition☆13Jul 15, 2024Updated 2 years ago
- ☆16Feb 6, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ACL 2025] 🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment☆11Updated this week
- [ICML 2026] Improving GPT via a simple normalization strategy☆15May 22, 2026Updated 5 months ago
- MIT iQuHACK 2022 x Microsoft x IonQ Challenge☆10Jan 30, 2022Updated 4 years ago
- ☆20Nov 14, 2025Updated 11 months ago
- Minimal code to train ELMo models in recent versions of TensorFlow☆14Jun 16, 2026Updated 4 months ago
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆53Oct 22, 2023Updated 3 years ago
- Generative tree visualiser for Python☆16Sep 15, 2020Updated 6 years ago
- BFloat16 Fused Adam Operator for PyTorch☆20Nov 16, 2024Updated last year
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆31Jan 25, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆56Mar 10, 2025Updated last year
- A tiny server to run local inference on MLX model in the style of OpenAI☆13Jan 31, 2024Updated 2 years ago
- [TMLR] "Can You Win Everything with Lottery Ticket?" by Tianlong Chen, Zhenyu Zhang, Jun Wu, Randy Huang, Sijia Liu, Shiyu Chang, Zhangy…☆10Sep 8, 2022Updated 4 years ago
- ☆16Mar 22, 2023Updated 3 years ago
- Resources related to EMNLP 2021 paper "FAME: Feature-Based Adversarial Meta-Embeddings for Robust Input Representations"☆13Dec 14, 2021Updated 4 years ago
- H-Net: Hierarchical Network with Dynamic Chunking☆922Nov 20, 2025Updated 11 months ago
- PyTorch Code for the Paper: "Exploiting Uncertainty of Loss Landscape for Stochastic Optimization [Bhaskara et al. (2019)]☆16Apr 30, 2026Updated 6 months ago