Alternatives and similar repositories for tokenizer-ui

Users that are interested in tokenizer-ui are comparing it to the libraries listed below

• lucidrains / h-net-dynamic-chunking
  Implementation of the dynamic chunking mechanism in H-net by Hwang et al. of Carnegie Mellon
  ☆66Updated 3 weeks ago
• facebookresearch / Mixture-of-Transformers
  Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.
  ☆148Updated 4 months ago
• KempnerInstitute / raptor
  Block-Recurrent Dynamics in ViTs 🦖
  ☆24Updated last month
• lucidrains / titok-pytorch
  Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"
  ☆182Updated last year
• bluorion-com / ZClip
  Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".
  ☆144Updated 2 months ago
• JinjieNi / dlms-are-super-data-learners
  The official github repo for "Diffusion Language Models are Super Data Learners".
  ☆220Updated 3 months ago
• ShangyuanTong / FreeFlow
  Official PyTorch Implementation of "Flow Map Distillation Without Data"
  ☆115Updated 2 months ago
• NVlabs / FastGen
  NVIDIA FastGen: Fast Generation from Diffusion Models
  ☆508Updated last week
• sayakpaul / nanoDiT
  Just another reasonably minimal repo for class-conditional training of pixel-space diffusion transformers.
  ☆143Updated 8 months ago
• test-time-training / e2e
  Official JAX implementation of End-to-End Test-Time Training for Long Context
  ☆511Updated last week
• idanshen / Self-Distillation
  ☆70Updated last week
• apple / ml-l3m
  Large multi-modal models (L3M) pre-training.
  ☆229Updated 4 months ago
• keshik6 / grafting
  [NeurIPS 2025 Oral] Official Code for Exploring Diffusion Transformer Designs via Grafting
  ☆70Updated 3 weeks ago
• amorehead / jvp_flash_attention
  Flash Attention Triton kernel with support for second-order derivatives
  ☆138Updated last month
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆119Updated 3 weeks ago
• LINs-lab / UCGM
  [Preprint] UCGM: Unified Continuous Generative Models
  ☆179Updated 8 months ago
• galilai-group / llm-jepa
  ☆169Updated 4 months ago
• ChenWu98 / algorithmic-creativity
  [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
  ☆84Updated 8 months ago
• lcqysl / DiffThinker
  DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Models
  ☆166Updated last month
• facebookresearch / eb_jepa
  An open source library designed to provide community examples of Joint Embedding Predictive Architectures (JEPAs). It contains code and e…
  ☆46Updated 2 weeks ago
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆107Updated last year
• nreHieW / minARImageGen
  Autoregressive Image Generation
  ☆31Updated 7 months ago
• huggingface / fineVideo
  ☆95Updated last year
• yinboc / dito
  Official PyTorch Implementation of "Diffusion Autoencoders are Scalable Image Tokenizers"
  ☆164Updated last year
• SakanaAI / DroPE
  Extending the Context of Pretrained LLMs by Dropping Their Positional Embedding
  ☆200Updated 3 weeks ago
• jadehaus / preference-flow-matching
  Official code implementation for the work Preference Alignment with Flow Matching (NeurIPS 2024)
  ☆66Updated last year
• Gengzigang / TokenSet
  Official PyTorch implementation of TokenSet.
  ☆127Updated 10 months ago
• lorenmt / clarity-template
  Clarity: A Minimalist Website Template for AI Research
  ☆179Updated last year
• Overworldai / owl-vaes
  Weird autoencoder experiments
  ☆24Updated last week
• lucidrains / spline-based-transformer
  Implementation of the proposed Spline-Based Transformer from Disney Research
  ☆105Updated last year