Alternatives and similar repositories for tokenizer-ui

Users that are interested in tokenizer-ui are comparing it to the libraries listed below

• lucidrains / h-net-dynamic-chunking
  Implementation of the dynamic chunking mechanism in H-net by Hwang et al. of Carnegie Mellon
  ☆65Updated 3 months ago
• facebookresearch / Mixture-of-Transformers
  Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.
  ☆129Updated 2 months ago
• lucidrains / titok-pytorch
  Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"
  ☆181Updated last year
• ShangyuanTong / FreeFlow
  Official PyTorch Implementation of "Flow Map Distillation Without Data"
  ☆69Updated last week
• zhixuan-lin / forgetting-transformer
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆134Updated last month
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆106Updated last year
• lucidrains / dreamer4
  Implementation of Danijar's latest iteration for his Dreamer line of work
  ☆121Updated 3 weeks ago
• sayakpaul / nanoDiT
  Just another reasonably minimal repo for class-conditional training of pixel-space diffusion transformers.
  ☆137Updated 6 months ago
• keshik6 / grafting
  [NeurIPS 2025 Oral] Exploring Diffusion Transformer Designs via Grafting
  ☆64Updated 5 months ago
• lorenmt / clarity-template
  Clarity: A Minimalist Website Template for AI Research
  ☆167Updated 10 months ago
• amorehead / jvp_flash_attention
  Flash Attention Triton kernel with support for second-order derivatives
  ☆116Updated last month
• jadehaus / preference-flow-matching
  Official code implementation for the work Preference Alignment with Flow Matching (NeurIPS 2024)
  ☆62Updated last year
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆109Updated last month
• lucidrains / maskbit-pytorch
  Implementation of the proposed MaskBit from Bytedance AI
  ☆83Updated last year
• LINs-lab / UCGM
  [Preprint] UCGM: Unified Continuous Generative Models
  ☆169Updated 6 months ago
• Lakonik / GMFlow
  [ICML 2025] Gaussian Mixture Flow Matching Models (GMFlow)
  ☆165Updated 3 weeks ago
• rbalestr-lab / llm-jepa
  ☆137Updated 2 months ago
• lucidrains / x-transformers-rl
  Implementation of a transformer for reinforcement learning using `x-transformers`
  ☆68Updated 2 months ago
• lucidrains / spline-based-transformer
  Implementation of the proposed Spline-Based Transformer from Disney Research
  ☆105Updated last year
• chenllliang / DnD-Transformer
  [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…
  ☆79Updated 11 months ago
• cfifty / rotation_trick
  ☆154Updated 8 months ago
• JinjieNi / dlms-are-super-data-learners
  The official github repo for "Diffusion Language Models are Super Data Learners".
  ☆207Updated 3 weeks ago
• Neur-IO / ReVQ
  Explore how to get a VQ-VAE models efficiently!
  ☆63Updated 4 months ago
• gstoica27 / DeltaFM
  [ICCV 2025] Official Implementation of Contrastive Flow Matching
  ☆147Updated 5 months ago
• Gengzigang / TokenSet
  Official PyTorch implementation of TokenSet.
  ☆127Updated 8 months ago
• bluorion-com / ZClip
  Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".
  ☆139Updated 2 weeks ago
• yinboc / dito
  Official PyTorch Implementation of "Diffusion Autoencoders are Scalable Image Tokenizers"
  ☆159Updated 10 months ago
• apple / ml-l3m
  Large multi-modal models (L3M) pre-training.
  ☆222Updated 2 months ago
• lucidrains / LVMAE-pytorch
  Implementation of the proposed LVMAE, from the paper, Extending Video Masked Autoencoders to 128 frames, in Pytorch
  ☆55Updated last year
• yosefdayani / MV-RAG
  MV-RAG combines retrieval with multi-view generation to create accurate 3D-consistent visuals. By retrieving reference images and text, i…
  ☆21Updated this week