hu-po / streamdocs
Documentation, notes, links, etc for streams.
☆72Updated 7 months ago
Related projects: ⓘ
- Implementation of Lumiere, SOTA text-to-video generation from Google Deepmind, in Pytorch☆241Updated last month
- Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"☆159Updated 3 months ago
- Implementation of the premier Text to Video model from OpenAI☆57Updated last week
- documentation for content creation☆120Updated this week
- Unofficial implementation and experiments related to Set-of-Mark (SoM) 👁️☆75Updated 11 months ago
- Object Recognition as Next Token Prediction (CVPR 2024)☆153Updated last month
- From scratch implementation of a vision language model in pure PyTorch☆149Updated 4 months ago
- Implementation of a framework for Gamengen in Pytorch☆81Updated last week
- Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration 🤗☆120Updated 8 months ago
- Data release for the ImageInWords (IIW) paper.☆194Updated 3 months ago
- ClickDiffusion: Harnessing LLMs for Interactive Precise Image Editing☆65Updated 4 months ago
- ☆131Updated 3 weeks ago
- ☆176Updated 6 months ago
- Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models".☆90Updated 3 months ago
- Official code of "EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Model"☆242Updated 2 weeks ago
- Implementation of a multimodal diffusion transformer in Pytorch☆92Updated 2 months ago
- Use Segment Anything 2, grounded with Florence-2, to auto-label data for use in training vision models.☆80Updated last month
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆162Updated 2 weeks ago
- VCoder: Versatile Vision Encoders for Multimodal Large Language Models, arXiv 2023 / CVPR 2024☆255Updated 5 months ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆115Updated last month
- a family of highly capabale yet efficient large multimodal models☆155Updated 3 weeks ago
- LoRA and DoRA from Scratch Implementations☆179Updated 6 months ago
- Reproduction of DDPO paper (RLHF for diffusion)☆70Updated last year
- ☆164Updated 8 months ago
- This is the repository for the Photorealistic Unreal Graphics (PUG) datasets for representation learning.☆227Updated 5 months ago
- Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch☆236Updated 3 weeks ago
- Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆107Updated 3 weeks ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆115Updated 2 weeks ago
- E5-V: Universal Embeddings with Multimodal Large Language Models☆148Updated 2 months ago
- WIP☆76Updated last month