Multi-model video-to-text by combining embeddings from Flan-T5 + CLIP + Whisper + SceneGraph. The 'backbone LLM' is pre-trained from scratch on YouTube (YT-1B dataset).
☆54Apr 21, 2023Updated 3 years ago
Alternatives and similar repositories for video-pretrained-transformer
Users that are interested in video-pretrained-transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ECCV2022] A PyTorch implementation of the paper "Spatial and Visual Perspective-Taking via View Rotation and Relation Reasoning for Embo…☆13Mar 20, 2023Updated 3 years ago
- Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"☆27Updated this week
- Implementation of VisionLLaMA from the paper: "VisionLLaMA: A Unified LLaMA Interface for Vision Tasks" in PyTorch and Zeta☆15Nov 11, 2024Updated last year
- ☆58Dec 2, 2025Updated 10 months ago
- Implementation of DropCov as described in DropCov: A Simple yet Effective Method for Improving Deep Architectures☆10Oct 15, 2022Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Mo…☆16Nov 11, 2024Updated last year
- ☆59Apr 24, 2024Updated 2 years ago
- Basic Handwritten Math Symbols Dataset☆11Apr 26, 2022Updated 4 years ago
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆51Jun 16, 2023Updated 3 years ago
- [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"☆156Sep 10, 2024Updated 2 years ago
- AI wearable necklace☆13Jul 29, 2024Updated 2 years ago
- PyQt MDI Image Viewer that supports synchonized zooming and panning of multiple windows☆14Nov 19, 2023Updated 2 years ago
- An app that extends the bluetooth comms☆12May 31, 2023Updated 3 years ago
- CRCNet for image deblurring☆10Feb 6, 2019Updated 7 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- The open sourced code from the Decent AI mobile app, built with Expo☆14Apr 3, 2025Updated last year
- Offline-first, decentralized graph database of collaborative Web apps☆15May 12, 2017Updated 9 years ago
- ☆18Aug 19, 2024Updated 2 years ago
- A much powerful probing method to tune your model with promising performance and linear probing training cost!☆15Jul 26, 2023Updated 3 years ago
- [CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval☆67Jun 19, 2024Updated 2 years ago
- Ultra Fast Multi-Modality Vector Database☆18Feb 21, 2024Updated 2 years ago
- Learning Interactions and Relationships between Movie Characters (CVPR'20)☆22Apr 12, 2023Updated 3 years ago
- Audio-visual diarization pipeline used for creating VoxConverse dataset☆22Jun 6, 2025Updated last year
- A guide to structured generation using constrained decoding☆18Jun 9, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆23Updated this week
- [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences☆47Mar 11, 2025Updated last year
- ☆13Sep 20, 2023Updated 3 years ago
- [WACV 2026 Oral] LASER: Lip Landmark Assisted Speaker Detection for Robustness official implemntation☆30Feb 26, 2026Updated 7 months ago
- ☆13Jul 20, 2022Updated 4 years ago
- Self-supervised place recognition by exploring temporal and feature neighborhoods☆16Dec 9, 2024Updated last year
- ☆15Aug 21, 2026Updated last month
- Generate interleaved text and image content in a structured format you can directly pass to downstream APIs.☆29Oct 18, 2024Updated last year
- End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)☆233Jan 3, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [WWW '24] UnifiedSSR: A Unified Framework of Sequential Search and Recommendation☆12Feb 16, 2024Updated 2 years ago
- [CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings☆45Aug 14, 2023Updated 3 years ago
- A Python implementation of HajiRassouliha et al SGGC based subpixel image registration algorithm☆18Apr 7, 2018Updated 8 years ago
- [CVPR 2019] Pytorch code for Audio Visual Scene-Aware Dialog☆34Feb 1, 2021Updated 5 years ago
- [ICCV2023 Oral] Implicit Temporal Modeling with Learnable Alignment for Video Recognition☆41Nov 29, 2023Updated 2 years ago
- [CVPR 2024] Official PyTorch implementation of the paper "One For All: Video Conversation is Feasible Without Video Instruction Tuning"☆35Feb 2, 2024Updated 2 years ago
- ☆24May 11, 2025Updated last year