albanie / foundation-models
Video descriptions of research papers relating to foundation models and scaling
☆30Updated last year
Alternatives and similar repositories for foundation-models:
Users that are interested in foundation-models are comparing it to the libraries listed below
- ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models (ICLR 2024, Official Implementation)☆14Updated 11 months ago
- Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"☆100Updated 4 months ago
- ☆40Updated this week
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆50Updated 4 months ago
- ☆31Updated 11 months ago
- ☆21Updated 3 months ago
- Holistic evaluation of multimodal foundation models☆42Updated 5 months ago
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆37Updated last year
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆112Updated 3 months ago
- ☆20Updated last week
- Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch☆98Updated last year
- ☆22Updated 3 months ago
- Code release for "Improved baselines for vision-language pre-training"☆58Updated 8 months ago
- Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegrained Image …☆62Updated last month
- Official implementation of the paper The Hidden Language of Diffusion Models☆69Updated 11 months ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind☆54Updated 4 months ago
- Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"☆35Updated 4 months ago
- ☆64Updated last year
- Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stron…☆16Updated 2 months ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆47Updated last month
- Code for "Don't trust your eyes: on the (un)reliability of feature visualizations"☆31Updated last year
- Implementation of Bitune: Bidirectional Instruction-Tuning☆16Updated 7 months ago
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆33Updated 6 months ago
- M4 experiment logbook☆56Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆91Updated 4 months ago
- ☆29Updated last year
- Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…☆20Updated last year