xplip / pixel
Research code for pixel-based encoders of language (PIXEL)
☆335Updated 11 months ago
Alternatives and similar repositories for pixel:
Users that are interested in pixel are comparing it to the libraries listed below
- Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint☆374Updated 10 months ago
- ☆127Updated 2 years ago
- Repository containing code for "How to Train BERT with an Academic Budget" paper☆311Updated last year
- Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch☆225Updated 5 months ago
- Language Models Can See: Plugging Visual Controls in Text Generation☆257Updated 2 years ago
- Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…☆196Updated 5 months ago
- Implementation of the deepmind Flamingo vision-language model, based on Hugging Face language models and ready for training☆165Updated last year
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆136Updated last year
- 🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".☆478Updated last year
- Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models☆138Updated 2 years ago
- PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)☆367Updated last year
- Sequence modeling with Mega.☆298Updated 2 years ago
- Code release for "Dropout Reduces Underfitting"☆311Updated last year
- Code for the ALiBi method for transformer language models (ICLR 2022)☆515Updated last year
- Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers☆86Updated last year
- Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.☆379Updated 2 years ago
- Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"☆443Updated last year
- This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.1…☆127Updated last year
- Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"☆139Updated 2 years ago
- Pipeline for pulling and processing online language model pretraining data from the web☆175Updated last year
- M4 experiment logbook☆56Updated last year
- Package to compute Mauve, a similarity score between neural text and human text. Install with `pip install mauve-text`.☆281Updated 7 months ago
- MEND: Fast Model Editing at Scale☆242Updated last year
- A concise but complete implementation of CLIP with various experimental improvements from recent papers☆708Updated last year
- Language Quantized AutoEncoders☆99Updated 2 years ago
- DiffusER: Discrete Diffusion via Edit-based Reconstruction (Reid, Hellendoorn & Neubig, 2022)☆54Updated last year
- Easily convert common crawl to a dataset of caption and document. Image/text Audio/text Video/text, ...☆315Updated last year
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆157Updated 2 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆226Updated 2 years ago
- Reliably download millions of images efficiently☆114Updated 3 years ago