lucidrains / tableformer-pytorch
Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
☆37Updated 3 years ago
Alternatives and similar repositories for tableformer-pytorch:
Users that are interested in tableformer-pytorch are comparing it to the libraries listed below
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- A dashboard for exploring timm learning rate schedulers☆19Updated 5 months ago
- ☆29Updated 2 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆48Updated 3 years ago
- Implementation of the Remixer Block from the Remixer paper, in Pytorch☆35Updated 3 years ago
- Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012☆49Updated 3 years ago
- A package for fine tuning of pretrained NLP transformers using Semi Supervised Learning☆15Updated 3 years ago
- Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI☆57Updated last year
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 3 years ago
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Updated 2 years ago
- Implementation of Multistream Transformers in Pytorch☆53Updated 3 years ago
- Index of URLs to pdf files all over the internet and scripts☆23Updated 2 years ago
- Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch☆45Updated 4 years ago
- An open source implementation of CLIP.☆32Updated 2 years ago
- ☆37Updated last year
- [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training☆16Updated 6 months ago
- Another attempt at a long-context / efficient transformer by me☆37Updated 3 years ago
- This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…☆26Updated 2 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- Code for the paper "Query-Key Normalization for Transformers"☆40Updated 4 years ago
- An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain☆33Updated 4 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- codebase for the SIMAT dataset and evaluation☆39Updated 3 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated 2 weeks ago
- Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️☆54Updated 2 years ago
- ImageNet-12k subset of ImageNet-21k (fall11)☆21Updated last year
- Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"☆57Updated last year
- Embedding Recycling for Language models☆38Updated last year
- Experiments for "A Closer Look at In-Context Learning under Distribution Shifts"☆20Updated last year
- Implementation of Metaformer, but in an autoregressive manner☆24Updated 2 years ago