facebookresearch / Exact-Byte-Level-Probabilities-from-Tokenized-LMsLinks
Example implementation of "Exact Byte-Level Probabilities from Tokenized Language Models for FIM-Tasks and Model Ensembles" by Buu Phan, Brandon Amos, Itai Gat, Marton Havasi, Matthew Muckley, and Karen UllrichWork conducted as part of a MetaAI internship.
☆18Updated 2 weeks ago
Alternatives and similar repositories for Exact-Byte-Level-Probabilities-from-Tokenized-LMs
Users that are interested in Exact-Byte-Level-Probabilities-from-Tokenized-LMs are comparing it to the libraries listed below
Sorting:
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated last year
- Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️☆57Updated 3 years ago
- JAX implementation of VQVAE/VQGAN autoencoders (+FSQ)☆41Updated last year
- Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk☆47Updated 2 years ago
- Implementation and explorations into Blackbox Gradient Sensing (BGS), an evolutionary strategies approach proposed in a Google Deepmind p…☆20Updated 6 months ago
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated last year
- ☆40Updated 5 months ago
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆53Updated 2 years ago
- Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch☆91Updated 2 years ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆46Updated 2 years ago
- Repository for the PopulAtion Parameter Averaging (PAPA) paper☆30Updated last year
- ☆52Updated last year
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆120Updated last month
- Implementation of a holodeck, written in Pytorch☆18Updated 2 years ago
- Official Jax Implementation of MD4 Masked Diffusion Models☆153Updated 11 months ago
- Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group☆37Updated last year
- Standalone Product Key Memory module in Pytorch - for augmenting Transformer models☆87Updated 3 months ago
- Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"☆59Updated 2 years ago
- ☆14Updated 3 years ago
- ☆44Updated last year
- Frechet inception distance (FID) evaluation in JAX☆14Updated last year
- FID computation in Jax/Flax.☆29Updated last year
- ☆63Updated 2 years ago
- Flash Attention Triton kernel with support for second-order derivatives☆144Updated last week
- ☆32Updated 2 years ago
- Minimal JAX/Flax port of `lpips` supporting `vgg16`, with pre-trained weights stored in the 🤗 Hugging Face hub.☆17Updated 3 years ago
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆98Updated 4 years ago
- ☆62Updated last year
- Easily run PyTorch on multiple GPUs & machines☆57Updated last month
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Updated 2 years ago