facebookresearch / Exact-Byte-Level-Probabilities-from-Tokenized-LMsLinks
Example implementation of "Exact Byte-Level Probabilities from Tokenized Language Models for FIM-Tasks and Model Ensembles" by Buu Phan, Brandon Amos, Itai Gat, Marton Havasi, Matthew Muckley, and Karen UllrichWork conducted as part of a MetaAI internship.
☆13Updated 7 months ago
Alternatives and similar repositories for Exact-Byte-Level-Probabilities-from-Tokenized-LMs
Users that are interested in Exact-Byte-Level-Probabilities-from-Tokenized-LMs are comparing it to the libraries listed below
Sorting:
- Source code for the paper "Positional Attention: Expressivity and Learnability of Algorithmic Computation"☆14Updated last month
- PyTorch implementation of Shortcut Models [Frans, 2025] with little modification☆44Updated last week
- Hierarchical VAE with a Diffusion-based VampPrior☆10Updated 7 months ago
- JAX implementation of VQVAE/VQGAN autoencoders (+FSQ)☆30Updated last year
- LMAct: A Benchmark for In-Context Imitation Learning with Long Multimodal Demonstrations☆19Updated 2 months ago
- [WIP🚧] 2025 up-to-date list of resources on visual tokenizers (primarily for visual generation). Give it a star 🌟 if you find it useful…☆14Updated 6 months ago
- [ICML 2024]: Official implementation for the paper: "Consistent Diffusion Meets Tweedie"☆53Updated last year
- Neural Optimal Transport with Lagrangian Costs☆56Updated 2 months ago
- [NeurIPS 2024, spotlight] Multivariate Learned Adaptive Noise for Diffusion Models☆23Updated 7 months ago
- [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction☆44Updated last month
- NF-Layers for constructing neural functionals.☆87Updated last year
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated 6 months ago
- Explorations into the proposed Streaming Deep Reinforcement Learning, from University of Alberta☆21Updated 8 months ago
- Repository for the PopulAtion Parameter Averaging (PAPA) paper☆26Updated last year
- Reward fine-tuning for Stable Diffusion models based on stochastic optimal control, including Adjoint Matching☆39Updated last month
- Deep Networks Grok All the Time and Here is Why☆37Updated last year
- RS-IMLE☆41Updated 7 months ago
- ☆67Updated last year
- Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group☆36Updated 9 months ago
- Official Repository for "Unbalancedness in Neural Monge Maps Improves Unpaired Domain Translation" [ICLR 2024]☆15Updated last year
- Remasking Discrete Diffusion Models with Inference-Time Scaling☆34Updated 4 months ago
- Implementation of Diffusion Transformer Model in Pytorch☆62Updated 2 months ago
- ☆15Updated 2 years ago
- ☆51Updated last year
- ☆44Updated last year
- 👆PyTorch Implementation of JEDi Metric described in "Beyond FVD: Enhanced Evaluation Metrics for Video Generation Quality"☆25Updated 7 months ago
- PyTorch implementation for all methods and environments in the paper "MIMEx: Intrinsic Rewards from Masked Input Modeling"☆16Updated 2 years ago
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆14Updated 7 months ago
- This repo contains the official code release of the Neural Experts paper, published in NeurIPS 2024.☆10Updated 7 months ago
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆20Updated 2 years ago