Example implementation of "Exact Byte-Level Probabilities from Tokenized Language Models for FIM-Tasks and Model Ensembles" by Buu Phan, Brandon Amos, Itai Gat, Marton Havasi, Matthew Muckley, and Karen UllrichWork conducted as part of a MetaAI internship.
☆19Jan 22, 2026Updated 8 months ago
Alternatives and similar repositories for Exact-Byte-Level-Probabilities-from-Tokenized-LMs
Users that are interested in Exact-Byte-Level-Probabilities-from-Tokenized-LMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Advanced Formal Language Theory (263-5352-00L; Frühjahr 2023)☆10Feb 21, 2023Updated 3 years ago
- Материалы курса "Компьютерная лингвистика и информационные технологии" для 4-го курса бакалавриата направления "Фундаментальная и приклад…☆10Mar 25, 2021Updated 5 years ago
- An open-source custom Gstreamer plugin for Versatile Video Coding (VVC) encoder.☆13Feb 8, 2023Updated 3 years ago
- Автоматическая обработка естественного языка для студентов 3-4 курсов Школы лингвистики НИУ ВШЭ.☆14Dec 20, 2023Updated 2 years ago
- Python script for manipulating the existing tokenizer.☆21Mar 6, 2026Updated 7 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A collection of fast FISTA-type algorithms for MRI.☆13Dec 18, 2023Updated 2 years ago
- An in-context learning research testbed☆19Mar 16, 2025Updated last year
- ☆12Apr 1, 2025Updated last year
- Linear Mode Connectivity in Multitask and Continual Learning: https://arxiv.org/abs/2010.04495☆13Oct 12, 2020Updated 6 years ago
- Cycles agroecosystem model☆12Jun 11, 2026Updated 4 months ago
- Maze navigation with MLM-U☆17Dec 21, 2024Updated last year
- Implementation of the variational network for denoising.☆17Dec 14, 2022Updated 3 years ago
- Self-Similarity Priors: Neural Collages as Differentiable Fractal Representations☆30Nov 26, 2022Updated 3 years ago
- [CoRL2023] Task Generalization with Stability Guarantees via Elastic Dynamical System Motion Policies☆13Oct 16, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICML 2026] Less Is More: Training-Free Sparse Attention with Global Locality for Efficient Reasoning☆36Sep 12, 2025Updated last year
- [ICLR 2025] Highly Efficient Self-Adaptive Reward Shaping for Reinforcement Learning (SASR)☆12Aug 26, 2025Updated last year
- Video Diffusion State Space Models☆19Mar 27, 2024Updated 2 years ago
- ☆20Dec 8, 2024Updated last year
- ☆33May 3, 2023Updated 3 years ago
- AuthFace: Towards Authentic Blind Face Restoration with Face-oriented Generative Diffusion Prior (ACM MM 2025 Oral)☆21Mar 5, 2026Updated 7 months ago
- Multi-Word Probabilistic based supertokenizer☆15May 15, 2025Updated last year
- Official code accompanying the arXiv paper Compressing Multisets with Large Alphabets☆30Sep 22, 2021Updated 5 years ago
- PyTorch code for TAPAS-GMM.☆16Nov 21, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Semi-Supervised Offline Reinforcement Learning with Action-Free Trajectories☆41Jul 16, 2023Updated 3 years ago
- The official codebase of FineAction dataset. We will update the data and code of our FineAction.☆24Apr 10, 2025Updated last year
- Authors' PyTorch implementation of "Lossy Image Compression with Quantized Hierarchical VAEs"☆16Mar 8, 2023Updated 3 years ago
- Differentiable Meta-learning Model for Few-shot Semantic Segmentation☆11Nov 20, 2020Updated 5 years ago
- Plannable Approximations to MDP Homomorphisms: Equivariance under Actions☆30Jun 30, 2020Updated 6 years ago
- [CVPR 2026] EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decomposition☆29Dec 29, 2025Updated 9 months ago
- A neural network capable of translating handwriting into text along with complex tools to generate datasets☆19Apr 5, 2020Updated 6 years ago
- initial repo for rl-waypoints project☆18Aug 16, 2024Updated 2 years ago
- ☆36Jan 23, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Package to align tokens from different tokenizations.☆15Mar 25, 2024Updated 2 years ago
- [ICLR 2025] Official Implementation: "Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models trained on Cor…☆26Feb 27, 2025Updated last year
- j-Algo is an algorithm visualisation tool.☆11Feb 1, 2022Updated 4 years ago
- ☆37Aug 27, 2026Updated last month
- [TGRS21] Crop Classification under Varying Cloud Cover with Neural Ordinary Differential Equations☆26Mar 30, 2022Updated 4 years ago
- Few-shot Learning with Auxiliary Data☆30Dec 8, 2023Updated 2 years ago
- Quasi-Newton Algorithm for Stochastic Optimization☆11May 20, 2022Updated 4 years ago