[EMNLP 2022/2023] Fast Vocabulary Transfer & Multi-word Tokenization
☆27Jan 19, 2025Updated last year
Alternatives and similar repositories for fast-vocabulary-transfer
Users that are interested in fast-vocabulary-transfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Show the time in Roman Numerals☆12Jan 23, 2020Updated 6 years ago
- ☆18Sep 12, 2019Updated 7 years ago
- Codebase for VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programming☆26Jun 30, 2023Updated 3 years ago
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆22Feb 14, 2024Updated 2 years ago
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Mar 6, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Evaluate Transformers from the Hub 🔥☆14Sep 24, 2026Updated 3 weeks ago
- Get up in the morning by striking a pose to stop your alarm from ringing.☆12Jun 9, 2021Updated 5 years ago
- ☆15Oct 4, 2024Updated 2 years ago
- Coala is a python package for Contextual Answer Sentence Selection.☆15Jun 12, 2023Updated 3 years ago
- [CVPR 2025] LoRA Recycle: Unlocking Tuning-Free Few-Shot Adaptability in Visual Foundation Models by Recycling Pre-Tuned LoRAs☆15Jun 20, 2025Updated last year
- [NeurIPS 2024 D&B Track] DACO: Towards Application-Driven and Comprehensive Data Analysis via Code Generation☆14Mar 5, 2025Updated last year
- Code for Zero-Shot Tokenizer Transfer☆147Jan 14, 2025Updated last year
- PathPiece tokenizer☆14Nov 10, 2024Updated last year
- This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.☆14Apr 9, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- CaMML:Context-Aware MultiModal Learner for Large Models (ACL 2024 SAC Award)☆15May 21, 2025Updated last year
- Code and data from the paper 'Human Feedback is not Gold Standard'☆20Aug 9, 2026Updated 2 months ago
- ☆12Jun 30, 2024Updated 2 years ago
- Repository for Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts, EMNLP22☆19Jun 23, 2023Updated 3 years ago
- [ICLR 2024] "Data Distillation Can Be Like Vodka: Distilling More Times For Better Quality" by Xuxi Chen*, Yu Yang*, Zhangyang Wang, Baha…☆15May 18, 2024Updated 2 years ago
- PyTorch implementation of the original evidental-deep-learning@https://github.com/aamini/evidential-deep-learning/☆13Sep 20, 2021Updated 5 years ago
- Diverse Demonstrations Improve In-context Compositional Generalization☆13Jul 7, 2023Updated 3 years ago
- The elegant integration of huggingface/nlp and fastai2 and handy transforms using pure huggingface/nlp☆19Oct 6, 2020Updated 6 years ago
- Official Code Repository for [AutoScale📈: Scale-Aware Data Mixing for Pre-Training LLMs] Published as a conference paper at **COLM 2025*…☆14Aug 8, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆16Feb 5, 2026Updated 8 months ago
- TREC QA dataset for question answering cleaned for usage in Question Answering☆14Aug 26, 2019Updated 7 years ago
- https://footprints.baulab.info☆17Oct 4, 2024Updated 2 years ago
- ☆15Mar 24, 2022Updated 4 years ago
- PyPSDD porting to Python 3 + PyTorch equivalent tree construction.☆15Jun 7, 2023Updated 3 years ago
- ☆11Feb 28, 2025Updated last year
- a deep learning tool for the classification of biological sequences☆18May 13, 2026Updated 5 months ago
- CLAIR: A (surprisingly) simple semantic text metric with large language models.☆23Jan 28, 2024Updated 2 years ago
- A modern take on forum application☆22Jun 22, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Generating Captions via Perceiver-Resampler Cross-Attention Networks☆18Dec 20, 2022Updated 3 years ago
- ☆20Dec 31, 2020Updated 5 years ago
- This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…☆27Oct 20, 2022Updated 3 years ago
- Implementation of Gradient Information Optimization (GIO) for effective and scalable training data selection☆14Jun 22, 2023Updated 3 years ago
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆35May 24, 2024Updated 2 years ago
- Uncertainty quantification for in-context learning of large language models☆15Apr 1, 2024Updated 2 years ago
- crypt elf dynstr or rodata section☆19Jul 3, 2019Updated 7 years ago