Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https://arxiv.org/abs/2309.08351)
☆30Apr 17, 2024Updated 2 years ago
Alternatives and similar repositories for headless-lm
Users that are interested in headless-lm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated last year
- Official Code for "Token Distillation: Attention-aware Input Embeddings for New Tokens"☆13Mar 11, 2026Updated 7 months ago
- 🚀🤗 A collection of templates for Hugging Face Spaces☆34Oct 9, 2023Updated 3 years ago
- Python source code for EMNLP 2021 Findings paper: "Subword Mapping and Anchoring Across Languages".☆13Sep 17, 2021Updated 5 years ago
- A fully-fledge PyTorch package for Morphological Analysis, tailored to morphologically rich and historical languages.☆25Oct 27, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Jun 14, 2024Updated 2 years ago
- Terminal UI for monitoring SLURM jobs☆16Mar 29, 2026Updated 7 months ago
- Sentence Splitting Dataset☆10Nov 5, 2019Updated 6 years ago
- ☆16May 14, 2024Updated 2 years ago
- Lyrics crawling, pre-processing, embedding generation, model training, and lyrics generation - all in one tool☆14Nov 4, 2018Updated 7 years ago
- Code for Retrofitting Large Language Models with Dynamic Tokenization.☆14Jul 22, 2025Updated last year
- ☆31Jun 27, 2022Updated 4 years ago
- Multilingual Pretraining for Pixel Language Models (EMNLP 2025, Official Implementation)☆13Feb 2, 2026Updated 9 months ago
- A software for transferring pre-trained English models to foreign languages☆19Mar 20, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- Evaluate your models with A/B test experiments☆14Jan 5, 2023Updated 3 years ago
- ☆10Oct 15, 2019Updated 7 years ago
- A Multilingual Keyboard Layout-Based Typo Generator☆18Nov 23, 2025Updated 11 months ago
- Language modeling that treats text as images, leveraging visual structure for enhanced understanding.☆15Oct 22, 2026Updated last week
- ☆13Apr 28, 2021Updated 5 years ago
- ☆11Oct 3, 2021Updated 5 years ago
- Python package developed to evaluate textual overlap (N-Grams) between two volumes of text.☆11Sep 23, 2021Updated 5 years ago
- [ICASSP 2025] AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencoder☆16Mar 11, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- CNER: Concept and Named Entity Recognition☆13Jul 15, 2024Updated 2 years ago
- [ACL 2025] 🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment☆11Updated this week
- Library for fast text representation and classification. Fix compatibility with numpy 2☆17Nov 21, 2024Updated last year
- T-Projection is a method to perform high-quality Annotation Projection of Sequence Labeling datasets.☆13Nov 21, 2023Updated 2 years ago
- Linear Attention for Efficient Bidirectional Sequence Modeling☆18May 13, 2025Updated last year
- Minimal code to train ELMo models in recent versions of TensorFlow☆14Jun 16, 2026Updated 4 months ago
- Fast, flexible, elastically deterministic data loading for foundation model training☆85Updated this week
- DPO, but faster 🚀☆51Dec 6, 2024Updated last year
- This repository provides code for the paper "Memory-Efficient Fine-Tuning of Transformers via Token Selection" (EMNLP 2024).☆14Feb 11, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆21Apr 26, 2026Updated 6 months ago
- EMNLP 2022: Biomedical NER for the Enterprise with Distillated BERN2 and the Kazu Framework☆11Aug 29, 2024Updated 2 years ago
- [NeurIPS 2024] 🕸 GlotCC Dataset and Pipline☆21Apr 6, 2025Updated last year
- An opinionated NLP research template☆10Aug 29, 2024Updated 2 years ago
- Resources related to EMNLP 2021 paper "FAME: Feature-Based Adversarial Meta-Embeddings for Robust Input Representations"☆13Dec 14, 2021Updated 4 years ago
- Schemas for repositories of HTR/OCR models☆14Jul 24, 2026Updated 3 months ago
- (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.☆21Jul 13, 2022Updated 4 years ago