☆11Jan 27, 2025Updated last year
Alternatives and similar repositories for MorphBPE
Users that are interested in MorphBPE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Multilingual Pretraining for Pixel Language Models (EMNLP 2025, Official Implementation)☆13Feb 2, 2026Updated 8 months ago
- FlexiTokens☆23Dec 27, 2025Updated 9 months ago
- On the Similarities of Embeddings in Contrastive Learning (ICML 2025)☆11Jul 15, 2025Updated last year
- Code for training CamemBERTa, a French language model based on DeBERTa V3. Development is done here https://gitlab.inria.fr/almanach/Came…☆13Nov 18, 2024Updated last year
- Get plain text from Wikipedia pages☆11Jul 2, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- PathPiece tokenizer☆14Nov 10, 2024Updated last year
- A tiny BERT for low-resource monolingual models☆32Dec 24, 2025Updated 9 months ago
- This is the repository for MorphScore, a tokenizer evaluation framework for morphological alignment.☆19Jul 10, 2025Updated last year
- This repository provides code for the paper "Memory-Efficient Fine-Tuning of Transformers via Token Selection" (EMNLP 2024).☆14Feb 11, 2025Updated last year
- ☆17Aug 22, 2026Updated 2 months ago
- ☆11Mar 17, 2026Updated 7 months ago
- ☆29Dec 23, 2019Updated 6 years ago
- Code for the paper "BPE stays on SCRIPT", "Which Pieces Does Unigram Tokenization Really Need?" and MinGram☆22Updated this week
- ☆37Jul 27, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Multilingual Keyboard Layout-Based Typo Generator☆18Nov 23, 2025Updated 10 months ago
- TODa: Tamazight Open Dataset☆21Jan 13, 2025Updated last year
- version 4.x of the Princeton Geniza Project☆14Oct 15, 2026Updated last week
- ☆20Dec 28, 2025Updated 9 months ago
- The website of the Oscar Project☆11Mar 27, 2025Updated last year
- ☆12Feb 20, 2025Updated last year
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆27Nov 25, 2024Updated last year
- The training codes of Jasper-Token-Compression-600M☆22Nov 19, 2025Updated 11 months ago
- ☆59Dec 27, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ACL'26 Findings] Recovered in Translation: Efficient Pipeline for Automated Translation of Benchmarks and Datasets☆20Jun 27, 2026Updated 3 months ago
- ☆15Oct 6, 2026Updated 2 weeks ago
- Code for SaGe subword tokenizer (EACL 2023)☆28Nov 30, 2024Updated last year
- Temporary remove unused tokens during training to save ram and speed.☆23Jun 15, 2025Updated last year
- This is the robofont extension for the package fontGadgets.☆16Nov 27, 2025Updated 10 months ago
- 🚀🤗 A collection of templates for Hugging Face Spaces☆34Oct 9, 2023Updated 3 years ago
- Data for the HIPE 2022 shared task.☆25May 15, 2026Updated 5 months ago
- CIFAR-10 IMAGE CLASSIFICATION WITH KERAS CONVOLUTIONAL NEURAL NETWORK TUTORIAL☆11Sep 1, 2017Updated 9 years ago
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆27Oct 3, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Megatron-LM setup in the smol-cluster☆12Aug 26, 2024Updated 2 years ago
- ☆31Oct 8, 2025Updated last year
- ☆60Dec 11, 2025Updated 10 months ago
- Visual similarity search engine demo with use of PyTorch Metric Learning and Qdrant☆16Jan 9, 2023Updated 3 years ago
- Deep Learning & Applied AI: Tutorials☆14Jul 5, 2020Updated 6 years ago
- Materials for the "My Workflow for Understanding LLM Architectures" tutorial☆31Apr 10, 2026Updated 6 months ago
- Scripts and documentation on scaling large language model training on the LUMI supercomputer☆10Jun 30, 2023Updated 3 years ago