[NAACL 2024] A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretraining
β18Nov 26, 2023Updated 2 years ago
Alternatives and similar repositories for ofa
Users that are interested in ofa are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"β40Jun 7, 2025Updated last year
- [ACL 2025] π Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignmentβ11Apr 6, 2025Updated last year
- Code for Zero-Shot Tokenizer Transferβ147Jan 14, 2025Updated last year
- [ACL 2024] π¬ MaskLID: Code-Switching Language Identification through Iterative Maskingβ13Updated this week
- [NeurIPS 2024] πΈ GlotCC Dataset and Piplineβ21Apr 6, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β12Oct 10, 2026Updated 3 weeks ago
- β11Sep 13, 2022Updated 4 years ago
- A Multilingual Keyboard Layout-Based Typo Generatorβ18Nov 23, 2025Updated 11 months ago
- β15Sep 30, 2025Updated last year
- [ACL 2025] TokAlign: Efficient Vocabulary Adaptation via Token Alignmentβ12Jun 4, 2025Updated last year
- #μΈκΆμ½νΌμ€β31Oct 6, 2023Updated 3 years ago
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.β93Sep 12, 2024Updated 2 years ago
- β10Dec 28, 2023Updated 2 years ago
- [WWW 2026] πΈ GlotWeb: Web Indexing for Minority Languagesβ17Apr 14, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Difference-based Contrastive Learning for Korean Sentence Embeddingsβ23Mar 11, 2026Updated 7 months ago
- β23Oct 30, 2023Updated 3 years ago
- β15Mar 8, 2024Updated 2 years ago
- β59Dec 27, 2025Updated 10 months ago
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.β72Jul 6, 2025Updated last year
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper heβ¦β28Aug 8, 2025Updated last year
- β17Dec 16, 2022Updated 3 years ago
- Code for Retrofitting Large Language Models with Dynamic Tokenization.β14Jul 22, 2025Updated last year
- [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervisionβ97Oct 30, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β10Dec 17, 2020Updated 5 years ago
- β19Nov 5, 2025Updated 11 months ago
- β38Oct 4, 2023Updated 3 years ago
- KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)β25Apr 11, 2022Updated 4 years ago
- PyTorch source code of NAACL 2021 paper "Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Tranβ¦β18Oct 18, 2022Updated 4 years ago
- Bias, Hate classification with KoELECTRA πΏβ27Jun 12, 2023Updated 3 years ago
- Google 곡μ Rouge Implementationμ νκ΅μ΄μμ μ¬μ©ν μ μλλ‘ μ²λ¦¬β17Jan 3, 2024Updated 2 years ago
- [ACL 2023] Glot500: Scaling Multilingual Corpora and Language Models to 500 Languagesβ108Apr 14, 2026Updated 6 months ago
- π Transformer Model for Lip Reading in the Wild (LRW) Benchmarkβ12Mar 18, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectsβ28May 20, 2026Updated 5 months ago
- PyTorch implementation of NAACL 2021 paper "Multi-view Subword Regularization"β25Jun 2, 2021Updated 5 years ago
- PathPiece tokenizerβ14Nov 10, 2024Updated last year
- Tooling to create CLDF datasets from existing dataβ12May 5, 2026Updated 5 months ago
- TPUμμ νκ΅μ΄μ© LLM μΆλ‘ μ μν Jax/Flax ꡬν체μ λλ€.β12Jun 12, 2023Updated 3 years ago
- β16Dec 9, 2023Updated 2 years ago
- [LREC 2024] π Resource and Tool for Writing System Identificationβ24Mar 29, 2026Updated 7 months ago