Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper here: https://aclanthology.org/2023.emnlp-main.658/
☆28Aug 8, 2025Updated last year
Alternatives and similar repositories for Cross-Lingual-Consistency
Users that are interested in Cross-Lingual-Consistency are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch source code of NAACL 2021 paper "Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Tran…☆18Oct 18, 2022Updated 4 years ago
- Python source code for EMNLP 2021 Findings paper: "Subword Mapping and Anchoring Across Languages".☆13Sep 17, 2021Updated 5 years ago
- ☆14Sep 1, 2025Updated last year
- ☆16Jun 14, 2024Updated 2 years ago
- [NAACL 2024] A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretraining☆18Nov 26, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆278Aug 1, 2025Updated last year
- A repo for LLM jailbreak☆14Sep 5, 2023Updated 3 years ago
- [ACL 2025] 🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment☆11Apr 6, 2025Updated last year
- ACL 2024 main: Cross-Lingual Knowledge Editing in Large Language Models☆12Nov 8, 2024Updated last year
- ☆10Mar 22, 2024Updated 2 years ago
- Transfer learning for neural machine translation using cross-lingual word embeddings☆10Dec 17, 2025Updated 10 months ago
- Evaluation results for Machine Translation within the BigScience project☆11May 15, 2023Updated 3 years ago
- [ACL 2023] Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages☆108Apr 14, 2026Updated 6 months ago
- ✅ Predicting LLM correctness from model internals☆11Apr 20, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"☆26Jun 3, 2025Updated last year
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.☆93Sep 12, 2024Updated 2 years ago
- This repository contains the code for the Form-Context Model and its Attentive Mimicking variant.☆30May 11, 2020Updated 6 years ago
- A Multilingual Keyboard Layout-Based Typo Generator☆18Nov 23, 2025Updated 11 months ago
- A simple, Python-based, command-line runner for MGIZA++.☆10Mar 24, 2022Updated 4 years ago
- [NAACL 2025] Taxi1500: A Multilingual Dataset for Text Classification in 1500 Languages☆12May 31, 2024Updated 2 years ago
- ☆12Oct 10, 2026Updated 2 weeks ago
- BinaryAlign: Word Alignment as Binary Sequence Labeling☆13Aug 8, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆15Mar 8, 2024Updated 2 years ago
- Python source code for EMNLP 2020 paper "Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT".☆35Mar 16, 2022Updated 4 years ago
- The geometry of multilingual language model representations (EMNLP 2022).☆22Oct 21, 2022Updated 4 years ago
- CNER: Concept and Named Entity Recognition☆13Jul 15, 2024Updated 2 years ago
- Auto Model Factorization☆12Sep 14, 2021Updated 5 years ago
- Code for Retrofitting Large Language Models with Dynamic Tokenization.☆14Jul 22, 2025Updated last year
- ☆49Jan 21, 2024Updated 2 years ago
- ☆19Nov 5, 2025Updated 11 months ago
- A software for transferring pre-trained English models to foreign languages☆19Mar 20, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆25Jan 22, 2024Updated 2 years ago
- The repo for paper: Exploiting the Index Gradients for Optimization-Based Jailbreaking on Large Language Models.☆15Dec 16, 2024Updated last year
- Code for Zero-Shot Tokenizer Transfer☆147Jan 14, 2025Updated last year
- Analyzing mBERT's multilinguality in a small laboratory setting☆13Jun 12, 2023Updated 3 years ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆30Apr 17, 2024Updated 2 years ago
- ☆10Jul 6, 2023Updated 3 years ago
- Official Code for "Token Distillation: Attention-aware Input Embeddings for New Tokens"☆13Mar 11, 2026Updated 7 months ago