Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning
☆31Jan 25, 2023Updated 3 years ago
Alternatives and similar repositories for clp-transfer
Users that are interested in clp-transfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.☆93Sep 12, 2024Updated 2 years ago
- [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"☆40Jun 7, 2025Updated last year
- Search the biomedical literature for protein interactions and protein associations☆11Nov 24, 2023Updated 2 years ago
- Code for the paper "BPE stays on SCRIPT", "Which Pieces Does Unigram Tokenization Really Need?" and MinGram☆22Oct 21, 2026Updated last week
- A library for language transfer methods and algorithms.☆16Feb 6, 2026Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆11Jun 23, 2022Updated 4 years ago
- Code for our TSD paper "TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Models"☆14Aug 19, 2022Updated 4 years ago
- Code for Zero-Shot Tokenizer Transfer☆147Jan 14, 2025Updated last year
- German Alpaca Dataset (Cleaned + Translated)☆26Apr 6, 2023Updated 3 years ago
- ☆12Dec 24, 2025Updated 10 months ago
- ☆16Jun 14, 2024Updated 2 years ago
- Klexikon: A German Dataset for Joint Summarization and Simplification☆17Oct 5, 2022Updated 4 years ago
- ☆18Nov 25, 2022Updated 3 years ago
- Make the Best of Cross-lingual Transfer: Evidence from POS Tagging with over 100 Languages (ACL 2022)☆19May 17, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆21Dec 5, 2022Updated 3 years ago
- Allow admins to grant restricted docker/nvidia-docker commandline access to users.☆19Jun 11, 2021Updated 5 years ago
- triple-encoders is a library for contextualizing distributed Sentence Transformers representations.☆15Sep 3, 2024Updated 2 years ago
- Master thesis: Exploring bias in German NLG (GPT-3 & GerPT-2). Applies regard classification and bias mitigation triggers.☆16Sep 25, 2024Updated 2 years ago
- ☆18Feb 1, 2023Updated 3 years ago
- Code for "Merging Text Transformers from Different Initializations"☆20Feb 2, 2025Updated last year
- BenGER - Research-grade benchmarking for LLMs in the German legal domain☆20Updated this week
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆22Feb 14, 2024Updated 2 years ago
- [Konvens21] This repository contains the DFKI MobIE Corpus, a dataset of 3,232 German-language documents that have been annotated with fi…☆12Sep 17, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆30Apr 17, 2024Updated 2 years ago
- EWoK dataset generation framework☆14May 14, 2024Updated 2 years ago
- Official Code for "Token Distillation: Attention-aware Input Embeddings for New Tokens"☆13Mar 11, 2026Updated 7 months ago
- Pytorch Lightning Hydra Best Practices Cookiecutter☆10Aug 22, 2021Updated 5 years ago
- Code for the paper "Modelling Latent Translations for Cross-Lingual Transfer"☆17Nov 22, 2021Updated 4 years ago
- Python package developed to evaluate textual overlap (N-Grams) between two volumes of text.☆11Sep 23, 2021Updated 5 years ago
- Ukrainian ELECTRA model☆12Mar 11, 2023Updated 3 years ago
- Diverse Image Captioning with Context-Object Split Latent Spaces (NeurIPS 2020)☆37May 16, 2022Updated 4 years ago
- Pipeline for pulling and processing online language model pretraining data from the web☆180Jul 31, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SCT: An Efficient Self-Supervised Cross-View Training For Sentence Embedding (TACL)☆16Jul 27, 2024Updated 2 years ago
- When is multilinguality a curse? Language modeling for 250 high- and low-resource languages (EMNLP 2024).☆11Jan 30, 2025Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Aug 15, 2023Updated 3 years ago
- Efficient and simple data mixing with on-policy proxies!☆22May 18, 2026Updated 5 months ago
- ☆10Oct 22, 2026Updated last week
- German Text Embedding Clustering Benchmark☆18Mar 15, 2024Updated 2 years ago
- LTG-Bert☆35Jan 8, 2024Updated 2 years ago