fdschmidt93 / trident-nllb-llm2vec
Repository for "Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages"
☆14Updated 6 months ago
Alternatives and similar repositories for trident-nllb-llm2vec:
Users that are interested in trident-nllb-llm2vec are comparing it to the libraries listed below
- 🕸 GlotCC Dataset and Pipline -- NeurIPS 2024☆18Updated 2 weeks ago
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆16Updated last year
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆21Updated 2 years ago
- ☆33Updated 2 weeks ago
- Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)☆22Updated last year
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Updated 2 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆71Updated last year
- ☆13Updated this week
- 🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment☆10Updated 2 weeks ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆31Updated last year
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆55Updated 2 years ago
- ☆20Updated 2 years ago
- [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"☆30Updated 6 months ago
- Experiments for XLM-V Transformers Integeration☆13Updated 2 years ago
- This repository contains the implementation of the paper: "Span Classification with Structured Information for Disfluency Detection in Sp…☆12Updated last year
- ☆46Updated last month
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆26Updated last year
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆25Updated 2 years ago
- ☆33Updated 10 months ago
- https://liuzeming01.github.io/XDailyDialog/☆11Updated last year
- Can LLMs generate code-mixed sentences through zero-shot prompting?☆11Updated 2 years ago
- ☆12Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- Hugging Face RoBERTa with Flash Attention 2☆22Updated last year
- A repository for experiments in quality-aware decoding☆16Updated 2 years ago
- ☆14Updated 6 months ago
- Official implementation of "GPT or BERT: why not both?"☆52Updated last month
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆58Updated 2 years ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆19Updated 2 months ago
- ☆23Updated 2 months ago