azadyasar / NeuralMachineTranslation
PyTorch implementation of NMT models along with custom tokenizers, models, and datasets
☆20Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for NeuralMachineTranslation
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆70Updated 8 months ago
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Updated 3 years ago
- Long-context pretrained encoder-decoder models☆95Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆92Updated last year
- Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers☆47Updated last year
- ☆44Updated 3 years ago
- A collection of preprocessed datasets and pretrained models for generating paraphrases.☆29Updated 3 years ago
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆19Updated 2 years ago
- NTREX -- News Test References for MT Evaluation☆75Updated 5 months ago
- Are foundation LMs multilingual knowledge bases? (EMNLP 2023)☆18Updated 11 months ago
- Reduce the size of pretrained Hugging Face models via vocabulary trimming.☆43Updated last year
- This repository contains the code for paper Prompting ELECTRA Few-Shot Learning with Discriminative Pre-Trained Models.☆45Updated 2 years ago
- ☆12Updated 3 years ago
- [TMLR'23] Contrastive Search Is What You Need For Neural Text Generation☆118Updated last year
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆91Updated last year
- An official implementation for the EMNLP 2023 Findings paper "Prompt-Based Editing for Text Style Transfer"☆12Updated 11 months ago
- Comparing M2M and mT5 on a rare language pairs, blog post: https://medium.com/@abdessalemboukil/comparing-facebooks-m2m-to-mt5-in-low-re…☆13Updated 3 years ago
- A Multilingual Replicable Instruction-Following Model☆93Updated last year
- Ranking of fine-tuned HF models as base models.☆35Updated last year
- Can LLMs generate code-mixed sentences through zero-shot prompting?☆11Updated last year
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆44Updated 11 months ago
- ☆46Updated last month
- Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP☆58Updated 2 years ago
- ☆95Updated last year
- Implementation of "SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages" paper, accepted to E…☆23Updated last year
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆90Updated last month
- BERT, RoBERTa fine-tuning over SQuAD Dataset using pytorch-lightning⚡️, 🤗-transformers & 🤗-nlp.☆36Updated last year
- Efficient Memory-Augmented Transformers☆35Updated last year
- Ensembling Hugging Face transformers made easy☆62Updated last year
- A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.☆70Updated 3 months ago