Alternatives and similar repositories for mt5-M2M-comparison:

Users that are interested in mt5-M2M-comparison are comparing it to the libraries listed below

• kutvonenaki / cc100-sentencepiece
  Common crawl pretrained sentencepiece tokenizers for English and Japanese for various vocabulary sizes. Also development environment for …
  ☆10Updated 3 years ago
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆46Updated 3 years ago
• apple / ml-kg-mt
  ☆14Updated 5 months ago
• monk1337 / Awesome-Question-Answering
  Awesome Question Answering
  ☆28Updated 2 years ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆68Updated last year
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• masakhane-io / afriqa
  Crosslingual Question Answering for African Languages
  ☆29Updated 6 months ago
• aj-naik / Text-Summarization
  Abstractive and Extractive Text summarization using Transformers.
  ☆83Updated last year
• louisteo9 / t5-text-summarizer
  Use Google's state-of-the-art T5 pre-train model to create human-like summarization
  ☆25Updated 3 years ago
• Yale-LILY / ConvoSumm
  ☆38Updated 2 years ago
• ejmejm / multilingual-nmt-mt5
  An example of multilingual machine translation using a pretrained version of mt5 from Hugging Face.
  ☆42Updated 4 years ago
• paulmelki / BERT_BM25_InformationRetrieval
  This project aims at creating a search engine based on BERT language model.
  ☆20Updated 4 years ago
• Geotrend-research / smaller-transformers
  Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
  ☆102Updated 2 years ago
• wangcongcong123 / ttt
  A package for fine-tuning Transformers with TPUs, written in Tensorflow2.0+
  ☆37Updated 4 years ago
• rycolab / probing-via-prompting
  ☆11Updated 2 years ago
• sgugger / torchdynamo-tests
  ☆19Updated 2 years ago
• google-research / xtreme-up
  ☆51Updated last year
• gonglinyuan / metro_t0
  Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)
  ☆22Updated last year
• helmy-elrais / RoBERT_Recurrence_over_BERT
  pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …
  ☆81Updated 2 years ago
• Clyde013 / Paraphrase-OPT
  Observe the slow deterioration of my mental sanity in the github commit history
  ☆12Updated last year
• geronimi73 / 3090_shorts
  minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆38Updated last month
• hyperconnect / pseudo-dialog-prompting
  This repository contains code for the paper "Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a…
  ☆13Updated 2 years ago
• patrickvonplaten / notebooks
  Some notebooks for NLP
  ☆200Updated last year
• hetpandya / paraphrase-datasets-pretrained-models
  A collection of preprocessed datasets and pretrained models for generating paraphrases.
  ☆29Updated 3 years ago
• thiborose / gecko-app
  A web application that interfaces two GEC systems. [web instance is down]
  ☆31Updated 8 months ago
• gautierdag / tokenizer-bench
  Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"
  ☆16Updated last year
• bigcode-project / bigcode-tokenizer
  ☆15Updated last year
• huggingface / data-measurements-tool
  Developing tools to automatically analyze datasets
  ☆74Updated 5 months ago
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆55Updated 9 months ago