Alternatives and similar repositories for CodeMixed-Text-Generator:

Users that are interested in CodeMixed-Text-Generator are comparing it to the libraries listed below

• microsoft / LID-tool
  This code provides word level language identification tool for identifying language for individual words in Code-Mixed text. e.g. The tex…
  ☆51Updated 4 years ago
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆70Updated last year
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆77Updated 5 months ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 5 months ago
• hyunwoongko / megatron-11b
  Megatron LM 11B on Huggingface Transformers
  ☆27Updated 3 years ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 2 years ago
• microsoft / DialogLM
  Official Implementation of "DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization."
  ☆137Updated 2 years ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆81Updated 8 months ago
• zaemyung / sentsplit
  A flexible sentence segmentation library using CRF model and regex rules
  ☆29Updated last year
• tshrjn / Finetune-QA
  BERT, RoBERTa fine-tuning over SQuAD Dataset using pytorch-lightning⚡️, 🤗-transformers & 🤗-nlp.
  ☆36Updated last year
• monologg / EncT5
  Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks
  ☆63Updated 3 years ago
• shijie-wu / neural-transducer
  This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.
  ☆72Updated last year
• microsoft / GLUECoS
  A benchmark for code-switched NLP, ACL 2020
  ☆74Updated 9 months ago
• bitextor / bicleaner-ai
  Bicleaner fork that uses neural networks
  ☆39Updated 7 months ago
• Huffon / factsumm
  FactSumm: Factual Consistency Scorer for Abstractive Summarization
  ☆110Updated last year
• thevasudevgupta / transformers-adapters
  This repositary hosts my experiments for the project, I did with OffNote Labs.
  ☆10Updated 3 years ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆99Updated 10 months ago
• neulab / newlang-tech
  A guide to building language technology in new languages.
  ☆58Updated 3 years ago
• ahmetustun / hyperx
  ☆20Updated 2 years ago
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆99Updated 2 months ago
• amazon-science / contrastive-controlled-mt
  Code and data for the IWSLT 2022 shared task on Formality Control for SLT
  ☆21Updated last year
• Observeai-Research / Phoneme-BERT
  ☆34Updated 3 years ago
• wietsedv / gpt2-recycle
  As good as new. How to successfully recycle English GPT-2 to make models for other languages (ACL Findings 2021)
  ☆48Updated 3 years ago
• VProv / BPE-Dropout
  An official implementation of "BPE-Dropout: Simple and Effective Subword Regularization" algorithm.
  ☆50Updated 4 years ago
• google-research-datasets / Disfl-QA
  A Benchmark Dataset for Understanding Disfluencies in Question Answering
  ☆62Updated 3 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• hlt-mt / FBK-fairseq
  Repository containing the open source code of works published at the FBK MT unit.
  ☆42Updated last month
• jeongukjae / smaller-labse
  Applying "Load What You Need: Smaller Versions of Multilingual BERT" to LaBSE
  ☆18Updated 3 years ago
• utkd / encdecmodel-hf
  ☆34Updated 4 years ago
• ricsinaruto / gutenberg-dialog
  Build a dialog dataset from online books in many languages
  ☆72Updated 2 years ago