sagorbrur / codeswitch
CodeSwitch is a NLP tool, can use for language identification, pos tagging, name entity recognition, sentiment analysis of code mixed data.
☆33Updated 4 years ago
Alternatives and similar repositories for codeswitch:
Users that are interested in codeswitch are comparing it to the libraries listed below
- This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.☆72Updated last year
- BERT models for many languages created from Wikipedia texts☆34Updated 4 years ago
- Statistics on multilingual datasets☆17Updated 2 years ago
- A Benchmark Dataset for Understanding Disfluencies in Question Answering☆62Updated 3 years ago
- NTREX -- News Test References for MT Evaluation☆80Updated 7 months ago
- ☆14Updated 9 months ago
- This tool helps automatic generation of grammatically valid synthetic Code-mixed data by utilizing linguistic theories such as Equivalenc…☆53Updated 6 months ago
- Tool to fix bitexts and tag near-duplicates for removal☆29Updated 5 months ago
- ☆21Updated 8 months ago
- CodemixedNLP: An Extensible and Open NLP Toolkit for Code-Switching☆18Updated 3 years ago
- XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning☆101Updated 3 years ago
- diagNNose is a Python library that facilitates a broad set of tools for analysing hidden activations of neural models.☆81Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆99Updated 9 months ago
- ☆29Updated last year
- The repository for the paper "When Do You Need Billions of Words of Pretraining Data?"☆21Updated 4 years ago
- A guide to building language technology in new languages.☆58Updated 2 years ago
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆15Updated 11 months ago
- A program to choose transfer languages for cross-lingual learning☆72Updated last year
- Tooling to play around with multilingual machine translation for Indian Languages.☆21Updated 2 years ago
- A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations☆54Updated 2 years ago
- A web application that interfaces two GEC systems. [web instance is down]☆31Updated 5 months ago
- Codebase for probing and visualizing multilingual models.☆46Updated 4 years ago
- The Benchmark of Linguistic Minimal Pairs☆146Updated 2 years ago
- ☆38Updated 4 years ago
- Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'☆17Updated 2 years ago
- Code and Data for Evaluation WG☆41Updated 2 years ago
- LTG-Bert☆29Updated last year
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated last year
- ☆21Updated 3 years ago
- This repository contains the code for the Form-Context Model and its Attentive Mimicking variant.☆31Updated 4 years ago