csebuetnlp / normalizer
This python module is an easy-to-use port of the text normalization used in the paper "Not low-resource anymore: Aligner ensembling, batch filtering, and new datasets for Bengali-English machine translation". It is intended to be used for normalizing / cleaning Bengali and English text.
☆35Updated 10 months ago
Alternatives and similar repositories for normalizer:
Users that are interested in normalizer are comparing it to the libraries listed below
- This repository contains the official release of the model "BanglaT5" and associated downstream finetuning code and datasets introduced i…☆83Updated last year
- Bangla Unicode Normalization☆19Updated 10 months ago
- This repository contains the official release of the model "BanglaBERT" and associated downstream finetuning code and datasets introduced…☆239Updated 2 years ago
- Automatic Context Sensitive Spelling Correction for Bangla Text Using Bert and Levenstein Distance☆20Updated 4 months ago
- This repository contains the code and data of the paper titled "Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Da…☆147Updated 5 months ago
- Awesome datasets for Bangla language computing.☆58Updated 3 years ago
- Bangla NLP dataset. Bangla NER,POStag, text summarization, stopword, translate, sentiment analysis, wiki articles, root word, dataset e…☆36Updated 3 years ago
- Bangla Text Augmentation☆11Updated last year
- Bangla Machine Translator☆44Updated 2 years ago
- Bangla text to speech, Multilingual (Bangla, English) real-time speech synthesis library☆88Updated 5 months ago
- Transformer based Bangla Speech Recognition☆52Updated last year
- Bangla-Bert is a pretrained bert model for Bengali language☆78Updated last year
- BNLP is a natural language processing toolkit for Bengali Language.☆289Updated 3 months ago
- ☆25Updated 4 years ago
- ☆23Updated 3 years ago
- A collection of Bangla newspaper and blog crawlers. Can be used to mine bangla text data for Natural Language Processing tasks.☆15Updated 2 years ago
- A rule-based lemmatizer for Bengali / Bangla based written in Python. Under active development.☆25Updated 5 years ago
- Dataset for Bangla named entity recognition☆7Updated 3 years ago
- ☆15Updated 6 years ago
- This repository contains the code, data, and associated models of the paper titled "BanglaParaphrase: A High-Quality Bangla Paraphrase Da…☆15Updated 2 years ago
- Pytorch implementation for paper 'BANNER: A Cost-Sensitive Contextualized Model for Bangla Named Entity Recognition'☆14Updated 4 years ago
- Bangla word2vec using skipgram approach☆15Updated last year
- This repository contains the code, data, and models of the paper titled "CrossSum: Beyond English-Centric Cross-Lingual Summarization for…☆49Updated last year
- Classification Benchmarks for Under-resourced Bengali Language based on Multichannel Convolutional-LSTM Network☆20Updated 3 years ago
- Bengali transformer using transformers☆20Updated last month
- Resources and Tool for Bangla language computation☆14Updated last year
- State of the Art Language models and Classifier for Bengali, which is primarily spoken by the Bengalis in South Asia.☆32Updated 4 years ago
- Writing Bangla in Latex with Overleaf Online Editor☆27Updated 7 months ago
- BNLTK(Bangla Natural Language Processing Toolkit): a python package for NLP in Bangla☆22Updated 2 weeks ago
- Bangla NLP toolkit. Bangla NER, POStag, Stemmer, Word embedding, sentence embedding, summarization, preprocessor, sentiment analysis, etc…☆25Updated last year