csebuetnlp / normalizer
This python module is an easy-to-use port of the text normalization used in the paper "Not low-resource anymore: Aligner ensembling, batch filtering, and new datasets for Bengali-English machine translation". It is intended to be used for normalizing / cleaning Bengali and English text.
☆35Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for normalizer
- This repository contains the official release of the model "BanglaT5" and associated downstream finetuning code and datasets introduced i…☆83Updated last year
- Bangla Unicode Normalization☆17Updated 5 months ago
- This repository contains the official release of the model "BanglaBERT" and associated downstream finetuning code and datasets introduced…☆234Updated last year
- This repository contains the code and data of the paper titled "Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Da…☆147Updated 3 weeks ago
- Awesome datasets for Bangla language computing.☆57Updated 2 years ago
- Bangla Machine Translator☆43Updated 2 years ago
- Fully Configurable RAG Pipeline for Bengali Language RAG Applications. Supports both Local and Huggingface Models, Built with Langchain.☆37Updated 3 months ago
- Bangla-Bert is a pretrained bert model for Bengali language☆76Updated last year
- Bangla text to speech, Multilingual (Bangla, English) real-time ([almost] in a GPU) speech synthesis library☆87Updated last month
- Transformer based Bangla Speech Recognition☆51Updated last year
- BNLP is a natural language processing toolkit for Bengali Language.☆276Updated 2 months ago
- Automatic Context Sensitive Spelling Correction for Bangla Text Using Bert and Levenstein Distance☆20Updated this week
- Bangla NLP dataset. Bangla NER,POStag, text summarization, stopword, translate, sentiment analysis, wiki articles, root word, dataset e…☆31Updated 2 years ago
- ☆22Updated 2 years ago
- Bangla Text Augmentation☆12Updated last year
- ☆25Updated 4 years ago
- Pytorch implementation for paper 'BANNER: A Cost-Sensitive Contextualized Model for Bangla Named Entity Recognition'☆14Updated 4 years ago
- Bangla NLP toolkit. Bangla NER, POStag, Stemmer, Word embedding, sentence embedding, summarization, preprocessor, sentiment analysis, etc…☆25Updated 9 months ago
- Deep learning Bangla resources with TensorFlow☆141Updated last year
- ☆15Updated 6 years ago
- State of the Art Language models and Classifier for Bengali, which is primarily spoken by the Bengalis in South Asia.☆30Updated 4 years ago
- Bangla word2vec using skipgram approach☆15Updated last year
- A rule-based lemmatizer for Bengali / Bangla based written in Python. Under active development.☆25Updated 4 years ago
- ☆15Updated 6 months ago
- Classification Benchmarks for Under-resourced Bengali Language based on Multichannel Convolutional-LSTM Network☆20Updated 3 years ago
- Resources and Tool for Bangla language computation☆13Updated last year
- Writing Bangla in Latex with Overleaf Online Editor☆26Updated 3 months ago
- This repository contains the code, data, and associated models of the paper titled "BanglaParaphrase: A High-Quality Bangla Paraphrase Da…☆14Updated 2 years ago
- Python implementation of Avro Phonetic☆26Updated 3 years ago
- Bengali transformer using transformers☆20Updated this week