csebuetnlp / normalizer
This python module is an easy-to-use port of the text normalization used in the paper "Not low-resource anymore: Aligner ensembling, batch filtering, and new datasets for Bengali-English machine translation". It is intended to be used for normalizing / cleaning Bengali and English text.
☆35Updated 9 months ago
Alternatives and similar repositories for normalizer:
Users that are interested in normalizer are comparing it to the libraries listed below
- This repository contains the official release of the model "BanglaT5" and associated downstream finetuning code and datasets introduced i…☆83Updated last year
- Bangla Unicode Normalization☆17Updated 8 months ago
- Bangla-Bert is a pretrained bert model for Bengali language☆78Updated last year
- Awesome datasets for Bangla language computing.☆57Updated 2 years ago
- This repository contains the code and data of the paper titled "Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Da…☆147Updated 3 months ago
- Bangla Machine Translator☆44Updated 2 years ago
- This repository contains the official release of the model "BanglaBERT" and associated downstream finetuning code and datasets introduced…☆237Updated 2 years ago
- Bangla NLP dataset. Bangla NER,POStag, text summarization, stopword, translate, sentiment analysis, wiki articles, root word, dataset e…☆34Updated 3 years ago
- A rule-based lemmatizer for Bengali / Bangla based written in Python. Under active development.☆25Updated 5 years ago
- ☆25Updated 4 years ago
- Bangla text to speech, Multilingual (Bangla, English) real-time ([almost] in a GPU) speech synthesis library☆89Updated 4 months ago
- Transformer based Bangla Speech Recognition☆52Updated last year
- BNLP is a natural language processing toolkit for Bengali Language.☆287Updated 2 months ago
- Pytorch implementation for paper 'BANNER: A Cost-Sensitive Contextualized Model for Bangla Named Entity Recognition'☆14Updated 4 years ago
- Automatic Context Sensitive Spelling Correction for Bangla Text Using Bert and Levenstein Distance☆20Updated 3 months ago
- State of the Art Language models and Classifier for Bengali, which is primarily spoken by the Bengalis in South Asia.☆32Updated 4 years ago
- Fully Configurable RAG Pipeline for Bengali Language RAG Applications. Supports both Local and Huggingface Models, Built with Langchain.☆40Updated 6 months ago
- Bangla Text Augmentation☆11Updated last year
- ☆23Updated 3 years ago
- A collection of Bangla newspaper and blog crawlers. Can be used to mine bangla text data for Natural Language Processing tasks.☆15Updated 2 years ago
- Classification Benchmarks for Under-resourced Bengali Language based on Multichannel Convolutional-LSTM Network☆20Updated 3 years ago
- ☆15Updated 6 years ago
- Bangla NLP toolkit. Bangla NER, POStag, Stemmer, Word embedding, sentence embedding, summarization, preprocessor, sentiment analysis, etc…☆25Updated last year
- Resources and Tool for Bangla language computation☆14Updated last year
- Bengali transformer using transformers☆20Updated last week
- ☆17Updated 9 months ago
- Deep learning Bangla resources with TensorFlow☆142Updated 3 weeks ago
- Dataset for Bangla named entity recognition☆7Updated 3 years ago
- This repository contains the code, data, and models of the paper titled "CrossSum: Beyond English-Centric Cross-Lingual Summarization for…☆49Updated 10 months ago
- Bangla word2vec using skipgram approach☆15Updated last year