csebuetnlp / normalizer
This python module is an easy-to-use port of the text normalization used in the paper "Not low-resource anymore: Aligner ensembling, batch filtering, and new datasets for Bengali-English machine translation". It is intended to be used for normalizing / cleaning Bengali and English text.
☆35Updated 11 months ago
Alternatives and similar repositories for normalizer:
Users that are interested in normalizer are comparing it to the libraries listed below
- This repository contains the official release of the model "BanglaT5" and associated downstream finetuning code and datasets introduced i…☆83Updated last year
- Bangla Unicode Normalization☆19Updated 10 months ago
- This repository contains the official release of the model "BanglaBERT" and associated downstream finetuning code and datasets introduced…☆241Updated 2 years ago
- Awesome datasets for Bangla language computing.☆58Updated 3 years ago
- Bangla Machine Translator based on seq2seq Architecture☆44Updated 3 years ago
- Bangla NLP dataset. Bangla NER,POStag, text summarization, stopword, translate, sentiment analysis, wiki articles, root word, dataset e…☆37Updated 3 years ago
- Bangla-Bert is a pretrained bert model for Bengali language☆78Updated last year
- This repository contains the code and data of the paper titled "Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Da…☆147Updated 5 months ago
- Pytorch implementation for paper 'BANNER: A Cost-Sensitive Contextualized Model for Bangla Named Entity Recognition'☆14Updated 5 years ago
- ☆23Updated 3 years ago
- Automatic Context Sensitive Spelling Correction for Bangla Text Using Bert and Levenstein Distance☆20Updated 5 months ago
- Python implementation of Avro Phonetic☆26Updated 3 years ago
- A collection of Bangla newspaper and blog crawlers. Can be used to mine bangla text data for Natural Language Processing tasks.☆16Updated 2 years ago
- BNLP is a natural language processing toolkit for Bengali Language.☆290Updated 4 months ago
- ☆25Updated 4 years ago
- Fully Configurable RAG Pipeline for Bengali Language RAG Applications. Supports both Local and Huggingface Models, Built with Langchain.☆41Updated 8 months ago
- Bangla text to speech, Multilingual (Bangla, English) real-time speech synthesis library☆89Updated 6 months ago
- Deep learning Bangla resources☆154Updated this week
- ☆15Updated 6 years ago
- A rule-based lemmatizer for Bengali / Bangla based written in Python. Under active development.☆25Updated 5 years ago
- Transformer based Bangla Speech Recognition☆52Updated 2 years ago
- Bangla Text Augmentation☆11Updated last year
- State of the Art Language models and Classifier for Bengali, which is primarily spoken by the Bengalis in South Asia.☆32Updated 4 years ago
- This repository contains the code, data, and models of the paper titled "CrossSum: Beyond English-Centric Cross-Lingual Summarization for…☆50Updated last year
- This repository contains the code, data, and associated models of the paper titled "BanglaParaphrase: A High-Quality Bangla Paraphrase Da…☆16Updated 2 years ago
- Bangla NLP toolkit.☆12Updated 2 years ago
- This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 4…☆267Updated last year
- Bangla NLP toolkit. Bangla NER, POStag, Stemmer, Word embedding, sentence embedding, summarization, preprocessor, sentiment analysis, etc…☆25Updated last year
- Bangla word2vec using skipgram approach☆15Updated last year
- A library of implementations of published stemming methods for the Bengali language.☆33Updated 3 years ago