riotu-lab / aranizerLinks
Aranizer: A Custom Tokenizer based on SentencePiece and BPE tailored for Arabic Language Modeling
☆21Updated last year
Alternatives and similar repositories for aranizer
Users that are interested in aranizer are comparing it to the libraries listed below
Sorting:
- Python intefrace for evaluation on chatgpt models☆19Updated last year
- Instruction dataset for Arabic with 10,000 instruction and output pairs. CIDAR can be used to fine-tune LLMs to follow instructions.☆43Updated 9 months ago
- ☆128Updated last year
- Code, models, and data for "Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigation". EMNLP 2023.☆17Updated last year
- Seq2Seq-based open domain empathetic conversational model for Arabic: Dataset & Model☆59Updated 10 months ago
- Arabic edition of ALBERT pretrained language models☆16Updated 4 years ago
- ☆41Updated 3 years ago
- AraT5: Text-to-Text Transformers for Arabic Language Understanding☆93Updated last year
- TURJUMAN, a neural toolkit for translating from 20 languages into Modern Standard Arabic (MSA).☆57Updated 2 years ago
- ☆61Updated 5 months ago
- This is the official repository for Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarks.☆26Updated last year
- Arabic nested named entity recognition☆42Updated 9 months ago
- A framework for Arabic spelling correction using different seq2seq model architectures such as transformers and RNNs☆23Updated last year
- Code and models for "The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models". EACL 2021, WANLP.☆55Updated last year
- UBC ARBERT and MARBERT Deep Bidirectional Transformers for Arabic☆112Updated 4 years ago
- مستودع الأوراق المسحية في معالجة اللغة العربية (أسبر) A Repository for survey and review papers in Arabic Natural Language processing (AN…☆84Updated last month
- A Python implementation of Farasa toolkit☆139Updated 3 months ago
- Arabic cleaning, normalization and segmentation library.☆72Updated 2 years ago
- This is a repository of the Multi-dialect Arabic BERT model.☆38Updated 5 years ago
- This is a diacritization model for Arabic language. This model was built/trained using the Tashkeela: the Arabic diacritization corpus on…☆46Updated 2 years ago
- [Computer Speech & Language] A transformer-based spelling error correction framework for Bangla and resource scarce Indic languages☆14Updated last year
- Benchmark Arabic text diacritization dataset☆77Updated 6 years ago
- Several deep learning models for restoring Arabic diacritics using Pytorch.☆36Updated 3 years ago
- The largest public catalogue for Arabic NLP and speech datasets. There are +500 datasets annotated with more than 25 attributes.☆191Updated last week
- Code-Switched translations with Large Language models☆24Updated last year
- The official implementation of CATT Arabic diacritization models.☆58Updated 5 months ago
- [ACL 2025 🔥] A Comprehensive Multi-Domain Benchmark for Arabic OCR and Document Understanding☆60Updated 7 months ago
- ☆56Updated last year
- hULMonA (حلمنا): tHe first Universal Language MOdel iN Arabic☆47Updated 5 years ago
- Official Repository of the Deep Diacritization Paper☆16Updated 5 years ago