Aranizer: A Custom Tokenizer based on SentencePiece and BPE tailored for Arabic Language Modeling
☆22Aug 4, 2024Updated 2 years ago
Alternatives and similar repositories for aranizer
Users that are interested in aranizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python intefrace for evaluation on chatgpt models☆19Feb 13, 2024Updated 2 years ago
- Instruction dataset for Arabic with 10,000 instruction and output pairs. CIDAR can be used to fine-tune LLMs to follow instructions.☆45Apr 3, 2025Updated last year
- مجموعة من الكُنَّاشات على Google Colab تسمح للمستخدمين بأداء المهام بشكل أسرع☆10Jan 4, 2025Updated last year
- Jupyter Notebooks for Data Structures & Algorithms (Persian Language)☆13Aug 13, 2023Updated 3 years ago
- UBC ARBERT and MARBERT Deep Bidirectional Transformers for Arabic☆120Sep 2, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This is a diacritization model for Arabic language. This model was built/trained using the Tashkeela: the Arabic diacritization corpus on…☆48Sep 10, 2023Updated 3 years ago
- FibVID☆10Jun 23, 2021Updated 5 years ago
- Official Repository of the Deep Diacritization Paper☆17Dec 16, 2020Updated 5 years ago
- Wikimapcts is the first version of climate impact dataset creating by generative AI GPT4.0☆12Apr 5, 2026Updated 7 months ago
- Deep Visual Speech Recognition in arabic words☆17Oct 18, 2023Updated 3 years ago
- ☆32Mar 21, 2026Updated 7 months ago
- ☆57Jul 21, 2024Updated 2 years ago
- Deploy Your Swarm In One Click with FastAPI, Uvicorn, and more ;)☆10Oct 13, 2025Updated last year
- Arabic Tokenization Library. It provides many tokenization algorithms.☆113Jan 4, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Implementing a Decoder-Only Transformer from Scratch.☆11Jul 3, 2025Updated last year
- ☆11Nov 28, 2023Updated 2 years ago
- A simple semi-supervised approach for creating huggingface data script loaders and upload to the hub.☆11Jun 23, 2024Updated 2 years ago
- mchine learning portfolio project☆11Sep 18, 2021Updated 5 years ago
- End-to-End Arabic ASR using DeepSpeech engine☆14Nov 2, 2021Updated 5 years ago
- Arabic collocations library and data for Python☆10Nov 14, 2021Updated 4 years ago
- ☆10Feb 2, 2024Updated 2 years ago
- LOLA: Large and Open Source Multilingual Language Model☆11Apr 8, 2026Updated 6 months ago
- ☆11May 11, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Get Tunisian translation, audio and sample sentence for the most common 20.000 english word☆13Jan 20, 2024Updated 2 years ago
- ArSarcasm-v2 is an extension to the original ArSarcasm dataset. It was used for the shared task on sarcasm detection and sentiment analys…☆12Jan 26, 2022Updated 4 years ago
- ☆10May 11, 2024Updated 2 years ago
- Building a verification system based on the finger vein image is a hard problem since it goes through many steps including vein detection…☆10Jan 6, 2020Updated 6 years ago
- A tool to calculate dataset scaling needed to achieve cross-lingual training data equity.☆13Aug 14, 2024Updated 2 years ago
- A minimal proof-of-concept for a Vite backend integration with Flask.☆18Sep 11, 2024Updated 2 years ago
- ☆41Feb 1, 2025Updated last year
- ☆11Apr 26, 2023Updated 3 years ago
- Visualize expert firing frequencies across sentences in the Mixtral MoE model☆18Dec 22, 2023Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- The official implementation of CATT Arabic diacritization models.☆81Jul 18, 2025Updated last year
- ☆72Oct 25, 2026Updated last week
- A comprehensive list of Arabic NLP resources.☆55Sep 7, 2025Updated last year
- Seamlessly integrate IoT data with AI agents, enabling the effortless parsing, processing, and utilization of IoT data streams.☆12Jan 27, 2025Updated last year
- Autopilot for DJI Tello Drone using deep learning and image processing in python☆11Nov 3, 2019Updated 7 years ago
- Sakhi, a mobile-first app tailored for women, encompasses daily journals, safety features, community, and holistic health tools. Elevate …☆13Mar 7, 2024Updated 2 years ago
- A Question Generation Application leveraging RAG and Weaviate vector store to be able to retrieve relative contexts and generate a more u…☆17Feb 3, 2025Updated last year