ARBML / darLinks
A simple semi-supervised approach for creating huggingface data script loaders and upload to the hub.
☆11Updated last year
Alternatives and similar repositories for dar
Users that are interested in dar are comparing it to the libraries listed below
Sorting:
- MAFAND-MT☆59Updated last year
- ☆17Updated 2 years ago
- Arabic Tokenization Library. It provides many tokenization algorithms.☆109Updated last year
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.☆32Updated 7 months ago
- Arabic cleaning, normalization and segmentation library.☆72Updated 2 years ago
- NTREX -- News Test References for MT Evaluation☆85Updated last year
- Instruction dataset for Arabic with 10,000 instruction and output pairs. CIDAR can be used to fine-tune LLMs to follow instructions.☆42Updated 6 months ago
- AraT5: Text-to-Text Transformers for Arabic Language Understanding☆92Updated last year
- ☆113Updated 2 weeks ago
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆163Updated 4 months ago
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.☆85Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆52Updated 3 weeks ago
- UBC ARBERT and MARBERT Deep Bidirectional Transformers for Arabic☆111Updated 4 years ago
- A simple strategy for training and finetuning NLP models for Arabic. Specify the parameters and just wait for the results. A simple desig…☆22Updated last year
- ☆113Updated 10 months ago
- ☆42Updated 2 years ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆97Updated 2 years ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆106Updated last year
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆87Updated 3 months ago
- Arabic nested named entity recognition☆41Updated 7 months ago
- A Python implementation of Farasa toolkit☆136Updated last month
- مستودع الأوراق المسحية في معالجة اللغة العربية (أسبر) A Repository for survey and review papers in Arabic Natural Language processing (AN…☆84Updated this week
- Tools for managing datasets for governance and training.☆86Updated 2 weeks ago
- This repository contains the HiNER dataset released with our paper at LREC 2022☆15Updated 2 years ago
- A Multilingual Replicable Instruction-Following Model☆95Updated 2 years ago
- ☆15Updated 4 years ago
- TURJUMAN, a neural toolkit for translating from 20 languages into Modern Standard Arabic (MSA).☆57Updated 2 years ago
- The FLORES+ Machine Translation Benchmark☆108Updated 11 months ago
- COMET for African languages☆10Updated 9 months ago
- [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"☆34Updated 4 months ago