ARBML / darLinks
A simple semi-supervised approach for creating huggingface data script loaders and upload to the hub.
☆11Updated last year
Alternatives and similar repositories for dar
Users that are interested in dar are comparing it to the libraries listed below
Sorting:
- NTREX -- News Test References for MT Evaluation☆86Updated last year
- MAFAND-MT☆60Updated last year
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.☆34Updated 9 months ago
- Fine-tuning Open-Source LLMs for Adaptive Machine Translation☆89Updated 5 months ago
- Arabic Tokenization Library. It provides many tokenization algorithms.☆110Updated last year
- ☆17Updated 2 years ago
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆97Updated 2 years ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆53Updated 2 months ago
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.☆85Updated last year
- The FLORES+ Machine Translation Benchmark☆109Updated last year
- This repository contains the Arabic sarcasm dataset (ArSarcasm)☆24Updated 4 years ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆106Updated last year
- Arabic cleaning, normalization and segmentation library.☆72Updated 2 years ago
- German Alpaca Dataset (Cleaned + Translated)☆26Updated 2 years ago
- ☆118Updated last year
- UBC ARBERT and MARBERT Deep Bidirectional Transformers for Arabic☆112Updated 4 years ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆121Updated last month
- A library of translation-based text similarity measures☆25Updated 2 years ago
- ☆15Updated last month
- Yet Another Neural Machine Translation Toolkit☆180Updated 9 months ago
- A simple strategy for training and finetuning NLP models for Arabic. Specify the parameters and just wait for the results. A simple desig…☆22Updated last year
- OpusFilter - Parallel corpus processing toolkit