Alternatives and similar repositories for aiXplain

Users that are interested in aiXplain are comparing it to the libraries listed below

• masakhane-io / lafand-mt
  MAFAND-MT
  ☆59Updated last year
• google-research / metricx
  ☆116Updated 11 months ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆171Updated 5 months ago
• AI4Bharat / IndicInstruct
  Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"
  ☆61Updated last year
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆59Updated last year
• hplt-project / OpusCleaner
  OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.
  ☆52Updated last month
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆90Updated 2 months ago
• CAMeL-Lab / camel_parser
  ☆15Updated 3 weeks ago
• mrmps / ai-chunker
  Chunk your text using gpt4o-mini more accurately
  ☆44Updated last year
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆86Updated last year
• ymoslem / Adaptive-MT-LLM-Fine-tuning
  Fine-tuning Open-Source LLMs for Adaptive Machine Translation
  ☆88Updated 4 months ago
• flairNLP / fabricator
  [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.
  ☆110Updated last year
• masakhane-io / afriqa
  Crosslingual Question Answering for African Languages
  ☆31Updated last year
• vipulraheja / coedit
  Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)
  ☆132Updated last year
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆33Updated last year
• machinetranslate / machinetranslate.org
  Open information and community for machine translation
  ☆79Updated 2 weeks ago
• commoncrawl / web-languages
  Crowd-sourced lists of urls to help Common Crawl crawl under-resourced languages. See https://github.com/commoncrawl/web-languages-code/ …
  ☆65Updated this week
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆86Updated last week
• davidberenstein1957 / spacy-setfit
  This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.
  ☆80Updated 2 years ago
• Knowledgator / GLiClass
  Generalist and Lightweight Model for Text Classification
  ☆165Updated 5 months ago
• riotu-lab / aranizer
  Aranizer: A Custom Tokenizer based on SentencePiece and BPE tailored for Arabic Language Modeling
  ☆21Updated last year
• mungg / FABLES
  ☆58Updated last year
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆66Updated last month
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆85Updated last year
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆188Updated 4 months ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆106Updated last year
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆62Updated last year
• pszemraj / ai-msgbot
  Training & Implementation of chatbots leveraging GPT-like architecture with the aitextgen package to enable dynamic conversations.
  ☆49Updated 3 years ago
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆109Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆69Updated last year