Alternatives and similar repositories for fasterText:

Users that are interested in fasterText are comparing it to the libraries listed below

• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆24Updated 4 months ago
• stefan-it / modern-bert-ner
  My NER Experiments with ModernBERT
  ☆18Updated 3 months ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆26Updated 11 months ago
• lucy3 / whos_filtered
  ☆14Updated 6 months ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆31Updated last year
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆19Updated 2 months ago
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 4 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆61Updated 10 months ago
• ltgoslo / ltg-bert
  LTG-Bert
  ☆32Updated last year
• liujch1998 / infini-gram
  ☆23Updated this week
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆34Updated this week
• salesforce / simplification
  ☆22Updated 2 months ago
• UniversalNER / UniversalNER
  ☆26Updated last month
• UKPLab / eacl2024-lagonn
  Source code and data for Like a Good Nearest Neighbor
  ☆28Updated 3 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆53Updated this week
• gautierdag / tokenizer-bench
  Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"
  ☆16Updated last year
• gonglinyuan / metro_t0
  Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)
  ☆22Updated last year
• r-three / common-pile
  Repo to hold code and track issues for the collection of permissively licensed data
  ☆23Updated this week
• chandar-lab / NeoBERT
  ☆44Updated last month
• mariosasko / datasets_sql
  Execute arbitrary SQL queries on 🤗 Datasets
  ☆32Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated last year
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated last year
• orevaahia / magnet-tokenization
  ☆11Updated 4 months ago
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆80Updated 7 months ago
• MilaNLProc / language-invariant-properties
  ☆22Updated 3 years ago