Alternatives and similar repositories for SaGe:

Users that are interested in SaGe are comparing it to the libraries listed below

• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆19Updated 2 months ago
• stefan-it / modern-bert-ner
  My NER Experiments with ModernBERT
  ☆18Updated 3 months ago
• salesforce / simplification
  ☆22Updated 2 months ago
• orevaahia / magnet-tokenization
  ☆11Updated 4 months ago
• bltlab / seqscore
  SeqScore: Scoring for named entity recognition and other sequence labeling tasks
  ☆23Updated last month
• ltgoslo / ltg-bert
  LTG-Bert
  ☆32Updated last year
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆31Updated last year
• gautierdag / tokenizer-bench
  Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"
  ☆16Updated last year
• r-three / common-pile
  Repo to hold code and track issues for the collection of permissively licensed data
  ☆23Updated last week
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 4 months ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆28Updated last year
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆48Updated last year
• liujch1998 / infini-gram
  ☆23Updated this week
• stefan-it / gc4lm
  GC4LM: A Colossal (Biased) language model for German
  ☆13Updated 3 years ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• webis-de / lightning-ir
  One-stop shop for running and fine-tuning transformer-based language models for retrieval
  ☆52Updated last week
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆26Updated 11 months ago
• rycolab / probing-via-prompting
  ☆11Updated 2 years ago
• Leukas / CUTE
  ☆13Updated 6 months ago
• flairNLP / familiarity
  Label shift estimation for transfer difficulty with Familiarity.
  ☆10Updated 2 months ago
• UniversalNER / UniversalNER
  ☆26Updated last month
• katzurik / NERetrieve
  ☆28Updated last year
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• thakur-nandan / income
  INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.
  ☆24Updated last year
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆52Updated last month
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆30Updated 9 months ago
• flipz357 / S3BERT
  Semantically Structured Sentence Embeddings
  ☆65Updated 5 months ago
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆33Updated 10 months ago
• allenai / bff
  ☆38Updated 11 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago