Alternatives and similar repositories for trigrams

Users that are interested in trigrams are comparing it to the libraries listed below

• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated 10 months ago
• Zyphra / Zyda_processing
  ☆35Updated last year
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆24Updated 7 months ago
• epfml / DenseFormer
  ☆81Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated 10 months ago
• arcee-ai / DAM
  ☆52Updated 8 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated 9 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆64Updated 11 months ago
• jkallini / mrt5
  Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."
  ☆43Updated 3 months ago
• LAGoM-NLP / transtokenizer
  ☆48Updated 5 months ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆61Updated last month
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 5 months ago
• AnswerDotAI / fastkmeans
  ☆62Updated last week
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆183Updated 5 months ago
• GenRobo / MatMamba
  Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"
  ☆59Updated 7 months ago
• RobertCsordas / moeut
  ☆82Updated 10 months ago
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• facebookresearch / mexma
  MEXMA: Token-level objectives improve sentence representations
  ☆41Updated 6 months ago
• KaiNylund / lm-weights-encode-time
  ☆68Updated 10 months ago
• allenai / infinigram-api
  ☆69Updated last month
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 5 months ago
• google-deepmind / asyncdiloco
  ☆45Updated last year
• lilakk / BLEUBERI
  Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"
  ☆25Updated last month
• YuchenJin / llm.c
  LLM training in simple, raw C/CUDA
  ☆15Updated 7 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated 10 months ago
• apple / ml-hypercloning
  ☆48Updated 8 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆48Updated 5 months ago
• Aleph-Alpha-Research / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆62Updated 8 months ago