Alternatives and similar repositories for trigrams:

Users that are interested in trigrams are comparing it to the libraries listed below

• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 5 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆23Updated 4 months ago
• RobertCsordas / moeut
  ☆70Updated 5 months ago
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 2 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆53Updated 5 months ago
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• arcee-ai / DAM
  ☆48Updated 2 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 8 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• Zyphra / Zyda_processing
  ☆31Updated 7 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆121Updated 2 weeks ago
• google-deepmind / asyncdiloco
  ☆41Updated last year
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆35Updated 2 months ago
• ScaledFoundations / MatMamba
  Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"
  ☆56Updated 2 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated 10 months ago
• SalesforceAIResearch / LaTRO
  ☆98Updated last week
• allenai / OLMo-core
  PyTorch building blocks for OLMo
  ☆49Updated this week
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆80Updated 2 weeks ago
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated last month
• euclaise / supertrainer2000
  ☆49Updated 10 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆77Updated 3 weeks ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆67Updated 3 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated 9 months ago
• YuchenJin / llm.c
  LLM training in simple, raw C/CUDA
  ☆14Updated last month
• google-deepmind / mishax
  ☆118Updated last week
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆91Updated 2 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆79Updated 10 months ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆33Updated 8 months ago