Alternatives and similar repositories for mmsg:

Users that are interested in mmsg are comparing it to the libraries listed below

• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 9 months ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated this week
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 6 months ago
• catid / spectral_ssm
  Implementation of Spectral State Space Models
  ☆16Updated last year
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated last month
• catid / lllm
  Latent Large Language Models
  ☆17Updated 6 months ago
• enjalot / latent-sae
  Training code for Sparse Autoencoders on Embedding models
  ☆35Updated 3 weeks ago
• cloneofsimo / zeroshampoo
  ☆33Updated 6 months ago
• arcee-ai / DAM
  ☆48Updated 4 months ago
• ethansmith2000 / TransformerExperiments
  ☆19Updated 5 months ago
• ClashLuke / SOAP
  ☆21Updated 4 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• Zyphra / Zyda_processing
  ☆31Updated 9 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 6 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆22Updated 2 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 2 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• luohongyin / EntST
  Entailment self-training
  ☆25Updated last year
• CERC-AAI / Robin
  ☆63Updated 5 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 9 months ago
• haileyschoelkopf / triton-index
  See https://github.com/cuda-mode/triton-index/ instead!
  ☆11Updated 10 months ago
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆23Updated this week
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• TristanThrush / i-am-a-strange-dataset
  Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"
  ☆41Updated last year
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆48Updated last week