Alternatives and similar repositories for SONAR

Users that are interested in SONAR are comparing it to the libraries listed below

• facebookresearch / large_concept_model
  Large Concept Models: Language modeling in a sentence representation space
  ☆2,153Updated 3 months ago
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆871Updated 2 weeks ago
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,358Updated this week
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆327Updated 5 months ago
• seal-rg / recurrent-pretraining
  Pretraining code for a large-scale depth-recurrent language model
  ☆760Updated last month
• huggingface / cosmopedia
  ☆515Updated 5 months ago
• facebookresearch / blt
  Code for BLT research paper
  ☆1,587Updated this week
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,537Updated this week
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,071Updated last week
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆640Updated 2 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆596Updated 2 weeks ago
• stanfordnlp / pyreft
  Stanford NLP Python library for Representation Finetuning (ReFT)
  ☆1,466Updated 3 months ago
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆551Updated 4 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆294Updated 2 weeks ago
• allenai / dolma
  Data and tools for generating and inspecting OLMo pre-training data.
  ☆1,214Updated this week
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,109Updated 3 months ago
• trotsky1997 / MathBlackBox
  ☆1,019Updated 5 months ago
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆517Updated last year
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆353Updated 8 months ago
• McGill-NLP / llm2vec
  Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'
  ☆1,510Updated 3 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,870Updated this week
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆731Updated 8 months ago
• huggingface / huggingface-llama-recipes
  ☆645Updated 2 weeks ago
• facebookresearch / fairseq2
  FAIR Sequence Modeling Toolkit 2
  ☆900Updated this week
• xfactlab / orpo
  Official repository for ORPO
  ☆452Updated 11 months ago
• nomic-ai / contrastors
  Train Models Contrastively in Pytorch
  ☆702Updated last month
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆307Updated 6 months ago
• MinishLab / model2vec
  Fast State-of-the-Art Static Embeddings
  ☆1,615Updated this week
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆535Updated last year
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,377Updated last week