Alternatives and similar repositories for SONAR

Users that are interested in SONAR are comparing it to the libraries listed below

• facebookresearch / large_concept_model
  Large Concept Models: Language modeling in a sentence representation space
  ☆2,254Updated 6 months ago
• facebookresearch / blt
  Code for BLT research paper
  ☆1,760Updated 2 months ago
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆899Updated 3 months ago
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,469Updated last month
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆1,131Updated 6 months ago
• seal-rg / recurrent-pretraining
  Pretraining and inference code for a large-scale depth-recurrent language model
  ☆806Updated 2 weeks ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆698Updated 3 weeks ago
• huggingface / huggingface-llama-recipes
  ☆677Updated 3 months ago
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,110Updated 2 months ago
• stanfordnlp / pyreft
  Stanford NLP Python library for Representation Finetuning (ReFT)
  ☆1,500Updated 5 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆342Updated 7 months ago
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,216Updated 6 months ago
• NVIDIA-NeMo / Curator
  Scalable data pre processing and curation toolkit for LLMs
  ☆1,040Updated last week
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆318Updated 9 months ago
• gradio-app / trackio
  A lightweight, local-first, and free experiment tracking Python library built on top of 🤗 Datasets and Spaces.
  ☆339Updated this week
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,766Updated this week
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆516Updated last year
• huggingface / cosmopedia
  ☆525Updated 8 months ago
• allenai / dolma
  Data and tools for generating and inspecting OLMo pre-training data.
  ☆1,279Updated last week
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆555Updated 7 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆367Updated this week
• nomic-ai / contrastors
  Train Models Contrastively in Pytorch
  ☆731Updated 4 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆2,068Updated 3 weeks ago
• xfactlab / orpo
  Official repository for ORPO
  ☆461Updated last year
• microsoft / LongRoPE
  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
  ☆237Updated 11 months ago
• redotvideo / mamba-chat
  Mamba-Chat: A chat LLM based on the state-space model architecture 🐍
  ☆927Updated last year
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆323Updated 3 months ago
• dingo-actual / infini-transformer
  PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…
  ☆290Updated last year
• open-thought / reasoning-gym
  procedural reasoning datasets
  ☆998Updated this week
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆645Updated last month