Alternatives and similar repositories for SONAR

Users that are interested in SONAR are comparing it to the libraries listed below

• facebookresearch / large_concept_model
  Large Concept Models: Language modeling in a sentence representation space
  ☆2,317Updated 11 months ago
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆936Updated last month
• facebookresearch / blt
  Code for BLT research paper
  ☆2,018Updated 2 months ago
• stanfordnlp / pyreft
  Stanford NLP Python library for Representation Finetuning (ReFT)
  ☆1,548Updated last week
• huggingface / huggingface-llama-recipes
  ☆694Updated 8 months ago
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆345Updated last year
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,602Updated 6 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆2,233Updated this week
• ZHZisZZ / dllm
  dLLM: Simple Diffusion Language Modeling
  ☆1,541Updated this week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆2,407Updated 3 weeks ago
• seal-rg / recurrent-pretraining
  Pretraining and inference code for a large-scale depth-recurrent language model
  ☆857Updated last week
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,430Updated 4 months ago
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆519Updated last year
• NVIDIA-NeMo / Curator
  Scalable data pre processing and curation toolkit for LLMs
  ☆1,327Updated last week
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆817Updated 2 weeks ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆366Updated last year
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆1,179Updated 11 months ago
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,123Updated 7 months ago
• huggingface / cosmopedia
  ☆559Updated last year
• huggingface / fineweb-2
  ☆217Updated 2 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆423Updated last week
• allenai / dolma
  Data and tools for generating and inspecting OLMo pre-training data.
  ☆1,393Updated 2 months ago
• gradio-app / trackio
  A lightweight, local-first, and 🆓 experiment tracking library from Hugging Face 🤗
  ☆1,191Updated this week
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆562Updated last year
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆656Updated this week
• xfactlab / orpo
  Official repository for ORPO
  ☆468Updated last year
• nomic-ai / contrastors
  Train Models Contrastively in Pytorch
  ☆770Updated 9 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆351Updated 8 months ago
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,812Updated this week
• dingo-actual / infini-transformer
  PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…
  ☆294Updated last year