facebookresearch / SONAR
SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.
☆732Updated 3 weeks ago
Alternatives and similar repositories for SONAR:
Users that are interested in SONAR are comparing it to the libraries listed below
- Large Concept Models: Language modeling in a sentence representation space☆2,098Updated 2 months ago
- Code for BLT research paper☆1,513Updated last week
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆865Updated 2 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,438Updated last week
- Bringing BERT into modernity via both architecture changes and scaling☆1,329Updated last month
- Minimalistic large language model 3D-parallelism training☆1,808Updated this week
- ☆515Updated 5 months ago
- Pretraining code for a large-scale depth-recurrent language model☆745Updated last week
- An Open Source Toolkit For LLM Distillation☆579Updated 3 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆320Updated 4 months ago
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆304Updated 6 months ago
- Recipes to scale inference-time compute of open models☆1,058Updated 2 months ago
- ☆634Updated 4 months ago
- Scalable data pre processing and curation toolkit for LLMs☆885Updated this week
- Scalable toolkit for efficient model alignment☆770Updated last week
- ☆1,017Updated 4 months ago
- Training Large Language Model to Reason in a Continuous Latent Space☆1,076Updated 3 months ago
- FAIR Sequence Modeling Toolkit 2☆891Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,360Updated last week
- System 2 Reasoning Link Collection☆826Updated last month
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,659Updated this week
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,043Updated 2 months ago
- A bibliography and survey of the papers surrounding o1☆1,187Updated 5 months ago
- OLMoE: Open Mixture-of-Experts Language Models☆716Updated last month
- procedural reasoning datasets☆571Updated this week
- Stanford NLP Python library for Representation Finetuning (ReFT)☆1,463Updated 2 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆354Updated 7 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆286Updated last week
- Official implementation of Half-Quadratic Quantization (HQQ)☆791Updated this week
- A project to improve skills of large language models☆295Updated this week