facebookresearch / palLinks
PAL: Predictive Analysis & Laws of Large Language Models
☆38Updated 9 months ago
Alternatives and similar repositories for pal
Users that are interested in pal are comparing it to the libraries listed below
Sorting:
- ICLR 2025 - official implementation for "I-Con: A Unifying Framework for Representation Learning"☆117Updated 4 months ago
- ☆59Updated last year
- ☆78Updated 2 months ago
- Train, tune, and infer Bamba model☆135Updated 4 months ago
- Recycling diverse models☆46Updated 2 years ago
- Repository containing awesome resources regarding Hugging Face tooling.☆48Updated last year
- Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind☆68Updated last year
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆57Updated 5 months ago
- A regression-alike loss to improve numerical reasoning in language models - ICML 2025☆26Updated 2 months ago
- ☆29Updated 3 months ago
- Minimum Description Length probing for neural network representations☆20Updated 9 months ago
- KV Cache Steering for Inducing Reasoning in Small Language Models☆40Updated 3 months ago
- One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation☆44Updated last week
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Model Stock: All we need is just a few fine-tuned models☆125Updated 2 months ago
- Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch☆89Updated last year
- PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)☆78Updated 2 years ago
- OLMost every training recipe you need to perform data interventions with the OLMo family of models.☆52Updated this week
- Supercharge huggingface transformers with model parallelism.☆77Updated 3 months ago
- ☆52Updated last year
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated last year
- Towards Understanding the Mixture-of-Experts Layer in Deep Learning☆32Updated last year
- AIRA-dojo: a framework for developing and evaluating AI research agents☆104Updated last month
- Understanding how features learned by neural networks evolve throughout training☆39Updated last year
- Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…☆99Updated this week
- Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models" ICLR 2024☆106Updated last year
- ☆81Updated last year
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆119Updated last year
- The official repository for HyperZ⋅Z⋅W Operator Connects Slow-Fast Networks for Full Context Interaction.☆40Updated 6 months ago
- ML/DL Math and Method notes☆64Updated last year