Modalities / modalities
Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
☆67Updated this week
Alternatives and similar repositories for modalities:
Users that are interested in modalities are comparing it to the libraries listed below
- SDLG is an efficient method to accurately estimate aleatoric semantic uncertainty in LLMs☆25Updated 7 months ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆56Updated 7 months ago
- A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.☆100Updated last year
- Interpretating the latent space representations of attention head outputs for LLMs☆30Updated 5 months ago
- nanoGPT-like codebase for LLM training☆83Updated this week
- Interpretability for sequence generation models 🐛 🔍☆394Updated 2 months ago
- Discovering Data-driven Hypotheses in the Wild☆51Updated 2 months ago
- ☆52Updated last year
- A case study of efficient training of large language models using commodity hardware.☆68Updated 2 years ago
- Minimum Description Length probing for neural network representations☆18Updated last week
- Supercharge huggingface transformers with model parallelism.☆76Updated 3 months ago
- SciRepEval benchmark training and evaluation scripts☆71Updated 8 months ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆30Updated last month
- Repository of machine learning benchmarks☆33Updated this week
- ☆32Updated 11 months ago
- JAX/Flax implementation of the Hyena Hierarchy☆33Updated last year
- Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22☆65Updated 2 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆57Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆102Updated last year
- Simple-to-use scoring function for arbitrarily tokenized texts.☆35Updated last week
- Efficient LLM inference on Slurm clusters using vLLM.☆43Updated this week
- Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"☆20Updated last year
- An annotated implementation of the Hyena Hierarchy paper☆31Updated last year
- ☆41Updated this week
- ☆34Updated last month
- ☆37Updated last month
- ☆37Updated 9 months ago
- some common Huggingface transformers in maximal update parametrization (µP)☆78Updated 2 years ago
- Utilities for the HuggingFace transformers library☆63Updated last year