Modalities / modalities
Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
☆68Updated this week
Alternatives and similar repositories for modalities:
Users that are interested in modalities are comparing it to the libraries listed below
- SDLG is an efficient method to accurately estimate aleatoric semantic uncertainty in LLMs☆25Updated 8 months ago
- Efficient LLM inference on Slurm clusters using vLLM.☆47Updated this week
- Pretraining Efficiently on S2ORC!☆156Updated 3 months ago
- Discovering Data-driven Hypotheses in the Wild☆55Updated 3 months ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆56Updated 8 months ago
- Parallel data preprocessing for NLP and ML.☆34Updated 3 months ago
- PyTorch Explain: Interpretable Deep Learning in Python.☆151Updated 9 months ago
- nanoGPT-like codebase for LLM training☆89Updated this week
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆17Updated 2 weeks ago
- Interpretating the latent space representations of attention head outputs for LLMs☆30Updated 6 months ago
- ☆28Updated 9 months ago
- Simple-to-use scoring function for arbitrarily tokenized texts.☆37Updated 3 weeks ago
- A library to create and manage configuration files, especially for machine learning projects.☆76Updated 2 years ago
- some common Huggingface transformers in maximal update parametrization (µP)☆78Updated 2 years ago
- ☆52Updated this week
- ☆24Updated 3 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆58Updated last year
- Supercharge huggingface transformers with model parallelism.☆76Updated 4 months ago
- ☆72Updated 9 months ago
- Quickest way to share everything about your research within a single app☆17Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆102Updated last year
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆72Updated 2 years ago
- ☆25Updated last year
- ☆33Updated 2 months ago
- How do transformer LMs encode relations?☆46Updated 11 months ago
- A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.☆71Updated 6 months ago
- ☆53Updated last year
- ☆67Updated 2 years ago
- End-to-End Ontology Learning with Large Language Models, NeurIPS 2024.☆18Updated 3 months ago
- ☆37Updated this week