Modalities / modalities
Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
☆64Updated this week
Related projects ⓘ
Alternatives and complementary repositories for modalities
- NanoGPT-like codebase for LLM training☆75Updated this week
- Simple-to-use scoring function for arbitrarily tokenized texts.☆32Updated 3 weeks ago
- Supercharge huggingface transformers with model parallelism.☆75Updated last month
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆56Updated 5 months ago
- some common Huggingface transformers in maximal update parametrization (µP)☆76Updated 2 years ago
- ☆34Updated 11 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆17Updated last month
- A Python package for generating concise, high-quality summaries of a probability distribution☆41Updated 3 weeks ago
- A python package for benchmarking interpretability techniques on Transformers.☆212Updated last month
- ☆28Updated 6 months ago
- Discovering Data-driven Hypotheses in the Wild☆41Updated this week
- ☆75Updated last month
- Dataset and benchmark for assessing LLMs in translating natural language descriptions of planning problems into PDDL☆43Updated last month
- ☆71Updated 3 months ago
- How to Turn Your Knowledge Graph Embeddings into Generative Models☆45Updated 4 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆58Updated 3 months ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆44Updated last year
- ☆26Updated last year
- Graph neural networks in JAX.☆67Updated 5 months ago
- Interpretability for sequence generation models 🐛 🔍☆377Updated last week
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆25Updated 5 months ago
- PyTorch Explain: Interpretable Deep Learning in Python.☆146Updated 6 months ago
- A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.☆25Updated 2 months ago
- Interpretating the latent space representations of attention head outputs for LLMs☆26Updated 3 months ago
- ☆128Updated this week
- ☆35Updated 3 years ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆149Updated 4 months ago
- Embedding Recycling for Language models☆38Updated last year
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆55Updated last year
- TorchFix - a linter for PyTorch-using code with autofix support☆103Updated last week