krypticmouse / matryoshka-representation-learning
PyTorch implementation for MRL
☆18Updated last year
Alternatives and similar repositories for matryoshka-representation-learning:
Users that are interested in matryoshka-representation-learning are comparing it to the libraries listed below
- Embedding Recycling for Language models☆38Updated last year
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆30Updated 3 weeks ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆46Updated 3 weeks ago
- ☆48Updated 5 months ago
- Aioli: A unified optimization framework for language model data mixing☆25Updated 3 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆19Updated 3 months ago
- QLoRA for Masked Language Modeling☆22Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 8 months ago
- ☆24Updated last year
- Official implementation of "BERTs are Generative In-Context Learners"☆27Updated last month
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 3 months ago
- [SIGIR 2024 (Demo)] CoSearchAgent: A Lightweight Collborative Search Agent with Large Language Models☆24Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆14Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆77Updated 7 months ago
- ☆15Updated last year
- Implementation of "SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models"☆27Updated 2 months ago
- Minimum Description Length probing for neural network representations☆19Updated 3 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated 2 weeks ago
- ☆33Updated 10 months ago
- ☆19Updated 3 weeks ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Using short models to classify long texts☆21Updated 2 years ago
- SCREWS: A Modular Framework for Reasoning with Revisions☆27Updated last year
- ☆47Updated 8 months ago
- ☆21Updated 6 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 7 months ago
- A library for squeakily cleaning and filtering language datasets.☆47Updated last year
- Few-shot Learning with Auxiliary Data☆27Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year