shreyansh26 / LLM-SamplingLinks
A collection of various LLM sampling methods implemented in pure Pytorch
☆24Updated 5 months ago
Alternatives and similar repositories for LLM-Sampling
Users that are interested in LLM-Sampling are comparing it to the libraries listed below
Sorting:
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 9 months ago
- ☆58Updated 3 weeks ago
- Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.☆29Updated 2 months ago
- ☆47Updated 9 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆56Updated 3 weeks ago
- ☆49Updated 7 months ago
- One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation☆40Updated 7 months ago
- The repository contains code for Adaptive Data Optimization☆24Updated 5 months ago
- ☆43Updated 3 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 10 months ago
- Understanding how features learned by neural networks evolve throughout training☆34Updated 7 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆28Updated 8 months ago
- ☆29Updated 6 months ago
- ☆55Updated 3 weeks ago
- PyTorch library for Active Fine-Tuning☆79Updated 3 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 4 months ago
- An introduction to LLM Sampling☆78Updated 5 months ago
- ☆23Updated last year
- Supercharge huggingface transformers with model parallelism.☆77Updated 8 months ago
- Repository for "I am a Strange Dataset: Metalinguistic Tests for Language Models"☆44Updated last year
- ☆68Updated 9 months ago
- Simple GRPO scripts and configurations.☆58Updated 4 months ago
- Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.☆29Updated last month
- Source code for the collaborative reasoner research project at Meta FAIR.☆87Updated last month
- MEXMA: Token-level objectives improve sentence representations☆41Updated 5 months ago
- PyTorch implementation for MRL☆18Updated last year
- ☆31Updated 2 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- A repository for research on medium sized language models.☆76Updated last year