kyegomez / SelfExtendLinks
Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta
☆13Updated 9 months ago
Alternatives and similar repositories for SelfExtend
Users that are interested in SelfExtend are comparing it to the libraries listed below
Sorting:
- A Data Source for Reasoning Embodied Agents☆19Updated last year
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Updated last year
- An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!☆40Updated last year
- GoldFinch and other hybrid transformer components☆46Updated last year
- Rust bindings for CTranslate2☆14Updated 2 years ago
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆18Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆31Updated last week
- ☆63Updated 11 months ago
- Training hybrid models for dummies.☆25Updated 7 months ago
- MPI Code Generation through Domain-Specific Language Models☆14Updated 9 months ago
- ☆38Updated last year
- Tiktok is an advanced multimedia recommender system that fuses the generative modality-aware collaborative self-augmentation and contrast…☆13Updated 2 years ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated 2 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆24Updated last week
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Updated last year
- A repository for research on medium sized language models.☆78Updated last year
- Minimum Description Length probing for neural network representations☆18Updated 6 months ago
- Mixture of Expert (MoE) techniques for enhancing LLM performance through expert-driven prompt mapping and adapter combinations.☆12Updated last year
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- Implementation of Spectral State Space Models☆16Updated last year
- LLMs as Collaboratively Edited Knowledge Bases☆45Updated last year
- ☆54Updated 9 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Updated last year
- ☆61Updated last year
- Lottery Ticket Adaptation☆39Updated 9 months ago
- Latent Large Language Models☆18Updated last year
- ☆27Updated last year