kyegomez / SelfExtend
Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta
☆13Updated 2 months ago
Alternatives and similar repositories for SelfExtend:
Users that are interested in SelfExtend are comparing it to the libraries listed below
- Training hybrid models for dummies.☆18Updated 2 weeks ago
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆14Updated 10 months ago
- Implementation of Spectral State Space Models☆16Updated 11 months ago
- Latent Large Language Models☆17Updated 5 months ago
- ☆18Updated 2 months ago
- A Data Source for Reasoning Embodied Agents☆19Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 10 months ago
- MPI Code Generation through Domain-Specific Language Models☆13Updated 2 months ago
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 3 months ago
- ☆14Updated 4 months ago
- A testbed for agents and environments that can automatically improve models through data generation.☆14Updated last month
- Minimum Description Length probing for neural network representations☆18Updated this week
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆22Updated 7 months ago
- BH hackathon☆14Updated 9 months ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆31Updated 11 months ago
- Lottery Ticket Adaptation☆37Updated 2 months ago
- Aioli: A unified optimization framework for language model data mixing☆19Updated last week
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆18Updated last week
- ☆30Updated 4 months ago
- ☆48Updated 2 months ago
- alternative way to calculating self attention☆18Updated 8 months ago
- This repository implements DSPy programs to tasks in Indian Languages☆11Updated last year
- The Swarm Ecosystem☆19Updated 5 months ago
- An AI character interaction system with emotional modeling and advanced memory management☆15Updated 3 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 9 months ago
- ☆12Updated 5 months ago
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks"☆17Updated 3 weeks ago
- Modified Beam Search with periodical restart☆12Updated 4 months ago
- Apps that run on modal.com☆12Updated 7 months ago