deepseek-ai / EngramLinks
Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models
☆1,612Updated this week
Alternatives and similar repositories for Engram
Users that are interested in Engram are comparing it to the libraries listed below
Sorting:
- ☆816Updated 7 months ago
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆952Updated 9 months ago
- Muon is Scalable for LLM Training☆1,397Updated 5 months ago
- Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling☆467Updated 7 months ago
- ☆443Updated 5 months ago
- ☆1,421Updated last month
- slime is an LLM post-training framework for RL Scaling.☆3,224Updated last week
- MoBA: Mixture of Block Attention for Long-Context LLMs☆2,031Updated 9 months ago
- VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo☆1,524Updated this week
- ☆1,260Updated last month
- ☆1,257Updated last month
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆888Updated this week
- A construction kit for reinforcement learning environment management.☆292Updated this week
- ☆1,515Updated last month
- DeepConf: Deep Think with Confidence☆352Updated 3 months ago
- Speed Always Wins: A Survey on Efficient Architectures for Large Language Models☆385Updated 2 months ago
- Seed-Coder is a family of lightweight open-source code LLMs comprising base, instruct and reasoning models, developed by ByteDance Seed.☆725Updated 7 months ago
- A MemAgent framework that can be extrapolated to 3.5M, along with a training framework for RL training of any agent workflow.☆849Updated 5 months ago
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆238Updated 8 months ago
- A framework for efficient model inference with omni-modality models☆2,087Updated this week
- ☆1,376Updated 4 months ago
- ☆208Updated 2 months ago
- An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models☆2,619Updated this week
- Unleashing the Power of Reinforcement Learning for Math and Code Reasoners☆737Updated 7 months ago
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆773Updated last month
- Miles is an enterprise-facing reinforcement learning framework for large-scale MoE post-training and production workloads, forked from an…☆714Updated this week
- Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.☆3,381Updated this week
- ☆508Updated 3 weeks ago
- dInfer: An Efficient Inference Framework for Diffusion Language Models☆389Updated last week
- ☆870Updated last month