cognitivecomputations / extract-expertLinks
Extract a single expert from a Mixture Of Experts model using slerp interpolation.
☆17Updated last year
Alternatives and similar repositories for extract-expert
Users that are interested in extract-expert are comparing it to the libraries listed below
Sorting:
- ☆66Updated last year
- ☆73Updated last year
- ☆51Updated 7 months ago
- ☆20Updated last year
- entropix style sampling + GUI☆26Updated 7 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- ☆45Updated last year
- ☆27Updated last year
- Lego for GRPO☆28Updated 3 weeks ago
- ☆63Updated last month
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆140Updated 4 months ago
- A framework for evaluating function calls made by LLMs☆37Updated 11 months ago
- ☆47Updated last year
- look how they massacred my boy☆63Updated 8 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆63Updated 2 months ago
- Small, simple agent task environments for training and evaluation☆18Updated 7 months ago
- ☆114Updated 6 months ago
- ☆124Updated 2 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 5 months ago
- ☆132Updated 10 months ago
- Let's create synthetic textbooks together :)☆75Updated last year
- Model REVOLVER, a human in the loop model mixing system.☆33Updated last year
- ☆157Updated 11 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 5 months ago
- ☆34Updated 3 months ago
- All the world is a play, we are but actors in it.☆50Updated this week
- Just a bunch of benchmark logs for different LLMs☆119Updated 10 months ago
- ☆96Updated last week
- EvaByte: Efficient Byte-level Language Models at Scale☆102Updated 2 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 7 months ago