cognitivecomputations / extract-expert
Extract a single expert from a Mixture Of Experts model using slerp interpolation.
☆17Updated 11 months ago
Alternatives and similar repositories for extract-expert
Users that are interested in extract-expert are comparing it to the libraries listed below
Sorting:
- ☆66Updated 11 months ago
- entropix style sampling + GUI☆26Updated 6 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆90Updated 3 months ago
- Small, simple agent task environments for training and evaluation☆18Updated 6 months ago
- ☆48Updated 6 months ago
- ☆48Updated last year
- ☆73Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated 9 months ago
- ☆113Updated 4 months ago
- ☆20Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆77Updated last month
- Mixing Language Models with Self-Verification and Meta-Verification☆104Updated 5 months ago
- ☆45Updated last year
- ☆30Updated 10 months ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆40Updated 2 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 11 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆121Updated last year
- Let's create synthetic textbooks together :)☆74Updated last year
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆22Updated last month
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆52Updated 3 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆92Updated 3 weeks ago
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- ☆53Updated 11 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆61Updated last year
- ☆156Updated 9 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆60Updated 9 months ago
- Simple GRPO scripts and configurations.☆58Updated 3 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Updated 11 months ago
- ☆123Updated last month
- Simple examples using Argilla tools to build AI☆52Updated 5 months ago