Alternatives and similar repositories for Parameter-Efficient-MoE:

Users that are interested in Parameter-Efficient-MoE are comparing it to the libraries listed below

• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 10 months ago
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 5 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆42Updated 11 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 11 months ago
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• arcee-ai / DAM
  ☆48Updated 5 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• emrgnt-cmplxty / SmolTrainer
  ☆20Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆54Updated 11 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• cg123 / bitnet
  Modeling code for a BitNet b1.58 Llama-style model.
  ☆23Updated 11 months ago
• Alignment-Lab-AI / Our-Projects
  A repository of projects and datasets under active development by Alignment Lab AI
  ☆22Updated last year
• teknium1 / ShareGPT-Builder
  ☆112Updated 4 months ago
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆27Updated 2 months ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆82Updated last month
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆31Updated 8 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 6 months ago
• catid / lllm
  Latent Large Language Models
  ☆17Updated 8 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 4 months ago
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated 11 months ago
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆27Updated 3 weeks ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆83Updated 5 months ago
• kyegomez / Finetuning-Suite
  Finetune any model on HF in less than 30 seconds
  ☆58Updated 2 weeks ago
• SkunkworksAI / CodeFusion
  ☆15Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆51Updated last year
• nyunAI / PruneGPT
  ☆53Updated 10 months ago