Alternatives and similar repositories for qingketalk

Users that are interested in qingketalk are comparing it to the libraries listed below

• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆123Updated this week
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆74Updated 4 months ago
• step-law / steplaw
  ☆198Updated 4 months ago
• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆67Updated last week
• sii-research / siiRL
  siiRL: Shanghai Innovation Institute RL Framework for Advanced LLMs and Multi-Agent Systems
  ☆179Updated this week
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆189Updated 2 months ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆349Updated this week
• stepfun-ai / Step3
  ☆413Updated 3 weeks ago
• fxmeng / TransMLA
  TransMLA: Multi-Head Latent Attention Is All You Need
  ☆349Updated this week
• bobo0810 / LearnDeepSpeed
  DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
  ☆177Updated last year
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆236Updated 3 weeks ago
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆92Updated last month
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆310Updated 4 months ago
• NVlabs / Fast-dLLM
  Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"
  ☆402Updated last week
• mdy666 / mdy_triton
  ☆143Updated 2 months ago
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆139Updated 4 months ago
• intelligent-machine-learning / atorch
  An industrial extension library of pytorch to accelerate large scale model training
  ☆47Updated 3 weeks ago
• OpenBMB / infllmv2_cuda_impl
  ☆46Updated 3 months ago
• madsys-dev / deepseekv2-profile
  ☆146Updated 6 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆110Updated 4 months ago
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆556Updated last month
• liangyuwang / Tiny-DeepSpeed
  Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library
  ☆43Updated 2 weeks ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆136Updated last year
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆406Updated 2 weeks ago
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆248Updated 6 months ago
• Ascend / AscendSpeed
  ☆79Updated last year
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆164Updated 7 months ago
• modelscope / Trinity-RFT
  Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…
  ☆321Updated this week
• MiroMindAI / MiroRL
  MiroRL is an MCP-first reinforcement learning framework for deep research agent.
  ☆145Updated last week
• TencentARC / mllm-npu
  mllm-npu: training multimodal large language models on Ascend NPUs
  ☆91Updated last year