ConCopilot / concopilotLinks
Making AI & LLM APPs components reusable, replaceable, portable, and flexible.
☆24Updated last year
Alternatives and similar repositories for concopilot
Users that are interested in concopilot are comparing it to the libraries listed below
Sorting:
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆136Updated last year
- PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant with Reliable References☆18Updated last year
- Mixture-of-Experts (MoE) Language Model☆189Updated 11 months ago
- CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…☆178Updated this week
- Repo of ACL 2025 Paper "Quantification of Large Language Model Distillation"☆91Updated last month
- Manages vllm-nccl dependency☆17Updated last year
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆19Updated last week
- A MoE impl for PyTorch, [ATC'23] SmartMoE☆67Updated 2 years ago
- LLMem: GPU Memory Estimation for Fine-Tuning Pre-Trained LLMs☆23Updated 3 months ago
- TensorRT LLM Benchmark Configuration☆13Updated last year
- Beyond the Model: Scaling Medical Capability with a Large Verifier System☆82Updated last week
- ☆79Updated last year
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆56Updated 9 months ago
- ☆33Updated 6 months ago
- ☆293Updated 3 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆41Updated last year
- Fused Qwen3 MoE layer for faster training, compatible with HF Transformers, LoRA, 4-bit quant, Unsloth☆168Updated last week
- ☆30Updated last year
- patches for huggingface transformers to save memory☆27Updated 3 months ago
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆56Updated 9 months ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆247Updated last year
- A memory efficient DLRM training solution using ColossalAI☆106Updated 2 years ago
- 最简易的R1结果在小模型上的复现,阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证,对于强推理能力,think思考过程性内容是AGI/ASI的核心。☆44Updated 6 months ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆47Updated last year
- Official Implementation of APB (ACL 2025 main Oral)☆31Updated 6 months ago
- ☆29Updated 2 months ago
- ☆16Updated last year
- ☆83Updated last year
- ☆56Updated 3 months ago
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆19Updated 7 months ago