ConCopilot / concopilotLinks
Making AI & LLM APPs components reusable, replaceable, portable, and flexible.
☆24Updated last year
Alternatives and similar repositories for concopilot
Users that are interested in concopilot are comparing it to the libraries listed below
Sorting:
- A MoE impl for PyTorch, [ATC'23] SmartMoE☆70Updated 2 years ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆137Updated last year
- 官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系 统，其他都是运行在其上面的软件。☆17Updated 2 years ago
- Manages vllm-nccl dependency☆17Updated last year
- ☆79Updated last year
- CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…☆205Updated last month
- Mixture-of-Experts (MoE) Language Model☆192Updated last year
- Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".☆48Updated last year
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆41Updated last year
- Repo of ACL 2025 Paper "Quantification of Large Language Model Distillation"☆94Updated 4 months ago
- LLMem: GPU Memory Estimation for Fine-Tuning Pre-Trained LLMs☆26Updated 6 months ago
- Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature se…☆89Updated this week
- 最简 易的R1结果在小模型上的复现，阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证，对于强推理能力，think思考过程性内容是AGI/ASI的核心。☆44Updated 9 months ago
- PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant with Reliable References☆19Updated last year
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆59Updated last year
- ☆29Updated last year
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆119Updated last year
- ☆34Updated 9 months ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆61Updated last year
- GPTQ inference TVM kernel☆40Updated last year
- ☆46Updated 4 months ago
- ☆16Updated last year
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆19Updated this week
- Fused Qwen3 MoE layer for faster training, compatible with HF Transformers, LoRA, 4-bit quant, Unsloth☆212Updated 3 weeks ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆249Updated last year
- CodeLLaMA 中文版 - 代码生成助手，huggingface累积下载2w+次☆45Updated 2 years ago
- ☆60Updated 6 months ago
- ☆20Updated last month
- ☆300Updated 6 months ago
- 中国如何下载huggingface 模型并共享链接☆56Updated last year