GeeeekExplorer / 3d-parallel-demoLinks
使用torch.distributed实现DP/TP/PP
☆12Updated 2 years ago
Alternatives and similar repositories for 3d-parallel-demo
Users that are interested in 3d-parallel-demo are comparing it to the libraries listed below
Sorting:
- a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation☆61Updated 9 months ago
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆181Updated this week
- 😎 A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, Agent, and Beyond☆325Updated last week
- [ICLR 2025🔥] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models☆25Updated 6 months ago
- Official Implementation of "Learning Harmonized Representations for Speculative Sampling" (HASS)☆52Updated 9 months ago
- ☆208Updated 2 months ago
- A Comprehensive Survey on Long Context Language Modeling☆216Updated last month
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆144Updated 2 weeks ago
- [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆197Updated last month
- Reproducing R1 for Code with Reliable Rewards☆278Updated 8 months ago
- Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)☆350Updated 8 months ago
- Efficient Mixture of Experts for LLM Paper List☆154Updated 3 months ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆281Updated 2 months ago
- End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoning☆348Updated 3 months ago
- Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**☆214Updated 10 months ago
- Curation of resources for LLM research, screened by @tongyx361 to ensure high quality and accompanied with elaborately-written concise de…☆63Updated last year
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆270Updated last year
- ☆71Updated 8 months ago
- Evaluation utilities based on SymPy.☆21Updated last year
- This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.☆253Updated last week
- PoC for "SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning" [NeurIPS '25]☆61Updated 3 months ago
- ☆150Updated 6 months ago
- Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…☆255Updated 4 months ago
- ☆215Updated 10 months ago
- Super-Efficient RLHF Training of LLMs with Parameter Reallocation☆330Updated 8 months ago
- ☆97Updated last month
- ☆49Updated last year
- (best/better) practices of megatron on veRL and tuning guide☆114Updated 3 months ago
- This is the official Python version of CoreInfer: Accelerating Large Language Model Inference with Semantics-Inspired Adaptive Sparse Act…☆17Updated last year
- Model merging is a highly efficient approach for long-to-short reasoning.☆96Updated 2 months ago