GeeeekExplorer / 3d-parallel-demoLinks
使用torch.distributed包实现DP/TP/PP
☆10Updated last year
Alternatives and similar repositories for 3d-parallel-demo
Users that are interested in 3d-parallel-demo are comparing it to the libraries listed below
Sorting:
- a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation☆50Updated 2 months ago
- ☆64Updated last month
- Model merging is a highly efficient approach for long-to-short reasoning.☆56Updated this week
- ☆43Updated last year
- A Comprehensive Survey on Long Context Language Modeling☆147Updated this week
- Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…☆221Updated this week
- Evaluation utilities based on SymPy.☆18Updated 5 months ago
- 🔥 How to efficiently and effectively compress the CoTs or directly generate concise CoTs during inference while maintaining the reasonin…☆46Updated 2 weeks ago
- ☆169Updated this week
- Reproducing R1 for Code with Reliable Rewards☆208Updated last month
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆220Updated last year
- [ICLR 2025 Workshop] "Landscape of Thoughts: Visualizing the Reasoning Process of Large Language Models"☆19Updated last week
- Chain of Thoughts (CoT) is so hot! so long! We need short reasoning process!☆54Updated 2 months ago
- Implementation code for ACL2024:Advancing Parameter Efficiency in Fine-tuning via Representation Editing☆14Updated last year
- PoC for "SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning" [arXiv '25]☆37Updated 3 weeks ago
- ☆198Updated 7 months ago
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆85Updated 3 months ago
- Curation of resources for LLM research, screened by @tongyx361 to ensure high quality and accompanied with elaborately-written concise de…☆54Updated 10 months ago
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆45Updated 7 months ago
- ☆33Updated 8 months ago
- This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.☆107Updated this week
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆110Updated this week
- ☆189Updated last month
- The official repository of "Whoever Started the Interference Should End It: Guiding Data-Free Model Merging via Task Vectors""☆15Updated last month
- ☆202Updated 3 months ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆83Updated last month
- 😎 A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond☆237Updated this week
- ☆132Updated last month
- [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling☆29Updated this week
- my commonly-used tools☆56Updated 5 months ago