GeeeekExplorer / 3d-parallel-demo
使用torch.distributed包实现DP/TP/PP
☆10Updated last year
Alternatives and similar repositories for 3d-parallel-demo:
Users that are interested in 3d-parallel-demo are comparing it to the libraries listed below
- Reproducing R1 for Code with Reliable Rewards☆179Updated this week
- a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation☆46Updated 3 weeks ago
- This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.☆72Updated this week
- ☆54Updated last week
- Curation of resources for LLM research, screened by @tongyx361 to ensure high quality and accompanied with elaborately-written concise de…☆52Updated 9 months ago
- ☆63Updated 4 months ago
- Evaluation utilities based on SymPy.☆16Updated 4 months ago
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆75Updated 2 months ago
- 😎 A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond☆191Updated this week
- Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…☆190Updated last week
- Chain of Thoughts (CoT) is so hot! so long! We need short reasoning process!☆49Updated 3 weeks ago
- ☆38Updated last year
- ☆31Updated 6 months ago
- A Comprehensive Survey on Long Context Language Modeling☆131Updated 3 weeks ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆203Updated 11 months ago
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆42Updated 5 months ago
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆71Updated 2 years ago
- ☆192Updated 6 months ago
- ☆60Updated this week
- ☆187Updated 2 months ago
- ☆116Updated this week
- Model merging is a highly efficient approach for long-to-short reasoning.☆42Updated 3 weeks ago
- A research repo for experiments about Reinforcement Finetuning☆44Updated 2 weeks ago
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning☆162Updated last year
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆87Updated 2 months ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆77Updated last week
- ☆39Updated 5 months ago
- Based on the R1-Zero method, using rule-based rewards and GRPO on the Code Contests dataset.☆17Updated this week
- [ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"☆41Updated 4 months ago
- Multi-Candidate Speculative Decoding☆35Updated last year