Most RL post-training pipelines are compute-bound in a place dev teams rarely optimize: rollout generation. In a synchronous RL training step, generation accounts for 65–72% of total wall-clock time. Gradient computation, log-probability recomputation, and weight synchronization together consume the remaining 27–33%. 

**Every efficiency gain on the optimizer side is bounded by that ceiling. A New NVIDIA Research addresses this directly.**

The research work integrates EAGLE-3 speculative decoding into NeMo RL with a vLLM backend as a rollout acceleration primitive — not as an inference optimization applied after training, but as a component wired into the RL training loop itself, with coordinated weight synchronization between the learner and the rollout engine at every policy update.

**🎯 What makes this approach architecturally distinct:**

Every existing rollout efficiency method changes the training dynamics in some way. Asynchronous execution introduces policy lag. Off-policy replay requires importance sampling corrections. Low-precision rollouts introduce distribution mismatch. Speculative decoding is different — the rejection sampling procedure guarantees the rollouts are drawn from the target model's exact output distribution. The training signal is unchanged by construction.

**Measured Results (8B Scale | 32x GB200 GPUs): 📈**

→ Generation Latency: 100.0s ➡️ 56.6s (1.8x speedup) ⚡

→ End-to-End Step Time: 151.2s ➡️ 107.5s (1.41x speedup)

→ Accuracy: AIME-2024 validation remains identical.

**💡 3 Key Operational Findings:**

1️⃣ DAPO Matters: Draft initialization on in-domain data (1.77x) crushes generic chat-domain setups (1.51x). Alignment is everything. 🧩

2️⃣ The "K" Sweet Spot: Draft length k=3 outperformed k=5 or 7. Verification overhead scales fast—don't get greedy. ⚖️

3️⃣ Acceptance ≠ Speed: n-gram drafting had decent acceptance but was actually slower than the baseline.

**Simulator projections at 235B scale (Qwen3-235B-A22B, 2048 GB200 GPUs, async RL at policy lag 2):**

→ Rollout speedup: \~3.5× 

→ Projected end-to-end training speedup: \~2.5×

**Full analysis:** [https://www.marktechpost.com/2026/05/01/a-new-nvidia-research-shows-speculative-decoding-in-nemo-rl-achieves-1-8x-rollout-generation-speedup-at-8b-and-projects-2-5x-end-to-end-speedup-at-235b/](https://www.marktechpost.com/2026/05/01/a-new-nvidia-research-shows-speculative-decoding-in-nemo-rl-achieves-1-8x-rollout-generation-speedup-at-8b-and-projects-2-5x-end-to-end-speedup-at-235b/)

**Paper:** [https://arxiv.org/pdf/2604.26779](https://arxiv.org/pdf/2604.26779)

**Nemo RL v0.6.0 Repo:** [https://github.com/NVIDIA-NeMo/RL/](https://github.com/NVIDIA-NeMo/RL/)

A New NVIDIA Research Shows Speculative Decoding in NeMo RL Achieves 1.8× Rollout Generation Speedup at 8B and Projects 2.5× End-to-End Speedup at 235B