SIGN IN SIGN UP

[Pipeline] Enforce an outstanding send budget (#196727)

## Summary

Add an optional `max_outstanding_sends` limit to runtime pipeline schedules. The schedule moves existing send waits earlier to keep pending forward and backward sends within the per-rank limit.

Waits move only when dependency analysis proves the placement cannot create a cycle. Unsafe limits raise an actionable error. The default behavior remains unchanged.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/196727
Approved by: https://github.com/sanketpurandare
ghstack dependencies: #196640, #196724, #196725, #196963, #196726
C
Chien-Chin Huang committed
38cca96300da024842405ecefa081e4761254922
Parent: bc3ce28
Committed by PyTorch MergeBot <pytorchmergebot@users.noreply.github.com> on 9/30/2026, 11:36:28 PM