GPipe: Steps in a Pipeline Schedule
Beginner
The problem, from first principles
A GPipe forward pass takes M plus S minus one time steps: the first micro-batch needs S steps to reach the last stage, and the remaining micro-batches follow one per step.
From theory to code
Implement schedule_steps(stages, micro), the length of the forward schedule.
Constraints
- Returns an integer.
Hints
Hint 1
Add the micro-batch count to the stage count and subtract one.
Keywords
research-paperssystemsparallelismpipeline
Python
Run your code to see results
No results yet
Run your code to check it against the examples, or submit to run every test.