Techniques for divergent thread group execution scheduling

Warp sharding techniques to switch execution between divergent shards on instructions that trigger a long stall, thereby interleaving execution between diverged threads within a warp instead of across warps. The technique may be applied to mitigate pipeline stalls in applications with low warp occup...

Full description

Saved in:
Bibliographic Details
Main Authors Stephenson, Mark, Kulkarni, Rishkul, Damani, Sana, Rangan, Ram, Johnson, Daniel Robert
Format Patent
LanguageEnglish
Published 19.03.2024
Subjects
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:Warp sharding techniques to switch execution between divergent shards on instructions that trigger a long stall, thereby interleaving execution between diverged threads within a warp instead of across warps. The technique may be applied to mitigate pipeline stalls in applications with low warp occupancy and high divergence. Warp data cache locality may also be improved by concentrating memory accesses within a warp rather than spreading them across warps.
Bibliography:Application Number: US202117184420