Asynchronous reprojection is a class ofcomputer graphics technologies aimed at ensuring avirtual reality headset is responsive to user motion even when theGPU isn't able to keep up with the headset's targetframerate,[1] and to reduce perceivedinput lag at all times regardless of internal framerate.[2] Reprojection involves the headset's driver taking one or multiple previouslyrendered frames and using newer motion information from the headset's sensors toextrapolate (often referred to as "reprojecting" or "warping") the previous frame into a prediction of what a normally rendered frame would look like.[3] "Asynchronous" refers to this process being continuously performed in parallel with rendering, allowing synthesized frames to be displayed without delay in case a regular frame is not rendered in time, and reprojecting all frames by default to reduce perceived latency.[3]
The use of these techniques allows for a lowering in the video renderinghardware specifications required to achieve a certain intended level of responsiveness.[4]
Various vendors have implemented their own variations of the technique under different names. Basic versions of the technique are referred to asasynchronous reprojection byGoogle andValve,[1][5] whileOculus has two implementations, calledasynchronous timewarp[3] andasynchronous spacewarp. Asynchronous timewarp uses the headset's rotational data to reproject all frames. Asynchronous spacewarp extrapolates a new frame based on the last frame it received if none is rendered, additionally usingdepth information to help compensate for perspective and other geometric changes.[6][7][8] Valve's early version calledinterleaved reprojection would make the application run at half frame rate and reproject every other frame.[9] A later variant by Valve isSteamVR Motion Smoothing, which builds upon regular asynchronous reprojection in being able to reproject two frames instead of one.[5]
