Movatterモバイル変換

Per-Face Texture Mapping forPer-Face Texture Mapping forRealtime RenderingRealtime Rendering““Realtime Ptex”Realtime Ptex”

Quick NoteQuick Note• For CUDA/Compute folks:For CUDA/Compute folks:– Ptex != PTXPtex != PTX

GoalsGoals Render native Ptex datasets in real-time on commodityhardware Remove texture seams from textured modelsRemove texture seams from textured models Remove expensive, manual model unwrap step from artRemove expensive, manual model unwrap step from artpipelinepipeline Support arbitrary resolutions on a per-face basisSupport arbitrary resolutions on a per-face basis

Video Time!Video Time!© Disney. Used with permission.

Video RecapVideo RecapStored as 8Kx8KRendered as 2Kx2K© Disney. Used with permission.

Model StatisticsModel Statistics• ~800 FPS on GTX 460 with no optimization~800 FPS on GTX 460 with no optimization• 278M of Color Texture Data278M of Color Texture Data• 5812 Patches5812 Patches© Disney. Used with permission.

General StepsGeneral StepsLoadModelLoadModelRenderRenderPreprocessDraw TimeBucketandSortBucketandSortGenerateMipmapsGenerateMipmapsFillBordersFillBordersPackTextureArraysPackTextureArraysReorderIndexBufferReorderIndexBufferPackPatchConstantsPackPatchConstantsRed: Vertex and Index dataGreen: Patch Constant informationBlue: Texel dataOrange: Adjacency information

Load ModelLoad ModelLoadModelLoadModelRenderRenderPreprocessDraw TimeBucketandSortBucketandSortGenerateMipmapsGenerateMipmapsFillBordersFillBordersPackTextureArraysPackTextureArraysReorderIndexBufferReorderIndexBufferPackPatchConstantsPackPatchConstantsRed: Vertex and Index dataGreen: Patch Constant informationBlue: Texel dataOrange: Adjacency information

Load ModelLoad Model• Vertex DataVertex Data– Any geometry arranged as a quad-based meshAny geometry arranged as a quad-based mesh– Example: Wavefront OBJExample: Wavefront OBJ• Patch TexturePatch Texture– Power-of-two texture imagesPower-of-two texture images• Adjacency InformationAdjacency Information– 4 Neighbors of each quad patch4 Neighbors of each quad patch• Easily load with library available fromEasily load with library available from http://ptex.us/http://ptex.us/

Load Model (cont’d)Load Model (cont’d)• Texel DataTexel Data– Per face, load the largest available mipmap level from thePer face, load the largest available mipmap level from thesource filessource files– In memory, place the loaded texel data into a memoryIn memory, place the loaded texel data into a memorybuffer that has a fixed-size texel border regionbuffer that has a fixed-size texel border region– The borders must be big enough for the largest filter kernelThe borders must be big enough for the largest filter kernelyou will support (Border size = ½ filter kernel size)you will support (Border size = ½ filter kernel size)• Bilinear (2x2 kernel): 1 pixel borderBilinear (2x2 kernel): 1 pixel border• 16x Aniso (16x16 kernel): 8 pixel border16x Aniso (16x16 kernel): 8 pixel border

Load ModelLoad ModelVB: …IB:

Bucket and SortBucket and SortLoadModelLoadModelRenderRenderPreprocessDraw TimeBucketandSortBucketandSortGenerateMipmapsGenerateMipmapsFillBordersFillBordersPackTextureArraysPackTextureArraysReorderIndexBufferReorderIndexBufferPackPatchConstantsPackPatchConstantsRed: Vertex and Index dataGreen: Patch Constant informationBlue: Texel dataOrange: Adjacency information

Bucket and SortBucket and Sort• Bucket ptex surfaces into groups by Aspect RatioBucket ptex surfaces into groups by Aspect Ratio– Each Aspect Ratio will be one bucketEach Aspect Ratio will be one bucket– 1:1 bucket, 2:1 bucket, 4:1 bucket, etc1:1 bucket, 2:1 bucket, 4:1 bucket, etc• Then, within each bucket, sort by decreasing surfaceThen, within each bucket, sort by decreasing surfacesize and assign IDs.size and assign IDs.– This allows us to densely pack texture arrays, avoiding “empty”This allows us to densely pack texture arrays, avoiding “empty”surfaces.surfaces.

Bucket and SortBucket and SortBucket 4:1Bucket 1:10

Reorder Index BufferReorder Index BufferLoadModelLoadModelRenderRenderPreprocessDraw TimeBucketandSortBucketandSortGenerateMipmapsGenerateMipmapsFillBordersFillBordersPackTextureArraysPackTextureArraysReorderIndexBufferReorderIndexBufferPackPatchConstantsPackPatchConstantsRed: Vertex and Index dataGreen: Patch Constant informationBlue: Texel dataOrange: Adjacency information

Reorder Index BufferReorder Index Buffer• OriginalOriginal • Post Sort, we have 2!Post Sort, we have 2!IB:IB(1:1):IB(4:1):

Generate MipmapsGenerate MipmapsLoadModelLoadModelRenderRenderPreprocessDraw TimeBucketandSortBucketandSortGenerateMipmapsGenerateMipmapsFillBordersFillBordersPackTextureArraysPackTextureArraysReorderIndexBufferReorderIndexBufferPackPatchConstantsPackPatchConstantsRed: Vertex and Index dataGreen: Patch Constant informationBlue: Texel dataOrange: Adjacency information

Generate MipmapsGenerate Mipmaps• Walk through surfaces, and generate a mipmap chainWalk through surfaces, and generate a mipmap chainfrom native size to (MinFilterSize x MinFilterSize) forfrom native size to (MinFilterSize x MinFilterSize) foreach surface.each surface.– Bilinear stops at 2x2, 8xAniso stops at 8x8Bilinear stops at 2x2, 8xAniso stops at 8x8• Ptex data files do not guarantee complete mipmapPtex data files do not guarantee complete mipmapchains—although the library can generate all levels forchains—although the library can generate all levels foryou—with pre-multiplied alpha.you—with pre-multiplied alpha.• Mipmap chains stop to allow for unique pinning valuesMipmap chains stop to allow for unique pinning valuesin the cornersin the corners

Generate MipmapsGenerate Mipmaps• Done for every surface, but only inside the surface—theDone for every surface, but only inside the surface—theborder is not touched.border is not touched.

Fill BordersFill BordersLoadModelLoadModelRenderRenderPreprocessDraw TimeBucketandSortBucketandSortGenerateMipmapsGenerateMipmapsFillBordersFillBordersPackTextureArraysPackTextureArraysReorderIndexBufferReorderIndexBufferPackPatchConstantsPackPatchConstantsRed: Vertex and Index dataGreen: Patch Constant informationBlue: Texel dataOrange: Adjacency information

Fill BordersFill Borders• Copy neighbor texels into border area of this surface’sCopy neighbor texels into border area of this surface’smip levelmip level– Match source and destination number of pixels whenMatch source and destination number of pixels whenpossiblepossible• Bordered textures are the heart of the logical realtimeBordered textures are the heart of the logical realtimeptex solutionptex solution• Allows 1-2 texture lookups per ptex sample requestAllows 1-2 texture lookups per ptex sample request– 1 if not performing tween-mip-level interpolation, 2 otherwise1 if not performing tween-mip-level interpolation, 2 otherwise

Pack Texture ArraysPack Texture ArraysLoadModelLoadModelRenderRenderPreprocessDraw TimeBucketandSortBucketandSortGenerateMipmapsGenerateMipmapsFillBordersFillBordersPackTextureArraysPackTextureArraysReorderIndexBufferReorderIndexBufferPackPatchConstantsPackPatchConstantsRed: Vertex and Index dataGreen: Patch Constant informationBlue: Texel dataOrange: Adjacency information

Texture ArraysTexture Arrays• Like 3D / Volume Textures, except:Like 3D / Volume Textures, except:– No filtering between 2D slicesNo filtering between 2D slices– Only X and Y decrease with mipmap level (Z doesn’t)Only X and Y decrease with mipmap level (Z doesn’t)– Z indexed by integer index, not [0,1]Z indexed by integer index, not [0,1]• E.g. (0.5, 0.5, 4) would be (0.5, 0.5) from the 5E.g. (0.5, 0.5, 4) would be (0.5, 0.5) from the 5ththsliceslice• API SupportAPI Support– Direct3D 10+: Texture2DArrayDirect3D 10+: Texture2DArray– OpenGL 3.0+: GL_TEXTURE_2D_ARRAYOpenGL 3.0+: GL_TEXTURE_2D_ARRAY

Pack Texture ArraysPack Texture Arrays• Copy all generated data into Texture2DArrayCopy all generated data into Texture2DArray• Each Texture2DArray represents a single mipmap levelEach Texture2DArray represents a single mipmap level– Texture2DArrays present a view of the data that is efficientTexture2DArrays present a view of the data that is efficientfor GPU layoutfor GPU layout– Logical Textures cut across the same page index of everyLogical Textures cut across the same page index of everyTexture2DArrayTexture2DArray

Pack Texture ArraysPack Texture Arrays0 1 23Logical Texture Layout

Pack Texture ArraysPack Texture Arrays10x10x3(1+8+1)x(1+8+1)x36x6x4(1+4+1)x(1+4+1)x44x4x4(1+2+1)x(1+2+1)x4GPU Layout Texture2DArraygColor[0]gColor[1]gColor[2]

Pack Patch ConstantsPack Patch ConstantsLoadModelLoadModelRenderRenderPreprocessDraw TimeBucketandSortBucketandSortGenerateMipmapsGenerateMipmapsFillBordersFillBordersPackTextureArraysPackTextureArraysReorderIndexBufferReorderIndexBufferPackPatchConstantsPackPatchConstantsRed: Vertex and Index dataGreen: Patch Constant informationBlue: Texel dataOrange: Adjacency information

Pack Patch ConstantsPack Patch Constants• Each primitive has a “PatchInfo” struct:Each primitive has a “PatchInfo” struct:– TextureId – which array slice contains our dataTextureId – which array slice contains our data– TopMipLevel – the index of the top-most mipmap level for thisTopMipLevel – the index of the top-most mipmap level for thistexturetexture– FlipUVs – whether or not to flip UVs, allows 1:2 and 2:1 to beFlipUVs – whether or not to flip UVs, allows 1:2 and 2:1 to begrouped into same bucketgrouped into same bucket– MaxMipLevels – Maximum mipmap level for each edgeMaxMipLevels – Maximum mipmap level for each edge

RenderRender• Brief Recap of D3D11 Pipe stagesBrief Recap of D3D11 Pipe stagesNew Direct3D 11 StagesNew Direct3D 11 StagesIAIA VS HS TSTS DS GS RASRAS PS OMOMProgrammable (Shader)Fixed Function

RenderRender• In the Hull ShaderIn the Hull Shader– Store pre-expansion PrimitiveID to output control pointsStore pre-expansion PrimitiveID to output control points– This is used everywhere to determine which set of PatchThis is used everywhere to determine which set of PatchConstants are owned by the currently running thread (inConstants are owned by the currently running thread (inDomain, Geometry or Pixel Shaders)Domain, Geometry or Pixel Shaders)New Direct3D 11 StagesNew Direct3D 11 StagesIAIA VS HS TSTS DS GS RASRAS PS OMOM

RenderRender• In the Domain ShaderIn the Domain Shader– Vertices belonging to a quad meshes are evaluated with aVertices belonging to a quad meshes are evaluated with adomain location, which is (0,0)-(1,1) for each patchdomain location, which is (0,0)-(1,1) for each patch– Use this value to store our UV locationUse this value to store our UV locationNew Direct3D 11 StagesNew Direct3D 11 StagesIAIA VS HS TSTS DS GS RASRAS PS OMOM

RenderRender• Texture lookups in Domain or Pixel Shader are replacedTexture lookups in Domain or Pixel Shader are replacedwith a “ptex” sample function.with a “ptex” sample function.– Determines which logical texture to work fromDetermines which logical texture to work from– Compute mipmap level(s) to accessCompute mipmap level(s) to access– Scale and bias computed (u,v) by mipmap sizeScale and bias computed (u,v) by mipmap size– Lookup texels, return weighted averageLookup texels, return weighted average

Texture Lookup Shader CodeTexture Lookup Shader Code• Traditional (D3D11)Traditional (D3D11)returnreturngTxDiffuse.Sample(gTxDiffuse.Sample(gSampler,gSampler,I.fTextureUV );I.fTextureUV );• PtexPtexreturnreturnptex( gTxDiffuse,ptex( gTxDiffuse,gSampler,gSampler,I.uPrimitiveId,I.uPrimitiveId,I.fTextureUV );I.fTextureUV );Complex logic hiddenin single function call

Questions?Questions?• jmcdonald at nvidia dot comjmcdonald at nvidia dot com• Brent dot Burley at disneyanimation dot comBrent dot Burley at disneyanimation dot com• http://ptex.us/http://ptex.us/• http://groups.google.com/group/ptexhttp://groups.google.com/group/ptex• Or visit our studio sessionOr visit our studio session– Monday, 8 August @ 4:30 PM – 5:00 PMMonday, 8 August @ 4:30 PM – 5:00 PM– The Studio / West Building, Ballroom AThe Studio / West Building, Ballroom A

Additional ConsiderationsAdditional Considerations• Filtering across edges with differing numbers of pixelsFiltering across edges with differing numbers of pixels• Filtering across cornersFiltering across corners

Filtering across edgesFiltering across edges

Filtering across cornersFiltering across corners• Corners with valence > 4Corners with valence > 4cannot be exactlycannot be exactlymatched with amatched with abilerp (4 samples)bilerp (4 samples)© Disney. Used with permission.

Filtering across cornersFiltering across corners• The solution is a bit more involved.The solution is a bit more involved.– First, walk the mesh and determine which corners are sharedFirst, walk the mesh and determine which corners are shared– For each shared group, determine the correct value for whenFor each shared group, determine the correct value for whenwe’re exactly at that corner. E.g. Simple Average.we’re exactly at that corner. E.g. Simple Average.– Then, modify every mipmap level of every surface of thatThen, modify every mipmap level of every surface of thatgroup s.t. the shared corner has the same valuegroup s.t. the shared corner has the same value– When you’re in the corner, everyone will perform the sameWhen you’re in the corner, everyone will perform the samelookup—regardless of mipmap level—and continuity prevailslookup—regardless of mipmap level—and continuity prevails

Filtering across cornersFiltering across corners• For Realtime Ptex, we apply pinning to all corners,For Realtime Ptex, we apply pinning to all corners,regardless of valence.regardless of valence.

Questions redux?Questions redux?• jmcdonald at nvidia dot comjmcdonald at nvidia dot com• Brent dot Burley at disneyanimation dot comBrent dot Burley at disneyanimation dot com• http://ptex.us/http://ptex.us/• http://groups.google.com/group/ptexhttp://groups.google.com/group/ptex• Or visit our studio sessionOr visit our studio session– Monday, 8 August @ 4:30 PM – 5:00 PMMonday, 8 August @ 4:30 PM – 5:00 PM– The Studio / West Building, Ballroom AThe Studio / West Building, Ballroom A

Movatterモバイル変換

Change Language

Realtime Per Face Texture Mapping (PTEX)

Embed presentation

Recommended

More Related Content

What's hot

Similar to Realtime Per Face Texture Mapping (PTEX)

Recently uploaded

Realtime Per Face Texture Mapping (PTEX)

Editor's Notes