US20070139435A1 - Data structure for texture data, computer program product, and texture mapping method - Google Patents

Abstract

The present invention has as an object to propose a texture mapping method which enables smooth shading, and is also appropriate for conserving memory resources. In order to achieve this object, in this invention, data regions with different color tones are set so as to form density gradients in the U coordinate direction and in the V coordinate direction of the texture data. If the brightness of the surface of the object to which texture mapping is performed is I, then among the coordinates to be read to access texture fdata, the U coordinate is calculated as U=a*I+b, and the V coordinate is determined from V=d. The value of the dynamic variable d can be set appropriately according to the application. Because the texture data is such that color tone density gradients are formed in two mutually orthogonal directions, smooth shading is possible, and a plurality of texture memory areas can be consolidated to conserve memory usage.

Description

BACKGROUND OF THE INVENTION
• 1. Field of the Invention
• This invention relates to a data structure for texture data, and in particular to a data structure appropriate for cell shading.
• 2. Description of the Related Art
• In conventional computer graphics, a technique called cell shading is known as a method of texture mapping using multiple textures. Cell shading is also called toon shading; in this shading method, the distance between the object (the model) for texture mapping and the light source, as well as the angles made by normal vectors to the object surface, are used to compute texture data UV coordinates (read addresses) and brightnesses and colors are appropriately filtered and textures mapped to the object surface.FIG. 8 is a figure explaining the texture data used in conventional cell shading. Thetexture data70 shown in the figure is used for shading processing from white to black when the brightness of the object surface exceeds a constant threshold, and in the normalized UV coordinate system (0.0≦U≦1.0 and 0.0≦V≦1.0), comprisesdata regions71 in which “white” data (0.0≦U ≦0.5 and 0.0≦V≦1.0) is allocated as well asdata regions72 in which “black” data (0.5≦U≦1.0 and 0.0≦V≦1.0) is allocated. UV coordinates referenced during texture mapping can be computed using the following two equations.
  U=a*I+b  (1)
  V=c*I+d  (2)
• Here I is the brightness value, computed from the inner product of the normalized normal vector to the object surface and the normalized light ray vector, and a, b, c, d are constants. Because the cell shading method is well known, the details of a, b, c, d are here omitted. If the brightness I can be computed, the UV coordinates for the texture data can be computed from equations (1) and (2). The movement locus of UV coordinates when the value of the brightness I is changed is similar to thestraight line73. As is clear from the figure, as a result of light source calculations, when setting the UV values at each vertex of the object, a small U value is specified and white texture mapping is performed at each portion for which the angle made by the object surface normal vector and the light ray vector is small and on which a large amount of light is incident; on the other hand, a large U value is specified and black texture mapping is performed at each portion for which the angle made by the object surface normal vector and the light ray vector is large and on which not much light is incident. In other words, when the U value exceeds 0.5, pixels on the object surface are shaded from white to black. Thus by performing shading processing using the two values of white and black, the difference between exposed faces and unexposed faces on the object surface can be made apparent, and so-called animation-style shading can be performed.
• However, in conventional cell shading methods, it is necessary to prepare texture data for shading according to the light source color, distance between light source, and object, light intensity of the light source and other exposure conditions, and consequently there are the problems of additional labor for the designer, and waste of hardware resources. Further, in the past object details were represented in texture mapping by applying a two-dimensional design or pattern to a two-dimensional plane; but when texture mapping is employed for shading as described above, because texture data for shades suffices in only a single-dimension direction, the use of two-dimensional texture data as texture data for shading results in wasted memory. This problem is explained referring toFIGS. 9 and 10.
• FIG. 9 explains a case in which the texture data to be used is changed according to the color of the light source; as the light sources illuminating theobject50, ared light source41,green light source42, andblue light source43 are arranged in a virtual space. Three types of texture data are prepared for binary shading processing according to each light source color. In the state shown in the drawing, because theobject50 is in the position of thegreen light source42, texture data for green shading processing is used to perform texture mapping. However, when theobject50 crosses theboundary61 between thered light source41 andgreen light source42 to move to the side of thered light source41, the texture data for thegreen light source42 can no longer be used for shading, and shading must be performed using the texture data for thered light source41. When the texture data to be used is suddenly changed at theborder line61, the shading displayed on the surface of theobject50 suddenly changes, and the appearance of the graphic display is extremely unnatural. The case in which theobject50 crosses theboundary62 between thegreen light source42 andblue light source43 to move to the side of theblue light source43 is similar.
• FIG. 10 explains a case in which the texture data used is changed according to the positional relation between the camera (virtual viewpoint) and object; thelight source40,object50, andcamera60 are arranged in prescribed positions. In three-dimensional computer graphics, each of the polygons comprised by theobject50 is modeling-transformed into world coordinates, and after performing field-of-view transformation to the camera viewpoint as seen from thecamera60, three-dimensional clipping processing, hidden surface elimination, texture mapping, shading processing, display priority processing, and other processing, the result is displayed on a video display. Because the shading to which theobject50 is subjected is viewed differently according to the distance between thecamera60 andobject50, texture data for a plurality of types of shading processing are prepared in advance, and when the distance between theobject50 andcamera60 exceeds a certain distance, the texture used in shading is changed. In the example of the drawing, when theobject50 crosses over theboundary63 and moves farther from thecamera60, the texture used is changed. However, if the texture used changes suddenly at theboundary63, the shades displayed on the surface of theobject50 changes suddenly, and the appearance of the graphic display is extremely unnatural.
• However, of thetexture data70 shown inFIG. 8, the data actually used is only the data on thestraight line73, and the other data regions are not used, and the problem of considerable waste of memory for texture data storage has been noted.
SUMMARY OF THE INVENTION
• An object of the present invention is to propose a data structure for texture data, a program to cause a computer system to execute texture mapping, and texture mapping method, and a texture mapping device which resolve the above-described problems and enable smooth shading while also conserving memory resources.
• In order to resolve the above problems, this invention provides a method comprising a step in which, in order to access texture data comprising a computer-readable data region in which color data forming density gradients in two mutually orthogonal directions is arranged, coordinates are calculated in order to access the above data region in one of the directions among the above two directions, using brightness information of the object surface for texture mapping based on a prescribed equation; a step to calculate coordinates to access the above data region in the other direction of the above two directions based on an arbitrary value substituted into a dynamic variable; and, a step to read color data by accessing the above data region based on the calculated coordinates and perform texture mapping to the surface of the above object.
• Further, the present invention can provide computer-readable recording media on which is recorded a computer program to cause a computer system to execute the above method. Such recording media may be, for example, optical recording media (such as CD-RAM, CD-ROM, DVD-RAM, DVD-ROM, DVD-R, PD discs, MD discs, MO discs, and other recording media the data of which can be read optically), magnetic recording media (such as flexible disks, magnetic cards, magnetic tape, and other recording media the data of which can be read magnetically), as well as memory cartridges comprising DRAM, SRAM, MRAM, FRAM, or other memory devices, and other transportable recording media.
• Moreover, the above program can be distributed on demand from a Web server or other network server in response to a request from a client device (such as a personal computer, game equipment, portable telephone equipped with a Web browser, PDA, Palm-type PC, or other portable information terminal or similar) connected to the Internet or to a packet communication or other open network.
BRIEF DESCRIPTION OF THE DRAWINGS
• FIG. 1 is a drawing which explains texture data;
• FIG. 2 is a drawing which explains texture data;
• FIG. 3 is a drawing which explains texture mapping;
• FIG. 4 is a drawing which explains texture mapping;
• FIG. 5 is a drawing which explains texture mapping;
• FIG. 6 is a drawing which explains texture mapping;
• FIG. 7 is a functional block diagram of the generation of video signals;
• FIG. 8 is a drawing which explains conventional texture data;
• FIG. 9 is a drawing which explains conventional texture mapping; and,
• FIG. 10 is a drawing which explains conventional texture mapping.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
• Below, aspects of this invention are explained, referring to the drawings.
• FIG. 7 is a functional block diagram of texture mapping onto an object using texture data for shading, to output video signals to a video display. In the figure,11 is texture memory in which is stored texture data,12 is a filter,13 is frame memory for writing one screen's worth of image data, and14 is a video signal generation unit to output video signals to a video display. After the results of light source calculations corresponding to individual pixels on the object surface or the vertices of polygons comprised by the object, which are brightness data and color data corresponding to each pixel or to the vertices of polygons, are read fromtexture memory11, filter computations are performed in thefilter12, referring to the brightness data and color data of surrounding pixels, and the processing results are written toframe memory13. The videosignal generator unit14 generates video signals based on the image data written to theframe memory13, and outputs the signals to a video display, not shown.
• FIG. 1 is a drawing which explains the texture data of this aspect. Thetexture data20 shown in the drawing is, for convenience in explanation, shown with the texture in a state of expansion in a two-dimensional plane; however, the state in which data is stored in thetexture memory11 need not necessarily be expanded in a two-dimensional plane, and the data structure of the texture data is identical so long as the interrelation between color data at arbitrary coordinates of the texture data shown in the drawing is satisfied. In other words, “data structure” in this specification does not signify the interrelation between individual data bits in the state in which the texture data is stored in memory or other recording media, but refers instead to the interrelation between color data at individual coordinates defined by texture data read addresses. Color data comprises, in the case of chromatic colors, information relating to brightness, hue, and color saturation, and in the case of achromatic colors, information relating to brightness (brightness and darkness). In the case of transparent colors, color data comprises information relating to transparency; in the case of colored translucence, color data comprises, in addition to transparency, information relating to brightness, hue, and saturation.
• As shown inFIG. 3, thetexture data20 is prepared for use in shading of the object surface in cases where theobject50 moves in the lateral direction in the drawing under the red, green, andblue light sources41,42 and43. In thetexture data20, white texture data is allocated in data region C10 in which 0.0≦U≦0.5 and 0.0≦V≦1.0, and texture data for use in shading for thelight sources41,42,43 is allocated at substantially equal intervals in data regions C1 to C9, in which 0.5≦U≦1.0 and 0.0≦V≦1.0. More specifically, C1 is deep red texture data, C2 is light red, C3 is a mixture of light red and light green, C4 is light green, C5 is dark green, C6 is light green, C7 is a mixture of light green and light blue, C8 is light blue, and C9 is dark blue texture data. That is, texture data for shading in a plurality of different color tones is arranged in the V coordinate direction, according to the positions of thelight sources41,42 and43. In the example shown in the drawing, for convenience in explanation, a density gradient is provided in nine stages; however, in actuality a finer density gradient, with several tens of stages, may be provided. Of course, setting the U coordinate and V coordinate of the texture in the opposite manner does not change the essence of this invention. By providing a density gradient which is appropriate to the application, various shading processing can be performed, from animation-style shading processing with binary shades, to comic-style shading processing with multi-value shades. In this aspect, when using thetexture data20 to perform shading, equation (1) is employed to compute the U value through light source calculations, and in place of equation (2), the following equation (3) is used to determine the V value.
  V=d  (3)
• According to equation (3), the V value can be set by the value of the variable d, regardless of the brightness I. The variable d is a dynamic variable which can be changed arbitrarily by the program, and can, for example, be changed in realtime according to the distance between the light source and object; moreover, the variable d can be changed as appropriate according to an unfolding game situation in a virtual space (for example, according to whether a player is in a favorable situation or not, or whether the number of points scored is increased or not), regardless of the positional relation with the light source. The value to which the variable d is set can be decided appropriately by the programmer according to various applications, such as whether this invention is to be used for computer graphics art or for game applications.
• For example, in the example ofFIG. 1, if the value of d is set to 0.15, light red shading enables representation of a weak contrast, whereas if the value of d is set to 0.9, dark blue shading can be used to represent a strong contrast. If the value of d is defined in association with the distance from the light source, the value of d can be changed in realtime in concert with the positional relation between the light source and the object. For example, in the example ofFIG. 3 a coordinate axis is set in the lateral direction in the drawing, and if the position of thelight source41 is set to d=0.0, the position of thelight source42 is set to d=0.5, and the position of thelight source43 is set to d=1.0, then as theobject50 approaches thelight source41, the value of d approaches to 0.0; as theobject50 approaches thelight source42, the value of d approaches 0.5; and as theobject50 approaches thelight source43, the value of d approaches 1.0. In the example of the drawing, theobject50 is slightly to the left of the position of thelight source42; if the value of d on the above coordinate axis is determined to be d=0.35, the color of shades on the surface of theobject50 will be light green.
• In this way, by using the U value for shading, and using the V value for color tone control of the shades, smooth shading processing for light sources with three colors can be realized. And because there is no sudden change in the color tone of shades at a boundary set in advance by the positional relation with light sources, as in the prior art, smooth shading without abnormalities can be realized. Also, in the prior art it was necessary to prepare a plurality of texture data sets according to the number of light sources, but in the present aspect only one data set is necessary, so that the labor of a designer creating a plurality of texture data sets can be eliminated, and texture memory requirements can be reduced.
• Another usage example employing the texture data of this aspect is explained below. If it is supposed that a density gradient is set such that the texture data gradually changes from dark black to light black as the value of d increases from 0.0 to 1.0, then the shade contrast can be changed in concert with the positional relation between light source and object. For example, inFIG. 4, a coordinate axis is set in the lateral direction in the drawing, and if the position of thelight source40 is d=0.0, then as the object moves away from thelight source40, the value of d changes from d=0.0 to d=1.0. For example, at d=0.3 the distance between thelight source40 and theobject50 is relatively small, so that shading is performed using shades with a comparatively strong contrast, whereas when d=0.8 the distance between thelight source40 andobject50 is relatively large, so that shading is performed using shades with a comparatively weak contrast. In other words, in moving away from thelight source40, the intensity of light incident on the object surface weakens in inverse proportion to the square of the distance, so that shading with gradually weaker contrast is performed, and an effect equivalent to the effect of lighting can be obtained.
• FIG. 5 is a drawing explaining the case in which the value of d is changed in concert with the distance between thecamera60 andobject50 to perform shading. A coordinate axis is set in the lateral direction in the drawing, and if the position of thecamera60 is d=0.0, then the value of d changes from d=0.0 to d=1.0 as the object moves away from thecamera60. If it is supposed that a density gradient is set such that, as the value of d increases from 0.0 to 1.0, the texture data changes gradually from dark black to light black, then as the object moves away from thecamera60, shading is performed with gradually weaker contrast, and an effect similar to fog can be obtained.
• This invention is not limited to cases in which the value of d is changed according to the distance between the light source or camera and the object to perform shading; for example, the light intensity of the light source may be associated with the value of d to perform shading. For example, if the value of d is 0.0 for a light source for which the light intensity is maximum, and the value of d is gradually increased as the light intensity gradually weakens, so that the value of d is 1.0 for a light source with minimum light intensity, then fine adjustment of the shade contrast can be performed according to the magnitude of the light intensity of the light source. However, in this case it is assumed that a density gradient is set such that, as the value of d increases from 0.0 to 1.0, the texture data changes gradually from dark black to light black. Further, as an example of setting of the d value, the value of d may be associated with the distance from the object to sea level, or with the distance between objects, or with other game parameters.
• FIG. 2 shows another example of texture data. Thetexture data30 shown in the drawing is arranged in a white data region C11, light gray data region C12, gray data region C13, dark gray data region C14, and black data region C15, so as to form curved density gradients in the U coordinate direction and in the V coordinate direction. Equation (1) is used to determine the U value oftexture data30 through light source calculations, and equation (3) is used to determine the V value. By using thetexture data30, the number of gray scales of the shades corresponding to the d value can be adjusted. For example, if the d value is 0.2, the V value can take the values of any of the data regions C11, C13, or C15, so that three values are possible for shades; if the d value is 0.8, the V value can take the values of any of the data regions from C11 to C15, so that five values are possible for shades.FIG. 6 explains an example of application of shading using thetexture data30; by increasing or decreasing the value of d in concert with the number of points obtained by a player in a game, the number of gray scales of shades is adjusted. In the example of the drawing, when there are no points, the number of gray scales is set to 3 by setting the d value to 0.2, and when there are numerous points, the number of gray scales is set to 5 by setting the d value to 0.8. Because the number of gray scales of the shades of a game character or other object can be adjusted freely in concert with the number of points acquired by a player, the atmosphere of a character can be freely changed from animation-style to comic-style as the game unfolds, so that the game can be made more amusing.
• As explained above, by means of this aspect, the color tone of the texture is changed not only in the U coordinate direction, but in the V coordinate direction as well; hence it is possible, for example, to apply shading in a smooth transition from red shades to blue shades, and the color tone of the shades can be changed naturally and without abnormalities. And because the texture for shading has a design in advance, more complex drawing can easily be performed compared with the continuous changes of conventional fog. Also, whereas in the prior art a plurality of texture data sets were prepared corresponding to the number of light sources or other conditions, in this aspect the plurality of texture data sets can be consolidated into a single texture data set, so that the hit rate of the cache can be raised, and the drawing speed can be increased. Also, the V value can be specified independently and regardless of the brightness I, so that data regions in the entirety of the texture data can be utilized effectively, with no waste of texture memory.
• According to this aspect, in addition to the number of color tons and number of stages of shades, highlights which appear in stages, increases and decreases in reflected light amounts, changes in the exposed area of the object surface, changes in color tones and color saturation, changes in transparency, and other parameters can be freely adjusted. And, by appropriately changing the setting of the d value, noise-like representations, as well as changes in light amounts which give a “dancing” effect as if light from a flame were incident, and changes in the area ratios of shaded portions and exposed portions, can be represented. Also, by changing the value of d at each vertex of the object, complicated point light sources can be represented, changes in the shades only of specific portions of the object surface can be represented, and a luster only at a specific portion can be represented. In addition to texture mapping to an object comprising polygons, this invention can also be used in texture mapping to NURBS and other curved surfaces.
• By means of this invention, texture mapping is performed using texture data comprising computer-readable data regions in which color data is arranged forming density gradients in two mutually orthogonal directions, so that coordinates to access the texture data can be computed from a value computed from object surface brightness information using a prescribed equation and from a value computed based on an arbitrary value assigned to a dynamic variable, and the color tone, density, and other parameters of the texture data to be read can be changed appropriately according to the assigned value of the dynamic variable. Hence shading with different shade colors can be displayed with natural transitions. Also, a plurality of texture data sets can be consolidated into a single texture data set, so that texture memory requirements can be reduced.

Claims (4)

1-11. (canceled)

12. A texture mapping method, which maps a texture to an object, comprising:

calculating first coordinate information in order to access a data region of said texture data in one direction of two mutually orthogonal directions defined for the texture data, from information set for said object surface;

calculating second coordinate information in order to access a data region of said texture data in the other direction of said two mutually orthogonal directions, from information other than information set for said object surface;

reading color data from said texture data by accessing said data region based on said first and second coordinate information; and

performing texture mapping to said object surface.

13-21. (canceled)

22. A texture mapping device for mapping a texture to an object, comprising:

means for calculating first coordinate information in order to access a data region of texture data in one direction of two mutually orthogonal directions defined for said texture data from information set on the surface of said object;

means for calculating second coordinate information in order to access a data region of said texture data in the other direction of said two directions from information other than information set on the surface of said object; and

means for accessing said data region based on said first and second coordinate information to read color data from said texture data and to perform texture mapping to said object surface.

Images