CLAIM OF PRIORITYThis application claims the priority benefit of: (1) U.S. Provisional Application No. 61/905,126, filed Nov. 15, 2013; (2) U.S. Provisional Application No. 61/904,263, filed Nov. 14, 2013; (3) U.S. Provisional Application No. 61/904,522, filed Nov. 15, 2013; (4) U.S. Provisional Application No. 61/905,118, filed Nov. 15, 2013; (5) U.S. Provisional Application No. 61/905,122, filed Nov. 15, 2013, which are incorporated herein by reference in their entirety.
TECHNICAL FIELDThe present application relates generally to the technical field of three-dimensional (3-D) modeling and, in one specific example, to 3-D garment modeling for online shopping.
BACKGROUNDShopping for clothes in conventional (e.g., non-online) can be an arduous task and, due to travelling and parking, can be very time consuming. With the advent of online shopping, consumers may purchase clothing, while staying home, via a computer or any electronic device connected to the Internet. Additionally, purchasing clothes online can be different in comparison to purchasing clothes in a store. One difference is the lack of a physical dressing room to see if and how an article of clothing fits the particular consumer. Since different consumers can have different dimensions, seeing how an article of clothing fits, by use of a dressing room, can be a very important aspect of a successful and satisfying shopping experience.
The systems and methods described in the present disclosure attempt to provide solutions to the problems presented above.
BRIEF DESCRIPTION OF THE DRAWINGSFIG. 1 illustrates an exemplary system for three-dimensional (3-D) digital garment creation from planar garment photographs, in accordance with embodiments of the present disclosure.
FIG. 2 is a block diagram illustrating an exemplary file system, in accordance with embodiments of the present disclosure.
FIG. 3 is a block diagram illustrating an exemplary 3-D digital garment creation module, in accordance with embodiments of the present disclosure.
FIG. 4 is a flow diagram of a process for 3-D digital garment creation, according to certain embodiments of the present disclosure.
FIG. 5 is a flow diagram continuing the process for 3-D digital garment creation fromFIG. 4, according to certain embodiments of the present disclosure.
FIGS. 6-8 illustrate examples of garments in a garment template database, in accordance with embodiments of the present disclosure.
FIG. 9 illustrates a method for creating 3-D digital jeans based on a front image and a back image of the jeans and presenting the digital jeans on a 3-D body model, in accordance with embodiments of the present disclosure.
FIG. 10 illustrates method for creating a 3-D digital dress based on a front image and a back image of the dress and presenting the digital dress on a 3-D body model, in accordance with embodiments of the present disclosure.
FIG. 11 illustrates an example for joining partial shapes to generate a 3-D digital shirt, in accordance with embodiments of the present disclosure.
FIG. 12 illustrates another example for joining partial shapes to generate a 3-D hooded sweatshirt without joining some of the edges, in accordance with embodiments of the present disclosure.
FIG. 13 illustrates a sample triangle associated with the tessellated garment, in accordance with embodiments of the present disclosure.
FIG. 14 illustrates an example of a triangulation method, in accordance with embodiments of the present disclosure.
FIG. 15 illustrates a method for calibrating the size of the garment based on a calibration object, in accordance with embodiments of the present disclosure.
FIG. 16 is a block diagram illustrating components of a machine, according to some example embodiments, able to read instructions from a machine-readable medium and perform any one or more of the methodologies discussed herein.
DESCRIPTION OF EMBODIMENTSExample systems and methods for 3-dimensional (3-D) digital garment creation from one or more planar garment images are described. The systems can include instructions to produce a 3-D garment model using one or more planar garment images (e.g., photographs). Additionally, the systems can present the garment model on a 3-D body model based on various body shapes/dimensions, the tension or force in the garment draped on a body, and how the garment flows as the body performs actions.
Examples merely typify possible variations. Unless explicitly stated otherwise, components and functions are optional and may be combined or subdivided, and operations may vary in sequence or be combined or subdivided. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of example embodiments. It will be evident to one skilled in the art, however, that the present subject matter may be practiced without these specific details.
Reference will now be made in detail to various embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure and the described embodiments. However, the present disclosure may be practiced without these specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.
FIG. 1 is a block diagram illustrating asystem100 in accordance with one embodiment of the present disclosure. Thesystem100 includes client devices (e.g., client device10-1, client device10-2, client device10-3) connected toserver202 via network34 (e.g., the Internet).Server202 typically includes one or more processing units (CPUs)222 for executing modules, programs and/or instructions stored inmemory236 and thereby performing processing operations; one ormore communications interfaces220;memory236; and one ormore communication buses230 for interconnecting these components.Communication buses230 optionally include circuitry (e.g., a chipset) that interconnects and controls communications between system components.Server202 also optionally includespower source224 andcontroller212 coupled tomass storage214.System100 optionally includes a user interface232 comprising adisplay device226 and a keyboard228.
Memory236 includes high-speed random access memory, such as dynamic random-access memory (DRAM), static random-access memory (SRAM), double data rate random-access memory (DDR RAM) or other random access solid state memory devices; and may include non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices.Memory236 may optionally include one or more storage devices remotely located from the CPU(s)222.Memory236, or alternately the non-volatile memory device(s) withinmemory236, comprises a non-transitory computer readable storage medium. In some embodiments,memory236, or the computer readable storage medium ofmemory236, stores the following programs, modules and data structures, or a subset thereof: anoperating system240; afile system242; anetwork communications module244; and a 3-D digitalgarment creation module246.
Theoperating system240 can include procedures for handling various basic system services and for performing hardware dependent tasks. Thefile system242 can store and organize various files utilized by various programs. Thenetwork communications module244 can communicate with client devices (e.g., client device10-1, client device10-2, client device10-3) via the one or more communications interfaces220 (e.g., wired, wireless), thenetwork34, other wide area networks, local area networks, metropolitan area networks, and so on.
Thenetwork34 may be any network that enables communication between or among machines, databases, and devices (e.g., theserver202 and the client device10-1). Accordingly, thenetwork34 may be a wired network, a wireless network (e.g., a mobile or cellular network), or any suitable combination thereof. Thenetwork34 may include one or more portions that constitute a private network, a public network (e.g., the Internet), or any suitable combination thereof. Accordingly, thenetwork34 may include one or more portions that incorporate a local area network (LAN), a wide area network (WAN), the Internet, a mobile telephone network (e.g., a cellular network), a wired telephone network (e.g., a plain old telephone system (POTS) network), a wireless data network (e.g., Wi-Fi network or WiMAX network), or any suitable combination thereof. Any one or more portions of thenetwork34 may communicate information via a transmission medium. As used herein, “transmission medium” refers to any intangible (e.g., transitory) medium that is capable of communicating (e.g., transmitting) instructions for execution by a machine (e.g., by one or more processors of such a machine), and includes digital or analog communication signals or other intangible media to facilitate communication of such software.
Theserver202 and the client devices (e.g., client device10-1, client device10-2, client device10-3) may each be implemented in a computer system, in whole or in part, as described below with respect toFIG. 16.
Any of the machines, databases, or devices shown inFIG. 1 may be implemented in a general-purpose computer modified (e.g., configured or programmed) by software (e.g., one or more software modules) to be a special-purpose computer to perform one or more of the functions described herein for that machine, database, or device. For example, a computer system able to implement any one or more of the methodologies described herein is discussed below with respect toFIG. 16. As used herein, a “database” is a data storage resource and may store data structured as a text file, a table, a spreadsheet, a relational database (e.g., an object-relational database), a triple store, a hierarchical data store, or any suitable combination thereof. Moreover, any two or more of the machines, databases, or devices illustrated inFIG. 1 may be combined into a single machine, and the functions described herein for any single machine, database, or device may be subdivided among multiple machines, databases, or devices.
AlthoughFIG. 1 shows asystem100,FIG. 1 is intended more as a functional description of the various features which may be present in a set of servers than as a structural schematic of the embodiments described herein. In practice, and as recognized by those of ordinary skill in the art, items shown separately could be combined and some items could be separated. For example, some items shown separately inFIG. 1 could be implemented on single servers and single items could be implemented by one or more servers.
FIG. 2 further describes theexemplary memory236 inserver202, as initially described inFIG. 1.FIG. 2 includes an expanded depiction ofexemplary file system242.File system242 may include one or more of the following files: input image photo files251; extractedgeometry files252; extractedtexture files253; stitching information files254;garment template database255; drapingparameter files256; simulation parameter files257; and simulation result geometry files258.FIGS. 4-5 further describe operations using the files fromFIG. 2.
FIG. 3 is a block diagram illustrating components of the 3-D digitalgarment creation module246, according to some example embodiments, as initially described inFIG. 1. The 3-D digitalgarment creation module246 is shown as including aboundary extraction module261; atexture mapping module262; atessellation module263; astitching module264; adraping module265; and asimulation module266 all configured to communicate with each other (e.g., via a bus, shared memory, or a switch).FIGS. 4-5 further describe operations using the modules fromFIG. 3.
Any one or more of the modules described herein may be implemented using hardware (e.g., one or more processors of a machine) or a combination of hardware and software. For example, any module described herein may configure a processor (e.g., among one or more processors of a machine) to perform the operations described herein for that module. Moreover, any two or more of these modules may be combined into a single module, and the functions described herein for a single module may be subdivided among multiple modules. Furthermore, according to various example embodiments, modules described herein as being implemented within a single machine, database, or device may be distributed across multiple machines, databases, or devices.
Each of the above identified elements may be stored in one or more of the previously mentioned memory devices, and corresponds to a set of instructions for performing a function described above. The above identified modules or programs (i.e., sets of instructions) need not be implemented as separate software programs, procedures or modules, and thus various subsets of these modules may be combined or otherwise rearranged in various embodiments. In some embodiments,memory236 may store a subset of the modules and data structures identified above. Furthermore,memory236 may store additional modules and data structures not described above.
The actual number of servers used to implement a 3-D digitalgarment creation module246 and how features are allocated among them will vary from one implementation to another, and may depend in part on the amount of data traffic that the system handles during peak usage periods as well as during average usage periods.
FIGS. 4-5 are flowcharts representing amethod400 for 3-dimensional digital garment creation from one or more planar garment images, according to certain embodiments of the present disclosure.Method400 is governed by instructions stored in a computer readable storage medium and that are executed by one or more processors of one or more servers. Each of the operations shown inFIGS. 4-5 may correspond to instructions stored in a computer memory or computer readable storage medium.
Operations in themethod400 may be performed by theserver202, using modules described above with respect toFIG. 3, As shown inFIGS. 4-5, themethod400 includesoperations410,420,430,440,450,460,470 and480. Optionally,method400 can include an operation for calibrating the size of the garment and an operation for applying a texture map on the digital garment.
The computer readable storage medium may include a magnetic or optical disk storage device, solid state storage devices such as flash memory, or other non-volatile memory device or devices. The computer readable instructions stored on the computer readable storage medium are in source code, assembly language code, object code, or other instruction format that is interpreted by one or more processors.
The foregoing description, for purposes of explanation, has been described with reference to specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the present disclosure to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the present disclosure and its practical applications, to thereby enable others skilled in the art to best utilize the present disclosure and various embodiments with various modifications as are suited to the particular use contemplated.
Atoperation410, 3-D digitalgarment creation module246 can receive a first image depicting a first view of a garment. The first image (e.g., planar garment photographs) can include input image photo files251. For example, a user can capture the front view of a pair of jeans using a camera on a mobile device and transmit the image, using a receiver on the mobile device, to the 3-D digitalgarment creation module246.
Similar to theoperation410, 3-D digitalgarment creation module246 can receive a second image depicting a second view of a garment atoperation420. In some instances, two received images can suffice, if all visible parts of the garment are captured in the set of received images. In some other instances, one or more other images (e.g., third image, fourth image) may be received by the 3-D digital garment creation module in order to capture all visible part of the garment.
For example, a user can capture the front and the back view of a pair of jeans with just two images using a camera and transmit the image to the 3-D digitalgarment creation module246. The first and second images can be received from a client device (e.g., client device10-1) or a third party vendor using network34 (e.g., Bluetooth, cellular, internet).
A first and a second side of a garment can be determined using the first and second image received atoperations410 and420. The images received atoperations410 and420 can be stored in the input image photo files251.
Atoperation430, 3-D digitalgarment creation module246 can generate a first partial shape of the garment based on the received first image usingboundary extraction module261.
Atoperation440, 3-D digitalgarment creation module246 can generate a second partial shape of the garment based on the received second image usingboundary extraction module261. The partial shapes generated atoperations430 and440 can be stored in the extracted geometry files252. Optionally, when texture information is obtained from the received images, the texture information associated with the generated partial shapes can be stored in the extracted texture files253.
In some instances, generating the partial shape can be based on determining an identified boundary or outline of the garment. The boundary can be determined by identifying a discrete set of points (e.g., set of vertices) using a boundary detection algorithm.
One example of a boundary detection algorithm can be to determine the color-range of the background of the image by averaging out pixel values at the boundary (e.g., first row, first column, last row, last column) of the input image. The background color can be determined to be B (i.e., BRED, BGREEN, BBLUE). Additionally, a pre-determined threshold value (t) can be chosen. The threshold value can be set by the user or calculated by the system (e.g., system100). All pixel values in the received images that are within a range of the background color (i.e., BRED+/−t, BGREEN+/−t, BBLUE+/−t) are interpreted as background pixels, and hence not part of the garment. Having identified each pixel value as either foreground (i.e., part of garment) or background, for each row of pixels, the pixel values where there is a transition between foreground and background can be identified as the contour/garment boundary pixels. Using these boundary pixels, an outline can be used to generate a partial shape of the garment.
In another example of a boundary detection algorithm, fir each row of pixels, the intensity (or color value) at each pixel is compared to the intensity (or color value) of the previous pixel. For a pre-determined threshold, once the difference between consecutive pixel values exceeds the threshold, the identified pixels can be classified as boundary pixels. In some instances, the intensity values for the foreground and background can be assigned via the scan line method. The scan line method includes traversing individual pixels and assigning the designation of background to the colors that match the outer edges of the photograph. In another instances, the boundary can be identified (e.g., extracted) using a gradient calculation method. In the gradient calculation method, differences in pixel color and intensity are calculated between adjacent pixels. A boundary can be identified when the differences are above a predetermined threshold value (e.g., sharp difference in pixel color and/or intensity between adjacent pixels). In yet other instances, the boundary can be determined using both the scan line method and the gradient calculation method. Using both methods can allow for a more accurate identification of the boundary.
Generating the partial shapes can include creating a continuous curve using the identified boundary. As mentioned, the identified boundary can be a discrete set of points. The discrete set of points can be a set of vertices associated with pixels that have been identified as boundary points using a boundary detection algorithm. The curve can be created by joining the discrete set of points that are determined to be boundaries of the garment and then running a smoothing function to eliminate outliers. Additionally, the curve can be modified based on a garment template from the garment database. The curve can be smoothed out by eliminating noise (e.g., remove outliers from the data), For example, noise can refer to the artifacts in image acquisition (e.g., lighting, image compression). Hence, the process of noise removal can help create a smooth edge instead of a jagged edge.
Moreover, the precision can be adjusted to accommodate varying levels of desired accuracy of the created digital garment and can be based on computation power. The precision can be automatically adjusted by the system based on the client device (e.g., lower precision or mobile device, higher precision for large screen display). In some instances, the standard error of tolerance is a parameter that can be set. Tolerance can be measured by actual units of distance (e.g., 0.01 inches). Alternatively, tolerance can be measured in number of pixels.
Furthermore, accuracy parameters can be received (e.g., from a user) or determined (e.g., by 3-D digital garment creation module246) to help identify the boundary of the garment. Accuracy parameters can include, but are not limited to, extractedgeometry files252, extractedtexture files253, stitching information files254 andgarment template database255.
Optionally, texture and optical properties can be determined from the images (e.g., photographs) atoperations430 and440 in stored in the extracted texture files253. The texture information can be used to determine the material properties of the garment and can be used to generate the texture map. The material properties of the garment can be used for calculating the simulated forces on the 3-D garment atoperation480. Furthermore, the material properties can be matched to thegarment template database255 atoperation450 in order to determine the type of garment using thetexture mapping module262. For example, the system can identify pleats in a garment when every part of the garment is captured in one of the input images. Moreover, the material property can be extracted even if the images of the garment are stretched or sheared. The optical properties can be used during the optional operations of applying a texture map to the 3-D digital garment.
Atoperation450, the 3-D digitalgarment creation module246 can determine a type of garment by comparing the generated first and second partial shapes to a database of reference garment shapes using thegarment template database255 and thestitching module264.
Thegarment template database255 can include stitching information files254. The stitching information files include which corresponding edges in the partial shapes are connected to each other. The draping parameters files256 can also extracted from thegarment template database255. Additionally, the simulation parameters files257 can also extracted from thegarment template database255.
FIGS. 6-8 illustrate examples of garments in agarment template database255 used inoperations450, in accordance with embodiments of the present disclosure. For example, inFIG. 6, thejeans garment template505 can include information such as the number ofpanels510, stitchinginformation515 of the jeans,body placement parameters520 of the jeans, drapingparameters525,simulation parameters530, and other relevant information associated with the jeans garment template.
In another example, inFIG. 7, the sleevelessdress garment template535 can include information such as the number ofpanels540, stitchinginformation545 of the dress,body placement parameters550 of the dress, drapingparameters555,simulation parameters560, and other relevant information associated with the sleeveless dress garment template.
FIG. 8 illustrates an exemplarygarment template database255, which includes thejeans garment template505 ofFIG. 6, and thesleeveless dress template535 ofFIG. 7. Additionally, thegarment template database255 can include other garment templates.
Returning back tomethod400, atoperation450, the 3-D digitalgarment creation module246 can extract the identified boundary from the partial shapes and match the shape of the extracted boundary to known databases of shapes (e.g., garment template database255) of categorized garments (e.g.,jeans garment template505, sleeveless dress garment template535) in order to determine the type of garment.
Atoperation460, the 3-D digitalgarment creation module246 can generate a 3-D garment module by joining the first partial shape and the second partial shape based on the determined type of garment. The generated 3-D garment module can include a first group of vertices based on the set of vertices from the partial shapes. The first group of vertices can be the outline of the 3-D garment module when the partial shapes have been joined (e.g., stitched).
For example, as illustrated inFIG. 9, two images (e.g., photographs) of the front of the jeans and the back of the jeans can be sufficient when all parts of the garment are captured in the images. Using the two images, the 3-D digitalgarment creation module246 can generate a first partial shape corresponding to the front of thejeans610 and a second partial shape corresponding to the back of thejeans620 atoperations430 and440. Then, atoperation450, the 3-D digitalgarment creation module246 can determine that the received images are images of a pair of jeans by comparing the generated partial shapes to thejeans garment template505 in thegarment template database255. Moreover, based on the determination that the garment is a pair of jeans, atoperation460 the 3-D digitalgarment creation module246 can join the partial shapes to generate a 3-D pair of thedigital jeans630. As will be further described atoperation470, thedigital jeans630 can be tessellated. Furthermore, the 3-D pair ofdigital jeans630 can be presented on anavatar640 atoperation480. Theavatar640 can have similar dimensions to the user that is interested in purchasing the jeans. Moreover, afit map650 corresponding to the tightness and/or looseness of the jeans on theavatar640 can be presented to the user.
In another example, as illustrated inFIG. 10, two partial shapes of the front of adress710 and the back of adress720 are generated based on received images. The 3-D digitalgarment creation module246 can generate a 3-Ddigital dress730 with only two received images and present the 3-Ddigital dress730 on anavatar740. Similar to the example inFIG. 9, only two images may be necessary because all parts of the dress are captured in the two images. If all parts on the dress are not captured in the two received images, then more images may be required to generate the 3-D digital garment. Additionally, theavatar740 can illustrate how the dress looks and feels by demonstrating a fashion presentation750 (e.g., catwalk) with the 3-Ddigital dress730. Alternatively, theavatar740 can illustrate how the dress looks and feels by demonstrating a lifestyle presentation. The lifestyle presentation can show the garments in use in everyday activities.
Continuing withoperation460, and as illustrated inFIG. 11, the 3-D digitalgarment creation module246 can join the partial shapes by digitally stitching together the shapes of the different sides of the garment to produce a garment model. The different sides may include afirst side810 and asecond side820 of the garment. For example, after generating a partial shape for front and back of the garment atoperations430 and at440, the two partial shapes can be joined (e.g., stitched together digitally) as illustrated by the joining of thedigital shirt830. As previously mentioned, the digital garment can be presented on anavatar840.
In some instances, when all parts of the garment are not captured in the first two received images, more than two sides can be joined to generate the 3-D garment. For example, inFIG. 11, the different sides may also include athird side850 and afourth side860 of the garment.
Continuing withoperation460, in some embodiments, a digital stitch can be based on a line connecting two points. 3-D digitalgarment creation module246 can align the front side and the back side versions of the garment by looking for similar analogous points on a side using the other side as a reference. The 3-D digitalgarment creation module246 can recognize which edges to join by matching a particular garment shape to a particular entry already stored in thegarment template database255. An exemplary garment database can hold entries for different garments (e.g.,jeans garment template505, sleevelessdress garment template535, blouse garment template, sweater garment template, shirt garment template). In some embodiments, if the shape does not match a previously stored entry in the basic garment database, then algorithms may be needed to provide guidance in sewing the sides together for the particular new garment shape. Alternatively, the intervention can be automated. The shape can then be stored as a new entry into the basic garment database.
In some instances, the stitch length can be set to zero, thus producing a zero length spring. A good stitching job can be represented by setting the stitch length to zero. Additionally, in some instances, the 3-D digitalgarment creation module246 can prevent bad stitching jobs by inhibiting stitching the front and the back of a garment where the stitches are long and can be seen. Accordingly, a stitch length equal to zero or close to zero length allows for a better digitally stitched garment atoperation460. However, setting the stitch length to zero or close to zero can be computationally intensive, because the simulation may need to solve a large number of equations. To illustrate this exemplary simulation, when using equations representing springs, based on Hooke's law, the denominator may be the length of the spring. Therefore, when the length of the spring has been set to zero, the equation solver has to solve equations with a zero in the denominator, which is not possible. Accordingly, another more computationally intensive formula for representing a spring, without using a denominator equal to zero, may be used.
Additionally, 3-D digitalgarment creation module246 can recognize which points to stitch and which points not to stitch based on a specific algorithm. For example, inFIG. 12, 3-D digitalgarment creation module246 recognizes thatfirst edge910 andsecond edge920 are not supposed to be joined (e.g., stitched) because those edges are intended to be an opening (e.g., opening to allow a user's head to fit through). Therefore, when the digitalhooded sweatshirt930 is generated atoperation460, thefirst edge910 andsecond edge920 are not joined. In some instances, the 3-D digitalgarment creation module246 can recognize which edges to not join by matching a particular garment shape to a particular entry already stored in a basic garment database.
Returning tomethod400, atoperation470, 3-D digitalgarment creation module246 can tessellate the generated 3-D garment model by adding a second group of vertices to the generated 3-D garment model using thetessellation module263. As illustrated inFIG. 13, tessellation can include breaking down (e.g., tiling) a garment into many tessellated geometric shape (e.g., sample triangle950) to generate atessellated garment940. For example, the shirt can be tessellated with triangles (e.g., about 20,000 triangles when triangle edge is around 1 centimeters), and the vertices (i.e.,vertex952,vertex954, vertex956) of the triangles can be the second group of vertices in the generated 3-D garment model. The vertices of the triangles can give location information of certain points in the material. The location information can be an x, y and z position value, and the location position can be independent of color and design of the garment.
Tessellation can be used to determine the location of certain points in the material of the garment. The certain points in the material of the garment can be represented by planar shapes. For example, the interior of the boundary of the garment can be filled with a plurality of similar geometric shapes. The points used for the tessellation can be based on the vertices of the shape. The shapes for the tessellation can be triangles, given that triangles are an efficient way (e.g., less computational power, faster tessellation speed) of representing a tessellated garment.
Furthermore, the points of the tessellated geometric shape can bend outside the shape, but not within. For example, if the tessellated shape is a triangle, different triangles can be folded over other triangles, but a triangle cannot be folded within itself. In other words, the triangle itself remains planar. In such example, the three vertices of the triangle determine the three points. An example tessellation can be an extracted shape (e.g., a shirt shape) being filled with a plurality of triangles, each with edges that can be calibrated (e.g., 1 cm). Thus, each point on the shirt can be approximated or located by reference to the nearest vertex on the most proximate triangle to the location of the determined position. In some embodiments, the triangles are equilateral triangles to maximize efficiency. In some arrangements, tessellation is consistent for each garment and thus, in the example, the same 1 cm edge triangle shape is used for tessellation of all extracted shapes. Alternatively, different tessellation shapes are used for different extracted shapes. Furthermore, tessellation can refer to the location of points of material and can be independent of the color and design of the garment.
Continuing withoperation470, according to some embodiments, the Delaunay triangulation method can be the triangulation method used for tessellation. In the Delaunay triangulation method, each iteration of the triangulation can try to maximize the minimum angle of the triangles in order to make close-to-uniform triangles. By maximizing the angles, the system ensures that none of the triangles are too skewed, and ensures the physical simulation runs efficiently.
For example, as illustrated inFIG. 14, Triangulation-2980 can be better than Triangulation-1970 for tessellation. As shown inFIG. 14, theminimum angle982 in Triangulation-2980 is greater than theminimum angle972 in Triangulation-1970, As a result, the triangles in Triangulation-2980 are close-to-uniform, and can help with the draping and simulating the digitized garment.
In various embodiments, data of tessellation and boundary can be compatible with single instruction multiple data (SIMD). SIMD can be a type of vector processor that uses the same instruction on multiple elements. SIMD compatibility can ensure that the code is consistent with the hardware. Making the processes SIMD friendly can allow for utilization of the hardware in a more efficient manner because current hardware includes processors, or processors with SIMD units, Additionally, the tessellation can be done in parallel (e.g., performing the tessellation using multiple SIMD units in parallel) in order to increase the tessellation speed, and the simulation of the garment under different scenarios.
Optionally,method400 can include an operation for calibration, as illustrated inFIG. 15. The first and/or second images received atoperations410 and/or420 can include an object (e.g., credit card) with a known size for the 3-D digitalgarment creation module246 to calibrate the boundary of the garment. In various embodiments, identifying the boundary can include computing shape and size of the garment.
InFIG. 15, thecalibration object1010 can be placed near the garment before the image is taken such that the one or more planar garment images (e.g., image of the front side of thejeans1020, image of the back side of the jeans1030) also include thecalibration object1010. In some instances, thecalibration object1010 can be placed on the garment, where thecalibration object1010 is clearly visible in the photograph but not distinct from the garment itself. A square object may be a better object for calibration because of the straight lines, four equal sides and four equal angles.
The calibration technique inmethod400 can determine the actual dimensions of the garment depicted in the one or more photographs. The calibration technique can be achieved through proportional comparison by utilizing any object of standard size (e.g., grid paper of standard size, a standard credit card, a CD).
Calibration can assign an x, y, z position value to each pixel. Given the garment is laid out on a planar surface, the system may need the relative position of three points to compute the calibration (or projection mapping from image to object space). For example, using thecalibration object1010, the system can extract the four corner points, and given the dimensions of thecalibration object1010, the system has enough information to compute the calibration. Based on the calibration, the system can present the garment on anavatar1040 and display properties1050 (e.g., rise measurement, inseam measurement, hips measurement, thigh measurement, calf measurement) associated with the garment. Similarly, with a grid paper as thecalibration object1010, the system can use the relative positions of three points to compute this calibration.
Optionally,method400 can further include applying a texture map to the 3-D garment model. In one or more arrangement, the 3-D digitalgarment creation module246 applies a texture map to the tessellated three-dimensional garment model. The texture map can include assigning a color to a vertex in the second group of vertices based the received first image. The color values can be extracted from the received images, or alternatively, may be assigned from a different image (e.g., a texture swatch applied to the whole garment). Since a shape of the garment has already been determined using the operations described above, texture mapping can give the garment a texture and color. The texture can be represented as color. For example, in texture mapping, each vertex of the shape (e.g., triangle) is assigned a red-green-blue-alpha (RGBA) value. Alpha can be the transparency value. Thus in the triangulation method, each triangle has potentially three different RGBA values per triangle. The rest of the points of the triangle can then be interpolated. Interpolation allows for the RGBA values of the remaining points in the triangle to be filled in using a linear combination method (e.g., the points of the triangle are weighted based on the distance to the three vertices and the RGBA values are assigned accordingly). The interpolated values can be extracted from the received image, or alternatively, may be assigned from a different image (e.g., a texture swatch applied to the whole garment).
Atoperation480, 3-D digitalgarment creation module246 can present the tessellated 3-D garment model on a body model using thedraping module265 and thesimulation module266. The tessellated 3-D garment model is presented based on a simulated force. The presentation can be done by digitally draping the tessellated 3-D garment model onto a 3-D body model. In some embodiments, 3-D digitalgarment creation module246 can put the digitally stitched garment generated atoperation470 onto a standard body, as illustrated byavatars640 and740. In various embodiments,operation480 involves taking data from all previous operations and combining them and inputting them into a cloth simulation engine. Additionally, the simulation results fromoperation480 can be stored in the simulation result geometry files258.
Optionally,method400 can include generating multiple sizes of the same garment by scaling or distorting the 3-D digital garment model. Scaling or distorting the 3-D digital garment model can generate 3-D models that are representative of the family of sizes of a garment typically carried and sold by retailers. Alternatively, scaling or distorting the 3-D digital garment model can generate a specific sized version of the garment. The distortion of the 3-D digital garment model can be uniform for the entire model (i.e., the entire model is grown or shrunk), or specific to individual zones (e.g., specific garment areas) with different distortions (e.g., scale factors) for the individual zones. Additionally, the scaling of dimensions of the garments can be arbitrary (as in the case of creating a custom size), or can be according to specifications. The specifications can be based on grading rules, size charts, actual measurements, and/or digital measurements.
As illustrated inFIGS. 9-10, a cloth engine can take as input tessellation and material properties and can output 3-D models of clothing onavatars640 and740. The cloth engine can move the points around to fit a 3-D body model based on a simulated force (e.g., friction, stitching force). Additionally, based on this modeling, the points are connected via springs and can be stretched based on a simulated force (e.g., gravity, material property of garment). The cloth engine can solve a system of equations, given that the equations are all inter-connected. In one example, the system of equations can be based on the spring force on each vertex.
Various operations described inmethod400 can be implemented through specific modules stored inmemory236. Some examples of implementations and equations are described below. For example, below is the system of equations to be used withmethod400 for a three-spring implementation of asample triangle950 with three-vertices (i.e.,vertex952,vertex954, vertex956) associated with atessellated garment940, as illustrated inFIG. 13.
- Where ksis the elastic spring constant, kdis the damping spring constant, and each vertex has a position (x) and velocity (v).
In the equations above, when the denominator is a restlength value, a non-zero value can be used for zero-length springs. Additionally, the equations can use a visual restlength value when the denominator is not the restlength value, which in zero-length spring cases is 0. This allows for the system to handle zero length springs without dividing by 0.
To further explain the equations above, a walkthrough of the equations is described. The state that the simulator (e.g., 3-D digital garment creation module246) can maintain is the positions and velocities of all the points that represent the garment. As the simulator moves forward in time, the simulator can update the position of the points over time by computing the net force on each point at each instance in time. Then, based on the mass of the particle, the simulator can use the equation based on the laws of motion, f=ma, to calculate an acceleration. The acceleration determines a change in velocity, which can be used to update the velocity of each point. Likewise, the velocity determines the change in position, which can be used to update the positions. Therefore, at each point in the simulation, the simulator can compute the net force on each particle. The forces exerted on each particle can be based on a gravitational force, spring forces, or other forces (e.g., drag forces to achieve desired styling). The equation for gravitational force is f=mg, and the spring force is described above.
The spring force f has two components, an elastic component (i.e., part of equation multiplied by ks) and a damping component (i.e., part of equation multiplied by kd). The elastic component calculates the oscillation of the spring. The strength of the elastic force is proportional to the amount the spring is stretched from the restlength value, which can be determined by x2−x1 (i.e., the current length of the spring) minus the restlength value. For example, the more the spring is compressed or stretched, the higher the force pushing the spring to return to its rest state. Additionally, ksis a spring constant that allows for scaling up/down the force based on the strength of the spring, which is then multiplied by the spring direction to give the force a direction (i.e., in the direction of the spring).
The damping component calculates the damping effect (e.g., heat being generated by the spring moving, drag). Damping can be drag force, where the higher the velocity, the higher the drag/damping force. Accordingly, damping can be proportional to velocity. In the case of a spring, there can be two particles moving, so instead of a single velocity the simulator computes a relative velocity between the two endpoints (e.g., v2-v1 inFIG. 13). For example, the larger the relative velocity, the faster the points are moving apart or coming close together, and as a result the larger the damping force (i.e., the damping is proportional to relative velocity). Additionally, kdis the damping spring constant to scale the damping force up/down, which can multiply by the spring direction to give the force a direction.
According to various example embodiments, one or more of the methodologies described herein may facilitate the online purchase of garments. Moreover, one or more of the methodologies described herein may facilitate the visualization of a garment on a 3-D body model using 3-D digitalgarment creation module246.
When these effects are considered in aggregate, one or more of the methodologies described herein may obviate a need for certain efforts or resources that otherwise would be involved in digitalizing the garment from images. Efforts expended by a user in generating 3-D models may be reduced by one or more of the methodologies described herein. Computing resources used by one or more machines, databases, or devices (e.g., within the system100) may similarly be reduced. Examples of such computing resources include processor cycles, network traffic, memory usage, data storage capacity, power consumption, and cooling capacity.
FIG. 16 is a block diagram illustrating components of a machine1200, according to some example embodiments, able to readinstructions1224 from a machine-readable medium1222 (e.g., a non-transitory machine-readable medium, a machine-readable storage medium, a computer-readable storage medium, or any suitable combination thereof) and perform any one or more of the methodologies discussed herein, in whole or in part. Specifically,FIG. 16 shows the machine1200 in the example form of a computer system (e.g., a computer) within which the instructions1224 (e.g., software, a program, an application, an applet, an app, or other executable code) for causing the machine1200 to perform any one or more of the methodologies discussed herein may be executed, in whole or in part.Server202 can be an example of machine1200.
In alternative embodiments, the machine1200 operates as a standalone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine1200 may operate in the capacity of a server machine or a client machine in a server-client network environment, or as a peer machine in a distributed (e.g., peer-to-peer) network environment. The machine1200 may be a server computer, a client computer, a personal computer (PC), a tablet computer, a laptop computer, a netbook, a cellular telephone, a smartphone, a set-top box (STB), a personal digital assistant (PDA), a web appliance, a network router, a network switch, a network bridge, or any machine capable of executing theinstructions1224, sequentially or otherwise, that specify actions to be taken by that machine. Further, while only a single machine is illustrated, the term “machine” shall also be taken to include any collection of machines that individually or jointly execute theinstructions1224 to perform all or part of any one or more of the methodologies discussed herein.
The machine1200 includes a processor1202 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a radio-frequency integrated circuit (RFIC), or any suitable combination thereof), amain memory1204, and astatic memory1206, which are configured to communicate with each other via abus1208. Theprocessor1202 may contain microcircuits that are configurable, temporarily or permanently, by some or all of theinstructions1224 such that theprocessor1202 is configurable to perform any one or more of the methodologies described herein, in whole or in part. For example, a set of one or more microcircuits of theprocessor1202 may be configurable to execute one or more modules (e.g., software modules) described herein.
The machine1200 may further include a graphics display1210 (e.g., a plasma display panel (PDP), a light emitting diode (LED) display, a liquid crystal display (LCD), a projector, a cathode ray tube (CRT), or any other display capable of displaying graphics or video). The machine1200 may also include an alphanumeric input device1212 (e.g., a keyboard or keypad), a cursor control device1214 (e.g., a mouse, a touchpad, a trackball, a joystick, a motion sensor, an eye tracking device, or other pointing instrument), astorage unit1216, an audio generation device1218 (e.g., a sound card, an amplifier, a speaker, a headphone jack, or any suitable combination thereof), and anetwork interface device1220.
Thestorage unit1216 includes the machine-readable medium1222 (e.g., a tangible and non-transitory machine-readable storage medium) on which are stored theinstructions1224 embodying any one or more of the methodologies or functions described herein. Theinstructions1224 may also reside, completely or at least partially, within themain memory1204, within the processor1202 (e.g., within the processor's cache memory), or both, before or during execution thereof by the machine1200. Accordingly, themain memory1204 and theprocessor1202 may be considered machine-readable media (e.g., tangible and non-transitory machine-readable media). Theinstructions1224 may be transmitted or received over thenetwork34 via thenetwork interface device1220. For example, thenetwork interface device1220 may communicate theinstructions1224 using any one or more transfer protocols (e.g., hypertext transfer protocol (HTTP)).
In some example embodiments, the machine1200 may be a portable computing device, such as a smart phone or tablet computer, and have one or more additional input components1230 (e.g., sensors or gauges). Examples ofsuch input components1230 include an image input component (e.g., one or more cameras), an audio input component (e.g., a microphone), a direction input component (e.g., a compass), a location input component (e.g., a global positioning system (GPS) receiver), an orientation component (e.g., a gyroscope), a motion detection component (e.g., one or more accelerometers), an altitude detection component (e.g., an altimeter), and a gas detection component (e.g., a gas sensor). Inputs harvested by any one or more of these input components may be accessible and available for use by any of the modules described herein.
As used herein, the term “memory” refers to a machine-readable medium able to store data temporarily or permanently and may be taken to include, but not be limited to, random-access memory (RAM), read-only memory (ROM), buffer memory, flash memory, and cache memory. While the machine-readable medium1222 is shown in an example embodiment to be a single medium, the term “machine-readable medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, or associated caches and servers) able to storeinstructions1224. The term “machine-readable medium” shall also be taken to include any medium, or combination of multiple media, that is capable of storing theinstructions1224 for execution b the machine1200, such that theinstructions1224, when executed by one or more processors of the machine1200 (e.g., processor1202), cause the machine1200 to perform any one or more of the methodologies described herein, in whole or in part. Accordingly, a “machine-readable medium” refers to a single storage apparatus or device, as well as cloud-based storage systems or storage networks that include multiple storage apparatus or devices. The term “machine-readable medium” shall accordingly be taken to include, but not be limited to, one or more tangible (e.g., non-transitory) data repositories in the form of a solid-state memory, an optical medium, a magnetic medium, or any suitable combination thereof.
Throughout this specification, plural instances may implement components, operations, or structures described as a single instance. Although individual operations of one or more methods are illustrated and described as separate operations, one or more of the individual operations may be performed concurrently, and nothing requires that the operations be performed in the order illustrated. Structures and functionality presented as separate components in example configurations may be implemented as a combined structure or component. Similarly, structures and functionality presented as a single component may be implemented as separate components. These and other variations, modifications, additions, and improvements fall within the scope of the subject matter herein.
Certain embodiments are described herein as including logic or a number of components, modules, or mechanisms. Modules may constitute software modules (e.g., code stored or otherwise embodied on a machine-readable medium or in a transmission medium), hardware modules, or any suitable combination thereof. A “hardware module” is a tangible (e.g., non-transitory) unit capable of performing certain operations and may be configured or arranged in a certain physical manner. In various example embodiments, one or more computer systems (e.g., a standalone computer system, a client computer system, or a server computer system) or one or more hardware modules of a computer system (e.g., a processor or a group of processors) may be configured by software (e.g., an application or application portion) as a hardware module that operates to perform certain operations as described herein.
In some embodiments, a hardware module may be implemented mechanically, electronically, or any suitable combination thereof. For example, a hardware module may include dedicated circuitry or logic that is permanently configured to perform certain operations. For example, a hardware module may be a special-purpose processor, such as a field programmable gate array (FPGA) or an ASIC. A hardware module may also include programmable logic or circuitry that is temporarily configured by software to perform certain operations. For example, a hardware module may include software encompassed within a general-purpose processor or other programmable processor. It will be appreciated that the decision to implement a hardware module mechanically, in dedicated and permanently configured circuitry, or in temporarily configured circuitry (e.g., configured by software) may be driven by cost and time considerations.
Accordingly, the phrase “hardware module” should be understood to encompass a tangible entity, and such a tangible entity may be physically constructed, permanently configured (e.g., hardwired), or temporarily configured (e.g., programmed) to operate in a certain manner or to perform certain operations described herein. As used herein, “hardware-implemented module” refers to a hardware module. Considering embodiments in which hardware modules are temporarily configured (e.g., programmed), each of the hardware modules need not be configured or instantiated at any one instance in time. For example, where a hardware module comprises a general-purpose processor configured by software to become a special-purpose processor, the general-purpose processor may be configured as respectively different special-purpose processors e comprising different hardware modules) at different times. Software (e.g., a software module) may accordingly configure one or more processors, for example, to constitute a particular hardware module at one instance of time and to constitute a different hardware module at a different instance of time.
Hardware modules can provide information to, and receive information from, other hardware modules. Accordingly, the described hardware modules may be regarded as being communicatively coupled. Where multiple hardware modules exist contemporaneously, communications may be achieved through signal transmission (e.g., over appropriate circuits and buses) between or among two or more of the hardware modules. In embodiments in which multiple hardware modules are configured or instantiated at different times, communications between such hardware modules may be achieved, for example, through the storage and retrieval of information in memory structures to which the multiple hardware modules have access. For example, one hardware module may perform an operation and store the output of that operation in a memory device to which it is communicatively coupled. A further hardware module may then, at a later time, access the memory device to retrieve and process the stored output. Hardware modules may also initiate communications with input or output devices, and can operate on a resource (e.g., a collection of information).
The various operations of example methods described herein may be performed, at least partially, by one or more processors that are temporarily configured (e.g., by software) or permanently configured to perform the relevant operations. Whether temporarily or permanently configured, such processors may constitute processor-implemented modules that operate to perform one or more operations or functions described herein. As used herein, “processor-implemented module” refers to a hardware module implemented using one or more processors.
Similarly, the methods described herein may be at least partially processor-implemented, a processor being an example of hardware. For example, at least some of the operations of a method may be performed by one or more processors or processor-implemented modules. As used herein, “processor-implemented module” refers to a hardware module in which the hardware includes one or more processors. Moreover, the one or more processors may also operate to support performance of the relevant operations in a “cloud computing” environment or as a “software as a service” (SaaS). For example, at least some of the operations may be performed by a group of computers (as examples of machines including processors), with these operations being accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., an application program interface (API)).
The performance of certain operations may be distributed among the one or more processors, not only residing within a single machine, but deployed across a number of machines. In some example embodiments, the one or more processors or processor-implemented modules may be located in a single geographic location (e.g., within a home environment, an office environment, or a server farm). In other example embodiments, the one or more processors or processor-implemented modules may be distributed across a number of geographic locations.
Some portions of the subject matter discussed herein may be presented in terms of algorithms or symbolic representations of operations on data stored as bits or binary digital signals within a machine memory (e.g., a computer memory). Such algorithms or symbolic representations are examples of techniques used by those of ordinary skill in the data processing arts to convey the substance of their work to others skilled in the art. As used herein, an “algorithm” is a self consistent sequence of operations or similar processing leading to a desired result. In this context, algorithms and operations involve physical manipulation of physical quantities. Typically, but not necessarily, such quantities may take the form of electrical, magnetic, or optical signals capable of being stored, accessed, transferred, combined, compared, or otherwise manipulated by a machine. It is convenient at times, principally for reasons of common usage, to refer to such signals using words such as “data,” “content,” “bits,” “values,” “elements,” “symbols,” “characters,” “terms,” “numbers,” “numerals,” or the like. These words, however, are merely convenient labels and are to be associated with appropriate physical quantities.
Unless specifically stated otherwise, discussions herein using words such as “processing,” “computing,” “calculating,” “determining,” “presenting,” “displaying,” or the like may refer to actions or processes of a machine (e.g., a computer) that manipulates or transforms data represented as physical (e.g., electronic, magnetic, or optical) quantities within one or more memories (e.g., volatile memory, non-volatile memory, or any suitable combination thereof), registers, or other machine components that receive, store, transmit, or display information. Furthermore, unless specifically stated otherwise, the terms “a” or “an” are herein used, as is common in patent documents, to include one or more than one instance. Finally, as used herein, the conjunction “or” refers to a non-exclusive “or,” unless specifically stated otherwise.
It will be understood that, although the terms “first,” “second,” etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another.