技术领域technical field
本发明涉及移动设备技术领域，尤其涉及一种商品展示方法、装置及移动设备。The present invention relates to the technical field of mobile devices, in particular to a product display method, device and mobile device.
背景技术Background technique
随着移动设备的发展，在一些使用场景下，用户会有通过移动设备对所要购买的商品进行浏览的需求。例如，用户对所要购买的商品进行拍照，基于得到的照片获悉该商品的展示效果。With the development of mobile devices, in some usage scenarios, users have a need to browse products to be purchased through mobile devices. For example, the user takes a photo of the product to be purchased, and learns the display effect of the product based on the obtained photo.
发明内容Contents of the invention
本发明旨在至少在一定程度上解决相关技术中的技术问题之一。The present invention aims to solve one of the technical problems in the related art at least to a certain extent.
为此，本发明在于提出一种商品展示方法、装置及移动设备，能够使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。To this end, the present invention proposes a commodity display method, device and mobile device, which can make the information of the target commodity displayed more comprehensively, and the display angle is multi-dimensional, so that the user can know the matching display effect of the target commodity and the environment, and the display result is more three-dimensional Intuitive and intuitive, while improving the product display effect, it also improves the user experience.
本发明第一方面实施例提出的商品展示方法，包括：采集目标商品在结构光下对应的散斑图案，并采集所述目标商品的平面图像；基于所述散斑图案的深度信息和所述平面图像对所述目标商品进行3D建模，得到第一3D模型；获取搁置所述目标商品的环境的3D模型并作为第二3D模型；对所述第一3D模型和所述第二3D模型进行合成处理，并对合成处理后的模型进行展示。The product display method proposed in the embodiment of the first aspect of the present invention includes: collecting the speckle pattern corresponding to the target product under structured light, and collecting the planar image of the target product; based on the depth information of the speckle pattern and the Carry out 3D modeling on the target commodity with a plane image to obtain a first 3D model; obtain a 3D model of the environment where the target commodity is placed as a second 3D model; Carry out synthesis processing, and display the model after synthesis processing.
本发明第一方面实施例提出的商品展示方法，通过采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像，并基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型，获取搁置目标商品的环境的3D模型并作为第二3D模型，以及对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示，由于不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。The product display method proposed in the embodiment of the first aspect of the present invention collects the speckle pattern corresponding to the target product under structured light, collects the planar image of the target product, and conducts the target product based on the depth information of the speckle pattern and the planar image. 3D modeling, obtaining the first 3D model, obtaining the 3D model of the environment where the target product is placed as the second 3D model, and synthesizing the first 3D model and the second 3D model, and displaying the synthesized model , because not only the 3D modeling of the target product is carried out, but also the 3D modeling of the environment that needs to be matched with the target product when displaying the target product, so that the information when displaying the target product is more comprehensive, and the display angle is multi-dimensional, making The user knows the matching display effect of the target product and the environment, and the display result is more three-dimensional and intuitive, which not only improves the product display effect, but also improves the user experience.
本发明第二方面实施例提出的商品展示装置，包括：第一采集模块，用于采集目标商品在结构光下对应的散斑图案，并采集所述目标商品的平面图像；第一建模模块，用于基于所述散斑图案的深度信息和所述平面图像对所述目标商品进行3D建模，得到第一3D模型；获取模块，用于获取搁置所述目标商品的环境的3D模型并作为第二3D模型；合成模块，用于对所述第一3D模型和所述第二3D模型进行合成处理，并对合成处理后的模型进行展示。The product display device proposed in the embodiment of the second aspect of the present invention includes: a first collection module, configured to collect a speckle pattern corresponding to a target product under structured light, and collect a planar image of the target product; a first modeling module , for performing 3D modeling on the target product based on the depth information of the speckle pattern and the planar image to obtain a first 3D model; an acquisition module, configured to obtain a 3D model of the environment where the target product is placed and As the second 3D model; a synthesis module, configured to perform synthesis processing on the first 3D model and the second 3D model, and display the synthesized model.
本发明第二方面实施例提出的商品展示装置，通过采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像，并基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型，获取搁置目标商品的环境的3D模型并作为第二3D模型，以及对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示，由于不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。The product display device proposed in the embodiment of the second aspect of the present invention collects the speckle pattern corresponding to the target product under structured light, collects the planar image of the target product, and conducts the target product based on the depth information of the speckle pattern and the planar image. 3D modeling, obtaining the first 3D model, obtaining the 3D model of the environment where the target product is placed as the second 3D model, and synthesizing the first 3D model and the second 3D model, and displaying the synthesized model , because not only the 3D modeling of the target product is carried out, but also the 3D modeling of the environment that needs to be matched with the target product when displaying the target product, so that the information when displaying the target product is more comprehensive, and the display angle is multi-dimensional, making The user knows the matching display effect of the target product and the environment, and the display result is more three-dimensional and intuitive, which not only improves the product display effect, but also improves the user experience.
本发明第三方面实施例提出的商品展示装置，其特征在于，包括：处理器；用于存储处理器可执行指令的存储器；其中，所述处理器被配置为：采集目标商品在结构光下对应的散斑图案，并采集所述目标商品的平面图像；基于所述散斑图案的深度信息和所述平面图像对所述目标商品进行3D建模，得到第一3D模型；获取搁置所述目标商品的环境的3D模型并作为第二3D模型；对所述第一3D模型和所述第二3D模型进行合成处理，并对合成处理后的模型进行展示。The commodity display device proposed in the embodiment of the third aspect of the present invention is characterized in that it includes: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to: collect target commodities under structured light corresponding speckle pattern, and collect a planar image of the target commodity; perform 3D modeling on the target commodity based on the depth information of the speckle pattern and the planar image to obtain a first 3D model; acquire the The 3D model of the environment of the target commodity is used as a second 3D model; the first 3D model and the second 3D model are synthesized, and the synthesized model is displayed.
本发明第三方面实施例提出的商品展示装置，通过采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像，并基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型，获取搁置目标商品的环境的3D模型并作为第二3D模型，以及对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示，由于不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。The product display device proposed in the embodiment of the third aspect of the present invention collects the speckle pattern corresponding to the target product under structured light, collects the planar image of the target product, and conducts the target product based on the depth information of the speckle pattern and the planar image. 3D modeling, obtaining the first 3D model, obtaining the 3D model of the environment where the target product is placed as the second 3D model, and synthesizing the first 3D model and the second 3D model, and displaying the synthesized model , because not only the 3D modeling of the target product is carried out, but also the 3D modeling of the environment that needs to be matched with the target product when displaying the target product, so that the information when displaying the target product is more comprehensive, and the display angle is multi-dimensional, making The user knows the matching display effect of the target product and the environment, and the display result is more three-dimensional and intuitive, which not only improves the product display effect, but also improves the user experience.
本发明第四方面实施例提出了一种非临时性计算机可读存储介质，当所述存储介质中的指令由终端的处理器执行时，使得终端能够执行一种商品展示方法，所述方法包括：采集目标商品在结构光下对应的散斑图案，并采集所述目标商品的平面图像；基于所述散斑图案的深度信息和所述平面图像对所述目标商品进行3D建模，得到第一3D模型；获取搁置所述目标商品的环境的3D模型并作为第二3D模型；对所述第一3D模型和所述第二3D模型进行合成处理，并对合成处理后的模型进行展示。The embodiment of the fourth aspect of the present invention proposes a non-transitory computer-readable storage medium. When the instructions in the storage medium are executed by the processor of the terminal, the terminal can execute a product display method, and the method includes : Collect the speckle pattern corresponding to the target commodity under structured light, and collect the planar image of the target commodity; perform 3D modeling on the target commodity based on the depth information of the speckle pattern and the planar image, and obtain the first A 3D model; obtaining the 3D model of the environment where the target product is placed as a second 3D model; performing synthesis processing on the first 3D model and the second 3D model, and displaying the synthesized model.
本发明第四方面实施例提出的非临时性计算机可读存储介质，通过采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像，并基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型，获取搁置目标商品的环境的3D模型并作为第二3D模型，以及对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示，由于不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。The non-transitory computer-readable storage medium proposed in the embodiment of the fourth aspect of the present invention collects the speckle pattern corresponding to the target commodity under structured light, and collects the plane image of the target commodity, and based on the depth information of the speckle pattern and the plane image The image performs 3D modeling on the target product to obtain the first 3D model, obtains the 3D model of the environment where the target product is placed as the second 3D model, and performs synthesis processing on the first 3D model and the second 3D model, and performs synthesis processing The final model is displayed, because not only the 3D modeling of the target product is carried out, but also the 3D modeling of the environment that needs to be matched with the target product when displaying the target product, so that the information when displaying the target product is more comprehensive. The multi-dimensional angle allows users to know the matching display effect of the target product and the environment, and the display result is more three-dimensional and intuitive, which improves the product display effect and improves user experience at the same time.
本发明第五方面还提出一种移动设备，该移动设备包括存储器及处理器，所述存储器中储存有计算机可读指令，所述指令被所述处理器执行时，使得所述处理器执行如本发明第一方面实施例提出的商品展示方法。The fifth aspect of the present invention also proposes a mobile device, the mobile device includes a memory and a processor, the memory stores computer-readable instructions, and when the instructions are executed by the processor, the processor executes the following steps: The product display method proposed in the embodiment of the first aspect of the present invention.
本发明第五方面实施例提出的移动设备，通过采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像，并基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型，获取搁置目标商品的环境的3D模型并作为第二3D模型，以及对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示，由于不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。The mobile device proposed in the embodiment of the fifth aspect of the present invention collects the speckle pattern corresponding to the target product under structured light, collects the plane image of the target product, and performs 3D processing on the target product based on the depth information of the speckle pattern and the plane image. Modeling, obtaining the first 3D model, obtaining the 3D model of the environment where the target product is placed as the second 3D model, performing synthesis processing on the first 3D model and the second 3D model, and displaying the synthesized model, Since 3D modeling is not only performed on the target product, but also on the environment that needs to be matched with the target product when displaying the target product, the information when displaying the target product is more comprehensive, and the display angle is multi-dimensional, allowing users to Knowing the matching display effect of the target product and the environment, the display result is more three-dimensional and intuitive, which improves the product display effect and improves the user experience at the same time.
本发明附加的方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本发明的实践了解到。Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
附图说明Description of drawings
本发明上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解，其中：The above and/or additional aspects and advantages of the present invention will become apparent and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, wherein:
图1是本发明一实施例提出的应用于网络购物的商品展示方法的流程示意图；FIG. 1 is a schematic flowchart of a product display method applied to online shopping proposed by an embodiment of the present invention;
图2为相关技术中结构光示意图；FIG. 2 is a schematic diagram of structured light in the related art;
图3为本发明实施例中结构光的投影集合示意图；FIG. 3 is a schematic diagram of a projection set of structured light in an embodiment of the present invention;
图4是本发明另一实施例提出的应用于网络购物的商品展示方法的流程示意图；Fig. 4 is a schematic flowchart of a product display method applied to online shopping proposed by another embodiment of the present invention;
图5为一个投射结构光的装置示意图；5 is a schematic diagram of a device for projecting structured light;
图6是本发明另一实施例提出的商品展示方法的流程示意图；Fig. 6 is a schematic flowchart of a commodity display method proposed in another embodiment of the present invention;
图7是本发明一实施例提出的商品展示装置的结构示意图；Fig. 7 is a schematic structural diagram of a commodity display device proposed by an embodiment of the present invention;
图8是本发明另一实施例提出的商品展示装置的结构示意图；Fig. 8 is a schematic structural diagram of a product display device proposed in another embodiment of the present invention;
图9为一个实施例中图像处理电路的示意图。FIG. 9 is a schematic diagram of an image processing circuit in one embodiment.
具体实施方式detailed description
下面详细描述本发明的实施例，所述实施例的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的，仅用于解释本发明，而不能理解为对本发明的限制。相反，本发明的实施例包括落入所附加权利要求书的精神和内涵范围内的所有变化、修改和等同物。Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention. On the contrary, the embodiments of the present invention include all changes, modifications and equivalents coming within the spirit and scope of the appended claims.
图1是本发明一实施例提出的商品展示方法的流程示意图。Fig. 1 is a schematic flowchart of a product display method proposed by an embodiment of the present invention.
本实施例以该商品展示方法被配置为商品展示装置中来举例说明。This embodiment is described by taking the commodity display method configured in a commodity display device as an example.
该商品展示装置可以设置移动设备中，对此不作限制。The commodity display device can be installed in a mobile device, without limitation.
其中，用户可以通过该商品展示装置获得更加立体化、直观化的观看体验。Among them, the user can obtain a more three-dimensional and intuitive viewing experience through the commodity display device.
其中，移动设备例如智能手机、平板电脑、个人数字助理、电子书等具有各种操作系统的硬件设备。Among them, mobile devices such as smart phones, tablet computers, personal digital assistants, e-books and other hardware devices with various operating systems.
参见图1，该方法包括：Referring to Figure 1, the method includes:
步骤101：采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像。Step 101: Collect the speckle pattern corresponding to the target commodity under structured light, and collect a planar image of the target commodity.
其中的目标商品为，当前需要对其进行展示的商品。The target product is a product that needs to be displayed currently.
其中，已知空间方向光束的投影集合称为结构光，如图2所示，图2为相关技术中结构光示意图，生成结构光的设备可以是将光点、线、光栅、格网或斑纹投影到被测物体上的某种投影设备或仪器，也可以是生成激光束的激光器。Among them, the projection set of light beams with known spatial directions is called structured light, as shown in Figure 2, which is a schematic diagram of structured light in the related art. Some kind of projection device or instrument projected onto the object to be measured, or a laser that generates a laser beam.
在本发明的实施例中，可以将结构光投射至目标商品上，采集基于结构光下目标商品相关的一些图像数据。由于结构光的物理特性，通过结构光所采集到的图像数据，能够反映出目标商品的深度信息，该深度信息可以例如为目标商品的3D信息，由于不仅仅是基于目标商品的平面图像进行展示，还结合了目标商品的深度信息，因而，提升商品的展示效果。In the embodiment of the present invention, the structured light can be projected onto the target product, and some image data related to the target product under the structured light can be collected. Due to the physical characteristics of structured light, the image data collected by structured light can reflect the depth information of the target product. The depth information can be, for example, the 3D information of the target product, because it is not only based on the planar image of the target product. , and also combines the in-depth information of the target product, thus improving the display effect of the product.
可选地，参见图3，图3为本发明实施例中结构光的投影集合示意图。以结构光的投影集合为点的集合进行示例，该点的集合可以被称为散斑集合。Optionally, refer to FIG. 3 , which is a schematic diagram of a projection set of structured light in an embodiment of the present invention. Taking the projection set of structured light as a set of points as an example, the set of points may be called a speckle set.
本发明实施例中的结构光对应的投影集合具体为散斑集合，即，一个用于投射结构光的装置具体是将光点投射到被测物体上，通过将光点投射到被测物体上，使得生成被测物体在结构光下的散斑集合，而不是将线、光栅、格网或斑纹投影到被测物体上，由于散斑集合所需的存储空间较小，因而，能够避免影响移动设备的运行效率，节约设备的存储空间。The projection set corresponding to the structured light in the embodiment of the present invention is specifically a speckle set, that is, a device for projecting structured light specifically projects a light point onto the measured object, and by projecting the light point onto the measured object , so that the speckle collection of the measured object under structured light is generated instead of projecting lines, gratings, grids or speckles onto the measured object. Since the storage space required for the speckle collection is small, the influence of The operating efficiency of the mobile device saves the storage space of the device.
进一步地，在本发明的实施例中，在采集目标商品在结构光下对应的散斑图案时，还采集目标商品的平面图像。例如，可以由移动设备的摄像头对目标商品进行识别，并采集目标商品的平面图像。Further, in the embodiment of the present invention, when collecting the speckle pattern corresponding to the target product under structured light, the planar image of the target product is also collected. For example, the camera of the mobile device may identify the target product and collect a planar image of the target product.
可选地，参见图4，在步骤101之前，该方法还包括：Optionally, referring to FIG. 4, before step 101, the method further includes:
步骤100：在识别到目标商品时，投射结构光。Step 100: Project structured light when the target product is recognized.
具体地，移动设备的摄像头可以对拍照范围内的多个商品进行对焦，若在某一个商品上的对焦时间大于或者等于一个预设的阈值时，可以生成询问信息(例如，是否将当前对焦商品确定为目标商品)，并将询问信息显示给用户，待用户基于该询问信息将该商品确定为目标商品时，触发透射结构光，或者，也可以在拍照范围内仅存在有一个商品时，生成询问信息(例如，是否将当前商品确定为目标商品)，并将询问信息显示给用户，待用户基于该询问信息将该商品确定为目标商品时，触发透射结构光，对此不作限制。Specifically, the camera of the mobile device can focus on multiple commodities within the photographing range, and if the focusing time on a certain commodity is greater than or equal to a preset threshold, an inquiry message can be generated (for example, whether to focus on the currently focused commodity determined as the target product), and display the query information to the user, and when the user determines the product as the target product based on the query information, the transmitted structured light is triggered, or, when there is only one product within the photographing range, a generated Query information (for example, whether the current product is determined as the target product), and display the query information to the user. When the user determines the product as the target product based on the query information, trigger the transmission of structured light, which is not limited.
在本发明的实施例中，可以预先在移动设备中配置能够投射结构光的装置，进而，在识别到目标商品时，开启该用于投射结构光的装置，以透射结构光。In an embodiment of the present invention, a device capable of projecting structured light may be pre-configured in the mobile device, and then, when a target product is identified, the device for projecting structured light is turned on to transmit the structured light.
参见图5，图5为一个投射结构光的装置示意图，以结构光的投影集合为线进行示例，对于投影集合为散斑的结构光的原理类似，该装置可以包括光学投射器和摄像机，其中，光学投射器将一定模式的结构光投射于被测物体表面，在表面上形成由被测物体表面形状所调制的线的三维图像。该三维图像由处于另一位置的摄像机探测，从而获得线的二维畸变图像。线的畸变程度取决于光学投射器与摄像机之间的相对位置和被测物体表面轮廓，直观上，沿线显示出的位移(或偏移)与被测物体表面高度成比例，线的扭曲表示了被测物体平面的变化，不连续显示了被测物体表面的物理间隙，当光学投射器与摄像机之间的相对位置一定时，由线的二维畸变图像坐标便可重现被测物体表面三维轮廓。Referring to Fig. 5, Fig. 5 is a schematic diagram of a device for projecting structured light. The projection set of structured light is used as an example for example. The principle of structured light for projection set as speckle is similar. The device may include an optical projector and a camera, where , the optical projector projects a certain pattern of structured light on the surface of the measured object, forming a three-dimensional image of the line modulated by the surface shape of the measured object on the surface. This three-dimensional image is detected by a camera at another location, so that a two-dimensional distorted image of the line is obtained. The degree of distortion of the line depends on the relative position between the optical projector and the camera and the surface profile of the measured object. Intuitively, the displacement (or offset) displayed along the line is proportional to the surface height of the measured object. The distortion of the line represents the The change of the plane of the measured object shows the physical gap on the surface of the measured object discontinuously. When the relative position between the optical projector and the camera is constant, the three-dimensional image coordinates of the two-dimensional distortion of the line can reproduce the three-dimensional surface of the measured object. contour.
通过在识别到目标商品时，才投射结构光，能够节约移动设备的能耗。By projecting structured light only when the target product is recognized, energy consumption of mobile devices can be saved.
步骤102：基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型。Step 102: Perform 3D modeling on the target product based on the depth information of the speckle pattern and the plane image to obtain a first 3D model.
其中，该深度信息可以具体例如，目标商品的轮廓以及目标商品的距离，轮廓可以例如为，目标商品上的每个点在空间直角坐标系中的坐标值，距离可以例如为目标商品上的每个点相对于一个基准位置的距离，该基准位置可以是移动设备上的某个位置(例如，摄像头所在的位置)，对此不作限制。Wherein, the depth information can specifically be, for example, the outline of the target commodity and the distance of the target commodity. The contour can be, for example, the coordinate value of each point on the target commodity in the spatial Cartesian coordinate system, and the distance can be, for example, the distance of each point on the target commodity. The distance between a point and a reference position, where the reference position may be a certain position on the mobile device (for example, the position where the camera is located), is not limited to this.
具体地，可以根据散斑图像的扭曲获取深度信息。Specifically, depth information can be obtained according to the distortion of the speckle image.
根据结构光的物理特性，若将其投射在一个立体的被测物体上，则其投影集合的散斑图像会出现散斑扭曲，即，某一些散斑的排布方式与其它散斑出现偏移。According to the physical characteristics of structured light, if it is projected on a three-dimensional object to be measured, the speckle image of the projection set will appear speckle distortion, that is, the arrangement of certain speckles is deviated from other speckles. shift.
因此，在本发明的实施例中，可以基于这些偏移信息，确定出扭曲的二维散斑图像坐标作为对应的深度信息，并直接根据该深度信息还原出目标商品的轮廓以及目标商品的距离。Therefore, in the embodiment of the present invention, based on these offset information, the coordinates of the distorted two-dimensional speckle image can be determined as the corresponding depth information, and the contour of the target product and the distance of the target product can be directly restored based on the depth information .
其中的平面图像是基于摄像头对目标商品拍照得到的，或者，可以是从移动设备的相册中读取的，对此不作限制。The planar image is obtained based on a camera taking pictures of the target product, or it may be read from an album of a mobile device, which is not limited.
该平面图像为二维图像。The planar image is a two-dimensional image.
在本发明的实施例中，可以将根据深度信息还原出的目标商品的轮廓以及目标商品的距离，结合平面图像，进行3D图像合成处理，并将合成处理得到的3D模型作为第一3D模型。In the embodiment of the present invention, the outline of the target commodity and the distance of the target commodity restored according to the depth information can be combined with the plane image to perform 3D image synthesis processing, and the 3D model obtained through the synthesis processing can be used as the first 3D model.
通过基于散斑图案的深度信息和平面图像对目标商品进行3D建模，其中，是基于结构光采集到的散斑图案的深度信息和平面图像合成3D模型，建模方法简单易实现，且数据来源精准，提升商品展示效果的同时，提升商品3D模型的建模效果及效率。The 3D modeling of the target product is carried out based on the depth information of the speckle pattern and the plane image. The 3D model is synthesized based on the depth information of the speckle pattern collected by structured light and the plane image. The modeling method is simple and easy to implement, and the data The source is accurate, while improving the product display effect, it also improves the modeling effect and efficiency of the 3D model of the product.
步骤103：获取搁置目标商品的环境的3D模型并作为第二3D模型。Step 103: Obtain a 3D model of the environment where the target product is placed as a second 3D model.
其中，搁置目标商品的环境为，在展示目标商品时，需要与目标商品进行匹配展示的环境，例如，若目标商品为家具，则环境为待搁置该家具的房间，若目标商品为衣服，则环境为待搁置该衣服的衣橱或者3D人体模型，对此不作限制。Wherein, the environment where the target product is placed is the environment that needs to be displayed in a matching manner with the target product when displaying the target product. For example, if the target product is furniture, the environment is the room where the furniture is to be placed; if the target product is clothes, then The environment is a wardrobe or a 3D human body model where the clothes are to be placed, without limitation.
进一步地，可以采用与对目标商品进行3D建模的同样的方法，对环境进行3D建模，或者，也可以直接从网络数据库中下载该环境的3D模型，对此不作限制。Further, the 3D modeling of the environment may be performed in the same way as the 3D modeling of the target product, or the 3D model of the environment may be downloaded directly from the network database, without limitation.
网络数据库可以是预先建立的，具体可以采用统计的方式建立数据库，例如，由后台人员对商品类的网站中的数据进行统计，将匹配较多的环境的3D模型保存在数据库中。或者，也可以采用机器学习的方式建立数据库，例如，用网页相关技术如爬虫技术等从网页上得到匹配较多的环境的3D模型保存在数据库中。The network database can be pre-established, specifically, the database can be established in a statistical way, for example, the background personnel will count the data in the commodity website, and save the 3D models matching many environments in the database. Alternatively, the database can also be established in a machine learning manner, for example, the 3D models of environments with more matches obtained from the webpage by using webpage-related technologies such as crawler technology are stored in the database.
在本发明的实施例中，不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，提升展现效果。In the embodiment of the present invention, not only 3D modeling is performed on the target product, but also 3D modeling is performed on the environment that needs to be matched with the target product when displaying the target product, so that the information when displaying the target product is more comprehensive, The display angle is multi-dimensional and the display effect is improved.
步骤104：对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示。Step 104: Synthesize the first 3D model and the second 3D model, and display the synthesized model.
该合成处理后的模型，用于展示目标商品在环境中的搁置效果。The synthetically processed model is used to demonstrate the shelving effect of the target commodity in the environment.
一些场景下，例如，若目标商品为家具，则环境为待搁置该家具的房间，为了更好的对家具的摆放效果进行展现，可以将家具与房间进行匹配展示，例如，对家具相对应的第一3D模型，和与环境相对应的第二3D模型进行合成处理，并对合成处理后的模型进行展示，通过对合成处理后的模型进行展示，能够使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。In some scenarios, for example, if the target product is furniture, the environment is the room where the furniture is to be placed. In order to better display the placement effect of the furniture, the furniture can be displayed in a matching manner with the room, for example, corresponding to the furniture Synthesize the first 3D model and the second 3D model corresponding to the environment, and display the synthesized model. By displaying the synthesized model, the user can know the matching between the target commodity and the environment The display effect, the display result is more three-dimensional and intuitive, while improving the product display effect, it also improves the user experience.
本实施例中，通过采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像，并基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型，获取搁置目标商品的环境的3D模型并作为第二3D模型，以及对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示，由于不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。In this embodiment, the first 3D model is obtained by collecting the speckle pattern corresponding to the target product under structured light, collecting the planar image of the target product, and performing 3D modeling on the target product based on the depth information of the speckle pattern and the planar image. model, obtain the 3D model of the environment where the target commodity is placed as the second 3D model, and synthesize the first 3D model and the second 3D model, and display the synthesized model, because not only the target commodity 3D modeling also performs 3D modeling on the environment that needs to be matched with the target product when displaying the target product, so that the information when displaying the target product is more comprehensive, and the display angle is multi-dimensional, so that users can know the match between the target product and the environment The display effect, the display result is more three-dimensional and intuitive, while improving the product display effect, it also improves the user experience.
图6是本发明另一实施例提出的商品展示方法的流程示意图。Fig. 6 is a schematic flowchart of a product display method proposed by another embodiment of the present invention.
参见图6，该方法包括：Referring to Figure 6, the method includes:
步骤601：采集环境在结构光下对应的散斑图案。Step 601: Collect speckle patterns corresponding to the environment under structured light.
其中，环境为，在展示目标商品时，需要与目标商品进行匹配展示的环境，例如，若目标商品为家具，则环境为待搁置该家具的房间，若目标商品为衣服，则环境为待搁置该衣服的衣橱或者3D人体模型，对此不作限制。Among them, the environment is the environment that needs to be matched with the target product when displaying the target product. For example, if the target product is furniture, the environment is the room where the furniture is to be put on hold; The wardrobe of the clothes or the 3D human body model, without limitation.
在本发明的实施例中，可以在需要采集环境的深度信息时，启动投射结构光的装置，基于该装置将结构光投射至环境，以采集环境在结构光下对应的散斑图案，也可以直接从互联网上下载结构光对应的散斑图案，对此不作限制。In the embodiment of the present invention, when the depth information of the environment needs to be collected, the device for projecting structured light can be activated, and based on the device, the structured light can be projected to the environment to collect the speckle pattern corresponding to the environment under the structured light, or Directly download the speckle pattern corresponding to the structured light from the Internet, without limitation.
步骤602：启动摄像头，采集环境对应的平面图像。Step 602: start the camera, and collect the plane image corresponding to the environment.
进一步地，在本发明的实施例中，在采集环境在结构光下对应的散斑图案时，还采集环境的平面图像。例如，可以由移动设备的摄像头对环境进行识别，并采集环境的平面图像，或者，也可以直接从互联网上下载环境对应的平面图像，对此不作限制。Further, in the embodiment of the present invention, when collecting the speckle pattern corresponding to the environment under structured light, a plane image of the environment is also collected. For example, the camera of the mobile device may recognize the environment and collect a planar image of the environment, or may directly download the planar image corresponding to the environment from the Internet, without limitation.
步骤603：根据对应的散斑图案的深度信息和对应的平面图像对环境进行3D建模，得到环境的3D模型。Step 603: Perform 3D modeling on the environment according to the depth information of the corresponding speckle pattern and the corresponding planar image to obtain a 3D model of the environment.
其中，可以采用与对目标商品进行3D建模的同样的方法，对环境进行3D建模，或者，也可以直接从网络数据库中下载该环境的3D模型，对此不作限制。Wherein, the 3D modeling of the environment can be carried out in the same way as the 3D modeling of the target product, or the 3D model of the environment can be downloaded directly from the network database, without limitation.
网络数据库可以是预先建立的，具体可以采用统计的方式建立数据库，例如，由后台人员对商品类的网站中的数据进行统计，将匹配较多的环境的3D模型保存在数据库中。或者，也可以采用机器学习的方式建立数据库，例如，用网页相关技术如爬虫技术等从网页上得到匹配较多的环境的3D模型保存在数据库中。The network database can be pre-established, specifically, the database can be established in a statistical way, for example, the background personnel will count the data in the commodity website, and save the 3D models matching many environments in the database. Alternatively, the database can also be established in a machine learning manner, for example, the 3D models of environments with more matches obtained from the webpage by using webpage-related technologies such as crawler technology are stored in the database.
通过基于散斑图案的深度信息和平面图像对环境进行3D建模，其中，是基于结构光采集到的散斑图案的深度信息和平面图像合成环境的3D模型，建模方法简单易实现，且数据来源精准，提升环境的3D模型的建模效果及效率。The 3D modeling of the environment is carried out based on the depth information of the speckle pattern and the planar image, wherein the 3D model of the environment is synthesized based on the depth information of the speckle pattern collected by structured light and the planar image, the modeling method is simple and easy to implement, and Accurate data sources improve the modeling effect and efficiency of the 3D model of the environment.
步骤604：将环境的3D模型存储在本地存储中。Step 604: Store the 3D model of the environment in local storage.
通过将环境的3D模型存储在本地存储中，能够便于后续直接从本地存储中读取环境的3D模型，提升处理效率。By storing the 3D model of the environment in the local storage, it is convenient to read the 3D model of the environment directly from the local storage in the future, and the processing efficiency is improved.
步骤605：采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像。Step 605: Collect the speckle pattern corresponding to the target product under the structured light, and collect the planar image of the target product.
进一步地，在本发明的实施例中，在采集目标商品在结构光下对应的散斑图案时，还采集目标商品的平面图像。例如，可以由移动设备的摄像头对目标商品进行识别，并采集目标商品的平面图像。Further, in the embodiment of the present invention, when collecting the speckle pattern corresponding to the target product under structured light, the planar image of the target product is also collected. For example, the camera of the mobile device may identify the target product and collect a planar image of the target product.
步骤606：基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型。Step 606: Perform 3D modeling on the target product based on the depth information of the speckle pattern and the plane image to obtain a first 3D model.
其中，该深度信息可以具体例如，目标商品的轮廓以及目标商品的距离，轮廓可以例如为，目标商品上的每个点在空间直角坐标系中的坐标值，距离可以例如为目标商品上的每个点相对于一个基准位置的距离，该基准位置可以是移动设备上的某个位置(例如，摄像头所在的位置)，对此不作限制。Wherein, the depth information can specifically be, for example, the outline of the target commodity and the distance of the target commodity. The contour can be, for example, the coordinate value of each point on the target commodity in the spatial Cartesian coordinate system, and the distance can be, for example, the distance of each point on the target commodity. The distance between a point and a reference position, where the reference position may be a certain position on the mobile device (for example, the position where the camera is located), is not limited to this.
具体地，可以根据散斑图像的扭曲获取深度信息。Specifically, depth information can be obtained according to the distortion of the speckle image.
根据结构光的物理特性，若将其投射在一个立体的被测物体上，则其投影集合的散斑图像会出现散斑扭曲，即，某一些散斑的排布方式与其它散斑出现偏移。According to the physical characteristics of structured light, if it is projected on a three-dimensional object to be measured, the speckle image of the projection set will appear speckle distortion, that is, the arrangement of certain speckles is deviated from other speckles. shift.
因此，在本发明的实施例中，可以基于这些偏移信息，确定出扭曲的二维散斑图像坐标作为对应的深度信息，并直接根据该深度信息还原出目标商品的轮廓以及目标商品的距离。Therefore, in the embodiment of the present invention, based on these offset information, the coordinates of the distorted two-dimensional speckle image can be determined as the corresponding depth information, and the contour of the target product and the distance of the target product can be directly restored based on the depth information .
其中的平面图像是基于摄像头对目标商品拍照得到的，或者，可以是从移动设备的相册中读取的，对此不作限制。The planar image is obtained based on a camera taking pictures of the target product, or it may be read from an album of a mobile device, which is not limited.
该平面图像为二维图像。The planar image is a two-dimensional image.
在本发明的实施例中，可以将根据深度信息还原出的目标商品的轮廓以及目标商品的距离，结合平面图像，进行3D图像合成处理，并将合成处理得到的3D模型作为第一3D模型。In the embodiment of the present invention, the outline of the target commodity and the distance of the target commodity restored according to the depth information can be combined with the plane image to perform 3D image synthesis processing, and the 3D model obtained through the synthesis processing can be used as the first 3D model.
通过基于散斑图案的深度信息和平面图像对目标商品进行3D建模，其中，是基于结构光采集到的散斑图案的深度信息和平面图像合成3D模型，建模方法简单易实现，且数据来源精准，提升商品展示效果的同时，提升商品3D模型的建模效果及效率。The 3D modeling of the target product is carried out based on the depth information of the speckle pattern and the plane image. The 3D model is synthesized based on the depth information of the speckle pattern collected by structured light and the plane image. The modeling method is simple and easy to implement, and the data The source is accurate, while improving the product display effect, it also improves the modeling effect and efficiency of the 3D model of the product.
步骤607：直接从本地存储中获取预存的目标商品的环境的3D模型并作为第二3D模型。Step 607: Obtain the pre-stored 3D model of the environment of the target commodity directly from the local storage and use it as the second 3D model.
通过直接从本地存储中获取预存的目标商品的环境的3D模型并作为第二3D模型，提升处理效率。The processing efficiency is improved by directly obtaining the pre-stored 3D model of the environment of the target product from the local storage and using it as the second 3D model.
步骤608：对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示。Step 608: Synthesize the first 3D model and the second 3D model, and display the synthesized model.
该合成处理后的模型，用于展示目标商品在环境中的搁置效果。The synthetically processed model is used to demonstrate the shelving effect of the target commodity in the environment.
一些场景下，例如，若目标商品为家具，则环境为待搁置该家具的房间，为了更好的对家具的摆放效果进行展现，可以将家具与房间进行匹配展示，例如，对家具相对应的第一3D模型，和与环境相对应的第二3D模型进行合成处理，并对合成处理后的模型进行展示，通过对合成处理后的模型进行展示，能够使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。In some scenarios, for example, if the target product is furniture, the environment is the room where the furniture is to be placed. In order to better display the placement effect of the furniture, the furniture can be displayed in a matching manner with the room, for example, corresponding to the furniture Synthesize the first 3D model and the second 3D model corresponding to the environment, and display the synthesized model. By displaying the synthesized model, the user can know the matching between the target commodity and the environment The display effect, the display result is more three-dimensional and intuitive, while improving the product display effect, it also improves the user experience.
步骤609：接收用户对合成处理后的模型的操作指令。Step 609: Receive an operation instruction from the user on the synthesized model.
其中，该操作指令可以用于使用户对第一3D模型在合成处理后的模型中的摆放位置进行调整。Wherein, the operation instruction may be used to enable the user to adjust the placement position of the first 3D model in the synthesized model.
具体地，该操作指令可以例如为，用户可以选中第一3D模型并按照预设的向拖动第一3D模型，对此不作限制。Specifically, the operation instruction may be, for example, that the user may select the first 3D model and drag the first 3D model in a preset direction, which is not limited.
步骤610：根据操作指令对第一3D模型在合成处理后的模型中的摆放位置进行调整。Step 610: Adjust the placement position of the first 3D model in the synthesized model according to the operation instruction.
通过根据操作指令对第一3D模型在合成处理后的模型中的摆放位置进行调整，可以满足用户对商品展示的多样化需求，使得商品展示呈现不同的展示效果，且便于在不同的展示效果之间调整和切换，提升用户使用体验度。By adjusting the placement position of the first 3D model in the synthesized model according to the operation instructions, the diversified needs of users for commodity display can be met, so that the commodity display presents different display effects, and it is convenient to display different display effects. Adjust and switch between them to improve user experience.
本实施例中，通过基于散斑图案的深度信息和平面图像对环境进行3D建模，其中，是基于结构光采集到的散斑图案的深度信息和平面图像合成环境的3D模型，建模方法简单易实现，且数据来源精准，提升环境的3D模型的建模效果及效率。通过将环境的3D模型存储在本地存储中，能够便于后续直接从本地存储中读取环境的3D模型，提升处理效率。通过采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像，并基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型，获取搁置目标商品的环境的3D模型并作为第二3D模型，以及对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示，由于不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。通过根据操作指令对第一3D模型在合成处理后的模型中的摆放位置进行调整，可以满足用户对商品展示的多样化需求，使得商品展示呈现不同的展示效果，且便于在不同的展示效果之间调整和切换，提升用户使用体验度。In this embodiment, the 3D modeling of the environment is performed based on the depth information of the speckle pattern and the plane image, wherein the 3D model of the environment is synthesized based on the depth information of the speckle pattern collected by structured light and the plane image, and the modeling method It is simple and easy to implement, and the data source is accurate, which improves the modeling effect and efficiency of the 3D model of the environment. By storing the 3D model of the environment in the local storage, it is convenient to read the 3D model of the environment directly from the local storage in the future, and the processing efficiency is improved. By collecting the speckle pattern corresponding to the target product under structured light, and collecting the plane image of the target product, and based on the depth information of the speckle pattern and the plane image, the target product is 3D modeled to obtain the first 3D model and obtain the shelved target The 3D model of the environment of the commodity is used as the second 3D model, and the first 3D model and the second 3D model are synthesized, and the model after the synthesis is displayed, because not only the target commodity is 3D modeled, but also Perform 3D modeling on the environment that needs to be matched with the target product when displaying the target product, so that the information when displaying the target product is more comprehensive, and the display angle is multi-dimensional, so that users can know the matching display effect of the target product and the environment, and display the results It is more three-dimensional and intuitive, and improves the product display effect while enhancing the user experience. By adjusting the placement position of the first 3D model in the synthesized model according to the operation instructions, the diversified needs of users for commodity display can be met, so that the commodity display presents different display effects, and it is convenient to display different display effects Adjust and switch between them to improve user experience.
图7是本发明一实施例提出的商品展示装置的结构示意图。Fig. 7 is a schematic structural diagram of a product display device proposed by an embodiment of the present invention.
参见图7，该装置700包括：第一采集模块701、第一建模模块702、获取模块703，以及合成模块704，其中，Referring to FIG. 7, the device 700 includes: a first acquisition module 701, a first modeling module 702, an acquisition module 703, and a synthesis module 704, wherein,
第一采集模块701，用于采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像。The first collection module 701 is configured to collect the speckle pattern corresponding to the target commodity under structured light, and collect a planar image of the target commodity.
第一建模模块702，用于基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型。The first modeling module 702 is configured to perform 3D modeling on the target commodity based on the depth information of the speckle pattern and the planar image to obtain a first 3D model.
获取模块703，用于获取搁置目标商品的环境的3D模型并作为第二3D模型。An acquisition module 703, configured to acquire a 3D model of the environment where the target product is placed as a second 3D model.
可选地，一些实施例中，获取模块703，具体用于：Optionally, in some embodiments, the acquiring module 703 is specifically configured to:
直接从本地存储中获取预存的目标商品的环境的3D模型并作为第二3D模型。The pre-stored 3D model of the environment of the target commodity is directly obtained from the local storage and used as the second 3D model.
合成模块704，用于对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示。The synthesis module 704 is configured to perform synthesis processing on the first 3D model and the second 3D model, and display the synthesized models.
可选地，一些实施例中，参见图8，该装置700还包括：Optionally, in some embodiments, referring to FIG. 8, the device 700 further includes:
投射模块705，用于在识别到目标商品时，投射结构光。The projection module 705 is configured to project structured light when the target commodity is recognized.
第二采集模块706，用于采集环境在结构光下对应的散斑图案。The second collection module 706 is configured to collect speckle patterns corresponding to the environment under structured light.
第三采集模块707，用于启动摄像头，采集环境对应的平面图像。The third collection module 707 is configured to start the camera to collect the plane image corresponding to the environment.
第二建模模块708，用于根据对应的散斑图案的深度信息和对应的平面图像对环境进行3D建模，得到环境的3D模型。The second modeling module 708 is configured to perform 3D modeling on the environment according to the depth information of the corresponding speckle pattern and the corresponding planar image, to obtain a 3D model of the environment.
存储模块709，用于将环境的3D模型存储在本地存储中。The storage module 709 is configured to store the 3D model of the environment in a local storage.
接收模块710，用于接收用户对合成处理后的模型的操作指令。The receiving module 710 is configured to receive user's operation instruction on the synthesized model.
调整模块711，用于根据操作指令对第一3D模型在合成处理后的模型中的摆放位置进行调整。The adjustment module 711 is configured to adjust the placement position of the first 3D model in the synthesized model according to the operation instruction.
需要说明的是，前述图1-图6实施例中对商品展示方法实施例的解释说明也适用于该实施例的商品展示装置700，其实现原理类似，此处不再赘述。It should be noted that the explanations for the product display method embodiment in the above-mentioned embodiments in FIGS. 1-6 are also applicable to the product display device 700 in this embodiment, and its implementation principle is similar, so it will not be repeated here.
本实施例中，通过采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像，并基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型，获取搁置目标商品的环境的3D模型并作为第二3D模型，以及对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示，由于不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。In this embodiment, the first 3D model is obtained by collecting the speckle pattern corresponding to the target product under structured light, collecting the planar image of the target product, and performing 3D modeling on the target product based on the depth information of the speckle pattern and the planar image. model, obtain the 3D model of the environment where the target commodity is placed as the second 3D model, and synthesize the first 3D model and the second 3D model, and display the synthesized model, because not only the target commodity 3D modeling also performs 3D modeling on the environment that needs to be matched with the target product when displaying the target product, so that the information when displaying the target product is more comprehensive, and the display angle is multi-dimensional, so that users can know the match between the target product and the environment The display effect, the display result is more three-dimensional and intuitive, while improving the product display effect, it also improves the user experience.
本发明实施例还提供一种移动设备。上述移动设备中包括图像处理电路，图像处理电路可以利用硬件和/或软件组件实现，可包括定义ISP(Image Signal Processing，图像信号处理)管线的各种处理单元。图9为一个实施例中图像处理电路的示意图。如图9所示，为便于说明，仅示出与本发明实施例相关的图像处理技术的各个方面。The embodiment of the present invention also provides a mobile device. The aforementioned mobile device includes an image processing circuit, which may be implemented by hardware and/or software components, and may include various processing units defining an ISP (Image Signal Processing, image signal processing) pipeline. FIG. 9 is a schematic diagram of an image processing circuit in one embodiment. As shown in FIG. 9 , for ease of description, only various aspects of the image processing technology related to the embodiment of the present invention are shown.
如图9所示，图像处理电路包括成像设备910、ISP处理器930和控制逻辑器940。成像设备910可包括具有一个或多个透镜912、图像传感器914的照相机和结构光投射器916。结构光投射器916将结构光投影至被测物。其中，该结构光图案可为激光条纹、格雷码、正弦条纹、或者，随机排列的散斑图案等。图像传感器914捕捉投影至被测物形成的结构光图像，并将结构光图像发送至ISP处理器930，由ISP处理器930对结构光图像进行解调获取被测物的深度信息。同时，图像传感器914也可以捕捉被测物的色彩信息。当然，也可以由两个图像传感器914分别捕捉被测物的结构光图像和色彩信息。As shown in FIG. 9 , the image processing circuit includes an imaging device 910 , an ISP processor 930 and a control logic 940 . Imaging device 910 may include a camera having one or more lenses 912 , an image sensor 914 , and a structured light projector 916 . The structured light projector 916 projects the structured light onto the object under test. Wherein, the structured light pattern may be laser stripes, gray codes, sinusoidal stripes, or randomly arranged speckle patterns and the like. The image sensor 914 captures the structured light image projected onto the measured object, and sends the structured light image to the ISP processor 930, and the ISP processor 930 demodulates the structured light image to obtain the depth information of the measured object. At the same time, the image sensor 914 can also capture the color information of the measured object. Of course, the structured light image and color information of the object under test may also be captured by the two image sensors 914 respectively.
其中，以散斑结构光为例，ISP处理器930对结构光图像进行解调，具体包括，从该结构光图像中采集被测物的散斑图像，将被测物的散斑图像与参考散斑图像按照预定算法进行图像数据计算，获取被测物上散斑图像的各个散斑点相对于参考散斑图像中的参考散斑点的移动距离。利用三角法转换计算得到散斑图像的各个散斑点的深度值，并根据该深度值得到被测物的深度信息。Wherein, taking speckle structured light as an example, the ISP processor 930 demodulates the structured light image, which specifically includes collecting the speckle image of the object under test from the structured light image, and combining the speckle image of the object under test with the reference The image data of the speckle image is calculated according to a predetermined algorithm, and the moving distance of each speckle point in the speckle image on the object under test relative to the reference speckle point in the reference speckle image is obtained. The depth value of each speckle point of the speckle image is converted and calculated by using the triangulation method, and the depth information of the measured object is obtained according to the depth value.
当然，还可以通过双目视觉的方法或基于飞行时差TOF的方法来获取该深度图像信息等，在此不做限定，只要能够获取或通过计算得到被测物的深度信息的方法都属于本实施方式包含的范围。Of course, the depth image information can also be obtained through binocular vision or a method based on time-of-flight TOF, and there is no limitation here, as long as the method that can obtain or calculate the depth information of the measured object belongs to this implementation The range covered by the method.
在ISP处理器930接收到图像传感器914捕捉到的被测物的色彩信息之后，可被测物的色彩信息对应的图像数据进行处理。ISP处理器930对图像数据进行分析以获取可用于确定和/或成像设备910的一个或多个控制参数的图像统计信息。图像传感器914可包括色彩滤镜阵列(如Bayer滤镜)，图像传感器914可获取用图像传感器914的每个成像像素捕捉的光强度和波长信息，并提供可由ISP处理器930处理的一组原始图像数据。After the ISP processor 930 receives the color information of the object under test captured by the image sensor 914 , it can process the image data corresponding to the color information of the object under test. ISP processor 930 analyzes the image data to obtain image statistics that may be used to determine and/or control one or more parameters of imaging device 910 . Image sensor 914 may include a color filter array (such as a Bayer filter), and image sensor 914 may obtain light intensity and wavelength information captured with each imaging pixel of image sensor 914 and provide a set of raw images that may be processed by ISP processor 930. image data.
ISP处理器930按多种格式逐个像素地处理原始图像数据。例如，每个图像像素可具有8、10、12或14比特的位深度，ISP处理器930可对原始图像数据进行一个或多个图像处理操作、收集关于图像数据的图像统计信息。其中，图像处理操作可按相同或不同的位深度精度进行。The ISP processor 930 processes raw image data on a pixel-by-pixel basis in various formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP processor 930 may perform one or more image processing operations on the raw image data, collect image statistics about the image data. Among other things, image processing operations can be performed with the same or different bit depth precision.
ISP处理器930还可从图像存储器920接收像素数据。图像存储器920可为存储器装置的一部分、存储设备、或电子设备内的独立的专用存储器，并可包括DMA(Direct MemoryAccess，直接直接存储器存取)特征。ISP processor 930 may also receive pixel data from image memory 920 . The image memory 920 may be a part of a memory device, a storage device, or an independent dedicated memory in an electronic device, and may include a DMA (Direct Memory Access, Direct Memory Access) feature.
当接收到原始图像数据时，ISP处理器930可进行一个或多个图像处理操作。When receiving raw image data, the ISP processor 930 may perform one or more image processing operations.
在ISP处理器930获取到被测物的色彩信息和深度信息后，可对其进行融合，得到三维图像。其中，可通过外观轮廓提取方法或轮廓特征提取方法中的至少一种提取相应的被测物的特征。例如通过主动形状模型法ASM、主动外观模型法AAM、主成分分析法PCA、离散余弦变换法DCT等方法，提取被测物的特征，在此不做限定。再将分别从深度信息中提取到被测物的特征以及从色彩信息中提取到被测物的特征进行配准和特征融合处理。这里指的融合处理可以是将深度信息以及色彩信息中提取出的特征直接组合，也可以是将不同图像中相同的特征进行权重设定后组合，也可以有其他融合方式，最终根据融合后的特征，生成三维图像。After the ISP processor 930 acquires the color information and depth information of the object under test, they can be fused to obtain a three-dimensional image. Wherein, the feature of the corresponding object under test may be extracted by at least one of an appearance contour extraction method or a contour feature extraction method. For example, the features of the measured object are extracted by active shape modeling method ASM, active appearance modeling method AAM, principal component analysis method PCA, discrete cosine transform method DCT and other methods, which are not limited here. Then, the features of the measured object extracted from the depth information and the features of the measured object extracted from the color information are subjected to registration and feature fusion processing. The fusion processing referred to here can be to directly combine the features extracted from the depth information and color information, or to combine the same features in different images after setting weights, or there can be other fusion methods, and finally according to the fused features to generate a 3D image.
三维图像的图像数据可发送给图像存储器920，以便在被显示之前进行另外的处理。ISP处理器930从图像存储器920接收处理数据，并对所述处理数据进行原始域中以及RGB和YCbCr颜色空间中的图像数据处理。三维图像的图像数据可输出给显示器960，以供用户观看和/或由图形引擎或GPU(Graphics Processing Unit，图形处理器)进一步处理。此外，ISP处理器930的输出还可发送给图像存储器920，且显示器960可从图像存储器920读取图像数据。在一个实施例中，图像存储器920可被配置为实现一个或多个帧缓冲器。此外，ISP处理器930的输出可发送给编码器/解码器950，以便编码/解码图像数据。编码的图像数据可被保存，并在显示于显示器960设备上之前解压缩。编码器/解码器950可由CPU或GPU或协处理器实现。Image data for a three-dimensional image may be sent to image memory 920 for additional processing before being displayed. The ISP processor 930 receives processed data from the image memory 920 and performs image data processing on the processed data in the raw domain and in the RGB and YCbCr color spaces. The image data of the three-dimensional image may be output to the display 960 for viewing by the user and/or for further processing by a graphics engine or a GPU (Graphics Processing Unit, graphics processor). In addition, the output of the ISP processor 930 can also be sent to the image memory 920 , and the display 960 can read image data from the image memory 920 . In one embodiment, image memory 920 may be configured to implement one or more frame buffers. Also, the output of the ISP processor 930 may be sent to an encoder/decoder 950 for encoding/decoding image data. The encoded image data may be saved and decompressed prior to display on the display 960 device. Encoder/decoder 950 may be implemented by a CPU or GPU or a coprocessor.
ISP处理器930确定的图像统计信息可发送给控制逻辑器940单元。控制逻辑器940可包括执行一个或多个例程(如固件)的处理器和/或微控制器，一个或多个例程可根据接收的图像统计信息，确定成像设备910的控制参数。The image statistics determined by the ISP processor 930 may be sent to the control logic 940 unit. Control logic 940 may include a processor and/or microcontroller executing one or more routines (eg, firmware) that may determine control parameters for imaging device 910 based on received image statistics.
本发明实施例中，运用图9中图像处理技术实现商品展示方法的步骤可以参见上述实施例，在此不再赘述。In the embodiment of the present invention, the steps of implementing the product display method by using the image processing technology in FIG. 9 may refer to the above embodiments, and details are not repeated here.
为了实现上述实施例，本发明还提出一种非临时性计算机可读存储介质，当存储介质中的指令由终端的处理器执行时，使得终端能够执行一种商品展示方法，方法包括：采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像；基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型；获取搁置目标商品的环境的3D模型并作为第二3D模型；对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示。In order to realize the above-mentioned embodiments, the present invention also proposes a non-transitory computer-readable storage medium. When the instructions in the storage medium are executed by the processor of the terminal, the terminal can execute a commodity display method. The method includes: collecting the target The speckle pattern corresponding to the commodity under structured light, and collect the planar image of the target commodity; perform 3D modeling on the target commodity based on the depth information of the speckle pattern and the planar image, and obtain the first 3D model; obtain the information of the environment where the target commodity is placed The 3D model is used as the second 3D model; the first 3D model and the second 3D model are synthesized, and the synthesized model is displayed.
本实施例中的非临时性计算机可读存储介质，通过采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像，并基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型，获取搁置目标商品的环境的3D模型并作为第二3D模型，以及对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示，由于不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。The non-transitory computer-readable storage medium in this embodiment collects the speckle pattern corresponding to the target commodity under structured light, and collects the planar image of the target commodity, and based on the depth information of the speckle pattern and the planar image, the target commodity Perform 3D modeling to obtain the first 3D model, obtain the 3D model of the environment where the target commodity is placed as the second 3D model, and perform synthesis processing on the first 3D model and the second 3D model, and perform synthesis processing on the model For display, not only the 3D modeling of the target product is carried out, but also the 3D modeling of the environment that needs to be matched with the target product when displaying the target product, so that the information when displaying the target product is more comprehensive, and the display angle is multi-dimensional. It enables users to know the matching display effect of the target product and the environment, and the display result is more three-dimensional and intuitive. While improving the product display effect, it also improves the user experience.
为了实现上述实施例，本发明还提出一种计算机程序产品，当计算机程序产品中的指令被处理器执行时，执行一种商品展示方法，方法包括：采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像；基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型；获取搁置目标商品的环境的3D模型并作为第二3D模型；对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示。In order to realize the above-mentioned embodiments, the present invention also proposes a computer program product. When the instructions in the computer program product are executed by the processor, a product display method is executed. The method includes: collecting the speckle corresponding to the target product under structured light pattern, and collect the planar image of the target commodity; perform 3D modeling on the target commodity based on the depth information of the speckle pattern and the planar image, and obtain the first 3D model; obtain the 3D model of the environment where the target commodity is placed as the second 3D model; Synthesize the first 3D model and the second 3D model, and display the synthesized model.
本实施例中的计算机程序产品，通过采集目标商品在结构光下对应的散斑图案，并采集目标商品的平面图像，并基于散斑图案的深度信息和平面图像对目标商品进行3D建模，得到第一3D模型，获取搁置目标商品的环境的3D模型并作为第二3D模型，以及对第一3D模型和第二3D模型进行合成处理，并对合成处理后的模型进行展示，由于不仅仅对目标商品进行3D建模，还对在展示目标商品时，需要与目标商品进行匹配展示的环境进行3D建模，使得展示目标商品时的信息更加全面，展现角度多维化，使得用户获知目标商品与环境的匹配展示效果，展示结果更加立体化、直观化，提升商品展示效果的同时，提升用户使用体验度。The computer program product in this embodiment collects the speckle pattern corresponding to the target commodity under structured light, collects the planar image of the target commodity, and performs 3D modeling on the target commodity based on the depth information of the speckle pattern and the planar image, Obtain the first 3D model, obtain the 3D model of the environment where the target product is placed as the second 3D model, and synthesize the first 3D model and the second 3D model, and display the synthesized model, because not only Carry out 3D modeling for the target product, and also perform 3D modeling for the environment that needs to be matched with the target product when displaying the target product, so that the information when displaying the target product is more comprehensive, and the display angle is multi-dimensional, so that users can know the target product The matching display effect with the environment makes the display result more three-dimensional and intuitive, which improves the product display effect and improves the user experience at the same time.
需要说明的是，在本发明的描述中，术语“第一”、“第二”等仅用于描述目的，而不能理解为指示或暗示相对重要性。此外，在本发明的描述中，除非另有说明，“多个”的含义是两个或两个以上。It should be noted that, in the description of the present invention, the terms "first", "second" and so on are only used for description purposes, and should not be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, "plurality" means two or more.
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为，表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分，并且本发明的优选实施方式的范围包括另外的实现，其中可以不按所示出或讨论的顺序，包括根据所涉及的功能按基本同时的方式或按相反的顺序，来执行功能，这应被本发明的实施例所属技术领域的技术人员所理解。Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the invention includes alternative implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present invention pertain.
应当理解，本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中，多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如，如果用硬件来实现，和在另一实施方式中一样，可用本领域公知的下列技术中的任一项或他们的组合来实现：具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路，具有合适的组合逻辑门电路的专用集成电路，可编程门阵列(PGA)，现场可编程门阵列(FPGA)等。It should be understood that various parts of the present invention can be realized by hardware, software, firmware or their combination. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成，的程序可以存储于一种计算机可读存储介质中，该程序在执行时，包括方法实施例的步骤之一或其组合。Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed , including one or a combination of the steps of the method embodiment.
此外，在本发明各个实施例中的各功能单元可以集成在一个处理模块中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.
上述提到的存储介质可以是只读存储器，磁盘或光盘等。The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like.
在本说明书的描述中，参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不一定指的是相同的实施例或示例。而且，描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
尽管上面已经示出和描述了本发明的实施例，可以理解的是，上述实施例是示例性的，不能理解为对本发明的限制，本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710641661.6ACN107330974B (en) | 2017-07-31 | 2017-07-31 | Commodity display method and device and mobile equipment |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710641661.6ACN107330974B (en) | 2017-07-31 | 2017-07-31 | Commodity display method and device and mobile equipment |
| Publication Number | Publication Date |
|---|---|
| CN107330974Atrue CN107330974A (en) | 2017-11-07 |
| CN107330974B CN107330974B (en) | 2021-01-15 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710641661.6AExpired - Fee RelatedCN107330974B (en) | 2017-07-31 | 2017-07-31 | Commodity display method and device and mobile equipment |
| Country | Link |
|---|---|
| CN (1) | CN107330974B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107967095A (en)* | 2017-11-24 | 2018-04-27 | 天脉聚源（北京）科技有限公司 | A kind of image display method and device |
| CN110021062A (en)* | 2018-01-08 | 2019-07-16 | 佛山市顺德区美的电热电器制造有限公司 | A kind of acquisition methods and terminal, storage medium of product feature |
| CN113077306A (en)* | 2021-03-25 | 2021-07-06 | 中国联合网络通信集团有限公司 | Image processing method, device and equipment |
| CN113298619A (en)* | 2021-05-24 | 2021-08-24 | 成都威爱新经济技术研究院有限公司 | 3D commodity live broadcast display method and system based on free viewpoint technology |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101794056A (en)* | 2010-02-05 | 2010-08-04 | 明基电通有限公司 | Photographing setting control method and photographing device |
| US20120154571A1 (en)* | 2010-12-17 | 2012-06-21 | Mitutoyo Corporation | Edge detection using structured illumination |
| CN103308149A (en)* | 2013-06-24 | 2013-09-18 | 中国航空工业集团公司北京长城计量测试技术研究所 | Machine vision synchronous focusing scanning type laser vibration measuring device |
| CN103702100A (en)* | 2013-12-17 | 2014-04-02 | Tcl商用信息科技（惠州）股份有限公司 | 3D (three-dimensional) display method and 3D display system for scenario |
| CN103810748A (en)* | 2012-11-08 | 2014-05-21 | 纽海信息技术（上海）有限公司 | 3D simulation system construction and management method and 3D simulation device |
| CN104182880A (en)* | 2014-05-16 | 2014-12-03 | 孙锋 | Online shopping method and system based on real person and/or real object 3D (three-dimensional) models |
| CN104935893A (en)* | 2015-06-17 | 2015-09-23 | 浙江大华技术股份有限公司 | Monitoring method and device |
| CN106504283A (en)* | 2016-09-26 | 2017-03-15 | 深圳奥比中光科技有限公司 | Information broadcasting method, apparatus and system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101794056A (en)* | 2010-02-05 | 2010-08-04 | 明基电通有限公司 | Photographing setting control method and photographing device |
| US20120154571A1 (en)* | 2010-12-17 | 2012-06-21 | Mitutoyo Corporation | Edge detection using structured illumination |
| CN103810748A (en)* | 2012-11-08 | 2014-05-21 | 纽海信息技术（上海）有限公司 | 3D simulation system construction and management method and 3D simulation device |
| CN103308149A (en)* | 2013-06-24 | 2013-09-18 | 中国航空工业集团公司北京长城计量测试技术研究所 | Machine vision synchronous focusing scanning type laser vibration measuring device |
| CN103702100A (en)* | 2013-12-17 | 2014-04-02 | Tcl商用信息科技（惠州）股份有限公司 | 3D (three-dimensional) display method and 3D display system for scenario |
| CN104182880A (en)* | 2014-05-16 | 2014-12-03 | 孙锋 | Online shopping method and system based on real person and/or real object 3D (three-dimensional) models |
| CN104935893A (en)* | 2015-06-17 | 2015-09-23 | 浙江大华技术股份有限公司 | Monitoring method and device |
| CN106504283A (en)* | 2016-09-26 | 2017-03-15 | 深圳奥比中光科技有限公司 | Information broadcasting method, apparatus and system |
| Title |
|---|
| 张万祯: "数字投影结构光三维测量方法研究", 《中国博士学位论文全文数据库信息科技辑》* |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107967095A (en)* | 2017-11-24 | 2018-04-27 | 天脉聚源（北京）科技有限公司 | A kind of image display method and device |
| CN110021062A (en)* | 2018-01-08 | 2019-07-16 | 佛山市顺德区美的电热电器制造有限公司 | A kind of acquisition methods and terminal, storage medium of product feature |
| CN110021062B (en)* | 2018-01-08 | 2024-05-10 | 佛山市顺德区美的电热电器制造有限公司 | Product characteristic acquisition method, terminal and storage medium |
| CN113077306A (en)* | 2021-03-25 | 2021-07-06 | 中国联合网络通信集团有限公司 | Image processing method, device and equipment |
| CN113077306B (en)* | 2021-03-25 | 2023-07-07 | 中国联合网络通信集团有限公司 | Image processing method, device and equipment |
| CN113298619A (en)* | 2021-05-24 | 2021-08-24 | 成都威爱新经济技术研究院有限公司 | 3D commodity live broadcast display method and system based on free viewpoint technology |
| Publication number | Publication date |
|---|---|
| CN107330974B (en) | 2021-01-15 |
| Publication | Publication Date | Title |
|---|---|---|
| US8660362B2 (en) | Combined depth filtering and super resolution | |
| CN107481304B (en) | Method and device for constructing virtual image in game scene | |
| CN107563304B (en) | Terminal device unlocking method and device, and terminal device | |
| EP2824923B1 (en) | Apparatus, system and method for projecting images onto predefined portions of objects | |
| CN107517346B (en) | Photographing method, device and mobile device based on structured light | |
| US9049369B2 (en) | Apparatus, system and method for projecting images onto predefined portions of objects | |
| WO2019035155A1 (en) | Image processing system, image processing method, and program | |
| CN109118569A (en) | Rendering method and device based on threedimensional model | |
| CN107452034B (en) | Image processing method and device thereof | |
| CN107480615B (en) | Beauty treatment method and device and mobile equipment | |
| CN107564050B (en) | Control method and device based on structured light and terminal equipment | |
| CN105026997A (en) | Projection system, semiconductor integrated circuit and image correction method | |
| CN107610171B (en) | Image processing method and device | |
| WO2012096747A1 (en) | Forming range maps using periodic illumination patterns | |
| CN107481101B (en) | Dressing recommendation method and device | |
| CN107330974A (en) | merchandise display method, device and mobile device | |
| CN107392874B (en) | Beauty treatment method, device and mobile device | |
| JP2021182396A (en) | Methods and apparatus for generating three-dimensional reconstruction of object with reduced distortion | |
| CN107480612A (en) | Recognition methods, device and the terminal device of figure action | |
| CN107493427A (en) | Focusing method and device for mobile terminal and mobile terminal | |
| CN107592449A (en) | Three-dimension modeling method, apparatus and mobile terminal | |
| CN107656611A (en) | Somatosensory game realization method and device, terminal equipment | |
| CN108881885A (en) | Advanced treatment system | |
| CN107343148A (en) | Image completion method, device and terminal | |
| CN107469355A (en) | Game character image creation method and device, terminal equipment |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | Address after:Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before:Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. | |
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20210115 | |
| CF01 | Termination of patent right due to non-payment of annual fee |