技术领域technical field
本公开涉及数据处理技术领域，尤其涉及智能搜索领域，具体涉及图像处理方法、装置、电子设备、存储介质以及程序产品。The present disclosure relates to the technical field of data processing, in particular to the field of intelligent search, and in particular to an image processing method, device, electronic equipment, storage medium, and program product.
背景技术Background technique
随着互联网的普及，智能搜索已经成为互联网的重要工具之一。智能搜索可以提供信息查询、检索等服务，在提供该些服务的过程中，可以通过不断优化其智能化、个性化、交互性、主动性等优势，力求使用户快速精准地找到自己需要的信息。With the popularity of the Internet, intelligent search has become one of the important tools of the Internet. Intelligent search can provide services such as information query and retrieval. In the process of providing these services, it can continuously optimize its advantages such as intelligence, personalization, interactivity, and initiative, and strive to enable users to quickly and accurately find the information they need. .
发明内容Contents of the invention
本公开提供了一种图像处理方法、装置、电子设备、存储介质以及程序产品。The disclosure provides an image processing method, device, electronic equipment, storage medium and program product.
根据本公开的一方面，提供了一种图像处理方法，包括：识别图像数据中的目标物品对象的类别信息和属性特征信息；基于类别信息和属性特征信息，确定与目标物品对象相匹配的物品标识信息，并提供给用户；以及响应于用于图像处理的请求，根据类别信息和属性特性信息，对待处理图像进行图像处理，得到目标图像。According to an aspect of the present disclosure, an image processing method is provided, including: identifying category information and attribute feature information of a target item object in image data; and determining an item matching the target item object based on the category information and attribute feature information identifying information and providing it to the user; and in response to a request for image processing, performing image processing on the image to be processed according to the category information and attribute characteristic information to obtain a target image.
根据本公开的另一方面，提供了一种图像处理装置，包括：识别模块，用于识别图像数据中的目标物品对象的类别信息和属性特征信息；标识确定模块，用于基于类别信息和属性特征信息，确定与目标物品对象相匹配的物品标识信息，并提供给用户；以及响应模块，用于响应于用于图像处理的请求，根据类别信息和属性特性信息，对待处理图像进行图像处理，得到目标图像。According to another aspect of the present disclosure, an image processing device is provided, including: an identification module for identifying category information and attribute feature information of a target object in image data; an identification determination module for The feature information is used to determine the item identification information that matches the target item object and provide it to the user; and the response module is used to respond to the request for image processing, and perform image processing on the image to be processed according to the category information and attribute characteristic information, Get the target image.
根据本公开的另一方面，提供了一种电子设备，包括：至少一个处理器；以及与所述至少一个处理器通信连接的存储器；其中，所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行如上所述的方法。According to another aspect of the present disclosure, there is provided an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; Instructions executed by the at least one processor to enable the at least one processor to perform the method as described above.
根据本公开的另一方面，提供了一种存储有计算机指令的非瞬时计算机可读存储介质，其中，所述计算机指令用于使所述计算机执行如上所述的方法。According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the above method.
根据本公开的另一方面，提供了一种计算机程序产品，包括计算机程序，所述计算机程序在被处理器执行时实现如上所述的方法。According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method as described above.
应当理解，本部分所描述的内容并非旨在标识本公开的实施例的关键或重要特征，也不用于限制本公开的范围。本公开的其它特征将通过以下的说明书而变得容易理解。It should be understood that what is described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood through the following description.
附图说明Description of drawings
附图用于更好地理解本方案，不构成对本公开的限定。其中：The accompanying drawings are used to better understand the present solution, and do not constitute a limitation to the present disclosure. in:
图1示意性示出了根据本公开实施例的可以应用图像处理方法及装置的示例性系统架构；FIG. 1 schematically shows an exemplary system architecture to which an image processing method and device can be applied according to an embodiment of the present disclosure;
图2示意性示出了根据本公开实施例的图像处理方法的流程图；Fig. 2 schematically shows a flowchart of an image processing method according to an embodiment of the present disclosure;
图3示意性示出了根据本公开实施例的确定目标物品对象的属性特征信息和类别信息的示意图；Fig. 3 schematically shows a schematic diagram of determining attribute feature information and category information of a target item object according to an embodiment of the present disclosure;
图4示意性示出了根据本公开另一实施例的确定目标物品对象的属性特征信息和类别信息的示意图；Fig. 4 schematically shows a schematic diagram of determining attribute feature information and category information of a target item object according to another embodiment of the present disclosure;
图5示意性示出了根据本公开实施例的对待处理图像进行渲染的示意图；Fig. 5 schematically shows a schematic diagram of rendering an image to be processed according to an embodiment of the present disclosure;
图6示意性示出了根据本公开另一实施例的图像处理方法的流程图；FIG. 6 schematically shows a flowchart of an image processing method according to another embodiment of the present disclosure;
图7示意性示出了根据本公开实施例的图像处理装置的框图；以及Fig. 7 schematically shows a block diagram of an image processing device according to an embodiment of the present disclosure; and
图8示意性示出了根据本公开实施例的适于实现图像处理方法的电子设备的框图。Fig. 8 schematically shows a block diagram of an electronic device suitable for implementing an image processing method according to an embodiment of the present disclosure.
具体实施方式Detailed ways
以下结合附图对本公开的示范性实施例做出说明，其中包括本公开实施例的各种细节以助于理解，应当将它们认为仅仅是示范性的。因此，本领域普通技术人员应当认识到，可以对这里描述的实施例做出各种改变和修改，而不会背离本公开的范围和精神。同样，为了清楚和简明，以下的描述中省略了对公知功能和结构的描述。Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
随着互联网的快速发展，用户在浏览网页、观看直播等线上活动时，可能对漂亮的服饰、精致的妆容引发兴趣，有进一步了解和购买的想法。With the rapid development of the Internet, when users browse the web, watch live broadcasts and other online activities, they may be interested in beautiful clothing and exquisite makeup, and have further understanding and purchase ideas.
在实际情况中，可以采用文字搜索同款物品的方式来进一步获取物品信息。但是，少量的或者不精确的搜索信息，导致搜索结果难以符合用户预期，乃至难以满足用户精准需求。另外，还可以利用公众号推荐的方式来获取推荐的同款物品信息。但是，公众号推荐的单品种类和数量有限，难以满足对多种多样的物品的搜索需求。In actual situations, further item information can be obtained by text searching for the same item. However, a small amount of or inaccurate search information makes it difficult for the search results to meet user expectations, and even difficult to meet the precise needs of users. In addition, you can also use the official account recommendation method to obtain the recommended item information of the same item. However, the types and quantities of items recommended by official accounts are limited, making it difficult to meet the search needs for a variety of items.
本公开的实施例提供了一种图像处理方法、装置、电子设备、存储介质以及程序产品。Embodiments of the present disclosure provide an image processing method, device, electronic equipment, storage medium, and program product.
根据本公开的实施例，图像处理方法可以包括：识别图像数据中的目标物品对象的类别信息和属性特征信息；基于类别信息和属性特征信息，确定与目标物品对象相匹配的物品标识信息，并提供给用户；以及响应于用于图像处理的请求，根据类别信息和属性特性信息，对待处理图像进行图像处理，得到目标图像。According to an embodiment of the present disclosure, the image processing method may include: identifying category information and attribute feature information of the target item object in the image data; determining item identification information matching the target item object based on the category information and attribute feature information, and provided to the user; and in response to a request for image processing, perform image processing on the image to be processed according to the category information and attribute characteristic information to obtain a target image.
利用本公开的实施例提供的图像处理方法，可以通过识别图像数据中的目标物品对象的类别信息和属性特征信息，确定与目标物品对象相匹配的物品标识信息。用户可以通过获悉得到的与目标物品对象相匹配的物品标识信息，可以更深入地了解、学习目标物品对象。进而解决用户通过文字搜索而导致的搜索用语描述不准确，搜索结果难以满足用户需求等问题。更进一步，可以根据类别信息和属性特征信息，对待处理图像进行图像处理，得到目标图像，将目标物品对象与待处理图像相结合，将虚拟信息可视化，更直观，提高用户体验。Using the image processing method provided by the embodiments of the present disclosure, the item identification information matching the target item object can be determined by identifying the category information and attribute feature information of the target item object in the image data. The user can gain a deeper understanding and study of the target item object by knowing the obtained item identification information that matches the target item object. Furthermore, it solves problems such as inaccurate description of search terms caused by users searching through words, and difficulty in satisfying user needs in search results. Furthermore, image processing can be performed on the image to be processed according to the category information and attribute feature information to obtain the target image, and the target item object can be combined with the image to be processed to visualize the virtual information, which is more intuitive and improves user experience.
本公开的技术方案中，所涉及的用户个人信息的获取，存储和应用等，均符合相关法律法规的规定，且不违背公序良俗。In the technical solution of the present disclosure, the acquisition, storage and application of the user's personal information involved are in compliance with relevant laws and regulations, and do not violate public order and good customs.
图1示意性示出了根据本公开实施例的可以应用图像处理方法及装置的示例性系统架构。Fig. 1 schematically shows an exemplary system architecture to which an image processing method and device can be applied according to an embodiment of the present disclosure.
需要注意的是，图1所示仅为可以应用本公开实施例的系统架构的示例，以帮助本领域技术人员理解本公开的技术内容，但并不意味着本公开实施例不可以用于其他设备、系统、环境或场景。例如，在另一实施例中，可以应用图像处理方法及装置的示例性系统架构可以包括终端设备，但终端设备可以无需与服务器进行交互，即可实现本公开实施例提供的图像处理方法及装置。It should be noted that, what is shown in FIG. 1 is only an example of the system architecture to which the embodiments of the present disclosure can be applied, so as to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other device, system, environment or scenario. For example, in another embodiment, the exemplary system architecture to which the image processing method and device can be applied may include a terminal device, but the terminal device may implement the image processing method and device provided by the embodiments of the present disclosure without interacting with the server .
如图1所示，根据该实施例的系统架构100可以包括终端设备101、102、103，网络104和服务器105。网络104用以在终端设备101、102、103和服务器105之间提供通信链路的介质。网络104可以包括各种连接类型，例如有线和/或无线通信链路等等。As shown in FIG. 1 , a system architecture 100 according to this embodiment may include terminal devices 101 , 102 , 103 , a network 104 and a server 105 . The network 104 is used as a medium for providing communication links between the terminal devices 101 , 102 , 103 and the server 105 . Network 104 may include various connection types, such as wired and/or wireless communication links, among others.
用户可以使用终端设备101、102、103通过网络104与服务器105交互，以接收或发送消息等。终端设备101、102、103上可以安装有各种通讯客户端应用，例如知识阅读类应用、网页浏览器应用、搜索类应用、即时通信工具、邮箱客户端和/或社交平台软件等(仅为示例)。Users can use terminal devices 101 , 102 , 103 to interact with server 105 via network 104 to receive or send messages and the like. Various communication client applications can be installed on the terminal devices 101, 102, 103, such as knowledge reading applications, web browser applications, search applications, instant messaging tools, email clients and/or social platform software, etc. (only example).
终端设备101、102、103可以是具有显示屏并且支持网页浏览的各种电子设备，包括但不限于智能手机、平板电脑、膝上型便携计算机和台式计算机等等。The terminal devices 101, 102, 103 may be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers and the like.
服务器105可以是提供各种服务的服务器，例如对用户利用终端设备101、102、103所浏览的内容提供支持的后台管理服务器(仅为示例)。后台管理服务器可以对接收到的用户请求等数据进行分析等处理，并将处理结果(例如根据用户请求获取或生成的网页、信息、或数据等)反馈给终端设备。The server 105 may be a server that provides various services, such as a background management server that supports content browsed by users using the terminal devices 101 , 102 , 103 (just an example). The background management server can analyze and process received data such as user requests, and feed back processing results (such as webpages, information, or data obtained or generated according to user requests) to the terminal device.
需要说明的是，本公开实施例所提供的图像处理方法一般可以由终端设备101、102、或103执行。相应地，本公开实施例所提供的图像处理装置也可以设置于终端设备101、102、或103中。It should be noted that, generally, the image processing method provided by the embodiment of the present disclosure may be executed by the terminal device 101 , 102 , or 103 . Correspondingly, the image processing apparatus provided by the embodiment of the present disclosure may also be set in the terminal device 101 , 102 , or 103 .
或者，本公开实施例所提供的图像处理方法一般也可以由服务器105执行。相应地，本公开实施例所提供的图像处理装置一般可以设置于服务器105中。本公开实施例所提供的图像处理方法也可以由不同于服务器105且能够与终端设备101、102、103和/或服务器105通信的服务器或服务器集群执行。相应地，本公开实施例所提供的图像处理装置也可以设置于不同于服务器105且能够与终端设备101、102、103和/或服务器105通信的服务器或服务器集群中。Alternatively, the image processing method provided by the embodiment of the present disclosure may also generally be executed by the server 105 . Correspondingly, the image processing apparatus provided by the embodiments of the present disclosure can generally be set in the server 105 . The image processing method provided by the embodiments of the present disclosure may also be executed by a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101 , 102 , 103 and/or the server 105 . Correspondingly, the image processing apparatus provided by the embodiments of the present disclosure may also be set in a server or a server cluster that is different from the server 105 and can communicate with the terminal devices 101 , 102 , 103 and/or the server 105 .
例如，在用户搜索图像数据中的目标物品对象时，终端设备101、102、103可以获取图像数据，然后将获取的图像数据发送给服务器105，由服务器105对图像数据进行分析，识别图像数据中的目标物品对象的类别信息和属性特征信息；基于类别信息和属性特征信息，确定与目标物品对象相匹配的物品标识信息。或者由能够与终端设备101、102、103和/或服务器105通信的服务器或服务器集群对图像数据进行分析，并最终实现确定与目标物品对象相匹配的物品标识信息。For example, when a user searches for a target object in the image data, the terminal devices 101, 102, and 103 can acquire the image data, and then send the acquired image data to the server 105, and the server 105 analyzes the image data to identify The category information and attribute feature information of the target item object; based on the category information and attribute feature information, determine the item identification information matching the target item object. Alternatively, a server or server cluster capable of communicating with the terminal devices 101, 102, 103 and/or the server 105 analyzes the image data, and finally determines the item identification information matching the target item object.
应该理解，图1中的终端设备、网络和服务器的数目仅仅是示意性的。根据实现需要，可以具有任意数目的终端设备、网络和服务器。It should be understood that the numbers of terminal devices, networks and servers in Fig. 1 are only illustrative. According to the implementation needs, there can be any number of terminal devices, networks and servers.
图2示意性示出了根据本公开实施例的图像处理方法的流程图。Fig. 2 schematically shows a flowchart of an image processing method according to an embodiment of the present disclosure.
如图2所示，该方法包括操作S210～S230。As shown in FIG. 2, the method includes operations S210-S230.
在操作S210，识别图像数据中的目标物品对象的类别信息和属性特征信息。In operation S210, category information and attribute feature information of the target item object in the image data are recognized.
在操作S220，基于类别信息和属性特征信息，确定与目标物品对象相匹配的物品标识信息，并提供给用户。In operation S220, item identification information matching the target item object is determined based on the category information and attribute feature information, and provided to the user.
在操作S230，响应于用于图像处理的请求，根据类别信息和属性特性信息，对待处理图像进行图像处理，得到目标图像。In operation S230, in response to the request for image processing, image processing is performed on the image to be processed according to the category information and attribute characteristic information to obtain a target image.
根据本公开的实施例，图像数据的来源不做限定。例如，可以是通过图像采集装置采集的图像数据，也可以是从网页下载的图像数据，还可以是通过提取视频得到的视频帧数据。According to the embodiments of the present disclosure, the source of the image data is not limited. For example, it may be image data collected by an image acquisition device, image data downloaded from a web page, or video frame data obtained by extracting video.
根据本公开的实施例，目标物品对象的类型不做具体限定。例如，可以是涂在面部的化妆品，也可以是穿在身上的服饰，还可以是其他物品。According to the embodiments of the present disclosure, the type of the target item object is not specifically limited. For example, it can be cosmetics applied to the face, clothing worn on the body, or other items.
根据本公开的实施例，类别信息可以是用于区分物品类别的信息，可以表明图像数据中的目标物品对象的所属类别，例如，化妆品、服装、饰品等类别。According to an embodiment of the present disclosure, the category information may be information for distinguishing item categories, and may indicate the category to which the target item object in the image data belongs, for example, categories such as cosmetics, clothing, and accessories.
根据本公开的实施例，属性特征信息的类型不做限定。例如，可以是指目标物品对象的材质、颜色、图案、尺寸等相关属性信息。According to the embodiments of the present disclosure, the type of attribute feature information is not limited. For example, it may refer to related attribute information such as material, color, pattern, and size of the target item object.
根据本公开的实施例，物品标识信息的类型不做限定。例如，可以是二维码，也可以是条形码，还可以是物品标识证号。只要是能够起到唯一标识物品的作用即可。According to the embodiments of the present disclosure, the type of item identification information is not limited. For example, it can be a two-dimensional code, a barcode, or an item identification number. As long as it can uniquely identify the item.
根据本公开的实施例，与目标物品对象相匹配的物品标识信息，可以是目标物品对象的物品标识信息，但是并不局限于此。还可以是与目标物品对象相似的或者相关的物品的物品标识信息。According to an embodiment of the present disclosure, the item identification information matching the target item object may be the item identification information of the target item object, but it is not limited thereto. It may also be item identification information of items similar to or related to the target item object.
利用本公开的实施例提供的图像处理方法，可以通过识别图像数据中的目标物品对象的类别信息和属性特征信息，确定与目标物品对象相匹配的物品标识信息。用户可以通过获悉得到的与目标物品对象相匹配的物品标识信息，对目标物品对象进行更深入地了解、学习或者购买等操作。进而解决用户通过文字搜索而导致的搜索用语描述不准确，进而搜索结果不精确、搜索结果难以满足用户需求的问题。Using the image processing method provided by the embodiments of the present disclosure, the item identification information matching the target item object can be determined by identifying the category information and attribute feature information of the target item object in the image data. The user can perform more in-depth understanding, learning, or purchase operations on the target item object by learning the obtained item identification information that matches the target item object. Further, the problem of inaccurate description of search terms caused by users searching through words, and inaccurate search results and difficulty in meeting user needs can be solved.
根据本公开的实施例，待处理图像的图像内容不做限定。例如，可以包括脸部、头发、身体等其中一个或多个人体部位的图像，还可以具有动物、房子、自然风景等背景图像内容。According to the embodiment of the present disclosure, the image content of the image to be processed is not limited. For example, it may include images of one or more human body parts such as face, hair, body, etc., and may also have background image content such as animals, houses, and natural scenery.
根据本公开的实施例，图像处理的手段不做限定。例如，可以是图像渲染处理、图像着色处理，还可以是图像合成处理，也可以是图像变形处理等。在此不再赘述。According to the embodiments of the present disclosure, image processing methods are not limited. For example, it may be image rendering processing, image coloring processing, image composition processing, or image deformation processing. I won't repeat them here.
利用本公开的实施例，根据类别信息和属性特征信息，对待处理图像进行图像处理，得到目标图像，将目标物品对象与待处理图像相结合，将虚拟信息可视化，更直观，用户体验好。Utilizing the embodiments of the present disclosure, image processing is performed on the image to be processed according to category information and attribute feature information to obtain a target image, and the target item object is combined with the image to be processed to visualize virtual information, which is more intuitive and provides good user experience.
根据本公开的实施例，可以通过如下操作来确定目标物品对象的类别信息和属性特征信息。According to an embodiment of the present disclosure, the category information and attribute feature information of the target item object may be determined through the following operations.
例如，响应于用于识别图像数据的请求，识别图像数据中的目标物品对象的属性特征信息和附属位置信息，其中，附属位置信息用于表征目标物品对象附属于的对象的位置信息；以及基于附属位置信息，确定目标物品对象的类别信息。For example, in response to a request for identifying image data, identifying attribute feature information and attached location information of the target item object in the image data, wherein the attached location information is used to characterize the location information of the object to which the target item object is attached; and based on The subsidiary location information determines the category information of the target item object.
根据本公开的实施例，可以通过识别模型来识别目标物品对象的属性特征信息和附属位置信息。According to an embodiment of the present disclosure, the attribute feature information and the attached location information of the target item object can be identified through a recognition model.
根据本公开的实施例，属性特征信息可以包括颜色类别特征信息、颜色型号特征信息、颜色质地特征信息中的一项或多项。According to an embodiment of the present disclosure, the attribute feature information may include one or more items of color category feature information, color model feature information, and color texture feature information.
根据本公开的实施例，颜色类别特征信息可以是红、黄、蓝、白、黑等主颜色类别特征信息。According to an embodiment of the present disclosure, the color category feature information may be primary color category feature information such as red, yellow, blue, white, and black.
根据本公开的实施例，颜色型号特征信息可以是色号信息，即主颜色类别中的再精细划分的颜色信息。例如，红色中的鲜红、玫红、橘红等。颜色型号特征信息可以通过颜色色号来进行标识。According to an embodiment of the present disclosure, the color model feature information may be color number information, that is, subdivided color information in the main color category. For example, bright red, rose red, orange red and so on in red. The characteristic information of the color model can be identified by the color number.
根据本公开的实施例，颜色类别特征信息和颜色型号特征信息，可以通过颜色识别模型来识别；还可以分别采用颜色类别识别模型和颜色型号识别模型分别来识别。According to an embodiment of the present disclosure, the color category feature information and the color model feature information may be identified through a color recognition model; they may also be identified using a color category recognition model and a color model recognition model respectively.
根据本公开的实施例，精细化区分目标物品对象的颜色类别特征信息、颜色型号特征信息，可以更为精准的匹配与目标物品对象相匹配的物品标识信息。According to the embodiments of the present disclosure, by finely distinguishing the color category feature information and the color model feature information of the target item object, the item identification information matching the target item object can be matched more accurately.
根据本公开的实施例，颜色质地特征信息可以是哑光、珠光、正常等信息。According to an embodiment of the present disclosure, the color texture feature information may be matte, pearly, normal, and other information.
根据本公开的实施例，颜色质地特征信息可以通过质地识别模型来识别。According to an embodiment of the present disclosure, the color texture feature information can be identified through a texture recognition model.
根据本公开的示例性实施例，识别颜色类别特征信息、颜色型号特征信息和颜色质地特征信息，并利用颜色类别特征信息、颜色型号特征信息和颜色质地特征信息共同确定与目标物品对象相匹配的物品标识信息。能够更为精准的适用于化妆品类物品对象的识别与物品标识信息的确定。According to an exemplary embodiment of the present disclosure, the color category feature information, color model feature information, and color texture feature information are identified, and the color category feature information, color model feature information, and color texture feature information are used to jointly determine the Item identification information. It can be more accurately applied to the identification of cosmetic object objects and the determination of item identification information.
根据本公开的实施例，附属位置信息不做具体限定。例如，可以是附属于的对象(例如人物)的五官位置信息，也可以是附属于的对象的头部位置信息，还可以是附属于的对象的身体位置信息。可以通过对象识别模型来进行识别。例如，五官识别模型、人体识别模型等。According to the embodiments of the present disclosure, the affiliated location information is not specifically limited. For example, it may be the facial features position information of the attached object (such as a person), the head position information of the attached object, or the body position information of the attached object. Recognition may be performed by an object recognition model. For example, facial recognition models, human body recognition models, etc.
根据本公开的实施例，可以通过附属位置信息来确定目标物品对象的类别信息，尤其是化妆品类物品对象的类别信息。例如，眼部对应眼影、腮部对应腮红、眉毛对应眉笔、脸部对应粉底、嘴唇对应口红等。According to an embodiment of the present disclosure, the category information of the target item object, especially the category information of the cosmetic item object, may be determined through the subsidiary location information. For example, the eyes correspond to eyeshadow, the cheeks correspond to blush, the eyebrows correspond to eyebrow pencil, the face corresponds to foundation, and the lips correspond to lipstick, etc.
下面结合具体实施例，并参考图3～图6对根据本公开实施例的图像处理方法做进一步说明。The image processing method according to the embodiment of the present disclosure will be further described below with reference to specific embodiments and with reference to FIGS. 3 to 6 .
图3示意性示出了根据本公开实施例的确定目标物品对象的属性特征信息和类别信息的示意图。Fig. 3 schematically shows a schematic diagram of determining attribute feature information and category information of a target item object according to an embodiment of the present disclosure.
如图3所示，可以响应于用户用于识别例如人脸图像数据的请求，利用五官识别模型来识别图像数据中的附属位置信息、利用颜色识别模型和质地识别模型来识别图像数据中的属性特征信息。最终识别结果为，附属位置信息为嘴部，属性特征信息为玫红色的颜色色号，颜色质地为珠光。后续，基于附属位置信息，可以确定与附属位置信息对应的目标物品对象的类别信息为口红。As shown in Figure 3, in response to the user's request for identifying, for example, face image data, the facial features recognition model can be used to identify the attached position information in the image data, and the color recognition model and the texture recognition model can be used to identify attributes in the image data. characteristic information. The final recognition result is that the auxiliary position information is the mouth, the attribute feature information is the color number of rose red, and the color texture is pearlescent. Subsequently, based on the subsidiary location information, it may be determined that the category information of the target item object corresponding to the subsidiary location information is lipstick.
利用本公开实施例提供的属性特征信息和类别信息确定方式，可以获取图像数据中的多种信息，使识别范围广，搜索全面。By using the method for determining the attribute feature information and category information provided by the embodiments of the present disclosure, various information in the image data can be obtained, so that the identification range is wide and the search is comprehensive.
根据本公开的实施例，还可以通过如下操作来确定目标物品对象的类别信息和属性特征信息。According to an embodiment of the present disclosure, the category information and attribute feature information of the target item object may also be determined through the following operations.
例如，获取用于识别图像数据的请求，其中，请求中携带目标物品对象的类别信息；响应于用于识别图像数据的请求，从图像数据中确定与类别信息相对应的附属位置信息，其中，附属位置信息用于表征目标物品对象附属于的对象的位置信息；以及基于附属位置信息，从图像数据中识别目标对象的属性特征信息。For example, acquiring a request for identifying image data, wherein the request carries category information of the target item object; in response to the request for identifying image data, determining from the image data the attached location information corresponding to the category information, wherein, The attached location information is used to characterize the location information of the object to which the target item object is attached; and based on the attached location information, attribute feature information of the target object is identified from the image data.
根据本公开的实施例，在响应于用于识别图像数据的请求的情况下，已经获知目标物品对象的类别信息，只需利用五官识别模型识别到对应类别信息的附属位置信息，并利用颜色识别模型和质地识别模型分别识别得到对应附属位置信息的属性特征信息即可。According to an embodiment of the present disclosure, in response to a request for identifying image data, the category information of the target item object has already been known, and it is only necessary to use the facial features recognition model to identify the subsidiary position information corresponding to the category information, and use the color to identify The model and the texture recognition model can respectively recognize the attribute feature information corresponding to the attached location information.
图4示意性示出了根据本公开另一实施例的确定目标物品对象的属性特征信息和类别信息的示意图。Fig. 4 schematically shows a schematic diagram of determining attribute feature information and category information of a target item object according to another embodiment of the present disclosure.
如图4所示，在已知目标物品对象的类别信息为口红的情况下，响应于用于识别人脸图像数据的请求，利用五官识别模型来识别图像数据中的附属位置信息(嘴部位置信息)。利用颜色识别模型和质地识别模型来识别图像数据中的与嘴部位置信息对应的属性特征信息，例如，颜色色号为玫红色，颜色质地为珠光。As shown in Figure 4, when the category information of the target object is known as lipstick, in response to the request for identifying face image data, the facial features recognition model is used to identify the attached position information (mouth position) in the image data. information). Use the color recognition model and the texture recognition model to recognize the attribute feature information corresponding to the mouth position information in the image data, for example, the color number is rose red, and the color texture is pearlescent.
利用本公开另一实施例提供的属性特征信息和类别信息确定方式，可以更具有针对性，使识别更快速、精准。Using the method for determining the attribute feature information and category information provided by another embodiment of the present disclosure can be more targeted and make identification faster and more accurate.
根据本公开的实施例，可以通过如下操作来基于类别信息和属性特征信息，确定与目标物品对象相匹配的物品标识信息。According to an embodiment of the present disclosure, the item identification information matching the target item object can be determined based on the category information and attribute feature information through the following operations.
例如，从物品对象集合中筛选与类别信息和属性特征信息相匹配的候选物品对象；以及在确定候选物品对象满足预设条件的情况下，将候选物品对象的物品标识信息确定为与目标物品对象相匹配的物品标识信息。For example, screening candidate item objects matching the category information and attribute feature information from the item object collection; and determining that the item identification information of the candidate item object is consistent with the target item object when Matching item identification information.
根据本公开的实施例，与目标物品对象相匹配的物品对象可以是目标物品对象，也可以是与目标物品对象相似的或者相关的物品对象。According to an embodiment of the present disclosure, the item object matching the target item object may be the target item object, or an item object similar or related to the target item object.
根据本公开的实施例，基于类别信息和属性特征信息作为匹配信息来从物品对象集合中进行筛选，可以筛选出一个或者多个候选物品对象。According to an embodiment of the present disclosure, one or more candidate item objects may be screened out based on category information and attribute feature information as matching information to filter from the item object collection.
根据本公开的实施例，在将候选物品对象的物品标识信息确定为与目标物品对象相匹配的物品标识信息之前，本公开实施例提供的图像处理方法可以执行确定候选物品对象是否满足预设条件的操作。According to the embodiment of the present disclosure, before determining the item identification information of the candidate item object as the item identification information matching the target item object, the image processing method provided by the embodiment of the present disclosure may perform determining whether the candidate item object satisfies the preset condition operation.
根据本公开的实施例，利用预设条件进一步筛选候选物品对象，不仅能更贴近用户需求，而且能进一步筛减候选物品对象，避免信息冗余，影响用户体验。According to the embodiments of the present disclosure, using preset conditions to further screen candidate item objects can not only be closer to user needs, but also can further filter candidate item objects to avoid information redundancy and affect user experience.
根据本公开的实施例，可以通过如下方式来确定候选物品对象是否满足预设条件。According to an embodiment of the present disclosure, whether a candidate item object satisfies a preset condition may be determined in the following manner.
例如，确定候选物品对象的价值属性值；以及在确定候选物品对象的价值属性值小于或等于预设价值阈值的情况下，确定候选物品对象满足预设条件。For example, determining the value attribute value of the candidate item object; and determining that the candidate item object satisfies the preset condition when the value attribute value of the candidate item object is determined to be less than or equal to a preset value threshold.
根据本公开的实施例，将价值属性值小于或等于预设价值阈值作为预设条件，将价值属性值小于或等于预设价值阈值的候选物品对象的物品标识信息确定为与目标物品对象相匹配的物品标识信息，有利于快速筛选出与目标物品对象相类似的平价款物品对象或者目标物品对象。According to an embodiment of the present disclosure, the value attribute value is less than or equal to the preset value threshold as the preset condition, and the item identification information of the candidate item object whose value attribute value is less than or equal to the preset value threshold is determined to match the target item object The item identification information is beneficial to quickly filter out the cheap item object or the target item object similar to the target item object.
根据本公开的实施例，还可以通过如下方式来确定候选物品对象是否满足预设条件。According to an embodiment of the present disclosure, it may also be determined whether a candidate item object satisfies a preset condition in the following manner.
例如，确定多个候选物品对象中的每个候选物品对象的关注度；以及将关注度最高的候选物品对象确定为满足预设条件的候选物品对象。For example, determining the attention degree of each candidate item object among the plurality of candidate item objects; and determining the candidate item object with the highest attention degree as the candidate item object satisfying the preset condition.
根据本公开的实施例，候选物品对象的关注度的类型不做限定。例如，可以是用户对候选物品对象的感兴趣程度，也可以是该候选物品对象的热度，例如收藏数量、加入购物车数量、或者购买数量，还可以是候选物品对象的上市时间。According to the embodiment of the present disclosure, the type of the attention degree of the candidate item object is not limited. For example, it may be the user's degree of interest in the candidate item object, or the popularity of the candidate item object, such as the number of collections, the number of added shopping carts, or the number of purchases, or the listing time of the candidate item object.
根据本公开的示例性实施例，候选物品对象的关注度可以是基于感兴趣程度、热度、以及上市时间等多个因素共同确定。例如，可以为感兴趣程度、热度、以及上市时间等因素配置不同的权重因子，由总权重来确定关注度。According to an exemplary embodiment of the present disclosure, the attention degree of a candidate item object may be jointly determined based on multiple factors such as degree of interest, popularity, and time to market. For example, different weight factors can be configured for factors such as degree of interest, popularity, and time to market, and the degree of concern is determined by the total weight.
关注度＝感兴趣程度*第一权重因子+热度*第二权重因子+上市时间*第三权重因子。Attention degree = degree of interest * first weighting factor + popularity * second weighting factor + time to market * third weighting factor.
根据本公开的实施例，将关注度最高作为预设条件，将关注度最高的候选物品对象确定为满足预设条件的候选物品对象，贴近用户的需求。According to the embodiment of the present disclosure, the highest attention degree is taken as the preset condition, and the candidate item object with the highest attention degree is determined as the candidate item object meeting the preset condition, which is close to the needs of the user.
根据本公开的示例性实施例，还可以确定候选物品对象的价值属性值，并确定多个候选物品对象中的每个候选物品对象的关注度，将价值属性值小于或等于预设价值阈值的候选物品对象确定为候选物品对象满足第一预设条件，将关注度满足预设关注度阈值的候选物品对象确定为候选物品对象满足第二预设条件，将同时满足第一预设条件和第二预设条件的候选物品对象确定为满足预设条件的候选物品对象。According to an exemplary embodiment of the present disclosure, it is also possible to determine the value attribute value of the candidate item object, and determine the attention degree of each candidate item object in a plurality of candidate item objects, and make the value attribute value less than or equal to the preset value threshold The candidate article object is determined as the candidate article object that meets the first preset condition, and the candidate article object whose attention degree meets the preset attention degree threshold is determined as the candidate article object that meets the second preset condition, and will satisfy the first preset condition and the second preset condition at the same time. The candidate item objects of the two preset conditions are determined as the candidate item objects satisfying the preset conditions.
根据本公开的实施例，将价值属性值和关注度结合考虑，能够筛选出符合用户个性化需求的平价物品对象或者同款物品对象。According to the embodiments of the present disclosure, by considering the value attribute value and attention degree together, it is possible to filter out cheap item objects or same-style item objects that meet the user's individual needs.
根据本公开的实施例，与目标物品对象相匹配的物品标识信息可以包括：目标物品对象的物品链接信息、目标物品对象的物品型号信息、目标物品对象的物品价值属性值信息、与目标物品对象相似的物品的物品链接信息、与目标物品对象相似的物品的物品型号信息、与目标物品对象相似的物品的物品价值属性值信息中的一项或多项。According to an embodiment of the present disclosure, the item identification information matched with the target item object may include: item link information of the target item object, item model information of the target item object, item value attribute value information of the target item object, and One or more of item link information of similar items, item model information of items similar to the target item object, and item value attribute value information of items similar to the target item object.
根据本公开的实施例，与目标物品对象相匹配的物品标识信息可以是目标物品对象的物品标识信息，也可以是与目标物品对象相似的物品对象的物品标识信息。According to an embodiment of the present disclosure, the item identification information matching the target item object may be item identification information of the target item object, or item identification information of an item object similar to the target item object.
根据本公开的实施例，物品标识信息可以是二维码，也可以是条形码，还可以是物品标识证号，但是并不局限于此。还可以附加有链接信息、型号信息、物品价值属性值信息等。According to an embodiment of the present disclosure, the item identification information may be a two-dimensional code, a barcode, or an item identification number, but it is not limited thereto. Link information, model information, item value attribute value information, etc. may also be added.
根据本公开的实施例，在识别到目标物品对象的属性特征信息和类别信息后，进一步确定与目标物品对象匹配的物品标识信息，有利于用户快速、深入地了解目标物品对象或者与目标物品对象相似的物品对象，满足用户的购买需求。According to the embodiments of the present disclosure, after identifying the attribute feature information and category information of the target item object, the item identification information matching the target item object is further determined, which is helpful for the user to quickly and deeply understand the target item object or the target item object. Similar item objects to meet the user's purchase needs.
根据本公开的实施例，在确定与目标物品对象相匹配的物品标识信息后，还可以通过如下操作来得到目标对象，并展示给用户。According to an embodiment of the present disclosure, after determining the item identification information matching the target item object, the target object may also be obtained through the following operations and displayed to the user.
例如，响应于用于图像处理的请求，基于类别信息，确定待处理图像的目标位置信息；以及基于属性特征信息，对待处理图像的目标位置信息进行渲染，得到目标图像。For example, in response to the request for image processing, based on the category information, determine the target location information of the image to be processed; and based on the attribute feature information, render the target location information of the image to be processed to obtain the target image.
根据本公开的实施例，目标位置信息可以是众多附属位置信息中的一个或多个位置信息，例如，可以是五官、人体的头部、身体等部位中的一个或多个。在确定目标位置信息后，即可以确定待处理图像的纹理信息。可以根据属性特征信息中的颜色类别特征信息、颜色型号特征信息和颜色质地特征信息等中的一种或多种，对待处理图像的目标位置信息进行渲染，得到渲染后的目标图像。According to an embodiment of the present disclosure, the target location information may be one or more pieces of location information among numerous subsidiary location information, for example, it may be one or more of five sense organs, the head of the human body, and the body. After determining the target position information, the texture information of the image to be processed can be determined. According to one or more of the color category feature information, color model feature information, and color texture feature information in the attribute feature information, the target position information of the image to be processed can be rendered to obtain the rendered target image.
需要说明的是，对图像进行渲染处理的操作也可以基于用户的跳过请求而放弃执行。在获取到用户用于图像处理的请求的情况下，再响应于用于图像处理的请求，执行对待处理图像的目标位置信息进行渲染的操作。It should be noted that the operation of rendering the image may also be abandoned based on the user's skip request. When the user's request for image processing is obtained, an operation of rendering the target position information of the image to be processed is performed in response to the request for image processing.
利用本公开实施例提供的图像处理方法，选择性高、灵活、智能，满足用户的多种需求。The image processing method provided by the embodiments of the present disclosure has high selectivity, flexibility, and intelligence, and meets various demands of users.
图5示意性示出了根据本公开实施例的对待处理图像进行渲染的示意图。Fig. 5 schematically shows a schematic diagram of rendering an image to be processed according to an embodiment of the present disclosure.
如图5所示，对待处理图像510进行渲染，可以模拟对面部进行自动试妆的操作。待处理图像510可以是图库中用户确定的人脸图像，也可以是在线拍摄的人脸图像。可以基于用户的指令，进行整体面容试妆、唇部试妆、眼影试妆等操作。可以利用五官识别模型识别待处理图像中的目标位置信息520，例如唇部，然后基于属性特征信息，对唇部进行着色，得到涂覆口红的目标图像530。As shown in FIG. 5 , the rendering of the image to be processed 510 can simulate the operation of automatically trying makeup on the face. The image to be processed 510 may be a face image determined by a user in a library, or a face image captured online. Based on the user's instructions, operations such as overall face makeup trial, lip makeup trial, and eye shadow makeup trial can be performed. The facial features recognition model can be used to identify the target position information 520 in the image to be processed, such as lips, and then based on the attribute feature information, the lips are colored to obtain the target image 530 coated with lipstick.
利用本公开实施例提供的图像处理方法，通过对待处理图像的渲染，能够模拟在线试妆，可视化效果好。Using the image processing method provided by the embodiment of the present disclosure, by rendering the image to be processed, it is possible to simulate an online makeup test, and the visualization effect is good.
需要说明的是，利用本公开的实施例提供的图像处理方法，不仅可以对待处理图像进行渲染处理，还可以对待处理图像进行合成处理，例如将目标物品对象(包、服饰、发饰、首饰等物品对象)与待处理图像进行拼接，合成为一张图像，作为目标图像。It should be noted that, using the image processing methods provided by the embodiments of the present disclosure, not only can the image to be processed be rendered, but also the image to be processed can be synthesized, for example, the target object (bag, clothing, hair accessories, jewelry, etc. Item object) is spliced with the image to be processed, and synthesized into an image, which is used as the target image.
根据本公开的示例性实施例，智能识别五官中的位置信息，并识别图像数据中的化妆品类物品对象的属性特征信息，例如颜色类别特征信息、颜色型号特征信息、质地特征信息以及类别信息等，更为突出地解决了用户难以用语言文字描述搜索的诉求。According to an exemplary embodiment of the present disclosure, the position information in the facial features is intelligently identified, and the attribute feature information of the cosmetic item object in the image data is identified, such as color category feature information, color model feature information, texture feature information, and category information, etc. , which more prominently solves the user's difficulty in describing the search in words.
图6示意性示出了根据本公开另一实施例的图像处理方法的流程图。Fig. 6 schematically shows a flowchart of an image processing method according to another embodiment of the present disclosure.
如图6所示，图像数据610的来源可以是图片，也可以是视频。可以直接提取图片中的数据作为图像数据，也可以提取视频帧中的关键帧，提取关键帧中的数据作为图像数据。As shown in FIG. 6 , the source of the image data 610 may be a picture or a video. The data in the picture can be directly extracted as the image data, or the key frame in the video frame can be extracted, and the data in the key frame can be extracted as the image data.
利用深度学习的识别模型来智能识别图像数据610中的目标物品对象的类别信息、属性特征信息。并基于此，利用属性特征信息例如颜色类别信息、颜色型号信息、颜色质地信息、类别信息，从物品对象集合中进行映射检索，确定与目标物品对象相匹配的物品标识信息620。展示给用户。The recognition model of deep learning is used to intelligently recognize the category information and attribute feature information of the target object in the image data 610 . And based on this, use attribute feature information such as color category information, color model information, color texture information, and category information to perform mapping retrieval from the item object collection to determine item identification information 620 that matches the target item object. displayed to the user.
在本实施例中，还可以提供用户选择是否进行试妆操作，例如试妆或者跳过。在响应于用户用于进行试妆操作的请求的情况下，可以在线采集人脸面部信息，基于属性特征信息和类别信息，对面部图像进行着色，得到上妆的目标图像630。In this embodiment, it is also possible for the user to choose whether to perform a makeup trial operation, for example, try makeup or skip. In the case of responding to the user's request for a makeup trial operation, facial information can be collected online, and based on attribute feature information and category information, the facial image can be colored to obtain a makeup target image 630 .
用户可以根据目标图像来判断试妆效果，最终确定是否购买目标物品对象或者与目标物品对象相似的物品对象。The user can judge the makeup effect according to the target image, and finally determine whether to purchase the target item or an item similar to the target item.
利用本公开的实施例提供的图像处理方法，适用于图片或者视频等场景，可以精准识别图像数据中的目标物品对象的属性特征信息和类别信息，确定与目标物品对象相匹配的物品标识信息(即搜索到同款或者能够达到同等效果的相似款物品)，而且能够进行试妆，虚拟上妆的样貌。实现看、试、买的完整闭环操作，智能满足用户的多种需求，解决语言文字描述搜索不精准的问题。The image processing method provided by the embodiments of the present disclosure is applicable to scenes such as pictures or videos, and can accurately identify the attribute feature information and category information of the target item object in the image data, and determine the item identification information that matches the target item object ( That is, you can search for the same item or a similar item that can achieve the same effect), and you can try on the makeup and virtualize the appearance of the makeup. Realize the complete closed-loop operation of watching, trying and buying, intelligently meet the various needs of users, and solve the problem of inaccurate language and text description searches.
图7示意性示出了根据本公开实施例的图像处理装置的框图。Fig. 7 schematically shows a block diagram of an image processing device according to an embodiment of the present disclosure.
如图7所示，图像处理装置700可以包括识别模块710、标识确定模块720、以及响应模块730。As shown in FIG. 7 , the image processing apparatus 700 may include an identification module 710 , an identification determination module 720 , and a response module 730 .
识别模块710，用于识别图像数据中的目标物品对象的类别信息和属性特征信息；An identification module 710, configured to identify the category information and attribute feature information of the target object in the image data;
标识确定模块720，用于基于类别信息和属性特征信息，确定与目标物品对象相匹配的物品标识信息，并提供给用户；以及An identification determination module 720, configured to determine item identification information matching the target item object based on the category information and attribute feature information, and provide it to the user; and
响应模块730，用于响应于用于图像处理的请求，根据类别信息和属性特性信息，对待处理图像进行图像处理，得到目标图像。The response module 730 is configured to, in response to the request for image processing, perform image processing on the image to be processed according to the category information and attribute information, to obtain a target image.
根据本公开的实施例，识别模块710可以包括第一识别单元、以及类别确定单元。According to an embodiment of the present disclosure, the recognition module 710 may include a first recognition unit and a category determination unit.
第一识别单元，用于响应于用于识别图像数据的请求，识别图像数据中的目标物品对象的属性特征信息和附属位置信息，其中，附属位置信息用于表征目标物品对象附属于的对象的位置信息；A first recognition unit, configured to, in response to a request for identifying image data, identify attribute feature information and attached position information of the target item object in the image data, wherein the attached position information is used to characterize the object to which the target item object is attached location information;
类别确定单元，用于基于附属位置信息，确定目标物品对象的类别信息。A category determining unit, configured to determine the category information of the target item object based on the auxiliary location information.
根据本公开的实施例，识别模块710可以包括获取单元、位置确定单元、以及第二识别单元。According to an embodiment of the present disclosure, the identification module 710 may include an acquisition unit, a position determination unit, and a second identification unit.
获取单元，用于获取用于识别图像数据的请求，其中，请求中携带目标物品对象的类别信息；An acquisition unit, configured to acquire a request for identifying image data, wherein the request carries category information of the target object;
位置确定单元，用于响应于请求，从图像数据中确定与类别信息相对应的附属位置信息，其中，附属位置信息用于表征目标物品对象附属于的对象的位置信息；a location determining unit, configured to determine, from the image data, attached location information corresponding to the category information in response to the request, wherein the attached location information is used to represent the location information of the object to which the target item object is attached;
第二识别单元，用于基于附属位置信息，从图像数据中识别目标对象的属性特征信息。The second identifying unit is configured to identify attribute feature information of the target object from the image data based on the attached position information.
根据本公开的实施例，标识确定模块720可以包括筛选单元、以及标识确定单元。According to an embodiment of the present disclosure, the identity determination module 720 may include a screening unit and an identity determination unit.
筛选单元，用于从物品对象集合中筛选与类别信息和属性特征信息相匹配的候选物品对象；以及a screening unit, configured to screen candidate item objects matching category information and attribute feature information from the item object collection; and
标识确定单元，用于在确定候选物品对象满足预设条件的情况下，将候选物品对象的物品标识信息确定为与目标物品对象相匹配的物品标识信息。The identification determination unit is configured to determine the item identification information of the candidate item object as the item identification information matching the target item object when it is determined that the candidate item object satisfies a preset condition.
根据本公开的实施例，图像处理装置700还可以包括价值确定模块、以及第一候选确定模块。According to an embodiment of the present disclosure, the image processing apparatus 700 may further include a value determination module, and a first candidate determination module.
价值确定模块，用于确定候选物品对象的价值属性值；以及a value determination module, configured to determine the value attribute value of the candidate item object; and
第一候选确定模块，用于在确定候选物品对象的价值属性值小于或等于预设价值阈值的情况下，确定候选物品对象满足预设条件。The first candidate determination module is configured to determine that the candidate item object satisfies a preset condition when it is determined that the value attribute value of the candidate item object is less than or equal to a preset value threshold.
根据本公开的实施例，图像处理装置700还可以包括关注度确定模块、以及第二候选确定模块。According to an embodiment of the present disclosure, the image processing apparatus 700 may further include an attention degree determination module and a second candidate determination module.
关注度确定模块，用于确定多个候选物品对象中的每个候选物品对象的关注度；以及An attention degree determination module, configured to determine the attention degree of each candidate item object in a plurality of candidate item objects; and
第二候选确定模块，用于将关注度最高的候选物品对象确定为满足预设条件的候选物品对象。The second candidate determining module is configured to determine the candidate item object with the highest degree of attention as the candidate item object satisfying the preset condition.
根据本公开的实施例，响应模块730可以包括响应单元、以及渲染单元。According to an embodiment of the present disclosure, the response module 730 may include a response unit and a rendering unit.
响应单元，用于响应于用于图像处理的请求，基于类别信息，确定待处理图像的目标位置信息；a response unit, configured to determine the target position information of the image to be processed based on the category information in response to the request for image processing;
渲染单元，用于基于属性特征信息，对待处理图像的目标位置信息进行渲染，得到目标图像。The rendering unit is configured to render the target position information of the image to be processed based on the attribute feature information to obtain the target image.
根据本公开的实施例，属性特征信息包括以下至少一项：颜色类别特征信息、颜色型号特征信息、颜色质地特征信息。According to an embodiment of the present disclosure, the attribute feature information includes at least one of the following: color category feature information, color model feature information, and color texture feature information.
根据本公开的实施例，与目标物品对象相匹配的物品标识信息包括以下至少一项：目标物品对象的物品链接信息、目标物品对象的物品型号信息、目标物品对象的物品价值属性值信息、与目标物品对象相似的物品的物品链接信息、与目标物品对象相似的物品的物品型号信息、与目标物品对象相似的物品的物品价值属性值信息。According to an embodiment of the present disclosure, the item identification information matched with the target item object includes at least one of the following items: item link information of the target item object, item model information of the target item object, item value attribute value information of the target item object, and Item link information of items similar to the target item object, item model information of items similar to the target item object, and item value attribute value information of items similar to the target item object.
根据本公开的实施例，本公开还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。According to the embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.
根据本公开的实施例，一种电子设备，包括：至少一个处理器；以及与至少一个处理器通信连接的存储器；其中，存储器存储有可被至少一个处理器执行的指令，指令被至少一个处理器执行，以使至少一个处理器能够执行如上所述的方法。According to an embodiment of the present disclosure, an electronic device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by at least one processor, and the instructions are processed by at least one The processor is executed, so that at least one processor can perform the method as described above.
根据本公开的实施例，一种存储有计算机指令的非瞬时计算机可读存储介质，其中，计算机指令用于使计算机执行如上所述的方法。According to an embodiment of the present disclosure, there is a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the method as described above.
根据本公开的实施例，一种计算机程序产品，包括计算机程序，计算机程序在被处理器执行时实现如上所述的方法。According to an embodiment of the present disclosure, a computer program product includes a computer program, and the computer program implements the method as described above when executed by a processor.
图8示出了可以用来实施本公开的实施例的示例电子设备800的示意性框图。电子设备旨在表示各种形式的数字计算机，诸如，膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置，诸如，个人数字处理、蜂窝电话、智能电话、可穿戴设备和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例，并且不意在限制本文中描述的和/或者要求的本公开的实现。FIG. 8 shows a schematic block diagram of an example electronic device 800 that may be used to implement embodiments of the present disclosure. Electronic device is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.
如图8所示，设备800包括计算单元801，其可以根据存储在只读存储器(ROM)802中的计算机程序或者从存储单元808加载到随机访问存储器(RAM)803中的计算机程序，来执行各种适当的动作和处理。在RAM 803中，还可存储设备800操作所需的各种程序和数据。计算单元801、ROM 802以及RAM 803通过总线804彼此相连。输入/输出(I/O)接口805也连接至总线804。As shown in FIG. 8, the device 800 includes a computing unit 801 that can execute according to a computer program stored in a read-only memory (ROM) 802 or loaded from a storage unit 808 into a random access memory (RAM) 803. Various appropriate actions and treatments. In the RAM 803, various programs and data necessary for the operation of the device 800 can also be stored. The computing unit 801 , ROM 802 , and RAM 803 are connected to each other through a bus 804 . An input/output (I/O) interface 805 is also connected to the bus 804 .
设备800中的多个部件连接至I/O接口805，包括：输入单元806，例如键盘、鼠标等；输出单元807，例如各种类型的显示器、扬声器等；存储单元808，例如磁盘、光盘等；以及通信单元809，例如网卡、调制解调器、无线通信收发机等。通信单元809允许设备800通过诸如因特网的计算机网络和/或各种电信网络与其他设备交换信息/数据。Multiple components in the device 800 are connected to the I/O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, an optical disk, etc. ; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 809 allows the device 800 to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.
计算单元801可以是各种具有处理和计算能力的通用和/或专用处理组件。计算单元801的一些示例包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的计算单元、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。计算单元801执行上文所描述的各个方法和处理，例如图像处理方法。例如，在一些实施例中，图像处理方法可被实现为计算机软件程序，其被有形地包含于机器可读介质，例如存储单元808。在一些实施例中，计算机程序的部分或者全部可以经由ROM 802和/或通信单元809而被载入和/或安装到设备800上。当计算机程序加载到RAM 803并由计算单元801执行时，可以执行上文描述的图像处理方法的一个或多个步骤。备选地，在其他实施例中，计算单元801可以通过其他任何适当的方式(例如，借助于固件)而被配置为执行图像处理方法。The computing unit 801 may be various general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of computing units 801 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 executes various methods and processes described above, such as image processing methods. For example, in some embodiments, the image processing method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 808 . In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 800 via the ROM 802 and/or the communication unit 809 . When the computer program is loaded into RAM 803 and executed by computing unit 801, one or more steps of the image processing method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to execute the image processing method in any other suitable manner (for example, by means of firmware).
本文中以上描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、芯片上系统的系统(SOC)、负载可编程逻辑设备(CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些各种实施方式可以包括：实施在一个或者多个计算机程序中，该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释，该可编程处理器可以是专用或者通用可编程处理器，可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令，并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips Implemented in a system of systems (SOC), load programmable logic device (CPLD), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpreted on a programmable system including at least one programmable processor, the programmable processor Can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.
用于实施本公开的方法的程序代码可以采用一个或多个编程语言的任何组合来编写。这些程序代码可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器或控制器，使得程序代码当由处理器或控制器执行时使流程图和/或框图中所规定的功能/操作被实施。程序代码可以完全在机器上执行、部分地在机器上执行，作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special purpose computer, or other programmable data processing devices, so that the program codes, when executed by the processor or controller, make the functions/functions specified in the flow diagrams and/or block diagrams Action is implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
为了提供与用户的交互，可以在计算机上实施此处描述的系统和技术，该计算机具有：用于向用户显示信息的显示装置(例如，CRT(阴极射线管)或者LCD(液晶显示器)监视器)；以及键盘和指向装置(例如，鼠标或者轨迹球)，用户可以通过该键盘和该指向装置来将输入提供给计算机。其它种类的装置还可以用于提供与用户的交互；例如，提供给用户的反馈可以是任何形式的传感反馈(例如，视觉反馈、听觉反馈、或者触觉反馈)；并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。To provide for interaction with the user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user. ); and a keyboard and pointing device (eg, a mouse or a trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and can be in any form (including Acoustic input, speech input or, tactile input) to receive input from the user.
可以将此处描述的系统和技术实施在包括后台部件的计算系统(例如，作为数据服务器)、或者包括中间件部件的计算系统(例如，应用服务器)、或者包括前端部件的计算系统(例如，具有图形用户界面或者网络浏览器的用户计算机，用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如，通信网络)来将系统的部件相互连接。通信网络的示例包括：局域网(LAN)、广域网(WAN)和互联网。The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN) and the Internet.
计算机系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器，也可以是分布式系统的服务器，或者是结合了区块链的服务器。A computer system may include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, a server of a distributed system, or a server combined with a blockchain.
应该理解，可以使用上面所示的各种形式的流程，重新排序、增加或删除步骤。例如，本发公开中记载的各步骤可以并行地执行也可以顺序地执行也可以不同的次序执行，只要能够实现本公开公开的技术方案所期望的结果，本文在此不进行限制。It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, each step described in the present disclosure may be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution disclosed in the present disclosure can be achieved, no limitation is imposed herein.
上述具体实施方式，并不构成对本公开保护范围的限制。本领域技术人员应该明白的是，根据设计要求和其他因素，可以进行各种修改、组合、子组合和替代。任何在本公开的精神和原则之内所作的修改、等同替换和改进等，均应包含在本公开保护范围之内。The specific implementation manners described above do not limit the protection scope of the present disclosure. It should be apparent to those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present disclosure shall be included within the protection scope of the present disclosure.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110794124.1ACN113537043B (en) | 2021-07-14 | 2021-07-14 | Image processing method, device, electronic device and storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110794124.1ACN113537043B (en) | 2021-07-14 | 2021-07-14 | Image processing method, device, electronic device and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN113537043A CN113537043A (en) | 2021-10-22 |
| CN113537043Btrue CN113537043B (en) | 2023-08-18 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110794124.1AActiveCN113537043B (en) | 2021-07-14 | 2021-07-14 | Image processing method, device, electronic device and storage medium |
| Country | Link |
|---|---|
| CN (1) | CN113537043B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114511380A (en)* | 2022-01-25 | 2022-05-17 | 北京沃东天骏信息技术有限公司 | Method and apparatus for determining an attribute of an item |
| CN115223161A (en)* | 2022-07-15 | 2022-10-21 | 上海联影智能医疗科技有限公司 | Object recognition system and method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9916613B1 (en)* | 2014-06-26 | 2018-03-13 | Amazon Technologies, Inc. | Automatic color palette based recommendations for affiliated colors |
| CN108846792A (en)* | 2018-05-23 | 2018-11-20 | 腾讯科技（深圳）有限公司 | Image processing method, device, electronic equipment and computer-readable medium |
| US10242395B1 (en)* | 2015-04-30 | 2019-03-26 | Amazon Technologies, Inc. | Providing shopping links to items on a network page |
| CN112819767A (en)* | 2021-01-26 | 2021-05-18 | 北京百度网讯科技有限公司 | Image processing method, apparatus, device, storage medium, and program product |
| CN112905889A (en)* | 2021-03-03 | 2021-06-04 | 百度在线网络技术（北京）有限公司 | Clothing searching method and device, electronic equipment and medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9916613B1 (en)* | 2014-06-26 | 2018-03-13 | Amazon Technologies, Inc. | Automatic color palette based recommendations for affiliated colors |
| US10242395B1 (en)* | 2015-04-30 | 2019-03-26 | Amazon Technologies, Inc. | Providing shopping links to items on a network page |
| CN108846792A (en)* | 2018-05-23 | 2018-11-20 | 腾讯科技（深圳）有限公司 | Image processing method, device, electronic equipment and computer-readable medium |
| CN112819767A (en)* | 2021-01-26 | 2021-05-18 | 北京百度网讯科技有限公司 | Image processing method, apparatus, device, storage medium, and program product |
| CN112905889A (en)* | 2021-03-03 | 2021-06-04 | 百度在线网络技术（北京）有限公司 | Clothing searching method and device, electronic equipment and medium |
| Title |
|---|
| 周静.基于用户偏好和图像内容的服装个性化推荐研究.中国优秀硕士学位论文全文数据库.2021,(第2期),全文.* |
| Publication number | Publication date |
|---|---|
| CN113537043A (en) | 2021-10-22 |
| Publication | Publication Date | Title |
|---|---|---|
| US12088887B2 (en) | Display method and apparatus for item information, device, and computer-readable storage medium | |
| EP4062987A1 (en) | Method and apparatus for generating virtual character | |
| KR102668172B1 (en) | Identification of physical products for augmented reality experiences in messaging systems | |
| US12002160B2 (en) | Avatar generation method, apparatus and device, and medium | |
| US10019779B2 (en) | Browsing interface for item counterparts having different scales and lengths | |
| US10083521B1 (en) | Content recommendation based on color match | |
| US9607010B1 (en) | Techniques for shape-based search of content | |
| JP2023531264A (en) | Systems and methods for improved facial attribute classification and its use | |
| CN109409994A (en) | The methods, devices and systems of analog subscriber garments worn ornaments | |
| CN110147483A (en) | A kind of title method for reconstructing and device | |
| CN108846792A (en) | Image processing method, device, electronic equipment and computer-readable medium | |
| CN113362263A (en) | Method, apparatus, medium, and program product for changing the image of a virtual idol | |
| CN113537043B (en) | Image processing method, device, electronic device and storage medium | |
| CN114266621A (en) | Image processing method, image processing system and electronic device | |
| EP4209928A2 (en) | Method, apparatus and system for processing makeup, electronic device and storage medium | |
| CN112819767A (en) | Image processing method, apparatus, device, storage medium, and program product | |
| US11842457B2 (en) | Method for processing slider for virtual character, electronic device, and storage medium | |
| WO2025001846A1 (en) | Method and system for enhancing sense of reality of virtual model on basis of generative network | |
| CN112987932B (en) | Human-computer interaction and control method and device based on virtual image | |
| CN112084983B (en) | Hair style recommendation method based on ResNet and application thereof | |
| CN115619478A (en) | Method for wearing model and clothes based on neural network | |
| CN114648601A (en) | Virtual image generation method, electronic device, program product and user terminal | |
| CN114266782A (en) | Image processing method and system and electronic equipment | |
| CN111768334A (en) | A kind of face cartoon animation image design method | |
| US20250316044A1 (en) | Method of processing virtual avatar, electronic device, and storage medium |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |