CN113591594A - Weighing processing method and device and electronic equipment - Google Patents
Weighing processing method and device and electronic equipmentDownload PDFInfo
- Publication number
- CN113591594A CN113591594ACN202110765567.8ACN202110765567ACN113591594ACN 113591594 ACN113591594 ACN 113591594ACN 202110765567 ACN202110765567 ACN 202110765567ACN 113591594 ACN113591594 ACN 113591594A
- Authority
- CN
- China
- Prior art keywords
- visual
- commodity
- material information
- weighing
- visual material
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Library & Information Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Cash Registers Or Receiving Machines (AREA)
- Manipulator (AREA)
- General Factory Administration (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本申请涉及智能称重技术领域，特别是涉及称重处理方法、装置及电子设备。The present application relates to the technical field of intelligent weighing, and in particular, to a weighing processing method, device and electronic equipment.
背景技术Background technique
在实体店铺中使用智能称重设备进行称重时，可以通过设备中配备的视觉检测能力，对称重对象进行视觉特征采集，然后与数据库中保存的商品对象素材的视觉特征进行匹配，以此识别出当前的称重对象对应系统中的哪个具体的商品对象，进而可以确定出单价，并根据称重结果计算出应付金额。When using intelligent weighing equipment for weighing in a physical store, the visual detection capability of the equipment can be used to collect the visual features of the weighing object, and then match with the visual features of the commodity object material saved in the database to identify The current weighing object corresponds to which specific commodity object in the system, and then the unit price can be determined, and the payable amount can be calculated according to the weighing result.
可见，在上述智能称重过程中，商品对象素材的视觉特征用于对称重对象进行识别的重要依据，例如，具体的商品对象素材可以包括商品对象的照片等，具体的视觉特征可以包括颜色特征、形状/轮廓特征、纹理特征、空间关系特征，等等。但是，在实际应用中，经常会遇到视觉特征比较相似的商品对象。例如，同样是香蕉，但是不同品牌的香蕉对应着不同的商品对象，相应的，单价也是不同的，然而，不同品牌的香蕉在视觉特征方面可能具有很高的相似性。此时，在根据预先保存的商品对象素材对称重对象进行识别时，可能会存在无法确定具体对应着哪个商品对象的问题。针对该问题，现有技术中的处理方式是，将视觉特征相似的多个商品对象展示给称重操作者供其进行选择。也就是说，假设称重对象是香蕉，但是系统中存在两个品牌的香蕉，对应着不同的商品对象，此时，可以将两个商品对象都返回给称重操作者，由称重操作者从中进行选择。显然，这会增加称重操作者的工作量，称重效率比较低；并且由于称重操作者也只能通过肉眼观察或者结合自身经验做出判断，因此，也可能存在判断错误的情况，以至于造成消费者用户或者商家的损失。It can be seen that in the above intelligent weighing process, the visual features of the commodity object material are used as an important basis for identifying the weighing object. For example, the specific commodity object material may include photos of the commodity object, and the specific visual features may include color features. , shape/contour features, texture features, spatial relationship features, etc. However, in practical applications, commodity objects with similar visual features are often encountered. For example, the same bananas, but different brands of bananas correspond to different commodity objects, correspondingly, the unit prices are also different, however, different brands of bananas may have high similarity in visual characteristics. In this case, when recognizing the weighing object according to the pre-stored commodity object material, there may be a problem that it may not be possible to determine which commodity object corresponds to. In response to this problem, the prior art method is to display a plurality of commodity objects with similar visual characteristics to the weighing operator for selection. That is to say, assuming that the weighing object is bananas, but there are two brands of bananas in the system, corresponding to different commodity objects, at this time, both commodity objects can be returned to the weighing operator, and the weighing operator Choose from. Obviously, this will increase the workload of the weighing operator, and the weighing efficiency is relatively low; and since the weighing operator can only make judgments by visual observation or combined with his own experience, there may also be errors in judgment. As for the loss of consumers, users or businesses.
因此，针对存在视觉特征相似的多种商品对象的情况，如何进一步提升称重效率，降低对称重操作者主观判断力的依赖，成为需要本领域技术人员解决的技术问题。Therefore, in the case of multiple commodity objects with similar visual characteristics, how to further improve the weighing efficiency and reduce the dependence on the subjective judgment of the weighing operator has become a technical problem that needs to be solved by those skilled in the art.
发明内容SUMMARY OF THE INVENTION
本申请提供了称重处理方法、装置及电子设备，能够提升称重效率，降低对称重操作者主观判断力的依赖。The present application provides a weighing processing method, device and electronic equipment, which can improve the weighing efficiency and reduce the dependence on the subjective judgment of the weighing operator.
本申请提供了如下方案：This application provides the following solutions:
一种称重处理方法，其特征在于，包括：A weighing method, comprising:
获取商品对象视觉素材信息库，所述视觉素材信息库中包括商品对象对应的货品本体的第一视觉素材信息，以及附加标记的第二视觉素材信息；Acquiring a visual material information base of the commodity object, the visual material information base including the first visual material information of the commodity body corresponding to the commodity object, and the second visual material information of the additional mark;
对称重对象对应的货品本体以及附加标记进行视觉特征采集；Collect visual features of the product body and additional marks corresponding to the weighing object;
通过将所采集到的视觉特征信息与所述素材信息库中的视觉素材信息进行比对，对所述称重对象进行商品对象识别。By comparing the collected visual feature information with the visual material information in the material information library, commodity object recognition is performed on the weighing object.
其中，所述第二视觉素材信息是独立于所述第一视觉素材信息的视觉素材信息。Wherein, the second visual material information is visual material information independent of the first visual material information.
其中，同一商品对象对应的第一视觉素材信息以及第二视觉素材信息是在不同的时间点录入到所述视觉素材信息库中的。The first visual material information and the second visual material information corresponding to the same commodity object are entered into the visual material information database at different time points.
其中，同一商品对象对应的附加标记是非固定的；Among them, the additional marks corresponding to the same commodity object are not fixed;
所述方法还包括：The method also includes:
接收到为指定商品对象提交的新的第二视觉素材信息后，对所述指定商品对象与第二视觉素材信息之间的对应关系进行更新。After receiving the new second visual material information submitted for the specified commodity object, the corresponding relationship between the specified commodity object and the second visual material information is updated.
其中，所述附加标记用于对所述第一视觉素材信息进行增强，第一视觉素材信息相似的多个商品对象对应不同的附加标记，以便对所述第一视觉素材信息相似的多个商品对象进行区分识别。Wherein, the additional mark is used to enhance the first visual material information, and multiple commodity objects with similar first visual material information correspond to different additional marks, so as to enhance the information of the first visual material for multiple commodities with similar first visual material information Objects are distinguished.
其中，所述第一视觉素材信息相似的多个商品对象对应的不同附加标记，在同一视觉特征维度上具有不同的特征值；Wherein, different additional marks corresponding to a plurality of commodity objects with similar first visual material information have different feature values in the same visual feature dimension;
所述对称重对象对应的货品本体以及附加标记进行视觉特征采集，包括：The visual feature collection of the product body and the additional mark corresponding to the weighing object includes:
在采集所述称重对象对应的附加标记的视觉特征信息时，仅从所述同一视觉特征维度上对所述附加标记进行视觉特征采集；When collecting the visual feature information of the additional mark corresponding to the weighing object, only perform visual feature collection on the additional mark from the same visual feature dimension;
所述对所述称重对象进行商品对象识别，包括：The performing commodity object identification on the weighing object includes:
通过将货品本体的视觉特征与所述视觉素材信息库中的第一视觉素材信息进行对比，确定匹配的多个商品对象；Determine a plurality of matching commodity objects by comparing the visual features of the commodity ontology with the first visual material information in the visual material information database;
通过从所述同一视觉特征维度上采集到的附加标记的特征，与所述多个商品对象对应的第二视觉素材信息进行对比，确定与所述称重对象匹配的目标商品对象识别。By comparing the additional marked features collected from the same visual feature dimension with the second visual material information corresponding to the multiple commodity objects, the identification of the target commodity object matching the weighing object is determined.
其中，所述第一视觉素材信息相似的多个商品对象对应的不同附加标记，具有不同的颜色、形状或编号。Wherein, the different additional marks corresponding to the plurality of commodity objects with similar first visual material information have different colors, shapes or numbers.
其中，相同的附加标记可在第一视觉素材信息不相似的不同商品对象之间复用。Wherein, the same additional mark can be reused among different commodity objects with dissimilar first visual material information.
其中，所述附加标记用于贴附或绘制在所述货品本体上，或者，放置在用于堆放所述货品本体的货架上，或者，铺设在用于承载称重对象的容器内。Wherein, the additional mark is used to be attached or drawn on the commodity body, or placed on a shelf for stacking the commodity body, or laid in a container for carrying a weighing object.
其中，所述对所述称重对象进行商品对象识别，包括：Wherein, performing commodity object identification on the weighing object includes:
将所采集到的称重对象对应的货品本体的视觉特征与所述视觉素材信息库中的第一视觉素材信息进行比对，确定相匹配的商品对象；Comparing the collected visual features of the product body corresponding to the weighing object with the first visual material information in the visual material information library to determine the matching product object;
如果所述相匹配的商品对象为多个，则根据所述相匹配的多个商品对象对应的第二视觉素材信息，提供商品对象识别结果。If there are multiple matching commodity objects, a commodity object recognition result is provided according to the second visual material information corresponding to the multiple matching commodity objects.
其中，所述根据所述相匹配的多个商品对象对应的第二视觉素材信息，提供商品对象识别结果，包括：Wherein, according to the second visual material information corresponding to the plurality of matched commodity objects, providing the commodity object recognition result includes:
将所采集到的附加标记的视觉特征与所述多个商品对象对应的第二视觉素材信息进行比对，确定相匹配的目标商品对象；Comparing the collected visual features of the additional mark with the second visual material information corresponding to the plurality of commodity objects to determine a matching target commodity object;
或者，or,
将所述相匹配的多个商品对象进行展示，并将所述多个商品对象分别对应的第二视觉素材信息进行增强展示，以便称重操作者根据所述第二视觉素材信息对所述多个商品对象进行选择。Displaying the multiple matching commodity objects, and enhancing the display of the second visual material information corresponding to the multiple commodity objects respectively, so that the weighing operator can evaluate the multiple commodity objects according to the second visual material information. item object to select.
一种商品对象素材信息处理方法，包括：A method for processing commodity object material information, comprising:
提供用于为商品对象提交附加标记相关视觉素材的操作选项；Provides action options for submitting additional markup related visuals for item objects;
通过所述操作选项接收到为目标商品对象相关的附加标记的视觉素材后，保存到商品对象视觉素材信息库中，以用于在对称重对象进行商品对象识别时，通过将采集到的视觉特征信息与所述视觉素材信息库中的视觉素材信息进行比对的方式，确定与所述称重对象匹配的商品对象，其中，所采集到的视觉特征信息包括：所述称重对象相关的附加标记的视觉特征信息。After receiving the additionally marked visual material related to the target commodity object through the operation option, it is saved in the commodity object visual material information database, so that when the commodity object is recognized for the weighing object, the collected visual features The method of comparing the information with the visual material information in the visual material information database, to determine the commodity object that matches the weighing object, wherein the collected visual feature information includes: additional information related to the weighing object Labeled visual feature information.
其中，还包括：Among them, it also includes:
对同类目下的多个商品对象对应的货品本体的视觉素材信息进行相似度比对，如果相似度达到目标阈值，则提供为所述多个商品对象提交附加标记相关视觉素材信息的提示信息。Comparing the visual material information of the commodity body corresponding to multiple commodity objects under the same category is performed, and if the similarity reaches the target threshold, prompt information for submitting additional marking related visual material information for the multiple commodity objects is provided.
一种称重处理装置，包括：A weighing processing device, comprising:
视觉素材信息库获取单元，用于获取商品对象视觉素材信息库，所述视觉素材信息库中包括商品对象对应的货品本体的第一视觉素材信息，以及附加标记的第二视觉素材信息；a visual material information library acquisition unit, configured to acquire a visual material information library of a commodity object, the visual material information library including first visual material information of the commodity body corresponding to the commodity object, and second visual material information with additional marks;
视觉特征采集单元，用于对称重对象对应的货品本体以及附加标记进行视觉特征采集；The visual feature acquisition unit is used for visual feature acquisition of the product body and additional marks corresponding to the weighing object;
称重对象识别单元，用于通过将所采集到的视觉特征信息与所述素材信息库中的视觉素材信息进行比对，对所述称重对象进行商品对象识别。The weighing object recognition unit is configured to perform commodity object recognition on the weighing object by comparing the collected visual feature information with the visual material information in the material information library.
一种商品对象素材信息处理装置，包括：A commodity object material information processing device, comprising:
操作选项提供单元，用于提供用于为商品对象提交附加标记相关视觉素材的操作选项；The operation option providing unit is used to provide operation options for submitting additional markup related visual material for the commodity object;
视觉素材接收单元，用于通过所述操作选项接收到为目标商品对象相关的附加标记的视觉素材后，保存到商品对象视觉素材信息库中，以用于在对称重对象进行商品对象识别时，通过将采集到的视觉特征信息与所述视觉素材信息库中的视觉素材信息进行比对的方式，确定与所述称重对象匹配的商品对象，其中，所采集到的视觉特征信息包括：所述称重对象相关的附加标记的视觉特征信息。The visual material receiving unit is configured to, after receiving the additional marked visual material related to the target commodity object through the operation option, save it in the commodity object visual material information database, so as to be used for commodity object recognition on the weighing object, By comparing the collected visual feature information with the visual material information in the visual material information library, a commodity object matching the weighing object is determined, wherein the collected visual feature information includes: Describe the visual feature information of the additional mark related to the weighing object.
一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现前述任一项所述的方法的步骤。A computer-readable storage medium having a computer program stored thereon, the program implementing the steps of any of the foregoing methods when executed by a processor.
一种电子设备，包括：An electronic device comprising:
一个或多个处理器；以及one or more processors; and
与所述一个或多个处理器关联的存储器，所述存储器用于存储程序指令,所述程序指令在被所述一个或多个处理器读取执行时，执行前述任一项所述的方法的步骤。memory associated with the one or more processors for storing program instructions that, when read and executed by the one or more processors, perform the method of any preceding item A step of.
根据本申请提供的具体实施例，本申请公开了以下技术效果：According to the specific embodiments provided by the application, the application discloses the following technical effects:
通过本申请实施例，可以在商品对象视觉素材信息库中保存货品本体的第一视觉素材信息的基础上，增加附加标记的第二视觉素材信息。这样，在对称重对象进行视觉识别时，可以采集称重对象对应的货品本体以及附加标记两方面的视觉特征，并通过与素材库中保存的第一视觉素材信息以及第二视觉素材信息，提供识别结果。通过这种方式，可以帮助快速、准确地识别称重对象对应的商品对象，提升称重效率，并且可以降低对称重操作者主观判断力的依赖。Through the embodiment of the present application, on the basis of saving the first visual material information of the commodity body in the commodity object visual material information database, the second visual material information with additional marks can be added. In this way, when visually recognizing the weighing object, the visual features of the product body and the additional mark corresponding to the weighing object can be collected, and the first visual material information and the second visual material information saved in the material library can be used to provide Identify the results. In this way, the commodity object corresponding to the weighing object can be quickly and accurately identified, the weighing efficiency can be improved, and the dependence on the subjective judgment of the weighing operator can be reduced.
当然，实施本申请的任一产品并不一定需要同时达到以上所述的所有优点。Of course, implementing any product of the present application does not necessarily need to achieve all of the advantages described above at the same time.
附图说明Description of drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the accompanying drawings required in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some of the present application. In the embodiments, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without any creative effort.
图1是本申请实施例提供的系统架构的示意图；1 is a schematic diagram of a system architecture provided by an embodiment of the present application;
图2是本申请实施例提供的第一方法的流程图；2 is a flowchart of a first method provided by an embodiment of the present application;
图3是本申请实施例提供的第二方法的流程图；3 is a flowchart of a second method provided by an embodiment of the present application;
图4是本申请实施例提供的第一装置的示意图；4 is a schematic diagram of a first device provided by an embodiment of the present application;
图5是本申请实施例提供的第二装置的示意图；5 is a schematic diagram of a second device provided by an embodiment of the present application;
图6是本申请实施例提供的电子设备的示意图。FIG. 6 is a schematic diagram of an electronic device provided by an embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员所获得的所有其他实施例，都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art fall within the protection scope of this application.
本申请发明人在实现本申请的过程中发现，有些商品对象虽然具体的货品本体在视觉素材方面存在相似性，例如，不同品牌的香蕉具有相似的果形、颜色、大小，等等，但是，具体的货品还可能会关联有一些附加标识物料，并且，在不同的商品对象之间，这种附加标识物料在视觉上会存在一些差异。例如，同样是两个不同品牌的香蕉，由于其中一个品牌的香蕉带有“果标”(贴附在果体上的标签等，用于展示出具体的品牌标识(例如，logo等))，因此，可以与另一个不带“果标”的品牌区分开来，等等。当然，除了“果标”之外，还可以通过为具体的商品对象提供专门用于进行视觉识别的附加标记等方式，实现对不同商品对象对应的货品本体的视觉特征的增强。In the process of realizing the present application, the inventor of the present application found that although some commodity objects have similarities in the visual material of the specific commodity body, for example, bananas of different brands have similar fruit shapes, colors, sizes, etc., but, A specific item may also be associated with some additional identification materials, and among different commodity objects, there may be some visual differences in this additional identification material. For example, the same two different brands of bananas, because one brand of bananas has a "fruit label" (a label attached to the fruit body, etc., used to display a specific brand identity (for example, logo, etc.)), Therefore, it can be distinguished from another brand that does not carry a "fruit mark", etc. Of course, in addition to the "fruit mark", the visual features of the product body corresponding to different product objects can also be enhanced by providing additional marks for specific product objects specifically for visual identification.
因此，在本申请实施例中，在商品对象视觉素材库中，除了可以保存具体商品对象对应的货品本体的视觉素材，还可以对商品对象关联的附加标识物料的视觉素材进行保存。这样，在对称重对象进行商品对象识别时，除了可以采集称重对象对应的货品本体的视觉特征，还可以对具体附加标识物料的视觉特征进行采集。如果存在货品本体视觉特征相似的多个商品对象，则还可以通过这种附加标识物料来实现对相似商品对象的识别及分辨。Therefore, in the embodiment of the present application, in the commodity object visual material library, in addition to the visual material of the commodity body corresponding to the specific commodity object, the visual material of the additional identification material associated with the commodity object can also be saved. In this way, when the commodity object recognition is performed on the weighing object, in addition to the visual features of the commodity body corresponding to the weighing object, the visual features of the specific additional identification materials can also be collected. If there are multiple commodity objects with similar visual characteristics of the commodity ontology, the identification and discrimination of similar commodity objects can also be realized by this additional identification material.
当然，在具体实现时，除了以“果标”作为具体的附加标识之外，还可以有其他方式，例如，还可以包括其他能够附着(例如，贴附或者绘制等)在货品本体上的标记，或者，可以放置在“堆头”等用于堆放具体货品的货架上的标记物料，或者，还可以包括在托盘等器皿中铺设的标记物料(具体的称重对象放在该这种器皿中，再与器皿一起放到称重设备上进行称重)，等等。总之，这种附加标记可以伴随货品本体一起被称重设备的视觉采集装置采集到，并且在不同商品对象之间，在视觉特征方面可以具有一定的区分度。Of course, in the specific implementation, in addition to the "fruit mark" as a specific additional mark, there may also be other ways, for example, other marks that can be attached (for example, attached or drawn, etc.) on the product body may also be included , or, marking materials that can be placed on shelves such as "stacking heads" for stacking specific goods, or can also include marking materials laid in containers such as pallets (the specific weighing object is placed in the container). , and then put it on the weighing equipment together with the utensils for weighing), and so on. In a word, this additional mark can be collected by the visual acquisition device of the weighing equipment together with the commodity body, and can have a certain degree of discrimination in terms of visual features among different commodity objects.
需要说明的是，本申请实施例涉及到如下几个概念：商品对象、称重对象、货品、货品本体，为便于理解，下面首先对这几个概念的含义进行介绍。It should be noted that the embodiments of the present application involve the following concepts: commodity object, weighing object, commodity, and commodity body. For ease of understanding, the meanings of these concepts are first introduced below.
商品对象主要是指在具体的信息系统从数据层面对具体商品的表达。例如，某个商家向某个信息系统中发布了一款商品，相应的，该信息系统就可以生成对应的商品对象，还可以为其提供系统内的唯一性标识，包括商品ID，等等。另外，在信息系统中，具体的商品对象还可以关联有多种属性信息，包括价格、单价等等。The commodity object mainly refers to the expression of the specific commodity from the data level in the specific information system. For example, a merchant publishes a commodity to an information system, and accordingly, the information system can generate a corresponding commodity object, and can also provide it with a unique identifier in the system, including commodity ID, and so on. In addition, in the information system, a specific commodity object may also be associated with various attribute information, including price, unit price, and the like.
货品，信息系统中发布的商品对象在具体实体店铺中对应着具体的物理实体，这种物理实体就可以是本申请实施例中所述的“货品”，例如，信息系统中ID为“1000012”的商品对象，在实体店铺中对应的货品是某个品牌的“香蕉”。货品是有形、有重量的，具体的商品对象关联的视觉素材，就是通过对这种货品进行拍照等方式进行采集的。Goods, the commodity object published in the information system corresponds to a specific physical entity in a specific physical store, and this physical entity can be the "goods" described in the embodiments of this application, for example, the ID in the information system is "1000012" The product object of , the corresponding product in the physical store is a certain brand of "banana". Goods are tangible and weighty, and the visual materials associated with specific commodity objects are collected by taking pictures of such goods.
货品本体，也就是具体的货品本身，例如，香蕉的果体本身，等等。The product itself, that is, the specific product itself, for example, the fruit body of the banana itself, and so on.
称重对象，是指放置在称重设备上进行称重的对象，也就是说，实际放置到称重对象上的是实体店铺中的货品，通过智能称重设备对货品进行视觉特征采集(本申请实施例中，具体包括对货品本体以及附加标记素材的视觉素材采集)，并与素材库中的素材进行比对，确定出对应的商品对象，以此实现对称重对象的商品对象识别。The weighing object refers to the object placed on the weighing device for weighing, that is to say, the goods in the physical store are actually placed on the weighing object, and the visual features of the goods are collected by the intelligent weighing device (this In the application example, it specifically includes visual material collection of the product body and additional marking materials), and comparing with the materials in the material library to determine the corresponding commodity object, so as to realize the commodity object recognition of the weighing object.
从系统架构角度而言，如图1所示，本申请实施例可以涉及到智能称重设备，该智能称重设备可以包括硬件部分以及软件部分，其中，软件部分还可以分为客户端以及服务端，客户端运行于称重设备终端，服务端则可以运行于云端服务器中。具体的视觉素材可以保存在服务端的素材数据库中，客户端则用于对称重对象的视觉特征进行采集，并上传到服务端，由服务端识别出对应的商品对象信息后，返回给客户端，客户端则可以将识别结果通过称重设备关联的显示屏进行展示。当然，在另一种实现方式下，具体的素材数据库也可以保存在称重设备本地，因此，可以在称重设备本地进行商品对象识别。From the perspective of system architecture, as shown in FIG. 1 , an embodiment of the present application may involve an intelligent weighing device, and the intelligent weighing device may include a hardware part and a software part, wherein the software part may also be divided into a client and a service The client runs on the weighing equipment terminal, and the server runs on the cloud server. The specific visual material can be stored in the material database of the server, and the client is used to collect the visual features of the weighing object and upload it to the server. After the server recognizes the corresponding commodity object information, it returns to the client. The client can display the identification result through the display screen associated with the weighing device. Of course, in another implementation manner, the specific material database may also be stored locally on the weighing device, so commodity object recognition may be performed locally on the weighing device.
其中，在本申请实施例中，具体的素材数据库中保存的素材信息可以包括货品本体的视觉素材，还可以包括关联的附加标记的视觉素材。在具体实现时，具体的视觉素材可以由商家(例如，具体实体店铺中的店长等)提供，为此，还可以为商家用户提供工作台，使其可以对具体的视觉素材进行上传以及更新、编辑等处理。Wherein, in the embodiment of the present application, the material information stored in the specific material database may include the visual material of the product body, and may also include the associated visual material with additional marks. During specific implementation, specific visual materials can be provided by merchants (for example, store managers in specific physical stores, etc.), and for this purpose, a workbench can also be provided for merchant users, enabling them to upload and update specific visual materials , editing, etc.
此外，在实际应用中，在具体向消费者用户提供商品对象信息时，也可以利用具体素材数据库中保存的素材信息为消费者用户提供更丰富的信息，以帮助消费者用户进行商品对象的选择或者购买决策。In addition, in practical applications, when the commodity object information is specifically provided to the consumer user, the material information saved in the specific material database can also be used to provide the consumer user with more abundant information, so as to help the consumer user to select the commodity object. or purchasing decisions.
下面对本申请实施例提供的具体技术方案进行详细介绍。The specific technical solutions provided by the embodiments of the present application are described in detail below.
实施例一Example 1
首先，该实施例一从称重设备的角度，提供了一种称重处理方法，具体的，该方法的执行主体可以是图1所示的服务端或者客户端，参见图2，该方法可以包括：First, the first embodiment provides a weighing processing method from the perspective of weighing equipment. Specifically, the execution body of the method may be the server or client shown in FIG. 1 . Referring to FIG. 2 , the method may be include:
S201：获取商品对象视觉素材信息库，所述视觉素材信息库中包括商品对象对应的货品本体的第一视觉素材信息，以及相关的附加标记的第二视觉素材信息。S201: Acquire a commodity object visual material information library, where the visual material information library includes first visual material information of the commodity body corresponding to the commodity object and related second visual material information with additional marks.
具体的视觉素材就是用于通过视觉检测的方式对称重对象进行识别的素材，在现有技术中，通常仅在素材库中保存商品对象对应的货品本体的视觉素材信息，包括商家上传的货品本体的照片等。而在本申请实施例中，为了便于对外观相似的商品对象进行进一步的识别或者分辨，还可以在素材库中保存这种商品对象对应的附加标记的视觉素材信息。具体的，这种附加标记的视觉素材信息也可以是由商家进行提交的，例如，商家(例如，实体店铺中的工作人员等)可以对具体商品对象相关的附加标记进行拍照，并录入到视觉素材信息库中。The specific visual material is the material used to identify the weighing object through visual detection. In the prior art, usually only the visual material information of the product body corresponding to the product object is stored in the material library, including the product body uploaded by the merchant. photos, etc. In the embodiment of the present application, in order to facilitate further identification or discrimination of commodity objects with similar appearances, visual material information of additional marks corresponding to such commodity objects may also be stored in the material library. Specifically, the visual material information of the additional mark can also be submitted by the merchant. For example, the merchant (for example, the staff in the physical store, etc.) can take a picture of the additional mark related to the specific commodity object and enter it into the visual material in the material repository.
这里需要说明的是，由于具体的称重场景通常是发生在实体店铺中，不同的实体店铺中可能存在售卖的商品对象不同，或者，同一商品对象可能对应了不同的附加标记等情况，因此，关于具体的视觉素材库，可以以实体店铺为单位进行创建以及维护，也即，每个实体店铺可以有各自的视觉素材信息库。当然，在另一种方式下，如果存在连锁店铺等情况，不同的实体店铺之间可能统一售卖相同的商品对象，并且相同的商品对象也统一使用相同的附加标记，则也可以多个实体店铺共用同一视觉素材信息库。或者，也可能存在不同的实体店铺之间，在商品对象或者附加标记方面存在部分相同、部分存在差异的情况，此时，也同样可以在多个实体店铺之间共用相同的视觉素材信息库，其中，对于存在差异的部分，可以通过关联对应的实体店铺标识等方式，确定适用的实体店铺范围，等等。It should be noted here that since the specific weighing scene usually occurs in a physical store, there may be different commodity objects sold in different physical stores, or the same commodity object may correspond to different additional marks, etc. Therefore, The specific visual material library can be created and maintained in units of physical stores, that is, each physical store can have its own visual material information library. Of course, in another way, if there are chain stores, etc., different physical stores may sell the same commodity objects uniformly, and the same commodity objects also uniformly use the same additional mark, then multiple physical stores can also uniformly sell the same commodity objects. Share the same visual material repository. Alternatively, there may be cases where some of the product objects or additional marks are the same and some are different between different physical stores. In this case, the same visual material information library can also be shared among multiple physical stores. Among them, for the parts with differences, the applicable physical store scope can be determined by associating the corresponding physical store identifiers, and so on.
其中，在具体实现时，可以为商家用户提供工作台，使其可以对具体附加标记的视觉素材进行上传、更新或者编辑操作。具体的，对于同一商品对象关联的货品本体的第一视觉素材信息，以及附加标记的第二视觉素材信息，两者之间可以时相互独立的，可以一起录入到视觉素材信息库中，或者，还可以分别在不同的时间录入到视觉素材信息库中。例如，商家最初只上传了各个商品对象对应的货品本体的第一视觉素材信息，之后发现有些商品对象的货品本体之间很相似，以至于难以区分，于是可以为这些相似商品对象上传与附加标记相关的视觉素材信息，等等。也就是说，具体与附加标记相关的视觉素材，可以与货品本体的视觉素材相独立，同一商品对象在素材信息库中可以对应两份视觉素材信息，分别与货品本体以及附加标记相对应。这两份视觉素材信息，可以用于快速识别及分辨在货品本体外观上相似的多个商品对象。Among them, in the specific implementation, a workbench can be provided for the merchant user, so that the user can upload, update or edit the visual material with the specific additional mark. Specifically, for the first visual material information of the commodity body associated with the same commodity object, and the second visual material information of the additional mark, the two may be independent of each other, and may be entered into the visual material information database together, or, It can also be entered into the visual material information library at different times. For example, the merchant initially only uploaded the first visual material information of the product body corresponding to each product object, and later found that the product body of some product objects was so similar that it was difficult to distinguish them, so they could upload and attach tags for these similar product objects. Related visual material information, etc. That is to say, the visual material specifically related to the additional mark can be independent of the visual material of the product body, and the same product object can correspond to two pieces of visual material information in the material information database, respectively corresponding to the product body and the additional mark. The two pieces of visual material information can be used to quickly identify and distinguish multiple commodity objects that are similar in appearance to the commodity body.
其中，具体的附加标记可以有多种，例如，如前文所述，可以包括货品本体上附着的附加标记(例如，果标等)，或者，在用于堆放货品的货架上放置的附加标记(例如，堆头放置的价签等)，或者，在用于承载称重对象的容器内铺设的附加标记(例如，草莓等果形比较小的水果，虽然也是散装称重的非标品，但是可能会预先用提篮、盆等容器进行包装，只是每个容器内的水果重量不等，需要具体称重后确定价格，这种容器也可能会带有一些垫纸等，此时，这种垫纸也可以成为本申请实施例中的附加标记)，等等。具体实现时，可以由商家通过拍照等方式采集这种附加标记的视觉素材，并提交到系统中。There may be various specific additional marks, for example, as mentioned above, it may include additional marks attached to the main body of the goods (for example, fruit marks, etc.), or additional marks placed on the shelves for stacking goods ( For example, the price tag placed on the pile head, etc.), or an additional mark laid in the container used to carry the weighing object (for example, strawberries and other small fruits, although they are also non-standard products for bulk weighing, but It may be pre-packaged in containers such as baskets and basins, but the weight of the fruit in each container varies, and the price needs to be determined after specific weighing. This kind of container may also have some paper pads, etc. Paper can also be an additional mark in the embodiments of this application), and so on. In the specific implementation, the visual material with the additional mark can be collected by the businessman by taking pictures, etc., and submitted to the system.
这里需要说明的是，关于具体的果标、容器中的垫纸等，通常是由商品对象的品牌方提供的，具体的标记的视觉特征可能会比较复杂，甚至可能直接包括具体的商标图样等信息，以至于能够直接根据这种附加标记的视觉特征，识别出具体的商品对象。例如，某品牌的苹果，每个苹果果体上可能都贴有果标，该果标中带有该品牌的商标图样，因此，即使不依赖苹果果体的视觉特征，也能够通过该果标识别出对应的称重是苹果，并能够与其他品牌的苹果相区别，等等。It should be noted here that the specific fruit labels, the pads in the containers, etc. are usually provided by the brand side of the commodity object. The visual characteristics of the specific marks may be complicated, and may even directly include specific trademark patterns, etc. information, so that specific commodity objects can be identified directly according to the visual features of this additional mark. For example, a certain brand of apples may have a fruit label on each apple body, and the fruit label bears the brand's trademark pattern. Therefore, even without relying on the visual characteristics of the apple body, it can pass the fruit label. Recognize that the corresponding weight is an apple, and be able to distinguish it from apples of other brands, and so on.
上述将果标等作为附加标记时，具有区分度比较高的特点，但是，在实际应用中，由于果标等附加标记的视觉特征比较复杂，因此，在对这种附加标记进行特征采集以及后续的对比时，对计算资源的要求都会比较高，甚至需要比较长的计算耗时。而本申请实施例是在智能称重场景中进行商品对象识别，智能称重设备本身的计算资源可能会比较有限，同时对计算耗时的容忍度又比较低，因此，如果直接使用这种果标作为附加标记，可能会降低称重效率。When the fruit mark is used as the additional mark, it has the characteristics of relatively high discrimination. However, in practical applications, because the visual features of the fruit mark and other additional marks are relatively complex, it is necessary to perform feature collection and follow-up on such additional marks. When compared, the requirements for computing resources will be relatively high, and even a relatively long computing time will be required. However, in the embodiment of the present application, commodity object recognition is performed in an intelligent weighing scene. The computing resources of the intelligent weighing device itself may be relatively limited, and the tolerance for time-consuming calculation is relatively low. Therefore, if this kind of effect is directly used mark as an additional mark, which may reduce weighing efficiency.
为此，在更为优选的实施方式中，还可以为商品对象提供专门用于在称重过程中进行视觉识别的附加标记，这种附加标记可以用于对货品本体的第一视觉素材信息进行增强，通过为第一视觉素材信息相似的多个商品对象对应不同的附加标记，实现对所述第一视觉素材信息相似的多个商品对象进行区分识别。也就是说，可以通过货品本体的视觉特征进行商品对象的初步筛选，再通过附加标记的视觉特征进一步从初步筛选结果中确定出匹配的商品对象。To this end, in a more preferred embodiment, an additional mark specially used for visual identification during the weighing process can also be provided for the commodity object. Enhancement, by corresponding to different additional marks for a plurality of commodity objects with similar first visual material information, it is possible to distinguish and identify a plurality of commodity objects with similar first visual material information. That is to say, the commodity objects can be preliminarily screened by the visual features of the commodity body, and then the matching commodity objects can be further determined from the preliminary screening results by the visual features of the additional mark.
在这种实现方式下，具体的附加标记可以具有比较简单的视觉特征，例如，对于在货品本体的视觉特征方面比较容易混淆的多个商品对象，可以使用不同颜色、不同形状、不同编号附加标记。这种附加标记的具体形式也可以有多种，例如，可以是贴纸，甚至还可以是用记号笔绘制的颜色或者图案，等等。例如，某门店中存在三种容易在外观上混淆的苹果，此时，为了便于在称重时进行区分，可以为这三种苹果分别贴上红色、绿色和黄色的贴纸，以此作为各自的附加标记。这样，在称重时，可以通过识别具体附加标记的颜色，来区分出具体是哪种苹果。In this implementation manner, specific additional marks may have relatively simple visual features. For example, for multiple commodity objects that are easily confused in terms of the visual features of the product body, additional marks of different colors, shapes and numbers may be used. . There may also be various specific forms of this additional mark, for example, it may be a sticker, or even a color or pattern drawn with a marker, and so on. For example, there are three kinds of apples in a store that are easy to be confused in appearance. At this time, in order to facilitate the distinction during weighing, red, green and yellow stickers can be attached to these three kinds of apples as their respective labels. Additional markup. In this way, when weighing, it is possible to distinguish the specific apple by identifying the color of the specific additional mark.
也就是说，对于第一视觉素材信息相似的多个商品对象可以对应不同的附加标记，这些附加标记可以在同一视觉特征维度上具有不同的特征值。例如，前文所述的颜色、形状、编号等。这样，在对称重对象的附加标记进行特征采集时，可以仅从该同一视觉特征维度上进行视觉特征的采集即可，后续在进行特征比对时，可以利用第一视觉素材信息，初步识别出多个可能的商品对象，然后，再从该同一视觉特征维度上进行比对的方式，对附加标记的特征与第二视觉素材信息进行对比，以此确定出具体与当前称重对象匹配的商品对象。通过这种方式，可以使得特征采集以及比对过程得到简化。That is to say, multiple commodity objects with similar first visual material information may correspond to different additional marks, and these additional marks may have different feature values on the same visual feature dimension. For example, the colors, shapes, numbers, etc. previously described. In this way, when the feature collection is performed on the additional mark of the weighted object, the visual feature can only be collected from the same visual feature dimension, and the first visual material information can be used to preliminarily identify the feature in the subsequent feature comparison. There are multiple possible commodity objects, and then, by comparing the same visual feature dimension, the additionally marked features are compared with the second visual material information, so as to determine the specific commodity that matches the current weighing object. object. In this way, the process of feature collection and comparison can be simplified.
在通过专门添加的简单的附加标记对称重对象进行商品对象识别的方式中，由于附加标记仅用于在基于货品本体的视觉特征进行比对后，从初步确定的多个商品对象中，进行进一步的区分。因此，还可以实现相同的附加标记在第一视觉素材信息不相似的不同商品对象之间的复用。例如，某门店中三种容易混淆的苹果可以使用红色、绿色以及黄色三种不同颜色的贴纸作为附加标记，在进行称重时，首先通过称重对象本身的视觉特征，识别出可能是三种苹果，之后，再通过称重对象关联的附加标记的颜色，便可以进一步确定出是上述三种苹果中的具体哪一种。另外，该门店中还存在容易混淆的三种香蕉，由于香蕉本体的视觉特征与苹果具有明显的区别，因此，则这三种香蕉也同样可以使用红色、绿色以及黄色三种不同颜色的贴纸作为附加标记，等等。In the method of recognizing the weighing object by adding a simple additional mark, since the additional mark is only used to carry out further identification from the preliminarily determined multiple commodity objects after the comparison based on the visual features of the product body distinction. Therefore, it is also possible to realize the multiplexing of the same additional mark among different commodity objects with dissimilar first visual material information. For example, three kinds of apples that are easily confused in a store can use red, green and yellow stickers as additional markings. Apple, and then, through the color of the additional mark associated with the weighing object, it can be further determined which of the above three kinds of apples is. In addition, there are three kinds of bananas that are easy to be confused in the store. Since the visual characteristics of the banana itself are obviously different from that of the apple, the three kinds of bananas can also use red, green and yellow stickers as Additional markers, etc.
另外，在具体实现时，同一商品对象对应的附加标记可以是非固定的。例如，在前述通过单一颜色的贴纸作为附加标记的情况下，某品牌苹果在第一天使用黄色贴纸作为附加标记，第二天还可以使用绿色作为附加标记，等等，只要确保在同一时间段内，货品本体的视觉特征相似的多个商品对象具有不同的附加标记即可。In addition, during specific implementation, the additional marks corresponding to the same commodity object may be non-fixed. For example, in the aforementioned case of using a single-color sticker as an additional mark, a certain brand of Apple uses a yellow sticker as an additional mark on the first day, and green as an additional mark on the second day, and so on, as long as the same time period is ensured. It is sufficient that multiple commodity objects with similar visual features of the commodity body have different additional marks.
也就是说，视觉素材信息库中保存的具体商品对象的第二视觉素材信息，是具体商品对象当前正在使用的附加标记对应的视觉素材信息。在具体商品对象的附加标记发生变化时，还可以由具体的商家通过前述工作台，实现对商品对象对应的第二视觉素材信息的更新。也就是说，具体在接收到为指定商品对象提交的新的第二视觉素材信息后，可以对所述指定商品对象与第二视觉素材信息之间的对应关系进行更新。That is to say, the second visual material information of the specific commodity object stored in the visual material information database is the visual material information corresponding to the additional mark currently being used by the specific commodity object. When the additional mark of the specific commodity object changes, the specific merchant may also use the aforementioned workbench to update the second visual material information corresponding to the commodity object. That is to say, after receiving the new second visual material information submitted for the specified commodity object, the corresponding relationship between the specified commodity object and the second visual material information may be updated.
需要说明的是，在实际应用中，并不需要为全部商品对象都提供附加标记相关的视觉素材，而是只有在货品本体的视觉素材上存在相似性的商品对象，可以通过附加标记相关的视觉素材进行进一步的识别或者分辨。因此，可以根据具体的需求选择性地为部分商品对象通过附加标记相关的视觉素材信息。并且，在可选的实施方式中，还可以由服务端等对不同商品对象关联的货品本体的视觉素材之间的相似度进行计算，如果发现某些商品对象在货品本体的视觉素材上存在相似性，可能出现无法分辨或者识别错误等情况，则可以向关联的商家用户进行提示，提示其为这些商品对象补充附加标记相关的视觉素材信息，等等。It should be noted that, in practical applications, it is not necessary to provide visual materials related to additional marks for all commodity objects. The material is further identified or distinguished. Therefore, some commodity objects can be selectively marked with related visual material information according to specific requirements. Moreover, in an optional embodiment, the server can also calculate the similarity between the visual materials of the product body associated with different commodity objects, if it is found that some commodity objects are similar in the visual materials of the product body. If there is a possibility of inability to distinguish or identify errors, etc., the associated merchant user can be prompted to add visual material information related to additional markings for these commodity objects, and so on.
S202：对称重对象对应的货品本体以及相关的附加标记进行视觉特征采集。S202: Perform visual feature collection on the product body corresponding to the weighing object and related additional marks.
由于在素材信息库中对货品本体以及附加标记的视觉素材进行了保存，因此，在具体使用智能称重设备对货品进行称重时，可以对称重对象对应的货品本体以及相关的附加标记进行视觉特征采集。其中，具体实现时，为了便于对两者进行视觉特征采集，可以在将称重对象对应的货品本体放置到称重设备的称台时，将附加标记也同时放置到称台上，使得附加标记也进入到称重设备的视觉检测装置的检测范围。其中，如果具体的附加标记为贴附在货品本体上，或者是铺设在具体容器中等，则自然可以满足该条件。如果附加标记是放置在“堆头”等货架上的价签等，则也可以在将称重对象放置到称台上时，另外将这种价签也放置到称台上，以使得其视觉特征能够被称重设备的视觉检测装置检测到。由于这种价签等多数是以“纸牌”等形式存在，因此其重量对称重对象的重量造成的影响几乎可以忽略不记。当然，如果具体的附加标记自身的重量较大，则也可以不必放置到称重设备的称台上，而是可以在将称重对象放置到称台上之后，由称重操作者手持这种附加标记，以使其视觉特征能够被采集到，等等。Since the product body and the visual materials with additional marks are saved in the material information library, when the product is weighed by the intelligent weighing device, the product body corresponding to the weighing object and the related additional marks can be visually checked. Feature collection. Among them, in the specific implementation, in order to facilitate the visual feature collection of the two, when the product body corresponding to the weighing object is placed on the weighing platform of the weighing equipment, the additional mark can also be placed on the weighing platform at the same time, so that the additional mark It also enters the detection range of the visual inspection device of the weighing equipment. Among them, if the specific additional mark is attached to the product body, or laid on a specific container, etc., this condition can be naturally satisfied. If the additional mark is a price tag placed on a shelf such as a "stack head", it is also possible to place such a price tag on the weighing table when the weighing object is placed on the weighing table, so that it can be visually The features can be detected by the visual inspection means of the weighing equipment. Since most of these price tags exist in the form of "playing cards", the effect of their weight on the weight of the weighing object is almost negligible. Of course, if the weight of the specific additional mark itself is relatively large, it does not need to be placed on the weighing platform of the weighing equipment, but can be held by the weighing operator after placing the weighing object on the weighing platform. Attach markers so that their visual features can be captured, etc.
其中，在进行视觉特征采集的过程中，关于具体货品本体的视觉特征，可以从多个维度上进行视觉特征的采集。而关于附加标记的视觉特征，对于第一视觉素材信息相似的多个商品对象采用不同附加标记进行区分，并且不同的附加标记在同一视觉特征维度上具有不同的特征值的情况下，可以仅从该同一视觉特征维度进行视觉特征的采集。Among them, in the process of collecting the visual features, regarding the visual features of the specific product ontology, the visual features can be collected from multiple dimensions. As for the visual features of the additional markers, different additional markers are used to distinguish multiple commodity objects with similar first visual material information, and when the different additional markers have different feature values in the same visual feature dimension, only the The same visual feature dimension is used to collect visual features.
具体实现时，由于附加标记的面积通常可能比较小，并且有可能被货品本体遮挡，等等，因此，还可以对附加标记的视觉特征采集的完整度、清晰度等进行判断，如果不符合要求，则可以提供提示信息，以提示称重操作者通过调整货品本体或者附加标记的放置位置等方式，以使得采集到的附加标记的视觉特征能够符合要求。In the specific implementation, since the area of the additional mark may usually be relatively small, and may be blocked by the product body, etc., therefore, the completeness and clarity of the visual feature collection of the additional mark can also be judged. If it does not meet the requirements , prompt information can be provided to prompt the weighing operator to adjust the product body or the placement position of the additional mark, so that the collected visual features of the additional mark can meet the requirements.
S203：通过将所采集到的视觉特征信息与所述素材信息库中的视觉素材信息进行比对，对所述称重对象进行商品对象识别。S203: Perform commodity object recognition on the weighing object by comparing the collected visual feature information with the visual material information in the material information library.
由于采集到了货品本体以及相关的附加标记进行视觉特征，因此，可以通过将采集到的视觉特征信息与所述素材信息库中的视觉素材信息进行比对，对所述称重对象进行商品对象识别。也即，确定出当前的称重对象具体对应的是系统中的哪个商品对象，以便于确定出单价、商品名等信息，并进而生成用于结算的标签信息，等等。Since the product body and related additional marks are collected for visual features, the product object recognition can be performed on the weighing object by comparing the collected visual feature information with the visual material information in the material information library. . That is, it is determined which commodity object in the system the current weighing object corresponds to, so as to determine the unit price, commodity name and other information, and then generate label information for settlement, and so on.
其中，具体在对称重对象进行商品对象识别时，可以同时将两种视觉特征信息与视觉素材进行比对，或者，在另一种实现方式下，也可以首先将所采集到的称重对象对应的货品本体的视觉特征与所述视觉素材信息库中的第一视觉素材信息进行比对，确定相匹配的商品对象。如果所述相匹配的商品对象为多个，则根据所述相匹配的多个商品对象对应的第二视觉素材信息，提供商品对象识别结果。例如，具体可以将所采集到的附加标记的视觉特征与所述多个商品对象对应的第二视觉素材信息进行比对，确定相匹配的目标商品对象。也就是说，可以利用第一视觉素材信息，进行初步的商品对象识别，如果发现存在多个相似的商品对象，再利用第二视觉素材信息，从多个相似商品对象中进一步识别或者分辨出与当前称重对象匹配的目标商品对象。这样，最终返回给称重操作者进行确认的识别结果可以仅包括该目标商品对象。Specifically, when the commodity object recognition is performed on the weighing object, the two kinds of visual feature information may be compared with the visual material at the same time, or, in another implementation manner, the collected weighing object may be corresponding to the first. The visual features of the product body of the product are compared with the first visual material information in the visual material information database to determine the matching product object. If there are multiple matching commodity objects, a commodity object recognition result is provided according to the second visual material information corresponding to the multiple matching commodity objects. For example, the collected visual features of the additional mark may be compared with the second visual material information corresponding to the plurality of commodity objects to determine a matching target commodity object. That is to say, the first visual material information can be used to perform preliminary commodity object recognition. If it is found that there are multiple similar commodity objects, the second visual material information can be used to further identify or distinguish the similar commodity objects from the plurality of similar commodity objects. The target commodity object that the current weighing object matches. In this way, the identification result finally returned to the weighing operator for confirmation may only include the target commodity object.
或者，在另一种方式下，还可以将上述初步识别出的相匹配的多个商品对象进行展示，并将所述多个商品对象分别对应的第二视觉素材信息进行增强展示(例如，将果标放大展示，等等)，以便称重操作者根据所述第二视觉素材信息对所述多个商品对象进行选择。也就是说，在完成初步的识别之后，如果发现存在多个相似的商品对象，则可以将进一步的判断工作留给称重操作者。当然，为了帮助称重操作者进行判断，可以将具体附加标记相关的视觉素材信息进行放大等增强展示，以使得称重操作者可以根据这种增强展示的信息，更快速、准确地做出判断。Or, in another manner, the above-preliminarily identified multiple matching commodity objects may also be displayed, and the second visual material information corresponding to the multiple commodity objects may be enhanced and displayed (for example, displaying The fruit mark is enlarged and displayed, etc.), so that the weighing operator can select the plurality of commodity objects according to the second visual material information. That is to say, after completing the preliminary identification, if it is found that there are multiple similar commodity objects, further judgment work can be left to the weighing operator. Of course, in order to help the weighing operator make judgments, the visual material information related to the specific additional mark can be enlarged and displayed in an enhanced manner, so that the weighing operator can make a judgment more quickly and accurately based on the information displayed by this enhanced display. .
总之，通过本申请实施例，可以在商品对象视觉素材信息库中保存货品本体的第一视觉素材信息的基础上，增加附加标记的第二视觉素材信息。这样，在对称重对象进行视觉识别时，可以采集称重对象对应的货品本体以及附加标记两方面的视觉特征，并通过与素材库中保存的第一视觉素材信息以及第二视觉素材信息，提供识别结果。通过这种方式，可以帮助快速、准确地识别称重对象对应的商品对象，提升称重效率，并且可以降低对称重操作者主观判断力的依赖。In conclusion, through the embodiments of the present application, on the basis of storing the first visual material information of the commodity body in the commodity object visual material information database, the second visual material information with additional marks can be added. In this way, when visually recognizing the weighing object, the visual features of the product body and the additional mark corresponding to the weighing object can be collected, and the first visual material information and the second visual material information saved in the material library can be used to provide Identify the results. In this way, the commodity object corresponding to the weighing object can be quickly and accurately identified, the weighing efficiency can be improved, and the dependence on the subjective judgment of the weighing operator can be reduced.
实施例二Embodiment 2
该实施例二是从提供给商家用户的工作台的角度，提供了一种商品对象素材信息处理方法，参见图3，该方法可以包括：The second embodiment provides a method for processing commodity object material information from the perspective of a workbench provided to a merchant user. Referring to FIG. 3 , the method may include:
S301：提供用于为商品对象提交附加标记相关视觉素材的操作选项；S301: Provide operation options for submitting additional mark-related visual materials for commodity objects;
S302：通过所述操作选项接收到为目标商品对象相关的附加标记的视觉素材后，保存到商品对象视觉素材信息库中，以用于在对称重对象进行商品对象识别时，通过将采集到的视觉特征信息与所述视觉素材信息库中的视觉素材信息进行比对的方式，确定与所述称重对象匹配的商品对象，其中，所采集到的视觉特征信息包括：所述称重对象相关的附加标记的视觉特征信息。S302: After receiving the additionally marked visual material related to the target commodity object through the operation option, save it in the commodity object visual material information database, so as to be used for commodity object recognition on the weighing object, by The method of comparing the visual feature information with the visual material information in the visual material information database to determine the commodity object matching the weighing object, wherein the collected visual feature information includes: the weighing object is related to the weighing object. Additional tag visual feature information.
具体实现时，还可以对同一商家用户关联的多个商品对象的第一视觉素材之间的相似性进行判断，如果发现某些商品对象的第一视觉素材之间存在较高的相似性，则可以提示商家用户为这些商品对象提交附加标记相关视觉素材，等等。During specific implementation, the similarity between the first visual materials of multiple commodity objects associated with the same merchant user can also be judged. If it is found that there is a high similarity between the first visual materials of some commodity objects, then Merchant users may be prompted to submit additional markup related visuals for these product objects, and so on.
关于上述实施例二中的未详述部分，可以参见前述实施例一中的记载，这里不再赘述。For the parts not described in detail in the foregoing Embodiment 2, reference may be made to the descriptions in the foregoing Embodiment 1, and details are not repeated here.
需要说明的是，本申请实施例中可能会涉及到对用户数据的使用，在实际应用中，可以在符合所在国的适用法律法规要求的情况下(例如，用户明确同意，对用户切实通知，等)，在适用法律法规允许的范围内在本文描述的方案中使用用户特定的个人数据。It should be noted that the embodiments of the present application may involve the use of user data. In practical applications, the user's data may be used in accordance with the applicable laws and regulations of the country where the user is located (for example, the user expressly agrees, and the user is effectively notified. etc.), use user-specific personal data in the scenarios described herein to the extent permitted by applicable laws and regulations.
与实施例一相对应，本申请实施例还提供了一种称重处理装置，参见图4，该装置可以包括：Corresponding to the first embodiment, the embodiment of the present application also provides a weighing processing device, referring to FIG. 4 , the device may include:
视觉素材信息库获取单元401，用于获取商品对象视觉素材信息库，所述视觉素材信息库中包括商品对象对应的货品本体的第一视觉素材信息，以及附加标记的第二视觉素材信息；A visual material information
视觉特征采集单元402，用于对称重对象对应的货品本体以及附加标记进行视觉特征采集；A visual
称重对象识别单元403，用于通过将所采集到的视觉特征信息与所述素材信息库中的视觉素材信息进行比对，对所述称重对象进行商品对象识别。The weighing
其中，所述第二视觉素材信息是独立于所述第一视觉素材信息的视觉素材信息。Wherein, the second visual material information is visual material information independent of the first visual material information.
具体实现时，同一商品对象对应的第一视觉素材信息以及第二视觉素材信息可以是在不同的时间点录入到所述视觉素材信息库中的。During specific implementation, the first visual material information and the second visual material information corresponding to the same commodity object may be entered into the visual material information database at different time points.
其中，同一商品对象对应的附加标记可以是非固定的；此时，该装置还可以包括：Wherein, the additional mark corresponding to the same commodity object may be non-fixed; in this case, the device may further include:
素材更新单元，用于接收到为指定商品对象提交的新的第二视觉素材信息后，对所述指定商品对象与第二视觉素材信息之间的对应关系进行更新。The material updating unit is configured to update the corresponding relationship between the specified commodity object and the second visual material information after receiving the new second visual material information submitted for the specified commodity object.
一种具体的实现方式下，所述附加标记用于对所述第一视觉素材信息进行增强，第一视觉素材信息相似的多个商品对象对应不同的附加标记，以便对所述第一视觉素材信息相似的多个商品对象进行区分识别。In a specific implementation manner, the additional mark is used to enhance the first visual material information, and multiple commodity objects with similar first visual material information correspond to different additional marks, so as to enhance the first visual material information. Differentiate and identify multiple commodity objects with similar information.
此时，所述第一视觉素材信息相似的多个商品对象对应的不同附加标记，可以在同一视觉特征维度上具有不同的特征值；In this case, different additional marks corresponding to multiple commodity objects with similar first visual material information may have different feature values in the same visual feature dimension;
所述视觉特征采集单元具体可以用于：The visual feature acquisition unit can be specifically used for:
在采集所述称重对象对应的附加标记的视觉特征信息时，仅从所述同一视觉特征维度上对所述附加标记进行视觉特征采集；When collecting the visual feature information of the additional mark corresponding to the weighing object, only perform visual feature collection on the additional mark from the same visual feature dimension;
所述称重对象识别单元具体可以用于：The weighing object identification unit can be specifically used for:
通过将货品本体的视觉特征与所述视觉素材信息库中的第一视觉素材信息进行对比，确定匹配的多个商品对象；Determine a plurality of matching commodity objects by comparing the visual features of the commodity ontology with the first visual material information in the visual material information database;
通过从所述同一视觉特征维度上采集到的附加标记的特征，与所述多个商品对象对应的第二视觉素材信息进行对比，确定与所述称重对象匹配的目标商品对象识别。By comparing the additional marked features collected from the same visual feature dimension with the second visual material information corresponding to the multiple commodity objects, the identification of the target commodity object matching the weighing object is determined.
其中，所述第一视觉素材信息相似的多个商品对象对应的不同附加标记，具有不同的颜色、形状或编号。Wherein, the different additional marks corresponding to the plurality of commodity objects with similar first visual material information have different colors, shapes or numbers.
相同的附加标记可在第一视觉素材信息不相似的不同商品对象之间复用。The same additional mark can be reused between different commodity objects with dissimilar first visual material information.
具体的，所述附加标记可以用于贴附或绘制在所述货品本体上，或者，放置在用于堆放所述货品本体的货架上，或者，铺设在用于承载称重对象的容器内。Specifically, the additional mark can be used to be attached or drawn on the product body, or placed on a shelf for stacking the product body, or laid in a container for carrying weighing objects.
具体的，所述称重对象识别单元可以用于：Specifically, the weighing object identification unit can be used for:
将所采集到的称重对象对应的货品本体的视觉特征与所述视觉素材信息库中的第一视觉素材信息进行比对，确定相匹配的商品对象；Comparing the collected visual features of the product body corresponding to the weighing object with the first visual material information in the visual material information library to determine the matching product object;
如果所述相匹配的商品对象为多个，则根据所述相匹配的多个商品对象对应的第二视觉素材信息，提供商品对象识别结果。If there are multiple matching commodity objects, a commodity object recognition result is provided according to the second visual material information corresponding to the multiple matching commodity objects.
更为具体的，所述称重对象识别单元可以用于：More specifically, the weighing object identification unit can be used for:
将所采集到的附加标记的视觉特征与所述多个商品对象对应的第二视觉素材信息进行比对，确定相匹配的目标商品对象。The collected visual features of the additional mark are compared with the second visual material information corresponding to the plurality of commodity objects to determine a matching target commodity object.
或者，所述称重对象识别单元可以用于：Alternatively, the weighing object identification unit may be used to:
将所述相匹配的多个商品对象进行展示，并将所述多个商品对象分别对应的第二视觉素材信息进行增强展示，以便称重操作者根据所述第二视觉素材信息对所述多个商品对象进行选择。Displaying the multiple matching commodity objects, and enhancing the display of the second visual material information corresponding to the multiple commodity objects respectively, so that the weighing operator can evaluate the multiple commodity objects according to the second visual material information. item object to select.
与实施例二相对应，本申请实施例还提供了一种商品对象素材信息处理装置，参见图5，该装置可以包括：Corresponding to the second embodiment, the embodiment of the present application also provides a commodity object material information processing device. Referring to FIG. 5 , the device may include:
操作选项提供单元501，用于提供用于为商品对象提交附加标记相关视觉素材的操作选项；an operation
视觉素材接收单元502，用于通过所述操作选项接收到为目标商品对象相关的附加标记的视觉素材后，保存到商品对象视觉素材信息库中，以用于在对称重对象进行商品对象识别时，通过将采集到的视觉特征信息与所述视觉素材信息库中的视觉素材信息进行比对的方式，确定与所述称重对象匹配的商品对象，其中，所采集到的视觉特征信息包括：所述称重对象相关的附加标记的视觉特征信息。The visual
另外，本申请实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现前述方法实施例中任一项所述的方法的步骤。In addition, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the steps of the method described in any one of the foregoing method embodiments.
以及一种电子设备，包括：and an electronic device comprising:
一个或多个处理器；以及one or more processors; and
与所述一个或多个处理器关联的存储器，所述存储器用于存储程序指令,所述程序指令在被所述一个或多个处理器读取执行时，执行前述方法实施例中任一项所述的方法的步骤。a memory associated with the one or more processors, the memory is used to store program instructions that, when read and executed by the one or more processors, perform any one of the foregoing method embodiments the steps of the method.
其中，图6示例性的展示出了电子设备的架构，具体可以包括处理器610，视频显示适配器611，磁盘驱动器612，输入/输出接口613，网络接口614，以及存储器620。上述处理器610、视频显示适配器611、磁盘驱动器612、输入/输出接口613、网络接口614，与存储器620之间可以通过通信总线630进行通信连接。6 exemplarily shows the architecture of the electronic device, which may specifically include a processor 610 , a video display adapter 611 , a disk drive 612 , an input/output interface 613 , a network interface 614 , and a memory 620 . The processor 610 , the video display adapter 611 , the disk drive 612 , the input/output interface 613 , the network interface 614 , and the memory 620 can be communicatively connected through a
其中，处理器610可以采用通用的CPU(Central Processing Unit，中央处理器)、微处理器、应用专用集成电路(Application Specific Integrated Circuit，ASIC)、或者一个或多个集成电路等方式实现，用于执行相关程序，以实现本申请所提供的技术方案。The processor 610 may be implemented by a general-purpose CPU (Central Processing Unit, central processing unit), a microprocessor, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used for Execute relevant programs to realize the technical solutions provided by this application.
存储器620可以采用ROM(Read Only Memory，只读存储器)、RAM(Random AccessMemory，随机存取存储器)、静态存储设备，动态存储设备等形式实现。存储器620可以存储用于控制电子设备600运行的操作系统621，用于控制电子设备600的低级别操作的基本输入输出系统(BIOS)。另外，还可以存储网页浏览器623，数据存储管理系统624，以及称重处理系统625等等。上述称重处理系统625就可以是本申请实施例中具体实现前述各步骤操作的应用程序。总之，在通过软件或者固件来实现本申请所提供的技术方案时，相关的程序代码保存在存储器620中，并由处理器610来调用执行。The memory 620 may be implemented in the form of a ROM (Read Only Memory, read only memory), a RAM (Random Access Memory, random access memory), a static storage device, a dynamic storage device, and the like. The memory 620 may store an operating system 621 for controlling the operation of the electronic device 600 , and a basic input output system (BIOS) for controlling low-level operations of the electronic device 600 . In addition, a web browser 623, a data storage management system 624, a weighing processing system 625, and the like may also be stored. The above-mentioned weighing processing system 625 may be an application program that specifically implements the operations of the foregoing steps in this embodiment of the present application. In a word, when the technical solutions provided in the present application are implemented by software or firmware, the relevant program codes are stored in the memory 620 and called and executed by the processor 610 .
输入/输出接口613用于连接输入/输出模块，以实现信息输入及输出。输入输出/模块可以作为组件配置在设备中(图中未示出)，也可以外接于设备以提供相应功能。其中输入设备可以包括键盘、鼠标、触摸屏、麦克风、各类传感器等，输出设备可以包括显示器、扬声器、振动器、指示灯等。The input/output interface 613 is used for connecting input/output modules to realize information input and output. The input/output/module can be configured in the device as a component (not shown in the figure), or can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, and the like.
网络接口614用于连接通信模块(图中未示出)，以实现本设备与其他设备的通信交互。其中通信模块可以通过有线方式(例如USB、网线等)实现通信，也可以通过无线方式(例如移动网络、WIFI、蓝牙等)实现通信。The network interface 614 is used to connect a communication module (not shown in the figure), so as to realize the communication interaction between the device and other devices. The communication module may implement communication through wired means (eg, USB, network cable, etc.), or may implement communication through wireless means (eg, mobile network, WIFI, Bluetooth, etc.).
总线630包括一通路，在设备的各个组件(例如处理器610、视频显示适配器611、磁盘驱动器612、输入/输出接口613、网络接口614，与存储器620)之间传输信息。
需要说明的是，尽管上述设备仅示出了处理器610、视频显示适配器611、磁盘驱动器612、输入/输出接口613、网络接口614，存储器620，总线630等，但是在具体实施过程中，该设备还可以包括实现正常运行所必需的其他组件。此外，本领域的技术人员可以理解的是，上述设备中也可以仅包含实现本申请方案所必需的组件，而不必包含图中所示的全部组件。It should be noted that although the above device only shows the processor 610, the video display adapter 611, the disk drive 612, the input/output interface 613, the network interface 614, the memory 620, the
通过以上的实施方式的描述可知，本领域的技术人员可以清楚地了解到本申请可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例或者实施例的某些部分所述的方法。From the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products can be stored in storage media, such as ROM/RAM, magnetic disks , CD-ROM, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present application.
本说明书中的各个实施例均采用递进的方式描述，各个实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是与其他实施例的不同之处。尤其，对于系统或系统实施例而言，由于其基本相似于方法实施例，所以描述得比较简单，相关之处参见方法实施例的部分说明即可。以上所描述的系统及系统实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下，即可以理解并实施。Each embodiment in this specification is described in a progressive manner, and the same and similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system or the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for related parts. The systems and system embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, It can be located in one place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.
以上对本申请所提供的称重处理方法、装置及电子设备，进行了详细介绍，本文中应用了具体个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在具体实施方式及应用范围上均会有改变之处。综上所述，本说明书内容不应理解为对本申请的限制。The weighing processing method, device and electronic equipment provided by the present application have been introduced in detail above. The principles and implementations of the present application are described with specific examples in this paper. The method of the application and its core idea; meanwhile, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation and application scope. In conclusion, the content of this specification should not be construed as a limitation on the present application.
Claims (10)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110765567.8ACN113591594B (en) | 2021-07-06 | 2021-07-06 | Weighing processing method, device and electronic equipment |
| PCT/CN2022/103618WO2023280098A1 (en) | 2021-07-06 | 2022-07-04 | Weighing processing method and apparatus, and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110765567.8ACN113591594B (en) | 2021-07-06 | 2021-07-06 | Weighing processing method, device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113591594Atrue CN113591594A (en) | 2021-11-02 |
| CN113591594B CN113591594B (en) | 2025-03-28 |
Family
ID=78246012
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110765567.8AActiveCN113591594B (en) | 2021-07-06 | 2021-07-06 | Weighing processing method, device and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113591594B (en) |
| WO (1) | WO2023280098A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023280098A1 (en)* | 2021-07-06 | 2023-01-12 | 盒马(中国)有限公司 | Weighing processing method and apparatus, and electronic device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105448001A (en)* | 2014-09-22 | 2016-03-30 | 卡西欧计算机株式会社 | Commodity registration device |
| CN107180369A (en)* | 2016-03-10 | 2017-09-19 | 阿里巴巴集团控股有限公司 | Merchandise items information processing method, apparatus and system |
| US20190080207A1 (en)* | 2017-07-06 | 2019-03-14 | Frenzy Labs, Inc. | Deep neural network visual product recognition system |
| CN110163315A (en)* | 2019-05-06 | 2019-08-23 | 南京倍便利智能科技有限公司 | A kind of commodity visual identity method for chain unmanned supermarket |
| CN110793607A (en)* | 2019-09-24 | 2020-02-14 | 浙江大华技术股份有限公司 | Self-service weighing method, system and computer readable storage medium |
| CN110942035A (en)* | 2019-11-28 | 2020-03-31 | 浙江由由科技有限公司 | Method, system, device and storage medium for acquiring commodity information |
| CN110992140A (en)* | 2019-11-28 | 2020-04-10 | 浙江由由科技有限公司 | Matching method and system for recognition model |
| CN112665698A (en)* | 2020-12-15 | 2021-04-16 | 重庆电子工程职业学院 | Intelligent electronic scale |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9299007B2 (en)* | 2014-01-28 | 2016-03-29 | Ncr Corporation | Methods and apparatus for item identification using brightness compensation |
| US10657411B1 (en)* | 2014-03-25 | 2020-05-19 | Amazon Technologies, Inc. | Item identification |
| US9818038B2 (en)* | 2016-01-06 | 2017-11-14 | Toshiba Tec Kabushiki Kaisha | Image recognition apparatus |
| CN107748973A (en)* | 2017-09-29 | 2018-03-02 | 时瑞科技（深圳）有限公司 | Product identification system and automatic identification are sold or storage method |
| CN107862814A (en)* | 2017-11-01 | 2018-03-30 | 北京旷视科技有限公司 | Automated Clearing House system and automatic settlement method |
| CN108416403B (en)* | 2018-03-08 | 2021-05-04 | 上海扩博智能技术有限公司 | Method, system, device and storage medium for automatic association of goods and labels |
| JP7361359B2 (en)* | 2019-03-20 | 2023-10-16 | 株式会社イシダ | Product information inspection system and computer control method |
| CN113591594B (en)* | 2021-07-06 | 2025-03-28 | 盒马(中国)有限公司 | Weighing processing method, device and electronic equipment |
- 2021
- 2021-07-06CNCN202110765567.8Apatent/CN113591594B/enactiveActive
- 2022
- 2022-07-04WOPCT/CN2022/103618patent/WO2023280098A1/ennot_activeCeased
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105448001A (en)* | 2014-09-22 | 2016-03-30 | 卡西欧计算机株式会社 | Commodity registration device |
| CN107180369A (en)* | 2016-03-10 | 2017-09-19 | 阿里巴巴集团控股有限公司 | Merchandise items information processing method, apparatus and system |
| US20190080207A1 (en)* | 2017-07-06 | 2019-03-14 | Frenzy Labs, Inc. | Deep neural network visual product recognition system |
| CN110163315A (en)* | 2019-05-06 | 2019-08-23 | 南京倍便利智能科技有限公司 | A kind of commodity visual identity method for chain unmanned supermarket |
| CN110793607A (en)* | 2019-09-24 | 2020-02-14 | 浙江大华技术股份有限公司 | Self-service weighing method, system and computer readable storage medium |
| CN110942035A (en)* | 2019-11-28 | 2020-03-31 | 浙江由由科技有限公司 | Method, system, device and storage medium for acquiring commodity information |
| CN110992140A (en)* | 2019-11-28 | 2020-04-10 | 浙江由由科技有限公司 | Matching method and system for recognition model |
| CN112665698A (en)* | 2020-12-15 | 2021-04-16 | 重庆电子工程职业学院 | Intelligent electronic scale |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023280098A1 (en)* | 2021-07-06 | 2023-01-12 | 盒马(中国)有限公司 | Weighing processing method and apparatus, and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113591594B (en) | 2025-03-28 |
| WO2023280098A1 (en) | 2023-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7125899B2 (en) | Article interaction and movement detection method | |
| Marder et al. | Using image analytics to monitor retail store shelves | |
| JP5753215B2 (en) | Image recognition system for inventory management and marketing | |
| US10948338B2 (en) | Digital product label generation using modular scale device | |
| CN113935774A (en) | Image processing method, device, electronic device and computer storage medium | |
| CN116167596B (en) | Distribution path analysis method and system based on big data | |
| CN113191789A (en) | Goods distribution method and equipment based on second-hand scene | |
| CN110942293B (en) | Method, device, storage medium and system for processing article information | |
| CN112184361A (en) | Method and device for displaying commodity information in shopping cart in e-commerce shopping platform | |
| CN112070576A (en) | Method and equipment for selecting commodities for e-commerce model | |
| CN115761457A (en) | Commodity identification method and device, electronic equipment and computer readable medium | |
| CN116305977A (en) | Virtual shelf construction method, device, equipment and storage medium | |
| KR20110000789A (en) | Method and system to automatically quantify store display products using image recognition technology | |
| CN113591594A (en) | Weighing processing method and device and electronic equipment | |
| Liu et al. | Digital Twin in Retail: An AI-Driven Multi-Modal Approach for Real-Time Product Recognition and 3D Store Reconstruction | |
| CN113624314B (en) | Weighing processing method and device and weighing equipment | |
| CN118071465B (en) | Commodity order information processing method, system, computer equipment and storage medium | |
| CN115170221A (en) | Commodity information aggregation method and device and electronic equipment | |
| CN110633929B (en) | Commodity counting method, device and equipment | |
| CN120032380A (en) | Commodity price tag identification method, device, medium, processor and program product | |
| US20190304587A1 (en) | Nutrition performance scorecard and automated shopping list | |
| JP2016024596A (en) | Information processor | |
| CN117196758A (en) | Screening method, equipment and medium for commodity before being put on shelf | |
| HK40060985A (en) | Weighing processing method and device and electronic equipment | |
| WO2019163095A1 (en) | Registration device, registration method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code | Ref country code:HK Ref legal event code:DE Ref document number:40060985 Country of ref document:HK | |
| GR01 | Patent grant | ||
| GR01 | Patent grant |