技术领域technical field
本发明涉及智能商品存储技术领域，具体而言，尤其涉及一种基于人脸识别技术的智能商场暂存系统。The invention relates to the technical field of smart commodity storage, in particular, to a temporary storage system for smart shopping malls based on face recognition technology.
背景技术Background technique
现在快节奏的生活中，绝大部分人为了生活努力奔波，在沿海、发达一线城市中，面对的是林林总总的人、茫茫人海，因为堵车，短短的5Km路程，可能会花费30分钟，在归家的途中，人们经常会去大商场或者便利店购物，但是拥挤的人潮排队结款又需要很长时间。In today's fast-paced life, most people work hard to make a living. In coastal and developed first-tier cities, they are faced with numerous people and a vast sea of people. Because of traffic jams, a short 5Km journey may take 30 minutes. , On the way home, people often go to shopping malls or convenience stores, but it takes a long time for the crowd to queue up to pay.
大型超市会设立储物柜，每天打烊后都马上清理柜子，如果有顾客落下东西超市每天都会清点，超市会保存登记，待客人去取时，通过监控录像确定客人身份，但也仅是储存客人带来的物品，而不是去存储客人网上购物购买的物品。Large supermarkets will set up lockers, and they will clear the lockers immediately after closing every day. If a customer leaves something, the supermarket will count it every day, and the supermarket will keep the registration. Items that guests bring, instead of storing items that guests have purchased online.
发明内容SUMMARY OF THE INVENTION
根据上述提出的技术问题，而提供一种基于人脸识别技术的智能商场暂存系统。According to the technical problems raised above, a temporary storage system for smart shopping malls based on face recognition technology is provided.
本发明采用的技术手段如下：The technical means adopted in the present invention are as follows:
一种基于人脸识别技术的智能商场暂存系统，包括：A smart shopping mall temporary storage system based on face recognition technology, including:
数据储存单元，用于记录消费者在注册会员时上传的资料信息和照片信息；The data storage unit is used to record the data information and photo information uploaded by consumers when registering as a member;
客户下单单元，用于客户选取货物并完成支付，同时选取取货时间段，根据取货时间段系统计算客户需要支付的押金；The customer order unit is used for the customer to select the goods and complete the payment, and at the same time select the pick-up time period, and the system calculates the deposit that the customer needs to pay according to the pick-up time period;
数据传输单元，用于将客户下单的货物数据传输至商家终端，商家通过揽货将下单的货物放置于储物柜中，并将客户信息输入储物柜中；The data transmission unit is used to transmit the data of the goods placed by the customer to the merchant terminal. The merchant places the ordered goods in the locker through the collection of goods, and enters the customer information into the locker;
所述储物柜包括：图像采集单元，用于对前来取货的消费者的人脸图像进行图像采集；The locker includes: an image acquisition unit, which is used for image acquisition of the face image of the consumer who comes to pick up the goods;
人脸识别单元，用于对消费者进行人脸检测，具体为：图像采集单元采集到的多张人脸图像，通过卷积神经网络提取人脸图像的特征图像，根据提取到的特征图像与数据储存单元中存储的消费者信息进行比对，进而选出相似度最大的消费者作为人脸识别的目标；The face recognition unit is used to detect the face of consumers, specifically: extracting the feature images of the face images through the convolutional neural network from the multiple face images collected by the image acquisition unit, and according to the extracted feature images and The consumer information stored in the data storage unit is compared, and the consumer with the greatest similarity is selected as the target of face recognition;
判断单元，用于判断人脸识别单元筛选出的目标是否为商家输入的客户信息对应的消费者，若确认无误，则开启对应储物柜门。The judgment unit is used for judging whether the target screened by the face recognition unit is the consumer corresponding to the customer information input by the merchant, and if the confirmation is correct, the door of the corresponding locker is opened.
进一步地，所述储物柜还具有：时间管理单元，用于计算商家将货物放置于储物柜后至客户从储物柜取出货物的时间，Further, the locker also has: a time management unit for calculating the time from when the merchant places the goods in the locker to when the customer takes out the goods from the locker,
时间判断单元，用于将时间管理单元与客户提供的取货时间段进行比较，若在预设的可控阈值范围内，则返还用户的押金，否，则按照预设比例进行扣除。The time judging unit is used to compare the time management unit with the pickup time period provided by the customer. If it is within the preset controllable threshold range, the user's deposit will be returned, otherwise, it will be deducted according to the preset ratio.
进一步地，当客户超出所述可控阈值并选择退单时，则扣除全部押金。Further, when the customer exceeds the controllable threshold and chooses to refund the order, the entire deposit will be deducted.
进一步地，所述系统还包括：Further, the system also includes:
会员注册单元，用于消费者通过上传个人资料和照片至数据储存单元进行会员注册。The member registration unit is used for consumers to register members by uploading personal information and photos to the data storage unit.
进一步地，客户下单支付手段为在线支付，包括网上银行支付或微信、支付宝支付。Further, the customer's payment method for placing an order is online payment, including online banking payment or WeChat and Alipay payment.
进一步地，所述系统还包括：确认单元，用于消费者对人脸识别得到的结果进行确认。Further, the system further includes: a confirmation unit for the consumer to confirm the result obtained by face recognition.
进一步地，所述商家终端还包括：提醒单元，用于在收到订单信息后发出声、光提醒。Further, the merchant terminal further includes: a reminding unit, configured to send out sound and light reminders after receiving the order information.
进一步地，消费者之间可以通过互相授权功能，进行一次授权或者永久授权，授权记录存储于数据库中，授权成功后，第一消费者的购物信息在发送给第一消费者的同时也发送给第二消费者，储物柜在识别到未购买物品的第二消费者时也会控制电磁锁打开柜门，并将取货信息反馈至第一消费者。Further, consumers can perform one-time or permanent authorization through the mutual authorization function, and the authorization record is stored in the database. After the authorization is successful, the shopping information of the first consumer is sent to the first consumer at the same time. For the second consumer, when the locker recognizes the second consumer who has not purchased the item, the locker will also control the electromagnetic lock to open the cabinet door, and feedback the pickup information to the first consumer.
较现有技术相比，本发明具有以下优点：Compared with the prior art, the present invention has the following advantages:
本发明在用户远程下单后，客户及时装配货物并将其放置在储物柜中，客户可以在自己选定的时间段内通过人脸识别系统进行无差错的领取，节省了购物时间，在客户超出商家规定的预设超期值时，通过扣除押金的方式防止了恶意退货，保障了商家的劳动成果。In the present invention, after the user places an order remotely, the customer assembles the goods in time and places them in the locker, and the customer can collect the goods without errors through the face recognition system within the time period selected by himself, saving shopping time, and in When the customer exceeds the preset overdue value stipulated by the merchant, malicious returns are prevented by deducting the deposit, and the labor results of the merchant are guaranteed.
基于上述理由本发明可在智能商品存储领域广泛推广。Based on the above reasons, the present invention can be widely promoted in the field of smart commodity storage.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图做以简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。In order to illustrate the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.
图1为本发明基于人脸识别技术的智能商场暂存系统模块图。FIG. 1 is a block diagram of a temporary storage system for a smart shopping mall based on the face recognition technology of the present invention.
具体实施方式Detailed ways
为了使本技术领域的人员更好地理解本发明方案，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分的实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都应当属于本发明保护的范围。In order to make those skilled in the art better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only Embodiments are part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
需要说明的是，本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本发明的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances such that the embodiments of the invention described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those expressly listed Rather, those steps or units may include other steps or units not expressly listed or inherent to these processes, methods, products or devices.
如图1所示，本发明提供了一种基于人脸识别技术的智能商场暂存系统，包括：As shown in Figure 1, the present invention provides a smart shopping mall temporary storage system based on face recognition technology, including:
数据储存单元，用于记录消费者在注册会员时上传的资料信息和照片信息；The data storage unit is used to record the data information and photo information uploaded by consumers when registering as a member;
客户下单单元，用于客户选取货物并完成支付，同时选取取货时间段，根据取货时间段系统计算客户需要支付的押金；The customer order unit is used for the customer to select the goods and complete the payment, and at the same time select the pick-up time period, and the system calculates the deposit that the customer needs to pay according to the pick-up time period;
数据传输单元，用于将客户下单的货物数据传输至商家终端，商家通过揽货将下单的货物放置于储物柜中，并将客户信息输入储物柜中；The data transmission unit is used to transmit the data of the goods placed by the customer to the merchant terminal. The merchant places the ordered goods in the locker through the collection of goods, and enters the customer information into the locker;
所述储物柜包括：图像采集单元，用于对前来取货的消费者的人脸图像进行图像采集；The locker includes: an image acquisition unit, which is used for image acquisition of the face image of the consumer who comes to pick up the goods;
人脸识别单元，用于对消费者进行人脸检测，具体为：图像采集单元采集到的多张人脸图像，通过卷积神经网络提取人脸图像的特征图像，根据提取到的特征图像与数据储存单元中存储的消费者信息进行比对，进而选出相似度最大的消费者作为人脸识别的目标；The face recognition unit is used to detect the face of consumers, specifically: extracting the feature images of the face images through the convolutional neural network from the multiple face images collected by the image acquisition unit, and according to the extracted feature images and The consumer information stored in the data storage unit is compared, and the consumer with the greatest similarity is selected as the target of face recognition;
判断单元，用于判断人脸识别单元筛选出的目标是否为商家输入的客户信息对应的消费者，若确认无误，则开启对应储物柜门。The judgment unit is used for judging whether the target screened by the face recognition unit is the consumer corresponding to the customer information input by the merchant, and if the confirmation is correct, the door of the corresponding locker is opened.
所述储物柜还具有：时间管理单元，用于计算商家将货物放置于储物柜后至客户从储物柜取出货物的时间，The locker also has: a time management unit for calculating the time from when the merchant places the goods in the locker to when the customer takes out the goods from the locker,
时间判断单元，用于将时间管理单元与客户提供的取货时间段进行比较，若在预设的可控阈值范围内，则返还用户的押金，否，则按照预设比例进行扣除。The time judging unit is used to compare the time management unit with the pickup time period provided by the customer. If it is within the preset controllable threshold range, the user's deposit will be returned, otherwise, it will be deducted according to the preset ratio.
当客户超出所述可控阈值并选择退单时，则扣除全部押金。When the customer exceeds the controllable threshold and chooses to refund the order, the entire deposit is deducted.
所述系统还包括：The system also includes:
会员注册单元，用于消费者通过上传个人资料和照片至数据储存单元进行会员注册。The member registration unit is used for consumers to register members by uploading personal information and photos to the data storage unit.
客户下单支付手段为在线支付，包括网上银行支付或微信、支付宝支付。The payment method for customers to place an order is online payment, including online banking payment or WeChat and Alipay payment.
所述系统还包括：确认单元，用于消费者对人脸识别得到的结果进行确认。The system further includes: a confirmation unit for consumers to confirm the result obtained by face recognition.
所述商家终端还包括：提醒单元，用于在收到订单信息后发出声、光提醒。The merchant terminal further includes: a reminding unit, which is used for sounding and light reminding after receiving the order information.
消费者之间可以通过互相授权功能，进行一次授权或者永久授权，授权记录存储于数据库中，授权成功后，第一消费者的购物信息在发送给第一消费者的同时也发送给第二消费者，储物柜在识别到未购买物品的第二消费者时也会控制电磁锁打开柜门，并将取货信息反馈至第一消费者。Consumers can use the mutual authorization function to perform one-time authorization or permanent authorization. The authorization record is stored in the database. After the authorization is successful, the shopping information of the first consumer is sent to the first consumer and also to the second consumer. Alternatively, when the locker recognizes the second consumer who has not purchased the item, the locker will also control the electromagnetic lock to open the door of the cabinet, and feed back the pickup information to the first consumer.
上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.
在本发明的上述实施例中，对各个实施例的描述都各有侧重，某个实施例中没有详述的部分，可以参见其他实施例的相关描述。In the above-mentioned embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
在本申请所提供的几个实施例中，应该理解到，所揭露的技术内容，可通过其它的方式实现。其中，以上所描述的装置实施例仅仅是示意性的，例如所述单元的划分，可以为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，单元或模块的间接耦合或通信连接，可以是电性或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are only illustrative, for example, the division of the units may be a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components may be combined or Integration into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of units or modules, and may be in electrical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
最后应说明的是：以上各实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述各实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features thereof can be equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present invention. scope.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811231941.0ACN109961583A (en) | 2018-10-22 | 2018-10-22 | Intelligent mall temporary storage system based on face recognition technology |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811231941.0ACN109961583A (en) | 2018-10-22 | 2018-10-22 | Intelligent mall temporary storage system based on face recognition technology |
| Publication Number | Publication Date |
|---|---|
| CN109961583Atrue CN109961583A (en) | 2019-07-02 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811231941.0APendingCN109961583A (en) | 2018-10-22 | 2018-10-22 | Intelligent mall temporary storage system based on face recognition technology |
| Country | Link |
|---|---|
| CN (1) | CN109961583A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111079520A (en)* | 2019-11-01 | 2020-04-28 | 京东数字科技控股有限公司 | Image recognition method, device and storage medium |
| CN113053036A (en)* | 2019-12-26 | 2021-06-29 | 阿里巴巴集团控股有限公司 | Transaction and article access method, device, storage medium and system |
| CN114530002A (en)* | 2020-11-06 | 2022-05-24 | 丰田自动车株式会社 | Control device, system, storage box, and service providing method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204406547U (en)* | 2015-02-10 | 2015-06-17 | 王文伟 | A kind of intelligent register system |
| CN105469506A (en)* | 2015-12-09 | 2016-04-06 | 北京京东尚科信息技术有限公司 | Method and device for achieving product extraction based on face identification |
| US20160314465A1 (en)* | 2015-04-27 | 2016-10-27 | Hrb Innovations, Inc. | Payment vehicle for budgeting |
| WO2017028118A1 (en)* | 2015-08-16 | 2017-02-23 | 胡丹丽 | Human face recognition locker and method for controlling human face recognition locker |
| CN106599837A (en)* | 2016-12-13 | 2017-04-26 | 北京智慧眼科技股份有限公司 | Face identification method and device based on multi-image input |
| CN107221094A (en)* | 2017-08-09 | 2017-09-29 | 电子科技大学 | A kind of information encryption and identification system for unmanned delivery equipment |
| CN107392687A (en)* | 2016-05-13 | 2017-11-24 | 高博创科有限公司 | Automatic retail realization system |
| CN107610348A (en)* | 2017-09-04 | 2018-01-19 | 王楷 | The management system and management method of shared shelf |
| CN108280942A (en)* | 2017-12-25 | 2018-07-13 | 深圳市丰巢科技有限公司 | Pickup method based on living things feature recognition and express delivery cabinet |
| CN108416940A (en)* | 2018-03-07 | 2018-08-17 | 深圳万发创新进出口贸易有限公司 | A kind of locker managing device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204406547U (en)* | 2015-02-10 | 2015-06-17 | 王文伟 | A kind of intelligent register system |
| US20160314465A1 (en)* | 2015-04-27 | 2016-10-27 | Hrb Innovations, Inc. | Payment vehicle for budgeting |
| WO2017028118A1 (en)* | 2015-08-16 | 2017-02-23 | 胡丹丽 | Human face recognition locker and method for controlling human face recognition locker |
| CN105469506A (en)* | 2015-12-09 | 2016-04-06 | 北京京东尚科信息技术有限公司 | Method and device for achieving product extraction based on face identification |
| CN107392687A (en)* | 2016-05-13 | 2017-11-24 | 高博创科有限公司 | Automatic retail realization system |
| CN106599837A (en)* | 2016-12-13 | 2017-04-26 | 北京智慧眼科技股份有限公司 | Face identification method and device based on multi-image input |
| CN107221094A (en)* | 2017-08-09 | 2017-09-29 | 电子科技大学 | A kind of information encryption and identification system for unmanned delivery equipment |
| CN107610348A (en)* | 2017-09-04 | 2018-01-19 | 王楷 | The management system and management method of shared shelf |
| CN108280942A (en)* | 2017-12-25 | 2018-07-13 | 深圳市丰巢科技有限公司 | Pickup method based on living things feature recognition and express delivery cabinet |
| CN108416940A (en)* | 2018-03-07 | 2018-08-17 | 深圳万发创新进出口贸易有限公司 | A kind of locker managing device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111079520A (en)* | 2019-11-01 | 2020-04-28 | 京东数字科技控股有限公司 | Image recognition method, device and storage medium |
| CN111079520B (en)* | 2019-11-01 | 2024-05-21 | 京东科技控股股份有限公司 | Image recognition method, device and storage medium |
| CN113053036A (en)* | 2019-12-26 | 2021-06-29 | 阿里巴巴集团控股有限公司 | Transaction and article access method, device, storage medium and system |
| CN114530002A (en)* | 2020-11-06 | 2022-05-24 | 丰田自动车株式会社 | Control device, system, storage box, and service providing method |
| Publication | Publication Date | Title |
|---|---|---|
| US10755511B2 (en) | Systems and methods for facilitating package delivery or pickup | |
| CN108269371B (en) | Automatic commodity settlement method and device and self-service cash register | |
| RU2671767C2 (en) | Computer-controlled, unattended, automated checkout store outlet | |
| CN203773629U (en) | Intelligent self-service vending system | |
| CN104915795A (en) | Hotel self-help check-in management system and hotel self-help check-in management method | |
| US9959521B2 (en) | System and method for control of bailment inventory | |
| US20110251909A1 (en) | Credit card payment system for handling numerous payors | |
| US20070088624A1 (en) | Systems and methods for providing remote ordering capabilities | |
| CN109961583A (en) | Intelligent mall temporary storage system based on face recognition technology | |
| CN106713255B (en) | User information management method and system | |
| CN107103502A (en) | A kind of sequence information determines method and apparatus | |
| CN106408102A (en) | Management system for providing hotel guest with intelligent service | |
| CN102364527A (en) | A real-time identification authentication method for bank self-service equipment system | |
| CN104240400B (en) | A kind of bill intellectual access management system | |
| US9582971B2 (en) | System and method for smart deposit retrieval | |
| AU2015101920A4 (en) | System and method for control of bailment inventory | |
| WO2021129342A1 (en) | Data processing method, apparatus and device, storage medium, and computer program | |
| CN107516386A (en) | A kind of intelligent locker for connecting internet | |
| CN104112188A (en) | Self-serving and full-automatic type intelligent weighing management system | |
| CN110992539A (en) | 5G logistics fresh food distribution artificial intelligent video financial payment door lock and method | |
| CN204791137U (en) | Hotel moves in management system by oneself | |
| CN109934569B (en) | Settlement method, device and system | |
| WO2016210425A1 (en) | Methods and apparatus for financial transactions | |
| KR20200143984A (en) | Hybrid used merchandise trading system based on mobile device and public locker, and method thereof | |
| CN1730362A (en) | Centralized interactive transit cabinet and its supported e-commerce logistics system |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20190702 |