技术领域technical field
本发明涉及终端定位技术领域，尤其涉及一种终端定位方法和用户终端。The present invention relates to the technical field of terminal positioning, in particular to a terminal positioning method and a user terminal.
背景技术Background technique
现有的用户终端的定位方法大体分为卫星无线定位和地面无线定位这两大类。然而，无论是卫星无线定位，还是地面无线定位，都存在类似的问题，即当用户终端进入到室内环境时，用户终端可能会无法定位或者定位不准确。可见，目前的定位技术存在无法定位或者定位不准确的问题。Existing positioning methods for user terminals are roughly divided into two categories: satellite wireless positioning and ground wireless positioning. However, whether it is satellite wireless positioning or terrestrial wireless positioning, there are similar problems, that is, when the user terminal enters an indoor environment, the user terminal may not be able to locate or the positioning may be inaccurate. It can be seen that the current positioning technology has the problem of inability to locate or inaccurate positioning.
发明内容Contents of the invention
本发明实施例提供了一种终端定位方法和用户终端，可以实现用户终端定位，以及提高定位准确度。Embodiments of the present invention provide a terminal positioning method and a user terminal, which can realize user terminal positioning and improve positioning accuracy.
第一方面，本发明实施例提供一种终端定位方法，所述方法包括：In a first aspect, an embodiment of the present invention provides a terminal positioning method, the method comprising:
用户终端采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据；The user terminal collects the collected image including the store door, and extracts the store information of the store to which the store door belongs from the collected image, and extracts the image data of the store door;
所述用户终端使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据；The user terminal uses the store information to search for the image data of the store door in the pre-acquired indoor map;
所述用户终端将所述采集图像中的所述店门的图像数据与所述室内地图中的所述店门的图像数据进行比较，以获取比较结果；The user terminal compares the image data of the store door in the collected image with the image data of the store door in the indoor map to obtain a comparison result;
所述用户终端根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。The user terminal determines the location of the user terminal in the indoor map according to the comparison result.
可选的，所述用户终端将所述采集图像中的所述店门的图像数据与所述室内地图中的店门的图像数据进行比较，包括：Optionally, the user terminal compares the image data of the store door in the collected image with the image data of the store door in the indoor map, including:
所述用户终端将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较。The user terminal compares the size and angle of the store door in the captured image with the size and angle of the store door in the indoor map respectively.
可选的，所述室内地图中的店门的图像数据绑定有拍摄参数；Optionally, the image data of the store door in the indoor map is bound with shooting parameters;
所述用户终端将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较，包括：The user terminal compares the size and angle of the store door in the collected image with the size and angle of the store door in the indoor map, including:
所述用户终端将采集所述采集图像时使用的拍摄参数与所述室内地图中的店门的图像数据绑定的拍摄参数进行比较，当比较一致时，将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较。The user terminal compares the shooting parameters used when collecting the collected image with the shooting parameters bound to the image data of the store door in the indoor map, and when the comparison is consistent, the store in the collected image The size and angle of the door are compared with the size and angle of the store door in the indoor map, respectively.
可选的，所述比较结果包括所述采集图像中的所述店门的图像数据分别与所述室内地图中的店门的多个图像数据比较的比较结果；Optionally, the comparison result includes a comparison result of comparing the image data of the store door in the collected image with a plurality of image data of the store door in the indoor map;
所述用户终端根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置，包括：The user terminal determines the location of the user terminal in the indoor map according to the comparison result, including:
所述用户终端根据所述比较结果选择所述多个图像数据中与所述采集图像中的所述店门的图像数据最相近的图像数据作为参考图像数据，并将所述参考图像数据在所述室内地图中绑定的位置作为所述用户终端在所述室内地图中所处的位置。The user terminal selects the image data closest to the image data of the store door in the collected images among the plurality of image data according to the comparison result as the reference image data, and stores the reference image data in the The location bound in the indoor map is used as the location of the user terminal in the indoor map.
可选的，所述用户终端根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置，包括：Optionally, the user terminal determines the location of the user terminal in the indoor map according to the comparison result, including:
所述用户终端根据所述比较结果表示的所述采集图像中的所述店门的图像数据与所述室内地图中的店门的图像数据的差异值，以所述室内地图中的店门的图像数据在所述室内地图中绑定的位置为基准计算所述用户终端在所述室内地图中所处的位置。According to the difference value between the image data of the store door in the collected image represented by the comparison result and the image data of the store door in the indoor map, the user terminal calculates the value of the store door in the indoor map The location where the image data is bound in the indoor map is used as a reference to calculate the location of the user terminal in the indoor map.
可选的，所述用户终端采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据，包括：Optionally, the user terminal collects a collected image including a store door, and extracts store information of a store to which the store door belongs from the collected image, and extracts image data of the store door, including:
所述用户终端采集包括多个店门的采集图像，选择所述采集图像中最大的店门作为参考店门，并从所述采集图像中提取所述参考店门所属店铺的店铺信息，以及提取所述参考店门的图像数据。The user terminal collects a collection image including a plurality of store doors, selects the largest store door in the collection image as a reference store door, and extracts the store information of the store to which the reference store door belongs from the collection image, and extracts The image data of the reference store door.
第二方面，本发明实施例提供一种用户终端，包括：提取单元、查找单元、比较单元和确定单元，其中：In the second aspect, an embodiment of the present invention provides a user terminal, including: an extraction unit, a search unit, a comparison unit, and a determination unit, wherein:
所述提取单元，用于采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据；The extracting unit is configured to collect a captured image including a store door, extract store information of the store to which the store door belongs, and extract image data of the store door from the captured image;
所述查找单元，用于使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据；The searching unit is configured to use the shop information to search for the image data of the shop door in the pre-acquired indoor map;
所述比较单元，用于将所述采集图像中的所述店门的图像数据与所述室内地图中的所述店门的图像数据进行比较，以获取比较结果；The comparison unit is configured to compare the image data of the store door in the collected image with the image data of the store door in the indoor map to obtain a comparison result;
所述确定单元，用于根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。The determining unit is configured to determine the location of the user terminal in the indoor map according to the comparison result.
可选的，所述比较单元用于将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较。Optionally, the comparing unit is configured to compare the size and angle of the store door in the collected image with the size and angle of the store door in the indoor map respectively.
可选的，所述室内地图中的店门的图像数据绑定有拍摄参数；Optionally, the image data of the store door in the indoor map is bound with shooting parameters;
所述比较单元用于将采集所述采集图像时使用的拍摄参数与所述室内地图中的店门的图像数据绑定的拍摄参数进行比较，当比较一致时，将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较。The comparison unit is used to compare the shooting parameters used when collecting the collected images with the shooting parameters bound to the image data of the store door in the indoor map, and when they are consistent, compare all the shooting parameters in the collected images The size and angle of the store door are respectively compared with the size and angle of the store door in the indoor map.
可选的，所述比较结果包括所述采集图像中的所述店门的图像数据分别与所述室内地图中的店门的多个图像数据比较的比较结果；Optionally, the comparison result includes a comparison result of comparing the image data of the store door in the collected image with a plurality of image data of the store door in the indoor map;
所述确定单元用于根据所述比较结果选择所述多个图像数据中与所述采集图像中的所述店门的图像数据最相近的图像数据作为参考图像数据，并将所述参考图像数据在所述室内地图中绑定的位置作为所述用户终端在所述室内地图中所处的位置。The determination unit is configured to select the image data closest to the image data of the store door in the captured image among the plurality of image data according to the comparison result as reference image data, and store the reference image data The location bound in the indoor map is used as the location of the user terminal in the indoor map.
可选的，所述确定单元用于根据所述比较结果表示所述采集图像中的所述店门的图像数据与所述室内地图中的店门的图像数据的差异值，以所述室内地图中的店门的图像数据在所述室内地图中绑定的位置为基准计算所述用户终端在所述室内地图中所处的位置。Optionally, the determining unit is configured to indicate a difference value between the image data of the store door in the collected image and the image data of the store door in the indoor map according to the comparison result, and use the indoor map The position of the user terminal in the indoor map is calculated based on the bound position of the image data of the store door in the indoor map.
可选的，所述提取单元用于采集包括多个店门的采集图像，选择所述采集图像中最大的店门作为参考店门，并从所述采集图像中提取所述参考店门所属店铺的店铺信息，以及提取所述参考店门的图像数据。Optionally, the extracting unit is configured to collect a collection image including multiple store doors, select the largest store door in the collection image as a reference store door, and extract the store to which the reference store door belongs from the collection image. store information, and extract the image data of the reference store door.
上述技术方案中，用户终端采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据；所述用户终端使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据；所述用户终端将所述采集图像中的所述店门的图像数据与所述室内地图中的所述店门的图像数据进行比较，以获取比较结果；所述用户终端根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。这样用户终端在室内环境时可以使采集的图像数据进行定位，即本发明实施例可以实现用户终端定位，以及提高定位准确度。In the above technical solution, the user terminal collects the captured image including the store door, and extracts the store information of the store to which the store door belongs from the captured image, and extracts the image data of the store door; the user terminal uses the The store information searches for the image data of the store door in the pre-acquired indoor map; the user terminal combines the image data of the store door in the collected image with the image data of the store door in the indoor map The image data is compared to obtain a comparison result; the user terminal determines the location of the user terminal in the indoor map according to the comparison result. In this way, when the user terminal is in an indoor environment, the collected image data can be positioned, that is, the embodiment of the present invention can realize the positioning of the user terminal and improve the positioning accuracy.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1是本发明实施例提供的一种终端定位方法的流程示意图；FIG. 1 is a schematic flowchart of a terminal positioning method provided by an embodiment of the present invention;
图2是本发明实施例提供的另一种终端定位方法的流程示意图；FIG. 2 is a schematic flowchart of another terminal positioning method provided by an embodiment of the present invention;
图3是本发明实施例提供的一种用户终端的结构示意图；FIG. 3 is a schematic structural diagram of a user terminal provided by an embodiment of the present invention;
图4是本发明实施例提供的另一种用户终端的结构示意图；FIG. 4 is a schematic structural diagram of another user terminal provided by an embodiment of the present invention;
图5是本发明实施例提供的另一种用户终端的结构示意图。Fig. 5 is a schematic structural diagram of another user terminal provided by an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
请参阅图1，图1是本发明实施例提供的一种终端定位方法的流程示意图，如图1所示，包括以下步骤：Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a terminal positioning method provided by an embodiment of the present invention. As shown in FIG. 1, it includes the following steps:
101、用户终端采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据。101. The user terminal collects a captured image including a store door, and extracts store information of a store to which the store door belongs, and extracts image data of the store door from the captured image.
该步骤中可以是用户终端控制摄像头采集店铺以获取到包括店门的采集图像。然而，在实际生活店铺的店门往往会包括店铺信息的，例如：店铺的名称或者标识等可识别出店铺的店铺信息。这样步骤101就可以从采集图像中提取出店铺的店铺信息，以及采集图像中店门的图像数据。这里的图像数据可以包括采集图像中门店图像，该图像中可以包括店门的尺寸、角度等数据，或者通过该图像可以计算或者识别出店门的尺寸、角度等数据，当然这里的尺寸和角度指在采集图像中的尺寸和角度。In this step, the user terminal may control the camera to capture the store so as to acquire a captured image including the store door. However, in real life, the store door often includes store information, for example, the store name or logo and other store information that can identify the store. In this way, step 101 can extract the store information of the store from the captured image, and the image data of the store door in the captured image. The image data here can include the image of the store in the collected image, which can include data such as the size and angle of the store door, or can calculate or identify the size, angle and other data of the store door through the image. Of course, the size and angle here refer to Dimensions and angles in the acquired image.
102、用户终端使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据。102. The user terminal uses the store information to search for image data of a store door of the store in a pre-acquired indoor map.
本实施例中，用户终端可以预先获取有室内地图，该室内地图中包括多个店铺的门店的图像数据。例如：上述室内地图为某商场的室内地图时，那么，该室内地图就可以包括该商场内各店铺的店门的图像数据。In this embodiment, the user terminal may acquire an indoor map in advance, and the indoor map includes image data of stores of a plurality of stores. For example: when the above-mentioned indoor map is an indoor map of a certain shopping mall, then the indoor map may include image data of the store doors of each store in the shopping mall.
103、用户终端将所述采集图像中的所述店门的图像数据与所述室内地图中的所述店门的图像数据进行比较，以获取比较结果。103. The user terminal compares the image data of the store door in the collected image with the image data of the store door in the indoor map, to obtain a comparison result.
通过步骤103就可以获取到上述采集图像中店门的图像数据与室内地图中的店门的图像数据的比较结果。Through step 103, the comparison result of the image data of the store door in the above-mentioned collected image and the image data of the store door in the indoor map can be obtained.
104、用户终端根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。104. The user terminal determines the location of the user terminal in the indoor map according to the comparison result.
当步骤103获取到上述比较结果后，步骤104就可以根据该比较结果确定用户终端所处的位置。例如：当上述比较结果表示上述采集图像中店门的图像数据与室内地图中的店门的图像数据相似度高于特定阈值时，则可以确定用户终端在上述室内地图中的上述店铺的位置。当然，在上述室内地图中各店门的图像数据还绑定有位置信息，这样当上述比较结果表示上述采集图像中店门的图像数据与室内地图中的店门的图像数据相似度高于特定阈值时，可以将上述室内地图中上述店铺的店门的图像数据绑定的位置信息对应的位置作为上述用户终端当前所处的位置。After step 103 obtains the comparison result, step 104 can determine the location of the user terminal according to the comparison result. For example: when the comparison result shows that the similarity between the image data of the store door in the collected image and the image data of the store door in the indoor map is higher than a certain threshold, the location of the store of the user terminal in the indoor map can be determined. Of course, the image data of each store door in the indoor map is also bound with location information, so when the comparison result shows that the similarity between the image data of the store door in the above-mentioned collected image and the image data of the store door in the indoor map is higher than a certain threshold , the location corresponding to the location information bound to the image data of the store door in the indoor map may be used as the current location of the user terminal.
本实施例中，上述用户终端可以具备拍摄功能的智能终端，例如：平板电脑、手机、电子阅读器、笔记本电脑、可穿戴设备等具有网络功能的智能设备。In this embodiment, the above-mentioned user terminal may be an intelligent terminal with a shooting function, such as a tablet computer, a mobile phone, an e-reader, a notebook computer, a wearable device, and other intelligent devices with network functions.
本实施例中，用户终端采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据；所述用户终端使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据；所述用户终端将所述采集图像中的所述店门的图像数据与所述室内地图中的所述店门的图像数据进行比较，以获取比较结果；所述用户终端根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。这样用户终端在室内环境时可以使采集的图像数据进行定位，即本发明实施例可以实现用户终端定位，以及提高定位准确度。In this embodiment, the user terminal collects the collected image including the store door, and extracts the store information of the store to which the store door belongs from the collected image, and extracts the image data of the store door; the user terminal uses the The store information searches for the image data of the store door in the pre-acquired indoor map; the user terminal combines the image data of the store door in the collected image with the image data of the store door in the indoor map The image data is compared to obtain a comparison result; the user terminal determines the location of the user terminal in the indoor map according to the comparison result. In this way, when the user terminal is in an indoor environment, the collected image data can be positioned, that is, the embodiment of the present invention can realize the positioning of the user terminal and improve the positioning accuracy.
请参阅图2，图2是本发明实施例提供的另一种终端定位方法的流程示意图，如图2所示，包括以下步骤：Please refer to FIG. 2. FIG. 2 is a schematic flowchart of another terminal positioning method provided by an embodiment of the present invention. As shown in FIG. 2, it includes the following steps:
201、用户终端采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据。201. The user terminal collects a captured image including a store door, and extracts store information of a store to which the store door belongs, and extracts image data of the store door from the captured image.
本实施例中，当采集图像包括多个店铺的店门的图像数据时，步骤201可以选择其中店门的图像最大作为当前需要提取店铺信息和图像数据的店门。例如：步骤201可以包括：In this embodiment, when the collected images include image data of store doors of multiple stores, step 201 may select the largest store door image as the store door for which store information and image data need to be extracted currently. For example: step 201 may include:
所述用户终端采集包括多个店门的采集图像，选择所述采集图像中最大的店门作为参考店门，并从所述采集图像中提取所述参考店门所属店铺的店铺信息，以及提取所述参考店门的图像数据。The user terminal collects a collection image including a plurality of store doors, selects the largest store door in the collection image as a reference store door, and extracts the store information of the store to which the reference store door belongs from the collection image, and extracts The image data of the reference store door.
该实施方式中，可以实现将采集图像中最大的店门作为参考店门，并提取参考店门所属店铺的店铺信息，以及提取参考店门的图像数据。因为在采集图像中离用户终端最近的门店在采集图像中的图像是最大的，从而上述参考店门是多个店铺中离用户终端最近的店铺的店门，这样使用最近的店铺的店门的图像数据进行定位，那么定位的精度就更高。In this embodiment, it is possible to use the largest store door in the captured image as the reference store door, extract the store information of the store to which the reference store door belongs, and extract the image data of the reference store door. Because the image of the store closest to the user terminal in the collected image is the largest in the collected image, the above-mentioned reference store door is the store door of the store closest to the user terminal among the multiple stores, so the store door of the nearest store is used. If the image data is used for positioning, the positioning accuracy will be higher.
202、用户终端使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据。202. The user terminal uses the store information to search for image data of a store door of the store in a pre-acquired indoor map.
本实施例中，室内地图中存储了多个店铺的店门的图像数据，这样通过步骤201提取的上述店铺信息后，就可以在上述室内地图中查找到对应的店铺的店门的图像数据。例如：上述店铺信息包括店铺名称，那么，就可以直接使用该店铺名称查找到对应的店铺的店门的图像数据。In this embodiment, the image data of the store doors of multiple stores is stored in the indoor map, so that after the above store information is extracted in step 201, the image data of the corresponding store store doors can be found in the above indoor map. For example, if the above store information includes a store name, then the store name can be directly used to find the image data of the store door of the corresponding store.
203、用户终端将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较，以获取比较结果。203. The user terminal compares the size and angle of the store door in the collected image with the size and angle of the store door in the indoor map, respectively, to obtain a comparison result.
本实施例中，上述店门的尺寸是指图像中店门的尺寸，例如：图像中店门的宽和高数据，当然，这里比较时，是将上述采集图像和上述室内地图中店门的图像放在同一尺寸内进行比较的，当两者尺寸不一致时，可以对其一个进行压缩后再进行比较。另外，上述门店的尺寸还可以是图像中店门的特定位置所占的像素点个数，当然，这里比较时，是将上述采集图像和上述室内地图中的店门的图像放在同一分辨率进行比较的，这样当哪个所占像素点个数多时，其尺寸就大。这样通过尺寸的比较就可以得知拍摄上述采集图像的位置与拍摄室内地图中门店的图像的位置的关系，例如：如果在采集图像中店门的尺寸小于室内地图中的门店的尺寸时，则表示拍摄上述采集图像的位置与店铺之间的距离大于拍摄室内地图中门店的图像的位置与店铺之间的距离，反之，则表示拍摄上述采集图像的位置与店铺之间的距离小于拍摄室内地图中门店的图像的位置与店铺之间的距离。In this embodiment, the size of the above-mentioned store door refers to the size of the store door in the image, for example: the width and height data of the store door in the image. Of course, when comparing here, the above-mentioned collected image and the store door in the above-mentioned indoor map Images are placed in the same size for comparison. When the two sizes are inconsistent, one can be compressed and then compared. In addition, the size of the above-mentioned store can also be the number of pixels occupied by a specific position of the store door in the image. Of course, when comparing here, the above-mentioned collected image and the image of the store door in the above-mentioned indoor map are placed at the same resolution For comparison, when which one occupies more pixels, its size is larger. In this way, the relationship between the location where the above-mentioned collected image is taken and the location where the image of the store in the indoor map is taken can be known by comparing the sizes, for example: if the size of the store door in the collected image is smaller than the size of the store in the indoor map, then Indicates that the distance between the location where the image is captured and the store is greater than the distance between the location where the image of the store is captured in the indoor map and the store; otherwise, it means that the distance between the location where the image is captured and the store is smaller than the distance between the store where the image is captured in the indoor map The distance between the position of the image of the store and the store.
另外，上述店门的角度可以是在图像中店门的朝向，例如：朝向为正前方或者偏左N度或者偏右N度等，其中，N为大于0的实数。这样通过上述采集图像中店门的角度可以确定拍摄上述采集图像的位置相对于店铺的角度与拍摄室内地图中门店的图像的位置相对于店铺的角度之间的关系。例如：上述采集图像中店门的角度与室内地图中店门的角度一致时，则表示拍摄上述采集图像的位置相对于店铺的角度与拍摄室内地图中门店的图像的位置相对于店铺的角度相同；上述采集图像中店门的角度与室内地图中店门的角度相反时，则表示拍摄上述采集图像的位置相对于店铺的角度与拍摄室内地图中门店的图像的位置相对于店铺的角度相反等等，此处不作一一举例。In addition, the above-mentioned angle of the store door may be the orientation of the store door in the image, for example: the orientation is straight ahead or N degrees to the left or N degrees to the right, etc., wherein N is a real number greater than 0. In this way, the relationship between the angle of the position where the captured image is captured relative to the store and the position of the store image captured in the indoor map relative to the store can be determined through the angle of the store door in the captured image. For example: when the angle of the store door in the above collected image is consistent with the angle of the store door in the indoor map, it means that the angle of the location where the above collected image is taken relative to the store is the same as the angle of the location where the image of the store in the indoor map is taken relative to the store ; when the angle of the store door in the above-mentioned collected image is opposite to the angle of the store door in the indoor map, it means that the angle of the position of the above-mentioned collected image relative to the store is opposite to the angle of the position of the image of the store in the indoor map relative to the store, etc. Wait, I won't give examples one by one here.
另外，本实施例中，所述室内地图中的店门的图像数据可以绑定有拍摄参数，这里绑定的拍摄参数可以理解为拍摄室内地图中店门的图像数据时所使用的拍摄参数，例如：焦距。上述采集所述采集图像时使用的拍摄参数还可以是与上述室内地图中的店门的图像数据绑定的拍摄参数一致时，将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较。即步骤203可以包括：In addition, in this embodiment, the image data of the store door in the indoor map can be bound with shooting parameters, and the shooting parameters bound here can be understood as the shooting parameters used when shooting the image data of the store door in the indoor map, For example: focal length. When the shooting parameters used in the above-mentioned acquisition of the collected image are consistent with the shooting parameters bound to the image data of the store door in the above-mentioned indoor map, the size and angle of the store door in the collected image are respectively compared with The size and angle of the store door in the indoor map are compared. That is, step 203 may include:
用户终端将采集所述采集图像时使用的拍摄参数与所述室内地图中的店门的图像数据绑定的拍摄参数进行比较，当比较一致时，将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较。The user terminal compares the shooting parameters used when collecting the collected image with the shooting parameters bound to the image data of the store door in the indoor map, and when they are consistent, compares the shooting parameters of the store door in the collected image The size and angle are compared with the size and angle of the store door in the indoor map, respectively.
该实施方式中，可以实现当上述两个拍摄参数一致时，则进行比较，从而可以提高定位精度。另外，该实施方式中，当不一致时，可以根据上述两个拍摄参数之间的差异对其中一个图像数据进行调整，再使用调整的图像数据进行比较。In this embodiment, when the above two photographing parameters are consistent, they can be compared, so that the positioning accuracy can be improved. In addition, in this embodiment, if they are inconsistent, one of the image data may be adjusted according to the difference between the above two shooting parameters, and then the adjusted image data may be used for comparison.
另外，本实施例中，上述室内地图中每个门店可以存在多个拍摄参数的图像数据，这样在进行上述比较时，可以选择上述多个拍摄参数的图像数据中与采集所述采集图像时使用的拍摄参数最相似的图像数据进行比较，这样比较结果就更加精确。In addition, in this embodiment, there may be image data of multiple shooting parameters in each store in the above-mentioned indoor map, so that when performing the above-mentioned comparison, the image data of the above-mentioned multiple shooting parameters can be selected to be used when collecting the collected images. Compare the image data with the most similar shooting parameters, so that the comparison results will be more accurate.
204、用户终端根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。204. The user terminal determines the location of the user terminal in the indoor map according to the comparison result.
本实施例中，上述室内地图中可以存储上述门店的多个图像数据，这样在进行比较时，可以将上述采集图像中的店门的图像数据与这多个图像数据进行比较，从而可以获得多个比较结果。即上述比较结果可以包括所述采集图像中的所述店门的图像数据分别与所述室内地图中的店门的多个图像数据比较的比较结果。另外，在上述室内地图中每个图像数据都可以绑定一个位置，例如：在拍摄上述室内地图的图像数据时可以在不同的位置对上述门店进行拍摄，以获取不同的图像数据，再将拍摄时的位置绑定至对应的图像数据。该实施方式中，步骤204可以包括：In this embodiment, multiple image data of the above-mentioned store can be stored in the above-mentioned indoor map, so that when comparing, the image data of the store in the above-mentioned collected image can be compared with the multiple image data, so that multiple image data can be obtained. a comparison result. That is, the above-mentioned comparison result may include the comparison result of comparing the image data of the store door in the collected image with multiple image data of the store door in the indoor map. In addition, each image data in the above-mentioned indoor map can be bound to a location, for example: when shooting the image data of the above-mentioned indoor map, the above-mentioned stores can be photographed at different locations to obtain different image data, and then the photographed The location at the time is bound to the corresponding image data. In this embodiment, step 204 may include:
用户终端根据所述比较结果选择所述多个图像数据中与所述采集图像中的所述店门的图像数据最相近的图像数据作为参考图像数据，并将所述参考图像数据在所述室内地图中绑定的位置作为所述用户终端在所述室内地图中所处的位置。The user terminal selects the image data closest to the image data of the store door in the collected images among the multiple image data according to the comparison result as the reference image data, and stores the reference image data in the indoor The location bound in the map is used as the location of the user terminal in the indoor map.
该实施方式中，由于室内地图中存在多个图像数据，这样可以提高终端定位精度。In this implementation manner, since there are multiple image data in the indoor map, the positioning accuracy of the terminal can be improved.
本实施例中，步骤204可以包括：In this embodiment, step 204 may include:
用户终端根据所述比较结果表示的所述采集图像中的所述店门的图像数据与所述室内地图中的店门的图像数据的差异值，以所述室内地图中的店门的图像数据在所述室内地图中绑定的位置为基准计算所述用户终端在所述室内地图中所处的位置。The user terminal calculates the image data of the store door in the indoor map according to the difference value between the image data of the store door in the collected image represented by the comparison result and the image data of the store door in the indoor map The location bound in the indoor map is used as a reference to calculate the location of the user terminal in the indoor map.
例如：当上述比较结果表示上述采集图像中店门的角度与上述室内地图中店门的角度一致时，但上述采集图像中店门的尺寸小于上述室内地图中店门的尺寸时，则可以将所述室内地图中的店门的图像数据在所述室内地图中绑定的位置增加特定距离得到的位置作为所述用户终端在所述室内地图中所处的位置。其中，这里增加的特定距离是与上述尺寸的差异值对应的，且增加是在特定角度上增加的，因为上述采集图像中店门的角度与上述室内地图中店门的角度一致时，表示采集上述采集图像的位置相对于店铺的角度与拍摄上述室内地图中店门的图像数据的位置相对于店铺的角度相同，这样只需要在该角度上增加上述特定距离就可以得到用户终端在所述室内地图中所处的位置。同理，上述比较结果表示角度和/或尺寸存在差异时，根据该差异对所述室内地图中的店门的图像数据在所述室内地图中绑定的位置进行相应调整可以得到所述用户终端在所述室内地图中所处的位置。For example: when the above-mentioned comparison result shows that the angle of the store door in the above-mentioned collected image is consistent with the angle of the store door in the above-mentioned indoor map, but when the size of the store door in the above-mentioned collected image is smaller than the size of the store door in the above-mentioned indoor map, then the A position obtained by adding a certain distance to the bound position of the store door image data in the indoor map in the indoor map is used as the position of the user terminal in the indoor map. Among them, the specific distance increased here corresponds to the difference value of the above-mentioned size, and the increase is increased at a specific angle, because when the angle of the store door in the above-mentioned collected image is consistent with the angle of the store door in the above-mentioned indoor map, it means that the collected The angle of the position of the collected image relative to the store is the same as the angle of the position of the image data of the store door in the above indoor map captured relative to the store. In this way, it is only necessary to add the above-mentioned specific distance to the angle to obtain the user terminal in the indoor. Where you are on the map. Similarly, when the above comparison result shows that there is a difference in angle and/or size, the user terminal can be obtained by adjusting the position of the image data of the store door in the indoor map bound in the indoor map according to the difference. The current location in the indoor map.
本实施例中，在图1所示的实施例的基础上增加了多种可选的实施方式，且都可以实现用户终端定位，以及提高定位准确度。In this embodiment, on the basis of the embodiment shown in FIG. 1 , multiple optional implementation manners are added, all of which can realize user terminal positioning and improve positioning accuracy.
下面为本发明装置实施例，本发明装置实施例用于执行本发明方法实施例一至二实现的方法，为了便于说明，仅示出了与本发明实施例相关的部分，具体技术细节未揭示的，请参照本发明实施例一和实施例二。The following is the embodiment of the device of the present invention, which is used to execute the method realized by the method embodiment 1 to 2 of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, and the specific technical details are not disclosed. , please refer to Embodiment 1 and Embodiment 2 of the present invention.
请参阅图3，图3是本发明实施例提供的一种用户终端的结构示意图，如图3所示，包括：提取单元31、查找单元32、比较单元33和确定单元34，其中：Please refer to FIG. 3. FIG. 3 is a schematic structural diagram of a user terminal provided by an embodiment of the present invention. As shown in FIG. 3, it includes: an extraction unit 31, a search unit 32, a comparison unit 33, and a determination unit 34, wherein:
提取单元31，用于采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据。The extracting unit 31 is configured to collect a captured image including a store door, extract store information of the store to which the store door belongs, and extract image data of the store door from the captured image.
提取单元31可以是用户终端控制摄像头采集店铺以获取到包括店门的采集图像。然而，在实际生活店铺的店门往往会包括店铺信息的，例如：店铺的名称或者标识等可识别出店铺的店铺信息。这样提取单元31就可以从采集图像中提取出店铺的店铺信息，以及采集图像中店门的图像数据。这里的图像数据可以包括采集图像中门店图像，该图像中可以包括店门的尺寸、角度等数据，或者通过该图像可以计算或者识别出店门的尺寸、角度等数据，当然这里的尺寸和角度指在采集图像中的尺寸和角度。The extracting unit 31 may be a user terminal controlling a camera to capture a store to obtain a captured image including a store door. However, in real life, the store door often includes store information, for example, the store name or logo and other store information that can identify the store. In this way, the extracting unit 31 can extract the store information of the store from the captured image, and the image data of the store door in the captured image. The image data here can include the image of the store in the collected image, which can include data such as the size and angle of the store door, or can calculate or identify the size, angle and other data of the store door through the image. Of course, the size and angle here refer to Dimensions and angles in the acquired image.
查找单元32，用于使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据。A search unit 32, configured to use the store information to search for the image data of the store door in the pre-acquired indoor map.
本实施例中，用户终端可以预先获取有室内地图，该室内地图中包括多个店铺的门店的图像数据。例如：上述室内地图为某商场的室内地图时，那么，该室内地图就可以包括该商场内各店铺的店门的图像数据。In this embodiment, the user terminal may acquire an indoor map in advance, and the indoor map includes image data of stores of a plurality of stores. For example: when the above-mentioned indoor map is an indoor map of a certain shopping mall, then the indoor map may include image data of the store doors of each store in the shopping mall.
比较单元33，用于将所述采集图像中的所述店门的图像数据与所述室内地图中的所述店门的图像数据进行比较，以获取比较结果。The comparison unit 33 is configured to compare the image data of the store door in the collected image with the image data of the store door in the indoor map, so as to obtain a comparison result.
通过比较单元33就可以获取到上述采集图像中店门的图像数据与室内地图中的店门的图像数据的比较结果。The comparison result of the image data of the store door in the above-mentioned captured image and the image data of the store door in the indoor map can be obtained through the comparison unit 33 .
确定单元34，用于根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。A determining unit 34, configured to determine the location of the user terminal in the indoor map according to the comparison result.
当比较单元33获取到上述比较结果后，确定单元34就可以根据该比较结果确定用户终端所处的位置。例如：当上述比较结果表示上述采集图像中店门的图像数据与室内地图中的店门的图像数据相似度高于特定阈值时，则可以确定用户终端在上述室内地图中的上述店铺的位置。当然，在上述室内地图中各店门的图像数据还绑定有位置信息，这样当上述比较结果表示上述采集图像中店门的图像数据与室内地图中的店门的图像数据相似度高于特定阈值时，可以将上述室内地图中上述店铺的店门的图像数据绑定的位置信息对应的位置作为上述用户终端当前所处的位置。After the comparison unit 33 obtains the comparison result, the determination unit 34 can determine the location of the user terminal according to the comparison result. For example: when the comparison result shows that the similarity between the image data of the store door in the collected image and the image data of the store door in the indoor map is higher than a certain threshold, the location of the store of the user terminal in the indoor map can be determined. Of course, the image data of each store door in the indoor map is also bound with location information, so when the comparison result shows that the similarity between the image data of the store door in the above-mentioned collected image and the image data of the store door in the indoor map is higher than a certain threshold , the location corresponding to the location information bound to the image data of the store door in the indoor map may be used as the current location of the user terminal.
本实施例中，上述用户终端可以具备拍摄功能的智能终端，例如：平板电脑、手机、电子阅读器、笔记本电脑、可穿戴设备等具有网络功能的智能设备。In this embodiment, the above-mentioned user terminal may be an intelligent terminal with a shooting function, such as a tablet computer, a mobile phone, an e-reader, a notebook computer, a wearable device, and other intelligent devices with network functions.
本实施例中，用户终端采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据；所述用户终端使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据；所述用户终端将所述采集图像中的所述店门的图像数据与所述室内地图中的店门的图像数据进行比较，以获取比较结果；所述用户终端根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。这样用户终端在室内环境时可以使采集的图像数据进行定位，即本发明实施例可以实现用户终端定位，以及提高定位准确度。In this embodiment, the user terminal collects the collected image including the store door, and extracts the store information of the store to which the store door belongs from the collected image, and extracts the image data of the store door; the user terminal uses the The store information searches for the image data of the store door in the pre-acquired indoor map; the user terminal combines the image data of the store door in the collected image with the image data of the store door in the indoor map performing a comparison to obtain a comparison result; the user terminal determines the location of the user terminal in the indoor map according to the comparison result. In this way, when the user terminal is in an indoor environment, the collected image data can be positioned, that is, the embodiment of the present invention can realize the positioning of the user terminal and improve the positioning accuracy.
请参阅图4，图4是本发明实施例提供的另一种用户终端的结构示意图，如图4所示，包括：提取单元41、查找单元42、比较单元43和确定单元44，其中：Please refer to FIG. 4. FIG. 4 is a schematic structural diagram of another user terminal provided by an embodiment of the present invention. As shown in FIG. 4, it includes: an extraction unit 41, a search unit 42, a comparison unit 43, and a determination unit 44, wherein:
提取单元41，用于采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据。The extracting unit 41 is configured to collect a captured image including a store door, extract store information of the store to which the store door belongs, and extract image data of the store door from the captured image.
本实施例中，当采集图像包括多个店铺的店门的图像数据时，步骤201可以选择其中店门的图像最大作为当前需要提取店铺信息和图像数据的店门。例如：提取单元41可以用于采集包括多个店门的采集图像，选择所述采集图像中最大的店门作为参考店门，并从所述采集图像中提取所述参考店门所属店铺的店铺信息，以及提取所述参考店门的图像数据。In this embodiment, when the collected images include image data of store doors of multiple stores, step 201 may select the largest store door image as the store door for which store information and image data need to be extracted currently. For example: the extraction unit 41 can be used to collect a collection image that includes a plurality of store doors, select the largest store door in the collection image as a reference store door, and extract the store of the store to which the reference store door belongs from the collection image information, and extract the image data of the reference store door.
该实施方式中，可以实现将采集图像中最大的店门作为参考店门，并提取参考店门所属店铺的店铺信息，以及提取参考店门的图像数据。因为在采集图像中离用户终端最近的门店在采集图像中的图像是最大的，从而上述参考店门是多个店铺中离用户终端最近的店铺的店门，这样使用最近的店铺的店门的图像数据进行定位，那么定位的精度就更高。In this embodiment, it is possible to use the largest store door in the captured image as the reference store door, extract the store information of the store to which the reference store door belongs, and extract the image data of the reference store door. Because the image of the store closest to the user terminal in the collected image is the largest in the collected image, the above-mentioned reference store door is the store door of the store closest to the user terminal among the multiple stores, so the store door of the nearest store is used. If the image data is used for positioning, the positioning accuracy will be higher.
查找单元42，用于使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据。A searching unit 42, configured to use the shop information to search for the image data of the shop door in the pre-acquired indoor map.
本实施例中，室内地图中存储了多个店铺的店门的图像数据，这样通过提取单元41提取的上述店铺信息后，就可以在上述室内地图中查找到对应的店铺的店门的图像数据。例如：上述店铺信息包括店铺名称，那么，就可以直接使用该店铺名称查找到对应的店铺的店门的图像数据。In this embodiment, the image data of the store doors of a plurality of stores are stored in the indoor map, so that after the above store information is extracted by the extraction unit 41, the image data of the store doors of the corresponding stores can be found in the above indoor map. . For example, if the above store information includes a store name, then the store name can be directly used to find the image data of the store door of the corresponding store.
比较单元43，用于将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较，以获取比较结果。The comparing unit 43 is configured to compare the size and angle of the store door in the collected image with the size and angle of the store door in the indoor map respectively, so as to obtain a comparison result.
本实施例中，上述店门的尺寸是指图像中店门的尺寸，例如：图像中店门的宽和高数据，当然，这里比较时，是将上述采集图像和上述室内地图中店门的图像放在同一尺寸内进行比较的，当两者尺寸不一致时，可以对其一个进行压缩后再进行比较。另外，上述门店的尺寸还可以是图像中店门的特定位置所占的像素点个数，当然，这里比较时，是将上述采集图像和上述室内地图中的店门的图像放在同一分辨率进行比较的，这样当哪个所占像素点个数多时，其尺寸就大。这样通过尺寸的比较就可以得知拍摄上述采集图像的位置与拍摄室内地图中门店的图像的位置的关系，例如：如果在采集图像中店门的尺寸小于室内地图中的门店的尺寸时，则表示拍摄上述采集图像的位置与店铺之间的距离大于拍摄室内地图中门店的图像的位置与店铺之间的距离，反之，则表示拍摄上述采集图像的位置与店铺之间的距离小于拍摄室内地图中门店的图像的位置与店铺之间的距离。In this embodiment, the size of the above-mentioned store door refers to the size of the store door in the image, for example: the width and height data of the store door in the image. Of course, when comparing here, the above-mentioned collected image and the store door in the above-mentioned indoor map Images are placed in the same size for comparison. When the two sizes are inconsistent, one can be compressed and then compared. In addition, the size of the above-mentioned store can also be the number of pixels occupied by a specific position of the store door in the image. Of course, when comparing here, the above-mentioned collected image and the image of the store door in the above-mentioned indoor map are placed at the same resolution For comparison, when which one occupies more pixels, its size is larger. In this way, the relationship between the location where the above-mentioned collected image is taken and the location where the image of the store in the indoor map is taken can be known by comparing the sizes, for example: if the size of the store door in the collected image is smaller than the size of the store in the indoor map, then Indicates that the distance between the location where the image is captured and the store is greater than the distance between the location where the image of the store is captured in the indoor map and the store; otherwise, it means that the distance between the location where the image is captured and the store is smaller than the distance between the store where the image is captured in the indoor map The distance between the position of the image of the store and the store.
另外，上述店门的角度可以是在图像中店门的朝向，例如：朝向为正前方或者偏左N度或者偏右N度等，其中，N为大于0的实数。这样通过上述采集图像中店门的角度可以确定拍摄上述采集图像的位置相对于店铺的角度与拍摄室内地图中门店的图像的位置相对于店铺的角度之间的关系。例如：上述采集图像中店门的角度与室内地图中店门的角度一致时，则表示拍摄上述采集图像的位置相对于店铺的角度与拍摄室内地图中门店的图像的位置相对于店铺的角度相同；上述采集图像中店门的角度与室内地图中店门的角度相反时，则表示拍摄上述采集图像的位置相对于店铺的角度与拍摄室内地图中门店的图像的位置相对于店铺的角度相反等等，此处不作一一举例。In addition, the above-mentioned angle of the store door may be the orientation of the store door in the image, for example: the orientation is straight ahead or N degrees to the left or N degrees to the right, etc., wherein N is a real number greater than 0. In this way, the relationship between the angle of the position where the captured image is captured relative to the store and the position of the store image captured in the indoor map relative to the store can be determined through the angle of the store door in the captured image. For example: when the angle of the store door in the above-mentioned collected image is consistent with the angle of the store door in the indoor map, it means that the angle of the location where the above-mentioned collected image is taken relative to the store is the same as the angle of the location where the image of the store in the indoor map is taken relative to the store ; when the angle of the store door in the above-mentioned collected image is opposite to the angle of the store door in the indoor map, it means that the angle of the location where the above-mentioned collected image is taken relative to the store is opposite to the angle of the location where the image of the store in the indoor map is taken relative to the store, etc. Wait, I won't give examples one by one here.
另外，本实施例中，所述室内地图中的店门的图像数据可以绑定有拍摄参数，这里绑定的拍摄参数可以理解为拍摄室内地图中店门的图像数据时所使用的拍摄参数，例如：焦距。上述采集所述采集图像时使用的拍摄参数还可以是与上述室内地图中的店门的图像数据绑定的拍摄参数一致时，将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较。即比较单元43可以用于将采集所述采集图像时使用的拍摄参数与所述室内地图中的店门的图像数据绑定的拍摄参数进行比较，当比较一致时，将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较。In addition, in this embodiment, the image data of the store door in the indoor map can be bound with shooting parameters, and the shooting parameters bound here can be understood as the shooting parameters used when shooting the image data of the store door in the indoor map, For example: focal length. When the shooting parameters used in the above-mentioned acquisition of the collected image are consistent with the shooting parameters bound to the image data of the store door in the above-mentioned indoor map, the size and angle of the store door in the collected image are respectively compared with The size and angle of the store door in the indoor map are compared. That is to say, the comparison unit 43 can be used to compare the shooting parameters used when collecting the collected images with the shooting parameters bound to the image data of the store door in the indoor map, and when they are consistent, compare the shooting parameters in the collected images The size and angle of the store door are respectively compared with the size and angle of the store door in the indoor map.
该实施方式中，可以实现当上述两个拍摄参数一致时，则进行比较，从而可以提高定位精度。另外，该实施方式中，当不一致时，可以根据上述两个拍摄参数之间的差异对其中一个图像数据进行调整，再使用调整的图像数据进行比较。In this embodiment, when the above two photographing parameters are consistent, they can be compared, so that the positioning accuracy can be improved. In addition, in this embodiment, if they are inconsistent, one of the image data may be adjusted according to the difference between the above two shooting parameters, and then the adjusted image data may be used for comparison.
另外，本实施例中，上述室内地图中每个门店可以存在多个拍摄参数的图像数据，这样在进行上述比较时，可以选择上述多个拍摄参数的图像数据中与采集所述采集图像时使用的拍摄参数最相似的图像数据进行比较，这样比较结果就更加精确。In addition, in this embodiment, there may be image data of multiple shooting parameters in each store in the above-mentioned indoor map, so that when performing the above-mentioned comparison, the image data of the above-mentioned multiple shooting parameters can be selected to be used when collecting the collected images. Compare the image data with the most similar shooting parameters, so that the comparison results will be more accurate.
确定单元44，用于根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。A determining unit 44, configured to determine the location of the user terminal in the indoor map according to the comparison result.
本实施例中，上述室内地图中可以存储上述门店的多个图像数据，这样在进行比较时，可以将上述采集图像中的店门的图像数据与这多个图像数据进行比较，从而可以获得多个比较结果。即上述比较结果可以包括所述采集图像中的所述店门的图像数据分别与所述室内地图中的店门的多个图像数据比较的比较结果。另外，在上述室内地图中每个图像数据都可以绑定一个位置，例如：在拍摄上述室内地图的图像数据时可以在不同的位置对上述门店进行拍摄，以获取不同的图像数据，再将拍摄时的位置绑定至对应的图像数据。该实施方式中，确定单元44可以用于根据所述比较结果选择所述多个图像数据中与所述采集图像中的所述店门的图像数据最相近的图像数据作为参考图像数据，并将所述参考图像数据在所述室内地图中绑定的位置作为所述用户终端在所述室内地图中所处的位置。In this embodiment, multiple image data of the above-mentioned store can be stored in the above-mentioned indoor map, so that when comparing, the image data of the store in the above-mentioned collected image can be compared with the multiple image data, so that multiple image data can be obtained. a comparison result. That is, the above-mentioned comparison result may include the comparison result of comparing the image data of the store door in the collected image with multiple image data of the store door in the indoor map. In addition, each image data in the above-mentioned indoor map can be bound to a location, for example: when shooting the image data of the above-mentioned indoor map, the above-mentioned stores can be photographed at different locations to obtain different image data, and then the photographed The location at the time is bound to the corresponding image data. In this embodiment, the determination unit 44 may be configured to select the image data that is closest to the image data of the store door in the collected image among the plurality of image data according to the comparison result as the reference image data, and set The location where the reference image data is bound in the indoor map is used as the location of the user terminal in the indoor map.
该实施方式中，由于室内地图中存在多个图像数据，这样可以提高终端定位精度。In this implementation manner, since there are multiple image data in the indoor map, the positioning accuracy of the terminal can be improved.
本实施例中，确定单元44可以用于根据所述比较结果表示的所述采集图像中的所述店门的图像数据与所述室内地图中的店门的图像数据的差异值，以所述室内地图中的店门的图像数据在所述室内地图中绑定的位置为基准计算所述用户终端在所述室内地图中所处的位置。In this embodiment, the determining unit 44 may be configured to calculate the The location of the user terminal in the indoor map is calculated based on the location where the image data of the store door in the indoor map is bound in the indoor map.
例如：当上述比较结果表示上述采集图像中店门的角度与上述室内地图中店门的角度一致时，但上述采集图像中店门的尺寸小于上述室内地图中店门的尺寸时，则可以将所述室内地图中的店门的图像数据在所述室内地图中绑定的位置增加特定距离得到的位置作为所述用户终端在所述室内地图中所处的位置。其中，这里增加的特定距离是与上述尺寸的差异值对应的，且增加是在特定角度上增加的，因为上述采集图像中店门的角度与上述室内地图中店门的角度一致时，表示采集上述采集图像的位置相对于店铺的角度与拍摄上述室内地图中店门的图像数据的位置相对于店铺的角度相同，这样只需要在该角度上增加上述特定距离就可以得到用户终端在所述室内地图中所处的位置。同理，上述比较结果表示角度和/或尺寸存在差异时，根据该差异对所述室内地图中的店门的图像数据在所述室内地图中绑定的位置进行相应调整可以得到所述用户终端在所述室内地图中所处的位置。For example: when the above-mentioned comparison result shows that the angle of the store door in the above-mentioned collected image is consistent with the angle of the store door in the above-mentioned indoor map, but when the size of the store door in the above-mentioned collected image is smaller than the size of the store door in the above-mentioned indoor map, then the A position obtained by adding a certain distance to the bound position of the store door image data in the indoor map in the indoor map is used as the position of the user terminal in the indoor map. Among them, the specific distance increased here corresponds to the difference value of the above-mentioned size, and the increase is increased at a specific angle, because when the angle of the store door in the above-mentioned collected image is consistent with the angle of the store door in the above-mentioned indoor map, it means that the collected The angle of the position of the collected image relative to the store is the same as the angle of the position of the image data of the store door in the above indoor map captured relative to the store. In this way, it is only necessary to add the above-mentioned specific distance to the angle to obtain the user terminal in the indoor. Where you are on the map. Similarly, when the above comparison result shows that there is a difference in angle and/or size, the user terminal can be obtained by adjusting the position of the image data of the store door in the indoor map bound in the indoor map according to the difference. The current location in the indoor map.
本实施例中，在图3所示的实施例的基础上增加了多种可选的实施方式，且都可以实现用户终端定位，以及提高定位准确度。In this embodiment, on the basis of the embodiment shown in FIG. 3 , multiple optional implementation manners are added, all of which can realize user terminal positioning and improve positioning accuracy.
请参阅图5，图5是本发明实施例提供的另一种用户终端的结构示意图，如图5所示，包括：处理器51、网络接口52、存储器53和通信总线54，其中，所述通信总线54用于实现所述处理器51、网络接口52和存储器53之间连接通信，所述处理器51执行所述存储器53中存储的程序用于实现以下方法：Please refer to FIG. 5. FIG. 5 is a schematic structural diagram of another user terminal provided by an embodiment of the present invention. As shown in FIG. 5, it includes: a processor 51, a network interface 52, a memory 53, and a communication bus 54, wherein the The communication bus 54 is used to realize connection and communication between the processor 51, the network interface 52 and the memory 53, and the processor 51 executes the program stored in the memory 53 to realize the following method:
采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据；Collecting images including the store door, and extracting store information of the store to which the store door belongs and extracting image data of the store door from the collected image;
使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据；using the store information to search for the image data of the store door in the pre-acquired indoor map;
将所述采集图像中的所述店门的图像数据与所述室内地图中的所述店门的图像数据进行比较，以获取比较结果；comparing the image data of the store door in the collected image with the image data of the store door in the indoor map to obtain a comparison result;
根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。Determine the location of the user terminal in the indoor map according to the comparison result.
本实施例中，处理器51执行的将所述采集图像中的所述店门的图像数据与所述室内地图中的店门的图像数据进行比较的步骤，可以包括：In this embodiment, the step of comparing the image data of the store door in the collected image with the image data of the store door in the indoor map performed by the processor 51 may include:
将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较。Comparing the size and angle of the store door in the collected image with the size and angle of the store door in the indoor map respectively.
本实施例中，上述室内地图中的店门的图像数据可以绑定有拍摄参数；In this embodiment, the image data of the store door in the above-mentioned indoor map may be bound with shooting parameters;
处理器51执行的将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较的程序，可以包括：The program executed by the processor 51 to compare the size and angle of the store door in the captured image with the size and angle of the store door in the indoor map may include:
将采集所述采集图像时使用的拍摄参数与所述室内地图中的店门的图像数据绑定的拍摄参数进行比较，当比较一致时，将所述采集图像中的所述店门的尺寸和角度分别与所述室内地图中的所述店门的尺寸和角度进行比较。Comparing the shooting parameters used when collecting the collected image with the shooting parameters bound to the image data of the store door in the indoor map, and when they are consistent, comparing the size and the size of the store door in the collected image The angle is compared with the size and angle of the store door in the indoor map, respectively.
本实施例中，所述比较结果可以包括所述采集图像中的所述店门的图像数据分别与所述室内地图中的店门的多个图像数据比较的比较结果；In this embodiment, the comparison result may include a comparison result of comparing the image data of the store door in the collected image with multiple image data of the store door in the indoor map;
本实施例中，处理器51执行的根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置的程序，可以包括：In this embodiment, the program executed by the processor 51 to determine the location of the user terminal in the indoor map according to the comparison result may include:
根据所述比较结果选择所述多个图像数据中与所述采集图像中的所述店门的图像数据最相近的图像数据作为参考图像数据，并将所述参考图像数据在所述室内地图中绑定的位置作为所述用户终端在所述室内地图中所处的位置。According to the comparison result, select the image data closest to the image data of the store door in the collected image as the reference image data among the plurality of image data, and store the reference image data in the indoor map The bound location is used as the location of the user terminal in the indoor map.
本实施例中，处理器51执行的根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置的程序，可以包括：In this embodiment, the program executed by the processor 51 to determine the location of the user terminal in the indoor map according to the comparison result may include:
根据所述比较结果表示的所述采集图像中的所述店门的图像数据与所述室内地图中的店门的图像数据的差异值，以所述室内地图中的店门的图像数据在所述室内地图中绑定的位置为基准计算所述用户终端在所述室内地图中所处的位置。According to the difference value between the image data of the store door in the collected image and the image data of the store door in the indoor map represented by the comparison result, the image data of the store door in the indoor map is used in the calculating the location of the user terminal in the indoor map based on the location bound in the indoor map.
本实施例中，处理器51执行的采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据的程序，可以包括：In this embodiment, the acquisition performed by the processor 51 includes the acquired image of the store door, and the store information of the store to which the store door belongs is extracted from the acquired image, and the program for extracting the image data of the store door may include :
采集包括多个店门的采集图像，选择所述采集图像中最大的店门作为参考店门，并从所述采集图像中提取所述参考店门所属店铺的店铺信息，以及提取所述参考店门的图像数据。Collecting a collection image including a plurality of store doors, selecting the largest store door in the collection image as a reference store door, and extracting the store information of the store to which the reference store door belongs from the collection image, and extracting the reference store The image data of the door.
本实施例中，上述用户终端可以具备拍摄功能的智能终端，例如：平板电脑、手机、电子阅读器、笔记本电脑、可穿戴设备等具有网络功能的智能设备。In this embodiment, the above-mentioned user terminal may be an intelligent terminal with a shooting function, such as a tablet computer, a mobile phone, an e-reader, a notebook computer, a wearable device, and other intelligent devices with network functions.
本实施例中，用户终端采集包括店门的采集图像，并从所述采集图像中提取所述店门所属店铺的店铺信息，以及提取所述店门的图像数据；所述用户终端使用所述店铺信息在预先获取的室内地图中查找所述店铺的店门的图像数据；所述用户终端将所述采集图像中的所述店门的图像数据与所述室内地图中的店门的图像数据进行比较，以获取比较结果；所述用户终端根据所述比较结果确定在所述用户终端在所述室内地图中所处的位置。这样用户终端在室内环境时可以使采集的图像数据进行定位，即本发明实施例可以实现用户终端定位，以及提高定位准确度。In this embodiment, the user terminal collects the collected image including the store door, and extracts the store information of the store to which the store door belongs from the collected image, and extracts the image data of the store door; the user terminal uses the The store information searches for the image data of the store door in the pre-acquired indoor map; the user terminal combines the image data of the store door in the collected image with the image data of the store door in the indoor map performing a comparison to obtain a comparison result; the user terminal determines the location of the user terminal in the indoor map according to the comparison result. In this way, when the user terminal is in an indoor environment, the collected image data can be positioned, that is, the embodiment of the present invention can realize the positioning of the user terminal and improve the positioning accuracy.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的程序可存储于一计算机可读取存储介质中，该程序在执行时，可包括如上述各方法的实施例的流程。其中，所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory，ROM)或随机存取存储器(Random AccessMemory，简称RAM)等。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented through computer programs to instruct related hardware, and the programs can be stored in a computer-readable storage medium. During execution, it may include the processes of the embodiments of the above-mentioned methods. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM for short).
以上所揭露的仅为本发明较佳实施例而已，当然不能以此来限定本发明之权利范围，因此依本发明权利要求所作的等同变化，仍属本发明所涵盖的范围。The above disclosures are only preferred embodiments of the present invention, and certainly cannot limit the scope of rights of the present invention. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510737850.4ACN105354296B (en) | 2015-10-31 | 2015-10-31 | A kind of method of locating terminal and user terminal |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510737850.4ACN105354296B (en) | 2015-10-31 | 2015-10-31 | A kind of method of locating terminal and user terminal |
| Publication Number | Publication Date |
|---|---|
| CN105354296A CN105354296A (en) | 2016-02-24 |
| CN105354296Btrue CN105354296B (en) | 2018-06-29 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510737850.4AExpired - Fee RelatedCN105354296B (en) | 2015-10-31 | 2015-10-31 | A kind of method of locating terminal and user terminal |
| Country | Link |
|---|---|
| CN (1) | CN105354296B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106855946A (en)* | 2016-12-27 | 2017-06-16 | 努比亚技术有限公司 | A kind of image information acquisition method and apparatus |
| CN106846311B (en)* | 2017-01-21 | 2023-10-13 | 吴东辉 | Positioning and AR methods and systems and applications based on image recognition |
| CN107671863B (en)* | 2017-08-22 | 2020-06-26 | 广东美的智能机器人有限公司 | Robot control method and device based on two-dimensional code and robot |
| CN107687855B (en)* | 2017-08-22 | 2020-07-31 | 广东美的智能机器人有限公司 | Robot positioning method and device and robot |
| CN108871314B (en)* | 2018-07-18 | 2021-08-17 | 江苏实景信息科技有限公司 | Positioning and attitude determining method and device |
| CN112286176A (en)* | 2019-07-24 | 2021-01-29 | 北京石头世纪科技股份有限公司 | Autonomous mobile robot and its control method, medium and system |
| CN116861025A (en)* | 2023-06-19 | 2023-10-10 | 深圳市毫准科技有限公司 | Indoor shop information acquisition method and related equipment based on visual global positioning |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103424113A (en)* | 2013-08-01 | 2013-12-04 | 毛蔚青 | Indoor positioning and navigating method of mobile terminal based on image recognition technology |
| CN103903253A (en)* | 2012-12-28 | 2014-07-02 | 联想(北京)有限公司 | Mobile terminal positioning method and system |
| CN104899603A (en)* | 2015-06-03 | 2015-09-09 | 孙思宇 | Optimization algorithm based on image matching indoor positioning |
| CN104936283A (en)* | 2014-03-21 | 2015-09-23 | 中国电信股份有限公司 | Indoor positioning method, server and system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103903253A (en)* | 2012-12-28 | 2014-07-02 | 联想(北京)有限公司 | Mobile terminal positioning method and system |
| CN103424113A (en)* | 2013-08-01 | 2013-12-04 | 毛蔚青 | Indoor positioning and navigating method of mobile terminal based on image recognition technology |
| CN104936283A (en)* | 2014-03-21 | 2015-09-23 | 中国电信股份有限公司 | Indoor positioning method, server and system |
| CN104899603A (en)* | 2015-06-03 | 2015-09-09 | 孙思宇 | Optimization algorithm based on image matching indoor positioning |
| Publication number | Publication date |
|---|---|
| CN105354296A (en) | 2016-02-24 |
| Publication | Publication Date | Title |
|---|---|---|
| CN105354296B (en) | A kind of method of locating terminal and user terminal | |
| KR101854554B1 (en) | Method, device and storage medium for calculating building height | |
| JP5722502B2 (en) | Planar mapping and tracking for mobile devices | |
| CN105578027B (en) | A kind of photographic method and device | |
| CN104866804B (en) | A kind of method and apparatus of palm print information identification | |
| CN104199906B (en) | A kind of recommendation method and device of shooting area | |
| WO2021136386A1 (en) | Data processing method, terminal, and server | |
| CN104754234B (en) | A kind of photographic method and device | |
| KR102297217B1 (en) | Method and apparatus for identifying object and object location equality between images | |
| WO2016199662A1 (en) | Image information processing system | |
| EP2764325A1 (en) | Using videogrammetry to fabricate parts | |
| CN108027884A (en) | Optimization object detects | |
| CN113610967B (en) | Three-dimensional point detection method, three-dimensional point detection device, electronic equipment and storage medium | |
| WO2017054442A1 (en) | Image information recognition processing method and device, and computer storage medium | |
| CN105072348B (en) | A kind of method, apparatus and terminal of rapid focus face | |
| CN110245643B (en) | Target tracking shooting method, device and electronic device | |
| JP2011039974A (en) | Image search method and system | |
| CN112183431A (en) | Real-time pedestrian number statistical method and device, camera and server | |
| CN107193820B (en) | Location information acquisition method, device and device | |
| EP2959406B1 (en) | Automatic image rectification for visual search | |
| CN111294552A (en) | Image acquisition equipment determination method and device | |
| CN103327251B (en) | A kind of multimedia photographing process method, device and terminal equipment | |
| CN107992816A (en) | Photographing search method and device and electronic equipment | |
| CN104596509B (en) | Positioning method and system, and mobile terminal | |
| KR20220002626A (en) | Picture-based multidimensional information integration method and related devices |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder | Address after:Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before:Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee before:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. | |
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20180629 |