技术领域technical field
本发明涉及地图信息显示和增强现实技术领域，特别是涉及一种实现纸质地图与电子地图结合显示的方法及装置。The invention relates to the technical fields of map information display and augmented reality, in particular to a method and device for realizing the combined display of paper maps and electronic maps.
背景技术Background technique
增强现实(Augmented Reality，简称AR)是在虚拟现实的基础上发展起来的技术。它可以把计算机产生的虚拟图像与真实的世界进行叠加，令虚拟图像和真实世界能够合并显示，对于用户对真实世界的感知与交互能力有很好的增强效果。而且增强现实技术具有实时交互的性质，只要是具有摄像功能和显示屏的设备都可以满足要求。Augmented Reality (AR for short) is a technology developed on the basis of virtual reality. It can superimpose the virtual image generated by the computer with the real world, so that the virtual image and the real world can be combined and displayed, which has a good effect on enhancing the user's perception and interaction ability of the real world. Moreover, augmented reality technology has the nature of real-time interaction, as long as it is a device with a camera function and a display screen, it can meet the requirements.
纸质地形图是将地面上的地物地貌等按照平行投影的方法、一定的比例尺缩绘到图纸上，形成表示地表起伏形态和地理位置、形状的平面投影图。这是传统使用的地形图，通过它可以同时观察大范围内的地形、并且在需要的地方进行标记、使用方便、便于携带，这些都是纸质地形图的优点。但是随着科技迅速发展，人们所知道的信息快速增多，纸质地形图只能包含有限的信息量，无法全面及时的反映大量相关的信息，这是它的主要缺点。The paper topographic map is to shrink the ground objects and landforms on the ground according to the method of parallel projection and a certain scale to form a planar projection map showing the surface undulations, geographical location and shape. This is a traditional topographic map, through which you can observe a large area of terrain at the same time, and mark where needed, easy to use, easy to carry, these are the advantages of paper topographic maps. However, with the rapid development of science and technology, the information that people know is increasing rapidly. The paper topographic map can only contain a limited amount of information and cannot fully and timely reflect a large amount of relevant information. This is its main shortcoming.
而电子地形图即在计算机屏幕上绘制和显示的地形图，它拥有大量精确的数据信息，这是纸质地形图难易相比的。但是因为屏幕大小有限，电子地形图无法观察大范围的整体地形，进行标记也比较麻烦。在实际使用中，单独使用纸质地形图或者电子地形图都有一定不足，因此我们希望可以将它们结合起来使用。The electronic topographic map is the topographic map drawn and displayed on the computer screen, which has a large amount of accurate data information, which is difficult to compare with the paper topographic map. However, due to the limited size of the screen, the electronic topographic map cannot observe the overall terrain in a large area, and it is troublesome to mark it. In actual use, there are certain deficiencies in using paper topographic maps or electronic topographic maps alone, so we hope that they can be used in combination.
但是对于纸质地形图和电子地形图结合显示来说，增强现实技术最大的不足在于标识物图像单一且不具有代表意义，不方便用户使用。However, for the combined display of paper topographic maps and electronic topographic maps, the biggest disadvantage of augmented reality technology is that the images of markers are single and not representative, which is inconvenient for users to use.
发明内容Contents of the invention
本发明的目的是提供一种实现纸质地图与电子地图结合显示的方法及装置，目的在于综合利用纸质地图与电子地图的优点，弥补其不足，方便用户的使用。The purpose of the present invention is to provide a method and device for realizing the combined display of paper map and electronic map. The purpose is to make comprehensive use of the advantages of paper map and electronic map, make up for their shortcomings, and facilitate the use of users.
为解决上述技术问题，本发明提供一种实现纸质地图与电子地图结合显示的方法，包括：In order to solve the above technical problems, the present invention provides a method for realizing the combined display of paper maps and electronic maps, including:
捕获纸质地图的图像，从所述图像中检测出标识物，所述标识物为经过预先训练的标识物，所述标识物的内部图案为以所述纸质地图为背景的图案；capturing an image of a paper map, and detecting a marker from the image, the marker is a pre-trained marker, and the internal pattern of the marker is a pattern with the paper map as the background;
通过所述标识物的边框及内部图案计算得到所述标识物的位置信息及方向信息；Obtaining position information and direction information of the marker through calculating the frame and internal pattern of the marker;
将所述标识物的内部图案与预设的标识物模板进行比对，获取与所述标识物相对应的模型；Comparing the internal pattern of the marker with a preset marker template to obtain a model corresponding to the marker;
根据所述位置信息及方向信息，在纸质地图与电子地图结合显示的场景中对所述模型进行显示。According to the position information and direction information, the model is displayed in a scene where a paper map and an electronic map are combined.
可选地，在所述捕获纸质地图的图像，从所述图像中检测出标识物之前还包括：Optionally, before capturing the image of the paper map and detecting the marker from the image, the method further includes:
预先对多个标识物进行识别训练，建立标识物模板。Recognition training is performed on multiple markers in advance, and marker templates are established.
可选地，所述标识物的边框为边长60毫米、宽度10毫米的黑色边框。Optionally, the frame of the marker is a black frame with a side length of 60 mm and a width of 10 mm.
可选地，所述将所述标识物的内部图案与预设的标识物模板进行比对，获取与所述标识物相对应的模型包括：Optionally, comparing the internal pattern of the marker with a preset marker template, and obtaining a model corresponding to the marker includes:
当检测到的标识物为多个时，将所述多个标识物的内部图案分别与预设的标识物模板进行比对，获取与各个标识物相对应的多个模型，以同时对所述标识物进行识别。When there are multiple detected markers, compare the internal patterns of the multiple markers with the preset marker templates to obtain multiple models corresponding to each marker, so as to simultaneously analyze the identifiers for identification.
可选地，在所述根据所述位置信息及方向信息，在纸质地图与电子地图结合显示的场景中对所述模型进行显示之后还包括：Optionally, after displaying the model in the scene where the paper map and the electronic map are combined and displayed according to the location information and direction information, the method further includes:
响应用户输入的对所述模型进行缩放、平移或旋转操作的控制指令。Responsive to user-input control instructions for zooming, translating, or rotating the model.
可选地，所述用户通过键盘、鼠标或菜单输入所述控制指令。Optionally, the user inputs the control instruction through a keyboard, a mouse or a menu.
可选地，所述模型为3D模型。Optionally, the model is a 3D model.
本发明还提供了一种实现纸质地图与电子地图结合显示的装置，包括：The present invention also provides a device for realizing the combined display of a paper map and an electronic map, including:
检测模块，用于捕获纸质地图的图像，从所述图像中检测出标识物，所述标识物为经过预先训练的标识物，所述标识物的内部图案为以所述纸质地图为背景的图案；A detection module, configured to capture an image of a paper map, and detect a marker from the image, the marker is a pre-trained marker, and the internal pattern of the marker is the background of the paper map picture of;
计算模块，用于通过所述标识物外框及内部图案计算得到所述标识物的位置信息及方向信息；A calculation module, configured to calculate the position information and direction information of the marker through the outer frame and internal pattern of the marker;
获取模块，用于将所述标识物的内部图案与预设的标识物模板进行比对，获取与所述标识物相对应的模型；An acquisition module, configured to compare the internal pattern of the marker with a preset marker template, and acquire a model corresponding to the marker;
显示模块，用于根据所述位置信息及方向信息，在纸质地图与电子地图结合显示的场景中对所述模型进行显示。The display module is used to display the model in the scene where the paper map and the electronic map are combined and displayed according to the position information and the direction information.
可选地，还包括：Optionally, also include:
建立模块，用于在所述检测模块捕获纸质地图的图像，从所述图像中检测出标识物之前，预先对所述标识物进行识别训练，建立标识物模板。The establishment module is used to perform identification training on the markers in advance before the detection module captures the image of the paper map and detects the markers from the image, and establishes a template of the markers.
可选地，还包括：Optionally, also include:
响应模块，用于在所述显示模块根据所述位置信息及方向信息，在纸质地图与电子地图结合显示的场景中对所述模型进行显示之后，响应用户输入的对所述模型进行缩放、平移或旋转操作的控制指令。a response module, configured to respond to user input to zoom, zoom, and Control commands for translation or rotation operations.
本发明所提供的实现纸质地图与电子地图结合显示的方法及装置，通过对原标识物进行改进，将纸质地图上的图案直接用作标识物的内部图案，来获得大量互不相同的标识物。与原标识物的固定图案相比，本发明所提供的实现纸质地图与电子地图结合显示的方法及装置，其标识物具有自己的含义，不必用户自己设计标识物图案，使用户的使用更加方便。The method and device for realizing the combined display of paper maps and electronic maps provided by the present invention, by improving the original markers, the patterns on the paper maps are directly used as the internal patterns of the markers to obtain a large number of different identifier. Compared with the fixed pattern of the original marker, the method and device for realizing the combined display of the paper map and the electronic map provided by the present invention, the marker has its own meaning, and the user does not need to design the marker pattern by himself, which makes the user's use more convenient. Convenience.
附图说明Description of drawings
图1为本发明所提供的实现纸质地图与电子地图结合显示的方法的一种具体实施方式的流程图；Fig. 1 is a flow chart of a specific embodiment of the method for realizing the combined display of a paper map and an electronic map provided by the present invention;
图2为本发明所提供的实现纸质地图与电子地图结合显示的方法的另一种具体实施方式的流程图；Fig. 2 is a flow chart of another specific embodiment of the method for realizing the combined display of paper map and electronic map provided by the present invention;
图3为本发明所提供的实现纸质地图与电子地图结合显示的方法的效果图；Fig. 3 is an effect diagram of the method for realizing the combined display of a paper map and an electronic map provided by the present invention;
图4为本发明所提供的实现纸质地图与电子地图结合显示的装置的一种具体实施方式的结构框图。Fig. 4 is a structural block diagram of a specific embodiment of a device for realizing the combined display of a paper map and an electronic map provided by the present invention.
具体实施方式detailed description
增强现实技术可以做到将计算机产生的虚拟图像和真实的世界进行叠加，令用户可以同时对真实世界和虚拟世界进行融合观察。在本发明中，纸质地图即真实世界，电子地图的数据信息可以转换成计算机产生的虚拟图像，将它们使用增强现实技术进行融合显示。Augmented reality technology can superimpose the virtual image generated by the computer and the real world, so that users can simultaneously observe the real world and the virtual world. In the present invention, the paper map is the real world, and the data information of the electronic map can be converted into a virtual image generated by a computer, and they are fused and displayed using augmented reality technology.
为了使本技术领域的人员更好地理解本发明方案，下面结合附图和具体实施方式对本发明作进一步的详细说明。显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。In order to enable those skilled in the art to better understand the solution of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
本发明所提供的实现纸质地图与电子地图结合显示的方法的一种具体实施方式的流程图如图1所示，该方法包括：A flow chart of a specific embodiment of the method for realizing the combined display of a paper map and an electronic map provided by the present invention is shown in Figure 1. The method includes:
步骤S101：捕获纸质地图的图像，从所述图像中检测出标识物，所述标识物为经过预先训练的标识物，所述标识物的内部图案为以所述纸质地图为背景的图案；Step S101: Capture an image of a paper map, and detect a marker from the image, the marker is a pre-trained marker, and the internal pattern of the marker is a pattern with the paper map as the background ;
步骤S102：通过所述标识物的边框及内部图案计算得到所述标识物的位置信息及方向信息；Step S102: Calculate the position information and direction information of the marker through the frame and internal pattern of the marker;
步骤S103：将所述标识物的内部图案与预设的标识物模板进行比对，获取与所述标识物相对应的模型；Step S103: comparing the internal pattern of the marker with the preset marker template to obtain a model corresponding to the marker;
步骤S104：根据所述位置信息及方向信息，在纸质地图与电子地图结合显示的场景中对所述模型进行显示。Step S104: According to the location information and direction information, display the model in a scene where the paper map and the electronic map are combined.
本发明所提供的实现纸质地图与电子地图结合显示的方法，通过对原标识物进行改进，将纸质地图上的图案直接用作标识物的内部图案，来获得大量互不相同的标识物。与原标识物的固定图案相比，本发明所提供的实现纸质地图与电子地图结合显示的方法，其标识物具有自己的含义，不必用户自己设计标识物图案，使用户的使用更加方便。The method for realizing the combined display of paper maps and electronic maps provided by the present invention obtains a large number of different markers by improving the original markers and directly using the patterns on the paper maps as the inner patterns of markers . Compared with the fixed pattern of the original markers, the method for realizing the combined display of the paper map and the electronic map provided by the present invention has its own meanings for the markers, and the user does not need to design marker patterns by himself, which makes the user's use more convenient.
现有增强现实技术中原本的标识物很不适用，主要是由于：(1)原标识物的尺寸是固定的，不能在纸质地图上灵活使用；(2)原标识物的图案是固定的，而本申请中则需要大量的标识物，而逐一设计互不相同的标识物是很困难的，标识物不具有特定的意义也会增加实际应用的难度。The original markers in the existing augmented reality technology are not applicable, mainly because: (1) the size of the original markers is fixed and cannot be flexibly used on paper maps; (2) the pattern of the original markers is fixed , while a large number of markers are needed in this application, and it is very difficult to design different markers one by one, and the lack of specific meaning of the markers will also increase the difficulty of practical application.
因此，本发明提供了实现纸质地图与电子地图结合显示的方法的另一种具体实施方式，其流程图如图2所示，与上一实施例相比，本实施例中增加了对标识物进行训练的过程，能够实现同时识别多个标识物并且增加了用户交互功能，该方法包括：Therefore, the present invention provides another specific embodiment of the method for realizing the combined display of paper maps and electronic maps, the flow chart of which is shown in Figure 2. Compared with the previous embodiment, the identification The process of training objects can realize simultaneous recognition of multiple markers and increase the user interaction function. The method includes:
步骤S201：预先对多个标识物进行识别训练，建立标识物模板；Step S201: performing recognition training on multiple markers in advance, and establishing marker templates;
增强现实的开发包中原有的标识物是由边长为80mm，宽度为40mm的黑色边框包围的白色背景的图案，由于它的尺寸不够灵活，设计大量互不相同的图案也很困难，所以在实现纸质地形图和电子地形图结合的过程中并不实用。本发明将标识物的尺寸变为边长60mm，宽度10mm的黑色边框包围的任意非对称图案，这样的大小满足容易训练和识别、不过多的遮挡纸质地图的内容、有足够的空间来设计标识物图案的要求，能够使标识物的使用更加方便灵活，用在纸质地图上非常合适。The original logo in the augmented reality development kit is a pattern with a white background surrounded by a black border with a side length of 80mm and a width of 40mm. Because its size is not flexible enough, it is also difficult to design a large number of different patterns. It is not practical to realize the combination of paper topographic map and electronic topographic map. The present invention changes the size of the marker into any asymmetrical pattern surrounded by a black frame with a side length of 60 mm and a width of 10 mm. This size meets the requirements of easy training and identification, does not block the content of the paper map too much, and has enough space for design The requirement of marker patterns can make the use of markers more convenient and flexible, which is very suitable for use on paper maps.
其次，以纸质地图上的地形地貌构成复杂，极少有重复的情况，因此将纸质地图上的图案直接用作标识物。这样做不仅可以获得大量互不相同的标识物，而且标识物具有自己的含义，不必用户自己设计标识物图案，也能避免用户过多的麻烦，使本发明更加方便实用。Secondly, the terrain and landforms on the paper map are complex and rarely repeated, so the patterns on the paper map are directly used as markers. In this way, not only can a large number of different markers be obtained, but also the markers have their own meanings, and the user does not need to design marker patterns by himself, and can avoid too much trouble for the user, making the present invention more convenient and practical.
步骤S202：使用摄像头捕获视频，从中检测标识物；Step S202: Use the camera to capture the video, and detect the marker therefrom;
步骤S203：通过所述标识物的边框及内部图案计算得到所述标识物的位置信息及方向信息；Step S203: Calculate the position information and direction information of the marker through the frame and internal pattern of the marker;
步骤S204：当检测到的标识物为多个时，将所述多个标识物的内部图案分别与预设的标识物模板进行比对，获取与各个标识物相对应的多个模型，以同时对所述标识物进行识别；Step S204: When there are multiple detected markers, compare the internal patterns of the multiple markers with the preset marker templates to obtain multiple models corresponding to each marker, and simultaneously identifying the identifier;
为了能够实现同时识别多个标识物并渲染不同模型的功能，需要预先设置一个标识物模板列表，用于存放多个标识物模板的信息；设置一个值，用于存放标识物模板的总数量；设置一个数组和一个变量，用于存放模型及控制渲染哪个模型。In order to realize the function of recognizing multiple markers and rendering different models at the same time, it is necessary to pre-set a marker template list to store the information of multiple marker templates; set a value to store the total number of marker templates; Set up an array and a variable to hold the models and control which models are rendered.
步骤S205：根据所述位置信息及方向信息，在纸质地图与电子地图结合显示的场景中对所述模型进行显示；Step S205: According to the location information and direction information, display the model in the scene where the paper map and the electronic map are combined;
具体地，根据想要与纸质地图结合显示的电子地图的数据信息制作相应的模型。只要最终获得的模型为mqo格式，可以充分展示电子地图中想要的信息即可。Specifically, a corresponding model is made according to the data information of the electronic map to be displayed in combination with the paper map. As long as the final obtained model is in mqo format, it can fully display the desired information in the electronic map.
mqo格式是软件水杉(Metasequoia)的专有格式，它不仅可以通过水杉软件打开进行查看和修改，也可以通过文本文件的方式进行查看。mqo文件的内容主要包括mqo文件的标题、Scene、Material、Object、点集合等，这些模块是一般mqo文件中都会存在的。其中，文件标题就是该文件的名字；Scene主要定义了图形的初始位置，观察点，环境光等参数；Material中主要定义了材质名称，颜色(col)，扩散光(dif)，环境光(amb)，自发光(emi)，反射光(spc)，光强(power)等参数；Object中主要定义了定点集合，面及其UV贴图等。The mqo format is a proprietary format of the software Metasequoia. It can not only be opened for viewing and modification by the Metasequoia software, but also can be viewed in the form of a text file. The content of the mqo file mainly includes the title of the mqo file, Scene, Material, Object, point collection, etc. These modules will exist in the general mqo file. Among them, the file title is the name of the file; Scene mainly defines the initial position of the graphic, observation point, ambient light and other parameters; Material mainly defines the material name, color (col), diffuse light (dif), ambient light (amb ), self-illumination (emi), reflected light (spc), light intensity (power) and other parameters; Object mainly defines fixed-point collections, surfaces and their UV maps, etc.
步骤S206：响应用户输入的对所述模型进行缩放、平移或旋转操作的控制指令。Step S206: Responding to a control command input by the user to operate zooming, translating or rotating the model.
为了增加用户交互功能，使用户可以控制模型的缩放、平移和旋转，可以设置数组来存放用到的缩放、平移和旋转参数。数组的下标代表某个标识物在标识物模板列表中的序号，只要对数组中的某项的参数做出更改，就可以对该下标对应的标识物处渲染的模型进行想要做的操作。In order to increase the user interaction function, so that the user can control the zoom, translation and rotation of the model, an array can be set to store the zoom, translation and rotation parameters used. The subscript of the array represents the serial number of a marker in the marker template list. As long as the parameters of an item in the array are changed, you can do what you want to the model rendered at the marker corresponding to the subscript. operate.
所述用户可以通过键盘、鼠标或菜单输入所述控制指令。这三种交互方式各有自己的优点和适用情况，以平移模型为例：键盘方式通过键盘快捷键对模型进行操作，每次按下快捷键，模型移动的距离是固定的，键盘方式使用户可以观察模型逐渐移动的效果；鼠标方式通过跟踪鼠标按键按下或放开，以及鼠标的位置来对模型进行操作，它的优点在于可以同时使模型在各个方向发生移动；菜单操作通过输入想要模型所处的位置的坐标来控制模型的位置，在想要模型移动到某个特定位置时十分方便，此外，在想要将已经进行过操作的模型移回初始位置是非常实用。将这三种交互方式综合起来使用，基本上可以对模型完成任意想要的操作，能够满足任意数据信息的观察需求。The user can input the control instruction through keyboard, mouse or menu. These three interaction methods have their own advantages and applicable situations. Take the translation model as an example: the keyboard method operates the model through the keyboard shortcut keys, and each time the shortcut key is pressed, the model moves a fixed distance. You can observe the effect of the model moving gradually; the mouse mode operates the model by tracking the mouse button pressed or released, and the position of the mouse. Its advantage is that it can move the model in all directions at the same time; The coordinates of the position of the model are used to control the position of the model, which is very convenient when you want the model to move to a specific position. In addition, it is very practical when you want to move the model that has been operated back to the original position. Combining these three interaction methods can basically complete any desired operation on the model, and can meet the observation needs of any data information.
本发明可具体通过ARToolKit增强现实开发包来完成，ARToolKit是用C/C++语言编写的，可以完成获取每一帧图像并实时现实、识别图像中的标识物、在标识物的位置渲染模型等功能。在ARToolKit已有的源代码的基础上，根据本发明的特定需求对源代码作了以下两种改进：The present invention can be accomplished specifically through the ARToolKit augmented reality development kit. ARToolKit is written in C/C++ language, and can complete functions such as obtaining each frame of image and real-time display, identifying markers in the image, and rendering models at the positions of markers. . On the basis of the existing source code of ARToolKit, the following two improvements have been made to the source code according to the specific requirements of the present invention:
(1)源代码中同时只能识别一个标识物并渲染相应的模型，但是在本发明中，可能会有同时要显示几个不同的数据信息的情况。因此需要修改代码使其能够同时识别多个标识物并且渲染不同的模型；(2)ARToolKit的源代码中没有与用户进行交互的功能，但是在本实施例中，添加了用户进行交互的功能，(1) Only one identifier can be recognized and the corresponding model can be rendered in the source code at the same time, but in the present invention, there may be situations where several different data information should be displayed at the same time. Therefore, it is necessary to modify the code so that it can recognize multiple markers and render different models at the same time; (2) the source code of ARToolKit does not have the function of interacting with the user, but in this embodiment, the function of user interaction is added,
本发明所提供的实现纸质地图与电子地图结合显示的方法的效果图如图3所示，图中背景为等高线图，即纸质地图，山峰模型即使用电子地图的信息所制作的模型。用户在看到纸质地图内容的同时，也从模型中直观的了解到电子地图中有关的信息，使用户的观察更加全面、直观、立体。The effect diagram of the method for realizing the combined display of paper map and electronic map provided by the present invention is shown in Figure 3, the background in the figure is a contour map, that is, a paper map, and the mountain model is made using the information of the electronic map Model. While seeing the content of the paper map, the user also intuitively understands the relevant information in the electronic map from the model, making the user's observation more comprehensive, intuitive and three-dimensional.
针对纸质地形图便于整体观察、易于标注、但是无法及时的反映出越来越多的相关信息；电子地形图拥有丰富而精确的数据信息、但是无法观察到大范围的地形、难以进行必要的标记的特点。本发明所提供的实现纸质地图与电子地图结合显示的方法，既可以从整体上观察地形结构，进行需要的标记，也可以同时知道相关的各类信息。与单独观察某种地形图或单纯的将两种地图进行比照观察相比，不仅使用方便、定位准确，而且便于对地形的观察和分析。Paper topographic maps are convenient for overall observation and labeling, but cannot reflect more and more relevant information in a timely manner; electronic topographic maps have rich and accurate data information, but cannot observe large-scale topography, and it is difficult to carry out necessary Marking characteristics. The method for realizing the combined display of the paper map and the electronic map provided by the present invention can not only observe the terrain structure as a whole, but also perform required marking, and can also know all kinds of relevant information at the same time. Compared with observing a topographic map alone or simply comparing two maps, it is not only convenient to use, accurate in positioning, but also convenient to observe and analyze the topography.
本申请通过对原标识物进行改进，将纸质地图上的图案直接用作标识物的内部图案，来获得大量互不相同的标识物。与原标识物的固定图案相比，本发明所提供的实现纸质地图与电子地图结合显示的方法，其标识物具有自己的含义，不必用户自己设计标识物图案，使用户的使用更加方便。This application obtains a large number of different markers by improving the original markers and directly using the pattern on the paper map as the inner pattern of the markers. Compared with the fixed pattern of the original markers, the method for realizing the combined display of the paper map and the electronic map provided by the present invention has its own meanings for the markers, and the user does not need to design marker patterns by himself, which makes the user's use more convenient.
需要指出的是，本发明所提供的实现纸质地图与电子地图结合显示的方法，可以应用于其他多种地图，例如城市规划图、人口分布图等各类地图的纸质版和电子版都有相应的优点和缺点，考虑这些优点和缺点并进行适当的结合，对于各类情况的研究有不同的意义。It should be pointed out that the method for realizing the combined display of paper maps and electronic maps provided by the present invention can be applied to other kinds of maps, such as urban planning maps, population distribution maps, and other paper and electronic versions of maps. There are corresponding advantages and disadvantages. Considering these advantages and disadvantages and combining them appropriately have different meanings for the research of various situations.
本发明所提供的实现纸质地图与电子地图结合显示的方法，还可以使用3D模型表示部分信息。这样能够避免只使用常用的文字、图片、表格等信息表示方法会导致观察效果不够直观的缺点。The method for realizing the combined display of the paper map and the electronic map provided by the present invention can also use a 3D model to represent part of the information. This can avoid the disadvantage that the observation effect is not intuitive enough by only using commonly used information representation methods such as text, pictures, and tables.
本发明所提供的实现纸质地图与电子地图结合显示的方法，可以在多种终端使用。本申请充分利用现在移动智能设备非常普及的现状，弥补电脑移动不便、有使用环境限制的不足，使手机、平板电脑、甚至谷歌眼镜等具有摄像功能和显示屏的设备都可以进行纸质地形图和电子地形图结合显示的观察。The method for realizing the combined display of the paper map and the electronic map provided by the present invention can be used in various terminals. This application makes full use of the current situation that mobile smart devices are very popular, and makes up for the inconvenient movement of computers and the limitations of the use environment, so that mobile phones, tablet computers, and even Google Glass and other devices with camera functions and display screens can be used for paper topographic maps. Views displayed in conjunction with electronic topographic maps.
本发明所提供的实现纸质地图与电子地图结合显示的装置的一种具体实施方式的结构框图如图4所示，该装置包括：A structural block diagram of a specific embodiment of a device for realizing the combined display of a paper map and an electronic map provided by the present invention is shown in Figure 4. The device includes:
检测模块1，用于捕获纸质地图的图像，从所述图像中检测出标识物，所述标识物为经过预先训练的标识物，所述标识物的内部图案为以所述纸质地图为背景的图案；The detection module 1 is configured to capture an image of a paper map, and detect a marker from the image, the marker is a pre-trained marker, and the internal pattern of the marker is based on the paper map the pattern of the background;
计算模块2，用于通过所述标识物外框及内部图案计算得到所述标识物的位置信息及方向信息；Calculation module 2, used to calculate the position information and direction information of the marker through the outer frame and internal pattern of the marker;
获取模块3，用于将所述标识物的内部图案与预设的标识物模板进行比对，获取与所述标识物相对应的模型；An acquisition module 3, configured to compare the internal pattern of the marker with a preset marker template, and acquire a model corresponding to the marker;
显示模块4，用于根据所述位置信息及方向信息，在纸质地图与电子地图结合显示的场景中对所述模型进行显示。The display module 4 is configured to display the model in a scene where a paper map and an electronic map are combined and displayed according to the position information and direction information.
优选地，本发明所提供的实现纸质地图与电子地图结合显示的装置还可以进一步包括：Preferably, the device for realizing the combined display of a paper map and an electronic map provided by the present invention may further include:
建立模块5，用于在所述检测模块捕获纸质地图的图像，从所述图像中检测出标识物之前，预先对所述标识物进行识别训练，建立标识物模板。The establishment module 5 is used for performing recognition training on the markers before the detection module captures the image of the paper map and detects the markers from the image, and establishes a marker template.
响应模块6，用于在所述显示模块根据所述位置信息及方向信息，在纸质地图与电子地图结合显示的场景中对所述模型进行显示之后，响应用户输入的对所述模型进行缩放、平移或旋转操作的控制指令。Response module 6, configured to zoom the model in response to user input after the display module displays the model in the scene where the paper map and the electronic map are combined and displayed according to the position information and direction information , translation or rotation control commands.
本发明所提供的实现纸质地图与电子地图结合显示的装置，通过对原标识物进行改进，将纸质地图上的图案直接用作标识物的内部图案，来获得大量互不相同的标识物。与原标识物的固定图案相比，本发明所提供的实现纸质地图与电子地图结合显示的装置，其标识物具有自己的含义，不必用户自己设计标识物图案，使用户的使用更加方便。The device for realizing the combined display of paper maps and electronic maps provided by the present invention obtains a large number of different markers by improving the original markers and directly using the patterns on the paper maps as the inner patterns of markers . Compared with the fixed pattern of the original marker, the device for realizing the combined display of the paper map and the electronic map provided by the present invention has its own meaning, and the user does not need to design the marker pattern by himself, which makes the user's use more convenient.
本发明所提供的实现纸质地图与电子地图结合显示的装置的其他设置与方法相同，在此不再赘述。Other settings and methods of the device for realizing the combined display of paper maps and electronic maps provided by the present invention are the same, and will not be repeated here.
本说明书中各个实施例采用递进的方式描述，每个实施例重点说明的都是与其它实施例的不同之处，各个实施例之间相同或相似部分互相参见即可。Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same or similar parts of each embodiment can be referred to each other.
对所公开的实施例的上述说明，使本领域专业技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的，本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下，在其它实施例中实现。因此，本发明将不会被限制于本文所示的这些实施例，而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510271387.9ACN104821135B (en) | 2015-05-25 | 2015-05-25 | It is a kind of to realize the method and device that paper map is combined display with electronic map |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510271387.9ACN104821135B (en) | 2015-05-25 | 2015-05-25 | It is a kind of to realize the method and device that paper map is combined display with electronic map |
| Publication Number | Publication Date |
|---|---|
| CN104821135A CN104821135A (en) | 2015-08-05 |
| CN104821135Btrue CN104821135B (en) | 2017-07-11 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510271387.9AExpired - Fee RelatedCN104821135B (en) | 2015-05-25 | 2015-05-25 | It is a kind of to realize the method and device that paper map is combined display with electronic map |
| Country | Link |
|---|---|
| CN (1) | CN104821135B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105185222B (en)* | 2015-09-24 | 2018-03-06 | 百度在线网络技术（北京）有限公司 | A kind of map renders methods of exhibiting and device |
| CN108304593B (en)* | 2018-04-19 | 2020-12-29 | 北京星球时空科技有限公司 | Method for interactive display of paper map and electronic map |
| CN109064878B (en)* | 2018-09-10 | 2021-06-08 | 中国人民解放军海军潜艇学院 | Navigation plotting operation auxiliary method and device |
| CN115002196B (en)* | 2022-05-25 | 2024-01-26 | 国汽智图(北京)科技有限公司 | Data processing method and device and vehicle end acquisition equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101882320A (en)* | 2010-07-14 | 2010-11-10 | 南京市规划局 | Method for digital restoration of urban spatial pattern |
| CN103003786A (en)* | 2010-05-16 | 2013-03-27 | 诺基亚公司 | Method and apparatus for rendering a user interface having a main view portion and a preview portion for location-based services |
| CN104036476A (en)* | 2013-03-08 | 2014-09-10 | 三星电子株式会社 | Method for providing augmented reality, and portable terminal |
| CN104077394A (en)* | 2014-07-01 | 2014-10-01 | 东南大学 | Urban historical map restoration method based on spatial grid hierarchical positioning |
| CN104424841A (en)* | 2013-09-11 | 2015-03-18 | 阿尔派株式会社 | Map display apparatus and display method of character strings on map |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103003786A (en)* | 2010-05-16 | 2013-03-27 | 诺基亚公司 | Method and apparatus for rendering a user interface having a main view portion and a preview portion for location-based services |
| CN101882320A (en)* | 2010-07-14 | 2010-11-10 | 南京市规划局 | Method for digital restoration of urban spatial pattern |
| CN104036476A (en)* | 2013-03-08 | 2014-09-10 | 三星电子株式会社 | Method for providing augmented reality, and portable terminal |
| CN104424841A (en)* | 2013-09-11 | 2015-03-18 | 阿尔派株式会社 | Map display apparatus and display method of character strings on map |
| CN104077394A (en)* | 2014-07-01 | 2014-10-01 | 东南大学 | Urban historical map restoration method based on spatial grid hierarchical positioning |
| Publication number | Publication date |
|---|---|
| CN104821135A (en) | 2015-08-05 |
| Publication | Publication Date | Title |
|---|---|---|
| CN110163048B (en) | Recognition model training method, recognition method and equipment of hand key points | |
| CN105487673B (en) | A kind of man-machine interactive system, method and device | |
| CN100517316C (en) | Image file list display device | |
| EP3183640B1 (en) | Device and method of providing handwritten content in the same | |
| WO2021227628A1 (en) | Electronic device and interaction method therefor | |
| Lin et al. | Ubii: Physical world interaction through augmented reality | |
| EP3058512B1 (en) | Organizing digital notes on a user interface | |
| KR102285699B1 (en) | User terminal for displaying image and image display method thereof | |
| US9733792B2 (en) | Spatially-aware projection pen | |
| US20150040074A1 (en) | Methods and systems for enabling creation of augmented reality content | |
| EP2560145A2 (en) | Methods and systems for enabling the creation of augmented reality content | |
| CN107945283B (en) | Engineering display method based on mobile augmented reality technology and BIM | |
| KR20130088104A (en) | Mobile apparatus and method for providing touch-free interface | |
| WO2022227393A1 (en) | Image photographing method and apparatus, electronic device, and computer readable storage medium | |
| CN107450714A (en) | Man-machine interaction support test system based on augmented reality and image recognition | |
| CN103426202A (en) | Display system and display method for three-dimensional panoramic interactive mobile terminal | |
| CN113892129B (en) | Create a virtual parallax for a 3D appearance | |
| CN104081307A (en) | Image processing apparatus, image processing method, and program | |
| CN104821135B (en) | It is a kind of to realize the method and device that paper map is combined display with electronic map | |
| US12154236B1 (en) | Assisted drawing and writing in extended reality | |
| CN106682652B (en) | Structure surface disease inspection and analysis method based on augmented reality | |
| CN106293099A (en) | Gesture identification method and system | |
| CN103391396A (en) | Display control apparatus, display control method, and program | |
| CN102929387B (en) | Man-machine interaction method and man-machine interaction system based on common paper and pen | |
| CN115115812A (en) | Virtual scene display method and device and storage medium |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20170711 |