技术领域Technical Field
本申请涉及图像处理技术领域，尤其涉及文档扫描方法及装置。The present application relates to the field of image processing technology, and in particular to a document scanning method and device.
背景技术Background technique
用户可以利用智能手机对文档进行拍照扫描获得该文档的电子扫描文件。但是，目前的文档扫描方法在文档扫描过程中存在由于纸张遮挡等原因导致不能准确检测到文档的实际轮廓边界，即文档边界检测结果的准确率低。Users can use smart phones to take photos of documents and scan them to obtain electronic scanned files of the documents. However, the current document scanning methods cannot accurately detect the actual outline boundaries of the document due to reasons such as paper occlusion during the document scanning process, that is, the accuracy of the document boundary detection result is low.
发明内容Summary of the invention
有鉴于此，本申请提供了一种文档扫描方法及装置，以解决至少部分上述问题，其公开的技术方案如下：In view of this, the present application provides a document scanning method and device to solve at least part of the above problems, and the disclosed technical solutions are as follows:
第一方面，本申请提供了一种文档扫描方法，应用于电子设备，所述方法包括：在文档连续扫描模式下，响应于对文档扫描控件的操作执行以下步骤：获取第一待扫描文档的第一顶点位置信息及扫描图像；采集第二待扫描文档的第二图像，并基于所述第二图像获得所述第二待扫描文档的第二顶点位置信息；根据所述第一顶点位置信息和所述第二顶点位置信息确定所述第二待扫描文档的边界存在形变，基于所述第二图像的文档特征点对每次采集的所述第二待扫描文档的图像进行特征点追踪，并统计追踪成功的次数；所述追踪成功的次数大于或等于第一预设次数后，拍摄所述第二待扫描文档的第三图像，并基于所述第三图像获得所述第二待扫描文档的第三顶点位置信息；基于拍摄的所述第二待扫描文档的最新图像和所述第三顶点位置信息获得所述第二待扫描文档的扫描图像。可见，该方案通过检测文档边框是否存在形变判断文档是否存在遮挡，如果是，对文档追踪预设帧数后再进行文档检测和文档图像抓取，从而降低了误检测率和误抓取率，提高了文档扫描结果的准确率。此外，确定文档边框变化较大后，进行实时特征点追踪，无需实时进行文档检测，特征点追踪过程的耗时远远小于文档检测过程的耗时，因此该方案提高了文档扫描速度。In the first aspect, the present application provides a document scanning method, which is applied to an electronic device, and the method includes: in a document continuous scanning mode, in response to the operation of a document scanning control, performing the following steps: obtaining the first vertex position information and the scanned image of a first document to be scanned; collecting the second image of a second document to be scanned, and obtaining the second vertex position information of the second document to be scanned based on the second image; determining that the boundary of the second document to be scanned is deformed according to the first vertex position information and the second vertex position information, tracking the feature points of each image of the second document to be scanned collected based on the document feature points of the second image, and counting the number of successful tracking; after the number of successful tracking is greater than or equal to the first preset number of times, taking a third image of the second document to be scanned, and obtaining the third vertex position information of the second document to be scanned based on the third image; obtaining the scanned image of the second document to be scanned based on the latest image of the second document to be scanned and the third vertex position information. It can be seen that the scheme determines whether the document is blocked by detecting whether the document border is deformed, and if so, the document detection and document image capture are performed after the document is tracked for a preset number of frames, thereby reducing the false detection rate and false capture rate, and improving the accuracy of the document scanning result. In addition, after determining that the document border has changed significantly, real-time feature point tracking is performed without the need for real-time document detection. The time consumption of the feature point tracking process is much less than that of the document detection process, so this solution improves the document scanning speed.
在第一方面的一种可能的实现方式中，所述基于所述第一顶点位置信息和所述第二顶点位置信息确定所述第二待扫描文档的边界存在形变，包括：根据所述第一顶点位置信息获得所述第一待扫描文档的第一边界信息，以及，根据所述第二顶点位置信息获得所述第二待扫描文档的第二边界信息，所述第一边界信息包括所述第一待扫描文档各个边界的长度和位置；获取所述第一待扫描文档和所述第二待扫描文档的同一边界的长度差值；若所述同一边界的长度差值大于或等于所述第一阈值，确定所述第二待扫描文档的边界存在形变。这样，通常如果文档被遮挡，则根据文档边界的长度可以快速检测到文档是否被遮挡，因此，判断文档边界的长度变化简单且有效。In a possible implementation of the first aspect, the method of determining whether the boundary of the second document to be scanned is deformed based on the first vertex position information and the second vertex position information includes: obtaining the first boundary information of the first document to be scanned based on the first vertex position information, and obtaining the second boundary information of the second document to be scanned based on the second vertex position information, wherein the first boundary information includes the length and position of each boundary of the first document to be scanned; obtaining the length difference of the same boundary of the first document to be scanned and the second document to be scanned; if the length difference of the same boundary is greater than or equal to the first threshold, determining that the boundary of the second document to be scanned is deformed. In this way, if the document is usually obscured, whether the document is obscured can be quickly detected based on the length of the document boundary, so judging the length change of the document boundary is simple and effective.
在第一方面的一种可能的实现方式中，在所述拍摄所述第二待扫描文档的第三图像，并基于所述第三图像获得所述第二待扫描文档的第三顶点位置信息之后，所述方法还包括：采集所述第二待扫描文档的最新图像，并基于所述第二待扫描文档的第三图像的文档特征点，对每次采集的所述第二待扫描文档的图像进行特征点追踪，并统计追踪成功次数获得文档边界稳定次数；所述文档边界稳定次数大于或等于第二预设次数后，执行所述基于拍摄的所述第二待扫描文档的最新图像和所述第三顶点位置信息获得所述第二待扫描文档的扫描图像。可见，该方案在确定文档状态稳定后也可以实时追踪预设帧数，再抓取文档的图像最终获得文档的扫描图像，即待文档状态稳定保持一段时间后再抓取文档的图像，避免由于电子设备抖动或移动导致文档扫描图像不清晰的问题，最终提高了文档扫描图像的准确性，以及降低了对用户的协作要求In a possible implementation of the first aspect, after the third image of the second document to be scanned is captured and the third vertex position information of the second document to be scanned is obtained based on the third image, the method further includes: capturing the latest image of the second document to be scanned, and based on the document feature points of the third image of the second document to be scanned, tracking the feature points of each captured image of the second document to be scanned, and counting the number of successful tracking times to obtain the number of document boundary stabilization times; after the number of document boundary stabilization times is greater than or equal to the second preset number, executing the method of obtaining the scanned image of the second document to be scanned based on the latest image of the second document to be scanned and the third vertex position information. It can be seen that after determining that the document state is stable, the scheme can also track the preset number of frames in real time, and then capture the image of the document to finally obtain the scanned image of the document, that is, the image of the document is captured after the document state is stable for a period of time, so as to avoid the problem of unclear document scanned images due to shaking or movement of the electronic device, and finally improve the accuracy of the document scanned image, and reduce the requirements for user cooperation.
在第一方面的一种可能的实现方式中，所述电子设备包括相机应用和文档追踪模块；所述基于所述第二待扫描文档的第三图像的文档特征点，对每次采集的所述第二待扫描文档的图像进行特征点追踪，并统计追踪成功次数获得文档边界稳定次数，包括：所述文档追踪模块基于所述第三图像的文档特征点，对每次采集的所述第二待扫描文档的图像进行特征点追踪，并向所述相机应用返回追踪结果；所述相机应用接收追踪成功结果后，将文档边界稳定次数加1；所述相机应用接收追踪失败结果后，将文档边界稳定次数清零，以及，通过图像传输通道向所述文档检测模块传输所述第二待扫描文档的最新图像，使得所述文档检测模块检测所述第二待扫描文档的最新图像中的文档以及获得文档的顶点位置信息。可见，该方案由相机应用根据文档跟踪模块反馈的追踪结果维护文档边界稳定次数，以便相机应用在确定文档边界稳定次数达到要求后才触发获得文档的扫描图像的步骤，无需修改底层的算法，只需修改相机应用的处理逻辑，降低了代码修改工作量，提高了程序开发效率。In a possible implementation of the first aspect, the electronic device includes a camera application and a document tracking module; the document tracking module performs feature point tracking on each collected image of the second document to be scanned based on the document feature points of the third image of the second document to be scanned, and counts the number of successful tracking to obtain the number of document boundary stability, including: the document tracking module performs feature point tracking on each collected image of the second document to be scanned based on the document feature points of the third image, and returns the tracking result to the camera application; after the camera application receives the tracking success result, the number of document boundary stability is increased by 1; after the camera application receives the tracking failure result, the number of document boundary stability is cleared to zero, and the latest image of the second document to be scanned is transmitted to the document detection module through an image transmission channel, so that the document detection module detects the document in the latest image of the second document to be scanned and obtains the vertex position information of the document. It can be seen that in this solution, the camera application maintains the number of document boundary stability according to the tracking result fed back by the document tracking module, so that the camera application triggers the step of obtaining the scanned image of the document only after determining that the number of document boundary stability meets the requirement, without modifying the underlying algorithm, only the processing logic of the camera application needs to be modified, which reduces the workload of code modification and improves the efficiency of program development.
在第一方面的一种可能的实现方式中，确定追踪成功的过程，包括：根据特征点追踪信息确定所述第二待扫描文档的最新边界信息；若所述最新边界信息超出所述电子设备的拍摄界面的取景框的比例小于或等于第二阈值，确定追踪成功；或者，若根据所述特征点追踪信息确定本次采集的所述第二待扫描文档的图像中的特征点数量与所述第二图像包含的特征点数量的比值大于第三阈值，确定追踪成功；或者，根据所述特征点追踪信息确定本次采集的所述第二待扫描文档的图像中的追踪顶点信息，若根据同一顶点对应的所述第二顶点位置信息及所述追踪定点信息确定所述同一顶点的角度差值小于第四阈值，确定追踪成功。In a possible implementation of the first aspect, the process of determining successful tracking includes: determining the latest boundary information of the second document to be scanned based on feature point tracking information; if the proportion of the latest boundary information exceeding the viewfinder of the shooting interface of the electronic device is less than or equal to a second threshold, determining that the tracking is successful; or, if it is determined based on the feature point tracking information that the ratio of the number of feature points in the image of the second document to be scanned collected this time to the number of feature points contained in the second image is greater than a third threshold, determining that the tracking is successful; or, if it is determined based on the feature point tracking information that the tracking vertex information in the image of the second document to be scanned collected this time, if it is determined based on the second vertex position information corresponding to the same vertex and the tracking fixed point information that the angle difference of the same vertex is less than a fourth threshold, determining that the tracking is successful.
在第一方面的一种可能的实现方式中，在所述获取第一待扫描文档的第一顶点位置信息及扫描图像之后，所述方法还包括：确定顶点位置参数为空，将所述顶点位置参数赋值为所述第一顶点位置信息。In a possible implementation manner of the first aspect, after obtaining the first vertex position information and the scanned image of the first document to be scanned, the method further includes: determining that a vertex position parameter is empty, and assigning the vertex position parameter to the first vertex position information.
在第一方面的一种可能的实现方式中，所述电子设备包括相机应用、重检判断模块和文档追踪模块；所述根据所述第一顶点位置信息和所述第二顶点位置信息确定所述第二待扫描文档的边界存在形变后，基于所述第二图像的文档特征点对每次采集的所述第二待扫描文档的图像进行特征点追踪，并统计追踪成功的次数，包括：所述重检判断模块根据所述第一顶点位置信息和所述第二顶点位置信息确定所述第二待扫描文档的边界存在形变后，向所述相机应用返回边界存在形变的状态信息，以及将追踪次数设置为0；所述相机应用接收所述边界存在形变的状态信息后，通过图像传输通道向所述文档追踪模块传递每次采集的所述第二待扫描文档的图像；所述文档追踪模块基于所述第二图像的文档特征点对每次采集的所述第二待扫描文档的图像进行特征点追踪，并向所述重建判断模块返回追踪结果；所述重检判断模块接收所述文档追踪模块返回的文档追踪成功结果，将追踪次数加1。In a possible implementation of the first aspect, the electronic device includes a camera application, a re-inspection judgment module and a document tracking module; after determining that the boundary of the second document to be scanned is deformed according to the first vertex position information and the second vertex position information, the image of the second document to be scanned is tracked based on the document feature points of the second image, and the number of successful tracking is counted, including: after the re-inspection judgment module determines that the boundary of the second document to be scanned is deformed according to the first vertex position information and the second vertex position information, the state information of the boundary deformation is returned to the camera application, and the tracking number is set to 0; after the camera application receives the state information of the boundary deformation, it transmits the image of the second document to be scanned each time to the document tracking module through an image transmission channel; the document tracking module tracks the feature points of the second document to be scanned each time based on the document feature points of the second image, and returns the tracking result to the reconstruction judgment module; the re-inspection judgment module receives the document tracking success result returned by the document tracking module and increases the tracking number by 1.
在第一方面的一种可能的实现方式中，所述电子设备还包括文档检测模块，所述方法还包括：所述文档追踪模块确定对所述第二待扫描文档的图像追踪失败后，向所述相机应用返回追踪失败的状态信息；所述相机应用接收所述追踪失败的状态信息后，通过图像传输通道向所述文档检测模块传输所述第二待扫描文档的最新图像，使得所述文档检测模块对所述第二待扫描文档的最新图像进行文档检测获得所述第二待扫描文档的最新顶点位置信息。In a possible implementation of the first aspect, the electronic device also includes a document detection module, and the method also includes: after the document tracking module determines that the image tracking of the second document to be scanned has failed, the document tracking module returns tracking failure status information to the camera application; after the camera application receives the tracking failure status information, the camera application transmits the latest image of the second document to be scanned to the document detection module through an image transmission channel, so that the document detection module performs document detection on the latest image of the second document to be scanned to obtain the latest vertex position information of the second document to be scanned.
在第一方面的一种可能的实现方式中，在所述追踪成功的次数大于或等于第一预设次数后之后，所述方法还包括：通过所述重检判断模块确定所述追踪次数大于或等于所述第一预设次数，向所述相机应用返回扫描指令；所述相机应用响应所述扫描指令，根据所述第二待扫描文档的最后一次成功追踪的图像获得所述第二待扫描文档的扫描图像。In a possible implementation of the first aspect, after the number of successful tracking is greater than or equal to a first preset number of times, the method further includes: determining, by the re-inspection judgment module, that the number of tracking is greater than or equal to the first preset number of times, and returning a scanning instruction to the camera application; the camera application responds to the scanning instruction and obtains a scanned image of the second document to be scanned based on the last successfully tracked image of the second document to be scanned.
第二方面，本申请还提供了一种电子设备，所述电子设备包括：一个或多个处理器、存储器和触摸屏；所述存储器用于存储程序代码；所述处理器用于运行所述程序代码，使得所述电子设备实现如第一方面任一项所述的文档扫描方法。In a second aspect, the present application also provides an electronic device, comprising: one or more processors, a memory and a touch screen; the memory is used to store program code; the processor is used to run the program code, so that the electronic device implements the document scanning method as described in any one of the first aspects.
第三方面，本申请还提供了一种计算机可读存储介质，其上存储有程序代码，当所述程序代码在电子设备上运行时，使得所述电子设备执行如第一方面任一项所述的文档扫描方法。In a third aspect, the present application further provides a computer-readable storage medium having a program code stored thereon. When the program code is executed on an electronic device, the electronic device executes the document scanning method as described in any one of the first aspects.
第四方面，本申请还提供了一种计算机程序产品，其上存储有执行，当所述计算机程序产品在电子设备上运行时，使得所述电子设备实现如第一方面任一项所述的文档扫描方法。In a fourth aspect, the present application further provides a computer program product having an executable program stored thereon. When the computer program product is run on an electronic device, the electronic device implements the document scanning method as described in any one of the first aspects.
应当理解的是，本申请中对技术特征、技术方案、有益效果或类似语言的描述并不是暗示在任意的单个实施例中可以实现所有的特点和优点。相反，可以理解的是对于特征或有益效果的描述意味着在至少一个实施例中包括特定的技术特征、技术方案或有益效果。因此，本说明书中对于技术特征、技术方案或有益效果的描述并不一定是指相同的实施例。进而，还可以任何适当的方式组合本实施例中所描述的技术特征、技术方案和有益效果。本领域技术人员将会理解，无需特定实施例的一个或多个特定的技术特征、技术方案或有益效果即可实现实施例。在其他实施例中，还可在没有体现所有实施例的特定实施例中识别出额外的技术特征和有益效果。It should be understood that the description of technical features, technical solutions, beneficial effects or similar language in this application does not imply that all features and advantages can be realized in any single embodiment. On the contrary, it is understood that the description of features or beneficial effects means that specific technical features, technical solutions or beneficial effects are included in at least one embodiment. Therefore, the description of technical features, technical solutions or beneficial effects in this specification does not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions and beneficial effects described in the present embodiment can also be combined in any appropriate manner. Those skilled in the art will understand that the embodiment can be realized without one or more specific technical features, technical solutions or beneficial effects of a specific embodiment. In other embodiments, additional technical features and beneficial effects can also be identified in a specific embodiment that does not embody all embodiments.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
图1是本申请实施例提供的一种电子设备的结构示意图；FIG1 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
图2是本申请实施例提供的一种电子设备的软件架构示意图；FIG2 is a schematic diagram of a software architecture of an electronic device provided in an embodiment of the present application;
图3是本申请实施例提供的一种启动文档扫描功能的界面示意图；FIG3 is a schematic diagram of an interface for starting a document scanning function provided in an embodiment of the present application;
图4是本申请实施例提供的一种连续文档扫描过程的示意图；FIG4 is a schematic diagram of a continuous document scanning process provided by an embodiment of the present application;
图5是本申请实施例提供的一种文档检测错误过程的示意图；FIG5 is a schematic diagram of a document error detection process provided by an embodiment of the present application;
图6是本申请实施例提供的一种文档扫描方法的流程图。FIG. 6 is a flow chart of a document scanning method provided in an embodiment of the present application.
具体实施方式Detailed ways
本申请说明书和权利要求书及附图说明中的术语“第一”、“第二”和“第三”等是用于区别不同对象，而不是用于限定特定顺序。The terms "first", "second", "third", etc. in the specification, claims and drawings of this application are used to distinguish different objects rather than to limit a specific order.
在本申请实施例中，“示例性的”或者“例如”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言，使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
图1是本申请实施例提供的一种电子设备的结构示意图。该电子设备用于运行本申请提供的文档扫描方法。Fig. 1 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device is used to run the document scanning method provided in the present application.
该电子设备可以是设置有摄像头的电子设备，如手机、平板电脑、桌上型/膝上型笔记本电脑、超级移动个人计算机(Ultra-mobile Personal Computer，UMPC)、手持计算机、上网本、个人数字助理(Personal Digital Assistant，PDA)、可穿戴电子设备。本申请对电子设备的具体形式不做特殊限定。The electronic device may be an electronic device provided with a camera, such as a mobile phone, a tablet computer, a desktop/laptop notebook computer, an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a personal digital assistant (PDA), or a wearable electronic device. The present application does not specifically limit the specific form of the electronic device.
如图1所示，该电子设备可以包括处理器、摄像头、显示屏、触摸传感器、存储器等。As shown in FIG. 1 , the electronic device may include a processor, a camera, a display screen, a touch sensor, a memory, etc.
处理器可以包括一个或多个处理单元，例如，处理器可以包括应用处理器(application processor，AP)，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，数字信号处理器(digital signal processor，DSP)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。The processor may include one or more processing units, for example, the processor may include an application processor (AP), a graphics processing unit (GPU), an image signal processor (ISP), a digital signal processor (DSP), etc. Among them, different processing units may be independent devices or integrated into one or more processors.
存储器可以用于存储计算机可执行程序代码，该可执行程序代码可以包括操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像、视频播放功能等)等。该可执行程序代码包括指令，处理器通过运行存储在存储器的指令，从而使电子设备执行各种功能应用以及数据处理。例如，在本申请中，处理器通过运行存储器中存储的指令，使得电子设备执行本申请提供的文档扫描方法。The memory can be used to store computer executable program codes, which may include an operating system, an application required for at least one function (such as a sound playback function, an image, video playback function, etc.), etc. The executable program code includes instructions, and the processor runs the instructions stored in the memory, thereby enabling the electronic device to perform various functional applications and data processing. For example, in the present application, the processor runs the instructions stored in the memory, so that the electronic device executes the document scanning method provided in the present application.
显示屏用于显示图像、视频、一系列图形用户界面(graphical user interface，GUI)等。电子设备可以包括1个或N个显示屏，N为大于1的正整数。例如，在本申请实施例中，显示屏可以显示相机应用的控件。The display screen is used to display images, videos, a series of graphical user interfaces (GUIs), etc. The electronic device may include 1 or N display screens, where N is a positive integer greater than 1. For example, in an embodiment of the present application, the display screen may display controls for a camera application.
摄像头用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一示例性实施例中，电子设备可以包括1个或N个摄像头，N为大于1的正整数。The camera is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element converts the optical signal into an electrical signal, which is then transmitted to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In an exemplary embodiment, the electronic device may include 1 or N cameras, where N is a positive integer greater than 1.
触摸传感器，也称“触控器件”。触摸传感器可以设置于显示屏之上，由触摸传感器与显示屏组成触摸屏，也称“触控屏”。触摸传感器用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏提供与触摸操作相关的视觉输出。在另一些实施例中，触摸传感器也可以设置于电子设备的表面，与显示屏所处的位置不同。A touch sensor is also called a "touch control device". The touch sensor can be arranged on a display screen. The touch sensor and the display screen form a touch screen, also called a "touch control screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen. In other embodiments, the touch sensor can also be arranged on the surface of the electronic device, which is different from the position of the display screen.
可以理解的是，本实施例示意的结构并不构成对电子设备的具体限定。在另一些实施例中，电子设备可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
另外，在上述部件之上，运行有操作系统，在该操作系统上可以安装运行应用程序。In addition, an operating system runs on the above components, and application programs can be installed and run on the operating system.
电子设备的操作系统可以采用分层架构，事件驱动架构，微核架构，微服务架构，或云架构。本申请实施例以分层架构的系统为例，示例性说明电子设备的软件结构。The operating system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the electronic device is illustrated.
图2是本申请实施例的电子设备的软件结构框图。FIG. 2 is a software structure block diagram of the electronic device according to an embodiment of the present application.
分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。以Android系统为例，在一示例性实施例中，将Android系统分为四层，从上至下分别为应用程序层(Application，APP)，应用程序框架层(Framework)，系统库，硬件抽象层(Hardware Abstraction Layer，HAL)以及系统内核层(Kernel)。The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. Taking the Android system as an example, in an exemplary embodiment, the Android system is divided into four layers, from top to bottom: the application layer (Application, APP), the application framework layer (Framework), the system library, the hardware abstraction layer (HAL) and the system kernel layer (Kernel).
应用程序层可以包括一系列应用程序包，如包括相机、图库、日历、电话、导航等应用程序。The application layer can include a series of application packages, such as camera, gallery, calendar, phone, navigation and other applications.
应用程序框架层为应用程序层的应用程序提供应用编程接口(applicationprogramming interface，API)和编程框架。应用程序框架层包括一些预先定义的函数，如相机服务、窗口管理器，内容提供器，视图系统，电话管理器，资源管理器，通知管理器等。例如，在本申请一示例性实施例中，相机服务提供了上层的相机应用与相机HAL层之间通信的接口。The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions, such as camera service, window manager, content provider, view system, phone manager, resource manager, notification manager, etc. For example, in an exemplary embodiment of the present application, the camera service provides an interface for communication between the upper-layer camera application and the camera HAL layer.
相机HAL可将相机框架API连接到底层的相机驱动程序和硬件。The Camera HAL connects the Camera Framework API to the underlying camera driver and hardware.
在一示例性实施例中，相机HAL可以包括：文档检测模块、重检判断模块和文档追踪模块。In an exemplary embodiment, the camera HAL may include: a document detection module, a re-inspection determination module, and a document tracking module.
文档检测模块用于检测图像中是否包含文档，若包含文档进一步确定文档的四条边界，最终根据四条边界确定文档的四个角点的位置信息(或称为顶点的位置坐标)。The document detection module is used to detect whether the image contains a document. If the image contains a document, the four boundaries of the document are further determined, and finally the position information of the four corner points of the document (or the position coordinates of the vertices) are determined based on the four boundaries.
重检判断模块用于根据文档检测模块获得的文档的角点位置获得文档的边框信息(或称为边界信息，如包括文档每条边的长度及位置等)，进一步，根据文档的边框信息判定文档是否存在遮挡，若存在遮挡则触发文档追踪模块实时追踪文档；若不存在遮挡可以直接触发相机应用自动抓拍文档的图像。The re-inspection judgment module is used to obtain the document's border information (or boundary information, such as the length and position of each edge of the document, etc.) based on the document's corner point positions obtained by the document detection module. Further, it is used to determine whether the document is obstructed based on the document's border information. If there is occlusion, the document tracking module is triggered to track the document in real time; if there is no occlusion, the camera application can be directly triggered to automatically capture the image of the document.
文档追踪模块用于对文档的特征点进行追踪，获得文档角点的位置信息。The document tracking module is used to track the feature points of the document and obtain the location information of the document corner points.
内核层(kernel)是硬件和软件之间的层，至少包括摄像头驱动、相机驱动、触摸驱动等。The kernel layer is the layer between hardware and software, including at least camera driver, camera driver, touch driver, etc.
需要说明的是，本申请实施例虽然以Android系统为例进行说明，但是其基本原理同样适用于基于其他操作系统的电子设备。It should be noted that although the embodiments of the present application are described using the Android system as an example, its basic principles are also applicable to electronic devices based on other operating systems.
下面以手机为例说明文档扫描过程的界面示意图，其他类型电子设备的文档扫描的界面类似，此处不再赘述。The following is an interface diagram of the document scanning process using a mobile phone as an example. The document scanning interfaces of other types of electronic devices are similar and will not be described in detail here.
请参见图3，示出了本申请实施例提供的启动文档扫描功能的界面示意图。Please refer to FIG3 , which shows a schematic diagram of an interface for starting a document scanning function provided in an embodiment of the present application.
如图3的(1)所示，用户可以点击桌面界面上的相机应用图标101，进入图3的(2)所示的拍照界面，位于该界面底部的功能按钮区域包括“更多”按钮102，用户点击“更多”按钮102后进入图3的(3)所示的界面。As shown in (1) of Figure 3, the user can click the camera application icon 101 on the desktop interface to enter the photo taking interface shown in (2) of Figure 3. The function button area at the bottom of the interface includes a "more" button 102. After the user clicks the "more" button 102, the user enters the interface shown in (3) of Figure 3.
如图3的(3)所示，该界面包括多种功能按钮，例如，“文档扫描”按钮103、“慢动作”按钮、“HDR”按钮、“动态照片”按钮、“延时拍摄”按钮、“全景”按钮等。用户点击“文档扫描”按钮103后，进入图3的(4)所示的文档扫描界面104。位于文档扫描界面104顶部的功能按钮区域105内包括多个快捷功能按钮，如连续扫描按钮106，闪光灯按钮、AI摄影大师按钮、设置按钮等。As shown in (3) of FIG. 3 , the interface includes a variety of function buttons, such as a “document scan” button 103, a “slow motion” button, an “HDR” button, a “dynamic photo” button, a “time-lapse shooting” button, a “panorama” button, etc. After the user clicks the “document scan” button 103, the document scan interface 104 shown in (4) of FIG. 3 is entered. The function button area 105 at the top of the document scan interface 104 includes a plurality of shortcut function buttons, such as a continuous scan button 106, a flash button, an AI photography master button, a setting button, etc.
图3的(4)所示的按钮106的状态指示连续扫描功能已开启，在开启连续扫描功能的状态下，用户无需操作取景框下方的拍摄按钮107，手机可以自动抓拍多页文档的图片获得每一页文档的文档扫描图像。The status of the button 106 shown in (4) of Figure 3 indicates that the continuous scanning function has been turned on. When the continuous scanning function is turned on, the user does not need to operate the shooting button 107 below the viewfinder. The mobile phone can automatically capture pictures of multiple pages of documents to obtain document scan images of each page of the document.
可以理解，图3所示的界面仅是示例性附图，可以在相机应用的其他位置(例如，在拍照界面的功能按钮中增加文档扫描的按钮)显示文档扫描的入口，本申请对此不作限定。It can be understood that the interface shown in Figure 3 is only an exemplary illustration, and the document scanning entrance can be displayed in other locations of the camera application (for example, adding a document scanning button to the function buttons of the photo taking interface), and this application does not limit this.
在需要对多张文档进行扫描的场景下，用户只需手动移动已经扫描成功的文档页，无需手动操作拍摄按钮107即可依次获得每一张文档的扫描图像。In a scenario where multiple documents need to be scanned, the user only needs to manually move the document pages that have been successfully scanned, and can obtain the scanned image of each document in sequence without manually operating the shooting button 107 .
例如，重叠放置的多张纸质文档需要进行扫描，如图4的(1)所示，在扫描第一张文档前点击拍摄按钮107即启动文档自动扫描，进入图4的(2)所示的界面，手机会自动检测第一张文档201的轮廓边界(即图中所示的黑色实线框200)，然后自动拍摄第一张文档201的图像，获得如图4的(3)所示的扫描图像202。如图4的(4)所示，第一张文档扫描成功后，用户手动将第一张文档201移走，手机检测到翻到下一张文档203时，自动处理下一张文档。如图4的(5)所示，自动检测第二张文档203的轮廓边界并自动拍摄该文档的图像，如图4的(6)所示，最终获得第二张文档的扫描图像204。后续文档的扫描过程与第二张文档的过程相同，此处不再赘述。For example, multiple overlapping paper documents need to be scanned. As shown in FIG4 (1), before scanning the first document, click the shooting button 107 to start the automatic document scanning, and enter the interface shown in FIG4 (2). The mobile phone will automatically detect the outline boundary of the first document 201 (i.e., the black solid line frame 200 shown in the figure), and then automatically shoot the image of the first document 201 to obtain the scanned image 202 shown in FIG4 (3). As shown in FIG4 (4), after the first document is successfully scanned, the user manually moves the first document 201 away. When the mobile phone detects that the next document 203 has been turned, it automatically processes the next document. As shown in FIG4 (5), the outline boundary of the second document 203 is automatically detected and the image of the document is automatically shot. As shown in FIG4 (6), the scanned image 204 of the second document is finally obtained. The scanning process of subsequent documents is the same as that of the second document, which will not be repeated here.
由图4所示过程可知，自动扫描模式下，用户只需在扫描首张文档之前操作一次拍摄按钮107，即可依次自动检测多张文档的轮廓边界，并自动获得每一张文档的扫描图像。As can be seen from the process shown in FIG. 4 , in the automatic scanning mode, the user only needs to operate the shooting button 107 once before scanning the first document, and the contour boundaries of multiple documents can be automatically detected in sequence, and the scanned image of each document can be automatically obtained.
但是，目前的连续文档扫描方案，由于用户移动纸张的速度慢或纸张遮挡等原因可能导致误检测、误抓取等问题。例如，如图5的(1)所示，第一张文档201扫描完成后，用户移动第一文档201的速度缓慢，导致第二文档203还未完全露出(即，第一文档201遮挡第二文档203)时，手机就检测文档203的轮廓边界，如图5的(2)所示，此时检测到的文档203的轮廓边界不完整。进一步对检测框内的文档图像进行处理得到文档203的扫描图像也不完整，如图5的(3)所示，最终获得的文档203的扫描图像不完整，即存在误检测和误抓取的现象。However, the current continuous document scanning solution may cause problems such as misdetection and misgrabbing due to the user's slow paper movement speed or paper obstruction. For example, as shown in FIG5 (1), after the first document 201 is scanned, the user moves the first document 201 slowly, resulting in the second document 203 not being fully exposed (i.e., the first document 201 obstructs the second document 203). The mobile phone detects the outline boundary of the document 203, as shown in FIG5 (2). At this time, the detected outline boundary of the document 203 is incomplete. Further processing of the document image in the detection frame to obtain a scanned image of the document 203 is also incomplete, as shown in FIG5 (3). The scanned image of the document 203 finally obtained is incomplete, that is, there are misdetection and misgrabbing phenomena.
为了解决在连续扫描模式下，文档翻页速度缓慢等因素导致文档遮挡轮廓边界检测准确率低的问题，本申请提供了一种文档扫描方法，该方案在获得本次文档边框后，比较本次获得的文档边框与上一次的文档边框确定文档边框发生形变(如，当前文档的部分边框被上一页文档遮挡)后，对预设帧数的文档图像进行特征点追踪，然后重新检测文档的位置信息，最终获得文档的扫描图像；若确定文档稳定可以直接扫描获得该文档的扫描图像。可见该方案通过检测文档边框是否存在形变判断文档是否存在遮挡，如果是，则对文档追踪预设帧数后再进行文档检测和文档图像抓取，从而降低了误检测率和误抓取率，进而提高了文档扫描结果的准确率。而且，该方案可以根据文档的实际情况决策是否跟踪预设帧数再抓拍文档图像，而不是统一都等待一段时间后再抓拍，缩短了多张文档扫描过程的整体耗时，提高了文档扫描效率。In order to solve the problem of low accuracy of document occlusion contour boundary detection caused by factors such as slow document page turning speed in continuous scanning mode, the present application provides a document scanning method. After obtaining the document border of this time, the solution compares the document border obtained this time with the document border of the previous time to determine that the document border has been deformed (for example, part of the border of the current document is blocked by the previous page of the document), and then tracks the feature points of the document image of a preset number of frames, and then re-detects the position information of the document, and finally obtains the scanned image of the document; if it is determined that the document is stable, the scanned image of the document can be directly scanned to obtain the scanned image of the document. It can be seen that the solution determines whether the document is blocked by detecting whether the document border is deformed. If so, the document is tracked for a preset number of frames before document detection and document image capture, thereby reducing the false detection rate and false capture rate, thereby improving the accuracy of the document scanning result. Moreover, the solution can decide whether to track the preset number of frames and then capture the document image according to the actual situation of the document, instead of uniformly waiting for a period of time before capturing, shortening the overall time consumption of the scanning process of multiple documents and improving the document scanning efficiency.
下面将结合图6详细介绍本申请提供的文档扫描方法，如图6所示，该方法可以包括以下步骤：The document scanning method provided by the present application will be described in detail below in conjunction with FIG. 6. As shown in FIG. 6, the method may include the following steps:
S101，相机APP处于文档连续扫描模式，采集文档的图像。S101, the camera APP is in a document continuous scanning mode, capturing images of documents.
例如，在一示例性实施例中，用户点击图3的(2)所示界面中的更多按钮102后，显示图3的(3)所示的界面，点击文档扫描按钮103后进入图3的(4)所示的文档扫描界面，用户点击连续扫描按钮106后，相机APP进入文档连续扫描模式。For example, in an exemplary embodiment, after the user clicks the More button 102 in the interface shown in (2) of Figure 3, the interface shown in (3) of Figure 3 is displayed, and after clicking the Document Scan button 103, the document scanning interface shown in (4) of Figure 3 is entered. After the user clicks the Continuous Scan button 106, the camera APP enters the document continuous scanning mode.
在文档联系扫描模式下，摄像头按照一定帧率采集拍摄范围内的图像，本实施例中，采集包含待扫描文档的图像，即文档图像。帧率是每秒钟采集、传输、显示图片的帧数。In the document scanning mode, the camera collects images within the shooting range at a certain frame rate. In this embodiment, the image containing the document to be scanned, that is, the document image, is collected. The frame rate is the number of frames collected, transmitted, and displayed per second.
S102，相机APP通过图像数据传输通道向文档检测模块传输文档图像，以触发文档检测模块进行文档检测。S102, the camera APP transmits the document image to the document detection module through the image data transmission channel to trigger the document detection module to perform document detection.
可以理解，采集的文档图像中包含实际拍摄场景中除文档之外的其他物体。因此，需要对采集的文档图像进行文档检测，即检测图像中是否包含文档，如果包含文档则进一步确定文档的四条边界的位置及长度，最终根据四条边界确定文档的四个角点的位置坐标。It can be understood that the captured document image contains other objects in the actual shooting scene except the document. Therefore, it is necessary to perform document detection on the captured document image, that is, to detect whether the image contains the document, and if so, further determine the position and length of the four boundaries of the document, and finally determine the position coordinates of the four corner points of the document based on the four boundaries.
在本申请一示例性实施例中，相机APP设置一参数(例如，全局变量track)，该全局变量track用于指示进行文档检测还是文档追踪。例如，“track”的数值为“0”时表示进行文档检测，数值为“1”表示进行文档追踪。该示例中，“track”的数值默认为“0”，当检测到符合文档追踪的条件后将该全局变量赋值为“1”。In an exemplary embodiment of the present application, the camera APP sets a parameter (e.g., a global variable track), which is used to indicate whether to perform document detection or document tracking. For example, when the value of "track" is "0", it indicates document detection, and when the value is "1", it indicates document tracking. In this example, the value of "track" defaults to "0", and the global variable is assigned to "1" when the conditions for document tracking are detected.
相机APP根据参数track的数值决策将采集的当前帧文档图像发送至文档检测模块还是文档追踪模块。在本示例中，参数track的数值为“0”，则将当前帧图像发送至文档检测模块，从而触发文档检测模块检测文档的角点位置(或称为顶点位置)。若参数track的数值为“1”则将当前帧图像发送至文档追踪模块，从而触发文档追踪模块对文档的特征点进行追踪。The camera app decides whether to send the captured current frame document image to the document detection module or the document tracking module based on the value of the parameter track. In this example, if the value of the parameter track is "0", the current frame image is sent to the document detection module, thereby triggering the document detection module to detect the corner position (or vertex position) of the document. If the value of the parameter track is "1", the current frame image is sent to the document tracking module, thereby triggering the document tracking module to track the feature points of the document.
在一示例性实施例中，初次执行文档扫描时，“track”默认为0，即默认进行文档检测，因此，摄像头每次采集的文档的原始图像都通过图像数据传输通道传输至文档检测模块，进一步由文档检测模块对文档图像进行文档检测。In an exemplary embodiment, when document scanning is performed for the first time, "track" defaults to 0, that is, document detection is performed by default. Therefore, each time the original image of the document captured by the camera is transmitted to the document detection module through the image data transmission channel, the document detection module further performs document detection on the document image.
S103，文档检测模块基于文档图像，获得文档的角点位置。S103, the document detection module obtains the corner point positions of the document based on the document image.
文档检测模块对文档的原始图像数据进行分析处理，检测文档图像中是否包含文档，若包含文档，最终获得文档的四个角点在图像中的位置，即文档四个角点的位置坐标。The document detection module analyzes and processes the original image data of the document to detect whether the document is contained in the document image. If the document is contained, the position of the four corner points of the document in the image, that is, the position coordinates of the four corner points of the document, is finally obtained.
S104，文档检测模块通过相机服务接口向相机APP返回文档的角点位置，以及，向重检判断模块发送文档的角点位置。S104, the document detection module returns the corner point positions of the document to the camera APP through the camera service interface, and sends the corner point positions of the document to the re-inspection judgment module.
文档检测模块获得当前文档的角点位置坐标后，通过相机服务接口将角点位置反馈至相机APP，相机APP根据文档的角点位置绘制文档检测框。After the document detection module obtains the corner point position coordinates of the current document, it feeds back the corner point position to the camera APP through the camera service interface, and the camera APP draws the document detection frame according to the corner point position of the document.
与此同时，文档检测模块将文档的角点位置发送至重检判断模块，以便重检判断模块判断文档的边框是否发生形变。At the same time, the document detection module sends the corner point positions of the document to the re-inspection judgment module so that the re-inspection judgment module can judge whether the border of the document is deformed.
S105，相机APP根据文档的角点位置绘制文档检测框，并在拍摄界面上显示文档检测框。S105, the camera APP draws a document detection frame according to the corner point positions of the document, and displays the document detection frame on the shooting interface.
相机APP根据文档检测模块反馈的文档的角点位置坐标绘制文档的检测框，并在拍摄界面的取景框内显示该文档检测框。例如，图4的(2)所示界面中的黑色实线边框200即文档201的文档检测框。The camera APP draws a document detection frame based on the corner point position coordinates of the document fed back by the document detection module, and displays the document detection frame in the viewfinder of the shooting interface. For example, the black solid line frame 200 in the interface shown in (2) of Figure 4 is the document detection frame of the document 201.
S106，重检判断模块判断缓存器中是否存储有上一文档的角点位置。如果是，执行S107；如果否，则将本次的文档角点位置存入缓存器后，进一步执行S118。S106, the recheck judgment module judges whether the corner point position of the previous document is stored in the buffer. If yes, execute S107; if not, store the corner point position of the current document in the buffer, and further execute S118.
在本申请一示例性实施例中，可以设置一全局参数用于存储角点位置，例如，参数c的数值为文档的角点位置。如果参数c为空(或为零)则确定缓存器中没有保存文档的角点位置，如果参数c不为零则确定缓存器中保存有文档的角点位置。In an exemplary embodiment of the present application, a global parameter may be set to store the corner point position, for example, the value of parameter c is the corner point position of the document. If parameter c is empty (or zero), it is determined that the corner point position of the document is not stored in the buffer, and if parameter c is not zero, it is determined that the corner point position of the document is stored in the buffer.
如果缓存器中没有文档的角点位置，则表明当前文档不存在被遮挡的情况，即文档状态稳定，将本次检测到的文档的角点位置存入缓存器中，进一步向相机APP反馈文档稳定的状态信息(或称为第一状态或状态1)。If there is no corner point position of the document in the buffer, it indicates that the current document is not obstructed, that is, the document status is stable. The corner point position of the document detected this time is stored in the buffer, and the stable status information of the document (or called the first status or status 1) is further fed back to the camera APP.
S107，重检判断模块比较当前文档的边框与上一文档的边框的变化是否大于或等于第一阈值；如果是，则执行S108；如果否，则执行S118。S107, the re-check judgment module compares whether the change between the border of the current document and the border of the previous document is greater than or equal to the first threshold; if yes, execute S108; if not, execute S118.
如果存在上一文档的角点位置，重检判断模块根据该角点位置计算得到上一文档的边框信息。同理，重检判断模块根据本次获得的角点位置计算得到当前文档的边框信息。本文的边框信息包括文档的四个边的长度和位置。If there is a corner point position of the previous document, the re-inspection judgment module calculates the border information of the previous document based on the corner point position. Similarly, the re-inspection judgment module calculates the border information of the current document based on the corner point position obtained this time. The border information in this article includes the length and position of the four sides of the document.
进一步，比较两个文档的边框长度的差值是否超过阈值。进而根据比较结果决策是否追踪预设帧数文档图像后再重新触发文档检测。若两个文档的边框长度变化超过一定阈值，则确定当前文档可能存在被遮挡的情况。Furthermore, the difference between the border lengths of the two documents is compared to see if it exceeds a threshold. Then, based on the comparison result, a decision is made whether to track the document image for a preset number of frames and then re-trigger the document detection. If the border lengths of the two documents change by more than a certain threshold, it is determined that the current document may be obscured.
第一阈值可以根据有限次实验统计结果确定，本申请对其具体数值不做限定。The first threshold value can be determined based on statistical results of a limited number of experiments, and this application does not limit its specific value.
S108，重检判断模块通过相机服务接口向相机APP传递文档边框变化大的状态信息，以及，将文档跟踪次数设为0。S108, the re-check judgment module transmits status information of a large change in the document border to the camera APP through the camera service interface, and sets the document tracking times to 0.
如果两个文档存在至少一个角点的位置差值大于第一阈值，则确定当前文档的状态为第三状态(或称为状态3)，进一步，通过相机服务接口向相机APP反馈第三状态。If there is at least one corner point position difference between the two documents that is greater than the first threshold, the state of the current document is determined to be the third state (or called state 3), and further, the third state is fed back to the camera APP through the camera service interface.
第三状态表明两次检测的文档边框变化大，当前文档可能存在被遮挡的情况，进而触发文档追踪模块对预设帧数的图像进行特征点追踪。The third state indicates that the document borders between the two detections have changed greatly, and the current document may be obscured, thereby triggering the document tracking module to track feature points of a preset number of frames.
重检判断模块内维护一个计数器，该计数器用于记录成功追踪文档的帧数。因此，当确定需要重新检测文档，先将该计数器清零，每次成功追踪文档后计数器加1。A counter is maintained in the re-check judgment module, which is used to record the number of frames of successfully tracked documents. Therefore, when it is determined that a document needs to be re-checked, the counter is first cleared to zero, and the counter is increased by 1 each time a document is successfully tracked.
S109，相机APP接收第三状态后，通过图像传输通道向文档追踪模块传输文档的原始图像，以触发文档追踪模块对文档进行特征点跟踪，以及，将文档稳定次数设置为0。S109, after receiving the third state, the camera APP transmits the original image of the document to the document tracking module through the image transmission channel to trigger the document tracking module to track feature points of the document, and sets the document stabilization times to 0.
相机APP接收到重检判断模块返回的第三状态后，将参数track赋值为“1”，相机APP检测到参数track的数值为“1”后，将当前采集到的文档的初始图像通过图像传输通道向文档追踪模块传输，从而触发文档追踪模块执行文档追踪的过程。After the camera APP receives the third status returned by the re-inspection judgment module, it assigns the parameter track to "1". After the camera APP detects that the value of the parameter track is "1", it transmits the initial image of the currently collected document to the document tracking module through the image transmission channel, thereby triggering the document tracking module to execute the document tracking process.
在一示例性实施例中，相机APP维护一个计数器，该计数器用于记录文档状态稳定的帧数。当相机APP接收到表征文档边框形变较大的第三状态后，将该计数器清零；当相机APP接收到表征文档状态稳定的第一状态后，控制该计数器加1。In an exemplary embodiment, the camera APP maintains a counter, which is used to record the number of frames in which the document state is stable. When the camera APP receives the third state indicating that the document border is deformed more, the counter is cleared; when the camera APP receives the first state indicating that the document state is stable, the counter is controlled to increase by 1.
S110，文档追踪模块对接收的文档图像进行分析处理获得文档的特征点，并对特征点进行追踪。S110, the document tracking module analyzes and processes the received document image to obtain feature points of the document, and tracks the feature points.
在一示例性实施例中，可以采用光流追踪算法对文档的特征点进行追踪。In an exemplary embodiment, an optical flow tracking algorithm may be used to track feature points of a document.
文档特征点追踪过程是以文档检测模块检测到的文档角点位置的文档图像作为原始文档图像，分析获得该原始文档图像的特征点，并对该原始文档图像之后的接收到的文档图像进行特征点追踪。例如，如图5的(2)所示的文档203对应的文档图像(黑色粗实线框内的图像)为原始文档图像，对每次采集的文档图像进行文档追踪，即在新的文档图像中查找原始文档图像的特征点。The document feature point tracking process is to use the document image of the document corner point position detected by the document detection module as the original document image, analyze and obtain the feature points of the original document image, and perform feature point tracking on the document image received after the original document image. For example, the document image corresponding to the document 203 shown in (2) of Figure 5 (the image in the black thick solid line frame) is the original document image, and document tracking is performed on each collected document image, that is, searching for the feature points of the original document image in the new document image.
在文档特征点追踪过程中，相机APP采集的每一帧文档图像都通过图像传输通道传输至文档追踪模块，由文档追踪模块分析每一帧文档图像包含的与原始文档图像的文档特征点相同的特征点。During the document feature point tracking process, each frame of document image captured by the camera APP is transmitted to the document tracking module through the image transmission channel, and the document tracking module analyzes the feature points contained in each frame of document image that are the same as the document feature points of the original document image.
S111，文档追踪模块判断是否成功追踪文档；如果追踪成功，则执行S112；如果追踪失败，则执行S116。S111, the document tracking module determines whether the document is tracked successfully; if the tracking is successful, S112 is executed; if the tracking fails, S116 is executed.
在本申请一示例性实施例中，追踪成功的条件可以包括以下至少一种：In an exemplary embodiment of the present application, the condition for successful tracking may include at least one of the following:
(1)文档边框(根据文档的角点位置计算得到)未超出取景框，或者超出取景框的比例小于或等于某一阈值(如，第二阈值)。(1) The document border (calculated based on the position of the corner points of the document) does not exceed the viewfinder, or the proportion of the border exceeding the viewfinder is less than or equal to a certain threshold (eg, a second threshold).
(2)当前追踪文档的特征点与原始特征点的数量比例大于某一阈值(如第三阈值)。(2) The ratio of the number of feature points of the current tracked document to the number of original feature points is greater than a certain threshold (such as the third threshold).
(3)当前文档的四个角点中任一角点的角度与上一文档中任一角点角度的差值小于某一阈值(如第四阈值)。角点的角度是指经过该角点的两个边的夹角。(3) The difference between the angle of any corner point of the four corner points of the current document and the angle of any corner point in the previous document is less than a certain threshold (such as the fourth threshold). The angle of a corner point refers to the angle between two sides passing through the corner point.
若当前特征点追踪满足上述任一条件，确定本次追踪失败。反之，如果当前特征点追踪不满足上述的追踪失败条件则确定追踪成功。If the current feature point tracking meets any of the above conditions, it is determined that the tracking has failed. Conversely, if the current feature point tracking does not meet the above tracking failure conditions, it is determined that the tracking has succeeded.
上述的各个阈值根据有限次实验统计结果确定，本申请对其具体数值不做限定。The above thresholds are determined based on the statistical results of a limited number of experiments, and this application does not limit their specific values.
S112，文档追踪模块向重检判断模块返回文档追踪成功信息。S112, the document tracking module returns document tracking success information to the re-examination judgment module.
在一示例性实施例中，文档追踪成功信息包括当前追踪成功的文档图像包含的四个角点的位置坐标。根据原始文档图像的四个角点的原始位置坐标，以及特征点追踪获得的特征点对应的单应矩阵，计算得到追踪到的四个角点的最新位置坐标。In an exemplary embodiment, the document tracking success information includes the position coordinates of the four corner points contained in the currently tracked document image. The latest position coordinates of the tracked four corner points are calculated based on the original position coordinates of the four corner points of the original document image and the homography matrix corresponding to the feature points obtained by feature point tracking.
S113，重检判断模块接收文档追踪成功信息后，将文档追踪次数加1，并将文档追踪成功信息反馈至相机APP绘制最新的文档检测框。S113, after receiving the document tracking success information, the re-check judgment module increases the document tracking times by 1, and feeds back the document tracking success information to the camera APP to draw the latest document detection frame.
在一示例性实施例中，重检判断模块每次接收到追踪成功信息后，都会控制追踪次数计数器加1。In an exemplary embodiment, the recheck determination module controls the tracking times counter to increase by 1 each time after receiving tracking success information.
重检判断模块通过相机服务接口向相机APP返回追踪到的文档角点的最新位置坐标，从而使相机APP根据文档角点的最新位置坐标绘制新的文档检测框并在拍摄界面的取景框内显示最新的文档检测框。The re-inspection judgment module returns the latest position coordinates of the tracked document corner points to the camera APP through the camera service interface, so that the camera APP draws a new document detection frame according to the latest position coordinates of the document corner points and displays the latest document detection frame in the viewfinder of the shooting interface.
S114，重检判断模块判断当前追踪次数是否大于或等于第一预设次数；如果否，则继续对文档进行特征点追踪；如果是，则执行S115。S114, the recheck judgment module judges whether the current tracking times is greater than or equal to the first preset times; if not, continue to track the feature points of the document; if yes, execute S115.
第一预设次数可以通过有限次实验结果统计数据确定，如15次，本申请对第一预设次数的数值不做限定。The first preset number of times can be determined by statistical data of a limited number of experimental results, such as 15 times. The present application does not limit the value of the first preset number of times.
S115，重检判断模块删除缓存器中存储的文档角点位置，并通过相机服务接口向相机APP传递进行文档检测的信息。S115, the re-inspection judgment module deletes the document corner point positions stored in the buffer, and transmits the document detection information to the camera APP through the camera service interface.
在一示例性实施例中，对文档连续追踪成功的次数达到第一预设次数后，认为当前文档不存在被遮挡的情况，次数触发文档检测模块重新检测文档的角点位置，同时，删除缓存器中存储的文档的角点位置信息，这样，确保缓存器中存储的总是最新的文档位置信息。In an exemplary embodiment, after the number of successful continuous tracking of a document reaches a first preset number, it is considered that the current document is not obstructed. The number triggers the document detection module to re-detect the corner position of the document. At the same time, the corner position information of the document stored in the cache is deleted. In this way, it is ensured that the latest document position information is always stored in the cache.
相机APP接收重检判断模块返回的进行文档检测的信息后，将参数“track”的数值赋值为“0”，进一步，检测到“track”的数值为“0”后，将当前帧文档图像传输至文档检测模块，从而触发文档检测模块对当前帧文档图像进行文档检测，最终获得文档的四个角点的位置，即，执行完S115后返回执行S102。After the camera APP receives the document detection information returned by the re-inspection judgment module, it assigns the value of the parameter "track" to "0". Further, after detecting that the value of "track" is "0", the current frame document image is transmitted to the document detection module, thereby triggering the document detection module to perform document detection on the current frame document image, and finally obtain the positions of the four corner points of the document, that is, after executing S115, it returns to execute S102.
S116，文档追踪模块通过相机服务接口向相机APP传递文档追踪失败的状态信息(可称为第二状态或状态2)。S116, the document tracking module transmits status information of document tracking failure (which may be referred to as a second status or status 2) to the camera APP through the camera service interface.
如果文档追踪模块判定对当前帧文档图像的特征点追踪失败，则向相机APP传递第二状态，第二状态表明文档追踪失败。If the document tracking module determines that the tracking of the feature points of the current frame document image fails, a second state is transmitted to the camera APP, and the second state indicates that the document tracking fails.
S117，相机APP接收第二状态后，将文档稳定次数设置为0，并返回执行S102。S117, after receiving the second state, the camera APP sets the document stabilization times to 0 and returns to execute S102.
相机APP接收文档追踪模块反馈的第二状态后，确定当前帧文档图像追踪失败，将当前帧文档图像传输至文档检测模块，以触发文档检测模块检测文档位置，即返回执行S102。After the camera APP receives the second status feedback from the document tracking module, it determines that the tracking of the current frame document image fails, and transmits the current frame document image to the document detection module to trigger the document detection module to detect the document position, that is, returns to execute S102.
在一示例性实施例中，当相机APP接收到文档追踪失败的状态(第二状态)后，需要将自身维护的文档稳定次数计数器清零。In an exemplary embodiment, when the camera APP receives the status of document tracking failure (second status), it needs to clear the document stability times counter maintained by itself.
由S109和S117所述的内容可知，相机APP接收到第二状态或第三状态的信息后，都控制文档稳定次数计数器清零。It can be known from the contents of S109 and S117 that after the camera APP receives the information of the second state or the third state, it controls the document stability times counter to be cleared.
如果重检判断模块在S106中判定缓存器中不存在上一文档的角点位置，或者，在S107中判定两次文档的边框变化不超过第一阈值，则执行S118。If the recheck determination module determines in S106 that the corner point position of the previous document does not exist in the buffer, or determines in S107 that the border change between the two documents does not exceed the first threshold, S118 is executed.
S118，重检判断模块通过相机服务接口向相机APP传递文档稳定的状态信息(或称为第一状态或状态1)。S118, the re-examination judgment module transmits the document stable status information (or referred to as the first status or status 1) to the camera APP through the camera service interface.
S119，相机APP接收第一状态后，将文档稳定次数加1。S119, after receiving the first status, the camera APP increases the number of document stabilization times by 1.
相机APP每次接收到重检判断模块发送的第一状态的信息，都会控制文档稳定次数计数器加1。Every time the camera APP receives the first status information sent by the re-checking and judging module, it controls the document stability times counter to increase by 1.
在本申请实施例中，相机APP接收到第一状态后，控制文档稳定次数计数器加1，而当接收到第二状态或第三状态后，控制文档稳定次数计数器清零。In an embodiment of the present application, after the camera APP receives the first state, the document stability times counter is controlled to add 1, and when the second state or the third state is received, the document stability times counter is controlled to be cleared.
S120，相机APP接收第一状态信息后，通过图像传输通道向文档追踪模块传输当前帧文档图像，以触发文档追踪模块对文档进行特征点追踪。S120, after receiving the first status information, the camera APP transmits the current frame document image to the document tracking module through the image transmission channel to trigger the document tracking module to track feature points of the document.
在本申请一示例性实施例中，为了确保文档扫描结果准确率较高，在检测到文档状态稳定后，继续对预设帧数的文档图像进行追踪，确保文档稳定状态保持一定时间后才触发自动抓拍文档图像。In an exemplary embodiment of the present application, in order to ensure a high accuracy of the document scanning results, after detecting that the document state is stable, the document image of a preset number of frames is tracked to ensure that the document stable state remains for a certain period of time before triggering the automatic capture of the document image.
S121，文档追踪模块接收文档图像后进行文档特征点追踪。S121, the document tracking module tracks document feature points after receiving the document image.
S122，文档追踪模块判断文档追踪是否成功；如果否，则执行S123；如果是，则执行S124。S122, the document tracking module determines whether the document tracking is successful; if not, execute S123; if yes, execute S124.
S121和S122所述步骤的过程与S110和S111的过程相同，此处不再赘述。The processes of steps S121 and S122 are the same as those of steps S110 and S111 and will not be described in detail here.
S123，文档追踪模块通过相机服务接口向相机APP返回文档追踪失败的信息(或称为第二状态或状态2)，相机APP接收第二状态，将文档稳定次数设置为0，并返回执行S102。S123, the document tracking module returns the document tracking failure information (or called the second state or state 2) to the camera APP through the camera service interface. The camera APP receives the second state, sets the document stabilization times to 0, and returns to execute S102.
S124，文档追踪模块通过相机服务接口向相机APP返回文档追踪成功结果，文档追踪成功结果包括最新的文档位置。S124, the document tracking module returns a document tracking success result to the camera APP through the camera service interface, and the document tracking success result includes the latest document location.
S125，相机APP根据最新的文档位置绘制新的文档检测边框并显示，以及，将文档稳定次数加1。S125, the camera APP draws a new document detection border according to the latest document position and displays it, and increases the document stabilization times by 1.
在本申请一示例性实施例中，相机APP维护的文档稳定次数计数器在接收到第一状态的信息或者文档追踪成功接收后，都会控制该计数器加1。In an exemplary embodiment of the present application, the document stability counter maintained by the camera APP will be controlled to add 1 after receiving the information of the first state or the document tracking is successfully received.
S126，相机APP判断文档稳定次数是否大于或等于第二预设次数；如果是，则执行S127；如果否，则继续触发文档跟踪模块进行文档追踪，即继续触发文档追踪模块执行S121。S126, the camera APP determines whether the number of document stability times is greater than or equal to the second preset number; if yes, execute S127; if not, continue to trigger the document tracking module to track the document, that is, continue to trigger the document tracking module to execute S121.
S127，相机APP触发获得当前文档的扫描图像的流程。S127, the camera APP triggers the process of obtaining the scanned image of the current document.
在本申请的一示例性实施例中，算法层还包括文档扫描模块，该模块用于根据包含待扫描文档的图像获得该文档的扫描图像。In an exemplary embodiment of the present application, the algorithm layer further includes a document scanning module, which is used to obtain a scanned image of the document based on an image containing the document to be scanned.
例如，如图4的(2)所示，拍摄文档201的图像，进而对该图像进行处理得到如图4的(3)所示的文档201的扫描图像202。For example, as shown in (2) of FIG. 4 , an image of the document 201 is captured, and then the image is processed to obtain a scanned image 202 of the document 201 as shown in (3) of FIG. 4 .
在本申请实施例中，可以根据当前文档的追踪成功的最后一帧包含文档的图像，获得该文档的扫描图像。In the embodiment of the present application, a scanned image of the document can be obtained based on the image of the document contained in the last frame in which the current document is successfully tracked.
在本申请的其他实施例中，相机应用还可以在接收表征文档稳定的状态信息后，直接触发获得当前文档的扫描图像的流程。此种场景下，可以根据进行文档检测的文档图像获得当前文档的扫描图像。In other embodiments of the present application, the camera application may also directly trigger the process of obtaining the scanned image of the current document after receiving the state information indicating the stability of the document. In this scenario, the scanned image of the current document may be obtained based on the document image for document detection.
本实施例提供的文档扫描方法，在检测到文档的角点位置后，先判断是否存在上一个文档的位置，如果存在则通过比较两个文档的边框变化是否超过一定阈值，判断文档状态是否稳定，如果超过阈值表明文档状态不稳定(如当前文档可能被遮挡)，实时追踪预设帧数文档图像后，再次检测文档的位置并抓拍文档图像最终获得扫描图像，可见，该方案在检测到文档边框变化较大后，追踪预设帧数文档图像后再次检测文档的位置并抓拍文档图像，从而避免由于上一页文档移动速度缓慢导致误抓取(即，误抓取率高)的现象发生，因此，该方案提高了文档扫描准确率。而且，该方案在判定当前文档位置稳定后，直接拍摄当前文档的图像最终获得文档的扫描图像，该方案可以根据文档的实际情况决策是否跟踪预设帧数再拍摄扫描图像，而不是统一都等待一段时间后再进行扫描，缩短了多张文档扫描过程的整体耗时，提高了文档扫描效率。The document scanning method provided in this embodiment, after detecting the position of the corner point of the document, first determines whether there is the position of the previous document. If there is, it determines whether the document state is stable by comparing whether the border changes of the two documents exceed a certain threshold. If the threshold is exceeded, it indicates that the document state is unstable (such as the current document may be blocked). After real-time tracking of the preset number of frames of the document image, the position of the document is detected again and the document image is captured to finally obtain the scanned image. It can be seen that after detecting that the document border changes greatly, the scheme tracks the preset number of frames of the document image and detects the position of the document again and captures the document image, thereby avoiding the phenomenon of miscapture (i.e., high miscapture rate) caused by the slow movement speed of the previous page of the document. Therefore, the scheme improves the accuracy of document scanning. Moreover, after determining that the current document position is stable, the scheme directly captures the image of the current document to finally obtain the scanned image of the document. The scheme can decide whether to track the preset number of frames and then capture the scanned image according to the actual situation of the document, instead of uniformly waiting for a period of time before scanning, thereby shortening the overall time consumption of the scanning process of multiple documents and improving the document scanning efficiency.
而且，该方案在确定文档状态稳定后也可以实时追踪预设帧数，再抓取文档的图像最终获得文档的扫描图像，即待文档状态稳定保持一段时间后再抓取文档的图像，避免由于电子设备抖动或移动导致文档扫描图像不清晰的问题，最终提高了文档扫描图像的准确性，以及降低了对用户的协作要求，如允许用户手持扫描文档的电子设备抖动或平稳移动。Moreover, after determining that the document status is stable, the solution can also track the preset number of frames in real time, and then capture the image of the document to finally obtain the scanned image of the document. That is, the image of the document is captured after the document status remains stable for a period of time, thereby avoiding the problem of unclear document scanned images due to shaking or movement of the electronic device, and ultimately improving the accuracy of the document scanned image and reducing the requirements for user cooperation, such as allowing the user to shake or move the electronic device holding the document for scanning.
此外，确定文档边框变化较大后，进行实时特征点追踪，无需实时进行文档检测，特征点追踪过程的耗时远远小于文档检测过程的耗时，因此该方案提高了文档扫描速度。In addition, after determining that the document border has changed significantly, real-time feature point tracking is performed without the need for real-time document detection. The time consumption of the feature point tracking process is much less than that of the document detection process, so this solution improves the document scanning speed.
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
在本实施例所提供的几个实施例中，应该理解到，所揭露的系统，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述模块或单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。In the several embodiments provided in this embodiment, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外，在本实施例各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present embodiment may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional units.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或处理器执行各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment. The aforementioned storage medium includes: flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk and other media that can store program codes.
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何在本申请揭露的技术范围内的变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211446965.4ACN118097701A (en) | 2022-11-18 | 2022-11-18 | Document scanning method and device |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211446965.4ACN118097701A (en) | 2022-11-18 | 2022-11-18 | Document scanning method and device |
| Publication Number | Publication Date |
|---|---|
| CN118097701Atrue CN118097701A (en) | 2024-05-28 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211446965.4APendingCN118097701A (en) | 2022-11-18 | 2022-11-18 | Document scanning method and device |
| Country | Link |
|---|---|
| CN (1) | CN118097701A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119496858A (en)* | 2025-01-13 | 2025-02-21 | 国网浙江省电力有限公司 | A method and system for digital processing of customer files |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140268247A1 (en)* | 2012-08-15 | 2014-09-18 | Fuji Xerox Co., Ltd. | Systems and Methods for Efficiently Capturing High-Quality Scans of Multi-Page Documents with Hand-Held Devices |
| CN109559365A (en)* | 2018-11-30 | 2019-04-02 | 努比亚技术有限公司 | File scanning method, device, mobile terminal and storage medium |
| CN109729231A (en)* | 2018-12-17 | 2019-05-07 | 中国科学院深圳先进技术研究院 | A document scanning method, device and equipment |
| CN113259539A (en)* | 2020-02-12 | 2021-08-13 | 北京小米移动软件有限公司 | Document scanning method and device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140268247A1 (en)* | 2012-08-15 | 2014-09-18 | Fuji Xerox Co., Ltd. | Systems and Methods for Efficiently Capturing High-Quality Scans of Multi-Page Documents with Hand-Held Devices |
| CN109559365A (en)* | 2018-11-30 | 2019-04-02 | 努比亚技术有限公司 | File scanning method, device, mobile terminal and storage medium |
| CN109729231A (en)* | 2018-12-17 | 2019-05-07 | 中国科学院深圳先进技术研究院 | A document scanning method, device and equipment |
| CN113259539A (en)* | 2020-02-12 | 2021-08-13 | 北京小米移动软件有限公司 | Document scanning method and device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119496858A (en)* | 2025-01-13 | 2025-02-21 | 国网浙江省电力有限公司 | A method and system for digital processing of customer files |
| CN119496858B (en)* | 2025-01-13 | 2025-04-11 | 国网浙江省电力有限公司 | Customer file digital processing method and system |
| Publication | Publication Date | Title |
|---|---|---|
| KR102124604B1 (en) | Method for stabilizing image and an electronic device thereof | |
| US11048913B2 (en) | Focusing method, device and computer apparatus for realizing clear human face | |
| CN113810608B (en) | A shooting method, electronic device and storage medium | |
| CN107172296A (en) | A kind of image capturing method and mobile terminal | |
| CN109040474B (en) | Photo display method, device, terminal and storage medium | |
| CN112954210A (en) | Photographing method and device, electronic equipment and medium | |
| CN109951636A (en) | Photographing processing method and device, mobile terminal and storage medium | |
| WO2020207258A1 (en) | Image processing method and apparatus, storage medium and electronic device | |
| CN105827951A (en) | Moving object photographing method and mobile terminal | |
| CN105549814B (en) | Photographing method based on mobile terminal and mobile terminal | |
| CN107302666A (en) | Photographic method, mobile terminal and computer-readable recording medium | |
| US11606504B2 (en) | Method and electronic device for capturing ROI | |
| CN106231200B (en) | A kind of photographic method and device | |
| WO2017173585A1 (en) | Photographing method and terminal | |
| US7460689B1 (en) | System and method of detecting, recognizing, and tracking moving targets | |
| CN110297545A (en) | Gestural control method, gesture control device and system and storage medium | |
| CN110291775A (en) | Tracking shooting method, device and storage medium | |
| US12309508B2 (en) | Image frame selection for multi-frame fusion | |
| CN112668636A (en) | Camera shielding detection method and system, electronic equipment and storage medium | |
| CN114500837A (en) | Shooting method and device and electronic equipment | |
| CN108513069A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN105391940A (en) | Image recommendation method and apparatus | |
| WO2024061134A1 (en) | Photographing method and apparatus, electronic device, and medium | |
| CN118097701A (en) | Document scanning method and device | |
| CN107800960B (en) | A kind of safety shutter method of adjustment and mobile terminal |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | Country or region after:China Address after:Unit 3401, unit a, building 6, Shenye Zhongcheng, No. 8089, Hongli West Road, Donghai community, Xiangmihu street, Futian District, Shenzhen, Guangdong 518040 Applicant after:Honor Terminal Co.,Ltd. Address before:3401, unit a, building 6, Shenye Zhongcheng, No. 8089, Hongli West Road, Donghai community, Xiangmihu street, Futian District, Shenzhen, Guangdong Applicant before:Honor Device Co.,Ltd. Country or region before:China | |
| CB02 | Change of applicant information |