US20130143621A1 - System and Method for Capturing Augmented Reality Electronic Signatures - Google Patents

Abstract

A system and method for more accurately and easily recording signatures electronically/digitally. The preferred signing experience is generating a “wet” signature by putting a pen to paper as a pen and paper are ubiquitous and portable as well as familiar to most people. The present invention preserves this experience while combining it with a digital rendering of a document using conventional mobile communication devices having a camera feature in order to record a wet signature of a user and store a digital representation of the document that includes the recorded wet signature in the signature block of the document.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
• This application is a continuation of U.S. patent application Ser. No. 13/011,914 entitled “System and Method for Capturing Augmented Reality Electronic Signatures” filed on Jan. 23, 2011 which is incorporated by reference herein in its entirety.
FIELD OF THE INVENTION
• The application related to the field of electronic signatures and in particular to the capturing of signatures with a mobile personal device assistant device.
BACKGROUND OF THE INVENTION
• As more paper-based workflows are managed electronically, such a paperless offices, the need for electronic signatures is increasing. Conventional solutions attempt to replicate the experience of signing a document through the emulation of conventional pen to paper, i.e., “wet,” signatures using, for example, touch screen, computer pen, computer mouse or other specialized input device. A system requiring a specialized input device limits the proliferation and adoption of such systems. Using a finger or other device on a touch screens requires the specialized touch screen device and is also slow, cumbersome, unfamiliar to a typical user and frequently results in a signature that is a poor representation of a wet signature. Similarly, the use of specialized hardware such as computer pens are unfamiliar to the typical user as the signature often is misaligned with where the pen touches the screen, and the touch screen sensitivities result in “shaky” signatures. In addition, as described above, the requirement of a specialized pen is a hindrance to adoption of such systems. The use of a computer mouse is also a poor substitute of a wet signature as the use of a mouse to sign a document is unfamiliar and results in signatures that often bear little resemblance to wet signatures. Such poor representations of signatures results in authentication concerns.
• Alternatively, conventional electronic signatures can be typewritten, such as the name between backslash characters, “/signature/”. However, a problem with this technique is that such signatures are easy to forge and therefore present authentication concerns.
SUMMARY OF THE INVENTION
• An embodiment of the invention is a method for associating a digital representation of a wet signature with a digital document that is a digital representation of a document, comprising the steps of: initiating a signature application on a mobile communication device having a camera and a display; displaying the digital document on said display of said mobile communication device; positioning said camera of said mobile communication device over the wet signature wherein a representation of the wet signature is positioned in a signature block of the digital document by said signature application; capturing the wet signature by said camera; and storing, by said signature application, an executed version of the digital document with the wet signature digital representation in said signature block of the digital document.
• The features and advantages described in the specification are not all inclusive and, in particular, many additional features and advantages will be apparent to one of ordinary skill in the art in view of the drawings, specification, and claims. Moreover, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter.
BRIEF DESCRIPTION OF THE DRAWINGS
• FIG. 1 is an illustration of components of the invention in accordance with an embodiment of the present invention.
• FIG. 2 is a detailed illustration of a mobile communication device in accordance with an embodiment of the present invention.
• FIG. 3 is a flowchart of a method in accordance with an embodiment of the present invention.
• FIG. 4 is an illustration of components of the invention in accordance with an embodiment of the present invention.
• FIG. 5 is an illustration of components of the invention in accordance with an embodiment of the present invention.
• FIG. 6 is an illustration of components of the invention in accordance with an embodiment of the present invention.
• FIG. 7 is an illustration of components of the invention in accordance with an embodiment of the present invention.
• The figures depict various embodiments of the present invention for purposes of illustration only. One skilled in the art will readily recognize from the following discussion that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles of the invention described herein.
DETAILED DESCRIPTION OF THE INVENTION
• A preferred embodiment of the present invention is now described with reference to the figures where like reference numbers indicate identical or functionally similar elements. Also in the figures, the left most digits of each reference number corresponds to the figure in which the reference number is first used.
• FIG. 1 is an illustration of components of the invention in accordance with an embodiment of the present invention. In one embodiment the invention includes a mobile communication device (MCD)102, paper or other material that can be written upon, for ease of discussion this will be referred to herein aspaper104, but can include any material or object that can be written upon, e.g., desk, hand, blackboard, whiteboard, etc.FIG. 1 also includes awriting device106, e.g., a pen, marker, pencil, etc.
• FIG. 2 is a detailed illustration of amobile communication device102 in accordance with an embodiment of the present invention. Examples of a wireless mobile communication device (MCD)102 include a cellular phone, personal device assistant (PDA), smart phone, pocket personal computer (PC), laptop computer, smart watch or other devices having a processor, communications capability and are easily transportable, for example. Examples of applications include applications available for the iPhone™ that is commercially available from Apple Computer, Cupertino, Calif., applications for phones running the Android™ operating system that is commercially available from Google, Inc., Mountain View, Calif., applications for BlackBerry devices, available from RIM, Ontario Canada, or applications available for Windows Mobile devices, available from Microsoft Corp., Redmond, Wash. Such devices are examples of the MCD102.
• In an embodiment theMCD102 includes acommunications unit206, aprocessor208, an input/output device212, acamera216 and a memory/storage device204. The MCD102 has an operating system and can include various applications either integrated into the operating system or stored in the memory/storage device204 and executed by theprocessor208. In an embodiment, thememory device204 includes adata storage module222, a software module (signature app220), among other software and programs, for example, that is executed on theMCD102. The software module can be an application, such as an iPhone™ or Android™-based application. For ease of discussion this software module will be referred to herein as asignature application220. Thesignature application220 can be stored on the MCD102 and can be part of the embedded software of the MCD102 (e.g., iPhone) or integrated into the MCD's102 operating system. Alternatively, the application can be downloaded via a wired or wireless system, e.g., using Apple's iTunes™. In addition, in an embodiment the software module can be part of any of a variety of software paradigms, e.g., software as a service (SaaS), cloud computing. For ease of discussion, the following description will be based on the model of the software module being an application that is stored in theMCD memory module104 and executed by the MCDprocessor208.
• FIG. 3 is a flowchart of a method in accordance with an embodiment of the present invention. Some embodiments of the operation of the invention will be described with reference toFIGS. 4-7.
• FIG. 4 is an illustration of components of the invention in accordance with an embodiment of the present invention. As described above, the present invention is a system and method for more accurately and easily recording signatures electronically. The preferred signing experience is generating a “wet” signature by putting a pen to paper, as a pen and paper are ubiquitous and portable as well as familiar to most people. The present invention preserves this experience while combining it with a digital rendering of a document (referred to herein as a digital document, the digital document need not be created from a physical document, that is, it can be a document created using conventional word processors, e.g., Microsoft Word, and directly stored into a computer readable memory). The digital document is to be signed in a manner that overcomes the drawbacks of conventional electronic signing system and methods, as described above. In particular, MCDs (102) have become common and many MCDs (102) include acamera216. The present invention uses anMCD102 to record the signature and/or act of signing and superimposes the signature into the document. The signer or agent can record and save the superimposed signature with the document along with authentication information.
• With reference toFIG. 3, a user can initiate302 thesignature application220 on theMCD102. The steps set forth inFIG. 3 are illustrative and the steps do not necessarily need to occur in the order shown. Thesignature application220 can operate along with a document reading and displaying software, e.g. Microsoft Word, Adobe, etc, or document reading and displaying software can be part of thesignature application220. The document reading/displaying feature provides a digital rendering of the document on the screen of theMCD102. Thesignature application220 can include security protections to enable access only when the security protections are satisfied. Examples of such security include the use of a password, voice recognition, retinal scan, particular location, e.g., within a one mile radius of Fenwick & West LLP in Mountain View, Calif., fingerprint recognition possibly readable only by a device with a specific identifier, e.g., a serial number, SIM (subscriber identity module) card, phone number, etc.. Thesignature application220 utilizes theMCD camera216 and identifies the signature block area of the document. In an embodiment, thesignature application302 receives an output from thecamera216, for example a representation of the signature that will be received by thecamera216 when the camera is activated, such as a representation similar to that which may be displayed in a viewfinder, and superimposes the camera output onto the signature block area of the document. In alternate embodiments, other portions of the document can be filled in by the user, e.g., the date or other information at different areas of the document. The signature application can perform these functions using a variety of conventional techniques, e.g., using text field entry, drawing on a touchscreen in various colors, loading previously recorded data, e.g., addresses, system clock for time/date.
• With reference toFIG. 4, theuser signs304 thepaper104 using thewriting device106. As seen inFIG. 4, the paper (or other writing surface) signed need not include the text of the document, e.g., the paper can be blank prior to signing. In this embodiment the signature can occur prior to theinitiation302 of thesigning application220.
• FIG. 5 is an illustration of components of the invention in accordance with an embodiment of the present invention. The user places theMCD102 such that the camera218 captures the signature on thepaper104 and that the signature appears in theproper location502 in the electronic document displayed on theMCD102. Thesignature application220captures306 the signature, preferably when the signature is displayed in theproper location502 in the electronic document. In an embodiment the signature capture can occur by the pressing of a button or touching a particular area, e.g., touching the screen on theMCD102, or using a verbal command, for example. The document is stored308 in theMCD memory module204 with the signature and additional data such as the time/date of the signature capture, the location of the signature capture (which can be based upon location identification features of theMCD102, for example), the authentication information provided by the signature application security features (for example, a password, fingerprint, voice identification or other information that is provided in response to a security information request by the signature application),MCD102 identification information, retina scan, location information (using global positioning satellite (GPS) information or other location determination information/systems such as cellular tower triangulation based on signal strengths from multiple cellular towers), device identifier, phone number, etc.. This information can be stored with the document in thememory module204, for example as metadata and/or can be stored as a separate file.
• The additional data can assist in authenticating the signature. As described above, access to thesignature application220 can require satisfying the security features of thesignature application220 which can assist in authenticating the user of the signature application, the use of aparticular MCD102 as identified by the data can provide additional information to assist in authenticating the signature. There may also be security features required to access theMCD102 which provides additional security and authentication information.
• In addition, since the user uses awriting device106 and writingsurface104 to create a wet signature, which is consistent with the signature process that the user is accustomed to, the signature itself provides a measure of authentication as the signature can be compared with other signatures of the user. In addition, the additional data collected, as described above, such as the time/date of the signature capture, the location of the signature capture (which can be based upon location identification features of theMCD102, for example), the authentication information provided by the signature application security features, and/orMCD102 identification information, for example, also assist in authenticating the signature and the user (person signing the document).
• FIG. 6 is an illustration of components of the invention in accordance with an embodiment of the present invention. In another embodiment, thesignature application220 captures a video of the signature creation. This can be done using a video capture function of theMCD102. In one embodiment, afterinitiation302 of thesignature application220, the user positions theMCD102 such that the signature on thepaper104 is positioned such that the signature appears at theproper location602 of the document representation. The user can select a video capture mode and initiate306 the video capture. Using thewriting device106, theuser signs304 the document which is captured as a video signature and/or a static digital signature and the captured video and/or static signatures are stored308 in thememory device104 as part of the document file and/or as a separate file, for example. In an alternate embodiment, the document and additional information can be transmitted to a storage device (not shown) that is remote from theMCD102 using, for example, conventional communication methods, e.g., wireless telephone communication network, Bluetooth communication protocol, a WiFi network, etc..FIG. 7 is an illustration of components of the invention in accordance with an embodiment of the present invention. InFIG. 7, the signature is shown in the signature block of the document.
• In addition to the information described above that can be stored as part of the signature capture event, the video provides additional information that can be used to authenticate the signature and the user.
• Reference in the specification to “one embodiment” or to “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiments is included in at least one embodiment of the invention. The appearances of the phrase “in one embodiment” or “an embodiment” in various places in the specification are not necessarily all referring to the same embodiment.
• Some portions of the detailed description are presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of steps (instructions) leading to a desired result. The steps are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical, magnetic or optical signals capable of being stored, transferred, combined, compared and otherwise manipulated. It is convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like. Furthermore, it is also convenient at times, to refer to certain arrangements of steps requiring physical manipulations or transformation of physical quantities or representations of physical quantities as modules or code devices, without loss of generality.
• However, all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the following discussion, it is appreciated that throughout the description, discussions utilizing terms such as “processing” or “computing” or “calculating” or “determining” or “displaying” or “determining” or the like, refer to the action and processes of a computer system, or similar electronic computing device (such as a specific computing machine), that manipulates and transforms data represented as physical (electronic) quantities within the computer system memories or registers or other such information storage, transmission or display devices.
• Certain aspects of the present invention include process steps and instructions described herein in the form of an algorithm. It should be noted that the process steps and instructions of the present invention could be embodied in software, firmware or hardware, and when embodied in software, could be downloaded to reside on and be operated from different platforms used by a variety of operating systems. The invention can also be in a computer program product which can be executed on a computing system.
• The present invention also relates to an apparatus for performing the operations herein. This apparatus may be specially constructed for the purposes, e.g., a specific computer, or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a computer readable storage medium, such as, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, magnetic-optical disks, read-only memories (ROMs), random access memories (RAMs), EPROMs, EEPROMs, magnetic or optical cards, application specific integrated circuits (ASICs), or any type of media suitable for storing electronic instructions, and each coupled to a computer system bus. Memory can include any of the above and/or other devices that can store information/data/programs and can be transient or non-transient medium. Furthermore, the computers referred to in the specification may include a single processor or may be architectures employing multiple processor designs for increased computing capability.
• The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose systems may also be used with programs in accordance with the teachings herein, or it may prove convenient to construct more specialized apparatus to perform the method steps. The structure for a variety of these systems will appear from the description herein. In addition, the present invention is not described with reference to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any references herein to specific languages are provided for disclosure of enablement and best mode of the present invention.
• In addition, the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, the disclosure of the present invention is intended to be illustrative, but not limiting, of the scope of the invention, which is set forth in the claims.
• While particular embodiments and applications of the present invention have been illustrated and described herein, it is to be understood that the invention is not limited to the precise construction and components disclosed herein and that various modifications, changes, and variations may be made in the arrangement, operation, and details of the methods and apparatuses of the present invention without departing from the spirit and scope of the invention as it is defined in the appended claims.

Claims (1)

What is claimed is:

1. A method for associating a digital representation of a wet signature with a digital document, comprising the steps of:

initiating a signature application on a mobile communication device having a camera and a display;

displaying the digital document on said display of said mobile communication device;

positioning said camera of said mobile communication device over the wet signature wherein a representation of the wet signature is positioned in a signature block of the digital document by said signature application;

capturing the wet signature by said camera;

capturing a signature video by the camera of the creation of the wet signature;

identifying authentication information at substantially the same time as said capturing of the wet signature, wherein said authentication information includes at least one of a location of the mobile communication device, a mobile communication device identifier,

a time of the capturing of the wet signature, or information provided in response to security requests of said signature application; and

storing, by said signature application, an executed version of the digital document with the wet signature digital representation in said signature block of the digital document and said signature video;

wherein said executed version of the electronic document is stored as a first file and said signature video is stored as a second file, wherein said first file is associated with said second file.

Images