본 발명은 열적외선 입력장치를 사용하여 인체의 열정보를 획득하고 이를 이용하여 개인식별을 할 수 있도록 함으로써 개인인증시스템에 적용할 수 있도록 하는 인체의 열정보를 이용한 개인인증장치와 그 방법에 관한 것이다.The present invention relates to a personal authentication device using the thermal information of the human body that can be applied to the personal authentication system by acquiring the thermal information of the human body using the thermal infrared input device and to be able to use it to personal identification. will be.
생체 정보는 사람마다 고유하고, 기존의 패스워드에 비해서 망각 염려가 없고, 분실될 가능성이 없는 장점으로 인해서 최근에는 생체의 일부인 지문, 홍채, 정맥, 얼굴 등을 인증대상으로 이용하는 생체인식시스템이 많이 개발되고 있으며, 또한 이를 이용하여 사용권한이 부여된 사용자만이 이용할 수 있도록 허여하는 인증시스템에 관한 많은 연구가 진행되고 있다.Biometric information is unique to each person, and there is no fear of forgetting it compared to the existing password, and due to the advantage that it is not lost, recently, many biometric systems using fingerprints, irises, veins, and faces, which are part of the living body, have been developed. In addition, many researches have been conducted on the authentication system that allows the user to be used only by the authorized user.
특히, 많은 생체정보 중에서 안면인식은 사용자가 신체의 일부를 센서에 접촉시키는 불편한 과정이 없는 장점으로 인해 사용자 측면에서 가장 선호되어지는 인증 방법이다.In particular, among many biometric information, facial recognition is the authentication method that is most preferred in terms of the user because of the advantage that the user does not have an inconvenient process of contacting a part of the body with the sensor.
이에 반하여, 종래의 안면인식 기술은 인체에 대한 이미지 정보를 사용하는 특성으로 인해서, 조명의 변화와 개인의 치장(화장, 헤어스타일)으로 인해 다른 사람으로 판단 오류의 가능성이 크고, 피부색에 따른 얼굴정보의 획득이 어려운 취약점을 가지고 있다. 이를 극복하기 위한 많은 연구가 진행되고 있지만, 이미지 센서의 특성상 수학적 계산이나, 알고리즘만으로 완벽하게 극복하기는 어렵다.On the contrary, the conventional face recognition technology has a high possibility of error in judging by other people due to the change of lighting and the personal appearance (cosmetics, hairstyles) due to the characteristics of using image information about the human body, and the face according to the skin color. It is difficult to obtain information. Many researches have been made to overcome this problem, but due to the characteristics of the image sensor, it is difficult to completely overcome it by mathematical calculations or algorithms alone.
또한, 얼굴의 이미지 정보는 디지털카메라와 카메라폰의 대중화에 따라서, 쉽게 타인에 의해 채취되어질 수 있고, 고출력의 인쇄 장치 등에 의해서 위조되어 부정 사용될 가능성이 큰 문제점이 있다. In addition, according to the popularization of digital cameras and camera phones, face image information may be easily collected by others, and may be forged by a high-powered printing device or the like and may be illegally used.
본 발명은 상기한 사정을 감안하여 발명한 것으로, 인체의 열정보를 사용할 경우에 조명의 변화와 치장과 피부색 또는 인종에 무관한 안면인식이 가능한 점을 고려하여 안면인식이 가능한 열적외선 입력장치를 사용하여 획득한 인체의 열정보를 이용한 안면인식을 통해 개인인증을 할 수 있도록 된 인체의 열정보를 이용한 개인인증장치와 그 방법을 제공하고자 함에 그 목적이 있다.The present invention has been invented in view of the above-described circumstances, and a thermal infrared input device capable of facial recognition in consideration of a change in illumination and facial recognition irrespective of clothing, skin color or race when using thermal information of a human body is provided. The purpose of the present invention is to provide a personal authentication device using the thermal information of the human body and a method for personal authentication through facial recognition using the thermal information obtained using the human body.
상기한 바와 같은 목적을 해결하기 위한 본 발명에 따른 인체의 열정보를 이용한 개인인증장치는, 인증하고자하는 개인의 열정보를 획득하는 수집부; 상기 수집된 안면의 열정보에서 개인의 특징을 추출하여 데이터화 하는 전처리부; 상기 전처리부에 의해 디지털화된 특징 데이터를 저장하는 저장부와; 상기 저장부에 저장된 정보와 새로 입력되는 정보를 비교하여 개인 인증여부와 인증결과처리를 담당하는 인증부를 포함하여 이루어져 있다.Personal authentication device using the thermal information of the human body according to the present invention for solving the above object, the collection unit for obtaining the thermal information of the individual to be authenticated; A preprocessor configured to extract and characterize an individual's personality from the collected thermal information of the face; A storage unit for storing the digitized feature data by the preprocessor; Comparing the information stored in the storage unit with the newly input information, and comprises an authentication unit that is responsible for personal authentication and authentication result processing.
또한, 본 발명에 따른 인체의 열정보를 이용한 개인인증방법은, 열적외선 입력장치(열적외선센서나 열적외선카메라)를 이용하여 인증하고자 하는 사용자의 안면의 열정보를 획득하는 인체의 열정보 획득 단계: 상기의 열정보 획득단계를 통해 입력된 인체의 열정보에서 얼굴을 찾는 안면검색단계: 상기 안면검색단계를 거쳐 추출한 안면의 열정보에서 인식에 사용할 특징을 추출하는 특징데이터추출단계: 상기 특징데이터추출단계에서 추출된 안면 특징과 미리 저장된 안면 열정보 데이터 베이스에서 등록된 특징 데이터를 비교하는 인식단계: 상기의 인식단계를 거친 결과를 이용하여 사용자가 요구한 업무를 처리하거나, 결과를 관리자에게 통보하는 인식후 처리 단계로 이루어진다.In addition, the personal authentication method using the thermal information of the human body according to the present invention, the thermal information acquisition of the human body to obtain the thermal information of the face of the user to authenticate using a thermal infrared input device (thermal infrared sensor or thermal infrared camera) Step: Facial search step for finding a face from the thermal information of the human body input through the thermal information acquisition step: Feature data extraction step of extracting a feature to be used for recognition from the facial heat information extracted through the face search step: Recognition step of comparing the facial feature extracted in the data extraction step and the feature data registered in the pre-stored facial thermal information database: processing the task requested by the user using the result of the recognition step, or the results to the administrator It consists of a post-recognition post-processing step.
이하, 본 발명의 바람직한 일실시예의 구성 및 작용에 대하여 예시도면에 의거하여 보다 상세히 설명한다.Hereinafter, the configuration and operation of a preferred embodiment of the present invention will be described in more detail based on the drawings.
도 1은 본 발명에 따른 인체의 열정보를 이용하는 안면 인식 장치의 기능별 구성도를 나타낸다.1 is a functional diagram of a facial recognition apparatus using thermal information of a human body according to the present invention.
첨부도면에 도시된 바와 같이, 인증하고자하는 개인의 인체 열정보를 획득하는 수집부(12)는 인체의 열정보를 열적외선 입력장치(열적외선카메라, 열적외선센서; 10)를 통해서 입력을 받으며, 입력된 열정보를 온도의 높낮이에 따라 양자화하여 디지털 데이터로 변환하는 기능을 수행한다.As shown in the accompanying drawings, the collection unit 12 for acquiring the human body thermal information of the individual to be authenticated receives the thermal information of the human body through a thermal infrared input device (thermal infrared camera, thermal infrared sensor; 10) In this case, the input thermal information is quantized according to the height of the temperature and converted into digital data.
다음 단계의 전처리부(14)에서는 디지털화된 인체 열정보에서 얼굴영역을 추출하고, 추출된 영역에서의 열정보를 후술되는 인증부(18)에서 사용하기에 적합한 특징 데이터로 변환하는 기능을 수행한다.In the next step, the preprocessing unit 14 extracts a face region from the digitized human body thermal information and converts the thermal information in the extracted region into feature data suitable for use in the authentication unit 18 described later. .
다음의 저장부(16)는 개인의 안면 열정보에서 추출된 특징 데이터를 등록된 개인에 대해서 데이터베이스에 저장하고, 인증을 위한 인증부(18)의 요청시 등록되어 저장된 개인의 특징데이터를 제공하는 역할을 수행한다.The storage unit 16 stores the feature data extracted from the facial heat information of the person in a database for the registered individual, and provides the personalized feature data registered and stored at the request of the authentication unit 18 for authentication. Play a role.
다음 인증부(18)는 추출된 안면 열정보를 이용하여 개인인증을 수행하는 인증 알고리즘과 인증결과를 통보하고, 차후 업무를 진행하도록 하는 역할을 수행한다.Next, the authentication unit 18 notifies the authentication algorithm and the authentication result for performing personal authentication by using the extracted facial heat information, and performs a role of performing the work later.
상기 인증부(18)의 인증결과는 응용시스템(20)에 전송되어 응용시스템(20)의 작동을 제어하게 된다. 예컨대, 응용시스템(20)을 출입문제어장치에 응용한 경우 인증된 사용자가 출입이 허가된 사용자로 인식되면 출입문을 자동으로 개폐하여 출입을 허용할 수 있도록 하며, 컴퓨터와 같은 무인 기기에 응용한 경우에는 사용권한이 부여된 사용자로 인식되면 기기조작에 따른 요구정보를 제공하도록 할 수 있다.The authentication result of the authentication unit 18 is transmitted to the application system 20 to control the operation of the application system 20. For example, when the application system 20 is applied to an access control device, when an authenticated user is recognized as an authorized user, the door is automatically opened and closed to allow access, and when applied to an unmanned device such as a computer. If the user is recognized as a user authorized to use the device can provide the required information according to the operation of the device.
도 2는 본 발명의 사용예를 도시한 것으로, 열적외선 입력장치(10)와 수집부(12)는 전처리부(14)와 저장부(16) 및 인증부(18)가 내장되어 이루어진 인식시스템(30)과 별도로 구현되어 획득된 열정보를 케이블(40)을 통해 인식시스템(30)으로 전송하도록 이루어져 있다. 상기 열적외선 입력장치(10)와 수집부(12)는 부피가 작아 설치장소에 구애받지 않고 인체의 안면을 촬영하기 곳에 설치할 수 있으며, 인식시스템(30)은 제3자로부터 노출되지 않는 곳에 설치하여 기기파손이나 변경 등 부정조작을 방지할 수 있다.Figure 2 shows an example of the use of the present invention, the thermal infrared input device 10 and the collecting unit 12 is a recognition system in which the preprocessor 14, the storage unit 16 and the authentication unit 18 is built-in. It is configured to transmit the thermal information obtained by being implemented separately from the 30 to the recognition system 30 through the cable 40. The thermal infrared input device 10 and the collecting unit 12 is small in volume and can be installed anywhere to photograph the face of the human body regardless of the installation site, the recognition system 30 is installed in a place not exposed from a third party This can prevent unauthorized operation such as device damage or change.
이하에서는 도 3에 의거 열정보 획득을 통해 개인인식을 하는 방법에 대해 상세히 설명한다.Hereinafter, a method of personal recognition through obtaining thermal information based on FIG. 3 will be described in detail.
먼저, 인체의 열정보 수집단계에서는, 인체에서 개인인증을 받고자 하는 사용자의 얼굴 영역을 포함하는 열정보를 획득하게 된다. 이 단계는 열정보를 입력받는 장치인 열적외선 장치(10)에 의해서 인체의 열정보를 수집하게 된다.First, in the heat information collection step of the human body, the thermal information including the face area of the user to obtain personal authentication in the human body is obtained. In this step, the thermal information of the human body is collected by the thermal infrared apparatus 10 that is a device that receives the thermal information.
이어, 인체의 열정보 수집단계에서 수집된 열정보를 이용하여 안면을 검색하는 단계를 수행한다. 이는 인체의 열정보에서 안면영역을 검색하는 단계로서, 안면의 열정보는 80°F이상의 높은 온도로 타원모양으로 균일하게 분포되어 있다. 이때 안면 이미지 정보와는 달리 피부색에 무관하게 안면에 대해 공통적인 특징을 제공해준다. 열정보에서 수직과 수평방향으로 80°F이상의 온도데이터를 누적하고, 누적된 영역의 값의 분포한 수직, 수평의 좌표에서 얼굴영역이 존재하는 사각형의 영역을 검출한다.Subsequently, the facial search is performed using the thermal information collected in the human body thermal information collection step. This is a step of searching for the facial area from the thermal information of the human body. The passion beams of the face are uniformly distributed in elliptical shape at a high temperature of 80 ° F or more. At this time, unlike facial image information, it provides a common feature for facial regardless of skin color. The thermal data accumulates temperature data of 80 ° F or more in the vertical and horizontal directions, and detects the rectangular region where the face region exists from the vertical and horizontal coordinates of the accumulated region values.
이후에 얼굴영역에서 열정보 데이터를 미분한다. 얼굴영역에서 입술주위와 눈주위, 코주위와 눈썹 주위등에서 열정보의 변화가 존재하며, 이는 얼굴의 형태 정보를 포함하고 있다. 얼굴이 이미지 인식에서는 화장 등의 안면 치장으로 사라질 수 있는 얼굴의 특징 부위의 위치가 열정보에서는 그 차이가 변함 없이 존재하게 된다.Thereafter, the thermal information data is differentiated in the face region. In the face area, there is a change of thermal information around the lips, around the eyes, around the nose and around the eyebrows, which includes the shape information of the face. In the image recognition, the position of the facial feature that can disappear by facial makeup such as makeup is present in the thermal information without difference.
얼굴대상영역에서 열의 온도차를 반영한 미분을 통해 생성된 에지 정보를 통해서 얼굴의 영역과 얼굴내의 눈, 코, 입의 특징 부위를 추출한다.The edge region generated by the derivatives reflecting the temperature difference of heat in the face target region is extracted from the facial region and the features of eyes, nose and mouth in the face.
안면검색이후 특징데이터 추출단계를 수행한다. 이 단계는 개인인증알고리즘에서 사용할 특징을 추출하기 위한 단계이다.The feature data extraction step is performed after face searching. This step is to extract the features to be used in the personal authentication algorithm.
본 인증알고리즘은 얼굴의 전체적인 열 특징에서 주성분분석(Principle Component)을 통하여 개인의 특징이 두드러지도록 저차원 매핑을 실시하고, 저차원 매핑 후에 저장된 템플릿과의 거리를 비교하는 인식기와 안면영역의 미분값을 입력으로 사용하는 신경망 인식기와 안면의 구조적 특징값(눈, 코, 입의 위치, 얼굴형태)을 수치화한 정보를 비교하는 인식기로 다중인식기를 채택하고 있다.This authentication algorithm performs low dimensional mapping so that individual characteristics stand out through principal component analysis on the overall thermal features of the face, and compares distances from templates stored after low dimensional mapping. The multi-recognizer is adopted as a recognizer that compares the numerical information of the neural network recognizer used as the input and the structural feature values (eye, nose, mouth position, and face shape) of the face.
한 픽셀에 대해서 적, 녹, 청(RGB)의 3가지 정보를 저장해야 하는 칼라의 안면 이미지를 사용하는 얼굴인식 방법에 비해, 한 픽셀 정보로 온도의 값만을 사용하므로 그 처리 데이터의 량이 적은 관계로 다중인식기를 이용하여 동일시간에 더욱 세밀한 인증처리가 가능하다.Compared to the face recognition method using the face image of color that needs to store three kinds of information of red, green, and blue for one pixel, the amount of processed data is small because only the temperature value is used as one pixel information. By using multi-recognizer, more detailed authentication processing is possible at the same time.
이와 같은 다중인식기를 위해서 각각의 입력 특성에 적합한 특징데이터를 추출한다. 템플릿 비교기를 위해서 템플릿과 동일한 주성분 방향으로 투영을 실시하고, 신경망 인식기를 안면 열 데이터를 샘플링하고, 그후 미분연산을 실시하여, 가로 15와 세로 20의 총 300개의 미분데이터를 생성하고, 그 값을 0.0 ~ 1.0의 범위 내에서 정규화 한다. 안면의 구조적 특징값을 추출한다. 이때 안면의 폭과 높이에서 긴면의 크기를 100으로 설정한 후, 안면의 특징인(눈섭, 눈, 코, 입)의 크기와 위치 정보를 저장한다.For such a multiple recognizer, feature data suitable for each input characteristic is extracted. For the template comparator, the projection is performed in the same principal component direction as the template, and the neural network recognizer samples facial thermal data, and then performs differential calculation to generate a total of 300 differential data of 15 horizontal and 20 vertical, Normalize within the range of 0.0 to 1.0. The structural feature values of the face are extracted. At this time, the size of the long side is set to 100 in the width and height of the face, and the size and position information of the facial features (brows, eyes, nose, mouth) are stored.
안면의 구조적 특징데이터를 추출하여 저장한 이후에는 인식단계를 수행한다. 인식단계에서는 전처리 단계에서 추출된 특징데이터를 이용하여 각각의 인식기의 파라미터를 설정하고, 신경망을 학습시키는 단계이다. 이때 템플릿의 비교기와 신경망 인식기의 결과를 동일 가중치를 부여하여 인증한다. 이 두 인식기의 인식결과를 저장된 데이터 베이스에 대해 각각 0.0 ~1.0 의 비교결과를 출력하게 설정한다.After extracting and storing the structural feature data of the face, a recognition step is performed. In the recognition step, the parameters of each recognizer are set using the feature data extracted in the preprocessing step, and the neural network is trained. At this time, the result of the comparator and the neural network recognizer of the template is given the same weight to be authenticated. The recognition results of the two recognizers are set to output a comparison result of 0.0 to 1.0 for the stored database.
0.0은 무관한 특징을 의미하고, 1.0은 동일 특성에서 완전 일치함을 의미한다. 두 개의 인식기의 인식결과를 평균하여 최고의 인식결과를 산출하는 템플릿과 동일한 인물로 판정하는 방식을 채택한다. 이때 최고 값으로 선정된 템플릿의 인식결과 값이 0.5이하인 경우와 두 번째 최고 값이 0.5 이상인 경우는 인증불가 처리를 수행한다. 두 인식기를 이용하여 인증된 경우에만 얼굴의 구조적 특징 값을 사용하여 추가적인 비교처리를 수행한 후에 인정범위에 포함되는 경우에만 인증을 승인하고, 인증작업을 마무리하게 된다. 얼굴의 구조적 특징값은 최종적으로 선정된 템플릿과 입력되어진 특징과 비교하는 1번의 실행만을 수행하게 된다.0.0 means irrelevant features, 1.0 means perfect agreement on the same features. The recognition method of the two recognizers is averaged to determine the same person as the template that produces the best recognition result. At this time, if the recognition result value of the template selected as the highest value is 0.5 or less and the second highest value is 0.5 or more, the authentication is not processed. Only when it is authenticated using the two recognizers, additional comparison processing is performed using the structural feature values of the face, and then the authentication is approved only when it is included in the scope of accreditation, and the authentication work is completed. The structural feature value of the face is executed only once in comparison with the finally selected template and the input feature.
마지막으로 구조적 특징값은 오인식을 예방하기 위한 것으로, 얼굴이 긴 사람이 얼굴이 작은 사람으로 인정되는 등을 방지하기 위한 하나의 인증 안전장치용도로 사용한다.Finally, the structural feature value is used to prevent misperception, and is used as an authentication safety device for preventing a long face from being recognized as a small face.
인식이 완료된 이후 수행하게 되는 인식 후 처리단계에서는 개인인식 결과에 따라 해당 결과를 이용하는 응용시스템의 작동을 제어하는 단계로써, 인체 열정보를 이용한 개인인증장치가 설치된 응용시스템에서 그 응용시스템의 고유 목적에 따른, 인증된 사용자가 요구하는 처리를 수행하고, 인증이 실패한 경우에 경보음과 관리자에 통보하는 등의 처리를 수행하는 단계이다.In the post-recognition processing step performed after the recognition is completed, the operation of the application system using the result is controlled according to the result of personal recognition, and the unique purpose of the application system in the application system in which the personal authentication device using the human body thermal information is installed. According to the step, performing the processing required by the authenticated user, and if the authentication fails, and performs a process such as notifying the alarm sound and the administrator.
상기한 바와 같이 본 발명에 의하면, 안면 이미지인식만을 이용할 경우의 손쉽게 타인의 안면정보 위조를 통해 그 응용시스템의 부정거래를 방지할 수 있고, 열적외 카메라의 특성상 생체정보의 유효성(생사여부)도 동시에 확인할 수 있으므로 인해 생체정보의 도난을 방지하는 효과를 동시에 얻을 수 있다. 이로써 안면인식시스템의 신뢰성을 증가시켜 금융기관의 금융자동화기기에 적용하는 경우 은행고객이 안심하고 금융자동화기기를 이용할 수 있으며, 생체정보의 도난에 대한 막연한 두려움을 가지지 않게 되며, 생체정보입력시 사용자가 생체인식부위를 센서에 접촉시키는 불편함 없이 손쉽게 그 용용시스템을 이용할 수 있는 장점이 있다.As described above, according to the present invention, it is possible to easily prevent fraudulent transaction of the application system through forgery of other people's facial information when using only the face image recognition, and the validity (live or dead) of biometric information is also due to the characteristics of the thermal infrared camera. Since it can be checked at the same time, it is possible to simultaneously obtain the effect of preventing theft of biological information. This increases the reliability of the facial recognition system and applies it to financial institution's financial automation equipment, so that bank customers can use the financial automation equipment with confidence, and there is no vague fear of theft of biometric information. There is an advantage that can easily use the application system without the inconvenience of contacting the biometric part to the sensor.
본 발명은 인체의 열정보를 이용한 개인인증장치와 그 방법의 바람직한 일실시예에 대한 기술사상을 예시도면에 의거하여 설명했지만, 이는 본 발명의 가장 양호한 실시예를 예시적으로 설명한 것이지 본 발명의 특허청구범위를 한정하는 것은 아니다. 본 발명은 이 기술분야의 통상 지식을 가진 자라면 누구나 본 발명의 기술사상의 범주를 이탈하지 않는 범위 내에서 다양한 변형 및 모방이 가능함은 명백한 사실이다.The present invention has been described based on the technical drawings of the personal authentication device using the thermal information of the human body and a preferred embodiment of the method on the basis of the drawings, which is illustrative of the best embodiment of the present invention by way of example It is not intended to limit the scope of the claims. It will be apparent to those skilled in the art that various modifications and imitations can be made without departing from the scope of the technical idea of the present invention.
도 1은 본 발명의 구성도,1 is a block diagram of the present invention,
도 2는 본 발명의 사용상태도,2 is a state of use of the present invention,
도 3은 본 발명에 따른 인체의 열정보를 이용한 개인인증방법을 설명하기 위한 흐름도이다.3 is a flowchart illustrating a personal authentication method using the thermal information of the human body according to the present invention.
<도면의 주요부분에 대한 부호의 설명><Description of the symbols for the main parts of the drawings>
10 -- 열적외선입력장치,12 -- 수집부,10-thermal infrared input device, 12-collector,
14 -- 전처리부,16 -- 저장부,14-preprocessor, 16-storage,
18 -- 인증부,20 -- 응용시스템,18-certification unit, 20-application system,
30 -- 인식시스템,40 -- 케이블.30-recognition system, 40-cable.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020030093627AKR100554129B1 (en) | 2003-12-19 | 2003-12-19 | Personal authentication device using heat information of human body and its method |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020030093627AKR100554129B1 (en) | 2003-12-19 | 2003-12-19 | Personal authentication device using heat information of human body and its method |
| Publication Number | Publication Date |
|---|---|
| KR20050061975Atrue KR20050061975A (en) | 2005-06-23 |
| KR100554129B1 KR100554129B1 (en) | 2006-02-20 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020030093627AExpired - Fee RelatedKR100554129B1 (en) | 2003-12-19 | 2003-12-19 | Personal authentication device using heat information of human body and its method |
| Country | Link |
|---|---|
| KR (1) | KR100554129B1 (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100871557B1 (en)* | 2007-04-27 | 2008-12-01 | 금오공과대학교 산학협력단 | Face Detection and Identification Method for Image-Based Security |
| KR101014325B1 (en)* | 2008-02-11 | 2011-02-14 | 김동의 | Infrared Face Recognition System and Method |
| KR20170066714A (en)* | 2007-09-24 | 2017-06-14 | 애플 인크. | Embedded authentication systems in an electronic device |
| US10055634B2 (en) | 2013-09-09 | 2018-08-21 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs |
| US10142835B2 (en) | 2011-09-29 | 2018-11-27 | Apple Inc. | Authentication with secondary approver |
| US10334054B2 (en) | 2016-05-19 | 2019-06-25 | Apple Inc. | User interface for a device requesting remote authorization |
| US10395128B2 (en) | 2017-09-09 | 2019-08-27 | Apple Inc. | Implementation of biometric authentication |
| US10438205B2 (en) | 2014-05-29 | 2019-10-08 | Apple Inc. | User interface for payments |
| US10484384B2 (en) | 2011-09-29 | 2019-11-19 | Apple Inc. | Indirect authentication |
| US10521579B2 (en) | 2017-09-09 | 2019-12-31 | Apple Inc. | Implementation of biometric authentication |
| WO2020141696A1 (en)* | 2019-01-04 | 2020-07-09 | 주식회사 딥엑스 | Trained model creation method for performing specific function for electronic device, learning model for performing same function, exclusive chip and operation method for same, and electronic device and system |
| US10860096B2 (en) | 2018-09-28 | 2020-12-08 | Apple Inc. | Device control using gaze information |
| US11100349B2 (en) | 2018-09-28 | 2021-08-24 | Apple Inc. | Audio assisted enrollment |
| US11170085B2 (en) | 2018-06-03 | 2021-11-09 | Apple Inc. | Implementation of biometric authentication |
| US11209961B2 (en) | 2012-05-18 | 2021-12-28 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs |
| KR20220008621A (en)* | 2020-07-14 | 2022-01-21 | 엘지전자 주식회사 | Certificate apparatus |
| US11450151B2 (en)* | 2019-07-18 | 2022-09-20 | Capital One Services, Llc | Detecting attempts to defeat facial recognition |
| US11676373B2 (en) | 2008-01-03 | 2023-06-13 | Apple Inc. | Personal computing device control using face detection and recognition |
| US11977653B2 (en)* | 2022-03-07 | 2024-05-07 | Recolabs Ltd. | Systems and methods for securing files and/or records related to a business process |
| US12079458B2 (en) | 2016-09-23 | 2024-09-03 | Apple Inc. | Image data for enhanced user interactions |
| US12099586B2 (en) | 2021-01-25 | 2024-09-24 | Apple Inc. | Implementation of biometric authentication |
| US12210603B2 (en) | 2021-03-04 | 2025-01-28 | Apple Inc. | User interface for enrolling a biometric feature |
| US12216754B2 (en) | 2021-05-10 | 2025-02-04 | Apple Inc. | User interfaces for authenticating to perform secure operations |
| US12262111B2 (en) | 2011-06-05 | 2025-03-25 | Apple Inc. | Device, method, and graphical user interface for accessing an application in a locked device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102551473B1 (en)* | 2021-06-02 | 2023-07-04 | 동의대학교 산학협력단 | System and method for controlling of sterilization gate based on artificial intelligence |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100871557B1 (en)* | 2007-04-27 | 2008-12-01 | 금오공과대학교 산학협력단 | Face Detection and Identification Method for Image-Based Security |
| US10956550B2 (en) | 2007-09-24 | 2021-03-23 | Apple Inc. | Embedded authentication systems in an electronic device |
| US10275585B2 (en) | 2007-09-24 | 2019-04-30 | Apple Inc. | Embedded authentication systems in an electronic device |
| US11468155B2 (en) | 2007-09-24 | 2022-10-11 | Apple Inc. | Embedded authentication systems in an electronic device |
| KR20180114229A (en)* | 2007-09-24 | 2018-10-17 | 애플 인크. | Embedded authentication systems in an electronic device |
| KR20170066714A (en)* | 2007-09-24 | 2017-06-14 | 애플 인크. | Embedded authentication systems in an electronic device |
| US12406490B2 (en) | 2008-01-03 | 2025-09-02 | Apple Inc. | Personal computing device control using face detection and recognition |
| US11676373B2 (en) | 2008-01-03 | 2023-06-13 | Apple Inc. | Personal computing device control using face detection and recognition |
| KR101014325B1 (en)* | 2008-02-11 | 2011-02-14 | 김동의 | Infrared Face Recognition System and Method |
| US12262111B2 (en) | 2011-06-05 | 2025-03-25 | Apple Inc. | Device, method, and graphical user interface for accessing an application in a locked device |
| US10516997B2 (en) | 2011-09-29 | 2019-12-24 | Apple Inc. | Authentication with secondary approver |
| US10142835B2 (en) | 2011-09-29 | 2018-11-27 | Apple Inc. | Authentication with secondary approver |
| US11200309B2 (en) | 2011-09-29 | 2021-12-14 | Apple Inc. | Authentication with secondary approver |
| US11755712B2 (en) | 2011-09-29 | 2023-09-12 | Apple Inc. | Authentication with secondary approver |
| US10419933B2 (en) | 2011-09-29 | 2019-09-17 | Apple Inc. | Authentication with secondary approver |
| US10484384B2 (en) | 2011-09-29 | 2019-11-19 | Apple Inc. | Indirect authentication |
| US11209961B2 (en) | 2012-05-18 | 2021-12-28 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs |
| US11989394B2 (en) | 2012-05-18 | 2024-05-21 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs |
| US10410035B2 (en) | 2013-09-09 | 2019-09-10 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs |
| US11768575B2 (en) | 2013-09-09 | 2023-09-26 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on unlock inputs |
| US12314527B2 (en) | 2013-09-09 | 2025-05-27 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on unlock inputs |
| US11494046B2 (en) | 2013-09-09 | 2022-11-08 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on unlock inputs |
| US10372963B2 (en) | 2013-09-09 | 2019-08-06 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs |
| US10803281B2 (en) | 2013-09-09 | 2020-10-13 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs |
| US11287942B2 (en) | 2013-09-09 | 2022-03-29 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces |
| US10262182B2 (en) | 2013-09-09 | 2019-04-16 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on unlock inputs |
| US10055634B2 (en) | 2013-09-09 | 2018-08-21 | Apple Inc. | Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs |
| US11836725B2 (en) | 2014-05-29 | 2023-12-05 | Apple Inc. | User interface for payments |
| US10796309B2 (en) | 2014-05-29 | 2020-10-06 | Apple Inc. | User interface for payments |
| US10438205B2 (en) | 2014-05-29 | 2019-10-08 | Apple Inc. | User interface for payments |
| US10902424B2 (en) | 2014-05-29 | 2021-01-26 | Apple Inc. | User interface for payments |
| US10977651B2 (en) | 2014-05-29 | 2021-04-13 | Apple Inc. | User interface for payments |
| US10748153B2 (en) | 2014-05-29 | 2020-08-18 | Apple Inc. | User interface for payments |
| US10334054B2 (en) | 2016-05-19 | 2019-06-25 | Apple Inc. | User interface for a device requesting remote authorization |
| US11206309B2 (en) | 2016-05-19 | 2021-12-21 | Apple Inc. | User interface for remote authorization |
| US10749967B2 (en) | 2016-05-19 | 2020-08-18 | Apple Inc. | User interface for remote authorization |
| US12079458B2 (en) | 2016-09-23 | 2024-09-03 | Apple Inc. | Image data for enhanced user interactions |
| US11765163B2 (en) | 2017-09-09 | 2023-09-19 | Apple Inc. | Implementation of biometric authentication |
| US10521579B2 (en) | 2017-09-09 | 2019-12-31 | Apple Inc. | Implementation of biometric authentication |
| US10395128B2 (en) | 2017-09-09 | 2019-08-27 | Apple Inc. | Implementation of biometric authentication |
| US10410076B2 (en) | 2017-09-09 | 2019-09-10 | Apple Inc. | Implementation of biometric authentication |
| US11386189B2 (en) | 2017-09-09 | 2022-07-12 | Apple Inc. | Implementation of biometric authentication |
| US10783227B2 (en) | 2017-09-09 | 2020-09-22 | Apple Inc. | Implementation of biometric authentication |
| US11393258B2 (en) | 2017-09-09 | 2022-07-19 | Apple Inc. | Implementation of biometric authentication |
| US10872256B2 (en) | 2017-09-09 | 2020-12-22 | Apple Inc. | Implementation of biometric authentication |
| US12189748B2 (en) | 2018-06-03 | 2025-01-07 | Apple Inc. | Implementation of biometric authentication |
| US11170085B2 (en) | 2018-06-03 | 2021-11-09 | Apple Inc. | Implementation of biometric authentication |
| US11928200B2 (en) | 2018-06-03 | 2024-03-12 | Apple Inc. | Implementation of biometric authentication |
| US10860096B2 (en) | 2018-09-28 | 2020-12-08 | Apple Inc. | Device control using gaze information |
| US12105874B2 (en) | 2018-09-28 | 2024-10-01 | Apple Inc. | Device control using gaze information |
| US11100349B2 (en) | 2018-09-28 | 2021-08-24 | Apple Inc. | Audio assisted enrollment |
| US11619991B2 (en) | 2018-09-28 | 2023-04-04 | Apple Inc. | Device control using gaze information |
| US11809784B2 (en) | 2018-09-28 | 2023-11-07 | Apple Inc. | Audio assisted enrollment |
| US12124770B2 (en) | 2018-09-28 | 2024-10-22 | Apple Inc. | Audio assisted enrollment |
| US12165061B2 (en) | 2019-01-04 | 2024-12-10 | Deepx Co., Ltd. | Trained model creation method for performing specific function for electronic device, trained model for performing same function, exclusive chip and operation method for the same, and electronic device and system using the same |
| CN113366508A (en)* | 2019-01-04 | 2021-09-07 | 蒂普爱可斯有限公司 | Method for creating training model for executing specific function of electronic device, learning model for executing same function, dedicated chip and operating method thereof, and electronic device and system |
| CN113366508B (en)* | 2019-01-04 | 2025-03-21 | 蒂普爱可斯有限公司 | Training model creation method for executing specific functions of electronic device, learning model for executing the same function, dedicated chip and operation method thereof, electronic device and system |
| US11429180B2 (en) | 2019-01-04 | 2022-08-30 | Deepx Co., Ltd. | Trained model creation method for performing specific function for electronic device, trained model for performing same function, exclusive chip and operation method for the same, and electronic device and system using the same |
| WO2020141696A1 (en)* | 2019-01-04 | 2020-07-09 | 주식회사 딥엑스 | Trained model creation method for performing specific function for electronic device, learning model for performing same function, exclusive chip and operation method for same, and electronic device and system |
| US11450151B2 (en)* | 2019-07-18 | 2022-09-20 | Capital One Services, Llc | Detecting attempts to defeat facial recognition |
| KR20220008621A (en)* | 2020-07-14 | 2022-01-21 | 엘지전자 주식회사 | Certificate apparatus |
| US12099586B2 (en) | 2021-01-25 | 2024-09-24 | Apple Inc. | Implementation of biometric authentication |
| US12210603B2 (en) | 2021-03-04 | 2025-01-28 | Apple Inc. | User interface for enrolling a biometric feature |
| US12216754B2 (en) | 2021-05-10 | 2025-02-04 | Apple Inc. | User interfaces for authenticating to perform secure operations |
| US11977653B2 (en)* | 2022-03-07 | 2024-05-07 | Recolabs Ltd. | Systems and methods for securing files and/or records related to a business process |
| Publication number | Publication date |
|---|---|
| KR100554129B1 (en) | 2006-02-20 |
| Publication | Publication Date | Title |
|---|---|---|
| KR100554129B1 (en) | Personal authentication device using heat information of human body and its method | |
| US10728242B2 (en) | System and method for biometric authentication in connection with camera-equipped devices | |
| Burge et al. | Ear biometrics | |
| Ross et al. | Human recognition using biometrics: an overview | |
| CN105427421A (en) | Entrance guard control method based on face recognition | |
| JP7188446B2 (en) | Authentication device, authentication method, authentication program and recording medium | |
| Abdelwhab et al. | A survey on soft biometrics for human identification | |
| CN103699996A (en) | Payment authentication method based on human biological characteristics | |
| KR101266603B1 (en) | A face recognition system for user authentication of an unmanned receipt system | |
| Ibrahim et al. | Trends in Biometric Authentication: A review | |
| Musthafa et al. | Smart Authentication System Using Deep Learning Techniques Based on Face and License Plate Recognition | |
| Singla et al. | Face Detection and Recognition Using Digital Image Processing:" State of the Art" | |
| Sharma et al. | Human recognition methods based on biometric technologies | |
| KR20070118806A (en) | Facial Detection Method for Embedded System | |
| Said et al. | A survey on smartphone protecting identification against attacks using biometric authentication systems | |
| Patil et al. | Iris recognition using fuzzy system | |
| KR102757980B1 (en) | Authentication system and method through 3d sculpture | |
| KR20140060081A (en) | Apparatus and method for speed gate based on face recognition at a distance | |
| Falohun et al. | Remote Access Control System Using Iris Signature | |
| KR102714901B1 (en) | System and method for deep learning based non-contact palm print identification | |
| Schreiner | Biometrics: Prospects for going the distance | |
| Melin et al. | Human Recognition using Face, Fingerprint and Voice | |
| WO2023159350A1 (en) | Recognition system detecting facial features | |
| KR20070097629A (en) | Embedded system for face recognition | |
| CN107093231A (en) | Gate control system based on hand back vein |
| Date | Code | Title | Description |
|---|---|---|---|
| A201 | Request for examination | ||
| PA0109 | Patent application | St.27 status event code:A-0-1-A10-A12-nap-PA0109 | |
| PA0201 | Request for examination | St.27 status event code:A-1-2-D10-D11-exm-PA0201 | |
| PG1501 | Laying open of application | St.27 status event code:A-1-1-Q10-Q12-nap-PG1501 | |
| E902 | Notification of reason for refusal | ||
| PE0902 | Notice of grounds for rejection | St.27 status event code:A-1-2-D10-D21-exm-PE0902 | |
| T11-X000 | Administrative time limit extension requested | St.27 status event code:U-3-3-T10-T11-oth-X000 | |
| E13-X000 | Pre-grant limitation requested | St.27 status event code:A-2-3-E10-E13-lim-X000 | |
| P11-X000 | Amendment of application requested | St.27 status event code:A-2-2-P10-P11-nap-X000 | |
| P13-X000 | Application amended | St.27 status event code:A-2-2-P10-P13-nap-X000 | |
| E701 | Decision to grant or registration of patent right | ||
| PE0701 | Decision of registration | St.27 status event code:A-1-2-D10-D22-exm-PE0701 | |
| PR1002 | Payment of registration fee | St.27 status event code:A-2-2-U10-U11-oth-PR1002 Fee payment year number:1 | |
| GRNT | Written decision to grant | ||
| PR0701 | Registration of establishment | St.27 status event code:A-2-4-F10-F11-exm-PR0701 | |
| PG1601 | Publication of registration | St.27 status event code:A-4-4-Q10-Q13-nap-PG1601 | |
| P22-X000 | Classification modified | St.27 status event code:A-4-4-P10-P22-nap-X000 | |
| PR1001 | Payment of annual fee | St.27 status event code:A-4-4-U10-U11-oth-PR1001 Fee payment year number:4 | |
| PR1001 | Payment of annual fee | St.27 status event code:A-4-4-U10-U11-oth-PR1001 Fee payment year number:5 | |
| PR1001 | Payment of annual fee | St.27 status event code:A-4-4-U10-U11-oth-PR1001 Fee payment year number:6 | |
| PR1001 | Payment of annual fee | St.27 status event code:A-4-4-U10-U11-oth-PR1001 Fee payment year number:7 | |
| R18-X000 | Changes to party contact information recorded | St.27 status event code:A-5-5-R10-R18-oth-X000 | |
| P22-X000 | Classification modified | St.27 status event code:A-4-4-P10-P22-nap-X000 | |
| FPAY | Annual fee payment | Payment date:20121228 Year of fee payment:8 | |
| PR1001 | Payment of annual fee | St.27 status event code:A-4-4-U10-U11-oth-PR1001 Fee payment year number:8 | |
| FPAY | Annual fee payment | Payment date:20131219 Year of fee payment:9 | |
| PR1001 | Payment of annual fee | St.27 status event code:A-4-4-U10-U11-oth-PR1001 Fee payment year number:9 | |
| FPAY | Annual fee payment | Payment date:20150130 Year of fee payment:10 | |
| PR1001 | Payment of annual fee | St.27 status event code:A-4-4-U10-U11-oth-PR1001 Fee payment year number:10 | |
| FPAY | Annual fee payment | Payment date:20160128 Year of fee payment:11 | |
| PR1001 | Payment of annual fee | St.27 status event code:A-4-4-U10-U11-oth-PR1001 Fee payment year number:11 | |
| P22-X000 | Classification modified | St.27 status event code:A-4-4-P10-P22-nap-X000 | |
| FPAY | Annual fee payment | Payment date:20170123 Year of fee payment:12 | |
| PR1001 | Payment of annual fee | St.27 status event code:A-4-4-U10-U11-oth-PR1001 Fee payment year number:12 | |
| LAPS | Lapse due to unpaid annual fee | ||
| PC1903 | Unpaid annual fee | St.27 status event code:A-4-4-U10-U13-oth-PC1903 Not in force date:20180215 Payment event data comment text:Termination Category : DEFAULT_OF_REGISTRATION_FEE | |
| PN2301 | Change of applicant | St.27 status event code:A-5-5-R10-R13-asn-PN2301 St.27 status event code:A-5-5-R10-R11-asn-PN2301 | |
| PC1903 | Unpaid annual fee | St.27 status event code:N-4-6-H10-H13-oth-PC1903 Ip right cessation event data comment text:Termination Category : DEFAULT_OF_REGISTRATION_FEE Not in force date:20180215 | |
| R18-X000 | Changes to party contact information recorded | St.27 status event code:A-5-5-R10-R18-oth-X000 |