US20100295782A1 - System and method for control based on face ore hand gesture detection - Google Patents
System and method for control based on face ore hand gesture detectionDownload PDFInfo
- Publication number
- US20100295782A1 US20100295782A1US12/724,896US72489610AUS2010295782A1US 20100295782 A1US20100295782 A1US 20100295782A1US 72489610 AUS72489610 AUS 72489610AUS 2010295782 A1US2010295782 A1US 2010295782A1
- Authority
- US
- United States
- Prior art keywords
- image
- captured image
- control signal
- hand gesture
- response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
- G01S3/78—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using electromagnetic waves other than radio waves
- G01S3/782—Systems for determining direction or deviation from predetermined direction
- G01S3/785—Systems for determining direction or deviation from predetermined direction using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system
- G01S3/786—Systems for determining direction or deviation from predetermined direction using adjustment of orientation of directivity characteristics of a detector or detector system to give a desired condition of signal derived from that detector or detector system the desired condition being maintained automatically
- G01S3/7864—T.V. type tracking systems
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
- G06F3/005—Input arrangements through a video camera
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/24—Aligning, centring, orientation detection or correction of the image
- G06V10/242—Aligning, centring, orientation detection or correction of the image by image rotation, e.g. by 90 degrees
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/10—Intensity circuits
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/02—Calling substations, e.g. by ringing
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4131—Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42222—Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/4223—Cameras
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
- H04N21/43635—HDMI
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/51—Housings
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/63—Generation or supply of power specially adapted for television receivers
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers
- H04N5/645—Mounting of picture tube on chassis or in housing
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/002—Special television systems not provided for by H04N7/007 - H04N7/18
- H04N7/005—Special television systems not provided for by H04N7/007 - H04N7/18 using at least one opto-electrical conversion device
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/015—High-definition television systems
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/025—Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame
- H04N7/0255—Display systems therefor
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/10—Adaptations for transmission by electrical cable
- H04N7/102—Circuits therefor, e.g. noise reducers, equalisers, amplifiers
- H04N7/104—Switchers or splitters
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
- H04N7/163—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing by receiver means only
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
- H04W88/02—Terminal devices
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
- G09G2330/02—Details of power systems and of start or stop of display operation
- G09G2330/027—Arrangements or methods related to powering off a display
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
Definitions
- the present inventionrelates generally to devices (such as displays) controlled by face detection.
- a method and apparatus for using face detection functionalityfor obtaining a good visibility with a screen of a display.
- a digital camerais attached to a display having a central image captured substantially congruent with the display plane line-of-sight.
- a face detection algorithmis performed by an image processor, using the image captured by the digital camera to obtain the existence and localization of faces in the captured image.
- the horizontal deviation of a detected face from the image center lineis calculated.
- the camera and the image processorserve as a sensor providing the horizontal deviation value and direction.
- a control loop(open or closed) uses the horizontal deviation as an error signal, and a controller command a horizontal motor mechanically affixed to the display to rotate the display in the required direction (and the angular shift required) to correct for the deviation (set point zero).
- a closed loopmay be employed for minimizing the deviation continuously.
- the vertical deviation of a detected face from the image center lineis calculated.
- the camera and the image processorserve as a sensor providing the vertical deviation value and direction.
- a control loop(open or closed) uses the vertical deviation as an error signal, and a controller command a vertical motor mechanically affixed to the display to rotate the display in the required direction (and the angular shift required) for inclinator to correct for the deviation (set point zero).
- a closed loopmay be employed for minimizing the deviation continuously.
- both the vertical and horizontal deviations of a detected face from the image center lineare calculated.
- the camera and the image processorserve as a sensor providing the vertical and horizontal deviations values and directions.
- Independent vertical and horizontal control loops(each may be open or closed) are used, each uses the respective deviation as an error signal, and a controller command a respective vertical or horizontal motor mechanically affixed to the display to rotate the display in the direction required (and the angular shift required) to correct for the deviation (set point zero).
- a closed loopmay be employed for minimizing the deviation continuously.
- a negative feedback control loopis used.
- linear control loopmay be used.
- the loopmay use proportional-only control loop, or PID (Proportional, Integral, Derivative) control loop.
- a method for improving the angular field of view of a person watching a display having a screencomprising the steps of capturing an image across the display screen, converting the image into a digital data form, detecting an human face in the captured image using image processing algorithm, calculating the deviation between the detected face location in the captured image and the image center, and rotating the display in the direction required to reduce the calculated deviation.
- the stepsmay be executed once or executed, repeatedly until the calculated deviation is smaller than a pre defined value, thus implementing a linear feedback control loop, wherein the error is the calculated deviation, the set point is zero and the angular rotation of the display is the actuator controlled by the loop.
- the loopmay be a linear proportional control loop only, wherein the amount of angular rotation is proportional to the calculated deviation, or a PID (Proportional, Integral and Derivative) control loop wherein the amount of angular rotation is calculated based on proportional, integral and derivative computations of the calculated deviation.
- PIDProportional, Integral and Derivative
- the methodmay be handling only the horizontal positioning, wherein the horizontal deviation is calculated in the captured image, and wherein the rotation of the display is in the horizontal plane, or handling only the vertical positioning, wherein the vertical deviation is calculated in the captured image, and wherein the rotation of the display is in the vertical plane, or handling both vertical and horizontal functions.
- an apparatus for improving the angular field of view of a person watching a display having a screencomprising a digital camera for capturing an image in a digital data form, the camera is mechanically attached to the display and oriented to capture the view substantially across the display screen, an image processor coupled to receive the image in a digital data form from the digital camera, for applying face detection algorithm to detect and locate a human face location in the captured image, and a motor mechanically attached to the display for angularly rotating the display, wherein the apparatus is operative to rotate the motor in response to the location of the detected face in the captured image.
- the apparatusmay further comprise a firmware or software and a controller executing the firmware or software coupled between the digital camera and the motor for commanding the motor (which may be a stepper motor) rotation in response to the location of the detected face in the captured image.
- the deviationmay be calculated between the detected face location and the image center, and wherein the motor angular rotation is based on the calculated deviation. Further, no motor rotation may be required in the case wherein the calculated deviation is smaller than a pre defined value.
- the apparatusmay continuously rotate the motor in response to the location of the detected face in the captured image, defining a defining a linear feedback control loop, wherein the error is the calculated deviation, the set point is zero and the angular rotation of the display is the actuator controlled by the loop.
- the control loopmay be linear proportional control loop, wherein the amount of angular rotation is proportional to the calculated deviation, or a PID (Proportional, Integral and Derivative) control loop wherein the amount of angular rotation is calculated based on proportional, integral and derivative computations of the calculated deviation.
- PIDProportional, Integral and Derivative
- the apparatusmay handle only the horizontal plane wherein the horizontal deviation is calculated in the captured image and wherein the motor is attached to effect display rotation in the horizontal plane.
- the apparatusmay handle only the vertical plane wherein the vertical deviation is calculated in the captured image and wherein the motor is attached to effect display rotation in the vertical plane.
- both planesare handles simultaneously.
- the average point of the detected facesis calculated by the image processor, the deviation is calculated between the average point and the image center.
- the devicemay be a display or a television set, and the image may be captured substantially across the display screen. Further, the display may be blanked in response to not detecting a human face in the captured image.
- the control signalmay involve supplying power to the device, wherein the control signal involves disconnecting power to the device or part of the device circuits.
- an apparatus for face detection based control of a devicecomprising a digital camera for capturing an image in a digital data form, an image processor coupled to receive the image in a digital data form from the digital camera, for applying face detection algorithm to detect a human face occurrence in the captured image, and a controller coupled to the image processor for generating a control signal is to response to the detection of an human face in the captured image.
- the apparatusmay further comprise a firmware or software and the controller is executing the firmware or software, and the camera may be mechanically attached to the controlled device.
- the image processor and the controllermay be housed within a single enclosure.
- the apparatusmay further comprise a switch actuated by said control signal and the switch may be connected between a power source and the device, for powering the device is response to the control signal.
- the apparatusmay actuate the switch for supplying power to the device in response to the detection (or lack of detection or both) of a human face in the captured image.
- the switchmay be housed within the device enclosure.
- the apparatusmay use one or two timers for signaling a pre-set first period coupled or within the controller, such that the control signal is generated in response to detecting (or lack of detecting or both) a human face in the captured image for a pre-defined period.
- the control signalmay involve supplying power or disconnecting power to or from the device.
- the devicemay be a display, and the camera may be positioned such that the image captured is substantially across the display screen, and the display may be blanked in response to not detecting a human face in the captured image.
- a method for controlling a device based on hand gesture detectioncomprising the steps of capturing an image, converting the image into a digital data form, using image processing algorithm for detecting an hand gesture in said captured image, and providing a control signal in response to the detection of the hand gesture in said captured image. These steps can be executed one time or executed repeatedly, with or without waiting a pre-set period before repeating the steps.
- the methodmay further comprise the step of supplying or disconnecting power to the device is response to the detection of a hand gesture in said captured image.
- the devicemay be a display or a television set, and the image captured may be substantially across the display screen. Further, the display may be blanked in response to not detecting a hand gesture in the captured image.
- One or more control signalsmay be generated, in response to detecting or not detecting a hand gesture in said captured image for a pre-defined period.
- the control signalmay involve supplying power or disconnecting power (or both) to the device.
- the hand gesturemay involve extending a single finger, multiple or all fingers.
- One or multiple pre-defined hand gesturecan be detected and a dedicated control may be associated with each detected hand gesture.
- the methodmay be combined with the step of using image processing algorithm for detecting a human face in said captured image, and a control signal may be provided only in response to the detection of both the hand gesture and detecting a human face in said captured image. Further, only a specific area in the image may be analyzed for hand gesture detection, based on the location of the detected face.
- an apparatus for hand gesture detection based control of a devicecomprising a digital camera for capturing an image in a digital data form, an image processor coupled to receive the image in a digital data form from the digital camera, for applying hand gesture detection algorithm to detect a hand gesture occurrence in the captured image, and a controller coupled to the image processor for generating a control signal is response to the detection of a hand gesture in the captured image.
- the apparatusmay further comprise a firmware or software and the controller is executing the firmware or software, and the camera may be mechanically attached to the controlled device.
- the image processor and the controllermay be housed within a single enclosure.
- the apparatusmay further comprise a switch actuated by said control signal and the switch may be connected between a power source and the device, for powering the device is response to the control signal.
- the apparatusmay actuate the switch for supplying power to the device in response to the detection (or lack of detection or both) of a hand gesture in the captured image.
- the switchmay be housed within the device enclosure.
- the apparatusmay use one or two timers for signaling a pre-set first period coupled or within the controller, such that the control signal is generated in response to detecting (or lack of detecting or both) a hand gesture in the captured image for a pre-defined period.
- the control signalmay involve supplying power or disconnecting power to or from the device.
- the devicemay be a display, and the camera may be positioned such that the image captured is substantially across the display screen, and the display may be blanked in response to not detecting a hand gesture in the captured image.
- One or more control signalsmay be generated, in response to detecting or not detecting a hand gesture in said captured image for a pre-defined period.
- the control signalmay involve supplying power or disconnecting power (or both) to the device.
- the hand gesturemay involve extending a single finger, multiple or all fingers.
- One or multiple pre-defined hand gesturecan be detected and a dedicated control may be associated with each detected hand gesture.
- the apparatusmay be combined with image processing algorithm for detecting a human face in said captured image, and a control signal may be provided only in response to the detection of both the hand gesture and detecting a human face in said captured image. Further, only a specific area in the image may be analyzed for hand gesture detection, based on the location of the detected face.
- the cameramay be mechanically attached to the display or be a separate device housed within a separate enclosure.
- the digital data representing the captured imageis transmitted from the camera over a communication medium to an image processor in a control box.
- the control boxreceives the digital data from the communication medium and processes it.
- the cameraincludes a transmitter (or a transceiver) for transmitting the image digital data to the communication medium
- the control boxincludes a receiver (or a transceiver) for receiving the digital data from the communication medium.
- the video signalis carried in an analog form over the communication medium, respectively using an analog transmitter and an analog receiver.
- Each of the wireless signals or the wireless communication links abovemay be WPAN, WLAN, WMAN, WAN, BWA, LMDS, MMDS, WiMAX, HIPERMAN, IEEE802.16, Bluetooth, IEEE802.15, IEEE802.11 (such as a, b and g), UWB, ZigBee and cellular such as GSM, GPRS, 2.5G, 3G, UMTS, DCS, PCS and CDMA.
- each of the frequency bands abovemay be part of the ISM frequency bands.
- Such communicationcan use a conductive medium such as cables or wires, or any other metallic medium.
- Standard PAN or LAN cabling and protocolsmay be used, such as Ethernet 10/100/1000BaseT.
- powerline communicationis used wherein the AC power wiring is used as the communication medium.
- a lossy or non-lossy compression of the image informationis used for reducing the memory size and reducing the data rate required for the transmission over the communication medium.
- the face detection or the hand gesture detectionare used to control devices other than a display.
- the communication medium between the camera assembly and the image processor, or the communication between the control box and the controlled unit or both communication linksis a wired medium, and a transmitter is used as a wired transmitter adapted to transmit digital data to the wired medium.
- the communication over the wired mediummay be according to a wired PAN (Personal Area Network) or a LAN (Local area Network) standard, and may further be based on serial or parallel transmission.
- the wired mediummay be a LAN cable substantially according to EIT/TIA-568 or EIA/TIA-570 containing a UTP (unshielded Twisted Pair) or STP (Shielded Twisted Pair).
- the connectoris an RJ-45 type
- the communication over the cablemay substantially conform to IEEE802.3 Ethernet 10BaseT or 100BaseTX or 1000BaseT
- the transmittermay be a LAN transceiver.
- the wired transmitter and the connectorsubstantially conform to one out of IEEE1394, USB (Universal Serial Bus), EIA/TIA-232 and IEEE1284.
- the communication between the camera assembly and the image processor, or the communication between the control box and the controlled unit or both communication linksuses a wired medium such as a cable.
- the cableconcurrently carries a power signal, and the device is at least in part powered from the power signal.
- the power signalmay be a DC (Direct Current) power signal, or an AC (Alternating Current) power signal.
- the cablemay contain multiple insulated wires, and the power signal may be carried over dedicated wires distinct from the wires carrying the communication signal. In the case wherein the cable contains multiple insulated wires, and the wires are used to simultaneously carry both power and communication signals, the power and communication signals are carried over the same wires.
- the powermay be a DC power carrying over a phantom channel over the wires.
- the cablemay be a LAN cable substantially according to EIT/TIA-568 or EIA/TIA-570 and containing UTP or STP twisted-pairs
- the connectormay be RJ-45 type
- the communication over the cablemay substantially conform to IEEE802.3 Ethernet 10BaseT, 100BaseTX, or 1000BaseT
- the transmittermay be a LAN transceiver
- the powermay be carried over the cable substantially according to IEEE802.3af or IEEE802.3at standards.
- a single cableis used to connect between the camera assembly and the image processor, or between the control box and the controlled unit or both.
- the cablesimultaneously carries both the communication signal for displaying the captured image on the display, and a power signal.
- the power signalcan be fed from the control box to power the camera, or alternately fed from the camera to power the control box.
- Carrying both the power and data signals over the same cablecan make use of distinct separated wire sets, each set dedicated to one type of a signal. Alternatively, the same wires can carry both signals each over a different frequency band (FDM) or using phantom technique.
- FDMfrequency band
- FIG. 1illustrates schematically a simplified general functional block diagram of a system according to the invention
- FIG. 2illustrates schematically a perspective front view of a system according to the invention
- FIG. 3illustrates schematically a perspective rear view of a system according to the invention
- FIG. 4illustrates schematically a rear view of a system according to the invention
- FIG. 5illustrates schematically a top view of a system according to the invention
- FIG. 6illustrates schematically a side view of a system according to the invention
- FIG. 7illustrates schematically a simplified general functional block diagram of a prior-art electronic camera
- FIG. 8illustrates schematically a rear view of a system according to the invention
- FIG. 9illustrates schematically a top view of a system according to the invention.
- FIG. 10illustrates schematically a flow chart of the system operation according to the invention
- FIG. 11illustrates schematically a perspective view of a room with a system according to the invention
- FIG. 12illustrates schematically a perspective view of a room with a system according to the invention
- FIG. 13illustrates schematically a side view of a room with a system according to the invention
- FIG. 14illustrates schematically a top view of a room with a system according to the invention
- FIG. 15illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 16illustrates schematically a top view of a room with a system according to the invention
- FIG. 17illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 18illustrates schematically a top view of a room with a system according to the invention
- FIG. 19illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 20illustrates schematically a top view of a room with a system according to the invention
- FIG. 21illustrates schematically a perspective view of a room with a system according to the invention
- FIG. 23illustrates schematically a side view of a room with a system according to the invention
- FIG. 24illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 25illustrates schematically a top view of a room with a system according to the invention
- FIG. 26illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 27illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 28illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 29illustrates schematically a top view of a room with a system according to the invention.
- FIG. 30illustrates schematically a simplified general functional block diagram of a system according to the invention.
- FIG. 31illustrates schematically a perspective front view of a system according to the invention
- FIG. 32illustrates schematically a perspective rear view of a system according to the invention
- FIG. 33illustrates schematically a side view of a system according to the invention
- FIG. 34illustrates schematically a perspective side view of a system according to the invention
- FIG. 35illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 36illustrates schematically a simplified general functional block diagram of a system according to the invention.
- FIG. 37illustrates schematically a perspective front view of a system according to the invention.
- FIG. 38illustrates schematically a perspective rear view of a system according to the invention.
- FIG. 39illustrates schematically a perspective front view of a system according to the invention.
- FIG. 40illustrates schematically a flow chart of the system operation according to the invention
- FIG. 41illustrates schematically a simplified general functional block diagram of a system according to the invention.
- FIG. 42illustrates schematically a simplified general functional block diagram of a system according to the invention.
- FIG. 43illustrates schematically a perspective front view of a room according to the invention.
- FIG. 44illustrates schematically a side view of a room according to the invention.
- FIG. 45illustrates schematically a top view of a room according to the invention.
- FIG. 46illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 47illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 48illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 49illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 50illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 51illustrates schematically a flow chart of the system operation according to the invention
- FIG. 52illustrates schematically a flow chart of the system operation according to the invention
- FIG. 53illustrates schematically an image captured and analyzed in a system according to the invention
- FIG. 54illustrates schematically an image captured and analyzed in a system according to the invention.
- FIG. 55illustrates schematically a simplified general functional block diagram of a system according to the invention.
- FIG. 56illustrates schematically a simplified general functional block diagram of a system according to the invention.
- FIG. 57illustrates schematically a simplified general functional block diagram of a system according to the invention.
- FIG. 58illustrates schematically a simplified general functional block diagram of a system according to the invention.
- FIG. 59illustrates schematically a simplified general functional block diagram of a system according to the invention.
- FIG. 60illustrates schematically a simplified general functional block diagram of a system according to the invention.
- FIG. 1is a schematic block diagram of a system 10 according to one embodiment of the invention.
- a pictorial front perspective view 20 of the systemis shown in FIG. 2
- a rear perspective view 30is shown in FIG. 3
- a rear view 40is shown in FIG. 4
- an up view 50is shown in FIG. 5
- side view 60is shown in FIG. 6 .
- the inventionis exampled with regard to a fiat panel display 18 , for example a LCD television set.
- a fiat panel display 18for example a LCD television set.
- any other electronic display or any other output device used for presentation of visual informationmay be equally used.
- the display 18may be a digital or analog video display, and may use technologies such as LCD (Liquid Crystal Display), TFT (Thin-Film Transistor), FED (Field Emission Display), CRT (Cathode Ray Tube) or any other electronic screen technology that visually shows information such as graphics or text.
- an adaptor(not shown) is required in order to connect an analog display to the digital data.
- the adaptormay convert to composite video (PAL, NTSC) or S-Video or HDTV signal.
- Analog displaysare commonly using interfaces such as composite video such as NTSC, PAL or SECAM formats. Similarly, analog RGB, VGA (Video Graphics Array), SVGA (Super Video Graphics Array), SCART, S-video and other standard analog interfaces can be used. Further, personal computer monitors, plasma or flat panel displays, CRT, DLP display or a video projector may be equally used. Standard digital interfaces such as a IEEE1394 interface, also known as FireWireTM, may be used. Other digital interfaces that can be used are USB, SDI (Serial Digital Interface), FireWire, HDMI (High-Definition Multimedia Interface), DVI (Digital Visual Interface), UDI (Unified Display Interface), DisplayPort, Digital Component Video and DVB (Digital Video Broadcast).
- SDISerial Digital Interface
- FireWireFireWire
- HDMIHigh-Definition Multimedia Interface
- DVIDigital Visual Interface
- UDIUnified Display Interface
- DisplayPortDigital Component Video and DVB (Digital Video Broadcast).
- Display 18is mechanically mounted using a pedestal 28 attached to the rear part of the display 18 .
- the pedestal 18is attached to axis 17 of the electric motor 15 .
- the motor 15converts electrical energy into rotational motion of its axis.
- the torque applied to the motor axis 17rotates the display 18 horizontally via the pedestal 28 around its vertical center. This allows rotating and positioning the display 18 as required by controlling the electric motor 15 .
- the motor 15is mounted on and fixed to base 29 which is placed on drawer's chest 27 .
- the base 29provides support to the mechanical assembly including the display 18 , pedestal 28 and the motor 15 .
- the electric motor 15is controlled and powered by control box 11 , and connected thereto via cable 23 (shown connected via the base 29 ).
- FIG. 8shows a perspective rear view 80 and FIG. 9 shows an up view 90 of the system after angular rotating of the display 18 by the motor 15 from the original position shows as dashed lines 91 in FIG. 9 .
- the electric motor 15can be of Alternating Current (AC) or Direct Current (DC) powered type.
- AC powered motorthe motor may be either synchronous or induction type.
- DC powered motorthe motor may either be brushless or stepper type.
- the motoris controlled by motor controller 14 in the control box 11 .
- the motor controller 14might include a manual or automatic means for starting and stopping the motor, selecting forward or reverse rotation, selecting and regulating the speed, regulating or limiting the torque, and protecting against overloads and faults.
- An electric motor controlleris commonly suited to the type of motor it is to drive such as permanent magnet, servo, series, separately excited, and alternating current.
- a systemcomprises an electronic camera 16 .
- the camera 16is attached to the display 18 .
- the camera 16is attached to the display 18 such that the camera 16 center line-of-sight is substantially parallel to the display 18 center fine of sight, so that the center of the image captured by the camera 16 is congruent with a perpendicular line erecting from the center panel of the display 16 .
- Camera 16may be a still camera which converts captured image into electric signal upon a specific control, or can be a video camera, wherein the conversion between captured images to electronic signal is continuous (e.g. 24 frames per second).is preferable a digital camera.
- Camera 16is preferably a digital camera, wherein the video or still images are converted using electronic image sensor.
- An electronic signal representing the captured imageis transmitted from the camera 16 to the image processor 12 in the control box 11 via cable 26 .
- the signalmay be digital or analog signal.
- FIG. 7Block diagram of such digital camera 16 is shown in FIG. 7 , showing lens 71 (or few lenses) for focusing the received light onto a small semiconductor sensor 72 .
- the sensor 72commonly includes a panel with a matrix of tiny light-sensitive diodes (photocells), converting the image light to electric charges and then to electric signals, thus creating a video picture or a still image by recording the light intensity.
- Charge-Coupled Devices (CCD) and CMOS (Complementary Metal-Oxide-Semiconductor)are commonly used as the light-sensitive diodes. Linear or area arrays of light-sensitive elements may be used, and the light sensitive sensors may support monochrome (black & white), color or both.
- the CCD sensor KAI-2093 Image Sensor 1920 (H) ⁇ 1080 (V) Interline CCD Image Sensor or KAF-50100 Image Sensor 8176 (H) ⁇ 6132 (V) Full-Frame CCD Image Sensorcan be used, available from Image Sensor Solutions, Eastman Kodak Company, Rochester, N.Y.
- An image processor block 73receives the analog signal from the image sensor.
- the Analog Front End (AFE) in the block 73filters, amplifies and digitizes the signal, using an analog-to-digital (A/D) converter.
- the AFEfurther provides correlated double sampling (CDS), and provides a gain control to accommodate varying illumination conditions.
- CCD AFEAnalog Front End
- Such an AFEmay be based on. VSP2560 ‘CCD Analog Front End for Digital Cameras’ from Texas Instruments Incorporated of Dallas Tex., U.S.A.
- the block 73further contains a digital image processor, which receives the digital data from the ATE, and processes this digital representation of the image to handle various industry-standards, and to execute various computations and algorithms.
- a digital image processorreceives the digital data from the ATE, and processes this digital representation of the image to handle various industry-standards, and to execute various computations and algorithms.
- additional image enhancementsmay be performed by the block 73 such as generating greater pixel density or adjusting color balance, contrast and luminance.
- the block 73may perform other data management functions and processing on the raw digital image data. Commonly, the timing relationship of the vertical/horizontal reference signals and the pixel clock are also handled in this block.
- Digital Media System-on-Chip device TMS320DM357from Texas Instruments Incorporated of Dallas Tex., U.S.A.
- color filtersmay be placed between the imaging optics and the photosensor array to achieve desired color manipulation.
- the block 73converts the raw data received from the photosensor array 72 into a color-corrected image in a standard image file format.
- the camera 16further comprises a connector 79 for connecting to the cable 26 .
- a transmitter or transceiver 75is disposed between the connector 79 and the image processor 73 .
- the transceiver 75also includes isolation magnetic components (e.g. transformer-based), balancing, surge protection, and other suitable components required for providing a proper and standard interface via a connector 79 .
- the connector 79further contains protection circuitry for accommodating transients, over-voltage and lightning, and any other protection means for reducing or eliminating the damage from an unwanted signal over the wired medium.
- a band pass filtermay also be used for passing only the required communication signals, and rejecting or stopping other signals in the described path.
- a transformermay be used for isolating and reducing common-mode interferences.
- a wiring driver and wiring receiversmay be used in order to transmit and receive the appropriate level of signal to and from the wired medium.
- An equalizermay also be used in order to compensate for any frequency dependent characteristics of the wired medium.
- the communication over the cable 26can be bi-directional, such as half-duplex or full-duplex, or one-way, wherein the camera 16 only transmits the image to the control box 11 .
- a controller 77located within the camera module 16 , may be based on a discrete logic or an integrated device, such as a processor, microprocessor or microcomputer, and may include a general-purpose device or may be a special purpose processing device, such as an ASIC, PAL, PLA, PLD, Field Programmable Gate Array (FPGA), Gate Array, or other customized or programmable device.
- a memoryis required.
- the controller 77commonly includes a memory that may include a static RAM (random Access Memory), dynamic RAM, flash memory, ROM (Read Only Memory), or any other data storage medium.
- the memorymay include data, programs, and/or instructions and any other software or firmware executable by the processor.
- the control logiccan be implemented in hardware or in software, such as a firmware stored in the memory.
- the controller 77controls and monitors the device operation, such as initialization, configuration, interface and commands.
- the term “processor”is meant to include any integrated circuit or other electronic device (or collection of devices) capable of performing an operation on at least one instruction including, without limitation, reduced instruction set core (RISC) processors, CISC microprocessors, microcontroller units (MCUs), CISC-based central processing units (CPUs), and digital signal processors (DSPs).
- RISCreduced instruction set core
- MCUsmicrocontroller units
- CPUsCISC-based central processing units
- DSPsdigital signal processors
- the hardware of such devicesmay be integrated onto a single substrate (e.g., silicon “die”), or distributed among two or more substrates.
- various functional aspects of the processormay be implemented solely as software or firmware associated with the processor.
- Power to the digital camera module 16is required for its described functions such as for capturing, storing, manipulating, and transmitting the image.
- a dedicated power sourcemay be used such as a battery or a dedicated connection to an external power source via connector 69 .
- poweris supplied from the control box 11 via cable 26 , serving for both power and image transmitting.
- the power supply 78contains a DC/DC converter.
- the power supply 78is power fed from the AC power supply via AC plug as connector 69 and a cord, and thus may include an AC/DC converter, for converting the AC power (commonly 115 VAC/60 Hz or 220 VAC/50 Hz) into the required DC voltage or voltages.
- power supply 78is integrated into a single device or circuit, in order to share common circuits.
- the power supply 78may include a boost converter, such as a buck boost converter, charge pump, inverter and regulators as known in the art, as required for conversion of one form of electrical power to another desired form and voltage.
- boost convertersuch as a buck boost converter, charge pump, inverter and regulators as known in the art, as required for conversion of one form of electrical power to another desired form and voltage.
- power supply 78can be an integral part and housed within the camera enclosure, they may be enclosed as a separate housing connected via cable to the camera assembly.
- a small outlet plug-in step-down transformer shapecan be used (also known as wall-wart, “power brick”, “plug pack”, “plug-in adapter”, “adapter block”, “domestic mains adapter”, “power adapter”, or AC adapter).
- power supply 78may be a linear or switching type.
- TIFFTagged Image File Format
- RAWRaster Image File Format
- AVIAVI
- DVVariable Image File Format
- MOVMovable Image File Format
- WMVWide-V File Format
- DCFDesign Rule for Camera Format
- ITU-T H.261, ITU-T H.263, ITU-T H.264, ITU-T CCIR 601, ASF, Exif (Exchangeable Image File Format), and DPOF (Digital Print Order Format) standardsIn many cases, video data is compressed before transmission, in order to allow its transmission over a reduced bandwidth transmission system.
- a video compressor 74(or video encoder) is shown in FIG. 7 disposed between the image processor 73 and the transceiver 75 , allowing for compression of the digital video signal before its transmission over the cable 26 .
- Such compressioncan be lossy or lossless types.
- Common compression algorithmsare PEG (Joint Photographic Experts Group) and MPEG (Moving Picture Experts Group).
- PEGJoint Photographic Experts Group
- MPEGMotion Picture Experts Group
- the above and other image or video compression techniquescan make use of intraframe compression commonly based on registering the differences between part of single frame or a single image.
- Interframe compressioncan further be used for video streams, based on registering differences between frames.
- Other examples of image processinginclude run length encoding and delta modulation. Further, the image can be dynamically dithered to allow the displayed image to appear to have higher resolution and quality.
- Single lens or a lens array 71is positioned to collect optical energy representative of a subject or a scenery, and to focus the optical energy onto the photosensor array 72 .
- the photosensor array 72is a matrix of photosensitive pixels, which generates an electric signal that is representative of the optical energy that is directed at the pixel by the imaging optics.
- a prior art example of a portable electronic camera connectable to a computeris disclosed in U.S. Pat. No. 5,402,170 to Parulski et al. entitled: “Hand-Manipulated Electronic Camera Tethered to a Personal Computer”.
- a digital electronic camera which can accept various types of input/output cards or memory cardsis disclosed in U.S. Pat. No. 7,432,952 to Fukuoka entitled: “Digital Image Capturing Device having an Interface for Receiving a Control Program”, and the use of a disk drive assembly for transferring images out of an electronic camera is disclosed in U.S. Pat. No.
- Face detectionalso known as face localization
- Face detectionincludes an algorithms for identifying a group of pixels within a digitally-acquired image that relates to the existence, locations and sizes of human faces.
- Common face-detection algorithmsfocused on the detection of frontal human faces, and other algorithms attempt to solve the more general and difficult problem of multi-view face detection. That is, the detection of faces that are either rotated along the axis from the face to the observer (in-plane rotation), or rotated along the vertical or left-right axis (out-of-plane rotation), or both.
- Various face detection techniques and devicese.g. cameras having face detection features are disclosed in U.S. Pat. Nos.
- the electrical form of the image captured by the camera 16is received via cable 26 at the image processor 12 in control box 11 .
- the image processor 12performs face detection algorithms on the received image, to determine if there is a face (or plurality of faces) in the captured image, and the location of each detected face in the captured view.
- the image processor 12transmits the processing results to controller 13 via link 25 .
- the image processor 12may be based on a discrete logic or an integrated device, such as a processor, microprocessor or microcomputer, and may include a general-purpose device or may be a special purpose processing device, such as an ASIC, PAL, PLA, PLD, Field Programmable Gate Array (FPGA), Gate Array, or other customized or programmable device.
- the image processor 12commonly includes a memory that may include a static RAM (random Access Memory), dynamic RAM, flash memory, ROM (Read Only Memory), or any other data storage medium.
- the memorymay include data, programs, and/or instructions and any other software or firmware executable by the processor.
- the control logiccan be implemented in hardware or in software, such as a firmware stored in the memory.
- processoris meant to include any integrated circuit or other electronic device (or collection of devices) capable of performing an operation on at least one instruction including, without limitation, reduced instruction set core (RISC) processors, CISC microprocessors, microcontroller units (MCUs), CISC-based central processing units (CPUs), and digital signal processors (DSPs).
- RISCreduced instruction set core
- MCUmicrocontroller units
- CPUcentral processing units
- DSPdigital signal processors
- the hardware of such devicesmay be integrated onto a single substrate (e.g., silicon “die”), or distributed among two or more substrates.
- various functional aspects of the processormay be implemented solely as software or firmware associated with the processor.
- the controller 13controls and monitors the device operation, such as initialization, configuration, interface and commands.
- the controller 13located within the control box 11 , may be based on a discrete logic or an integrated device, such as a processor, microprocessor or microcomputer, and may include a general-purpose device or may be a special purpose processing device, such as an ASIC, PAL, PLA, PLD, Field Programmable Gate Array (FPGA), Gate Array, or other customized or programmable device. In the case of a programmable device as well as in other implementations, a memory is required.
- the controller 13commonly includes a memory that may include a static RAM (random. Access Memory), dynamic RAM, flash memory, ROM (Read Only Memory), or any other data storage medium.
- the memorymay include data, programs, and/or instructions and any other software or firmware executable by the processor.
- the control logiccan be implemented in hardware or in software, such as a firmware stored in the memory.
- the controller 13controls and monitors the device operation, such as initialization, configuration, interface and commands.
- the image captured by camera 16is processed for face detection by image processor 12 .
- the results of face detection processingsuch as the existence of a face in the image, the number of detected faces and the location of the detected face are provided to the controller 13 via link 25 .
- the controller 13in turn provides commands to the motor control 14 via link 24 , for rotating the motor 15 , which in turn rotates the display 18 attached thereto.
- FIG. 11shows a perspective rear view 110 of the display 18 (and a perspective front view of the person 114 sitting on the sofa 113 ).
- FIG. 12shows a perspective front view 120 of the display 18 (and a perspective rear view of the person 114 sitting on the sofa 113 ).
- FIG. 13shows a side view 130 and FIG. 14 is a top view of the system 10 , person 114 and the sofa 113 .
- FIG. 16shows a top view 160 of the room wherein no person is present in the room.
- the sofa 113is centered substantially vertically directly across from the display 118 , as shown in the imaginary line of sight 141 connecting the sofa 113 center to the display 18 center.
- the center place on the sofa 113is the optimal seating place, providing best visibility of the image on the display 18 .
- the person 114is sitting in a side seat of the sofa 113 , thus using the line of sight 142 to the display 18 , which is deviated from the optimal line 141 .
- the flow chart 100is executed by the system and controlled and managed by the software (or firmware) in controller 13 in the control box 11 .
- the system activationstarts at step ‘Start’ 101 .
- step ‘Image Capture’ 102the camera 16 is operated to capture a single ‘still’ frame or a video including streaming of frame.
- the image capturedis transmitted from the camera 16 to the image processor 12 within the control box 11 via communication link 26 , which may be a cable.
- FIG. 15shows an example of an image 150 that is captured by the camera 16 , featuring the person 114 sitting on the sofa 113 .
- the captured image(such as image 150 ) is then process by the image processor 12 in ‘face detection’ step 103 .
- a face detection algorithmis executed on the image captured, and the count of detected faces is checked in ‘Faces Count’ step 104 .
- the detected face locationis determined, such as rectangular 152 relating to person 113 face detected in image 150 .
- no personis present in the room, as shown in top view 160 in FIG. 16 .
- the image capturedis shown an image 170 in FIG. 17 , wherein only the sofa 113 is present, the image captured.
- the systemwait a pre determined period TIMER in ‘wait Time’ step 105 during which the system is idle, and afterwards the system resumes to its operation from the start in step 102 .
- the TIMER periodcan be in the order of seconds (e.g. 1 to 10 seconds), dozens of seconds (e.g. 30 to 60 seconds), minutes (e.g. 1 to 10 minutes), dozens of minutes (e.g. 30 to 60 minutes) or hours (e.g. 1 to 10 hours).
- the horizontal location of the face centeris determined by the image processor 12 , shown as dashed line 153 in FIG. 15 .
- the dashed vertical line 153is calculated to be at the detected face 152 center.
- ‘Face Location Deviation’ 106the distance deviation between the image center represented by the imaginary dashed line 151 horizontally centered in the image, and the detected face 152 center location line 153 is calculated (shown as the deviation line 154 in FIG. 15 ). This distance represents the deviation of the person location (particularly its face location) from the optimal viewing point represented by the image center line 151 .
- the deviationis checked in ‘Deviation ⁇ Delta’ step 107 .
- “Deviation ⁇ Delta’step 107 .
- the systemreverts to idling in step 105 .
- FIG. 18showing a top view 180 of a room wherein the person 114 watching the display 18 is sitting in the center seat of the sofa 113 and thus is located directly across the system having an optimum display 18 view.
- the image captures in such a caseis shown as image 190 in FIG.
- step ‘Display Rotation’ 111to rectify the situation by ordering the motor 15 (via the motor controller 14 ) to rotate in a direction that reduce the deviation.
- image 150 in FIG. 15the person is located to the left side of the image, when viewed from the camera 16 point of view. In this case, the motor 15 with rotate the display counter-clockwise when looked from top, bringing the display 18 to the viewer person 113 line of sight.
- the motor 15in the case wherein it is determined that the rotation of the motor 15 is required to correct the line-of-sight deviation 154 , the motor 15 will rotate a pre-set angular movement to the required direction, regardless of the measured deviation 154 .
- an angular shift of 1 degree (1°)can be used.
- the rotationwill be clockwise or counter-clockwise depending upon the deviation side versus the center line 151 .
- other angular shiftssuch as 2 degrees (2°) 5 degrees (5°) or 10 degrees (10°) may be used.
- the motor 15 angular shiftis dependent upon the actual measured deviation 154 . Large deviation will result in a larger shift, while small deviation value will result in a smaller angular shift.
- the angular rotationcan be proportional to the value of the deviation 154 .
- the systemAfter executing the required angular shift in ‘Display Rotation’ step 111 , the system is idling for a period of TIMER in ‘Wait Time’ step 105 before another correction cycle starts (a cycle comprising all the required steps from ‘Image Capture’ step 102 to completing a Display Rotation' step 111 ).
- the casemay be wherein few cycles will be required before the deviation is fully corrected and the system is idling after getting into zero (or substantially small) deviation.
- the systemwill require 5 (five) cycles to compensate for an angular deviation of 10 degrees (10°).
- continuous operationalso allows for continuous correction of the deviation, which may result due to the shift of the person position in the room. For example, in the case the person 114 moves to another seat on the sofa 113 , one or more cycles may be required to adjust the system to the new location of the person. Similarly, adding watching persons can also require system adjustments will be described hereafter.
- the continuous operation of the system as shown in flow chart 100effectively implement a feedback control loop, wherein the camera 16 acts as a sensor for obtaining the deviation 154 and the motor 15 serves as an actuator, and the control loop (which may be a linear control loop) tries to regulate in order to minimize the value of the deviation 154 (set point zero for the measured deviation 154 ).
- Linear controlmay also be used for such negative feedback system.
- PIDProportional, Integral, Derivative
- FIGS. 20 to 24show a living room wherein a person 114 is sitting on a sofa 113 and watching the display 18 (e.g. a flat screen television set) being part of a system 10 according to the invention.
- FIG. 20shows a top view 200 wherein the display 18 is shown facing directly the person 114 on sofa 113 , as shown in the dashed line-of-sight 201 .
- FIG. 22shows a perspective front view 210 of the display 18 (and a perspective rear view of the person 114 sitting on the sofa 113 ).
- FIG. 22shows a side view 220 and FIG. 23 is another perspective front view of the system 10 (and a perspective rear view of the person 114 sitting on the sofa 113 ).
- FIG. 24shows the image 240 captured by the camera 16 at this steady state.
- the face detected 152 center line 153coincides with the image center line 151 , resulting deviation distance of zero (actually or practically less than Delta).
- multiple personsmay be watching the display 18 at the same time.
- Such scenariois shown in a top view 250 in FIG. 25 .
- An additional person 114 bis shown sitting in the sofa 113 center seat, added to the person 114 a sitting on the sofa 113 side-seat as described above.
- the optimal viewing angleis different for each person being in different location.
- the best solutionis to direct the display 18 towards the center between the persons 114 a and 144 b, such that each will enjoy a low deviation in a fair partition. Handling few detected faces is handled in the left side of flow chart 100 , consisting of ‘Average Location Calculation’ step 108 and ‘average Location Deviation’ step 109 .
- Image 260 shown in FIG. 26shows the captured image in the camera 16 in the case shown in FIG. 26 .
- the image processor 12uses face detection algorithms, identifies the two faces of persons 114 a and 144 b by the respective face frames 152 a and 152 b , and associates an horizontal location lines 153 a and 153 b respectively, similar to above discussion relating to FIG. 15 .
- the average face locationis calculated. Such average horizontal location 271 is shown as part of image 270 in FIG. 27 .
- the lines 153 a and 153 brepresenting the respective location of the detected faces 152 a and 152 b, are equally distant from the average line 271 , as shown by distances 272 a and 272 b respectively.
- the average location 271is used, as a substitute to the location line 153 shown in FIG. 15 , as the means for calculating the deviation from the image center line 151 .
- the deviation 154 between the image center line 151 and the average line 271will be calculated in ‘Average Location deviation’ step 109 .
- FIG. 29shows a top view 290 wherein the display 18 is shown facing directly the middle point between the persons 114 a and 144 b on sofa 113 , as shown in the dashed line-of-sight 291 .
- the image captured by the camera 16 in this situationis shown as image 280 in FIG. 28 , wherein the average line 271 and the image center line 151 coincides, resulting in zero deviation value.
- FIG. 30A block diagram of such a system 300 is shown in FIG. 30 , using a two-axes control box 301 .
- the horizontal rotationis using the horizontal motor (H. Motor) controller 14 a which receives commands from the controller 13 via the connection 24 a, and controls horizontal motor 15 a via connection 23 a, which axis is in turn mechanically coupled to the display 18 for horizontal rotation.
- This horizontal handlingcorresponds to system 10 shown in FIG. 1 , showing the horizontal motor (H.
- Motor controller 14which receives commands from the controller 13 via the connection 24 , and controls horizontal motor 15 via connection 23 , which axis 17 a is in turn mechanically coupled to the display 18 for horizontal rotation.
- a set of a vertical motor (V. Motor) controller 14 b and a vertical motor 15 bare added to system 10 for inclining the display (in the vertical axis) as required.
- the vertical rotationis using the vertical motor (V. Motor) controller 14 b which receives commands from the controller 13 via the connection 24 b, and controls horizontal motor 15 b via connection 23 b, which axis 17 b is in turn mechanically coupled to the display 18 for vertical rotation.
- FIGS. 31 to 34A pictorial exemplary system is shown in FIGS. 31 to 34 , wherein a pictorial front perspective view 310 of the system having two axes line of sight correction is shown in FIG. 31 , a rear perspective view 320 is shown in FIG. 32 , a side view 330 is shown in FIG. 33 and an another perspective side view 340 is shown in FIG. 34 .
- a control box 301is shown supporting operation in both vertical and horizontal planes.
- Horizontal motor 15 ais shown attached to pedestal 27 via axis 17 a, for horizontal, rotating of the display 18 , as described above relating to FIGS. 2 to 6 .
- a second pedestal 302is added attached to the former pedestal 28 .
- the second pedestal 302serves a basis to the vertical motor 15 b, which is attached to the display 18 via the axis 17 b.
- vertical motor 15 brotates its axis 17 b and the display 18 attached thereto thus inclining the display 18 , hence controlling its vertical line of sight.
- FIG. 3shows a display 18 shifted from its original inclination (shown as dashed frame 331 ) to a reclining position. Similarly, a reclining display 18 is shown in FIG. 34 .
- the vertical deviation 352is the difference between the image horizontal center line 351 and the vertical position 353 of the detected face 152 . Similar to above description, the control loop is operative to lower the vertical deviation 352 to a minimum value or zero, thus aligning the viewer line of sight with the plane of the display 18 offering optimal viewing experience.
- the inventionmay equally apply to rotating the display 18 in the vertical axis only.
- the display 18will be inclined as required to ensure direct line of sight for optimum view only in the vertical axis.
- the system 300 shown in FIG. 30will use only the vertical motor 15 b and its controller 14 b, and the horizontal components (such as motor 15 a and controller 14 a ) may be obviated.
- the inventionhas been exampled above with regard to a specific partition of the system components into various enclosures, the invention may equally apply to any other partition.
- the camera 16has been described above having a dedicated casing housing only the camera related hardware.
- the cameramay as well be integrated into the control box 301 (or control box 11 ), obviating the need for additional enclosure and cable 26 .
- the integrationmay be just housing of the camera 16 in the same enclosure, or may share common hardware such as power supply, control lines and mechanical fixing.
- the camera 16is integrated with the display 18 or fixedly attached thereto.
- One advantage of such solutionis that many displays already include a build-in camera for video conferencing (such as laptops).
- the image processor 12is integrated into the camera 16 enclosure.
- the motor controller 14 ais integrated within the casing of the motor 15 a.
- the motor controller 14 bis integrated within the casing of the motor 15 b .
- the motor 15 a (and/or the motor 15 b )may be integrated or fixedly combined with the display 18 .
- the control box 301(or control box 11 ) may be enclosed (in part or in full) in the camera 16 enclosure or with the motor 15 a (or motor 15 b ).
- the control box 301may be fully integrated within the display 18 housing.
- the inventionhas been exampled above with regard to using the face detection means in order to mechanically move the display 18 based on the location of the detected face or faces, the invention may equally apply to using the face detection for other controls of the display 18 or other devices.
- the face detection mechanismis used for turning the display ON and OFF.
- the detection of a human face in the captured imageis serving as an indication that at least one person is watching the screen. In the case no faces are detected, the system assumes that no one is watching the screen, thus shutting off the display. This provides the benefit of not consuming power when not required, thus saving energy and the associated electricity expenses. Further, since electrical systems in general and displays in particular have a limited life span, such shutdown increases the usage of the screen and its operation life by saving wear and tear of the screen when its operation is not required.
- a block diagram 360 of such a systemis shown in FIG. 36 , based on a control box 361 (substituting the control box 11 described above).
- the system 360comprises a camera, 16 , feeding its captured image to the image processor 12 via communication link 26 .
- the image processor 12uses face detection image processing algorithms, detect the existence of human faces in the image captured, and notify the controller 363 via connection 25 .
- Controller 363may be identical or similar to controller 13 above.
- the display 18is powered from the AC plug 21 via controlled on/off switch 362 and power cable 365 , which is controlled by the controller 363 via the control connection 364 .
- the controller 363may tom the display 18 on and off by activating switch 362 .
- the switch 362may be implemented by relay contacts, wherein line 364 is a control signal used to energize and de-energize the coil of the relay, or may be implemented using solid state circuitry as known in the art.
- the system operationis exampled as flow chart 400 in FIG. 40 .
- the flow chart 400 executionis managed, controlled and handled by the controller 363 in control box 361 .
- the controller 363Upon system activation in Start step 401 , the controller 363 provides an activation control signal 361 to the switch 362 , commanding it to close and pass the AC power from the AC plug 21 to the display 18 , thus turning the display 18 on.
- ‘Start Timer1’ step 403is executed, wherein a timer having a pre set period of time (Timer1) starts to count the elapsing time, counting down from the specified time interval to zero.
- ‘Face Detected’ Step 404is similar (or the same) as ‘Face detection’ step 103 , wherein the image processor 12 analyzes the captured image and notify the existence of a detected face to the controller 363 . If a face (or multiple faces) is detected, the Timer1 is reset and start its count again in ‘Start Timer1’ step 403 . Hence, as long as a face is detected, the system will be in the continuously performing the loop of steps ‘Start Timer1’ step 403 and ‘Face Detected’ step 404 , wherein the display 18 is in ON state as it continues to receive power via switch 362 .
- the time elapsedis checked in Timer1 in ‘Timer 1 expired’ step 405 .
- the systemwill continue to check if a face has been detected in ‘Face Detected’ step 404 , and will reset the timer upon such detection.
- the power to the display 18will be turned off in ‘Turn OFF’ step 406 , by opening the switch 362 contacts and thus de-energizing the display 18 .
- This mechanismallows for secure shutting off of the display 18 , and will obviate the false detection such as the case of turning the display 18 off due to intermittent missing of a face detection occurrence or after too short period of lacking of face detection, thus adding to the system reliability.
- a second timer(Timer2) is initiated in ‘Start Timer2’ step 407 .
- Timer2is pre set to a period which may be similar or distinct from the period set for Timer 1. Further, the two timers can be implemented using the same hardware or software/firmware, or sharing part of the means required for these timers.
- a face detection mechanismis executed in ‘face Detected’ step 408 (similar to the Face detected step 404 ). If no face is detected in ‘Face detected’ step 408 , the Timer2 is restarted its count.
- ‘Timer2 expired’ step 409assures that a face needs to be detected for at least the period set in Timer2. Upon such occurrence, it is assumed that a person is actually looking at the display 18 , and thus the power to the display 18 is resumed in ‘turn ON’ step 402 .
- This mechanismprovides a reliable and stable operation promising that no action will be taken before assuring that the face detection is consistent and stable.
- Each of said timers periodcan be in the order of seconds (e.g. 1 to 10 seconds), dozens of seconds (e.g. 30 to 60 seconds), minutes (e.g. 1 to 10 minutes), dozens of minutes (e.g. 30 to 60 minutes) or hours (e.g. 1 to 10 hours).
- the timers periodcan be the same, substantially similar or having substantial differences periods.
- the inventionmay equally apply to any other partition.
- the camera 16has been described above having a dedicated casing housing only the camera related hardware.
- the cameramay as well be integrated into the control box 361 obviating the need for additional enclosure and cable 26 .
- the integrationmay be just housing of the camera 16 in the same enclosure, or may share common hardware such as power supply, control lines and mechanical fixing.
- the camera 16is integrated with the display 18 or fixedly attached thereto.
- One advantage of such solutionis that many displays already include a build-in camera for video conferencing (such as laptops).
- the image processor 12is integrated into the camera 16 enclosure.
- the control box 361may be fully integrated within the display 18 housing.
- System 410 shown in FIG. 41is a block diagram of a system according to the invention which uses the face detection functionality for both obtaining a better viewing of the display 18 as described above (for example with regard to FIGS. 1 to 35 ), and for controlling the screen functions (e.g. turning on/off as exampled in FIGS. 36 to 40 ).
- the block diagram 300 shown in FIG. 30is combined with the system 360 shown in FIG. 36 , making an efficient use of the common components such as camera 16 and power supply 19 .
- Controller 412combines the functions of controller 363 with the functions of controller 13 , and the control box 411 is used to house all the relevant components as shown in FIG. 41 .
- the inventionmay equally apply to the case wherein the controlled functionality is internal to the display 18 .
- the controlled functionalityis internal to the display 18 .
- the display 18may be commended to shift to a shutdown mode, similar to the mode used upon turning off a display by a remote control.
- excessive power on I off actionsmay reduce its operative life span.
- FIG. 42An example of such a system 420 is shown in FIG. 42 .
- the switch 362is internal to the display 18 and controlled via connection 422 connected to a connector 423 , and effect only part of the display 18 functions, such as only excessive power consuming circuits or limited life span components.
- the control box 421comprises a connector 424 , used for connecting to the display 18 via cable 425 .
- the controller 363extends its control port 364 to manage and control the switch 362 internal to the display 18 .
- FIG. 37A pictorial perspective front view 370 of such a system is shown in FIG. 37
- a pictorial perspective rear view 380 of such a systemis shown in FIG. 38 .
- These viewsare similar respectively to views 20 and 30 shown in FIGS. 2 and 3 respectively, where the motor 15 (and its associated parts such as axis 17 ) is not used.
- the display power cord 365is shown connecting the display 18 to the control box 360 for receiving power therefrom via the switch 362 .
- FIG. 39An example of a wall mounting system is shown in view 390 in FIG. 39 , wherein a wall mounting fixture 391 is used, including a bracket for wall mounting.
- the inventionmay equally apply to the case wherein the system is using detection relating to other human organs. Further, the invention may equally apply to the case wherein active action from the person involved is detected such as a gesture made with a part of the human body, and detected by the image processor 12 . For example, nodding, bobbling or shaking can be used as indication to be detected by the image processor and used for various remote control applications.
- hand gestureis used for signaling the system, as exampled in FIGS. 43 to 46 .
- FIG. 30shows a perspective rear view 430
- FIG. 44shows a side view 440
- FIG. 45shows a top view 450 .
- the person 114 on the sofa 113signal the system by an hand gesture, consisting of extracting only the index finger, thus ‘pointing’ to the ceiling of the room.
- the image processor 12performs ‘hand gesture detection’ algorithms in order to detect the hand gesture made by the person 114 .
- the analysis resultsare exampled in the image captured 460 in FIG. 46 , wherein the hand 462 (or the palm) is detected as shown in the dashed rectangular 461 , and the index finger 463 is detected and identified as pointing upwards.
- image view 470shows three fingers 464 raised (the index, middle and ring fingers, added to the thumb).
- image view 480 in FIG. 48detects a person extracting all his/her fingers 465
- image view 490 in FIG. 49shows a case wherein only an index finger 466 is raised (added to the thumb). Two fingers 467 (index and middle) and a thumb are shown detected in the hand detected 461 as part of image 500 in FIG. 50 .
- the hand gestureis used to control the display 18 as a substitute to the face detection described above.
- the controlmay involve turning the display 18 on and off as described above relating to FIGS. 36 to 42 , wherein the image processor 12 is notifying the controller 412 regarding the detection of a hand gesture. Operation of such a system is described in flow chart 510 shown in FIG. 51 , based on the flow chart 400 shown in FIG. 40 and described above.
- the ‘Face Detected’ steps 404 and 408are respectively replaced with Hand Gesture Detected' steps 511 and 512 , wherein the ‘Yes’ branch related to the event when a hand gesture is detected and identified by the system.
- Remote controlsare known in the art as electronic devices used for the remote operation of equipment.
- Wired or wireless remote control devicesincluding Infra-Red (IR) or RF transmitter for remotely operating AC powered electrical appliances such as television receivers, home heaters, air conditioners, motorized curtains, lighting and other electrical appliances in homes, apartments, offices and buildings in general are switched on and off by a one way control or command signal.
- the person operating the remote control deviceverifying the on or off status of the operated device by visual means, such as the TV is on, or the lights are off, or the air-condition unit is activated or not, by being at the site of the operated appliance.
- remote controlsare Consumer IR devices used to issue commands from a distance to televisions or other consumer electronics such as stereo systems DVD players and dimmers.
- Remote controls for these devicesare usually small wireless handheld objects with an array of buttons for adjusting various settings such as television channel, track number, contrast, brightness and volume.
- the remotecontains all the function controls while the controlled device itself only has a handful of essential primary controls.
- the systemis used for turning on and off a specific function in the controlled device, or in general switching from one state to the other of two states.
- the function controlledmay be turning the display on and off by supplying or disconnected power to the display (e.g. as disclosed in FIG. 36 ), a ‘mute’ function or a ‘pause’/‘continue’ command to a DVD player.
- Such system operationmay be based on the flow chart 520 shown in FIG.
- the ‘Turn ON’ step 402 and the ‘Turn OFF’ step 406are substituted with the ‘Turn Function ON’ step 521 and ‘Turn Function OFF’ step 522 .
- the ‘Turn Function ON’ step 521is executed after the hand gesture is detected in ‘Hand Gesture Detected’ step 511 for at least the period Timer1, and.
- the ‘Turn Function OFF’ step 522is executed after the hand gesture is detected in ‘Hand Gesture Detected’ step 407 for at least the period Timer2.
- the function commandede.g. ‘mute’
- the function commandede.g. ‘mute’
- the function commandedis deactivated (e.g. power turned off in the case of on/off control) or switched to the other state (out of two states available).
- the hand gesturecan be used to signal a single step of the function.
- each time a detection of a hand gesture occursmay signal to shift to the next television channel, to the track number or to the next volume level.
- the ‘Turn Function ON’ step 521(or the ‘Turn Function OFF’ step 522 or both steps) activates the controlled unit to shift to the next step or level out of the multiple steps relating to the required function.
- only a single hand gesturecan be detected.
- the systemmay only detect the hand gesture involving extending only the index finger as shown in FIGS. 43 to 46 .
- Such systemmay use simple image processor 12 since only a single object needs to be detected, and such detection of the hand gesture will be detected in ‘Hand detection Detected’ steps 511 and 512 in flow chart 520 .
- the detected hand gesturemay be used for a single activation (or deactivation) of a function.
- the hand gesturemay be used to continuously toggle between activation and deactivation of a function, wherein each such new detection of a hand gesture results in switching from a state to the other (or shifting to the next level or step), as described in flow chart 520 in FIG. 52 .
- multiple hand gesturescan be detected and identified by the image processor 12 .
- separate hand gesturesmay be used for activation or deactivation of a function.
- the hand gesture of ‘pointing up’ shown in FIGS. 43 to 46can be detected and identified, together with the ‘all fingers up’ gesture shown in view 480 in FIG. 48 .
- the ‘pointing up’ gesturewill be detected in ‘Hand Gesture Detected’ step 511 in flow chart 520 and will cause to activate the function in ‘Turn Function ON’ step 521
- the ‘all fingers up’ gesturewill be detected in ‘Hand Gesture Detected’ step 512 in flow chart 520 and will cause to deactivate the function in ‘Turn Function OFF’ step 522 .
- one hand gesturemay cause a multiple states function (such as television channel selection) to shift upwards while the other hand gesture may results in shifting downwards. For example, assuming the television set is currently set to channel 15 , one gesture shifts to channel 16 (‘upwards’), while the other shifts to channel 14 ‘downwards’). Similarly, one type of hand gesture detected may affect increasing the volume for a louder result, while the other will lower the volume to more silent performance.
- a multiple states functionsuch as television channel selection
- each hand gesturemay be used to control a single function, such as one hand gesture for ‘mute’, one for ‘volume’ and one for turning the television on and off.
- the image processor 12is capable of detecting both hand gestures and human face. Such capability can be used in order to increase the reliability of the hand gesture and to minimize false hand gesture detection by searching for hand gesture in the image only if a face is detected in that image, since it is assumed that the hand gesture is signaled by a person viewing the display 18 , and thus his/her face are captured in the camera image. Hence, items which may be falsely identified as a hand gesture being of similar shape, will not be considered and thus will not be identified as a hand gesture. Further, since the location of the face and the hand of a person are related, this can be further used to improve the system performance, by searching and applying the algorithms for detecting hand gestures only in a defined location based on the detected face location.
- FIG. 53An example is shown in image 530 shown in FIG. 53 , based on image 460 in FIG. 46 .
- the face detection mechanismwill detect the face, as shown in the dashed rectangular 152 as described above.
- the probable location of the signaling handis expected (based on normal human dimensions) to be in the circled area 531 , hence the hand gesture detection should only search for a hand gesture in this area 531 , saving processing time and minimizing false detection.
- the circleis placed to the person left side as shown in area 532 as part of image 540 in FIG. 54 .
- the camera 16transmits the image to the image processor 12 via cable 26
- the inventionmay equally apply to the case wherein no such cable 26 is used for the communication.
- the camera 16is cordless, thus untethered and fully portable.
- the camera 16is preferably battery operated, thus powered from an internal battery during operation without the need to connect to a power source, such as AC power via a cord.
- the imageis transmitted over the air using radio frequency, thus obviating the need for a cable or any other conductor connecting the camera 16 and the control box. It is apparent the radio communication of the image can be implemented also in the case of AC powered (via cable) camera.
- Such a system 550is shown in FIG. 55 , adapter from system 410 in FIG. 41 .
- the transceiver 75 in camera 16 shown in FIG. 7is substituted with wireless transceiver 551 b , connected to antenna 552 b.
- the wireless transceiver 551 bmay be internally to the camera 16 enclosure or in a separate housing.
- the control box 553(adapted from control box 411 in FIG. 41 ) comprises a mating wireless transceiver 551 a connected to antenna 552 a.
- the imageis transmitted from the camera 16 via the wireless transceiver 551 b and antenna 552 b over the air communication, to be received in the antenna 552 a and wireless transceiver 551 a.
- antennas 552 a and 552 bcan be used. Among these are PCB printed antennas, chip antennas, as well as panel and dome antennas. Furthermore, the antennas may be omni-directional or directional. Typically, the antennas are coupled using mating coaxial connectors, such as SMA, F-Type, N-Type and IPX, providing both the electrical connection as well as the mechanical attachment. In many cases, the antenna connection allows for easy disconnection and connection by means of snapping or screwing.
- control linkis cordless, thus untethered and fully portable.
- control informationis transmitted over the air using radio frequency, thus obviating the need for a cable or any other conductor connecting the control box and the display unit 18 .
- FIG. 56Such a system 560 is shown in FIG. 56 , adapter from system 420 in FIG. 42 , wherein the connector 424 in the control box 421 is replaced with a wireless transceiver 551 a in control box 561 (adapted from control box 421 in FIG. 42 ), connected to antenna 552 a.
- a mating wireless transceiver 551 b connected to antenna 552 bare added to the display 18 side, and may be separated or housed integrally within the display 18 housing.
- the control informationis transmitted from the controller 363 in control box 561 via the wireless transceiver 551 a and antenna 552 a over the air communication, to be received in the antenna 552 b and wireless transceiver 551 b.
- antennas 552 a and 552 bcan be used. Among these are PCB printed antennas, chip antennas, as well as panel and dome antennas. Furthermore, the antennas may be omni-directional or directional. Typically, the antennas are coupled using mating coaxial connectors, such as SMA, F-Type, N-Type and IPX, providing both the electrical connection as well as the mechanical attachment. In many cases, the antenna connection allows for easy disconnection and connection by means of snapping or screwing.
- a WLAN communication linkis used to interconnect two or more isolated (W)PAN (Wireless Personal Area Network) systems.
- WWireless Personal Area Network
- the reach of a PANis typically a few meters, hence such networks are confined to a limited space, such as in-room communication.
- IEEE 802.15is the working group of the IEEE 802, which specializes in Wireless PAN (WPAN) standards.
- WPAN systemsinclude:
- WLAN technologiese.g. WiFi
- IEEE 802.11bwhich describes a communication using the 2.4 GHz frequency band and supporting a communication rate of 11 Mb/s
- IEEE 802.11auses the 5 GHz frequency band to carry 54 MB/s
- IEEE 802.11guses the 2.4 GHz band to support 54 Mb/s.
- IEEE 802.11The Institute of Electrical and Electronic Engineers (IEEE) 802.11 standard group, branded as WiFi by the Wi-Fi Alliance of Austin, Texas, USA.
- IEEE 802.11bdescribes a communication using the 2.4 GHz frequency band and supporting communication rate of 11 Mb/s
- IEEE 802.11auses the 5 GHz frequency band to carry 54 MB/s
- IEEE 802.11guses the 2.4 GHz band to support 54 Mb/s. This is described in an Intel White Paper entitled “54 Mbps IEEE 802.11 Wireless LAN at 2.4 GHz”, and a chip-set is described in an Agere Systems White Paper entitled “802.11 Wireless Chip Set Technology White Paper”, both of these documents being incorporated herein by reference.
- Such a 802.11 supporting transceiver block 551 a and 551 bmay be implemented using WaveLANTM WL60040 Multimode Wireless LAN media Access Controller (MAC) from Agere Systems of Allentown, Pa. U.S.A., whose a product brief is incorporated herein by reference, which is part of a full chip-set as described in WaveLANTM 802.11a/b/g Chip Set document from Agere Systems of Allentown, Pa. U.S.A., which is incorporated herein by reference. Reference is made to the manufacturer's data sheet Agere Systems, WaveLANTM WL60040 Multimode Wireless LAN Media Access Controller (MAC), Product Brief August 2003 PB03-164WLAN, which is incorporated herein by reference.
- MACMultimode Wireless LAN media Access Controller
- Some wireless technologiesin particular microwave signals used in the WAN and MAN arenas, are using frequencies above 2-3 GHz where the radio path is not reflected or refracted to any great extent. Propagation in such frequencies requires a Line-of-Sight (LOS) relying on a line of sight between the transmitting antenna and the receiving antenna. Using this concept allows for NLOS (Non-LOS) wireless networks to interconnect over a LOS-based communication link.
- the wireless technology implementedmay use either licensed frequency bands or unlicensed frequency bands, such as the frequency bands utilized in the industrial, scientific and Medical (ISM) frequency spectrum.
- the A band902-928 MHz
- the B band2.4-2.484 GHz
- the C band5.725-5.875 GHz (referred to as 5 GHz).
- Overlapping and/or similar bandsare used in different regions such as Europe and Japan.
- cellular technologiescan also be used, commonly using licensed spectrum.
- Such digital technologiesinclude GSM (Global System for Mobile Communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), EDGE (Enhanced Data Rates for GSM Evolution), 3GSM, DECT (Digital Enhanced Cordless Telecommunications), Digital AMPS (per IS-136/TDMA, for example) and iDEN (Integrated Digital Enhanced Network).
- the service carried over the cellular networkmay be voice, video or digital data such as the recently introduced EVDO (Evolution Data Only).
- a WirelessHD standard based wireless communicationis employed, which is based on the 7 GHz of continuous bandwidth around the 60 GHz radio frequency and allows for uncompressed, digital transmission.
- communication based on electromagnetic waves in various parts of the electromagnetic spectrumcan be used for communication.
- low-frequency electromagnetic radiationcan be used to transmit audio-frequency signals over short distances without a carrier.
- Radio-frequency transmissionis a special case of this general electromagnetic transmission.
- lightis also a special case of electromagnetic radiation, but is herein treated separately because of the characteristics of light are distinctly different from those of electromagnetic transmission in other usable parts of the electromagnetic spectrum.
- Non-wired communication accomplished by lightcan be used for the above transmission.
- the most popularis infrared (IR) based communication, but ultraviolet may also be used.
- IRinfrared
- Most such systemsrequire substantially ‘line-of-sight’ access.
- the antenna 552 b relating to the camera 16is replaced with light emitter (e.g. LEDs), and the antenna 552 a relating the control box 553 will be replaced with light detectors (e.g. photoelectric cell), and the communication over the air relies on the propagation of light.
- light emittere.g. LEDs
- light detectorse.g. photoelectric cell
- sound-based communication over spacemay be used, wherein the transceivers 551 a and 551 b use microphones and speakers, and the communication relies on the propagation of sound waves through the air in the space.
- Either audible sound (20-20,000 Hz band), or inaudible sound (ultrasonic, above 20,000 Hz; or infrasonic, below 20 Hz)can be used.
- the antennas 552 a and 552 bare substituted with a microphone or a similar device converting the sound signal into an electrical signal, and a speaker or a similar device for generating the audio signal and transmitting it to the air.
- a transducer combining into a single device both the speaker and the microphone functionalitiesmay also be used.
- the inventionhas been exampled above with regard to a camera 16 mechanically attached to display 18 , it will be appreciated that the invention equally applies to the case wherein there is no such mechanical attachment.
- the camera 16may be in a different room from the display 18 , but still uses the face detection or hand gesture detection to control the display 18 located in the other room.
- a non-visible spectrumcan be equally used, such as infrared and ultraviolet.
- the infrared imageis captured, and then processed by the image processor 12 .
- the sensor 72 in FIG. 7is sensitive to the non-visible part of the light spectrum (e.g. infrared).
- transceivers 551 a and 551 bare fiber optic transceivers, and similarly antennas 552 a and 552 b are replaced with a fiber optic connector.
- the term ‘wiring’ and ‘cable’ in this applicationshould be interpreted to include networks based on non-conductive medium such as fiber-optics cabling.
- Powerline communicationis known in the art for using the AC power wires in a building for digital data communication.
- Traditional approaches to powerline communicationinclude applications such as control of lighting and appliances, as well as sending data or broadband data, video or audio.
- Powerline command communication systemsinclude for example X-10, CEBus (Consumer Electronics Bus per EIA-600 standard), and LonWorks.
- the HomePlug organizationis an industry trade group for powerline communication including various entities to define powerline communication specifications.
- HomePlug 1.0is a specification for a home networking technology that connects devices to each other through power lines in a home.
- HomePlug certified productsconnect PCs and other devices that use Ethernet, USE, and 802.11.
- Many devices made by alliance membershave HomePlug built in and connect to a network upon plugging the device into a wall socket in a home with other HomePlug devices.
- Signal interference, from surge protectors, extension cords, outlet strips and/or other proximately located devices, including the high-frequency signals,is an on-going concern of the HomePlug alliance.
- HomePlug AVHPAV is a new generation of technology from the HomePlug Powerline Alliance.
- HPAVcan be for example embedded in consumer electronics or computing products, and provides high-quality, multi-stream, entertainment-oriented networking over existing AC wiring. Users can avoid having to install new wires in their premises by using devices having built-in HomePlug technology.
- HPAVuses advanced PHY and MAC technologies that provide a 200 Mbps (million bits per second) class powerline network for inter alia video, audio and data.
- the Physical (PHY) Layerutilizes this 200 Mbps channel rate to provide a 150 Mbps information rate to provide communications over noisy power line channels.
- PHYPhysical
- powerlineand “powerline communications” refer to any technology that is used to transfer data or signals over a power distribution system, including without limitation UPB, HomePlug, HomePlug a/v, and X-10 technologies.
- the term “UPB” or Universal Powerline Busrefers to one exemplary instance of technologies which impose digital or analog signals or pulses onto AC waveforms or DC power delivery systems, such as for example the well known UPB approach set forth in “Universal Powerline Bus: The UPB System Description”, Version 1.1 dated Sep. 19, 2003, incorporated herein by reference in its entirety.
- the term “HomePlug” as used hereinis meant specifically to include devices and systems compliant with the HomePlugTM Powerline Alliance Specification for powerline-based home networks (including the more recent HomePlug A/V), and generally to include all other comparable devices adapted for powerline networking.
- powerline communicationis used for the interconnection between the camera 16 and the control box 11 , such as HomePlug based communication.
- One advantage in such a configurationis that only a single power cable is used, carrying both the AC power and the communication signal.
- a camera 591is shown in FIG. 59 adapted from camera block diagram shown in FIG. 7 .
- a low pass filter 572 bis disposed between the AC power plug 21 and the power supply 78 , for passing only the AC power signal, such as the 50 Hz or the 60 Hz.
- Such a low pass filter 572 balso stops and exhibits high impedance in the digital data frequency band, thus reducing impedance loading at this frequency band.
- a powerline modem 574 bconnected to the AC power wires via a high pass filter 573 b, which passes only the digital data frequency band, hence allowing only the digital data signal to pass, while stopping the AC power.
- a powerline modem 574 bconnected to the AC power wires via a high pass filter 573 b, which passes only the digital data frequency band, hence allowing only the digital data signal to pass, while stopping the AC power.
- the modernis a HomePlug compliant modem, and the communication (physical layer and higher protocol layers) is implemented according to the HomePlug specification standard.
- such modemcan be based on INT6000 ‘HomePlug AV High-Speed Powerline Solution’ available from Intellon Corporation, headquartered in Orlando, Fla., U.S.A.
- control box 571shown in FIG. 57 as part of system 570 , is also adapted to support powerline communication, in order to communicate with a mating camera 591 of FIG. 59 .
- Low pass filter 572 ais added between the AC power plug 21 and the power supply 19 .
- a powerline modem 574 ais added, connected to the AC power wires 22 via high pass filter 573 a , which passes only the digital data frequency band, hence allowing only the digital data signal to pass, while stopping the AC power.
- the modemis a HomePlug compliant modem, and the communication (physical layer and higher protocol layers) is implemented according to the HomePlug specification standard.
- the communication of a control information between the control box and the displayis also adapted to support powerline communication, as shown as system 600 in FIG. 60 , adapted from system 420 in FIG. 42 .
- the control box 601shown in FIG. 60 as part of system 600 , is also adapted to support powerline communication, in order to communicate with a mating display 18 .
- Low pass filter 572 ais added between the AC power plug 21 a and the power supply 19 .
- a powerline modem 574 ais added, connected to the AC power wires 22 a via high pass filter 573 a, which passes only the digital data frequency band, hence allowing only the digital data signal to pass, while stopping the AC power.
- low pass filter 572 bis added between the AC power plug 21 b and the power supply connection of the display 18 .
- a powerline modem 574 bis added, connected to the AC power wires 22 b via high pass filter 573 b, which passes only the digital data frequency band, hence allowing only the digital data signal to pass, while stopping the AC power.
- the modems 574 a and 574 bare HomePlug compliant modems, and the communication (physical layer and higher protocol layers) is implemented according to the HomePlug specification standard.
- a wired medium 26is connected between the camera 16 and the image processor 12 .
- the wired mediumis a wired communication medium, connected to via a connector.
- Such wired mediummay be a UTP, STP, coaxial cable, a telephone wire pair, a CATV coaxial cable, AC power wire pair and LAN cable, such as Category 5 or Category 6.
- a suitable connectormay be used for connecting to the specific type of the wired medium, such as a coaxial connector for connecting to a coaxial cable and a telephone connector for connecting to a telephone wire pair.
- the wired mediummay be a single non-used twisted-pair in a LAN cable, or two such pairs connected in parallel.
- the wired mediumis using a phantom channel formed between two wire pairs, such as two twisted wire pairs in a LAN cable used in Ethernet 10BaseT, 100BaseTX or 1000BaseT.
- any PAN, LAN, MAN or WAN wiringmay be used as the wired medium.
- a wired transceiveris adapter to be a wired modem or a wired transceiver is used, suitable for transmitting and receiving over the appropriate wiring used.
- the communication over such cablecan be proprietary or preferably using an industry standard communication, wherein the connections of the camera and of the control box to the cable (as well as the connection from the control box to the display) are based on standard connectors and interfaces.
- the communicationmay be based on a parallel scheme, wherein multiple wires are used to concurrently carry the digital data, thus allowing a higher transfer rate of the information.
- serial communicationis used, allowing for few conductors to be used and smaller footprint connectors requiring the usage of less pins and contacts.
- Various standard PAN (Personal Area Network), WAN (Wide Area Network) and LAN (Local Area Network) protocolscan be used.
- standard LAN (Local Area Network)is used, such as Ethernet IEEE802.3 10BaseT, 100Base TX or 1000BaseT.
- the transceiver 34is Ethernet PHY (i.e.
- Ethernet physical layer or Ethernet transceiverthat can be implemented based on “LAN83C180 10/100 Fast Ethernet PHY Transceiver” or “LAN91C111 10/100 Non-PCI Ethernet Single Chip MAC +PHY” available from SMSC—Standard Microsystems Corporation of Hauppauge, N.Y. U.S.A. While this function can be implemented by using a single dedicated component, in many embodiments this function is integrated into a single component including other functions, such as handling higher layers.
- the transceivermay also contains isolation magnetic components (e.g. transformer-based), balancing components, surge protection hardware, and a LAN connector (commonly RJ-45) required for providing a proper and standard interface via a connector.
- standard cablingis used, such as standard LAN cabling.
- Category 5 cabling(‘structured wiring’) or any other wiring according to EIT/TIA-568 and EIA/TIA-570 can be used.
- LAN cablinginvolves wire pairs that may be UTP or STP.
- category 3, 4, 5e, 6, 6e and 7 cablesmay be equally used.
- Such configurationis described, for example, in EIT/TIA-568 and EIA/TIA-570.
- any wired interfaceother than Ethernet 10/100BaseT described above, being proprietary or standard, packet or synchronous, serial or parallel, may be equally used, such as IEEE1394, USB (Universal Serial Bus), EIA/TIA-232, PCI (Peripheral Component Interconnect), PCMCIA (Personal Computer Memory Card international Association), or IEEE1284, but not limited to the aforementioned.
- IEEE1394Universal Serial Bus
- EIA/TIA-232Peripheral Component Interconnect
- PCMCIAPersonal Computer Memory Card international Association
- IEEE1284Peripheral Component Interconnect
- multiple such interfacesbeing of the same type or mixed may also be used.
- the control boxis adapted to drive power to the cable for powering the camera.
- the camerais adapted to drive power to the cable for powering the control box. Such power can be used only for powering the camera module and related functionalities, or for fully powering the control box.
- the power and communication signalsare carried over the wires in the cable using Frequency Division Multiplexing (FDM, a.k.a. Frequency Domain Multiplexing).
- FDMFrequency Division Multiplexing
- the power and the communications signalsare carried each in its frequency band (or a single frequency) distinct from each other.
- the power signalcan be a DC (Direct Current) power (effectively 0 Hz), while the communication signal is carried over the 100 Hz-10 MHz (or 4-30 MHz) frequency band, which is distinct and above the DC power frequency.
- a relatively high voltagesuch as a 120 VDC can be used in order to compensate for the wiring resistance caused voltage drops.
- safety standardssuch as UL/IEC 60950 and EN60950 may limit the voltage level in many applications to 60 VDC.
- a telephony common 48 VDC voltage levelmay also be used.
- PoEPower over Ethernet
- LAN—PoLPower over LAN—PoL
- IEEE802.3af and IEEE802.3atalso explained in U.S. Pat. No. 6,473,609 to Lehr et al. titled: “Structure Cabling System”, which describes a method to carry power over LAN wiring, using the spare pairs and the phantom mechanism. The latter makes use of center-tap transformers.
- the powering scheme described abovemay use this standard as well as using non-standard proprietary powering schemes.
- USBUniversal Serial Bus
- the above various statesmay be each represented by a single dedicated single-state indicator.
- known techniquesare commonly used in order to combine signals. Such techniques may use different colors (of the same indicator), different intensity levels, variable duty-cycle and so forth. While visual indicators have been described, other indicating methods may be used such as audible tones (as stand alone or combined with visual).
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Electromagnetism (AREA)
- Computer Security & Cryptography (AREA)
- Automation & Control Theory (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Hardware Design (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Studio Devices (AREA)
Abstract
Description
- The present invention relates generally to devices (such as displays) controlled by face detection.
- In most display devices, the best visual quality is obtained when the observer is exactly in front of the surface wherein the image is displayed, thus having the widest angular field of view and maximum perceived area. Further, in many types of displays (such as LCD and plasma based panels), the luminance and the contrast are decreased when the viewing direction is deviated from the direction which is vertical to the display surface, both in the inclination and azimuth directions. In some cases, a viewing cone is defined, limiting the available directions from which the image can be viewed. ISO 13406-21 titled “Ergonomic requirements for work with visual displays based on flat panels—Part 2: Ergonomic requirements for flat panel displays” provides a classification of Viewing Direction Range Classes and Reflection Classes.
- An autorotative digital photo frame adapted to allow the frame to be adjusted to the same direction as the photo is disclosed in U.S. Patent Application Publication 2008/0236014 to Chao et al. entitled: “Autorotative Digital Photo Frame”, which is incorporated in its entirety for all purposes as if fully set forth herein.
- In consideration of the foregoing, it would be an advancement in the art to provide a method and system that is simple, cost-effective, faithful, reliable, has a minimum part count, minimum hardware, or uses existing and available components allowing convenient or better control or visualization of a device, and in particular a display, such as a television set. Furthermore, it would be highly advantageous to have a method and system providing a simpler, better and easier control of a device without using a remote control.
- In one aspect of the invention a method and apparatus for using face detection functionality for obtaining a good visibility with a screen of a display. A digital camera is attached to a display having a central image captured substantially congruent with the display plane line-of-sight. A face detection algorithm is performed by an image processor, using the image captured by the digital camera to obtain the existence and localization of faces in the captured image. The horizontal deviation of a detected face from the image center line is calculated. The camera and the image processor serve as a sensor providing the horizontal deviation value and direction. A control loop (open or closed) uses the horizontal deviation as an error signal, and a controller command a horizontal motor mechanically affixed to the display to rotate the display in the required direction (and the angular shift required) to correct for the deviation (set point zero). A closed loop may be employed for minimizing the deviation continuously.
- In one aspect of the invention, the vertical deviation of a detected face from the image center line is calculated. The camera and the image processor serve as a sensor providing the vertical deviation value and direction. A control loop (open or closed) uses the vertical deviation as an error signal, and a controller command a vertical motor mechanically affixed to the display to rotate the display in the required direction (and the angular shift required) for inclinator to correct for the deviation (set point zero). A closed loop may be employed for minimizing the deviation continuously.
- In one aspect of the invention, both the vertical and horizontal deviations of a detected face from the image center line are calculated. The camera and the image processor serve as a sensor providing the vertical and horizontal deviations values and directions. Independent vertical and horizontal control loops (each may be open or closed) are used, each uses the respective deviation as an error signal, and a controller command a respective vertical or horizontal motor mechanically affixed to the display to rotate the display in the direction required (and the angular shift required) to correct for the deviation (set point zero). A closed loop may be employed for minimizing the deviation continuously.
- In one aspect of the invention, a negative feedback control loop is used. Further, linear control loop may be used. Further. the loop may use proportional-only control loop, or PID (Proportional, Integral, Derivative) control loop.
- According to one aspect on the invention, a method for improving the angular field of view of a person watching a display having a screen is described, the method comprising the steps of capturing an image across the display screen, converting the image into a digital data form, detecting an human face in the captured image using image processing algorithm, calculating the deviation between the detected face location in the captured image and the image center, and rotating the display in the direction required to reduce the calculated deviation. The steps may be executed once or executed, repeatedly until the calculated deviation is smaller than a pre defined value, thus implementing a linear feedback control loop, wherein the error is the calculated deviation, the set point is zero and the angular rotation of the display is the actuator controlled by the loop. The loop may be a linear proportional control loop only, wherein the amount of angular rotation is proportional to the calculated deviation, or a PID (Proportional, Integral and Derivative) control loop wherein the amount of angular rotation is calculated based on proportional, integral and derivative computations of the calculated deviation.
- The method may be handling only the horizontal positioning, wherein the horizontal deviation is calculated in the captured image, and wherein the rotation of the display is in the horizontal plane, or handling only the vertical positioning, wherein the vertical deviation is calculated in the captured image, and wherein the rotation of the display is in the vertical plane, or handling both vertical and horizontal functions.
- If no human face is detected, no rotation is executed. If two or more human faces are detected in the captured image, then the average point of the detected faces is calculated, and the deviation is calculated between the average point and the image center.
- According to one aspect on the invention, an apparatus for improving the angular field of view of a person watching a display having a screen is described. The apparatus comprising a digital camera for capturing an image in a digital data form, the camera is mechanically attached to the display and oriented to capture the view substantially across the display screen, an image processor coupled to receive the image in a digital data form from the digital camera, for applying face detection algorithm to detect and locate a human face location in the captured image, and a motor mechanically attached to the display for angularly rotating the display, wherein the apparatus is operative to rotate the motor in response to the location of the detected face in the captured image. The apparatus may further comprise a firmware or software and a controller executing the firmware or software coupled between the digital camera and the motor for commanding the motor (which may be a stepper motor) rotation in response to the location of the detected face in the captured image.
- The deviation may be calculated between the detected face location and the image center, and wherein the motor angular rotation is based on the calculated deviation. Further, no motor rotation may be required in the case wherein the calculated deviation is smaller than a pre defined value. The apparatus may continuously rotate the motor in response to the location of the detected face in the captured image, defining a defining a linear feedback control loop, wherein the error is the calculated deviation, the set point is zero and the angular rotation of the display is the actuator controlled by the loop. The control loop may be linear proportional control loop, wherein the amount of angular rotation is proportional to the calculated deviation, or a PID (Proportional, Integral and Derivative) control loop wherein the amount of angular rotation is calculated based on proportional, integral and derivative computations of the calculated deviation.
- The apparatus may handle only the horizontal plane wherein the horizontal deviation is calculated in the captured image and wherein the motor is attached to effect display rotation in the horizontal plane. Alternatively, the apparatus may handle only the vertical plane wherein the vertical deviation is calculated in the captured image and wherein the motor is attached to effect display rotation in the vertical plane. Alternatively both planes are handles simultaneously.
- In the case wherein two or more human faces are detected in the captured image, then the average point of the detected faces is calculated by the image processor, the deviation is calculated between the average point and the image center.
- According to one aspect on the invention, a method for controlling a device based on face detection is described, comprising the steps of capturing an image, converting the image into a digital data form, using image processing algorithm for detecting an human face in the captured image, and providing a control signal in response to the detection of an human face in the captured image. These steps can be executed once or executed repeatedly, and may further include waiting a pre-set period before repeating the steps.
- The method may control supplying power to the device is response to the detection of a human face in the captured image, or control disconnecting power to the device is response to not detecting a human face in the captured image.
- The device may be a display or a television set, and the image may be captured substantially across the display screen. Further, the display may be blanked in response to not detecting a human face in the captured image.
- Further, the control signal may be generated in response to detecting a human face in the captured image for a pre-defined period or lacking of such detection. Further, a first control signal may generated in response to not detecting a human face in the captured image for a first pre-defined period, and a second control signal may be generated in response to detecting a human face in the captured image for a second pre-defined period.
- The control signal may involve supplying power to the device, wherein the control signal involves disconnecting power to the device or part of the device circuits.
- According to one aspect on the invention, an apparatus for face detection based control of a device is described, comprising a digital camera for capturing an image in a digital data form, an image processor coupled to receive the image in a digital data form from the digital camera, for applying face detection algorithm to detect a human face occurrence in the captured image, and a controller coupled to the image processor for generating a control signal is to response to the detection of an human face in the captured image. The apparatus may further comprise a firmware or software and the controller is executing the firmware or software, and the camera may be mechanically attached to the controlled device. Further, the image processor and the controller may be housed within a single enclosure.
- The apparatus may further comprise a switch actuated by said control signal and the switch may be connected between a power source and the device, for powering the device is response to the control signal. Thus, the apparatus may actuate the switch for supplying power to the device in response to the detection (or lack of detection or both) of a human face in the captured image. The switch may be housed within the device enclosure. Further, the apparatus may use one or two timers for signaling a pre-set first period coupled or within the controller, such that the control signal is generated in response to detecting (or lack of detecting or both) a human face in the captured image for a pre-defined period. Further, the control signal may involve supplying power or disconnecting power to or from the device. The device may be a display, and the camera may be positioned such that the image captured is substantially across the display screen, and the display may be blanked in response to not detecting a human face in the captured image.
- According to one aspect on the invention, a method for controlling a device based on hand gesture detection is described, the method comprising the steps of capturing an image, converting the image into a digital data form, using image processing algorithm for detecting an hand gesture in said captured image, and providing a control signal in response to the detection of the hand gesture in said captured image. These steps can be executed one time or executed repeatedly, with or without waiting a pre-set period before repeating the steps. The method may further comprise the step of supplying or disconnecting power to the device is response to the detection of a hand gesture in said captured image. The device may be a display or a television set, and the image captured may be substantially across the display screen. Further, the display may be blanked in response to not detecting a hand gesture in the captured image.
- One or more control signals may be generated, in response to detecting or not detecting a hand gesture in said captured image for a pre-defined period. The control signal may involve supplying power or disconnecting power (or both) to the device. The hand gesture may involve extending a single finger, multiple or all fingers. One or multiple pre-defined hand gesture can be detected and a dedicated control may be associated with each detected hand gesture.
- The method may be combined with the step of using image processing algorithm for detecting a human face in said captured image, and a control signal may be provided only in response to the detection of both the hand gesture and detecting a human face in said captured image. Further, only a specific area in the image may be analyzed for hand gesture detection, based on the location of the detected face.
- According to one aspect on the invention, an apparatus for hand gesture detection based control of a device is described, comprising a digital camera for capturing an image in a digital data form, an image processor coupled to receive the image in a digital data form from the digital camera, for applying hand gesture detection algorithm to detect a hand gesture occurrence in the captured image, and a controller coupled to the image processor for generating a control signal is response to the detection of a hand gesture in the captured image. The apparatus may further comprise a firmware or software and the controller is executing the firmware or software, and the camera may be mechanically attached to the controlled device. Further, the image processor and the controller may be housed within a single enclosure.
- The apparatus may further comprise a switch actuated by said control signal and the switch may be connected between a power source and the device, for powering the device is response to the control signal. Thus, the apparatus may actuate the switch for supplying power to the device in response to the detection (or lack of detection or both) of a hand gesture in the captured image. The switch may be housed within the device enclosure. Further, the apparatus may use one or two timers for signaling a pre-set first period coupled or within the controller, such that the control signal is generated in response to detecting (or lack of detecting or both) a hand gesture in the captured image for a pre-defined period. Further, the control signal may involve supplying power or disconnecting power to or from the device. The device may be a display, and the camera may be positioned such that the image captured is substantially across the display screen, and the display may be blanked in response to not detecting a hand gesture in the captured image.
- One or more control signals may be generated, in response to detecting or not detecting a hand gesture in said captured image for a pre-defined period. The control signal may involve supplying power or disconnecting power (or both) to the device.
- The hand gesture may involve extending a single finger, multiple or all fingers. One or multiple pre-defined hand gesture can be detected and a dedicated control may be associated with each detected hand gesture.
- The apparatus may be combined with image processing algorithm for detecting a human face in said captured image, and a control signal may be provided only in response to the detection of both the hand gesture and detecting a human face in said captured image. Further, only a specific area in the image may be analyzed for hand gesture detection, based on the location of the detected face.
- The camera may be mechanically attached to the display or be a separate device housed within a separate enclosure. The digital data representing the captured image is transmitted from the camera over a communication medium to an image processor in a control box. The control box receives the digital data from the communication medium and processes it. In this scenario, the camera includes a transmitter (or a transceiver) for transmitting the image digital data to the communication medium, and the control box includes a receiver (or a transceiver) for receiving the digital data from the communication medium. In one aspect according to the invention, the video signal is carried in an analog form over the communication medium, respectively using an analog transmitter and an analog receiver.
- The communication between the camera assembly and the image processor, as well the communication between the control box and the controlled unit, can be non-conductive over-the-air wireless, using radio, audio or light based communication, and use various WLAN, WPAN and other technologies. The wireless communication may use a spread-spectrum signal such as multi-carrier (e.g. OFDM, DMT and CDMA), or a single carrier (narrow-band) signal. Each of the wireless signals or the wireless communication links above may be WPAN, WLAN, WMAN, WAN, BWA, LMDS, MMDS, WiMAX, HIPERMAN, IEEE802.16, Bluetooth, IEEE802.15, IEEE802.11 (such as a, b and g), UWB, ZigBee and cellular such as GSM, GPRS, 2.5G, 3G, UMTS, DCS, PCS and CDMA. Similarly, each of the frequency bands above may be part of the ISM frequency bands.
- Alternatively, the power and communication signals may be carried over the same wires using Frequency Division Multiplexing (FDM), wherein the power signal is carried over a power frequency, and wherein the communication signal is carried over a communication frequency band distinct and above the power frequency. In this case, the device may further include a low pass filter coupled between the connector and the transmitter for substantially passing only the power frequency, for powering the transmitter from the power signal. Such device may also further include a high pass filter coupled between the connector and the transmitter for substantially passing only the communication frequency band, for passing the communication signal between the connector and the transmitter. In the case where power is AC power, the connector may be an AC power plug for connecting to AC power wiring, and the transmitter may be part of a powerlines modem, such as HomePlug or UPB.
- Further, such communication can use a conductive medium such as cables or wires, or any other metallic medium. Standard PAN or LAN cabling and protocols may be used, such as
Ethernet 10/100/1000BaseT. In one embodiment, powerline communication is used wherein the AC power wiring is used as the communication medium. - In another aspect of the present invention, a lossy or non-lossy compression of the image information is used for reducing the memory size and reducing the data rate required for the transmission over the communication medium.
- According to one aspect on the invention, the face detection or the hand gesture detection (or both) are used to control devices other than a display.
- In one aspect of the invention, the communication medium between the camera assembly and the image processor, or the communication between the control box and the controlled unit or both communication links, is a wired medium, and a transmitter is used as a wired transmitter adapted to transmit digital data to the wired medium. The communication over the wired medium may be according to a wired PAN (Personal Area Network) or a LAN (Local area Network) standard, and may further be based on serial or parallel transmission. For example, the wired medium may be a LAN cable substantially according to EIT/TIA-568 or EIA/TIA-570 containing a UTP (unshielded Twisted Pair) or STP (Shielded Twisted Pair). In such case the connector is an RJ-45 type, and the communication over the cable may substantially conform to IEEE802.3 Ethernet 10BaseT or 100BaseTX or 1000BaseT, and the transmitter may be a LAN transceiver. In an alternative aspect, the wired transmitter and the connector substantially conform to one out of IEEE1394, USB (Universal Serial Bus), EIA/TIA-232 and IEEE1284.
- In one aspect of the invention, the communication between the camera assembly and the image processor, or the communication between the control box and the controlled unit or both communication links, uses a wired medium such as a cable. Further, the cable concurrently carries a power signal, and the device is at least in part powered from the power signal. The power signal may be a DC (Direct Current) power signal, or an AC (Alternating Current) power signal. The cable may contain multiple insulated wires, and the power signal may be carried over dedicated wires distinct from the wires carrying the communication signal. In the case wherein the cable contains multiple insulated wires, and the wires are used to simultaneously carry both power and communication signals, the power and communication signals are carried over the same wires. In such a case the power may be a DC power carrying over a phantom channel over the wires. For example, the cable may be a LAN cable substantially according to EIT/TIA-568 or EIA/TIA-570 and containing UTP or STP twisted-pairs, the connector may be RJ-45 type, the communication over the cable may substantially conform to IEEE802.3 Ethernet 10BaseT, 100BaseTX, or 1000BaseT, the transmitter may be a LAN transceiver, and the power may be carried over the cable substantially according to IEEE802.3af or IEEE802.3at standards.
- In another aspect of the present invention, a single cable is used to connect between the camera assembly and the image processor, or between the control box and the controlled unit or both. The cable simultaneously carries both the communication signal for displaying the captured image on the display, and a power signal. The power signal can be fed from the control box to power the camera, or alternately fed from the camera to power the control box. Carrying both the power and data signals over the same cable can make use of distinct separated wire sets, each set dedicated to one type of a signal. Alternatively, the same wires can carry both signals each over a different frequency band (FDM) or using phantom technique.
- The above summary is not an exhaustive list of all aspects of the present invention. Indeed, the inventor contemplates that his invention includes all systems and methods that can be practiced from all suitable combinations and derivatives of the various aspects summarized above, as well as those disclosed in the detailed description below and particularly pointed out in the claims filed with the application. Such combinations have particular advantages not specifically recited in the above summary.
- It is understood that other embodiments of the present invention will become readily apparent to those skilled in the art from the following detailed description, wherein are shown and described only embodiments of the invention by way of illustration. As will be realized, the invention is capable of other and different embodiments and its several details are capable of modification in various other respects, all without departing from the scope of the present invention as defined by the claims. Accordingly, the drawings and detailed description are to be regarded as illustrative in nature and not as restrictive.
- The above and other features and advantages of the present invention will become more fully apparent from the following description, drawings and appended claims, or may be learned by the practice of the invention as set forth hereinafter. It is intended that all such additional apparatus and advantages be included within this description, be within the scope of the present invention, and be protected by the accompanying claims.
- In order that the manner in which the above recited and other advantages and features of the invention are obtained, a more particular description of the invention briefly described above will be rendered by reference to specific embodiments thereof, which are illustrated in the appended figures and drawings. The invention is herein described, by way of non-limiting example only, with reference to the accompanying figures and drawings, wherein like designations denote like elements. Understanding that these drawings only provide information concerning typical embodiments of the invention and are not therefore to be considered limiting in scope:
FIG. 1 illustrates schematically a simplified general functional block diagram of a system according to the invention;FIG. 2 illustrates schematically a perspective front view of a system according to the invention;FIG. 3 illustrates schematically a perspective rear view of a system according to the invention;FIG. 4 illustrates schematically a rear view of a system according to the invention;FIG. 5 illustrates schematically a top view of a system according to the invention;FIG. 6 illustrates schematically a side view of a system according to the invention;FIG. 7 illustrates schematically a simplified general functional block diagram of a prior-art electronic camera;FIG. 8 illustrates schematically a rear view of a system according to the invention;FIG. 9 illustrates schematically a top view of a system according to the invention;FIG. 10 illustrates schematically a flow chart of the system operation according to the invention;FIG. 11 illustrates schematically a perspective view of a room with a system according to the invention;FIG. 12 illustrates schematically a perspective view of a room with a system according to the invention;FIG. 13 illustrates schematically a side view of a room with a system according to the invention;FIG. 14 illustrates schematically a top view of a room with a system according to the invention;FIG. 15 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 16 illustrates schematically a top view of a room with a system according to the invention;FIG. 17 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 18 illustrates schematically a top view of a room with a system according to the invention;FIG. 19 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 20 illustrates schematically a top view of a room with a system according to the invention;FIG. 21 illustrates schematically a perspective view of a room with a system according to the invention;FIG. 23 illustrates schematically a side view of a room with a system according to the invention;FIG. 24 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 25 illustrates schematically a top view of a room with a system according to the invention;FIG. 26 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 27 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 28 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 29 illustrates schematically a top view of a room with a system according to the invention;FIG. 30 illustrates schematically a simplified general functional block diagram of a system according to the invention;FIG. 31 illustrates schematically a perspective front view of a system according to the invention;FIG. 32 illustrates schematically a perspective rear view of a system according to the invention;FIG. 33 illustrates schematically a side view of a system according to the invention;FIG. 34 illustrates schematically a perspective side view of a system according to the invention;FIG. 35 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 36 illustrates schematically a simplified general functional block diagram of a system according to the invention;FIG. 37 illustrates schematically a perspective front view of a system according to the invention;FIG. 38 illustrates schematically a perspective rear view of a system according to the invention;FIG. 39 illustrates schematically a perspective front view of a system according to the invention;FIG. 40 illustrates schematically a flow chart of the system operation according to the invention;FIG. 41 illustrates schematically a simplified general functional block diagram of a system according to the invention;FIG. 42 illustrates schematically a simplified general functional block diagram of a system according to the invention;FIG. 43 illustrates schematically a perspective front view of a room according to the invention;FIG. 44 illustrates schematically a side view of a room according to the invention;FIG. 45 illustrates schematically a top view of a room according to the invention;FIG. 46 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 47 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 48 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 49 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 50 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 51 illustrates schematically a flow chart of the system operation according to the invention;FIG. 52 illustrates schematically a flow chart of the system operation according to the invention;FIG. 53 illustrates schematically an image captured and analyzed in a system according to the invention;FIG. 54 illustrates schematically an image captured and analyzed in a system according to the invention.FIG. 55 illustrates schematically a simplified general functional block diagram of a system according to the invention;FIG. 56 illustrates schematically a simplified general functional block diagram of a system according to the invention;FIG. 57 illustrates schematically a simplified general functional block diagram of a system according to the invention;FIG. 58 illustrates schematically a simplified general functional block diagram of a system according to the invention;FIG. 59 illustrates schematically a simplified general functional block diagram of a system according to the invention; andFIG. 60 illustrates schematically a simplified general functional block diagram of a system according to the invention.- The principles and operation of a network according to the present invention may be understood with reference to the figures and the accompanying description wherein similar components appearing in different figures are denoted by identical reference numerals. The drawings and descriptions are conceptual only. In actual practice, a single component can implement one or more functions; alternatively, each function can be implemented by a plurality of components and circuits. In the figures and descriptions, identical reference numerals indicate those components that are common to different embodiments or configurations. Identical numerical references (even in the case of using different suffix, such as5,5a,5band5c) refer to functions or actual devices that are either identical, substantially similar or having similar functionality. It will be readily understood that the components of the present invention, as generally described and illustrated in the figures herein, could be arranged and designed in a wide variety of different configurations. Thus, the following more detailed description of the embodiments of the apparatus, system, and method of the present invention, as represented in the figures herein, is not intended to limit the scope of the invention, as claimed, but is merely representative of embodiments of the invention.
FIG. 1 is a schematic block diagram of asystem 10 according to one embodiment of the invention. A pictorialfront perspective view 20 of the system is shown inFIG. 2 , arear perspective view 30 is shown inFIG. 3 , arear view 40 is shown inFIG. 4 , an upview 50 is shown inFIG. 5 andside view 60 is shown inFIG. 6 .- The invention is exampled with regard to a
fiat panel display 18, for example a LCD television set. However, any other electronic display or any other output device used for presentation of visual information may be equally used. Common applications for electronic visual displays used to be television sets or computer monitors. Thedisplay 18 may be a digital or analog video display, and may use technologies such as LCD (Liquid Crystal Display), TFT (Thin-Film Transistor), FED (Field Emission Display), CRT (Cathode Ray Tube) or any other electronic screen technology that visually shows information such as graphics or text. In many cases, an adaptor (not shown) is required in order to connect an analog display to the digital data. For example, the adaptor may convert to composite video (PAL, NTSC) or S-Video or HDTV signal. Various user controls can be available to allow the user to control and effect thedisplay unit 18 operations, such as an on/off switch, a reset button and others. Other exemplary controls involve display associated settings such as contrast, brightness and zoom. - Analog displays are commonly using interfaces such as composite video such as NTSC, PAL or SECAM formats. Similarly, analog RGB, VGA (Video Graphics Array), SVGA (Super Video Graphics Array), SCART, S-video and other standard analog interfaces can be used. Further, personal computer monitors, plasma or flat panel displays, CRT, DLP display or a video projector may be equally used. Standard digital interfaces such as a IEEE1394 interface, also known as FireWire™, may be used. Other digital interfaces that can be used are USB, SDI (Serial Digital Interface), FireWire, HDMI (High-Definition Multimedia Interface), DVI (Digital Visual Interface), UDI (Unified Display Interface), DisplayPort, Digital Component Video and DVB (Digital Video Broadcast).
Display 18 is mechanically mounted using apedestal 28 attached to the rear part of thedisplay 18. Thepedestal 18 is attached toaxis 17 of theelectric motor 15. Themotor 15 converts electrical energy into rotational motion of its axis. The torque applied to themotor axis 17 rotates thedisplay 18 horizontally via thepedestal 28 around its vertical center. This allows rotating and positioning thedisplay 18 as required by controlling theelectric motor 15. Themotor 15 is mounted on and fixed tobase 29 which is placed on drawer'schest 27. Thebase 29 provides support to the mechanical assembly including thedisplay 18,pedestal 28 and themotor 15. Theelectric motor 15 is controlled and powered bycontrol box 11, and connected thereto via cable23 (shown connected via the base29).FIG. 8 shows a perspective rear view80 andFIG. 9 shows an up view90 of the system after angular rotating of thedisplay 18 by themotor 15 from the original position shows as dashedlines 91 inFIG. 9 .- The
electric motor 15 can be of Alternating Current (AC) or Direct Current (DC) powered type. In the case of AC powered motor, the motor may be either synchronous or induction type. In the case of a DC powered motor, the motor may either be brushless or stepper type. The motor is controlled bymotor controller 14 in thecontrol box 11. Themotor controller 14 might include a manual or automatic means for starting and stopping the motor, selecting forward or reverse rotation, selecting and regulating the speed, regulating or limiting the torque, and protecting against overloads and faults. An electric motor controller is commonly suited to the type of motor it is to drive such as permanent magnet, servo, series, separately excited, and alternating current. - A system according to one embodiment of the invention comprises an
electronic camera 16. Thecamera 16 is attached to thedisplay 18. Preferably, thecamera 16 is attached to thedisplay 18 such that thecamera 16 center line-of-sight is substantially parallel to thedisplay 18 center fine of sight, so that the center of the image captured by thecamera 16 is congruent with a perpendicular line erecting from the center panel of thedisplay 16.Camera 16 may be a still camera which converts captured image into electric signal upon a specific control, or can be a video camera, wherein the conversion between captured images to electronic signal is continuous (e.g. 24 frames per second).is preferable a digital camera.Camera 16 is preferably a digital camera, wherein the video or still images are converted using electronic image sensor. An electronic signal representing the captured image is transmitted from thecamera 16 to theimage processor 12 in thecontrol box 11 viacable 26. The signal may be digital or analog signal. - Block diagram of such
digital camera 16 is shown inFIG. 7 , showing lens71 (or few lenses) for focusing the received light onto asmall semiconductor sensor 72. Thesensor 72 commonly includes a panel with a matrix of tiny light-sensitive diodes (photocells), converting the image light to electric charges and then to electric signals, thus creating a video picture or a still image by recording the light intensity. Charge-Coupled Devices (CCD) and CMOS (Complementary Metal-Oxide-Semiconductor) are commonly used as the light-sensitive diodes. Linear or area arrays of light-sensitive elements may be used, and the light sensitive sensors may support monochrome (black & white), color or both. For example, the CCD sensor KAI-2093 Image Sensor 1920 (H)×1080 (V) Interline CCD Image Sensor or KAF-50100 Image Sensor 8176 (H)×6132 (V) Full-Frame CCD Image Sensor can be used, available from Image Sensor Solutions, Eastman Kodak Company, Rochester, N.Y. - An
image processor block 73 receives the analog signal from the image sensor. The Analog Front End (AFE) in theblock 73 filters, amplifies and digitizes the signal, using an analog-to-digital (A/D) converter. The AFE further provides correlated double sampling (CDS), and provides a gain control to accommodate varying illumination conditions. In the case ofCCD sensor 72, a CCD AFE (Analog Front End) component may be used between thedigital image processor 73 and thesensor 72. Such an AFE may be based on. VSP2560 ‘CCD Analog Front End for Digital Cameras’ from Texas Instruments Incorporated of Dallas Tex., U.S.A. Theblock 73 further contains a digital image processor, which receives the digital data from the ATE, and processes this digital representation of the image to handle various industry-standards, and to execute various computations and algorithms. Preferably, additional image enhancements may be performed by theblock 73 such as generating greater pixel density or adjusting color balance, contrast and luminance. Further, theblock 73 may perform other data management functions and processing on the raw digital image data. Commonly, the timing relationship of the vertical/horizontal reference signals and the pixel clock are also handled in this block. Digital Media System-on-Chip device TMS320DM357 from Texas Instruments Incorporated of Dallas Tex., U.S.A. is an example of a device implementing in a single chip (and associated circuitry) part or all of theimage processor 73, part or all of thevideo compressor 74 and part or all oftransceiver 75. In addition to a lens or lens system, color filters may be placed between the imaging optics and the photosensor array to achieve desired color manipulation. - The
block 73 converts the raw data received from thephotosensor array 72 into a color-corrected image in a standard image file format. Thecamera 16 further comprises aconnector 79 for connecting to thecable 26. In order to transmit the digital image to theimage processor 12 in thecontrol box 11 via cable26 (which may contain a wired or non-wired medium), a transmitter ortransceiver 75 is disposed between theconnector 79 and theimage processor 73. Thetransceiver 75 also includes isolation magnetic components (e.g. transformer-based), balancing, surge protection, and other suitable components required for providing a proper and standard interface via aconnector 79. In the case of connecting to a wired medium, theconnector 79 further contains protection circuitry for accommodating transients, over-voltage and lightning, and any other protection means for reducing or eliminating the damage from an unwanted signal over the wired medium. A band pass filter may also be used for passing only the required communication signals, and rejecting or stopping other signals in the described path. A transformer may be used for isolating and reducing common-mode interferences. Further a wiring driver and wiring receivers may be used in order to transmit and receive the appropriate level of signal to and from the wired medium. An equalizer may also be used in order to compensate for any frequency dependent characteristics of the wired medium. Further, the communication over thecable 26 can be bi-directional, such as half-duplex or full-duplex, or one-way, wherein thecamera 16 only transmits the image to thecontrol box 11. - A
controller 77, located within thecamera module 16, may be based on a discrete logic or an integrated device, such as a processor, microprocessor or microcomputer, and may include a general-purpose device or may be a special purpose processing device, such as an ASIC, PAL, PLA, PLD, Field Programmable Gate Array (FPGA), Gate Array, or other customized or programmable device. In the case of a programmable device as well as in other implementations, a memory is required. Thecontroller 77 commonly includes a memory that may include a static RAM (random Access Memory), dynamic RAM, flash memory, ROM (Read Only Memory), or any other data storage medium. The memory may include data, programs, and/or instructions and any other software or firmware executable by the processor. The control logic can be implemented in hardware or in software, such as a firmware stored in the memory. Thecontroller 77 controls and monitors the device operation, such as initialization, configuration, interface and commands. The term “processor” is meant to include any integrated circuit or other electronic device (or collection of devices) capable of performing an operation on at least one instruction including, without limitation, reduced instruction set core (RISC) processors, CISC microprocessors, microcontroller units (MCUs), CISC-based central processing units (CPUs), and digital signal processors (DSPs). The hardware of such devices may be integrated onto a single substrate (e.g., silicon “die”), or distributed among two or more substrates. Furthermore, various functional aspects of the processor may be implemented solely as software or firmware associated with the processor. - Power to the
digital camera module 16 is required for its described functions such as for capturing, storing, manipulating, and transmitting the image. A dedicated power source may be used such as a battery or a dedicated connection to an external power source viaconnector 69. In a preferred embodiment, power is supplied from thecontrol box 11 viacable 26, serving for both power and image transmitting. Thepower supply 78 contains a DC/DC converter. In another embodiment, thepower supply 78 is power fed from the AC power supply via AC plug asconnector 69 and a cord, and thus may include an AC/DC converter, for converting the AC power (commonly 115 VAC/60 Hz or 220 VAC/50 Hz) into the required DC voltage or voltages. Such power supplies are known in the art and typically involves converting 120 or 240 volt AC supplied by a power utility company to a well-regulated lower voltage DC for electronic devices. In one embodiment,power supply 78 is integrated into a single device or circuit, in order to share common circuits. Further, thepower supply 78 may include a boost converter, such as a buck boost converter, charge pump, inverter and regulators as known in the art, as required for conversion of one form of electrical power to another desired form and voltage. While power supply78 (either separated or integrated) can be an integral part and housed within the camera enclosure, they may be enclosed as a separate housing connected via cable to the camera assembly. For example, a small outlet plug-in step-down transformer shape can be used (also known as wall-wart, “power brick”, “plug pack”, “plug-in adapter”, “adapter block”, “domestic mains adapter”, “power adapter”, or AC adapter). Further,power supply 78 may be a linear or switching type. - Various formats that can be used to represent the captured image are TIFF (Tagged Image File Format), RAW format, AVI, DV, MOV, WMV, MP4, DCF (Design Rule for Camera Format), ITU-T H.261, ITU-T H.263, ITU-T H.264, ITU-
T CCIR 601, ASF, Exif (Exchangeable Image File Format), and DPOF (Digital Print Order Format) standards. In many cases, video data is compressed before transmission, in order to allow its transmission over a reduced bandwidth transmission system. A video compressor74 (or video encoder) is shown inFIG. 7 disposed between theimage processor 73 and thetransceiver 75, allowing for compression of the digital video signal before its transmission over thecable 26. In some cases compression will not be required, hence obviating the need forsuch compressor 74. Such compression can be lossy or lossless types. Common compression algorithms are PEG (Joint Photographic Experts Group) and MPEG (Moving Picture Experts Group). The above and other image or video compression techniques can make use of intraframe compression commonly based on registering the differences between part of single frame or a single image. Interframe compression can further be used for video streams, based on registering differences between frames. Other examples of image processing include run length encoding and delta modulation. Further, the image can be dynamically dithered to allow the displayed image to appear to have higher resolution and quality. - Single lens or a
lens array 71 is positioned to collect optical energy representative of a subject or a scenery, and to focus the optical energy onto thephotosensor array 72. Commonly, thephotosensor array 72 is a matrix of photosensitive pixels, which generates an electric signal that is representative of the optical energy that is directed at the pixel by the imaging optics. - A prior art example of a portable electronic camera connectable to a computer is disclosed in U.S. Pat. No. 5,402,170 to Parulski et al. entitled: “Hand-Manipulated Electronic Camera Tethered to a Personal Computer”. A digital electronic camera which can accept various types of input/output cards or memory cards is disclosed in U.S. Pat. No. 7,432,952 to Fukuoka entitled: “Digital Image Capturing Device having an Interface for Receiving a Control Program”, and the use of a disk drive assembly for transferring images out of an electronic camera is disclosed in U.S. Pat. No. 5,138,459 to Roberts et al., entitled: “Electronic Still Video Camera with Direct Personal Computer (PC) Compatible Digital Format Output”, which are all incorporated in their entirety for all purposes as if fully set forth herein. A camera with human face detection means is disclosed in U.S. Pat. No. 6,940,545 to Ray et al., entitled: “Face Detecting Camera and Method”, which is incorporated in its entirety for all purposes as if fully set forth herein.
- Face detection (also known as face localization) includes an algorithms for identifying a group of pixels within a digitally-acquired image that relates to the existence, locations and sizes of human faces. Common face-detection algorithms focused on the detection of frontal human faces, and other algorithms attempt to solve the more general and difficult problem of multi-view face detection. That is, the detection of faces that are either rotated along the axis from the face to the observer (in-plane rotation), or rotated along the vertical or left-right axis (out-of-plane rotation), or both. Various face detection techniques and devices (e.g. cameras) having face detection features are disclosed in U.S. Pat. Nos. RE33682, RE31370, 4,047,187, 4,317,991, 4,367,027, 4,638,364, 5,291,234, 5,386,103, 5,488,429, 5,638,136, 5,642,431, 5,710,833, 5,724,456, 5,781,650, 5,812,193, 5,818,975, 5,835,616, 5,870,138, 5,978,519, 5,987,154, 5,991,456, 6,097,470, 6,101,271, 6,128,397, 6,148,092, 6,151,073, 6,188,777, 6,192,149, 6,249,315, 6,263,113, 6,268,939, 6,282,317, 6,301,370, 6,332,033, 6,393,148, 6,404,900, 6,407,777, 6,421,468, 6,438,264, 6,456,732, 6,459,436, 6,473,199, 6,501,857, 6,504,942, 6,504,951, 6,516,154, 6,526,161, 6,940,545, 7,110,575, 7,315,630, 7,317,815, 7,466,844, 7,466,866 and 7,508,961, which are all incorporated in its entirety for all purposes as if fully set forth herein.
- The electrical form of the image captured by the
camera 16 is received viacable 26 at theimage processor 12 incontrol box 11. Theimage processor 12 performs face detection algorithms on the received image, to determine if there is a face (or plurality of faces) in the captured image, and the location of each detected face in the captured view. Theimage processor 12 transmits the processing results tocontroller 13 vialink 25. Theimage processor 12 may be based on a discrete logic or an integrated device, such as a processor, microprocessor or microcomputer, and may include a general-purpose device or may be a special purpose processing device, such as an ASIC, PAL, PLA, PLD, Field Programmable Gate Array (FPGA), Gate Array, or other customized or programmable device. In the case of a programmable device as well as in other implementations, a memory is required. Theimage processor 12 commonly includes a memory that may include a static RAM (random Access Memory), dynamic RAM, flash memory, ROM (Read Only Memory), or any other data storage medium. The memory may include data, programs, and/or instructions and any other software or firmware executable by the processor. The control logic can be implemented in hardware or in software, such as a firmware stored in the memory. The term “processor” is meant to include any integrated circuit or other electronic device (or collection of devices) capable of performing an operation on at least one instruction including, without limitation, reduced instruction set core (RISC) processors, CISC microprocessors, microcontroller units (MCUs), CISC-based central processing units (CPUs), and digital signal processors (DSPs). The hardware of such devices may be integrated onto a single substrate (e.g., silicon “die”), or distributed among two or more substrates. Furthermore, various functional aspects of the processor may be implemented solely as software or firmware associated with the processor. - The
controller 13 controls and monitors the device operation, such as initialization, configuration, interface and commands. Thecontroller 13, located within thecontrol box 11, may be based on a discrete logic or an integrated device, such as a processor, microprocessor or microcomputer, and may include a general-purpose device or may be a special purpose processing device, such as an ASIC, PAL, PLA, PLD, Field Programmable Gate Array (FPGA), Gate Array, or other customized or programmable device. In the case of a programmable device as well as in other implementations, a memory is required. Thecontroller 13 commonly includes a memory that may include a static RAM (random. Access Memory), dynamic RAM, flash memory, ROM (Read Only Memory), or any other data storage medium. The memory may include data, programs, and/or instructions and any other software or firmware executable by the processor. The control logic can be implemented in hardware or in software, such as a firmware stored in the memory. Thecontroller 13 controls and monitors the device operation, such as initialization, configuration, interface and commands. - During operation, the image captured by
camera 16 is processed for face detection byimage processor 12. The results of face detection processing, such as the existence of a face in the image, the number of detected faces and the location of the detected face are provided to thecontroller 13 vialink 25. Thecontroller 13 in turn provides commands to themotor control 14 vialink 24, for rotating themotor 15, which in turn rotates thedisplay 18 attached thereto. - The system operation is described in
flow chart 100 inFIG. 10 , and will be exampled with regard toFIGS. 11 to 14 , showing a living room wherein aperson 114 is sitting on asofa 113 and watching the display18 (e.g. a flat screen television set) being part of asystem 10 according to the invention.FIG. 11 shows a perspectiverear view 110 of the display18 (and a perspective front view of theperson 114 sitting on the sofa113).FIG. 12 shows a perspective front view120 of the display18 (and a perspective rear view of theperson 114 sitting on the sofa113).FIG. 13 shows aside view 130 andFIG. 14 is a top view of thesystem 10,person 114 and thesofa 113. Similarly,FIG. 16 shows atop view 160 of the room wherein no person is present in the room. - As shown in
top view 140 inFIG. 14 , thesofa 113 is centered substantially vertically directly across from the display118, as shown in the imaginary line ofsight 141 connecting thesofa 113 center to thedisplay 18 center. Hence, the center place on thesofa 113 is the optimal seating place, providing best visibility of the image on thedisplay 18. However, as shown inFIGS. 11 to 14 , theperson 114 is sitting in a side seat of thesofa 113, thus using the line ofsight 142 to thedisplay 18, which is deviated from theoptimal line 141. - The
flow chart 100 is executed by the system and controlled and managed by the software (or firmware) incontroller 13 in thecontrol box 11. The system activation starts at step ‘Start’101. Next in step ‘Image Capture’102, thecamera 16 is operated to capture a single ‘still’ frame or a video including streaming of frame. The image captured is transmitted from thecamera 16 to theimage processor 12 within thecontrol box 11 viacommunication link 26, which may be a cable.FIG. 15 shows an example of animage 150 that is captured by thecamera 16, featuring theperson 114 sitting on thesofa 113. - The captured image (such as image150) is then process by the
image processor 12 in ‘face detection’step 103. A face detection algorithm is executed on the image captured, and the count of detected faces is checked in ‘Faces Count’step 104. if human faces are detected instep 103 by theimage processor 12, the detected face location is determined, such as rectangular152 relating toperson 113 face detected inimage 150. In some cases, no person is present in the room, as shown intop view 160 inFIG. 16 . In such a case, the image captured is shown animage 170 inFIG. 17 , wherein only thesofa 113 is present, the image captured. If no human faces are detected, either due to the fact that no humans are present in the image or they are not watching at thedisplay 18 orcamera 16, then it is assumed that no humans are currently watching the display18 (Faces Count equal zero). In this case, the system wait a pre determined period TIMER in ‘wait Time’step 105 during which the system is idle, and afterwards the system resumes to its operation from the start instep 102. The TIMER period can be in the order of seconds (e.g. 1 to 10 seconds), dozens of seconds (e.g. 30 to 60 seconds), minutes (e.g. 1 to 10 minutes), dozens of minutes (e.g. 30 to 60 minutes) or hours (e.g. 1 to 10 hours). - In the case a single human face is detected in step103 (such as
face detection 152 in image150), the horizontal location of the face center is determined by theimage processor 12, shown as dashedline 153 inFIG. 15 . The dashedvertical line 153 is calculated to be at the detectedface 152 center. - In the next step ‘Face Location Deviation’106, the distance deviation between the image center represented by the imaginary dashed
line 151 horizontally centered in the image, and the detectedface 152center location line 153 is calculated (shown as thedeviation line 154 inFIG. 15 ). This distance represents the deviation of the person location (particularly its face location) from the optimal viewing point represented by theimage center line 151. - Next, the deviation is checked in ‘Deviation<Delta’
step 107. In the case there is no deviation (Deviation=0), or if the deviation value is lower from a pre-set limit value, this means that the person watching the screen ofdisplay 18 is exactly or substantially locate in the best viewing position. Hence, there is no need for any improvement of the viewing angle, and the system reverts to idling instep 105. Such a case is described inFIG. 18 showing atop view 180 of a room wherein theperson 114 watching thedisplay 18 is sitting in the center seat of thesofa 113 and thus is located directly across the system having anoptimum display 18 view. The image captures in such a case is shown asimage 190 inFIG. 19 , showing that the imagehorizontal center line 151 coincides with the detectedface 152center line 153, hence thedeviation 154 is zero. In the case the deviation is above a pre-set value, thecontroller 13 operates in step ‘Display Rotation’111 to rectify the situation by ordering the motor15 (via the motor controller14) to rotate in a direction that reduce the deviation. In the example ofimage 150 inFIG. 15 , the person is located to the left side of the image, when viewed from thecamera 16 point of view. In this case, themotor 15 with rotate the display counter-clockwise when looked from top, bringing thedisplay 18 to theviewer person 113 line of sight. - In one embodiment, in the case wherein it is determined that the rotation of the
motor 15 is required to correct the line-of-sight deviation 154, themotor 15 will rotate a pre-set angular movement to the required direction, regardless of the measureddeviation 154. For example, an angular shift of 1 degree (1°) can be used. The rotation will be clockwise or counter-clockwise depending upon the deviation side versus thecenter line 151. Similarly, other angular shifts such as 2 degrees (2°) 5 degrees (5°) or 10 degrees (10°) may be used. In another embodiment, themotor 15 angular shift is dependent upon the actual measureddeviation 154. Large deviation will result in a larger shift, while small deviation value will result in a smaller angular shift. For example, the angular rotation can be proportional to the value of thedeviation 154. - After executing the required angular shift in ‘Display Rotation’
step 111, the system is idling for a period of TIMER in ‘Wait Time’step 105 before another correction cycle starts (a cycle comprising all the required steps from ‘Image Capture’step 102 to completing a Display Rotation' step111). The case may be wherein few cycles will be required before the deviation is fully corrected and the system is idling after getting into zero (or substantially small) deviation. For example, in the case of a fixed angular rotation of 2 degrees (2°) is performed in ‘Display Rotation’step 111, the system will require 5 (five) cycles to compensate for an angular deviation of 10 degrees (10°). Further, continuous operation also allows for continuous correction of the deviation, which may result due to the shift of the person position in the room. For example, in the case theperson 114 moves to another seat on thesofa 113, one or more cycles may be required to adjust the system to the new location of the person. Similarly, adding watching persons can also require system adjustments will be described hereafter. - The continuous operation of the system as shown in
flow chart 100 effectively implement a feedback control loop, wherein thecamera 16 acts as a sensor for obtaining thedeviation 154 and themotor 15 serves as an actuator, and the control loop (which may be a linear control loop) tries to regulate in order to minimize the value of the deviation154 (set point zero for the measured deviation154). Linear control may also be used for such negative feedback system. Such a system can use proportional-only control loop, however PID (Proportional, Integral, Derivative) control known in the art commonly provides better control results. - The system steady-state situation after completing all required cycles (one or more) to align the line-of-sight to its optimal position is described with regard to
FIGS. 20 to 24 , showing a living room wherein aperson 114 is sitting on asofa 113 and watching the display18 (e.g. a flat screen television set) being part of asystem 10 according to the invention.FIG. 20 shows atop view 200 wherein thedisplay 18 is shown facing directly theperson 114 onsofa 113, as shown in the dashed line-of-sight 201.FIG. 22 shows aperspective front view 210 of the display18 (and a perspective rear view of theperson 114 sitting on the sofa113).FIG. 22 shows aside view 220 andFIG. 23 is another perspective front view of the system10 (and a perspective rear view of theperson 114 sitting on the sofa113). FIG. 24 shows theimage 240 captured by thecamera 16 at this steady state. The face detected152center line 153 coincides with theimage center line 151, resulting deviation distance of zero (actually or practically less than Delta).- In some cases, multiple persons may be watching the
display 18 at the same time. Such scenario is shown in atop view 250 inFIG. 25 . Anadditional person 114bis shown sitting in thesofa 113 center seat, added to theperson 114asitting on thesofa 113 side-seat as described above. In such a situation, the optimal viewing angle is different for each person being in different location. The best solution is to direct thedisplay 18 towards the center between thepersons 114aand144b,such that each will enjoy a low deviation in a fair partition. Handling few detected faces is handled in the left side offlow chart 100, consisting of ‘Average Location Calculation’step 108 and ‘average Location Deviation’step 109. Image 260 shown inFIG. 26 shows the captured image in thecamera 16 in the case shown inFIG. 26 . Theimage processor 12, using face detection algorithms, identifies the two faces ofpersons 114aand144bby the respective face frames152aand152b, and associates anhorizontal location lines FIG. 15 . Next, as part of ‘Average Location Calculation’step 108 in flow-chart 100, the average face location is calculated. Such averagehorizontal location 271 is shown as part ofimage 270 inFIG. 27 . Thelines average line 271, as shown bydistances average location 271 is used, as a substitute to thelocation line 153 shown inFIG. 15 , as the means for calculating the deviation from theimage center line 151. Thedeviation 154 between theimage center line 151 and theaverage line 271 will be calculated in ‘Average Location deviation’step 109.- Based on the deviation value154 (derived from the average position of both faces), the system will rotate the
display 18 such that the deviation will be minimized as described above. The system steady-state situation after completing all required cycles (one or more) to align the line-of-sight to its optimal position is described with regard toFIG. 29 , showing a living room wherein the twopersons sofa 113 and watching the display18 (e.g. a flat screen television set) being part of asystem 10 according to the invention.FIG. 29 shows atop view 290 wherein thedisplay 18 is shown facing directly the middle point between thepersons 114aand144bonsofa 113, as shown in the dashed line-of-sight 291. The image captured by thecamera 16 in this situation is shown asimage 280 inFIG. 28 , wherein theaverage line 271 and theimage center line 151 coincides, resulting in zero deviation value. - While the invention has been exampled above with regard to a single motor and rotating the
display 18 in a single axis, being the horizontal axis, it is the invention may equally apply to rotating thedisplay 18 in the vertical axis only. In such a scenario, thedisplay 18 will be inclined as required to ensure direct line of sight for optimum view in the vertical axis. - Further, the invention can be applied to rotate the
display 18 in both the horizontal and vertical axes, thus allowing for better and optimal viewing. A block diagram of such asystem 300 is shown inFIG. 30 , using a two-axes control box 301. The horizontal rotation is using the horizontal motor (H. Motor)controller 14awhich receives commands from thecontroller 13 via theconnection 24a,and controlshorizontal motor 15aviaconnection 23a,which axis is in turn mechanically coupled to thedisplay 18 for horizontal rotation. This horizontal handling corresponds tosystem 10 shown inFIG. 1 , showing the horizontal motor (H. Motor)controller 14 which receives commands from thecontroller 13 via theconnection 24, and controlshorizontal motor 15 viaconnection 23, whichaxis 17ais in turn mechanically coupled to thedisplay 18 for horizontal rotation. A set of a vertical motor (V. Motor)controller 14band avertical motor 15bare added tosystem 10 for inclining the display (in the vertical axis) as required. The vertical rotation is using the vertical motor (V. Motor)controller 14bwhich receives commands from thecontroller 13 via theconnection 24b,and controlshorizontal motor 15bviaconnection 23b,whichaxis 17bis in turn mechanically coupled to thedisplay 18 for vertical rotation. - A pictorial exemplary system is shown in
FIGS. 31 to 34 , wherein a pictorialfront perspective view 310 of the system having two axes line of sight correction is shown inFIG. 31 , arear perspective view 320 is shown inFIG. 32 , aside view 330 is shown inFIG. 33 and an anotherperspective side view 340 is shown inFIG. 34 . Acontrol box 301 is shown supporting operation in both vertical and horizontal planes.Horizontal motor 15ais shown attached topedestal 27 viaaxis 17a,for horizontal, rotating of thedisplay 18, as described above relating toFIGS. 2 to 6 . In order to allow rotation also in the vertical plane, asecond pedestal 302 is added attached to theformer pedestal 28. Thesecond pedestal 302 serves a basis to thevertical motor 15b,which is attached to thedisplay 18 via theaxis 17b.In operation,vertical motor 15brotates itsaxis 17band thedisplay 18 attached thereto thus inclining thedisplay 18, hence controlling its vertical line of sight.FIG. 3 shows adisplay 18 shifted from its original inclination (shown as dashed frame331) to a reclining position. Similarly, areclining display 18 is shown inFIG. 34 . - The operation of such two-axes system in the horizontal plane will be similar to the above operation described in
FIG. 10 and the appendedFIGS. 11 to 29 , wherein the horizontal rotation required in affected by theH. Motor 14avia itsaxis 17a.In parallel, and simultaneously with the horizontal loop, a similar vertical control loop is executed. He image processing in case of correcting two planes is exampled with regard to image captured350 shown inFIG. 35 (based onFIG. 15 ). In the ‘Face Location deviation’step 106 executed as part offlow chart 100 executed by theimage processor 12, not only thehorizontal deviation 154 is estimated, but rather thevertical deviation 352 is calculated as well. Similar to the horizontal calculation above regarding thehorizontal deviation 154, thevertical deviation 352 is the difference between the imagehorizontal center line 351 and the vertical position353 of the detectedface 152. Similar to above description, the control loop is operative to lower thevertical deviation 352 to a minimum value or zero, thus aligning the viewer line of sight with the plane of thedisplay 18 offering optimal viewing experience. - While the invention has been exampled above with regard to a single motor and rotating the
display 18 in a single axis, being the horizontal axis, and with regard to including a second motor for rotating thedisplay 18 in both horizontal and vertical planes, the invention may equally apply to rotating thedisplay 18 in the vertical axis only. hi such a scenario, thedisplay 18 will be inclined as required to ensure direct line of sight for optimum view only in the vertical axis. In this case, thesystem 300 shown inFIG. 30 will use only thevertical motor 15band itscontroller 14b,and the horizontal components (such asmotor 15aandcontroller 14a) may be obviated. - While the invention has been exampled above with regard to a specific partition of the system components into various enclosures, the invention may equally apply to any other partition. For example, the
camera 16 has been described above having a dedicated casing housing only the camera related hardware. However, the camera may as well be integrated into the control box301 (or control box11), obviating the need for additional enclosure andcable 26. The integration may be just housing of thecamera 16 in the same enclosure, or may share common hardware such as power supply, control lines and mechanical fixing. In one embodiment, thecamera 16 is integrated with thedisplay 18 or fixedly attached thereto. One advantage of such solution is that many displays already include a build-in camera for video conferencing (such as laptops). In another embodiment, theimage processor 12 is integrated into thecamera 16 enclosure. - In one example, the
motor controller 14ais integrated within the casing of themotor 15a.Similarly, themotor controller 14bis integrated within the casing of themotor 15b. Further, themotor 15a(and/or themotor 15b) may be integrated or fixedly combined with thedisplay 18. In another embodiment, the control box301 (or control box11) may be enclosed (in part or in full) in thecamera 16 enclosure or with themotor 15a(ormotor 15b). Alternatively, thecontrol box 301 may be fully integrated within thedisplay 18 housing. - While the invention has been exampled above with regard to using the face detection means in order to mechanically move the
display 18 based on the location of the detected face or faces, the invention may equally apply to using the face detection for other controls of thedisplay 18 or other devices. - In one exemplary embodiment, the face detection mechanism is used for turning the display ON and OFF. The detection of a human face in the captured image is serving as an indication that at least one person is watching the screen. In the case no faces are detected, the system assumes that no one is watching the screen, thus shutting off the display. This provides the benefit of not consuming power when not required, thus saving energy and the associated electricity expenses. Further, since electrical systems in general and displays in particular have a limited life span, such shutdown increases the usage of the screen and its operation life by saving wear and tear of the screen when its operation is not required. A block diagram360 of such a system is shown in
FIG. 36 , based on a control box361 (substituting thecontrol box 11 described above). Similar tosystem 10 described above thesystem 360 comprises a camera,16, feeding its captured image to theimage processor 12 viacommunication link 26. Theimage processor 12 uses face detection image processing algorithms, detect the existence of human faces in the image captured, and notify thecontroller 363 viaconnection 25.Controller 363 may be identical or similar tocontroller 13 above. Thedisplay 18 is powered from theAC plug 21 via controlled on/offswitch 362 andpower cable 365, which is controlled by thecontroller 363 via thecontrol connection 364. Hence, thecontroller 363 may tom thedisplay 18 on and off by activatingswitch 362. Theswitch 362 may be implemented by relay contacts, whereinline 364 is a control signal used to energize and de-energize the coil of the relay, or may be implemented using solid state circuitry as known in the art. - The system operation is exampled as
flow chart 400 inFIG. 40 . Theflow chart 400 execution is managed, controlled and handled by thecontroller 363 incontrol box 361. Upon system activation inStart step 401, thecontroller 363 provides anactivation control signal 361 to theswitch 362, commanding it to close and pass the AC power from theAC plug 21 to thedisplay 18, thus turning thedisplay 18 on. Then ‘Start Timer1’step 403 is executed, wherein a timer having a pre set period of time (Timer1) starts to count the elapsing time, counting down from the specified time interval to zero. ‘Face Detected’Step 404 is similar (or the same) as ‘Face detection’step 103, wherein theimage processor 12 analyzes the captured image and notify the existence of a detected face to thecontroller 363. If a face (or multiple faces) is detected, the Timer1 is reset and start its count again in ‘Start Timer1’step 403. Hence, as long as a face is detected, the system will be in the continuously performing the loop of steps ‘Start Timer1’step 403 and ‘Face Detected’step 404, wherein thedisplay 18 is in ON state as it continues to receive power viaswitch 362. In the case no face is detected by theimage processor 12, the time elapsed is checked in Timer1 in ‘Timer 1 expired’step 405. As long as Timer has not elapsed, the system will continue to check if a face has been detected in ‘Face Detected’step 404, and will reset the timer upon such detection. Only if throughout the Timer1 operation period no face has been detected, the power to thedisplay 18 will be turned off in ‘Turn OFF’step 406, by opening theswitch 362 contacts and thus de-energizing thedisplay 18. This mechanism allows for secure shutting off of thedisplay 18, and will obviate the false detection such as the case of turning thedisplay 18 off due to intermittent missing of a face detection occurrence or after too short period of lacking of face detection, thus adding to the system reliability. - After turning off the power to the
display 18 in ‘Turn OFF’step 406, a second timer (Timer2) is initiated in ‘Start Timer2’step 407. Timer2 is pre set to a period which may be similar or distinct from the period set forTimer 1. Further, the two timers can be implemented using the same hardware or software/firmware, or sharing part of the means required for these timers. Then a face detection mechanism is executed in ‘face Detected’ step408 (similar to the Face detected step404). If no face is detected in ‘Face detected’step 408, the Timer2 is restarted its count. As long as no face is detected, it is assumed that no person is viewing thedisplay 18 hence no power is supplied to thedisplay 18 rendering it turned off. Similar to the action of ‘Timed expired’step 405, ‘Timer2 expired’step 409 assures that a face needs to be detected for at least the period set in Timer2. Upon such occurrence, it is assumed that a person is actually looking at thedisplay 18, and thus the power to thedisplay 18 is resumed in ‘turn ON’step 402. This mechanism provides a reliable and stable operation promising that no action will be taken before assuring that the face detection is consistent and stable. - Each of said timers period can be in the order of seconds (e.g. 1 to 10 seconds), dozens of seconds (e.g. 30 to 60 seconds), minutes (e.g. 1 to 10 minutes), dozens of minutes (e.g. 30 to 60 minutes) or hours (e.g. 1 to 10 hours). The timers period can be the same, substantially similar or having substantial differences periods.
- While the invention has been exampled above with regard to a specific partition of the system components into various enclosures, the invention may equally apply to any other partition. For example, the
camera 16 has been described above having a dedicated casing housing only the camera related hardware. However, the camera may as well be integrated into thecontrol box 361 obviating the need for additional enclosure andcable 26. The integration may be just housing of thecamera 16 in the same enclosure, or may share common hardware such as power supply, control lines and mechanical fixing. In one embodiment, thecamera 16 is integrated with thedisplay 18 or fixedly attached thereto. One advantage of such solution is that many displays already include a build-in camera for video conferencing (such as laptops). In another embodiment, theimage processor 12 is integrated into thecamera 16 enclosure. Alternatively, thecontrol box 361 may be fully integrated within thedisplay 18 housing. System 410 shown inFIG. 41 is a block diagram of a system according to the invention which uses the face detection functionality for both obtaining a better viewing of thedisplay 18 as described above (for example with regard toFIGS. 1 to 35 ), and for controlling the screen functions (e.g. turning on/off as exampled inFIGS. 36 to 40 ). The block diagram300 shown inFIG. 30 is combined with thesystem 360 shown inFIG. 36 , making an efficient use of the common components such ascamera 16 andpower supply 19.Controller 412 combines the functions ofcontroller 363 with the functions ofcontroller 13, and thecontrol box 411 is used to house all the relevant components as shown inFIG. 41 .- While the invention has been exampled above in
FIG. 41 with regard to turning thedisplay 18 on and off by connecting or disconnecting the power to the display18 (allowing the usage with any type of a display18), the invention may equally apply to the case wherein the controlled functionality is internal to thedisplay 18. For example, only the power to the screen itself (e.g. the LEDs—Light Emitting Diodes illuminating the screen) may be stopped, thus blanking the display. Alternatively, thedisplay 18 may be commended to shift to a shutdown mode, similar to the mode used upon turning off a display by a remote control. Further, excessive power on I off actions (for thewhole display 18 system) may reduce its operative life span. An example of such asystem 420 is shown inFIG. 42 . Theswitch 362 is internal to thedisplay 18 and controlled viaconnection 422 connected to aconnector 423, and effect only part of thedisplay 18 functions, such as only excessive power consuming circuits or limited life span components. Upon decision to turn off, thecontrol box 421 comprises aconnector 424, used for connecting to thedisplay 18 viacable 425. Thus, thecontroller 363 extends itscontrol port 364 to manage and control theswitch 362 internal to thedisplay 18. - A pictorial
perspective front view 370 of such a system is shown inFIG. 37 , and a pictorial perspective rear view380 of such a system is shown inFIG. 38 . These views are similar respectively toviews FIGS. 2 and 3 respectively, where the motor15 (and its associated parts such as axis17) is not used. Thedisplay power cord 365 is shown connecting thedisplay 18 to thecontrol box 360 for receiving power therefrom via theswitch 362. - While the invention has been exampled above with regard to the
display 18 placed on a horizontal plane such asdrawers chest 27, the invention may equally apply to other positioning means such as wall (or other vertical plane) mounting. An example of a wall mounting system is shown inview 390 inFIG. 39 , wherein awall mounting fixture 391 is used, including a bracket for wall mounting. - While the invention has been exampled above with regard to using face detection to control various devices, the invention may equally apply to the case wherein the system is using detection relating to other human organs. Further, the invention may equally apply to the case wherein active action from the person involved is detected such as a gesture made with a part of the human body, and detected by the
image processor 12. For example, nodding, bobbling or shaking can be used as indication to be detected by the image processor and used for various remote control applications. - In one example, hand gesture is used for signaling the system, as exampled in
FIGS. 43 to 46 .FIG. 30 shows a perspectiverear view 430,FIG. 44 shows aside view 440 andFIG. 45 shows atop view 450. As shown in the views in these figures, theperson 114 on thesofa 113 signal the system by an hand gesture, consisting of extracting only the index finger, thus ‘pointing’ to the ceiling of the room. While the above description referred to theimage processor 12 performing face detection algorithms such as in ‘Face Detection’step 103 in flow chart100 (and ‘Face Detected’steps image processor 12 executes ‘hand gesture detection’ algorithms in order to detect the hand gesture made by theperson 114. The analysis results are exampled in the image captured460 inFIG. 46 , wherein the hand462 (or the palm) is detected as shown in the dashed rectangular461, and theindex finger 463 is detected and identified as pointing upwards. - Similarly, other hand gestures may be signaled and detected (and identified as such), involving extending of all or part of the fingers. For example,
image view 470 shows threefingers 464 raised (the index, middle and ring fingers, added to the thumb). Similarly, image view480 inFIG. 48 detects a person extracting all his/her fingers465, andimage view 490 inFIG. 49 shows a case wherein only anindex finger 466 is raised (added to the thumb). Two fingers467 (index and middle) and a thumb are shown detected in the hand detected461 as part ofimage 500 inFIG. 50 . - In one embodiment, the hand gesture is used to control the
display 18 as a substitute to the face detection described above. For example, the control may involve turning thedisplay 18 on and off as described above relating toFIGS. 36 to 42 , wherein theimage processor 12 is notifying thecontroller 412 regarding the detection of a hand gesture. Operation of such a system is described inflow chart 510 shown inFIG. 51 , based on theflow chart 400 shown inFIG. 40 and described above. The ‘Face Detected’steps steps - Remote controls are known in the art as electronic devices used for the remote operation of equipment. Wired or wireless remote control devices including Infra-Red (IR) or RF transmitter for remotely operating AC powered electrical appliances such as television receivers, home heaters, air conditioners, motorized curtains, lighting and other electrical appliances in homes, apartments, offices and buildings in general are switched on and off by a one way control or command signal. In most cases, the person operating the remote control device verifying the on or off status of the operated device by visual means, such as the TV is on, or the lights are off, or the air-condition unit is activated or not, by being at the site of the operated appliance. Commonly, remote controls are Consumer IR devices used to issue commands from a distance to televisions or other consumer electronics such as stereo systems DVD players and dimmers. Remote controls for these devices are usually small wireless handheld objects with an array of buttons for adjusting various settings such as television channel, track number, contrast, brightness and volume. In fact, for the majority of modern devices with this kind of control, the remote contains all the function controls while the controlled device itself only has a handful of essential primary controls.
- Using face detection or hand gesture detection can replace part of or all the functions of a remote control unit, thus obviating the need for using such additional and dedicated device for control. In one embodiment, the system is used for turning on and off a specific function in the controlled device, or in general switching from one state to the other of two states. In the example of a
display 18 being controlled (e.g. television set), the function controlled may be turning the display on and off by supplying or disconnected power to the display (e.g. as disclosed inFIG. 36 ), a ‘mute’ function or a ‘pause’/‘continue’ command to a DVD player. Such system operation may be based on theflow chart 520 shown inFIG. 52 , wherein the ‘Turn ON’step 402 and the ‘Turn OFF’step 406 are substituted with the ‘Turn Function ON’step 521 and ‘Turn Function OFF’step 522. The ‘Turn Function ON’step 521 is executed after the hand gesture is detected in ‘Hand Gesture Detected’step 511 for at least the period Timer1, and. The ‘Turn Function OFF’step 522 is executed after the hand gesture is detected in ‘Hand Gesture Detected’step 407 for at least the period Timer2. In the ‘Turn Function ON’step 521 the function commanded (e.g. ‘mute’) is activated (e.g. power turned on in the case of on/off control) or switched to a first state (out of two states available), while in the ‘Turn Function OFF’step 522 the function commanded (e.g. ‘mute’) is deactivated (e.g. power turned off in the case of on/off control) or switched to the other state (out of two states available). In the case wherein more than two states are available in the involved function, such as television channels wherein multiple channels are available to choose from, or in the case of a track number in a DVD player, and volume having continuous or multiple discrete steps, the hand gesture can be used to signal a single step of the function. For example, each time a detection of a hand gesture occurs may signal to shift to the next television channel, to the track number or to the next volume level. In such control scheme, the ‘Turn Function ON’ step521 (or the ‘Turn Function OFF’step 522 or both steps) activates the controlled unit to shift to the next step or level out of the multiple steps relating to the required function. - In one embodiment only a single hand gesture can be detected. For example, the system may only detect the hand gesture involving extending only the index finger as shown in
FIGS. 43 to 46 . Such system may usesimple image processor 12 since only a single object needs to be detected, and such detection of the hand gesture will be detected in ‘Hand detection Detected’steps flow chart 520. The detected hand gesture may be used for a single activation (or deactivation) of a function. Alternatively, the hand gesture may be used to continuously toggle between activation and deactivation of a function, wherein each such new detection of a hand gesture results in switching from a state to the other (or shifting to the next level or step), as described inflow chart 520 inFIG. 52 . - In another embodiment, multiple hand gestures can be detected and identified by the
image processor 12. In this case, separate hand gestures may be used for activation or deactivation of a function. For example, the hand gesture of ‘pointing up’ shown inFIGS. 43 to 46 can be detected and identified, together with the ‘all fingers up’ gesture shown in view480 inFIG. 48 . For example, the ‘pointing up’ gesture will be detected in ‘Hand Gesture Detected’step 511 inflow chart 520 and will cause to activate the function in ‘Turn Function ON’step 521, while the ‘all fingers up’ gesture will be detected in ‘Hand Gesture Detected’step 512 inflow chart 520 and will cause to deactivate the function in ‘Turn Function OFF’step 522. Similarly, one hand gesture may cause a multiple states function (such as television channel selection) to shift upwards while the other hand gesture may results in shifting downwards. For example, assuming the television set is currently set to channel15, one gesture shifts to channel16 (‘upwards’), while the other shifts to channel14 ‘downwards’). Similarly, one type of hand gesture detected may affect increasing the volume for a louder result, while the other will lower the volume to more silent performance. - While the invention has been exampled above with regard to using hand gestures for a single function control, the invention may equally apply to the case wherein multiple types of hand gestures will be used to control multiple functions. For example, each hand gesture may be used to control a single function, such as one hand gesture for ‘mute’, one for ‘volume’ and one for turning the television on and off.
- In one embodiment, the
image processor 12 is capable of detecting both hand gestures and human face. Such capability can be used in order to increase the reliability of the hand gesture and to minimize false hand gesture detection by searching for hand gesture in the image only if a face is detected in that image, since it is assumed that the hand gesture is signaled by a person viewing thedisplay 18, and thus his/her face are captured in the camera image. Hence, items which may be falsely identified as a hand gesture being of similar shape, will not be considered and thus will not be identified as a hand gesture. Further, since the location of the face and the hand of a person are related, this can be further used to improve the system performance, by searching and applying the algorithms for detecting hand gestures only in a defined location based on the detected face location. An example is shown inimage 530 shown inFIG. 53 , based onimage 460 inFIG. 46 . The face detection mechanism will detect the face, as shown in the dashed rectangular152 as described above. Assuming right-hand person, the probable location of the signaling hand is expected (based on normal human dimensions) to be in the circledarea 531, hence the hand gesture detection should only search for a hand gesture in thisarea 531, saving processing time and minimizing false detection. Similarly, for a left-handed person, the circle is placed to the person left side as shown inarea 532 as part ofimage 540 inFIG. 54 . - While the invention has been exampled above wherein the
camera 16 transmits the image to theimage processor 12 viacable 26, the invention may equally apply to the case wherein nosuch cable 26 is used for the communication. In one embodiment according to the invention, thecamera 16 is cordless, thus untethered and fully portable. In such a configuration, thecamera 16 is preferably battery operated, thus powered from an internal battery during operation without the need to connect to a power source, such as AC power via a cord. Further, the image is transmitted over the air using radio frequency, thus obviating the need for a cable or any other conductor connecting thecamera 16 and the control box. It is apparent the radio communication of the image can be implemented also in the case of AC powered (via cable) camera. - Such a
system 550 is shown inFIG. 55 , adapter fromsystem 410 inFIG. 41 . Thetransceiver 75 incamera 16 shown inFIG. 7 is substituted withwireless transceiver 551b, connected toantenna 552b.Thewireless transceiver 551bmay be internally to thecamera 16 enclosure or in a separate housing. The control box553 (adapted fromcontrol box 411 inFIG. 41 ) comprises amating wireless transceiver 551aconnected toantenna 552a.The image is transmitted from thecamera 16 via thewireless transceiver 551bandantenna 552bover the air communication, to be received in theantenna 552aandwireless transceiver 551a.Hence, no cable is required between thecamera 16 and thecontrol box 553, thus avoiding the inconvenience associated with such cord. Various types ofantennas - Similarly, while the invention has been exampled above in
system 420 shown inFIG. 42 wherein the controlleddisplay 18 is controlled viacable 425, the invention may equally apply to the case wherein nosuch cable 425 is used for the control or communication link. In one embodiment according to the invention, this control link is cordless, thus untethered and fully portable. Hence the control information is transmitted over the air using radio frequency, thus obviating the need for a cable or any other conductor connecting the control box and thedisplay unit 18. - Such a
system 560 is shown inFIG. 56 , adapter fromsystem 420 inFIG. 42 , wherein theconnector 424 in thecontrol box 421 is replaced with awireless transceiver 551ain control box561 (adapted fromcontrol box 421 inFIG. 42 ), connected toantenna 552a.Amating wireless transceiver 551bconnected toantenna 552bare added to thedisplay 18 side, and may be separated or housed integrally within thedisplay 18 housing. The control information is transmitted from thecontroller 363 incontrol box 561 via thewireless transceiver 551aandantenna 552aover the air communication, to be received in theantenna 552bandwireless transceiver 551b.Hence, no cable is required between thedisplay 18 and thecontrol box 561, thus avoiding the inconvenience associated with such cord. Various types ofantennas - Any short-range wireless communication based on free-air propagation can be used for communication between the
camera 16 and thecontrol box 553 insystem 550, or between thecontrol box 561 and thedisplay 18 insystem 560. According to one embodiment of the invention, a WLAN communication link is used to interconnect two or more isolated (W)PAN (Wireless Personal Area Network) systems. The reach of a PAN is typically a few meters, hence such networks are confined to a limited space, such as in-room communication. IEEE 802.15 is the working group of the IEEE 802, which specializes in Wireless PAN (WPAN) standards. Non-limiting examples of WPAN systems include: - a. Bluetooth, which according to IEEE 802.15.1 standard, for example, operates over license-free ISM band at 2.45 GHz. An ad-hoc network of computing devices using Bluetooth technology protocols is known as piconet.
- b. Ultra-Wide-band (UWB), which according to the IEEE 802.15.3 standard, for example, uses a wavelet (sometimes referred to as wireless USB). UWB or impulse radio transmitters emit short pulses approaching a Gaussian monocycle with tightly controlled pulse-to-pulse intervals.
- c. ZigBee, which according to IEEE 802.15.4 standard, for example, offers low data rate and low power consumption.
- d. IEEE 802.11a, commonly considered as WLAN (Wireless Local Area Network), but since it works in 5 GHz spectrum its reach is considerably limited, thus IEEE802.11a may also be considered as WPAN.
- In addition to above technologies, proprietary networking schemes may also be used for interconnecting the units. Further, the
system 553 can make use of WLAN technologies. Currently widespread WLAN technologies (e.g. WiFi) are based on IEEE 802.11 and include IEEE 802.11b, which describes a communication using the 2.4 GHz frequency band and supporting a communication rate of 11 Mb/s, IEEE 802.11a uses the 5 GHz frequency band to carry 54 MB/s and IEEE 802.11g uses the 2.4 GHz band to support 54 Mb/s. Other technologies based on WPAN, WLAN, WMAN, WAN, BWA, LMDS, MMDS, WiMAX, HIPERMAN, IEEE802.16, Bluetooth, IEE802.15, UWB, ZigBee, cellular, IEEE802.11 standards, GSM, GPRS, 2.5G, 3G, UMTS, DCS, PCS and CDMA may be equally used. Wireless and wired technologies used for home networking can equally be used. - The Institute of Electrical and Electronic Engineers (IEEE) 802.11 standard group, branded as WiFi by the Wi-Fi Alliance of Austin, Texas, USA. IEEE 802.11b describes a communication using the 2.4 GHz frequency band and supporting communication rate of 11 Mb/s, IEEE 802.11a uses the 5 GHz frequency band to carry 54 MB/s and IEEE 802.11g uses the 2.4 GHz band to support 54 Mb/s. This is described in an Intel White Paper entitled “54 Mbps IEEE 802.11 Wireless LAN at 2.4 GHz”, and a chip-set is described in an Agere Systems White Paper entitled “802.11 Wireless Chip Set Technology White Paper”, both of these documents being incorporated herein by reference. Such a 802.11 supporting transceiver block551aand551bmay be implemented using WaveLAN™ WL60040 Multimode Wireless LAN media Access Controller (MAC) from Agere Systems of Allentown, Pa. U.S.A., whose a product brief is incorporated herein by reference, which is part of a full chip-set as described in WaveLAN™ 802.11a/b/g Chip Set document from Agere Systems of Allentown, Pa. U.S.A., which is incorporated herein by reference. Reference is made to the manufacturer's data sheet Agere Systems, WaveLAN™ WL60040 Multimode Wireless LAN Media Access Controller (MAC), Product Brief August 2003 PB03-164WLAN, which is incorporated herein by reference.
- Some wireless technologies, in particular microwave signals used in the WAN and MAN arenas, are using frequencies above 2-3 GHz where the radio path is not reflected or refracted to any great extent. Propagation in such frequencies requires a Line-of-Sight (LOS) relying on a line of sight between the transmitting antenna and the receiving antenna. Using this concept allows for NLOS (Non-LOS) wireless networks to interconnect over a LOS-based communication link. In addition, the wireless technology implemented may use either licensed frequency bands or unlicensed frequency bands, such as the frequency bands utilized in the industrial, scientific and Medical (ISM) frequency spectrum. In the US, three of the bands within the ISM spectrum are the A band, 902-928 MHz; the B band, 2.4-2.484 GHz (referred to as 2.4 GHz); and the C band, 5.725-5.875 GHz (referred to as 5 GHz). Overlapping and/or similar bands are used in different regions such as Europe and Japan. Further, cellular technologies can also be used, commonly using licensed spectrum. Such digital technologies include GSM (Global System for Mobile Communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), EDGE (Enhanced Data Rates for GSM Evolution), 3GSM, DECT (Digital Enhanced Cordless Telecommunications), Digital AMPS (per IS-136/TDMA, for example) and iDEN (Integrated Digital Enhanced Network). The service carried over the cellular network may be voice, video or digital data such as the recently introduced EVDO (Evolution Data Only). In one embodiment, a WirelessHD standard based wireless communication is employed, which is based on the 7 GHz of continuous bandwidth around the 60 GHz radio frequency and allows for uncompressed, digital transmission.
- Digital cameras utilizing wireless communication are disclosed in U.S. Pat. No. 6,535,243 to Tullis entitled: “Wireless Hand-Held Digital Camera”, U.S. Pat. No. 6,552,743 to Rissman entitled: “Digital Camera-Ready Printer”, U.S. Pat. No. 6,788,332 to Cook entitled: “Wireless Imaging Device and System”, and in U.S. Pat. No. 5,666,159 to Parulski et al. entitled: “Electronic camera system with programmable transmission capability”, which are all incorporated in their entirety for all purposes as if fully set forth herein. A display system and method utilizing a cellular telephone having digital camera capability and a television linked directly over a UWB wireless signal is disclosed in U.S. Pat. No. 7,327,385 to Yamaguchi entitled: “Home Picture/Video Display System with Ultra Wide-Band Technology”, which is incorporated in its entirety for all purposes as if fully set forth herein.
- As described above, communication based on electromagnetic waves in various parts of the electromagnetic spectrum can be used for communication. For example, low-frequency electromagnetic radiation can be used to transmit audio-frequency signals over short distances without a carrier. Radio-frequency transmission is a special case of this general electromagnetic transmission. As noted previously, light is also a special case of electromagnetic radiation, but is herein treated separately because of the characteristics of light are distinctly different from those of electromagnetic transmission in other usable parts of the electromagnetic spectrum.
- Non-wired communication accomplished by light, either visible or non-visible light wavelength, can be used for the above transmission. The most popular is infrared (IR) based communication, but ultraviolet may also be used. Most such systems require substantially ‘line-of-sight’ access. In such a system, the
antenna 552brelating to thecamera 16 is replaced with light emitter (e.g. LEDs), and theantenna 552arelating thecontrol box 553 will be replaced with light detectors (e.g. photoelectric cell), and the communication over the air relies on the propagation of light. - Similarly, sound-based communication over space may be used, wherein the
transceivers antennas - While the invention has been exampled above with regard to a
camera 16 mechanically attached to display18, it will be appreciated that the invention equally applies to the case wherein there is no such mechanical attachment. For example, thecamera 16 may be in a different room from thedisplay 18, but still uses the face detection or hand gesture detection to control thedisplay 18 located in the other room. - While the invention has been exampled above with regard to controlling a display18 (either the
display 18 positioning, power supplying to thedisplay 18 or any other control), it will be appreciated that the invention equally applies to any other visualization device to be controlled. Examples are television set, video projector, rear-projection TV. Further, audio devices may as well be controlled, such as speakers. Further, any type of a device may be equally used according to the invention. - While the invention has been exampled above with regard to capturing, transmitting and processing a visible image, it is apparent that a non-visible spectrum can be equally used, such as infrared and ultraviolet. In such a configuration, the infrared image is captured, and then processed by the
image processor 12. In such a system, thesensor 72 inFIG. 7 is sensitive to the non-visible part of the light spectrum (e.g. infrared). - In another embodiment of a non-conductive network medium, a fiber optic cable is used. In such a case,
transceivers antennas - Powerline communication is known in the art for using the AC power wires in a building for digital data communication. Traditional approaches to powerline communication (e.g., home or office) include applications such as control of lighting and appliances, as well as sending data or broadband data, video or audio. Powerline command communication systems include for example X-10, CEBus (Consumer Electronics Bus per EIA-600 standard), and LonWorks.
- The HomePlug organization is an industry trade group for powerline communication including various entities to define powerline communication specifications. HomePlug 1.0 is a specification for a home networking technology that connects devices to each other through power lines in a home. HomePlug certified products connect PCs and other devices that use Ethernet, USE, and 802.11. Many devices made by alliance members have HomePlug built in and connect to a network upon plugging the device into a wall socket in a home with other HomePlug devices. Signal interference, from surge protectors, extension cords, outlet strips and/or other proximately located devices, including the high-frequency signals, is an on-going concern of the HomePlug alliance. Similarly, HomePlug AV (HPAV) is a new generation of technology from the HomePlug Powerline Alliance. HPAV can be for example embedded in consumer electronics or computing products, and provides high-quality, multi-stream, entertainment-oriented networking over existing AC wiring. Users can avoid having to install new wires in their premises by using devices having built-in HomePlug technology. HPAV uses advanced PHY and MAC technologies that provide a 200 Mbps (million bits per second) class powerline network for inter alia video, audio and data. The Physical (PHY) Layer utilizes this 200 Mbps channel rate to provide a 150 Mbps information rate to provide communications over noisy power line channels. As used herein, the terms “powerline” and “powerline communications” refer to any technology that is used to transfer data or signals over a power distribution system, including without limitation UPB, HomePlug, HomePlug a/v, and X-10 technologies. As used herein, the term “UPB” or Universal Powerline Bus refers to one exemplary instance of technologies which impose digital or analog signals or pulses onto AC waveforms or DC power delivery systems, such as for example the well known UPB approach set forth in “Universal Powerline Bus: The UPB System Description”, Version 1.1 dated Sep. 19, 2003, incorporated herein by reference in its entirety. Lastly, the term “HomePlug” as used herein is meant specifically to include devices and systems compliant with the HomePlug™ Powerline Alliance Specification for powerline-based home networks (including the more recent HomePlug A/V), and generally to include all other comparable devices adapted for powerline networking.
- In one embodiment according to the invention, powerline communication is used for the interconnection between the
camera 16 and thecontrol box 11, such as HomePlug based communication. One advantage in such a configuration is that only a single power cable is used, carrying both the AC power and the communication signal. Such acamera 591 is shown inFIG. 59 adapted from camera block diagram shown inFIG. 7 . Alow pass filter 572bis disposed between theAC power plug 21 and thepower supply 78, for passing only the AC power signal, such as the 50 Hz or the 60 Hz. Such alow pass filter 572balso stops and exhibits high impedance in the digital data frequency band, thus reducing impedance loading at this frequency band.Transceiver 75 ofFIG. 7 is replaced with apowerline modem 574b, connected to the AC power wires via ahigh pass filter 573b,which passes only the digital data frequency band, hence allowing only the digital data signal to pass, while stopping the AC power. If HomePlug technology is used, the modern is a HomePlug compliant modem, and the communication (physical layer and higher protocol layers) is implemented according to the HomePlug specification standard. As an example, such modem can be based on INT6000 ‘HomePlug AV High-Speed Powerline Solution’ available from Intellon Corporation, headquartered in Orlando, Fla., U.S.A. - Similarly,
control box 571, shown inFIG. 57 as part ofsystem 570, is also adapted to support powerline communication, in order to communicate with amating camera 591 ofFIG. 59 .Low pass filter 572ais added between theAC power plug 21 and thepower supply 19. Apowerline modem 574ais added, connected to theAC power wires 22 viahigh pass filter 573a, which passes only the digital data frequency band, hence allowing only the digital data signal to pass, while stopping the AC power. If HomePlug technology is used, the modem is a HomePlug compliant modem, and the communication (physical layer and higher protocol layers) is implemented according to the HomePlug specification standard. - Similarly, the communication of a control information between the control box and the display is also adapted to support powerline communication, as shown as
system 600 inFIG. 60 , adapted fromsystem 420 inFIG. 42 . Thecontrol box 601, shown inFIG. 60 as part ofsystem 600, is also adapted to support powerline communication, in order to communicate with amating display 18.Low pass filter 572ais added between the AC power plug21aand thepower supply 19. Apowerline modem 574ais added, connected to theAC power wires 22aviahigh pass filter 573a,which passes only the digital data frequency band, hence allowing only the digital data signal to pass, while stopping the AC power. Similarly in thedisplay 18 side,low pass filter 572bis added between theAC power plug 21band the power supply connection of thedisplay 18. Apowerline modem 574bis added, connected to theAC power wires 22bviahigh pass filter 573b,which passes only the digital data frequency band, hence allowing only the digital data signal to pass, while stopping the AC power. If HomePlug technology is used, themodems - In one embodiment, a
wired medium 26 is connected between thecamera 16 and theimage processor 12. The wired medium is a wired communication medium, connected to via a connector. Such wired medium may be a UTP, STP, coaxial cable, a telephone wire pair, a CATV coaxial cable, AC power wire pair and LAN cable, such as Category 5 or Category 6. A suitable connector may be used for connecting to the specific type of the wired medium, such as a coaxial connector for connecting to a coaxial cable and a telephone connector for connecting to a telephone wire pair. The wired medium may be a single non-used twisted-pair in a LAN cable, or two such pairs connected in parallel. In another aspect of the present invention, the wired medium is using a phantom channel formed between two wire pairs, such as two twisted wire pairs in a LAN cable used in Ethernet 10BaseT, 100BaseTX or 1000BaseT. Similarly, any PAN, LAN, MAN or WAN wiring may be used as the wired medium. - In the case of wired medium connecting between the camera and the image processor (or between the control box and the controlled unit), a wired transceiver is adapter to be a wired modem or a wired transceiver is used, suitable for transmitting and receiving over the appropriate wiring used. The communication over such cable can be proprietary or preferably using an industry standard communication, wherein the connections of the camera and of the control box to the cable (as well as the connection from the control box to the display) are based on standard connectors and interfaces. The communication may be based on a parallel scheme, wherein multiple wires are used to concurrently carry the digital data, thus allowing a higher transfer rate of the information. In an alternative embodiment, serial communication is used, allowing for few conductors to be used and smaller footprint connectors requiring the usage of less pins and contacts. Various standard PAN (Personal Area Network), WAN (Wide Area Network) and LAN (Local Area Network) protocols can be used. hi one embodiment, standard LAN (Local Area Network) is used, such as Ethernet IEEE802.3 10BaseT, 100Base TX or 1000BaseT. In such a case the transceiver34 is Ethernet PHY (i.e. Ethernet physical layer or Ethernet transceiver) that can be implemented based on “
LAN83C180 10/100 Fast Ethernet PHY Transceiver” or “LAN91C111 10/100 Non-PCI Ethernet Single Chip MAC +PHY” available from SMSC—Standard Microsystems Corporation of Hauppauge, N.Y. U.S.A. While this function can be implemented by using a single dedicated component, in many embodiments this function is integrated into a single component including other functions, such as handling higher layers. The transceiver may also contains isolation magnetic components (e.g. transformer-based), balancing components, surge protection hardware, and a LAN connector (commonly RJ-45) required for providing a proper and standard interface via a connector. In one embodiment, standard cabling is used, such as standard LAN cabling. For example, Category 5 cabling (‘structured wiring’) or any other wiring according to EIT/TIA-568 and EIA/TIA-570 can be used. Such LAN cabling involves wire pairs that may be UTP or STP. Similarly,category Ethernet 10/100BaseT described above, being proprietary or standard, packet or synchronous, serial or parallel, may be equally used, such as IEEE1394, USB (Universal Serial Bus), EIA/TIA-232, PCI (Peripheral Component Interconnect), PCMCIA (Personal Computer Memory Card international Association), or IEEE1284, but not limited to the aforementioned. Furthermore, multiple such interfaces (being of the same type or mixed) may also be used. - In the cases wherein a conductive medium, such as a dedicated cable, is used as the communication medium between the camera and the control box, it may be preferred to use the same cable to concurrently carry power between the camera and the control, thus obviating the need for two cables, one for providing power and one for communication purposes. hi one embodiment, the control box is adapted to drive power to the cable for powering the camera. In alternate embodiment, the camera is adapted to drive power to the cable for powering the control box. Such power can be used only for powering the camera module and related functionalities, or for fully powering the control box.
- In an alternative embodiment, the power and communication signals are carried over the wires in the cable using Frequency Division Multiplexing (FDM, a.k.a. Frequency Domain Multiplexing). In such implementation, the power and the communications signals are carried each in its frequency band (or a single frequency) distinct from each other. For example, the power signal can be a DC (Direct Current) power (effectively 0 Hz), while the communication signal is carried over the 100 Hz-10 MHz (or 4-30 MHz) frequency band, which is distinct and above the DC power frequency. In one example, a relatively high voltage such as a 120 VDC can be used in order to compensate for the wiring resistance caused voltage drops. In some installations, safety standards such as UL/IEC 60950 and EN60950 may limit the voltage level in many applications to 60 VDC. A telephony common 48 VDC voltage level may also be used.
- Another technique for carrying power and data signals over the same conductors is known as Power over Ethernet (PoE) (i.e., Power over LAN—PoL) and standardized under IEEE802.3af and IEEE802.3at, also explained in U.S. Pat. No. 6,473,609 to Lehr et al. titled: “Structure Cabling System”, which describes a method to carry power over LAN wiring, using the spare pairs and the phantom mechanism. The latter makes use of center-tap transformers. The powering scheme described above may use this standard as well as using non-standard proprietary powering schemes. In one example, USB (Universal Serial Bus) connection is used for both power and digital data.
- The above various states may be each represented by a single dedicated single-state indicator. However, in order to reduce complexity, known techniques are commonly used in order to combine signals. Such techniques may use different colors (of the same indicator), different intensity levels, variable duty-cycle and so forth. While visual indicators have been described, other indicating methods may be used such as audible tones (as stand alone or combined with visual).
- All publications, patents, and patent applications cited in this specifications are herein incorporated by reference as if each individual publication, patent, or patent application were specifically and individually indicated to be incorporated by reference and set forth in its entirety herein.
- Those of skill in the art will understand that the various illustrative logical blocks, modules and circuits described in connection with the embodiments disclosed herein may be implemented in any number of ways including electronic hardware, computer software, or combinations of both. The various illustrative components, blocks, modules and circuits have been described generally in terms of their functionality. Whether the functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans recognize the interchangeability of hardware and software under these circumstances, and how best to implement the described functionality for each particular application.
- Although exemplary embodiments of the present invention have been described, this should not be construed to limit the scope of the appended claims. Those skilled in the art will understand that modifications may be made to the described embodiments. Moreover, to those skilled in the various arts, the invention itself herein will suggest solutions to other tasks and adaptations for other applications. It is therefore desired that the present embodiments be considered in all respects as illustrative and not restrictive, reference being made to the appended claims rather than the foregoing description to indicate the scope of the invention.
- It will be appreciated that the aforementioned features and advantages are presented solely by way of example. Accordingly, the foregoing should not be construed or interpreted to constitute, in any way, an exhaustive enumeration of features and advantages of embodiments of the present invention.
- The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes that come within the meaning and range of equivalency of the claims are to be embraced within their scope.
Claims (97)
1. A computer implemented method for improving the angular field of view for a person watching an image on a screen, the method comprising:
(a) capturing an image of a scene in front of the screen;
(b) converting the image into a digital data form;
(c) detecting the position of an image of a human face in the captured image;
(d) calculating at least one deviation between the detected position of the human face image in the captured image and an imaginary line that passes through the center of the image on the screen and extends substantially perpendicular to the screen; and
(e) rotating the screen in a direction to reduce the calculated deviation.
2. The method according toclaim 1 , further comprising repeatedly performing steps (a) to (e) until the calculated deviation is smaller than a predefined value.
3. The method according toclaim 1 , wherein steps (a) to (e) are executed repeatedly to form a linear feedback control loop, wherein the calculated deviation serves as a control loop error, the control loop has a set point equal to zero, and the rotation of the display is controlled by the loop.
4. The method according toclaim 3 , wherein said method defines a linear proportional control loop, wherein the amount of rotation of the screen is proportional to the calculated deviation.
5. The method according toclaim 3 , wherein said method defines a PID (Proportional, Integral and Derivative) control loop, the amount of rotation of the screen is calculated based on proportional, integral and derivative computations of the calculated deviation.
6. The method according toclaim 1 , wherein: the deviation is horizontal, the deviation is calculated in the captured image, and the rotation of the display is in the horizontal direction.
7. The method according toclaim 1 , wherein the deviation is vertical, the deviation is calculated in the captured image, and the rotation of the display is in the vertical direction.
8. The method according toclaim 1 , wherein the at least one deviation includes a horizontal deviation and a vertical deviation, the horizontal and vertical deviations are calculated in the captured image, and said rotation of the display includes rotating in the horizontal direction in response to the horizontal deviation and rotating in the vertical direction in response to the vertical deviation.
9. The method according to claim.1, wherein if no human face image is detected is step (c), no rotation is performed.
10. The method according toclaim 1 , wherein if two or more human faces are detected in the captured image, then the average of the positions of the detected faces is calculated, and in step (d) the deviation is calculated between the average and the image center.
11. An apparatus for improving the angular field of view for a person watching a display on a screen, said apparatus comprising:
a digital camera for capturing an image in digital data form, said camera being fixed in position relative to the screen and oriented to capture an image of the scene substantially in front of the screen;
an image processor coupled to receive the image in digital data form from said digital camera, for applying face detection algorithm to detect and locate an image of a human face in the captured image; and
a motor mechanically attached to the screen for angularly rotating the screen;
wherein said apparatus is operative to rotate said motor in response to the location of the detected image of a face in the captured image.
12. The apparatus according toclaim 11 , further comprising firmware or software and a controller to execute said firmware or software coupled between said digital camera and said motor for controlling rotation of the screen in response to the location of the detected image of a face in the captured image.
13. The apparatus according toclaim 11 , wherein said motor is a stepper motor.
14. The apparatus according toclaim 11 , further operative to calculate the deviation between the detected face image location and the image center, and wherein the angular rotation of the screen is based on the calculated deviation.
15. The apparatus according toclaim 14 , wherein no motor rotation is executed when the calculated deviation is smaller than a predefined value.
16. The apparatus according toclaim 14 , wherein said apparatus is operative to continuously rotate said motor in response to the location of the detected face image in the captured image in a linear feedback control loop, wherein the error used by the control loop is the calculated deviation, the set point of the control loop is zero and the angular rotation of the screen is the actuator controlled by the loop.
17. The apparatus according toclaim 16 , wherein the control loop is a linear proportional control loop, and the amount of angular rotation of the screen is proportional to the calculated deviation.
18. The apparatus according toclaim 16 , wherein the control loop is a PID (Proportional, Integral and Derivative) control loop, and the amount of angular rotation is calculated based on proportional, integral and derivative computations of the calculated deviation.
19. The apparatus according toclaim 16 , wherein the deviation is horizontal and is calculated in the captured image, and said motor is attached to effect rotation of the screen in a horizontal plane.
20. The apparatus according toclaim 19 , further comprising a second motor attached to effect rotation of the screen in a vertical plane, wherein a vertical deviation is calculated in the captured image, and wherein said second motor is attached to effect screen rotation in the vertical plane in response to the calculated vertical deviation.
21. The apparatus according toclaim 16 , wherein the deviation is vertical and is calculated in the captured image, and said motor is attached to effect rotation of the screen in the vertical plane.
22. The apparatus according toclaim 11 , wherein if no human face is detected by the image processor, no motor rotation is executed.
23. The apparatus according toclaim 14 , wherein if two or more human faces are detected in the captured image, then said image processor calculates the average of the positions of the detected face images and the deviation between that average and the image center.
24. A computer implemented method for controlling a device based on face detection, the method comprising the steps of
(a) capturing an image of a scene;
(b) converting the image into a digital data form;
(c) detecting an image of a human face in the captured image; and
(d) providing a first control signal associated with the detection of the human face image in the captured image.
25. The method according toclaim 24 , further comprising performing steps (a) to (d) repeatedly.
26. The method according toclaim 25 , further comprising waiting a pre-set period before repeating the steps (a) to (d).
27. The method according toclaim 24 , wherein step (d) comprises supplying power to the device is response to the detection of a human face image in the captured image.
28. The method according toclaim 24 , wherein step (d) comprises disconnecting power to the device is response to not detecting a human face image in the captured image.
29. The method according toclaim 24 , wherein said device comprises a display screen.
30. The method according toclaim 29 , wherein the image captured is of a scene substantially in front of the display screen.
31. The method according toclaim 29 , wherein in step (d) the display screen is blanked in response to not detecting a human face in said captured image.
32. The method according toclaim 24 , wherein in step (d) the control signal is generated in response to detecting a human face image in the captured image over a pre-defined period.
33. The method according toclaim 24 , wherein in step (d) the control signal is generated in response to not detecting a human face in said captured image over a pre-defined period.
34. The method according toclaim 24 , wherein the first control signal is generated in response to detecting a human face image in the captured image over a first pre-defined period, and said method further comprises generating a second control signal in response to not detecting a human face image in the captured image over a second pre-defined period.
35. The method according toclaim 34 , wherein the first control signal is operative to supply power to at least part of the device, and the second control signal is operative to disconnect power to at least part of the device.
36. The method according toclaim 35 , wherein the first control signal is operative to supply power to a selected part of the device, and the second control signal is operative to disconnect power to the selected part of the device.
37. An apparatus for face detection based control of a device, said apparatus comprising:
a digital camera for capturing an image in a digital data form;
an image processor coupled to receive the image in a digital data form from said digital camera, for applying a face detection algorithm to detect the position of a human face image in the captured image; and
a controller coupled to said image processor for generating a control signal in response to the detection or non-detection of a human face image in the captured image.
38. The apparatus according toclaim 37 , further comprising firmware or software executed by said controller.
39. The apparatus according toclaim 37 , wherein said camera is mechanically fixed to the device.
40. The apparatus according toclaim 37 , wherein said camera, said image processor and said controller are housed within a single enclosure.
41. The apparatus according toclaim 37 , further comprising a switch connected to be actuated by the control signal.
42. The apparatus according toclaim 41 , wherein said switch is connected between a power source and the device, for powering the device in response to the control signal.
43. The apparatus according toclaim 42 , operative to actuate said switch and to supply power to the device is response to the detection of a human face image in the captured image.
44. The apparatus according toclaim 42 , operative to actuate said switch and for supplying power to the device is response to not detecting a human face in said captured image.
45. The apparatus according toclaim 41 , wherein said camera, said image processor, said controller and said switch are housed within a single enclosure.
46. The apparatus according toclaim 37 , further comprising a first timer for signaling a pre-set first time period, said first timer being operatively associated with said controller to cause the control signal to be generated after elapse of the first time period following detecting a human face in said captured image for a first pre-defined period.
47. The apparatus according toclaim 46 , further comprising a second timer for signaling a pre-set second time period, said second timer being operatively associated with said controller to cause said controller to generate a second control signal in response to not detecting a human face image in the captured image for the second time period.
48. The apparatus according toclaim 47 , wherein the first-recited control signal is effective to initiate supplying of power to the device, and the second control signal is effective to disconnect power from the device.
49. The method according toclaim 48 wherein the first-recited control signal is effective to initiate supplying of power to part of the device, and the second control signal is effective to disconnect power from the part of the device.
50. The apparatus according toclaim 37 , further comprising a first timer for signaling a pre-set first period coupled or within said controller, and the control signal is generated in response to not detecting a human face in said captured image for the first pre-defined period.
51. The apparatus according toclaim 37 , wherein said device is a display or a television set.
52. The apparatus according toclaim 37 , wherein the device has a display screen and said camera is positioned such that the image captured is substantially in front of the display screen.
53. The apparatus according toclaim 37 , wherein the device has a display, and said apparatus further comprises a timer associated with said controller for signaling a pre-set time period, and said controller is operative to blank the display in response to not detecting a human face image in the captured image.
54. A computer implemented method for controlling a device based on hand gesture detection, said method comprising:
(a) capturing an image with a camera;
(b) electronically converting the image into a digital data form;
(c) detecting a hand gesture image in said captured image by use of a computer running a detecting algorithm; and
(d) producing a control signal in response to the detection of a hand gesture image in the captured image.
55. The method according toclaim 54 , further comprising repeating steps (a) to (d).
56. The method according toclaim 55 , further comprising waiting a pre-set time period before repeating steps (a) to (d).
57. The method according toclaim 54 , wherein step (d) comprises supplying power to the device is response to the detection of a hand gesture image in the captured image.
58. . The method according toclaim 54 , wherein step (d) comprises disconnecting power to the device in response to detecting a hand gesture face in the captured image.
59. The method according toclaim 54 , wherein the device is a display or a television set.
60. The method according toclaim 54 , wherein the device has a display screen, and the image captured is substantially of a scene facing the display screen.
61. The method according toclaim 60 , wherein in step (d) the display screen is blanked in response to not detecting a hand gesture image in the captured image.
62. The method according toclaim 54 , wherein in step (d) the control signal is generated in response to detecting a hand gesture image in the captured image for a pre-defined time period.
63. The method according toclaim 62 , further comprising producing a second control signal in response to not detecting a hand gesture image in the captured image for a second pre-defined time period.
64. The method according toclaim 63 wherein the first-recited control signal is effective to initiate supplying of power to the device, and the second control signal is effective to disconnect power from the device.
65. The method according toclaim 64 wherein the first-recited control signal is effective to initiate supplying of power to part of the device, and the second control signal is effective to disconnect power from the part of the device.
66. The method according toclaim 54 , wherein the detected hand gesture includes extending a single finger.
67. The method according toclaim 54 , wherein the detected hand gesture includes extending multiple fingers.
68. The method according toclaim 54 , wherein the detected hand gesture includes extending all fingers of a hand.
69. The method according toclaim 54 , wherein only a single pre-defined hand gesture can be detected.
70. The method according toclaim 54 , the detected hand gesture is any one of a plurality of pre-defined hand gestures.
71. The method according toclaim 70 , further comprising associating a respective dedicated control with each detected hand gesture.
72. The method according toclaim 54 , further comprising using an image processing algorithm to detect a human face image in the captured image.
73. The method according toclaim 72 , wherein the control signal is produced only in response to the detection of the hand gesture image and detection of a human face image in the captured image.
74. An apparatus for hand gesture detection based control of a device, said apparatus comprising:
a digital camera for capturing an image in a digital data form;
an image processor coupled to receive said image in a digital data form from said digital camera, for running a hand gesture detection algorithm to detect a hand gesture image in the captured image; and
a controller coupled to said image processor for generating a control signal in response to the detection or non-detection of a hand gesture image in the captured image.
75. The apparatus according toclaim 74 , further comprising firmware or software to be executed by said controller.
76. The apparatus according toclaim 74 , wherein said camera is mechanically fixed to the device.
77. The apparatus according toclaim 74 , wherein said camera, said image processor and said controller are housed within a single enclosure.
78. The apparatus according toclaim 74 , further comprising a switch coupled to be actuated by the control signal.
79. The apparatus according toclaim 78 , wherein said switch is connected between a power source and the device, for powering the device in response to the control signal.
80. The apparatus according toclaim 79 , operative to actuate said switch and to supply power to the device in response to the detection of a hand gesture image in the captured image.
81. The apparatus according toclaim 78 , wherein said camera, said image processor, said controller and said switch are housed within a single enclosure.
82. The apparatus according toclaim 74 , further comprising a first timer associated with said controller for signaling a pre-set first time period, and wherein the control signal is generated in response to detecting a hand gesture image in the captured image for the first pre-defined time period.
83. The apparatus according toclaim 74 , further comprising a first timer for signaling a pre-set first period coupled or within said controller, and the control signal is generated in response to not detecting a hand gesture in said captured image for a first pre-defined period.
84. The apparatus according toclaim 82 , further comprising a second timer associated with said controller for signaling a pre-set second time period, wherein the first-recited control signal is generated in response to not detecting a hand gesture image in the captured image for a first pre-defined time period, and a second control signal is generated in response to detecting a hand gesture image in the captured image for a second pre-defined time period.
85. The apparatus according toclaim 84 , wherein the second control signal is effective to supply power to at least part of the device, and the first control signal involves disconnecting power to at least part of the device.
86. The method according toclaim 84 wherein said second control signal is effective to supply power to part of the device, and the first control signal is effective to disconnect power from the part of the device.
87. The apparatus according toclaim 74 , wherein the device is a display or a television set.
88. The apparatus according toclaim 74 , wherein the device has a display screen, and said camera is positioned such that the image captured by said camera is of a scene substantially facing the display screen.
89. The apparatus according toclaim 88 , further comprising a timer associated with said controller for signaling a pre-set time period, and the display screen is blanked in response to not detecting a hand gesture image in the captured image.
90. The apparatus according toclaim 74 , wherein the hand gesture includes extending a single finger.
91. The apparatus according toclaim 74 , wherein the hand gesture includes extending of multiple fingers.
92. The apparatus according toclaim 74 , wherein the hand gesture includes extending all fingers of one hand.
93. The apparatus according toclaim 74 , wherein only a single pre-defined hand gesture can be detected.
94. The apparatus according toclaim 74 , wherein multiple pre-defined hand gestures can be detected.
95. The apparatus according toclaim 94 , wherein a respective, dedicated control is associated with each detected hand gesture.
96. The apparatus according toclaim 74 , further comprising a non-transitory computer readable medium storing an image processing algorithm for detecting a human face image in the captured image.
97. The apparatus according toclaim 96 , wherein the control signal is provided only in response to the detection of the hand gesture image and the human face image in the captured image.
Priority Applications (12)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/724,896US20100295782A1 (en) | 2009-05-21 | 2010-03-16 | System and method for control based on face ore hand gesture detection |
| US13/483,434US8614673B2 (en) | 2009-05-21 | 2012-05-30 | System and method for control based on face or hand gesture detection |
| US13/526,053US8614674B2 (en) | 2009-05-21 | 2012-06-18 | System and method for control based on face or hand gesture detection |
| US13/658,080US20130044198A1 (en) | 2009-05-21 | 2012-10-23 | System and method for control based on face or hand gesture detection |
| US13/864,581US20130235179A1 (en) | 2009-05-21 | 2013-04-17 | System and method for control based on face or hand gesture detection |
| US13/903,569US10582144B2 (en) | 2009-05-21 | 2013-05-28 | System and method for control based on face or hand gesture detection |
| US15/001,422US20160134834A1 (en) | 2009-05-21 | 2016-01-20 | System and method for control based on face or hand gesture detection |
| US15/002,425US20160139663A1 (en) | 2009-05-21 | 2016-01-21 | System and method for control based on face or hand gesture detection |
| US15/213,876US20160330395A1 (en) | 2009-05-21 | 2016-07-19 | System and method for control based on face or hand gesture detection |
| US15/213,914US20160328605A1 (en) | 2009-05-21 | 2016-07-19 | System and method for control based on face or hand gesture detection |
| US15/213,964US20160330505A1 (en) | 2009-05-21 | 2016-07-19 | System and method for control based on face or hand gesture detection |
| US16/788,333US20200186740A1 (en) | 2009-05-21 | 2020-02-12 | System and method for control based on face or hand gesture detection |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US18023709P | 2009-05-21 | 2009-05-21 | |
| US12/724,896US20100295782A1 (en) | 2009-05-21 | 2010-03-16 | System and method for control based on face ore hand gesture detection |
Related Child Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US13/483,434DivisionUS8614673B2 (en) | 2009-05-21 | 2012-05-30 | System and method for control based on face or hand gesture detection |
| US13/526,053ContinuationUS8614674B2 (en) | 2009-05-21 | 2012-06-18 | System and method for control based on face or hand gesture detection |
| US13/658,080ContinuationUS20130044198A1 (en) | 2009-05-21 | 2012-10-23 | System and method for control based on face or hand gesture detection |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| US20100295782A1true US20100295782A1 (en) | 2010-11-25 |
Family
ID=42799706
Family Applications (12)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US12/724,896AbandonedUS20100295782A1 (en) | 2009-05-21 | 2010-03-16 | System and method for control based on face ore hand gesture detection |
| US13/483,434ActiveUS8614673B2 (en) | 2009-05-21 | 2012-05-30 | System and method for control based on face or hand gesture detection |
| US13/526,053Active2030-04-23US8614674B2 (en) | 2009-05-21 | 2012-06-18 | System and method for control based on face or hand gesture detection |
| US13/658,080AbandonedUS20130044198A1 (en) | 2009-05-21 | 2012-10-23 | System and method for control based on face or hand gesture detection |
| US13/864,581AbandonedUS20130235179A1 (en) | 2009-05-21 | 2013-04-17 | System and method for control based on face or hand gesture detection |
| US13/903,569Active2033-07-07US10582144B2 (en) | 2009-05-21 | 2013-05-28 | System and method for control based on face or hand gesture detection |
| US15/001,422AbandonedUS20160134834A1 (en) | 2009-05-21 | 2016-01-20 | System and method for control based on face or hand gesture detection |
| US15/002,425AbandonedUS20160139663A1 (en) | 2009-05-21 | 2016-01-21 | System and method for control based on face or hand gesture detection |
| US15/213,876AbandonedUS20160330395A1 (en) | 2009-05-21 | 2016-07-19 | System and method for control based on face or hand gesture detection |
| US15/213,914AbandonedUS20160328605A1 (en) | 2009-05-21 | 2016-07-19 | System and method for control based on face or hand gesture detection |
| US15/213,964AbandonedUS20160330505A1 (en) | 2009-05-21 | 2016-07-19 | System and method for control based on face or hand gesture detection |
| US16/788,333PendingUS20200186740A1 (en) | 2009-05-21 | 2020-02-12 | System and method for control based on face or hand gesture detection |
Family Applications After (11)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US13/483,434ActiveUS8614673B2 (en) | 2009-05-21 | 2012-05-30 | System and method for control based on face or hand gesture detection |
| US13/526,053Active2030-04-23US8614674B2 (en) | 2009-05-21 | 2012-06-18 | System and method for control based on face or hand gesture detection |
| US13/658,080AbandonedUS20130044198A1 (en) | 2009-05-21 | 2012-10-23 | System and method for control based on face or hand gesture detection |
| US13/864,581AbandonedUS20130235179A1 (en) | 2009-05-21 | 2013-04-17 | System and method for control based on face or hand gesture detection |
| US13/903,569Active2033-07-07US10582144B2 (en) | 2009-05-21 | 2013-05-28 | System and method for control based on face or hand gesture detection |
| US15/001,422AbandonedUS20160134834A1 (en) | 2009-05-21 | 2016-01-20 | System and method for control based on face or hand gesture detection |
| US15/002,425AbandonedUS20160139663A1 (en) | 2009-05-21 | 2016-01-21 | System and method for control based on face or hand gesture detection |
| US15/213,876AbandonedUS20160330395A1 (en) | 2009-05-21 | 2016-07-19 | System and method for control based on face or hand gesture detection |
| US15/213,914AbandonedUS20160328605A1 (en) | 2009-05-21 | 2016-07-19 | System and method for control based on face or hand gesture detection |
| US15/213,964AbandonedUS20160330505A1 (en) | 2009-05-21 | 2016-07-19 | System and method for control based on face or hand gesture detection |
| US16/788,333PendingUS20200186740A1 (en) | 2009-05-21 | 2020-02-12 | System and method for control based on face or hand gesture detection |
Country Status (3)
| Country | Link |
|---|---|
| US (12) | US20100295782A1 (en) |
| EP (1) | EP2433199A1 (en) |
| WO (1) | WO2010134066A1 (en) |
Cited By (68)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100228494A1 (en)* | 2009-03-05 | 2010-09-09 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Postural information system and method including determining subject advisory information based on prior determined subject advisory information |
| US20110238218A1 (en)* | 2010-03-26 | 2011-09-29 | Hon Hai Precision Industry Co., Ltd. | Mirror and adjustment method therefor |
| US20110261038A1 (en)* | 2010-04-26 | 2011-10-27 | Hon Hai Precision Industry Co., Ltd. | Electronic device and method of adjusting viewing angles of liquid crystal displays |
| US20110289455A1 (en)* | 2010-05-18 | 2011-11-24 | Microsoft Corporation | Gestures And Gesture Recognition For Manipulating A User-Interface |
| US20110298967A1 (en)* | 2010-06-04 | 2011-12-08 | Microsoft Corporation | Controlling Power Levels Of Electronic Devices Through User Interaction |
| US20120019657A1 (en)* | 2010-07-26 | 2012-01-26 | Hsun-Hsien Lee | Surveillance device and method |
| US20120026617A1 (en)* | 2010-07-30 | 2012-02-02 | Hon Hai Precision Industry Co., Ltd. | Mirror and adjustment method therefor |
| US20120044142A1 (en)* | 2010-08-19 | 2012-02-23 | TPV Electronics (Fujian) Co., Ltd. | Display having auto-off function by person infrared sensing |
| WO2012030265A1 (en)* | 2010-08-30 | 2012-03-08 | Telefonaktiebolaget L M Ericsson (Publ) | Face screen orientation and related devices and methods |
| US20120098748A1 (en)* | 2010-10-21 | 2012-04-26 | Hon Hai Precision Industry Co., Ltd. | Button assembly and computer mouse having the same |
| US20120229300A1 (en)* | 2011-03-11 | 2012-09-13 | Wistron Corporation | Holder Device Capable of Automatically Adjusting Orientation of an Electronic Device Placed Thereon, and Assembly of Holder Device and Electronic Device |
| US20120236180A1 (en)* | 2011-03-15 | 2012-09-20 | Zhao-Yuan Lin | Image adjustment method and electronics system using the same |
| WO2012077922A3 (en)* | 2010-12-06 | 2012-10-11 | Samsung Electronics Co., Ltd. | 3 dimensional (3d) display system of responding to user motion and user interface for the 3d display system |
| US20120313896A1 (en)* | 2011-06-07 | 2012-12-13 | Sony Corporation | Information processing apparatus, information processing method, and program |
| US20120320180A1 (en)* | 2008-12-30 | 2012-12-20 | May Patents Ltd. | Electric shaver with imaging capability |
| US8457353B2 (en) | 2010-05-18 | 2013-06-04 | Microsoft Corporation | Gestures and gesture modifiers for manipulating a user-interface |
| EP2587830A3 (en)* | 2011-10-07 | 2013-06-05 | Samsung Electronics Co., Ltd. | Display apparatus and display method thereof |
| US20130201345A1 (en)* | 2012-02-06 | 2013-08-08 | Huawei Technologies Co., Ltd. | Method and apparatus for controlling video device and video system |
| US20130229346A1 (en)* | 2012-03-05 | 2013-09-05 | E.G.O. Elektro-Geraetebau Gmbh | Method and apparatus for a camera module for operating gesture recognition and home appliance |
| CN103309438A (en)* | 2012-03-15 | 2013-09-18 | 欧姆龙株式会社 | Gesture input apparatus, control method thereof, electronic device and gesture input system |
| US20130250158A1 (en)* | 2012-03-23 | 2013-09-26 | Panasonic Corporation | Imaging device |
| WO2014004149A1 (en)* | 2012-06-28 | 2014-01-03 | Intel Corporation | System and method for adaptive data processing |
| WO2014065771A1 (en)* | 2012-10-22 | 2014-05-01 | Echostar Ukraine, L.L.C. | Alternate approach for controlling entertainment equipment |
| CN103885566A (en)* | 2014-03-07 | 2014-06-25 | 京东方科技集团股份有限公司 | Power supply control method of displaying device and displaying device |
| US20140240342A1 (en)* | 2013-02-26 | 2014-08-28 | Lenovo (Beijing) Limited | Display screen, electronic device and information processing method for the electronic device |
| US8837780B2 (en) | 2012-06-22 | 2014-09-16 | Hewlett-Packard Development Company, L.P. | Gesture based human interfaces |
| US20140313297A1 (en)* | 2010-04-16 | 2014-10-23 | Samsung Electronics Co., Ltd. | Display apparatus, 3d glasses, and display system including the same |
| US20140333671A1 (en)* | 2013-05-10 | 2014-11-13 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
| US8898687B2 (en) | 2012-04-04 | 2014-11-25 | Microsoft Corporation | Controlling a media program based on a media reaction |
| US20150035746A1 (en)* | 2011-12-27 | 2015-02-05 | Andy Cockburn | User Interface Device |
| US8959541B2 (en) | 2012-05-04 | 2015-02-17 | Microsoft Technology Licensing, Llc | Determining a future portion of a currently presented media program |
| US20150201124A1 (en)* | 2014-01-15 | 2015-07-16 | Samsung Electronics Co., Ltd. | Camera system and method for remotely controlling compositions of self-portrait pictures using hand gestures |
| US9100685B2 (en) | 2011-12-09 | 2015-08-04 | Microsoft Technology Licensing, Llc | Determining audience state or interest using passive sensor data |
| US20150278586A1 (en)* | 2014-03-28 | 2015-10-01 | Wipro Limited | System and method for guided continuous body tracking for complex interaction |
| US9154837B2 (en) | 2011-12-02 | 2015-10-06 | Microsoft Technology Licensing, Llc | User interface presenting an animated avatar performing a media reaction |
| US20160109961A1 (en)* | 2013-06-20 | 2016-04-21 | Uday Parshionikar | Systems, methods, apparatuses, computer readable medium for controlling electronic devices |
| US9342143B1 (en)* | 2012-04-17 | 2016-05-17 | Imdb.Com, Inc. | Determining display orientations for portable devices |
| US9372544B2 (en) | 2011-05-31 | 2016-06-21 | Microsoft Technology Licensing, Llc | Gesture recognition techniques |
| US9494683B1 (en)* | 2013-06-18 | 2016-11-15 | Amazon Technologies, Inc. | Audio-based gesture detection |
| US20160350589A1 (en)* | 2015-05-27 | 2016-12-01 | Hsien-Hsiang Chiu | Gesture Interface Robot |
| US9690403B2 (en) | 2013-03-15 | 2017-06-27 | Blackberry Limited | Shared document editing and voting using active stylus based touch-sensitive displays |
| US20170182406A1 (en)* | 2014-03-21 | 2017-06-29 | Audience Entertainment Llc | Adaptive group interactive motion control system and method for 2d and 3d video |
| WO2017164567A1 (en)* | 2016-03-24 | 2017-09-28 | Samsung Electronics Co., Ltd. | Intelligent electronic device and method of operating the same |
| US9940533B2 (en) | 2014-09-30 | 2018-04-10 | Qualcomm Incorporated | Scanning window for isolating pixel values in hardware for computer vision operations |
| US9986211B2 (en) | 2014-09-30 | 2018-05-29 | Qualcomm Incorporated | Low-power always-on face detection, tracking, recognition and/or analysis using events-based vision sensor |
| US10104122B2 (en)* | 2012-11-30 | 2018-10-16 | Intel Corporation | Verified sensor data processing |
| US10137363B2 (en)* | 2013-06-20 | 2018-11-27 | Uday Parshionikar | Gesture based user interfaces, apparatuses and control systems |
| US20180364810A1 (en)* | 2013-06-20 | 2018-12-20 | Uday Parshionikar | Gesture control via eye tracking, head tracking, facial expressions and other user actions |
| US20190138110A1 (en)* | 2013-02-01 | 2019-05-09 | Samsung Electronics Co., Ltd. | Method of controlling an operation of a camera apparatus and a camera apparatus |
| US10515284B2 (en)* | 2014-09-30 | 2019-12-24 | Qualcomm Incorporated | Single-processor computer vision hardware control and application execution |
| CN110913190A (en)* | 2019-12-02 | 2020-03-24 | 淄博职业学院 | A digital media playback device capable of human-computer interaction |
| US10614332B2 (en) | 2016-12-16 | 2020-04-07 | Qualcomm Incorportaed | Light source modulation for iris size adjustment |
| US10868867B2 (en) | 2012-01-09 | 2020-12-15 | May Patents Ltd. | System and method for server based control |
| US10884493B2 (en)* | 2013-06-20 | 2021-01-05 | Uday Parshionikar | Gesture based user interfaces, apparatuses and systems using eye tracking, head tracking, hand tracking, facial expressions and other user actions |
| US10984235B2 (en) | 2016-12-16 | 2021-04-20 | Qualcomm Incorporated | Low power data generation for iris-related detection and authentication |
| EP3813357A1 (en)* | 2019-10-21 | 2021-04-28 | Top Victory Investments Limited | Method and system for automatically switching off a display screen of a television device |
| US20210180740A1 (en)* | 2019-12-13 | 2021-06-17 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Display and audio systems and methods for controlling positioning of displays and speakers based on viewer and listener attention |
| US11068712B2 (en) | 2014-09-30 | 2021-07-20 | Qualcomm Incorporated | Low-power iris scan initialization |
| CN113508356A (en)* | 2020-01-24 | 2021-10-15 | 深圳市理邦精密仪器股份有限公司 | System and method for automatically adjusting display system using user tracking |
| WO2022021647A1 (en)* | 2020-07-30 | 2022-02-03 | 深圳创维－Rgb电子有限公司 | Smart television control method and apparatus, and rotatable television and readable storage medium |
| US11250544B2 (en)* | 2017-08-11 | 2022-02-15 | Samsung Electronics Co., Ltd. | Display device for visualizing contents as the display is rotated and control method thereof |
| US20220080845A1 (en)* | 2019-05-27 | 2022-03-17 | Abb Schweiz Ag | Electric vehicle supply equipment for charging an electrical vehicle |
| CN114265499A (en)* | 2021-12-17 | 2022-04-01 | 交控科技股份有限公司 | Interaction method and system applied to customer service terminal |
| TWI763769B (en)* | 2017-01-23 | 2022-05-11 | 美商高通公司 | Single-processor computer vision hardware control and application execution |
| CN115113553A (en)* | 2021-09-03 | 2022-09-27 | 博泰车联网科技(上海)股份有限公司 | Control method, control system and control device for vehicle-mounted video and audio playing |
| US20220375268A1 (en)* | 2020-02-28 | 2022-11-24 | Fujifilm Corporation | Gesture recognition device, operation method for gesture recognition device, and operation program for gesture recognition device |
| US11644928B2 (en)* | 2020-03-23 | 2023-05-09 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
| US20240295922A1 (en)* | 2014-06-20 | 2024-09-05 | Uday Parshionikar | Gesture based user interfaces, apparatuses and systems using eye tracking, head tracking, hand tracking, facial expressions and other user actions |
Families Citing this family (85)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5628144B2 (en)* | 2008-03-18 | 2014-11-19 | エリプティック・ラボラトリーズ・アクシェルスカブＥｌｌｉｐｔｉｃ Ｌａｂｏｒａｔｏｒｉｅｓ Ａｓ | Object and motion detection |
| JP5418093B2 (en) | 2009-09-11 | 2014-02-19 | ソニー株式会社 | Display device and control method |
| US20110317871A1 (en)* | 2010-06-29 | 2011-12-29 | Microsoft Corporation | Skeletal joint recognition and tracking system |
| TW201222429A (en)* | 2010-11-23 | 2012-06-01 | Inventec Corp | Web camera device and operating method thereof |
| DE102012202957B4 (en)* | 2012-02-27 | 2022-03-03 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | display device |
| US10444836B2 (en) | 2012-06-07 | 2019-10-15 | Nook Digital, Llc | Accessibility aids for users of electronic devices |
| US9854159B2 (en)* | 2012-07-20 | 2017-12-26 | Pixart Imaging Inc. | Image system with eye protection |
| US9658746B2 (en) | 2012-07-20 | 2017-05-23 | Nook Digital, Llc | Accessible reading mode techniques for electronic devices |
| US8890812B2 (en)* | 2012-10-25 | 2014-11-18 | Jds Uniphase Corporation | Graphical user interface adjusting to a change of user's disposition |
| US8761448B1 (en)* | 2012-12-13 | 2014-06-24 | Intel Corporation | Gesture pre-processing of video stream using a markered region |
| US9448719B2 (en) | 2012-12-14 | 2016-09-20 | Barnes & Noble College Booksellers, Llc | Touch sensitive device with pinch-based expand/collapse function |
| DE112013005975T5 (en)* | 2012-12-14 | 2015-08-20 | Visteon Global Technologies, Inc. | System and method for automatically aligning an angle of a three-dimensional display within a vehicle |
| US9477382B2 (en) | 2012-12-14 | 2016-10-25 | Barnes & Noble College Booksellers, Inc. | Multi-page content selection technique |
| US9030430B2 (en) | 2012-12-14 | 2015-05-12 | Barnesandnoble.Com Llc | Multi-touch navigation mode |
| US9134903B2 (en) | 2012-12-14 | 2015-09-15 | Barnes & Noble College Booksellers, Llc | Content selecting technique for touch screen UI |
| US9001064B2 (en) | 2012-12-14 | 2015-04-07 | Barnesandnoble.Com Llc | Touch sensitive device with pinch-based archive and restore functionality |
| US9134893B2 (en) | 2012-12-14 | 2015-09-15 | Barnes & Noble College Booksellers, Llc | Block-based content selecting technique for touch screen UI |
| US8963865B2 (en) | 2012-12-14 | 2015-02-24 | Barnesandnoble.Com Llc | Touch sensitive device with concentration mode |
| US9134892B2 (en) | 2012-12-14 | 2015-09-15 | Barnes & Noble College Booksellers, Llc | Drag-based content selection technique for touch screen UI |
| US8933882B2 (en)* | 2012-12-31 | 2015-01-13 | Intentive Inc. | User centric interface for interaction with visual display that recognizes user intentions |
| US9836154B2 (en) | 2013-01-24 | 2017-12-05 | Nook Digital, Llc | Selective touch scan area and reporting techniques |
| US9971495B2 (en) | 2013-01-28 | 2018-05-15 | Nook Digital, Llc | Context based gesture delineation for user interaction in eyes-free mode |
| US9448643B2 (en) | 2013-03-11 | 2016-09-20 | Barnes & Noble College Booksellers, Llc | Stylus sensitive device with stylus angle detection functionality |
| US9189084B2 (en) | 2013-03-11 | 2015-11-17 | Barnes & Noble College Booksellers, Llc | Stylus-based user data storage and access |
| US9785259B2 (en) | 2013-03-11 | 2017-10-10 | Barnes & Noble College Booksellers, Llc | Stylus-based slider functionality for UI control of computing device |
| US9367161B2 (en) | 2013-03-11 | 2016-06-14 | Barnes & Noble College Booksellers, Llc | Touch sensitive device with stylus-based grab and paste functionality |
| US9891722B2 (en) | 2013-03-11 | 2018-02-13 | Barnes & Noble College Booksellers, Llc | Stylus-based notification system |
| US9632594B2 (en) | 2013-03-11 | 2017-04-25 | Barnes & Noble College Booksellers, Llc | Stylus sensitive device with stylus idle functionality |
| US9766723B2 (en) | 2013-03-11 | 2017-09-19 | Barnes & Noble College Booksellers, Llc | Stylus sensitive device with hover over stylus control functionality |
| US9760187B2 (en) | 2013-03-11 | 2017-09-12 | Barnes & Noble College Booksellers, Llc | Stylus with active color display/select for touch sensitive devices |
| US9946365B2 (en) | 2013-03-11 | 2018-04-17 | Barnes & Noble College Booksellers, Llc | Stylus-based pressure-sensitive area for UI control of computing device |
| US9626008B2 (en) | 2013-03-11 | 2017-04-18 | Barnes & Noble College Booksellers, Llc | Stylus-based remote wipe of lost device |
| US9261985B2 (en) | 2013-03-11 | 2016-02-16 | Barnes & Noble College Booksellers, Llc | Stylus-based touch-sensitive area for UI control of computing device |
| US9600053B2 (en) | 2013-03-11 | 2017-03-21 | Barnes & Noble College Booksellers, Llc | Stylus control feature for locking/unlocking touch sensitive devices |
| US10216266B2 (en) | 2013-03-14 | 2019-02-26 | Qualcomm Incorporated | Systems and methods for device interaction based on a detected gaze |
| KR102138512B1 (en)* | 2013-03-26 | 2020-07-28 | 엘지전자 주식회사 | Display Device And Controlling Method Thereof |
| US9146672B2 (en) | 2013-04-10 | 2015-09-29 | Barnes & Noble College Booksellers, Llc | Multidirectional swipe key for virtual keyboard |
| US8963869B2 (en) | 2013-04-23 | 2015-02-24 | Barnesandnoble.Com Llc | Color pattern unlocking techniques for touch sensitive devices |
| US8966617B2 (en) | 2013-04-23 | 2015-02-24 | Barnesandnoble.Com Llc | Image pattern unlocking techniques for touch sensitive devices |
| US9152321B2 (en) | 2013-05-03 | 2015-10-06 | Barnes & Noble College Booksellers, Llc | Touch sensitive UI technique for duplicating content |
| US9612740B2 (en) | 2013-05-06 | 2017-04-04 | Barnes & Noble College Booksellers, Inc. | Swipe-based delete confirmation for touch sensitive devices |
| US10019153B2 (en) | 2013-06-07 | 2018-07-10 | Nook Digital, Llc | Scrapbooking digital content in computing devices using a swiping gesture |
| US9244603B2 (en) | 2013-06-21 | 2016-01-26 | Nook Digital, Llc | Drag and drop techniques for discovering related content |
| US9423932B2 (en) | 2013-06-21 | 2016-08-23 | Nook Digital, Llc | Zoom view mode for digital content including multiple regions of interest |
| US9400601B2 (en) | 2013-06-21 | 2016-07-26 | Nook Digital, Llc | Techniques for paging through digital content on touch screen devices |
| US9575948B2 (en) | 2013-10-04 | 2017-02-21 | Nook Digital, Llc | Annotation of digital content via selective fixed formatting |
| CN104679397A (en)* | 2013-11-29 | 2015-06-03 | 英业达科技有限公司 | Display and control method thereof |
| US10620796B2 (en) | 2013-12-19 | 2020-04-14 | Barnes & Noble College Booksellers, Llc | Visual thumbnail scrubber for digital content |
| US9588979B2 (en) | 2013-12-31 | 2017-03-07 | Barnes & Noble College Booksellers, Llc | UI techniques for navigating a file manager of an electronic computing device |
| US9367212B2 (en) | 2013-12-31 | 2016-06-14 | Barnes & Noble College Booksellers, Llc | User interface for navigating paginated digital content |
| US9792272B2 (en) | 2013-12-31 | 2017-10-17 | Barnes & Noble College Booksellers, Llc | Deleting annotations of paginated digital content |
| US10915698B2 (en) | 2013-12-31 | 2021-02-09 | Barnes & Noble College Booksellers, Llc | Multi-purpose tool for interacting with paginated digital content |
| US9367208B2 (en) | 2013-12-31 | 2016-06-14 | Barnes & Noble College Booksellers, Llc | Move icon to reveal textual information |
| US10534528B2 (en) | 2013-12-31 | 2020-01-14 | Barnes & Noble College Booksellers, Llc | Digital flash card techniques |
| US9424241B2 (en) | 2013-12-31 | 2016-08-23 | Barnes & Noble College Booksellers, Llc | Annotation mode including multiple note types for paginated digital content |
| US10331777B2 (en) | 2013-12-31 | 2019-06-25 | Barnes & Noble College Booksellers, Llc | Merging annotations of paginated digital content |
| JP5899251B2 (en)* | 2014-01-29 | 2016-04-06 | 本田技研工業株式会社 | Vehicle input device |
| JP2015164789A (en)* | 2014-03-03 | 2015-09-17 | キヤノン株式会社 | Electronic apparatus |
| DE102014204800A1 (en)* | 2014-03-14 | 2015-09-17 | Volkswagen Aktiengesellschaft | Method and apparatus for providing a graphical user interface in a vehicle |
| CN106030614A (en)* | 2014-04-22 | 2016-10-12 | 史內普艾德有限公司 | System and method for controlling one camera based on processing of images captured by another camera |
| JP2017521970A (en)* | 2014-04-30 | 2017-08-03 | ビステオン グローバル テクノロジーズ インコーポレイテッド | System and method for calibrating stereoscopic display alignment in a vehicle |
| US9179184B1 (en)* | 2014-06-20 | 2015-11-03 | Google Inc. | Methods, systems, and media for detecting a presentation of media content on a display device |
| WO2016176368A1 (en)* | 2015-04-27 | 2016-11-03 | Infrasonix, Inc. | Sound detecting device and methods of using the same |
| WO2016174659A1 (en) | 2015-04-27 | 2016-11-03 | Snapaid Ltd. | Estimating and using relative head pose and camera field-of-view |
| WO2016207875A1 (en) | 2015-06-22 | 2016-12-29 | Photomyne Ltd. | System and method for detecting objects in an image |
| WO2017014728A1 (en) | 2015-07-17 | 2017-01-26 | Hewlett-Packard Development Company, L.P. | Rotating platform for a computing device |
| US11255663B2 (en) | 2016-03-04 | 2022-02-22 | May Patents Ltd. | Method and apparatus for cooperative usage of multiple distance meters |
| CN106228112B (en)* | 2016-07-08 | 2019-10-29 | 深圳市优必选科技有限公司 | Face detection tracking method, robot head rotation control method and robot |
| US10509300B2 (en)* | 2017-07-26 | 2019-12-17 | Rumi S Gonda | Electrical fixture apparatus and methods |
| KR102582045B1 (en) | 2018-01-04 | 2023-09-22 | 삼성전자주식회사 | An optical signal transferring apparatus, an electronic apparatus, a source device, and method thereof |
| CN109141249B (en)* | 2018-08-07 | 2021-11-09 | 深圳Tcl数字技术有限公司 | Distance measuring method and computer-readable storage medium |
| CN109558839A (en)* | 2018-11-29 | 2019-04-02 | 徐州立讯信息科技有限公司 | Adaptive face identification method and the equipment and system for realizing this method |
| EP3888346A4 (en) | 2019-02-19 | 2022-08-24 | Edgy Bees Ltd. | Estimating real-time delay of a video data stream |
| CN110798613B (en)* | 2019-10-11 | 2021-10-08 | 重庆特斯联智慧科技股份有限公司 | Face camera equipment that many visual angles were gathered |
| CN110830828B (en)* | 2019-10-17 | 2021-07-16 | 深圳宇讯云游科技有限公司 | 5G signal set-top box |
| US11375561B2 (en) | 2019-12-09 | 2022-06-28 | Amazon Technologies, Inc. | Multi-functional, software configurable device for fixed wireless networks |
| EP3862846B1 (en)* | 2020-02-05 | 2023-07-26 | Vestel Elektronik Sanayi ve Ticaret A.S. | Method and system for managing remote controller of a home electronic device |
| US12164363B2 (en)* | 2020-07-31 | 2024-12-10 | Hewlett-Packard Development Company, L.P. | Operational change control action |
| CN112097051A (en)* | 2020-09-27 | 2020-12-18 | 四川长虹电器股份有限公司 | Rotary television bracket and control method thereof |
| JP7394046B2 (en)* | 2020-11-25 | 2023-12-07 | 株式会社ソニー・インタラクティブエンタテインメント | System, imaging device, information processing device, information processing method, and information processing program |
| CN112543343B (en) | 2020-11-27 | 2024-02-23 | 广州华多网络科技有限公司 | Live broadcast picture processing method and device based on live broadcast with wheat |
| US11921831B2 (en) | 2021-03-12 | 2024-03-05 | Intellivision Technologies Corp | Enrollment system with continuous learning and confirmation |
| US11503361B1 (en)* | 2021-07-26 | 2022-11-15 | Sony Group Corporation | Using signing for input to search fields |
| WO2023126914A2 (en) | 2021-12-27 | 2023-07-06 | Yeda Research And Development Co. Ltd. | METHOD AND SYSTEM FOR SEMANTIC APPEARANCE TRANSFER USING SPLICING ViT FEATURES |
| US12340025B2 (en) | 2022-04-04 | 2025-06-24 | Comcast Cable Communications, Llc | Systems, methods, and apparatuses for execution of gesture commands |
Citations (104)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3783508A (en)* | 1970-08-14 | 1974-01-08 | Gillette Co | Electric shavers |
| US4019252A (en)* | 1974-02-28 | 1977-04-26 | Braun Aktiengesellschaft | Electric shaver |
| US4317991A (en)* | 1980-03-12 | 1982-03-02 | Honeywell Inc. | Digital auto focus system utilizing a photodetector array |
| US4367027A (en)* | 1980-03-12 | 1983-01-04 | Honeywell Inc. | Active auto focus system improvement |
| US4638364A (en)* | 1984-10-30 | 1987-01-20 | Sanyo Electric Co., Ltd. | Auto focus circuit for video camera |
| US4719698A (en)* | 1985-07-02 | 1988-01-19 | Kyushu Hitachi Maxell, Ltd. | Electric shaver with a drive control |
| US4831368A (en)* | 1986-06-18 | 1989-05-16 | Hitachi, Ltd. | Display apparatus with rotatable display screen |
| US5027506A (en)* | 1986-01-22 | 1991-07-02 | U.S. Philips Corporation | Electric shaving apparatus |
| US5032918A (en)* | 1989-10-06 | 1991-07-16 | Nikon Corporation | Electronic still camera |
| US5034804A (en)* | 1987-12-25 | 1991-07-23 | Kabushiki Kaisha Toshiba | Electronic still camera with various modes of data compression |
| US5189404A (en)* | 1986-06-18 | 1993-02-23 | Hitachi, Ltd. | Display apparatus with rotatable display screen |
| US5203704A (en)* | 1990-12-21 | 1993-04-20 | Mccloud Seth R | Method of communication using pointing vector gestures and mnemonic devices to assist in learning point vector gestures |
| US5206721A (en)* | 1990-03-08 | 1993-04-27 | Fujitsu Limited | Television conference system |
| US5238459A (en)* | 1990-04-17 | 1993-08-24 | Andre Bech J | Speed reducer with friction wheel for machines rotating at a high rate of rotation, of the epicycloidal double-train type |
| US5291234A (en)* | 1987-02-04 | 1994-03-01 | Asahi Kogaku Kogyo Kabushiki Kaisha | Auto optical focus detecting device and eye direction detecting optical system |
| US5343243A (en)* | 1992-01-07 | 1994-08-30 | Ricoh Company, Ltd. | Digital video camera |
| US5347295A (en)* | 1990-10-31 | 1994-09-13 | Go Corporation | Control of a computer through a position-sensed stylus |
| US5386103A (en)* | 1993-07-06 | 1995-01-31 | Neurnetics Ltd. | Identification and verification system |
| US5402170A (en)* | 1991-12-11 | 1995-03-28 | Eastman Kodak Company | Hand-manipulated electronic camera tethered to a personal computer |
| US5454043A (en)* | 1993-07-30 | 1995-09-26 | Mitsubishi Electric Research Laboratories, Inc. | Dynamic and static hand gesture recognition through low-level image analysis |
| US5483745A (en)* | 1994-08-19 | 1996-01-16 | Izumi Products Company | Electric shaver |
| US5488429A (en)* | 1992-01-13 | 1996-01-30 | Mitsubishi Denki Kabushiki Kaisha | Video signal processor for detecting flesh tones in am image |
| US5594469A (en)* | 1995-02-21 | 1997-01-14 | Mitsubishi Electric Information Technology Center America Inc. | Hand gesture machine control system |
| US5617312A (en)* | 1993-11-19 | 1997-04-01 | Hitachi, Ltd. | Computer system that enters control information by means of video camera |
| US5638136A (en)* | 1992-01-13 | 1997-06-10 | Mitsubishi Denki Kabushiki Kaisha | Method and apparatus for detecting flesh tones in an image |
| US5642431A (en)* | 1995-06-07 | 1997-06-24 | Massachusetts Institute Of Technology | Network-based system and method for detection of faces and the like |
| US5710833A (en)* | 1995-04-20 | 1998-01-20 | Massachusetts Institute Of Technology | Detection, recognition and coding of complex objects using probabilistic eigenspace analysis |
| US5724456A (en)* | 1995-03-31 | 1998-03-03 | Polaroid Corporation | Brightness adjustment of images using digital scene analysis |
| US5781650A (en)* | 1994-02-18 | 1998-07-14 | University Of Central Florida | Automatic feature detection and age classification of human faces in digital images |
| US5870138A (en)* | 1995-03-31 | 1999-02-09 | Hitachi, Ltd. | Facial image processing |
| US5920988A (en)* | 1997-08-04 | 1999-07-13 | Izumi Products Company | Electric shaver |
| US6010111A (en)* | 1996-11-15 | 2000-01-04 | Samsung Electronics Co., Ltd. | Swiveling device for liquid crystal display monitor |
| US6072494A (en)* | 1997-10-15 | 2000-06-06 | Electric Planet, Inc. | Method and apparatus for real-time gesture recognition |
| US6075895A (en)* | 1997-06-20 | 2000-06-13 | Holoplex | Methods and apparatus for gesture recognition based on templates |
| US6176782B1 (en)* | 1997-12-22 | 2001-01-23 | Philips Electronics North America Corp. | Motion-based command generation technology |
| US6179264B1 (en)* | 1999-07-22 | 2001-01-30 | Sony Corporation | Rolling base stand for computer monitors and other appliances |
| US6188777B1 (en)* | 1997-08-01 | 2001-02-13 | Interval Research Corporation | Method and apparatus for personnel detection and tracking |
| US6192149B1 (en)* | 1998-04-08 | 2001-02-20 | Xerox Corporation | Method and apparatus for automatic detection of image target gamma |
| US6222465B1 (en)* | 1998-12-09 | 2001-04-24 | Lucent Technologies Inc. | Gesture-based computer interface |
| US6249315B1 (en)* | 1997-03-24 | 2001-06-19 | Jack M. Holm | Strategy for pictorial digital image processing |
| US6252888B1 (en)* | 1998-04-14 | 2001-06-26 | Nortel Networks Corporation | Method and apparatus providing network communications between devices using frames with multiple formats |
| US6263113B1 (en)* | 1998-12-11 | 2001-07-17 | Philips Electronics North America Corp. | Method for detecting a face in a digital image |
| US6268939B1 (en)* | 1998-01-08 | 2001-07-31 | Xerox Corporation | Method and apparatus for correcting luminance and chrominance data in digital color images |
| US6348928B1 (en)* | 1998-11-13 | 2002-02-19 | Lg Electronics Inc. | Apparatus for automatically rotating visual display unit and method therefor |
| US6351222B1 (en)* | 1998-10-30 | 2002-02-26 | Ati International Srl | Method and apparatus for receiving an input by an entertainment device |
| US6359612B1 (en)* | 1998-09-30 | 2002-03-19 | Siemens Aktiengesellschaft | Imaging system for displaying image information that has been acquired by means of a medical diagnostic imaging device |
| US20020036617A1 (en)* | 1998-08-21 | 2002-03-28 | Timothy R. Pryor | Novel man machine interfaces and applications |
| US20020041260A1 (en)* | 2000-08-11 | 2002-04-11 | Norbert Grassmann | System and method of operator control |
| US20020057383A1 (en)* | 1998-10-13 | 2002-05-16 | Ryuichi Iwamura | Motion sensing interface |
| US6393148B1 (en)* | 1999-05-13 | 2002-05-21 | Hewlett-Packard Company | Contrast enhancement of an image using luminance and RGB statistical metrics |
| US6396391B1 (en)* | 1998-08-27 | 2002-05-28 | Serconet Ltd. | Communications and control network having multiple power supplies |
| US6404900B1 (en)* | 1998-06-22 | 2002-06-11 | Sharp Laboratories Of America, Inc. | Method for robust human face tracking in presence of multiple persons |
| US6407777B1 (en)* | 1997-10-09 | 2002-06-18 | Deluca Michael Joseph | Red-eye filter method and apparatus |
| US6421468B1 (en)* | 1999-01-06 | 2002-07-16 | Seiko Epson Corporation | Method and apparatus for sharpening an image by scaling elements of a frequency-domain representation |
| US6504707B2 (en)* | 2000-06-14 | 2003-01-07 | International Business Machines Corporation | Portable computer |
| US6504942B1 (en)* | 1998-01-23 | 2003-01-07 | Sharp Kabushiki Kaisha | Method of and apparatus for detecting a face-like region and observer tracking display |
| US6504951B1 (en)* | 1999-11-29 | 2003-01-07 | Eastman Kodak Company | Method for detecting sky in images |
| US6516154B1 (en)* | 2001-07-17 | 2003-02-04 | Eastman Kodak Company | Image revising camera and method |
| US6526161B1 (en)* | 1999-08-30 | 2003-02-25 | Koninklijke Philips Electronics N.V. | System and method for biometrics-based facial feature extraction |
| US6535243B1 (en)* | 1998-01-06 | 2003-03-18 | Hewlett- Packard Company | Wireless hand-held digital camera |
| US6549616B1 (en)* | 2000-03-20 | 2003-04-15 | Serconet Ltd. | Telephone outlet for implementing a local area network over telephone lines and a local area network using such outlets |
| US6552743B1 (en)* | 1998-04-08 | 2003-04-22 | Hewlett Packard Development Company, L.P. | Digital camera-ready printer |
| US6560319B1 (en)* | 2001-01-16 | 2003-05-06 | Serconet Ltd. | Method and telephone outlet for allowing telephone and data equipment to be connected to a telephone line via a common connector |
| US6564144B1 (en)* | 2002-01-10 | 2003-05-13 | Navigation Technologies Corporation | Method and system using a hand-gesture responsive device for collecting data for a geographic database |
| US6567101B1 (en)* | 1999-10-13 | 2003-05-20 | Gateway, Inc. | System and method utilizing motion input for manipulating a display of data |
| US6677969B1 (en)* | 1998-09-25 | 2004-01-13 | Sanyo Electric Co., Ltd. | Instruction recognition system having gesture recognition function |
| US6690677B1 (en)* | 1999-07-20 | 2004-02-10 | Serconet Ltd. | Network for telephony and data communication |
| US6766036B1 (en)* | 1999-07-08 | 2004-07-20 | Timothy R. Pryor | Camera based man machine interfaces |
| US6842459B1 (en)* | 2000-04-19 | 2005-01-11 | Serconet Ltd. | Network combining wired and non-wired segments |
| US20050063564A1 (en)* | 2003-08-11 | 2005-03-24 | Keiichi Yamamoto | Hand pattern switch device |
| US6871402B2 (en)* | 2000-10-20 | 2005-03-29 | Braun Gmbh | Electrically driven hair removal device |
| US20050132585A1 (en)* | 2003-12-18 | 2005-06-23 | Michael Weber | Flexible mirror attachment for electric shaver |
| US6931596B2 (en)* | 2001-03-05 | 2005-08-16 | Koninklijke Philips Electronics N.V. | Automatic positioning of display depending upon the viewer's location |
| US20060067367A1 (en)* | 2004-09-25 | 2006-03-30 | Samsung Electronics Co., Ltd | Method for selecting timing master in synchronous ethernet system |
| US20060071135A1 (en)* | 2002-12-06 | 2006-04-06 | Koninklijke Philips Electronics, N.V. | Apparatus and method for automated positioning of a device |
| US7042440B2 (en)* | 1997-08-22 | 2006-05-09 | Pryor Timothy R | Man machine interfaces and applications |
| US7050606B2 (en)* | 1999-08-10 | 2006-05-23 | Cybernet Systems Corporation | Tracking and gesture recognition system particularly suited to vehicular control applications |
| US7058204B2 (en)* | 2000-10-03 | 2006-06-06 | Gesturetek, Inc. | Multiple camera control system |
| US7059733B2 (en)* | 2003-03-18 | 2006-06-13 | Hitachi, Ltd. | Display apparatus |
| US7227976B1 (en)* | 2002-07-08 | 2007-06-05 | Videomining Corporation | Method and system for real-time facial image enhancement |
| US20070126884A1 (en)* | 2005-12-05 | 2007-06-07 | Samsung Electronics, Co., Ltd. | Personal settings, parental control, and energy saving control of television with digital video camera |
| US20070132725A1 (en)* | 2005-12-14 | 2007-06-14 | Victor Company Of Japan, Limited. | Electronic Appliance |
| US20070173202A1 (en)* | 2006-01-11 | 2007-07-26 | Serconet Ltd. | Apparatus and method for frequency shifting of a wireless signal and systems using frequency shifting |
| US7289645B2 (en)* | 2002-10-25 | 2007-10-30 | Mitsubishi Fuso Truck And Bus Corporation | Hand pattern switch device |
| US7315630B2 (en)* | 2003-06-26 | 2008-01-01 | Fotonation Vision Limited | Perfecting of digital image rendering parameters within rendering devices using face detection |
| US7317815B2 (en)* | 2003-06-26 | 2008-01-08 | Fotonation Vision Limited | Digital image processing composition using face detection information |
| US7317793B2 (en)* | 2003-01-30 | 2008-01-08 | Serconet Ltd | Method and system for providing DC power on local telephone lines |
| US7327385B2 (en)* | 2003-11-20 | 2008-02-05 | Texas Instruments Incorporated | Home picture/video display system with ultra wide-band technology |
| US20080028616A1 (en)* | 2006-08-02 | 2008-02-07 | Kwak Dong Shin | Shaver with lighting means |
| US7391888B2 (en)* | 2003-05-30 | 2008-06-24 | Microsoft Corporation | Head pose assessment methods and systems |
| US7405725B2 (en)* | 2003-01-31 | 2008-07-29 | Olympus Corporation | Movement detection device and communication apparatus |
| US7487375B2 (en)* | 1998-03-06 | 2009-02-03 | Intel Corporation | Method and apparatus for powering on an electronic device with a video camera that detects motion |
| US7508961B2 (en)* | 2003-03-12 | 2009-03-24 | Eastman Kodak Company | Method and system for face detection in digital images |
| US7521943B2 (en)* | 2005-01-23 | 2009-04-21 | Serconet, Ltd. | Device, method and system for estimating the termination to a wired transmission-line based on determination of characteristic impedance |
| US7522615B2 (en)* | 2002-11-13 | 2009-04-21 | Serconet, Ltd. | Addressable outlet, and a network using same |
| US7530019B2 (en)* | 2002-08-23 | 2009-05-05 | International Business Machines Corporation | Method and system for a user-following interface |
| US7542554B2 (en)* | 2001-07-05 | 2009-06-02 | Serconet, Ltd | Telephone outlet with packet telephony adapter, and a network using same |
| US7598942B2 (en)* | 2005-02-08 | 2009-10-06 | Oblong Industries, Inc. | System and method for gesture based control system |
| US7680287B2 (en)* | 2002-09-17 | 2010-03-16 | Kabushiki Kaisha Toshiba | Directional setting apparatus, directional setting system, directional setting method and directional setting program |
| US7680298B2 (en)* | 2001-09-28 | 2010-03-16 | At&T Intellectual Property I, L. P. | Methods, systems, and products for gesture-activated appliances |
| US7702130B2 (en)* | 2004-12-20 | 2010-04-20 | Electronics And Telecommunications Research Institute | User interface apparatus using hand gesture recognition and method thereof |
| US20100211918A1 (en)* | 2009-02-17 | 2010-08-19 | Microsoft Corporation | Web Cam Based User Interaction |
| US7952561B2 (en)* | 2006-11-17 | 2011-05-31 | Samsung Electronics Co., Ltd. | Method and apparatus for controlling application using motion of image pickup unit |
| US7975243B2 (en)* | 2008-02-25 | 2011-07-05 | Samsung Electronics Co., Ltd. | System and method for television control using hand gestures |
Family Cites Families (398)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4047187A (en) | 1974-04-01 | 1977-09-06 | Canon Kabushiki Kaisha | System for exposure measurement and/or focus detection by means of image senser |
| US4169663A (en) | 1978-02-27 | 1979-10-02 | Synemed, Inc. | Eye attention monitor |
| US4595990A (en) | 1980-12-31 | 1986-06-17 | International Business Machines Corporation | Eye controlled information transfer |
| US4567610A (en) | 1982-07-22 | 1986-01-28 | Wayland Research Inc. | Method of and apparatus for pattern recognition |
| US4503508A (en) | 1982-10-12 | 1985-03-05 | Eastman Kodak Company | Exposure control apparatus |
| US4659197A (en) | 1984-09-20 | 1987-04-21 | Weinblatt Lee S | Eyeglass-frame-mounted eye-movement-monitoring apparatus |
| JPS61156979A (en) | 1984-12-27 | 1986-07-16 | Sony Corp | Electronic steal camera device having recording function |
| US4703247A (en) | 1985-07-19 | 1987-10-27 | Sanyo Electric Co., Ltd. | Battery apparatus for an electric shaver |
| US4796019A (en) | 1987-02-19 | 1989-01-03 | Rca Licensing Corporation | Input device for a display system |
| US4836670A (en) | 1987-08-19 | 1989-06-06 | Center For Innovative Technology | Eye movement detector |
| US4973149A (en) | 1987-08-19 | 1990-11-27 | Center For Innovative Technology | Eye movement detector |
| US5808887A (en) | 1987-11-20 | 1998-09-15 | Philips Electronics North America Corporation | Animation of path planning |
| US5016282A (en) | 1988-07-14 | 1991-05-14 | Atr Communication Systems Research Laboratories | Eye tracking image pickup apparatus for separating noise from feature portions |
| US4950069A (en) | 1988-11-04 | 1990-08-21 | University Of Virginia | Eye movement detector with improved calibration and speed |
| US5214615A (en) | 1990-02-26 | 1993-05-25 | Will Bauer | Three-dimensional displacement of a body with computer interface |
| US5103254A (en) | 1990-05-29 | 1992-04-07 | Eastman Kodak Company | Camera with subject highlighting and motion detection |
| JP2748678B2 (en) | 1990-10-09 | 1998-05-13 | 松下電器産業株式会社 | Gradation correction method and gradation correction device |
| US5138459A (en) | 1990-11-20 | 1992-08-11 | Personal Computer Cameras, Inc. | Electronic still video camera with direct personal computer (pc) compatible digital format output |
| US5243418A (en) | 1990-11-27 | 1993-09-07 | Kabushiki Kaisha Toshiba | Display monitoring system for detecting and tracking an intruder in a monitor area |
| US5515130A (en) | 1990-12-10 | 1996-05-07 | Nikon Corporation | Camera control device |
| JP2522859B2 (en) | 1990-12-14 | 1996-08-07 | 日産自動車株式会社 | Eye position detection device |
| KR940007012Y1 (en) | 1991-01-31 | 1994-10-07 | 삼성전자 주식회사 | Tilting device |
| US5758201A (en) | 1991-06-28 | 1998-05-26 | Nikon Corporation | Camera having line of sight detecting device |
| US5274735A (en) | 1991-12-16 | 1993-12-28 | Sanyo Electric Co., Ltd. | Electric shaver |
| JP3298072B2 (en) | 1992-07-10 | 2002-07-02 | ソニー株式会社 | Video camera system |
| US5389952A (en) | 1992-12-02 | 1995-02-14 | Cordata Inc. | Low-power-consumption monitor standby system |
| JP3244798B2 (en) | 1992-09-08 | 2002-01-07 | 株式会社東芝 | Moving image processing device |
| JPH06119090A (en) | 1992-10-07 | 1994-04-28 | Hitachi Ltd | Power saving control method |
| KR100276681B1 (en) | 1992-11-07 | 2001-01-15 | 이데이 노부유끼 | Video camera system |
| US5475441A (en) | 1992-12-10 | 1995-12-12 | Eastman Kodak Company | Electronic camera with memory card interface to a computer |
| JPH06313838A (en) | 1993-04-28 | 1994-11-08 | Nikon Corp | Voice input camera |
| US5548764A (en) | 1993-04-30 | 1996-08-20 | Advanced Micro Devices, Inc. | Power interrupt device with remote activity detector |
| CA2119327A1 (en) | 1993-07-19 | 1995-01-20 | David Crawford Gibbon | Method and means for detecting people in image sequences |
| JPH0743804A (en) | 1993-07-30 | 1995-02-14 | Canon Inc | Function selection device |
| US5520888A (en) | 1994-02-01 | 1996-05-28 | Safe Alternatives Corporation | Bio-medical waste reactor, sterilizer and methods thereof |
| US5835616A (en) | 1994-02-18 | 1998-11-10 | University Of Central Florida | Face detection using templates |
| US5481622A (en) | 1994-03-01 | 1996-01-02 | Rensselaer Polytechnic Institute | Eye tracking apparatus and method employing grayscale threshold values |
| US5422690A (en) | 1994-03-16 | 1995-06-06 | Pulse Medical Instruments, Inc. | Fitness impairment tester |
| JPH086708A (en) | 1994-04-22 | 1996-01-12 | Canon Inc | Display device |
| JPH07318807A (en)* | 1994-05-19 | 1995-12-08 | Nikon Corp | Automatic microscope |
| US5523796A (en) | 1994-05-20 | 1996-06-04 | Prevue Networks, Inc. | Video clip program guide |
| US5550366A (en) | 1994-06-20 | 1996-08-27 | Roustaei; Alexander | Optical scanner with automatic activation |
| JP3893480B2 (en) | 1994-09-28 | 2007-03-14 | 株式会社リコー | Digital electronic camera |
| US5926168A (en) | 1994-09-30 | 1999-07-20 | Fan; Nong-Qiang | Remote pointers for interactive televisions |
| US5541585A (en) | 1994-10-11 | 1996-07-30 | Stanley Home Automation | Security system for controlling building access |
| US5629752A (en) | 1994-10-28 | 1997-05-13 | Fuji Photo Film Co., Ltd. | Method of determining an exposure amount using optical recognition of facial features |
| US5678312A (en) | 1994-10-31 | 1997-10-21 | Sanyo Electric Co., Ltd. | Electric shaver with reduced vibration |
| US6269449B1 (en) | 1994-12-02 | 2001-07-31 | Dell Usa, L.P. | Capacitive wake-up mechanism for hand held data entry unit |
| JPH08271784A (en) | 1995-03-30 | 1996-10-18 | Canon Inc | Optical device with line-of-sight detection function |
| US5666159A (en) | 1995-04-24 | 1997-09-09 | Eastman Kodak Company | Electronic camera system with programmable transmission capability |
| US5675364A (en) | 1995-04-28 | 1997-10-07 | Dell Usa, L.P. | Display wakeup control |
| JP4272711B2 (en) | 1995-05-15 | 2009-06-03 | キヤノン株式会社 | Image generation method and apparatus |
| US6181371B1 (en) | 1995-05-30 | 2001-01-30 | Francis J Maguire, Jr. | Apparatus for inducing attitudinal head movements for passive virtual reality |
| JP3671259B2 (en) | 1995-05-31 | 2005-07-13 | カシオ計算機株式会社 | Display device |
| JPH0981309A (en) | 1995-09-13 | 1997-03-28 | Toshiba Corp | Input device |
| US6473609B1 (en) | 1995-12-11 | 2002-10-29 | Openwave Systems Inc. | Method and architecture for interactive two-way communication devices to interact with a network |
| US5802220A (en) | 1995-12-15 | 1998-09-01 | Xerox Corporation | Apparatus and method for tracking facial motion through a sequence of images |
| US5912721A (en) | 1996-03-13 | 1999-06-15 | Kabushiki Kaisha Toshiba | Gaze detection apparatus and its method as well as information display apparatus |
| US6151073A (en) | 1996-03-28 | 2000-11-21 | Fotonation, Inc. | Intelligent camera flash system |
| US5991456A (en) | 1996-05-29 | 1999-11-23 | Science And Technology Corporation | Method of improving a digital image |
| US5835083A (en) | 1996-05-30 | 1998-11-10 | Sun Microsystems, Inc. | Eyetrack-driven illumination and information display |
| US5815147A (en) | 1996-06-07 | 1998-09-29 | The Trustees Of The University Of Pennsylvania | Virtual play environment for disabled children |
| US5831594A (en) | 1996-06-25 | 1998-11-03 | Sun Microsystems, Inc. | Method and apparatus for eyetrack derived backtrack |
| US5898423A (en) | 1996-06-25 | 1999-04-27 | Sun Microsystems, Inc. | Method and apparatus for eyetrack-driven captioning |
| US6437758B1 (en) | 1996-06-25 | 2002-08-20 | Sun Microsystems, Inc. | Method and apparatus for eyetrack—mediated downloading |
| US6002808A (en) | 1996-07-26 | 1999-12-14 | Mitsubishi Electric Information Technology Center America, Inc. | Hand gesture control system |
| US5978519A (en) | 1996-08-06 | 1999-11-02 | Xerox Corporation | Automatic image cropping |
| US5944530A (en) | 1996-08-13 | 1999-08-31 | Ho; Chi Fai | Learning method and system that consider a student's concentration level |
| US6061434A (en) | 1996-08-14 | 2000-05-09 | Joseph C. Corbett | Video caller identification systems and methods |
| US5936608A (en) | 1996-08-30 | 1999-08-10 | Dell Usa, Lp | Computer system including display control system |
| US5917476A (en) | 1996-09-24 | 1999-06-29 | Czerniecki; George V. | Cursor feedback text input method |
| IL119454A (en) | 1996-10-21 | 2002-07-25 | Serconet Ltd | Distributed serial control system |
| DE19643558C1 (en) | 1996-10-24 | 1998-04-09 | Leica Mikroskopie & Syst | Microscope with a proximity sensor |
| US6738558B2 (en) | 1996-10-24 | 2004-05-18 | Leica Microsystems Wetzlar Gmbh | Microscope with a proximity sensor |
| US5818975A (en) | 1996-10-28 | 1998-10-06 | Eastman Kodak Company | Method and apparatus for area selective exposure adjustment |
| US5731832A (en) | 1996-11-05 | 1998-03-24 | Prescient Systems | Apparatus and method for detecting motion in a video signal |
| JPH10150647A (en) | 1996-11-19 | 1998-06-02 | Fujitsu Ltd | Video conferencing systems |
| ATE232621T1 (en) | 1996-12-20 | 2003-02-15 | Hitachi Europ Ltd | METHOD AND SYSTEM FOR RECOGNIZING HAND GESTURES |
| US5892856A (en) | 1996-12-23 | 1999-04-06 | Intel Corporation | Method of presence detection using video input |
| US6111517A (en) | 1996-12-30 | 2000-08-29 | Visionics Corporation | Continuous video monitoring using face recognition for access control |
| US5914671A (en) | 1997-02-27 | 1999-06-22 | Micron Communications, Inc. | System and method for locating individuals and equipment, airline reservation system, communication system |
| US6009210A (en) | 1997-03-05 | 1999-12-28 | Digital Equipment Corporation | Hands-free interface to a virtual reality environment using head tracking |
| US5983501A (en) | 1997-04-02 | 1999-11-16 | Izumi Products Company | Electric shaver |
| US6351273B1 (en) | 1997-04-30 | 2002-02-26 | Jerome H. Lemelson | System and methods for controlling automatic scrolling of information on a display or screen |
| US6252598B1 (en) | 1997-07-03 | 2001-06-26 | Lucent Technologies Inc. | Video hand image computer interface |
| KR19990011180A (en) | 1997-07-22 | 1999-02-18 | 구자홍 | How to select menu using image recognition |
| US6023224A (en) | 1997-07-29 | 2000-02-08 | The Stanley Works | Door frame with integrated keyless entry system |
| DE19737449A1 (en)* | 1997-08-22 | 1999-02-25 | Hertz Inst Heinrich | Viewer-tracking autostereoscopic flat screen display |
| DE19736995B4 (en) | 1997-08-26 | 2009-05-07 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Device for determining a fixation point |
| US6002427A (en) | 1997-09-15 | 1999-12-14 | Kipust; Alan J. | Security system with proximity sensing for an electronic device |
| US6031934A (en) | 1997-10-15 | 2000-02-29 | Electric Planet, Inc. | Computer vision system for subject characterization |
| JP3795647B2 (en) | 1997-10-29 | 2006-07-12 | 株式会社竹中工務店 | Hand pointing device |
| US6108437A (en) | 1997-11-14 | 2000-08-22 | Seiko Epson Corporation | Face recognition apparatus, method, system and computer readable medium thereof |
| US6128397A (en) | 1997-11-21 | 2000-10-03 | Justsystem Pittsburgh Research Center | Method for finding all frontal faces in arbitrarily complex visual scenes |
| US5967801A (en) | 1997-11-26 | 1999-10-19 | The Whitaker Corporation | Modular plug having compensating insert |
| US6646673B2 (en) | 1997-12-05 | 2003-11-11 | Koninklijke Philips Electronics N.V. | Communication method and terminal |
| US6092058A (en) | 1998-01-08 | 2000-07-18 | The United States Of America As Represented By The Secretary Of The Army | Automatic aiding of human cognitive functions with computerized displays |
| US6148092A (en) | 1998-01-08 | 2000-11-14 | Sharp Laboratories Of America, Inc | System for detecting skin-tone regions within an image |
| US6249606B1 (en) | 1998-02-19 | 2001-06-19 | Mindmaker, Inc. | Method and system for gesture category recognition and training using a feature vector |
| US6152563A (en) | 1998-02-20 | 2000-11-28 | Hutchinson; Thomas E. | Eye gaze direction tracker |
| US6367020B1 (en) | 1998-03-09 | 2002-04-02 | Micron Technology, Inc. | System for automatically initiating a computer security and/or screen saver mode |
| US6204828B1 (en) | 1998-03-31 | 2001-03-20 | International Business Machines Corporation | Integrated gaze/manual cursor positioning system |
| KR19990079584A (en) | 1998-04-07 | 1999-11-05 | 윤종용 | Low power computer system with user sensing device and power supply control method thereof |
| US6301370B1 (en) | 1998-04-13 | 2001-10-09 | Eyematic Interfaces, Inc. | Face recognition from video images |
| GB9808016D0 (en) | 1998-04-15 | 1998-06-17 | Cambridge Display Tech Ltd | Display control |
| US6215471B1 (en) | 1998-04-28 | 2001-04-10 | Deluca Michael Joseph | Vision pointer method and apparatus |
| US6167469A (en) | 1998-05-18 | 2000-12-26 | Agilent Technologies, Inc. | Digital camera having display device for displaying graphical representation of user input and method for transporting the selected digital images thereof |
| ES2619367T3 (en) | 1998-05-21 | 2017-06-26 | Equifax Inc. | System and method for network user authentication |
| US6097470A (en) | 1998-05-28 | 2000-08-01 | Eastman Kodak Company | Digital photofinishing system including scene balance, contrast normalization, and image sharpening digital image processing |
| US6091378A (en) | 1998-06-17 | 2000-07-18 | Eye Control Technologies, Inc. | Video processing methods and apparatus for gaze point tracking |
| US6573883B1 (en) | 1998-06-24 | 2003-06-03 | Hewlett Packard Development Company, L.P. | Method and apparatus for controlling a computing device with gestures |
| US6311141B1 (en) | 1998-07-02 | 2001-10-30 | Intel Corporation | Controlling a physical Relationship between a display and a viewer of the display |
| JP3697487B2 (en) | 1998-07-28 | 2005-09-21 | コニカミノルタフォトイメージング株式会社 | Digital camera |
| US6480510B1 (en)* | 1998-07-28 | 2002-11-12 | Serconet Ltd. | Local area network of serial intelligent cells |
| US6950534B2 (en) | 1998-08-10 | 2005-09-27 | Cybernet Systems Corporation | Gesture-controlled interfaces for self-service machines and other applications |
| US6243076B1 (en) | 1998-09-01 | 2001-06-05 | Synthetic Environments, Inc. | System and method for controlling host system interface with point-of-interest data |
| US6330676B1 (en) | 1998-09-08 | 2001-12-11 | International Business Machines Corporation | Method and system for the automatic initiation of power application and start-up activities in a computer system |
| US6456732B1 (en) | 1998-09-11 | 2002-09-24 | Hewlett-Packard Company | Automatic rotation, cropping and scaling of images for printing |
| JP3285545B2 (en) | 1998-09-29 | 2002-05-27 | 松下電器産業株式会社 | Motion detection circuit and noise reduction device |
| EP1039752A4 (en) | 1998-10-09 | 2007-05-02 | Sony Corp | Communication apparatus and method |
| GB9823977D0 (en) | 1998-11-02 | 1998-12-30 | Scient Generics Ltd | Eye tracking method and apparatus |
| US6282553B1 (en) | 1998-11-04 | 2001-08-28 | International Business Machines Corporation | Gaze-based secure keypad entry system |
| JP3291259B2 (en) | 1998-11-11 | 2002-06-10 | キヤノン株式会社 | Image processing method and recording medium |
| US6374145B1 (en) | 1998-12-14 | 2002-04-16 | Mark Lignoul | Proximity sensor for screen saver and password delay |
| US7134130B1 (en) | 1998-12-15 | 2006-11-07 | Gateway Inc. | Apparatus and method for user-based control of television content |
| US6473199B1 (en) | 1998-12-18 | 2002-10-29 | Eastman Kodak Company | Correcting exposure and tone scale of digital images captured by an image capture device |
| US6466232B1 (en) | 1998-12-18 | 2002-10-15 | Tangis Corporation | Method and system for controlling presentation of information to a user based on the user's condition |
| US6720990B1 (en) | 1998-12-28 | 2004-04-13 | Walker Digital, Llc | Internet surveillance system and method |
| US6438264B1 (en) | 1998-12-31 | 2002-08-20 | Eastman Kodak Company | Method for compensating image color when adjusting the contrast of a digital color image |
| US6526159B1 (en) | 1998-12-31 | 2003-02-25 | Intel Corporation | Eye tracking for resource and power management |
| US6282317B1 (en) | 1998-12-31 | 2001-08-28 | Eastman Kodak Company | Method for automatic determination of main subjects in photographic images |
| US6393136B1 (en) | 1999-01-04 | 2002-05-21 | International Business Machines Corporation | Method and apparatus for determining eye contact |
| US6307384B2 (en) | 1999-01-07 | 2001-10-23 | Honeywell International Inc. | Micropower capacitance-based proximity sensor |
| US6473608B1 (en)* | 1999-01-12 | 2002-10-29 | Powerdsine Ltd. | Structure cabling system |
| US6363160B1 (en) | 1999-01-22 | 2002-03-26 | Intel Corporation | Interface using pattern recognition and tracking |
| US6577329B1 (en) | 1999-02-25 | 2003-06-10 | International Business Machines Corporation | Method and system for relevance feedback through gaze tracking and ticker interfaces |
| US6765608B1 (en) | 1999-03-09 | 2004-07-20 | Minolta Co., Ltd. | Image processing apparatus and system executing predetermined image processing on image data shot by camera, and image recording medium recorded with image processing program |
| US6535198B1 (en) | 1999-03-28 | 2003-03-18 | Nongqiang Fan | Remote control for interactive television |
| US7016595B1 (en) | 1999-05-28 | 2006-03-21 | Nikon Corporation | Television set capable of controlling external device and image storage controlled by television set |
| JP4332649B2 (en) | 1999-06-08 | 2009-09-16 | 独立行政法人情報通信研究機構 | Hand shape and posture recognition device, hand shape and posture recognition method, and recording medium storing a program for executing the method |
| US6956826B1 (en) | 1999-07-07 | 2005-10-18 | Serconet Ltd. | Local area network for distributing data communication, sensing and control signals |
| US6501857B1 (en) | 1999-07-20 | 2002-12-31 | Craig Gotsman | Method and system for detecting and classifying objects in an image |
| US6738066B1 (en) | 1999-07-30 | 2004-05-18 | Electric Plant, Inc. | System, method and article of manufacture for detecting collisions between video images generated by a camera and an object depicted on a display |
| US6618716B1 (en) | 1999-07-30 | 2003-09-09 | Microsoft Corporation | Computational architecture for managing the transmittal and rendering of information, alerts, and notifications |
| US6738041B2 (en) | 1999-10-29 | 2004-05-18 | Intel Corporation | Using video information to control cursor position |
| DE19953835C1 (en) | 1999-10-30 | 2001-05-23 | Hertz Inst Heinrich | Computer-aided method for contactless, video-based gaze direction determination of a user's eye for eye-guided human-computer interaction and device for carrying out the method |
| US6147612A (en) | 1999-11-10 | 2000-11-14 | Ruan; Ying Chao | Dual function optic sleep preventing device for vehicle drivers |
| US6665805B1 (en) | 1999-12-27 | 2003-12-16 | Intel Corporation | Method and apparatus for real time monitoring of user presence to prolong a portable computer battery operation time |
| US6788332B1 (en) | 1999-12-29 | 2004-09-07 | Qwest Communications International Inc. | Wireless imaging device and system |
| AU2637101A (en) | 2000-01-07 | 2001-07-24 | Ideo Product Development Inc. | System and method for image capture and management in an electronic device |
| EP1250702B1 (en) | 2000-01-27 | 2005-06-08 | Siemens Aktiengesellschaft | System and method for eye-tracking controlled speech processing with generation of a visual feedback signal |
| US6522292B1 (en) | 2000-02-23 | 2003-02-18 | Geovector Corp. | Information systems having position measuring capacity |
| US6940545B1 (en) | 2000-02-28 | 2005-09-06 | Eastman Kodak Company | Face detecting camera and method |
| US7124374B1 (en) | 2000-03-06 | 2006-10-17 | Carl Herman Haken | Graphical interface control system |
| US6988008B2 (en)* | 2000-03-10 | 2006-01-17 | Adept Technology, Inc. | Smart camera |
| SE0000850D0 (en) | 2000-03-13 | 2000-03-13 | Pink Solution Ab | Recognition arrangement |
| IL135744A (en) | 2000-04-18 | 2008-08-07 | Mosaid Technologies Inc | Telephone communication system over a single telephone line |
| US6456262B1 (en) | 2000-05-09 | 2002-09-24 | Intel Corporation | Microdisplay with eye gaze detection |
| US6603491B2 (en) | 2000-05-26 | 2003-08-05 | Jerome H. Lemelson | System and methods for controlling automatic scrolling of information on a display or screen |
| US7904939B2 (en) | 2000-06-21 | 2011-03-08 | At&T Intellectual Property I, L. P. | Methods, systems, and products for automated control of devices |
| US6795068B1 (en) | 2000-07-21 | 2004-09-21 | Sony Computer Entertainment Inc. | Prop input device and method for mapping an object from a two-dimensional camera image to a three-dimensional space for controlling action in a game program |
| US6731952B2 (en) | 2000-07-27 | 2004-05-04 | Eastman Kodak Company | Mobile telephone system having a detachable camera / battery module |
| JP2002062957A (en) | 2000-08-18 | 2002-02-28 | Fujitsu Ltd | Information processing apparatus and control method |
| US6633286B1 (en) | 2000-09-01 | 2003-10-14 | Rockwell Collins, Inc. | Method and apparatus for providing a monitor deployment |
| IL138517A (en) | 2000-09-17 | 2005-07-25 | Serconet Ltd | System and method for transmission-line termination by signal cancellation, and applications thereof |
| US6608615B1 (en) | 2000-09-19 | 2003-08-19 | Intel Corporation | Passive gaze-driven browsing |
| US7107605B2 (en) | 2000-09-19 | 2006-09-12 | Simple Devices | Digital image frame and method for using the same |
| US6961303B1 (en) | 2000-09-21 | 2005-11-01 | Serconet Ltd. | Telephone communication system and method over local area network wiring |
| JP3725460B2 (en) | 2000-10-06 | 2005-12-14 | 株式会社ソニー・コンピュータエンタテインメント | Image processing apparatus, image processing method, recording medium, computer program, semiconductor device |
| US6497043B1 (en) | 2000-10-13 | 2002-12-24 | Sarcos, L.C. | Intelligent shaver |
| US7095401B2 (en) | 2000-11-02 | 2006-08-22 | Siemens Corporate Research, Inc. | System and method for gesture interface |
| JP4590717B2 (en) | 2000-11-17 | 2010-12-01 | ソニー株式会社 | Face identification device and face identification method |
| US7099510B2 (en) | 2000-11-29 | 2006-08-29 | Hewlett-Packard Development Company, L.P. | Method and system for object detection in digital images |
| US6933979B2 (en) | 2000-12-13 | 2005-08-23 | International Business Machines Corporation | Method and system for range sensing of objects in proximity to a display |
| US6953249B1 (en) | 2001-01-29 | 2005-10-11 | Maguire Jr Francis J | Method and devices for displaying images for viewing with varying accommodation |
| GB0103349D0 (en) | 2001-02-10 | 2001-03-28 | Ibm | Facilitated user interface |
| US6628918B2 (en) | 2001-02-21 | 2003-09-30 | Sri International, Inc. | System, method and computer program product for instant group learning feedback via image-based marking and aggregation |
| US6834436B2 (en) | 2001-02-23 | 2004-12-28 | Microstrain, Inc. | Posture and body movement measuring system |
| US6397137B1 (en) | 2001-03-02 | 2002-05-28 | International Business Machines Corporation | System and method for selection of vehicular sideview mirrors via eye gaze |
| JP3437555B2 (en) | 2001-03-06 | 2003-08-18 | キヤノン株式会社 | Specific point detection method and device |
| US7068813B2 (en) | 2001-03-28 | 2006-06-27 | Koninklijke Philips Electronics N.V. | Method and apparatus for eye gazing smart display |
| US6804396B2 (en) | 2001-03-28 | 2004-10-12 | Honda Giken Kogyo Kabushiki Kaisha | Gesture recognition system |
| US7113074B2 (en) | 2001-03-30 | 2006-09-26 | Koninklijke Philips Electronics N.V. | Method and system for automatically controlling a personalized networked environment |
| US6965394B2 (en) | 2001-03-30 | 2005-11-15 | Koninklijke Philips Electronics N.V. | Remote camera control device |
| US6760465B2 (en) | 2001-03-30 | 2004-07-06 | Intel Corporation | Mechanism for tracking colored objects in a video sequence |
| US6578962B1 (en) | 2001-04-27 | 2003-06-17 | International Business Machines Corporation | Calibration-free eye gaze tracking |
| AUPR541801A0 (en) | 2001-06-01 | 2001-06-28 | Canon Kabushiki Kaisha | Face detection in colour images with complex background |
| US8035612B2 (en) | 2002-05-28 | 2011-10-11 | Intellectual Ventures Holding 67 Llc | Self-contained interactive video display system |
| US7259747B2 (en) | 2001-06-05 | 2007-08-21 | Reactrix Systems, Inc. | Interactive video display system |
| US20020186200A1 (en) | 2001-06-08 | 2002-12-12 | David Green | Method and apparatus for human interface with a computer |
| JP4593834B2 (en) | 2001-07-02 | 2010-12-08 | 富士フイルム株式会社 | Digital camera and system |
| JP3787760B2 (en) | 2001-07-31 | 2006-06-21 | 松下電器産業株式会社 | Mobile phone device with camera |
| US20030038754A1 (en) | 2001-08-22 | 2003-02-27 | Mikael Goldstein | Method and apparatus for gaze responsive text presentation in RSVP display |
| US6825769B2 (en) | 2001-09-14 | 2004-11-30 | Koninklijke Philips Electronics N.V. | Automatic shut-off light system when user sleeps |
| US6439920B1 (en) | 2001-09-18 | 2002-08-27 | Surtec Industries Inc. | Electronic connector plug for high speed transmission |
| US7284201B2 (en) | 2001-09-20 | 2007-10-16 | Koninklijke Philips Electronics N.V. | User attention-based adaptation of quality level to improve the management of real-time multi-media content delivery and distribution |
| US20030052903A1 (en) | 2001-09-20 | 2003-03-20 | Weast John C. | Method and apparatus for focus based lighting |
| US7023499B2 (en) | 2001-09-21 | 2006-04-04 | Williams Cassandra S | Television receiver with motion sensor |
| JP2003179556A (en) | 2001-09-21 | 2003-06-27 | Casio Comput Co Ltd | Information transmission method, information transmission system, imaging device, and information transmission method |
| DE60108533T2 (en) | 2001-09-25 | 2005-12-29 | Serconet Ltd. | ADAPTER FOR MOUNTING A FIRST-TYPE FRONT PANEL ON AN ELECTRIC PLUG-MOUNTED ROOF SECONDARY ART |
| EP2234394A1 (en) | 2001-10-11 | 2010-09-29 | Mosaid Technologies Incorporated | Coupling device |
| US20030081834A1 (en) | 2001-10-31 | 2003-05-01 | Vasanth Philomin | Intelligent TV room |
| US20030097659A1 (en) | 2001-11-16 | 2003-05-22 | Goldman Phillip Y. | Interrupting the output of media content in response to an event |
| US7139415B2 (en) | 2001-12-05 | 2006-11-21 | The Regents Of The University Of California | Robotic microscopy systems |
| KR100456619B1 (en) | 2001-12-05 | 2004-11-10 | 한국전자통신연구원 | A system for registering and authenticating human face using support vector machines and method thereof |
| TW504112U (en) | 2001-12-21 | 2002-09-21 | Coretronic Corp | Digital television with a digital camera combining device |
| US6801811B2 (en) | 2001-12-27 | 2004-10-05 | Hewlett-Packard Development Company, L.P. | Software-directed, energy-aware control of display |
| US6937745B2 (en) | 2001-12-31 | 2005-08-30 | Microsoft Corporation | Machine vision system and method for estimating and tracking facial pose |
| US6924607B2 (en) | 2002-01-07 | 2005-08-02 | Leica Microsystems Inc. | Method and apparatus for automatically shutting off a microscope |
| US7197165B2 (en) | 2002-02-04 | 2007-03-27 | Canon Kabushiki Kaisha | Eye tracking using image data |
| US7036025B2 (en) | 2002-02-07 | 2006-04-25 | Intel Corporation | Method and apparatus to reduce power consumption of a computer system display screen |
| US6990639B2 (en) | 2002-02-07 | 2006-01-24 | Microsoft Corporation | System and process for controlling electronic components in a ubiquitous computing environment using multimodal integration |
| AU2003217587A1 (en) | 2002-02-15 | 2003-09-09 | Canesta, Inc. | Gesture recognition system using depth perceptive sensors |
| US7010710B2 (en) | 2002-03-12 | 2006-03-07 | International Business Machines Corporation | Proximity sensor enhanced power management |
| JP2003280600A (en) | 2002-03-20 | 2003-10-02 | Hitachi Ltd | Display device and driving method thereof |
| US7206435B2 (en) | 2002-03-26 | 2007-04-17 | Honda Giken Kogyo Kabushiki Kaisha | Real-time eye detection and tracking under various light conditions |
| US7670224B2 (en) | 2002-04-03 | 2010-03-02 | Igt | Gaming apparatus with power saving feature |
| AUPS170902A0 (en) | 2002-04-12 | 2002-05-16 | Canon Kabushiki Kaisha | Face detection and tracking in a video sequence |
| JP3837505B2 (en) | 2002-05-20 | 2006-10-25 | 独立行政法人産業技術総合研究所 | Method of registering gesture of control device by gesture recognition |
| EP1376995A3 (en) | 2002-06-21 | 2004-03-17 | Samsung Electronics Co., Ltd. | Device and method for displaying data in a mobile terminal equipped with a camera |
| US20040001082A1 (en) | 2002-06-26 | 2004-01-01 | Amir Said | System and method of interaction with a computer controlled image display system using a projected light source |
| US7102615B2 (en) | 2002-07-27 | 2006-09-05 | Sony Computer Entertainment Inc. | Man-machine interface using a deformable device |
| US7782297B2 (en) | 2002-07-27 | 2010-08-24 | Sony Computer Entertainment America Inc. | Method and apparatus for use in determining an activity level of a user in relation to a system |
| US7110575B2 (en) | 2002-08-02 | 2006-09-19 | Eastman Kodak Company | Method for locating faces in digital color images |
| JP4031325B2 (en) | 2002-08-30 | 2008-01-09 | 富士通株式会社 | Mobile terminals and mobile phones |
| EP1398947A3 (en) | 2002-09-13 | 2007-08-01 | Sharp Kabushiki Kaisha | Broadcast program recording method, communication control device and mobile communication device |
| US6943754B2 (en) | 2002-09-27 | 2005-09-13 | The Boeing Company | Gaze tracking system, eye-tracking assembly and an associated method of calibration |
| JP3744002B2 (en) | 2002-10-04 | 2006-02-08 | ソニー株式会社 | Display device, imaging device, and imaging / display system |
| US7030856B2 (en) | 2002-10-15 | 2006-04-18 | Sony Corporation | Method and system for controlling a display device |
| US7233684B2 (en) | 2002-11-25 | 2007-06-19 | Eastman Kodak Company | Imaging method and system using affective information |
| WO2004054255A1 (en) | 2002-12-11 | 2004-06-24 | Nielsen Media Research, Inc. | Detecting a composition of an audience |
| US7203338B2 (en) | 2002-12-11 | 2007-04-10 | Nielsen Media Research, Inc. | Methods and apparatus to count people appearing in an image |
| US20080197790A1 (en)* | 2002-12-11 | 2008-08-21 | Mangiaracina Anthony A | Lighting utilizing power over the ethernet |
| US7415137B2 (en) | 2002-12-13 | 2008-08-19 | Canon Kabushiki Kaisha | Image processing method, apparatus and storage medium |
| JP4107093B2 (en) | 2003-01-30 | 2008-06-25 | 株式会社日立製作所 | Interactive terminal device and interactive application providing method |
| US6859144B2 (en) | 2003-02-05 | 2005-02-22 | Delphi Technologies, Inc. | Vehicle situation alert system with eye gaze controlled alert signal generation |
| US7379560B2 (en) | 2003-03-05 | 2008-05-27 | Intel Corporation | Method and apparatus for monitoring human attention in dynamic power management |
| IL154921A (en) | 2003-03-13 | 2011-02-28 | Mosaid Technologies Inc | Telephone system having multiple distinct sources and accessories therefor |
| US7762665B2 (en) | 2003-03-21 | 2010-07-27 | Queen's University At Kingston | Method and apparatus for communication between humans and devices |
| US8292433B2 (en) | 2003-03-21 | 2012-10-23 | Queen's University At Kingston | Method and apparatus for communication between humans and devices |
| DE10313023B4 (en) | 2003-03-24 | 2006-02-23 | GTG Gesellschaft für elektronische Geräte mbH | Device for audiovisual presentation of sound and images |
| US8745541B2 (en) | 2003-03-25 | 2014-06-03 | Microsoft Corporation | Architecture for controlling a computer using hand gestures |
| US7665041B2 (en) | 2003-03-25 | 2010-02-16 | Microsoft Corporation | Architecture for controlling a computer using hand gestures |
| US20040215694A1 (en) | 2003-03-26 | 2004-10-28 | Leon Podolsky | Automated system and method for integrating and controlling home and office subsystems |
| JP4674820B2 (en) | 2003-04-11 | 2011-04-20 | トムソン ライセンシング | Method and apparatus for selecting broadcast program |
| US7627343B2 (en) | 2003-04-25 | 2009-12-01 | Apple Inc. | Media player system |
| US7259785B2 (en) | 2003-04-28 | 2007-08-21 | Hewlett-Packard Development Company, L.P. | Digital imaging method and apparatus using eye-tracking control |
| EP1627294A2 (en) | 2003-05-01 | 2006-02-22 | Delta Dansk Elektronik, Lys & Akustik | A man-machine interface based on 3-d positions of the human body |
| US7872635B2 (en) | 2003-05-15 | 2011-01-18 | Optimetrics, Inc. | Foveated display eye-tracking system and method |
| US7088220B2 (en) | 2003-06-20 | 2006-08-08 | Motorola, Inc. | Method and apparatus using biometric sensors for controlling access to a wireless communication device |
| US7565030B2 (en) | 2003-06-26 | 2009-07-21 | Fotonation Vision Limited | Detecting orientation of digital images using face detection information |
| US7574016B2 (en) | 2003-06-26 | 2009-08-11 | Fotonation Vision Limited | Digital image processing using face detection information |
| US7269292B2 (en) | 2003-06-26 | 2007-09-11 | Fotonation Vision Limited | Digital image adjustable compression and resolution using face detection information |
| US7274822B2 (en) | 2003-06-30 | 2007-09-25 | Microsoft Corporation | Face annotation for photo management |
| IL157787A (en) | 2003-09-07 | 2010-12-30 | Mosaid Technologies Inc | Modular outlet for data communications network |
| DE10335766A1 (en)* | 2003-08-05 | 2004-11-25 | Siemens Ag | Optimum positioning of the screen of a computer monitor relative to the user uses camera coupled to computer to control adjusting mechanism |
| US7353413B2 (en) | 2003-08-18 | 2008-04-01 | Intel Corporation | Computer system power policy adjustment in response to an affirmative indication from a user |
| US6987454B2 (en) | 2003-08-29 | 2006-01-17 | International Business Machines Corporation | Power management |
| JP4479194B2 (en)* | 2003-08-29 | 2010-06-09 | 富士ゼロックス株式会社 | Motion identification device and object posture identification device |
| US8705808B2 (en) | 2003-09-05 | 2014-04-22 | Honeywell International Inc. | Combined face and iris recognition system |
| US7874917B2 (en) | 2003-09-15 | 2011-01-25 | Sony Computer Entertainment Inc. | Methods and systems for enabling depth and direction detection when interfacing with a computer program |
| US7548255B2 (en) | 2003-09-30 | 2009-06-16 | Microsoft Corporation | Method and system for capturing video on a personal computer |
| US7117380B2 (en) | 2003-09-30 | 2006-10-03 | International Business Machines Corporation | Apparatus, system, and method for autonomic power adjustment in an electronic device |
| WO2005048091A1 (en) | 2003-11-17 | 2005-05-26 | Sony Computer Entertainment Inc. | Image display |
| US7447740B2 (en) | 2003-12-19 | 2008-11-04 | Microsoft Corporation | Internet video conferencing on a home television |
| JP4425642B2 (en) | 2004-01-08 | 2010-03-03 | 富士重工業株式会社 | Pedestrian extraction device |
| IL159838A0 (en) | 2004-01-13 | 2004-06-20 | Yehuda Binder | Information device |
| GB2410359A (en) | 2004-01-23 | 2005-07-27 | Sony Uk Ltd | Display |
| US7755608B2 (en) | 2004-01-23 | 2010-07-13 | Hewlett-Packard Development Company, L.P. | Systems and methods of interfacing with a machine |
| IL160417A (en) | 2004-02-16 | 2011-04-28 | Mosaid Technologies Inc | Outlet add-on module |
| US7565139B2 (en) | 2004-02-20 | 2009-07-21 | Google Inc. | Image-based search engine for mobile phones with camera |
| US7330216B2 (en) | 2004-02-24 | 2008-02-12 | Research In Motion Limited | Handheld electronic device having a battery compartment door that includes a camera |
| US7106261B2 (en) | 2004-02-25 | 2006-09-12 | Control4 Corporation | System for remotely controlling an electrical switching device |
| US20050194509A1 (en) | 2004-03-08 | 2005-09-08 | Tsai Yung M. | Rotatable carrier for objects or display |
| US20050229228A1 (en) | 2004-04-07 | 2005-10-13 | Sandeep Relan | Unicast cable content delivery |
| US20050228673A1 (en) | 2004-03-30 | 2005-10-13 | Nefian Ara V | Techniques for separating and evaluating audio and video source data |
| US20050221791A1 (en) | 2004-04-05 | 2005-10-06 | Sony Ericsson Mobile Communications Ab | Sensor screen saver |
| US7302089B1 (en) | 2004-04-29 | 2007-11-27 | National Semiconductor Corporation | Autonomous optical wake-up intelligent sensor circuit |
| IL161869A (en) | 2004-05-06 | 2014-05-28 | Serconet Ltd | System and method for carrying a wireless based signal over wiring |
| US7308112B2 (en) | 2004-05-14 | 2007-12-11 | Honda Motor Co., Ltd. | Sign based human-machine interaction |
| US20050281531A1 (en) | 2004-06-16 | 2005-12-22 | Unmehopa Musa R | Television viewing apparatus |
| US20050283812A1 (en) | 2004-06-18 | 2005-12-22 | Soon-Keat Soo | Multi-functional multimedia playing device |
| ES2568506T3 (en) | 2004-06-18 | 2016-04-29 | Tobii Ab | Eye control of computer equipment |
| US8232962B2 (en) | 2004-06-21 | 2012-07-31 | Trading Technologies International, Inc. | System and method for display management based on user attention inputs |
| US7532197B2 (en) | 2004-06-22 | 2009-05-12 | Lenovo (Singapore) Pte Ltd. | Method and system for automated monitoring of a display |
| US7454039B2 (en) | 2004-07-12 | 2008-11-18 | The Board Of Trustees Of The University Of Illinois | Method of performing shape localization |
| US7171114B2 (en) | 2004-07-12 | 2007-01-30 | Milton Curtis A | Mirror-mimicking video system |
| US7729538B2 (en) | 2004-08-26 | 2010-06-01 | Microsoft Corporation | Spatial recognition and grouping of text and graphics |
| US7730505B2 (en) | 2004-09-02 | 2010-06-01 | Panasonic Corporation | Stream reproducing device |
| KR100561633B1 (en) | 2004-09-22 | 2006-03-20 | 한국전자통신연구원 | Intelligent Home Visitor Identification and Call Service System Using Wireless Communication Terminal |
| US7730534B2 (en) | 2004-09-23 | 2010-06-01 | Smartvue Corporation | Enterprise video intelligence and analytics management system and method |
| DE102004047962A1 (en) | 2004-10-01 | 2006-04-06 | Patent-Treuhand-Gesellschaft für elektrische Glühlampen mbH | sensor system |
| US7730406B2 (en) | 2004-10-20 | 2010-06-01 | Hewlett-Packard Development Company, L.P. | Image processing system and method |
| US7626569B2 (en) | 2004-10-25 | 2009-12-01 | Graphics Properties Holdings, Inc. | Movable audio/video communication interface system |
| KR100681233B1 (en) | 2004-10-28 | 2007-02-09 | 김재황 | Laparoscopic Surgery Monitor and Display Method |
| US7435177B1 (en) | 2004-11-12 | 2008-10-14 | Sprint Spectrum L.P. | Method and system for video-based navigation in an application on a handheld game device |
| KR200374579Y1 (en) | 2004-11-19 | 2005-02-02 | 툴디자인 (주) | Rotatable Built-In System of Image-Sound Installation |
| WO2006064881A1 (en) | 2004-12-17 | 2006-06-22 | Dai Nippon Printing Co., Ltd. | Imaging information management system and method, and imaging information search system |
| WO2006074289A2 (en) | 2005-01-07 | 2006-07-13 | Gesturetek, Inc. | Detecting and tracking objects in images |
| US20060187331A1 (en) | 2005-02-20 | 2006-08-24 | Nucore Technology, Inc. | Digital camera having electronic visual jockey capability |
| US20060192775A1 (en) | 2005-02-25 | 2006-08-31 | Microsoft Corporation | Using detected visual cues to change computer system operating states |
| TWI289742B (en) | 2005-04-29 | 2007-11-11 | Clevo Co | Double screen device of portable computer and operation method thereof |
| US8385880B2 (en) | 2005-05-10 | 2013-02-26 | Mobile Communication Technologies, Llc | Apparatus for and system for enabling a mobile communicator |
| JP2006324952A (en)* | 2005-05-19 | 2006-11-30 | Hitachi Ltd | Television equipment |
| US20060277584A1 (en) | 2005-06-07 | 2006-12-07 | Taylor Norman L | Data distribution, analysis and methods using integrated entertainment appliances |
| JP4951881B2 (en) | 2005-06-20 | 2012-06-13 | 株式会社日立製作所 | Image display device and image display device stand |
| US20070009139A1 (en) | 2005-07-11 | 2007-01-11 | Agere Systems Inc. | Facial recognition device for a handheld electronic device and a method of using the same |
| US20090189972A1 (en) | 2005-07-12 | 2009-07-30 | Harris Michael D | System and method for video medical examination and real time transmission to remote locations |
| US20070078294A1 (en) | 2005-09-03 | 2007-04-05 | Yogendra Jain | Dynamic relaxation and motivational agent |
| WO2007029710A1 (en) | 2005-09-07 | 2007-03-15 | Matsushita Electric Industrial Co., Ltd. | Mobile processor apparatus |
| DE102005045362B4 (en) | 2005-09-22 | 2012-03-22 | Siemens Ag | Device for determining the position of a medical instrument, associated imaging examination device and associated method |
| US7728316B2 (en) | 2005-09-30 | 2010-06-01 | Apple Inc. | Integrated proximity sensor and light sensor |
| US7728904B2 (en) | 2005-11-08 | 2010-06-01 | Qualcomm Incorporated | Skin color prioritized automatic focus control via sensor-dependent skin color detection |
| US7599520B2 (en) | 2005-11-18 | 2009-10-06 | Accenture Global Services Gmbh | Detection of multiple targets on a plane of interest |
| US7843845B2 (en) | 2005-11-28 | 2010-11-30 | Alcatel Lucent | Diagnostic tool and method for troubleshooting multicast connectivity flow problem(s) in a layer 2 aggregation network |
| US8848057B2 (en) | 2005-12-05 | 2014-09-30 | Samsung Electronics Co., Ltd. | Home security applications for television with digital video cameras |
| TWI300473B (en) | 2005-12-14 | 2008-09-01 | Ind Tech Res Inst | A status sensing mechanism and the cursor-control device applying the same |
| TWI277848B (en) | 2006-01-11 | 2007-04-01 | Ind Tech Res Inst | Apparatus for automatically adjusting display parameters relying on visual performance and method for the same |
| US7726890B2 (en) | 2006-01-19 | 2010-06-01 | Fujifilm Corporation | Camera |
| WO2007126781A2 (en) | 2006-03-27 | 2007-11-08 | Exceptional Innovation Llc | Set top box for convergence and automation system |
| WO2007109924A1 (en) | 2006-03-29 | 2007-10-04 | Intel Corporation | Apparatus and method for a mobile personal computer system (mpc) with a built-in scanner |
| JP2007292809A (en) | 2006-04-20 | 2007-11-08 | Matsushita Electric Ind Co Ltd | Display device and display method |
| JP5146315B2 (en) | 2006-05-15 | 2013-02-20 | 日本電気株式会社 | Video playback device, video playback method, and video playback program |
| US7925269B2 (en)* | 2006-05-18 | 2011-04-12 | Samsung Electronics Co., Ltd. | Method and system for establishing a channel for a wireless video area network |
| IE20060420A1 (en) | 2006-06-06 | 2008-02-06 | John Mary Ryan | An electric shaver |
| KR200426275Y1 (en) | 2006-06-08 | 2006-09-19 | 오태준 | Multi-type Head Moving Razor |
| US8013838B2 (en) | 2006-06-30 | 2011-09-06 | Microsoft Corporation | Generating position information using a video camera |
| US20100122277A1 (en) | 2006-07-12 | 2010-05-13 | Koninklijike Phillips Electronics, N.V. | device and a method for playing audio-video content |
| US8180114B2 (en) | 2006-07-13 | 2012-05-15 | Northrop Grumman Systems Corporation | Gesture recognition interface system with vertical display |
| US7701439B2 (en) | 2006-07-13 | 2010-04-20 | Northrop Grumman Corporation | Gesture recognition simulation system and method |
| AU2007275991B2 (en) | 2006-07-20 | 2010-12-02 | Lg Electronics Inc. | Operation method of interactive refrigerator system |
| US7886326B2 (en) | 2006-08-23 | 2011-02-08 | Kye Systems Corp. | Web cam for indicating the expression of a remote end user |
| JP4650381B2 (en) | 2006-09-08 | 2011-03-16 | 日本ビクター株式会社 | Electronics |
| US7738392B2 (en) | 2006-09-20 | 2010-06-15 | At&T Intellectual Property I, L.P. | Methods and apparatus to provide services over integrated broadband communication systems |
| KR100783552B1 (en) | 2006-10-11 | 2007-12-07 | 삼성전자주식회사 | Method and device for input control of a mobile terminal |
| US8340365B2 (en) | 2006-11-20 | 2012-12-25 | Sony Mobile Communications Ab | Using image recognition for controlling display lighting |
| JP4745207B2 (en) | 2006-12-08 | 2011-08-10 | 株式会社東芝 | Facial feature point detection apparatus and method |
| US7995794B2 (en) | 2007-03-02 | 2011-08-09 | Sony Ericsson Mobile Communications Ab | Remote control of an image capturing unit in a portable electronic device |
| US7921307B2 (en)* | 2007-03-27 | 2011-04-05 | Cisco Technology, Inc. | Methods and apparatus providing advanced classification for power over Ethernet |
| US20080236014A1 (en) | 2007-03-29 | 2008-10-02 | Kinpo Electronics, Inc. | Autorotative digital photo frame |
| EP2284664B1 (en) | 2007-03-29 | 2012-10-31 | Y.T. Ventures Ltd | System and method for tracking an electronic device |
| US20080244854A1 (en)* | 2007-04-05 | 2008-10-09 | Master Artist Faux Painting Corporation | Apparatus for applying liquid |
| US7957765B1 (en) | 2007-05-25 | 2011-06-07 | At&T Mobility Ii Llc | Mobile phone with integrated wireless camera |
| US8159519B2 (en) | 2007-05-31 | 2012-04-17 | Eastman Kodak Company | Personal controls for personal video communications |
| US8154583B2 (en) | 2007-05-31 | 2012-04-10 | Eastman Kodak Company | Eye gazing imaging for video communications |
| US8154578B2 (en) | 2007-05-31 | 2012-04-10 | Eastman Kodak Company | Multi-camera residential communication system |
| US7835999B2 (en) | 2007-06-27 | 2010-11-16 | Microsoft Corporation | Recognizing input gestures using a multi-touch input device, calculated graphs, and a neural network with link weights |
| TR200704549A2 (en) | 2007-06-29 | 2009-01-21 | Vestel Elektroni̇k San. Ve Ti̇c. A.Ş. | A user-friendly TV stand rotation mechanism and method |
| US8031272B2 (en) | 2007-07-19 | 2011-10-04 | International Business Machines Corporation | System and method of adjusting viewing angle for display |
| CN101365139B (en) | 2007-08-08 | 2011-08-17 | 群康科技(深圳)有限公司 | Digital photo frame and control method thereof |
| JP5430572B2 (en) | 2007-09-14 | 2014-03-05 | インテレクチュアル ベンチャーズ ホールディング ６７ エルエルシー | Gesture-based user interaction processing |
| US8159551B2 (en) | 2007-09-26 | 2012-04-17 | Sony Ericsson Mobile Communications Ab | Portable electronic equipment with automatic control to keep display turned on and method |
| TWI360761B (en) | 2007-10-03 | 2012-03-21 | Inventec Corp | An electronic apparatus and a method for automatic |
| US20090113297A1 (en) | 2007-10-24 | 2009-04-30 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Requesting a second content based on a user's reaction to a first content |
| US9513699B2 (en) | 2007-10-24 | 2016-12-06 | Invention Science Fund I, LL | Method of selecting a second content based on a user's reaction to a first content |
| US20090112694A1 (en) | 2007-10-24 | 2009-04-30 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Targeted-advertising based on a sensed physiological response by a person to a general advertisement |
| US8005263B2 (en) | 2007-10-26 | 2011-08-23 | Honda Motor Co., Ltd. | Hand sign recognition using label assignment |
| US20090221368A1 (en) | 2007-11-28 | 2009-09-03 | Ailive Inc., | Method and system for creating a shared game space for a networked game |
| US20090147081A1 (en) | 2007-12-05 | 2009-06-11 | Thomas Hanson | Hair styling system and apparatus |
| CN101458531A (en) | 2007-12-12 | 2009-06-17 | 深圳富泰宏精密工业有限公司 | Display screen automatic adjustment system and method |
| US8600120B2 (en) | 2008-01-03 | 2013-12-03 | Apple Inc. | Personal computing device control using face detection and recognition |
| US8115877B2 (en) | 2008-01-04 | 2012-02-14 | International Business Machines Corporation | System and method of adjusting viewing angle for display based on viewer positions and lighting conditions |
| US8174483B2 (en) | 2008-02-20 | 2012-05-08 | Computime, Ltd. | Automatic display unit activation |
| US8555207B2 (en) | 2008-02-27 | 2013-10-08 | Qualcomm Incorporated | Enhanced input using recognized gestures |
| US8259163B2 (en) | 2008-03-07 | 2012-09-04 | Intellectual Ventures Holding 67 Llc | Display with built in 3D sensing |
| EP2109313B1 (en) | 2008-04-09 | 2016-01-13 | Sony Computer Entertainment Europe Limited | Television receiver and method |
| WO2009128064A2 (en)* | 2008-04-14 | 2009-10-22 | Pointgrab Ltd. | Vision based pointing device emulation |
| US7641521B2 (en) | 2008-04-15 | 2010-01-05 | Tyco Electronics Corporation | Electrical connector with compensation loops |
| US20090265764A1 (en) | 2008-04-21 | 2009-10-22 | Verizon Business Network Services Inc. | Aggregation and use of information relating to a users context |
| GB2459705B (en) | 2008-05-01 | 2010-05-12 | Sony Computer Entertainment Inc | Media reproducing device, audio visual entertainment system and method |
| CN201336128Y (en) | 2008-07-18 | 2009-10-28 | 鸿富锦精密工业（深圳）有限公司 | Intelligently-controlled electric picture frame |
| US7990421B2 (en) | 2008-07-18 | 2011-08-02 | Sony Ericsson Mobile Communications Ab | Arrangement and method relating to an image recording device |
| JP5355548B2 (en) | 2008-09-03 | 2013-11-27 | オリンパス株式会社 | Microscope and control method of microscope |
| US8788977B2 (en) | 2008-11-20 | 2014-07-22 | Amazon Technologies, Inc. | Movement recognition as input mechanism |
| WO2010060211A1 (en) | 2008-11-28 | 2010-06-03 | Nortel Networks Limited | Method and apparatus for controling a camera view into a three dimensional computer-generated virtual environment |
| US8289364B2 (en) | 2009-01-08 | 2012-10-16 | Sony Corporation | TV with internet videoconferencing |
| WO2010112062A1 (en) | 2009-03-30 | 2010-10-07 | Renault S.A.S. | Device for projecting a virtual object onto a screen |
| US9498718B2 (en) | 2009-05-01 | 2016-11-22 | Microsoft Technology Licensing, Llc | Altering a view perspective within a display environment |
| US8009022B2 (en) | 2009-05-29 | 2011-08-30 | Microsoft Corporation | Systems and methods for immersive interaction with virtual objects |
| EP2265006A1 (en) | 2009-06-17 | 2010-12-22 | Koninklijke Philips Electronics N.V. | Display apparatus for displaying information to a person |
| TWI401963B (en) | 2009-06-25 | 2013-07-11 | Pixart Imaging Inc | Dynamic image compression method for face detection |
| WO2011003437A1 (en) | 2009-07-06 | 2011-01-13 | Siemens Aktiengesellschaft | Visualization system for correct alignment of an output unit with respect to a user and method for this purpose |
| US8144201B2 (en) | 2009-09-15 | 2012-03-27 | Pegatron Corporation | Portable computer capable of performing digital photo frame function under main-power-off state |
| CA2684192C (en) | 2009-10-30 | 2017-09-19 | Crosswing Inc. | Apparatus and method for robotic display choreography |
| GB0921284D0 (en) | 2009-12-04 | 2010-01-20 | Portus Robert T | Lifting and rotating device |
| US8416277B2 (en) | 2009-12-10 | 2013-04-09 | Apple Inc. | Face detection as a metric to stabilize video during video chat session |
| TW201123032A (en) | 2009-12-30 | 2011-07-01 | Hon Hai Prec Ind Co Ltd | Monitor adjusting system and the method use the same |
| US8232990B2 (en) | 2010-01-05 | 2012-07-31 | Apple Inc. | Working with 3D objects |
| US20110194762A1 (en) | 2010-02-04 | 2011-08-11 | Samsung Electronics Co., Ltd. | Method for detecting hair region |
| US20110199538A1 (en) | 2010-02-18 | 2011-08-18 | Erik David Gershfeld | Digital photo-frame anywhere |
| EP2362636B1 (en) | 2010-02-26 | 2013-04-24 | Research In Motion Limited | Object detection and selection using gesture recognition |
| US8213680B2 (en) | 2010-03-19 | 2012-07-03 | Microsoft Corporation | Proxy training data for human body tracking |
| US8373654B2 (en) | 2010-04-29 | 2013-02-12 | Acer Incorporated | Image based motion gesture recognition method and system thereof |
| US8730332B2 (en) | 2010-09-29 | 2014-05-20 | Digitaloptics Corporation | Systems and methods for ergonomic measurement |
| US8767030B2 (en) | 2011-04-07 | 2014-07-01 | Tara Chand Singhal | System and method for a grooming mirror in a portable electronic device with a user-facing camera |
| US8913005B2 (en) | 2011-04-08 | 2014-12-16 | Fotonation Limited | Methods and systems for ergonomic feedback using an image analysis module |
| US8358321B1 (en) | 2011-04-29 | 2013-01-22 | Google Inc. | Change screen orientation |
| US20120286957A1 (en) | 2011-05-13 | 2012-11-15 | Stephen Frechette | Mobile Sleep Detection Method and System |
- 2010
- 2010-03-16USUS12/724,896patent/US20100295782A1/ennot_activeAbandoned
- 2010-05-16WOPCT/IL2010/000392patent/WO2010134066A1/enactiveApplication Filing
- 2010-05-16EPEP10727953Apatent/EP2433199A1/ennot_activeWithdrawn
- 2012
- 2012-05-30USUS13/483,434patent/US8614673B2/enactiveActive
- 2012-06-18USUS13/526,053patent/US8614674B2/enactiveActive
- 2012-10-23USUS13/658,080patent/US20130044198A1/ennot_activeAbandoned
- 2013
- 2013-04-17USUS13/864,581patent/US20130235179A1/ennot_activeAbandoned
- 2013-05-28USUS13/903,569patent/US10582144B2/enactiveActive
- 2016
- 2016-01-20USUS15/001,422patent/US20160134834A1/ennot_activeAbandoned
- 2016-01-21USUS15/002,425patent/US20160139663A1/ennot_activeAbandoned
- 2016-07-19USUS15/213,876patent/US20160330395A1/ennot_activeAbandoned
- 2016-07-19USUS15/213,914patent/US20160328605A1/ennot_activeAbandoned
- 2016-07-19USUS15/213,964patent/US20160330505A1/ennot_activeAbandoned
- 2020
- 2020-02-12USUS16/788,333patent/US20200186740A1/enactivePending
Patent Citations (105)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3783508A (en)* | 1970-08-14 | 1974-01-08 | Gillette Co | Electric shavers |
| US4019252A (en)* | 1974-02-28 | 1977-04-26 | Braun Aktiengesellschaft | Electric shaver |
| US4317991A (en)* | 1980-03-12 | 1982-03-02 | Honeywell Inc. | Digital auto focus system utilizing a photodetector array |
| US4367027A (en)* | 1980-03-12 | 1983-01-04 | Honeywell Inc. | Active auto focus system improvement |
| US4638364A (en)* | 1984-10-30 | 1987-01-20 | Sanyo Electric Co., Ltd. | Auto focus circuit for video camera |
| US4719698A (en)* | 1985-07-02 | 1988-01-19 | Kyushu Hitachi Maxell, Ltd. | Electric shaver with a drive control |
| US5027506A (en)* | 1986-01-22 | 1991-07-02 | U.S. Philips Corporation | Electric shaving apparatus |
| US4831368A (en)* | 1986-06-18 | 1989-05-16 | Hitachi, Ltd. | Display apparatus with rotatable display screen |
| US5189404A (en)* | 1986-06-18 | 1993-02-23 | Hitachi, Ltd. | Display apparatus with rotatable display screen |
| US5291234A (en)* | 1987-02-04 | 1994-03-01 | Asahi Kogaku Kogyo Kabushiki Kaisha | Auto optical focus detecting device and eye direction detecting optical system |
| US5034804A (en)* | 1987-12-25 | 1991-07-23 | Kabushiki Kaisha Toshiba | Electronic still camera with various modes of data compression |
| US5032918A (en)* | 1989-10-06 | 1991-07-16 | Nikon Corporation | Electronic still camera |
| US5206721A (en)* | 1990-03-08 | 1993-04-27 | Fujitsu Limited | Television conference system |
| US5238459A (en)* | 1990-04-17 | 1993-08-24 | Andre Bech J | Speed reducer with friction wheel for machines rotating at a high rate of rotation, of the epicycloidal double-train type |
| US5347295A (en)* | 1990-10-31 | 1994-09-13 | Go Corporation | Control of a computer through a position-sensed stylus |
| US5203704A (en)* | 1990-12-21 | 1993-04-20 | Mccloud Seth R | Method of communication using pointing vector gestures and mnemonic devices to assist in learning point vector gestures |
| US5402170A (en)* | 1991-12-11 | 1995-03-28 | Eastman Kodak Company | Hand-manipulated electronic camera tethered to a personal computer |
| US5343243A (en)* | 1992-01-07 | 1994-08-30 | Ricoh Company, Ltd. | Digital video camera |
| US5488429A (en)* | 1992-01-13 | 1996-01-30 | Mitsubishi Denki Kabushiki Kaisha | Video signal processor for detecting flesh tones in am image |
| US5638136A (en)* | 1992-01-13 | 1997-06-10 | Mitsubishi Denki Kabushiki Kaisha | Method and apparatus for detecting flesh tones in an image |
| US5386103A (en)* | 1993-07-06 | 1995-01-31 | Neurnetics Ltd. | Identification and verification system |
| US5454043A (en)* | 1993-07-30 | 1995-09-26 | Mitsubishi Electric Research Laboratories, Inc. | Dynamic and static hand gesture recognition through low-level image analysis |
| US5617312A (en)* | 1993-11-19 | 1997-04-01 | Hitachi, Ltd. | Computer system that enters control information by means of video camera |
| US5781650A (en)* | 1994-02-18 | 1998-07-14 | University Of Central Florida | Automatic feature detection and age classification of human faces in digital images |
| US5483745A (en)* | 1994-08-19 | 1996-01-16 | Izumi Products Company | Electric shaver |
| US5594469A (en)* | 1995-02-21 | 1997-01-14 | Mitsubishi Electric Information Technology Center America Inc. | Hand gesture machine control system |
| US5724456A (en)* | 1995-03-31 | 1998-03-03 | Polaroid Corporation | Brightness adjustment of images using digital scene analysis |
| US5870138A (en)* | 1995-03-31 | 1999-02-09 | Hitachi, Ltd. | Facial image processing |
| US5710833A (en)* | 1995-04-20 | 1998-01-20 | Massachusetts Institute Of Technology | Detection, recognition and coding of complex objects using probabilistic eigenspace analysis |
| US5642431A (en)* | 1995-06-07 | 1997-06-24 | Massachusetts Institute Of Technology | Network-based system and method for detection of faces and the like |
| US6010111A (en)* | 1996-11-15 | 2000-01-04 | Samsung Electronics Co., Ltd. | Swiveling device for liquid crystal display monitor |
| US6249315B1 (en)* | 1997-03-24 | 2001-06-19 | Jack M. Holm | Strategy for pictorial digital image processing |
| US6075895A (en)* | 1997-06-20 | 2000-06-13 | Holoplex | Methods and apparatus for gesture recognition based on templates |
| US6188777B1 (en)* | 1997-08-01 | 2001-02-13 | Interval Research Corporation | Method and apparatus for personnel detection and tracking |
| US5920988A (en)* | 1997-08-04 | 1999-07-13 | Izumi Products Company | Electric shaver |
| US7042440B2 (en)* | 1997-08-22 | 2006-05-09 | Pryor Timothy R | Man machine interfaces and applications |
| US6407777B1 (en)* | 1997-10-09 | 2002-06-18 | Deluca Michael Joseph | Red-eye filter method and apparatus |
| US6072494A (en)* | 1997-10-15 | 2000-06-06 | Electric Planet, Inc. | Method and apparatus for real-time gesture recognition |
| US6256033B1 (en)* | 1997-10-15 | 2001-07-03 | Electric Planet | Method and apparatus for real-time gesture recognition |
| US6176782B1 (en)* | 1997-12-22 | 2001-01-23 | Philips Electronics North America Corp. | Motion-based command generation technology |
| US6535243B1 (en)* | 1998-01-06 | 2003-03-18 | Hewlett- Packard Company | Wireless hand-held digital camera |
| US6268939B1 (en)* | 1998-01-08 | 2001-07-31 | Xerox Corporation | Method and apparatus for correcting luminance and chrominance data in digital color images |
| US6504942B1 (en)* | 1998-01-23 | 2003-01-07 | Sharp Kabushiki Kaisha | Method of and apparatus for detecting a face-like region and observer tracking display |
| US7487375B2 (en)* | 1998-03-06 | 2009-02-03 | Intel Corporation | Method and apparatus for powering on an electronic device with a video camera that detects motion |
| US6192149B1 (en)* | 1998-04-08 | 2001-02-20 | Xerox Corporation | Method and apparatus for automatic detection of image target gamma |
| US6552743B1 (en)* | 1998-04-08 | 2003-04-22 | Hewlett Packard Development Company, L.P. | Digital camera-ready printer |
| US6252888B1 (en)* | 1998-04-14 | 2001-06-26 | Nortel Networks Corporation | Method and apparatus providing network communications between devices using frames with multiple formats |
| US6404900B1 (en)* | 1998-06-22 | 2002-06-11 | Sharp Laboratories Of America, Inc. | Method for robust human face tracking in presence of multiple persons |
| US20020036617A1 (en)* | 1998-08-21 | 2002-03-28 | Timothy R. Pryor | Novel man machine interfaces and applications |
| US6396391B1 (en)* | 1998-08-27 | 2002-05-28 | Serconet Ltd. | Communications and control network having multiple power supplies |
| US6677969B1 (en)* | 1998-09-25 | 2004-01-13 | Sanyo Electric Co., Ltd. | Instruction recognition system having gesture recognition function |
| US6359612B1 (en)* | 1998-09-30 | 2002-03-19 | Siemens Aktiengesellschaft | Imaging system for displaying image information that has been acquired by means of a medical diagnostic imaging device |
| US20020057383A1 (en)* | 1998-10-13 | 2002-05-16 | Ryuichi Iwamura | Motion sensing interface |
| US6351222B1 (en)* | 1998-10-30 | 2002-02-26 | Ati International Srl | Method and apparatus for receiving an input by an entertainment device |
| US6348928B1 (en)* | 1998-11-13 | 2002-02-19 | Lg Electronics Inc. | Apparatus for automatically rotating visual display unit and method therefor |
| US6222465B1 (en)* | 1998-12-09 | 2001-04-24 | Lucent Technologies Inc. | Gesture-based computer interface |
| US6263113B1 (en)* | 1998-12-11 | 2001-07-17 | Philips Electronics North America Corp. | Method for detecting a face in a digital image |
| US6421468B1 (en)* | 1999-01-06 | 2002-07-16 | Seiko Epson Corporation | Method and apparatus for sharpening an image by scaling elements of a frequency-domain representation |
| US6393148B1 (en)* | 1999-05-13 | 2002-05-21 | Hewlett-Packard Company | Contrast enhancement of an image using luminance and RGB statistical metrics |
| US6766036B1 (en)* | 1999-07-08 | 2004-07-20 | Timothy R. Pryor | Camera based man machine interfaces |
| US6690677B1 (en)* | 1999-07-20 | 2004-02-10 | Serconet Ltd. | Network for telephony and data communication |
| US6179264B1 (en)* | 1999-07-22 | 2001-01-30 | Sony Corporation | Rolling base stand for computer monitors and other appliances |
| US7050606B2 (en)* | 1999-08-10 | 2006-05-23 | Cybernet Systems Corporation | Tracking and gesture recognition system particularly suited to vehicular control applications |
| US6526161B1 (en)* | 1999-08-30 | 2003-02-25 | Koninklijke Philips Electronics N.V. | System and method for biometrics-based facial feature extraction |
| US6567101B1 (en)* | 1999-10-13 | 2003-05-20 | Gateway, Inc. | System and method utilizing motion input for manipulating a display of data |
| US6504951B1 (en)* | 1999-11-29 | 2003-01-07 | Eastman Kodak Company | Method for detecting sky in images |
| US6549616B1 (en)* | 2000-03-20 | 2003-04-15 | Serconet Ltd. | Telephone outlet for implementing a local area network over telephone lines and a local area network using such outlets |
| US6842459B1 (en)* | 2000-04-19 | 2005-01-11 | Serconet Ltd. | Network combining wired and non-wired segments |
| US6504707B2 (en)* | 2000-06-14 | 2003-01-07 | International Business Machines Corporation | Portable computer |
| US20020041260A1 (en)* | 2000-08-11 | 2002-04-11 | Norbert Grassmann | System and method of operator control |
| US7058204B2 (en)* | 2000-10-03 | 2006-06-06 | Gesturetek, Inc. | Multiple camera control system |
| US6871402B2 (en)* | 2000-10-20 | 2005-03-29 | Braun Gmbh | Electrically driven hair removal device |
| US6560319B1 (en)* | 2001-01-16 | 2003-05-06 | Serconet Ltd. | Method and telephone outlet for allowing telephone and data equipment to be connected to a telephone line via a common connector |
| US6931596B2 (en)* | 2001-03-05 | 2005-08-16 | Koninklijke Philips Electronics N.V. | Automatic positioning of display depending upon the viewer's location |
| US7542554B2 (en)* | 2001-07-05 | 2009-06-02 | Serconet, Ltd | Telephone outlet with packet telephony adapter, and a network using same |
| US6516154B1 (en)* | 2001-07-17 | 2003-02-04 | Eastman Kodak Company | Image revising camera and method |
| US7680298B2 (en)* | 2001-09-28 | 2010-03-16 | At&T Intellectual Property I, L. P. | Methods, systems, and products for gesture-activated appliances |
| US6564144B1 (en)* | 2002-01-10 | 2003-05-13 | Navigation Technologies Corporation | Method and system using a hand-gesture responsive device for collecting data for a geographic database |
| US7227976B1 (en)* | 2002-07-08 | 2007-06-05 | Videomining Corporation | Method and system for real-time facial image enhancement |
| US7530019B2 (en)* | 2002-08-23 | 2009-05-05 | International Business Machines Corporation | Method and system for a user-following interface |
| US7680287B2 (en)* | 2002-09-17 | 2010-03-16 | Kabushiki Kaisha Toshiba | Directional setting apparatus, directional setting system, directional setting method and directional setting program |
| US7289645B2 (en)* | 2002-10-25 | 2007-10-30 | Mitsubishi Fuso Truck And Bus Corporation | Hand pattern switch device |
| US7522615B2 (en)* | 2002-11-13 | 2009-04-21 | Serconet, Ltd. | Addressable outlet, and a network using same |
| US20060071135A1 (en)* | 2002-12-06 | 2006-04-06 | Koninklijke Philips Electronics, N.V. | Apparatus and method for automated positioning of a device |
| US7317793B2 (en)* | 2003-01-30 | 2008-01-08 | Serconet Ltd | Method and system for providing DC power on local telephone lines |
| US7405725B2 (en)* | 2003-01-31 | 2008-07-29 | Olympus Corporation | Movement detection device and communication apparatus |
| US7508961B2 (en)* | 2003-03-12 | 2009-03-24 | Eastman Kodak Company | Method and system for face detection in digital images |
| US7059733B2 (en)* | 2003-03-18 | 2006-06-13 | Hitachi, Ltd. | Display apparatus |
| US7391888B2 (en)* | 2003-05-30 | 2008-06-24 | Microsoft Corporation | Head pose assessment methods and systems |
| US7315630B2 (en)* | 2003-06-26 | 2008-01-01 | Fotonation Vision Limited | Perfecting of digital image rendering parameters within rendering devices using face detection |
| US7317815B2 (en)* | 2003-06-26 | 2008-01-08 | Fotonation Vision Limited | Digital image processing composition using face detection information |
| US20050063564A1 (en)* | 2003-08-11 | 2005-03-24 | Keiichi Yamamoto | Hand pattern switch device |
| US7327385B2 (en)* | 2003-11-20 | 2008-02-05 | Texas Instruments Incorporated | Home picture/video display system with ultra wide-band technology |
| US20050132585A1 (en)* | 2003-12-18 | 2005-06-23 | Michael Weber | Flexible mirror attachment for electric shaver |
| US20060067367A1 (en)* | 2004-09-25 | 2006-03-30 | Samsung Electronics Co., Ltd | Method for selecting timing master in synchronous ethernet system |
| US7702130B2 (en)* | 2004-12-20 | 2010-04-20 | Electronics And Telecommunications Research Institute | User interface apparatus using hand gesture recognition and method thereof |
| US7521943B2 (en)* | 2005-01-23 | 2009-04-21 | Serconet, Ltd. | Device, method and system for estimating the termination to a wired transmission-line based on determination of characteristic impedance |
| US7598942B2 (en)* | 2005-02-08 | 2009-10-06 | Oblong Industries, Inc. | System and method for gesture based control system |
| US20070126884A1 (en)* | 2005-12-05 | 2007-06-07 | Samsung Electronics, Co., Ltd. | Personal settings, parental control, and energy saving control of television with digital video camera |
| US20070132725A1 (en)* | 2005-12-14 | 2007-06-14 | Victor Company Of Japan, Limited. | Electronic Appliance |
| US20070173202A1 (en)* | 2006-01-11 | 2007-07-26 | Serconet Ltd. | Apparatus and method for frequency shifting of a wireless signal and systems using frequency shifting |
| US20080028616A1 (en)* | 2006-08-02 | 2008-02-07 | Kwak Dong Shin | Shaver with lighting means |
| US7952561B2 (en)* | 2006-11-17 | 2011-05-31 | Samsung Electronics Co., Ltd. | Method and apparatus for controlling application using motion of image pickup unit |
| US7975243B2 (en)* | 2008-02-25 | 2011-07-05 | Samsung Electronics Co., Ltd. | System and method for television control using hand gestures |
| US20100211918A1 (en)* | 2009-02-17 | 2010-08-19 | Microsoft Corporation | Web Cam Based User Interaction |
Cited By (173)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11206342B2 (en) | 2008-12-30 | 2021-12-21 | May Patents Ltd. | Electric shaver with imaging capability |
| US12081847B2 (en) | 2008-12-30 | 2024-09-03 | May Patents Ltd. | Electric shaver with imaging capability |
| US10449681B2 (en) | 2008-12-30 | 2019-10-22 | May Patents Ltd. | Electric shaver with imaging capability |
| US10456933B2 (en) | 2008-12-30 | 2019-10-29 | May Patents Ltd. | Electric shaver with imaging capability |
| US10456934B2 (en) | 2008-12-30 | 2019-10-29 | May Patents Ltd. | Electric hygiene device with imaging capability |
| US10500741B2 (en) | 2008-12-30 | 2019-12-10 | May Patents Ltd. | Electric shaver with imaging capability |
| US9950434B2 (en) | 2008-12-30 | 2018-04-24 | May Patents Ltd. | Electric shaver with imaging capability |
| US9950435B2 (en)* | 2008-12-30 | 2018-04-24 | May Patents Ltd. | Electric shaver with imaging capability |
| US10661458B2 (en) | 2008-12-30 | 2020-05-26 | May Patents Ltd. | Electric shaver with imaging capability |
| US9848174B2 (en) | 2008-12-30 | 2017-12-19 | May Patents Ltd. | Electric shaver with imaging capability |
| US10695922B2 (en) | 2008-12-30 | 2020-06-30 | May Patents Ltd. | Electric shaver with imaging capability |
| US10730196B2 (en) | 2008-12-30 | 2020-08-04 | May Patents Ltd. | Electric shaver with imaging capability |
| US10863071B2 (en) | 2008-12-30 | 2020-12-08 | May Patents Ltd. | Electric shaver with imaging capability |
| US10868948B2 (en) | 2008-12-30 | 2020-12-15 | May Patents Ltd. | Electric shaver with imaging capability |
| US20120320180A1 (en)* | 2008-12-30 | 2012-12-20 | May Patents Ltd. | Electric shaver with imaging capability |
| US10958819B2 (en) | 2008-12-30 | 2021-03-23 | May Patents Ltd. | Electric shaver with imaging capability |
| US10986259B2 (en) | 2008-12-30 | 2021-04-20 | May Patents Ltd. | Electric shaver with imaging capability |
| US10999484B2 (en) | 2008-12-30 | 2021-05-04 | May Patents Ltd. | Electric shaver with imaging capability |
| US11006029B2 (en) | 2008-12-30 | 2021-05-11 | May Patents Ltd. | Electric shaver with imaging capability |
| US12389092B1 (en) | 2008-12-30 | 2025-08-12 | May Patents Ltd. | Electric shaver with imaging capability |
| US11206343B2 (en) | 2008-12-30 | 2021-12-21 | May Patents Ltd. | Electric shaver with imaging capability |
| US12309468B2 (en) | 2008-12-30 | 2025-05-20 | May Patents Ltd. | Electric shaver with imaging capability |
| US12284428B2 (en) | 2008-12-30 | 2025-04-22 | May Patents Ltd. | Electric shaver with imaging capability |
| US11438495B2 (en) | 2008-12-30 | 2022-09-06 | May Patents Ltd. | Electric shaver with imaging capability |
| US12075139B2 (en) | 2008-12-30 | 2024-08-27 | May Patents Ltd. | Electric shaver with imaging capability |
| US11985397B2 (en) | 2008-12-30 | 2024-05-14 | May Patents Ltd. | Electric shaver with imaging capability |
| US11838607B2 (en) | 2008-12-30 | 2023-12-05 | May Patents Ltd. | Electric shaver with imaging capability |
| US11570347B2 (en) | 2008-12-30 | 2023-01-31 | May Patents Ltd. | Non-visible spectrum line-powered camera |
| US11778290B2 (en) | 2008-12-30 | 2023-10-03 | May Patents Ltd. | Electric shaver with imaging capability |
| US11758249B2 (en) | 2008-12-30 | 2023-09-12 | May Patents Ltd. | Electric shaver with imaging capability |
| US11716523B2 (en) | 2008-12-30 | 2023-08-01 | Volteon Llc | Electric shaver with imaging capability |
| US10220529B2 (en) | 2008-12-30 | 2019-03-05 | May Patents Ltd. | Electric hygiene device with imaging capability |
| US11616898B2 (en) | 2008-12-30 | 2023-03-28 | May Patents Ltd. | Oral hygiene device with wireless connectivity |
| US11297216B2 (en) | 2008-12-30 | 2022-04-05 | May Patents Ltd. | Electric shaver with imaging capabtility |
| US11575817B2 (en) | 2008-12-30 | 2023-02-07 | May Patents Ltd. | Electric shaver with imaging capability |
| US11303791B2 (en) | 2008-12-30 | 2022-04-12 | May Patents Ltd. | Electric shaver with imaging capability |
| US11575818B2 (en) | 2008-12-30 | 2023-02-07 | May Patents Ltd. | Electric shaver with imaging capability |
| US11303792B2 (en) | 2008-12-30 | 2022-04-12 | May Patents Ltd. | Electric shaver with imaging capability |
| US11800207B2 (en) | 2008-12-30 | 2023-10-24 | May Patents Ltd. | Electric shaver with imaging capability |
| US11563878B2 (en) | 2008-12-30 | 2023-01-24 | May Patents Ltd. | Method for non-visible spectrum images capturing and manipulating thereof |
| US11509808B2 (en) | 2008-12-30 | 2022-11-22 | May Patents Ltd. | Electric shaver with imaging capability |
| US11336809B2 (en) | 2008-12-30 | 2022-05-17 | May Patents Ltd. | Electric shaver with imaging capability |
| US11445100B2 (en) | 2008-12-30 | 2022-09-13 | May Patents Ltd. | Electric shaver with imaging capability |
| US11356588B2 (en) | 2008-12-30 | 2022-06-07 | May Patents Ltd. | Electric shaver with imaging capability |
| US9174351B2 (en)* | 2008-12-30 | 2015-11-03 | May Patents Ltd. | Electric shaver with imaging capability |
| US20160001453A1 (en)* | 2008-12-30 | 2016-01-07 | May Patents Ltd. | Electric shaver with imaging capability |
| US20100228494A1 (en)* | 2009-03-05 | 2010-09-09 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Postural information system and method including determining subject advisory information based on prior determined subject advisory information |
| US20110238218A1 (en)* | 2010-03-26 | 2011-09-29 | Hon Hai Precision Industry Co., Ltd. | Mirror and adjustment method therefor |
| US8433444B2 (en)* | 2010-03-26 | 2013-04-30 | Hon Hai Precision Industry Co., Ltd. | Mirror and adjustment method therefor |
| US20140313297A1 (en)* | 2010-04-16 | 2014-10-23 | Samsung Electronics Co., Ltd. | Display apparatus, 3d glasses, and display system including the same |
| US9247232B2 (en)* | 2010-04-16 | 2016-01-26 | Samsung Electronics Co., Ltd. | Display apparatus, 3D glasses, and display system including the same |
| US20110261038A1 (en)* | 2010-04-26 | 2011-10-27 | Hon Hai Precision Industry Co., Ltd. | Electronic device and method of adjusting viewing angles of liquid crystal displays |
| US20110289455A1 (en)* | 2010-05-18 | 2011-11-24 | Microsoft Corporation | Gestures And Gesture Recognition For Manipulating A User-Interface |
| US8457353B2 (en) | 2010-05-18 | 2013-06-04 | Microsoft Corporation | Gestures and gesture modifiers for manipulating a user-interface |
| US20110298967A1 (en)* | 2010-06-04 | 2011-12-08 | Microsoft Corporation | Controlling Power Levels Of Electronic Devices Through User Interaction |
| US9113190B2 (en)* | 2010-06-04 | 2015-08-18 | Microsoft Technology Licensing, Llc | Controlling power levels of electronic devices through user interaction |
| US8896691B2 (en)* | 2010-07-26 | 2014-11-25 | Gemtek Technology Co., Ltd. | Surveillance device and method |
| US20120019657A1 (en)* | 2010-07-26 | 2012-01-26 | Hsun-Hsien Lee | Surveillance device and method |
| US8502865B2 (en)* | 2010-07-30 | 2013-08-06 | Hon Hai Precision Industry Co., Ltd. | Mirror and adjustment method therefor |
| US20120026617A1 (en)* | 2010-07-30 | 2012-02-02 | Hon Hai Precision Industry Co., Ltd. | Mirror and adjustment method therefor |
| US20120044142A1 (en)* | 2010-08-19 | 2012-02-23 | TPV Electronics (Fujian) Co., Ltd. | Display having auto-off function by person infrared sensing |
| WO2012030265A1 (en)* | 2010-08-30 | 2012-03-08 | Telefonaktiebolaget L M Ericsson (Publ) | Face screen orientation and related devices and methods |
| US20120098748A1 (en)* | 2010-10-21 | 2012-04-26 | Hon Hai Precision Industry Co., Ltd. | Button assembly and computer mouse having the same |
| WO2012077922A3 (en)* | 2010-12-06 | 2012-10-11 | Samsung Electronics Co., Ltd. | 3 dimensional (3d) display system of responding to user motion and user interface for the 3d display system |
| CN103250124A (en)* | 2010-12-06 | 2013-08-14 | 三星电子株式会社 | 3D display system responsive to user motion and user interface for the 3D display system |
| US20120229300A1 (en)* | 2011-03-11 | 2012-09-13 | Wistron Corporation | Holder Device Capable of Automatically Adjusting Orientation of an Electronic Device Placed Thereon, and Assembly of Holder Device and Electronic Device |
| US8981962B2 (en)* | 2011-03-11 | 2015-03-17 | Wistron Corporation | Holder device capable of automatically adjusting orientation of an electronic device placed thereon, and assembly of holder device and electronic device |
| US20120236180A1 (en)* | 2011-03-15 | 2012-09-20 | Zhao-Yuan Lin | Image adjustment method and electronics system using the same |
| US9372544B2 (en) | 2011-05-31 | 2016-06-21 | Microsoft Technology Licensing, Llc | Gesture recognition techniques |
| US10331222B2 (en) | 2011-05-31 | 2019-06-25 | Microsoft Technology Licensing, Llc | Gesture recognition techniques |
| US20120313896A1 (en)* | 2011-06-07 | 2012-12-13 | Sony Corporation | Information processing apparatus, information processing method, and program |
| US9766796B2 (en)* | 2011-06-07 | 2017-09-19 | Sony Corporation | Information processing apparatus, information processing method, and program |
| US9733718B2 (en) | 2011-10-07 | 2017-08-15 | Samsung Electronics Co., Ltd. | Display apparatus and display method thereof |
| EP2587830A3 (en)* | 2011-10-07 | 2013-06-05 | Samsung Electronics Co., Ltd. | Display apparatus and display method thereof |
| US8947488B2 (en) | 2011-10-07 | 2015-02-03 | Samsung Electronics Co., Ltd. | Display apparatus and display method thereof |
| US9154837B2 (en) | 2011-12-02 | 2015-10-06 | Microsoft Technology Licensing, Llc | User interface presenting an animated avatar performing a media reaction |
| US10798438B2 (en) | 2011-12-09 | 2020-10-06 | Microsoft Technology Licensing, Llc | Determining audience state or interest using passive sensor data |
| US9628844B2 (en) | 2011-12-09 | 2017-04-18 | Microsoft Technology Licensing, Llc | Determining audience state or interest using passive sensor data |
| US9100685B2 (en) | 2011-12-09 | 2015-08-04 | Microsoft Technology Licensing, Llc | Determining audience state or interest using passive sensor data |
| US20150035746A1 (en)* | 2011-12-27 | 2015-02-05 | Andy Cockburn | User Interface Device |
| US11349925B2 (en) | 2012-01-03 | 2022-05-31 | May Patents Ltd. | System and method for server based control |
| US12177301B2 (en) | 2012-01-09 | 2024-12-24 | May Patents Ltd. | System and method for server based control |
| US11375018B2 (en) | 2012-01-09 | 2022-06-28 | May Patents Ltd. | System and method for server based control |
| US12231497B2 (en) | 2012-01-09 | 2025-02-18 | May Patents Ltd. | Controlled AC power plug with a sensor |
| US12192283B2 (en) | 2012-01-09 | 2025-01-07 | May Patents Ltd. | System and method for server based control |
| US11245765B2 (en) | 2012-01-09 | 2022-02-08 | May Patents Ltd. | System and method for server based control |
| US12149589B2 (en) | 2012-01-09 | 2024-11-19 | May Patents Ltd. | Controlled AC power plug with an actuator |
| US12137144B2 (en) | 2012-01-09 | 2024-11-05 | May Patents Ltd. | System and method for server based control |
| US12088670B2 (en) | 2012-01-09 | 2024-09-10 | May Patents Ltd. | System and method for server based control |
| US11240311B2 (en) | 2012-01-09 | 2022-02-01 | May Patents Ltd. | System and method for server based control |
| US12081620B2 (en) | 2012-01-09 | 2024-09-03 | May Patents Ltd. | System and method for server based control |
| US12401721B1 (en) | 2012-01-09 | 2025-08-26 | May Patents Ltd. | System and method for server based control |
| US12010174B2 (en) | 2012-01-09 | 2024-06-11 | May Patents Ltd. | System and method for server based control |
| US11190590B2 (en) | 2012-01-09 | 2021-11-30 | May Patents Ltd. | System and method for server based control |
| US11336726B2 (en) | 2012-01-09 | 2022-05-17 | May Patents Ltd. | System and method for server based control |
| US11128710B2 (en) | 2012-01-09 | 2021-09-21 | May Patents Ltd. | System and method for server-based control |
| US10868867B2 (en) | 2012-01-09 | 2020-12-15 | May Patents Ltd. | System and method for server based control |
| US11979461B2 (en) | 2012-01-09 | 2024-05-07 | May Patents Ltd. | System and method for server based control |
| US12401720B1 (en) | 2012-01-09 | 2025-08-26 | May Patents Ltd. | System and method for server based control |
| US11824933B2 (en) | 2012-01-09 | 2023-11-21 | May Patents Ltd. | System and method for server based control |
| US12316706B2 (en) | 2012-01-09 | 2025-05-27 | May Patents Ltd. | System and method for server based control |
| US20130201345A1 (en)* | 2012-02-06 | 2013-08-08 | Huawei Technologies Co., Ltd. | Method and apparatus for controlling video device and video system |
| US20130229346A1 (en)* | 2012-03-05 | 2013-09-05 | E.G.O. Elektro-Geraetebau Gmbh | Method and apparatus for a camera module for operating gesture recognition and home appliance |
| CN103309438A (en)* | 2012-03-15 | 2013-09-18 | 欧姆龙株式会社 | Gesture input apparatus, control method thereof, electronic device and gesture input system |
| US20130241830A1 (en)* | 2012-03-15 | 2013-09-19 | Omron Corporation | Gesture input apparatus, control program, computer-readable recording medium, electronic device, gesture input system, and control method of gesture input apparatus |
| US9300875B2 (en)* | 2012-03-23 | 2016-03-29 | Panasonic Intellectual Property Management Co., Ltd. | Imaging device display controller |
| JP2013225835A (en)* | 2012-03-23 | 2013-10-31 | Panasonic Corp | Imaging apparatus |
| US20130250158A1 (en)* | 2012-03-23 | 2013-09-26 | Panasonic Corporation | Imaging device |
| US8898687B2 (en) | 2012-04-04 | 2014-11-25 | Microsoft Corporation | Controlling a media program based on a media reaction |
| US11100608B2 (en) | 2012-04-17 | 2021-08-24 | Imdb, Inc. | Determining display orientations for portable devices |
| US10186018B2 (en) | 2012-04-17 | 2019-01-22 | Imdb.Com, Inc. | Determining display orientations for portable devices |
| US9342143B1 (en)* | 2012-04-17 | 2016-05-17 | Imdb.Com, Inc. | Determining display orientations for portable devices |
| US8959541B2 (en) | 2012-05-04 | 2015-02-17 | Microsoft Technology Licensing, Llc | Determining a future portion of a currently presented media program |
| US9788032B2 (en) | 2012-05-04 | 2017-10-10 | Microsoft Technology Licensing, Llc | Determining a future portion of a currently presented media program |
| US8837780B2 (en) | 2012-06-22 | 2014-09-16 | Hewlett-Packard Development Company, L.P. | Gesture based human interfaces |
| WO2014004149A1 (en)* | 2012-06-28 | 2014-01-03 | Intel Corporation | System and method for adaptive data processing |
| WO2014065771A1 (en)* | 2012-10-22 | 2014-05-01 | Echostar Ukraine, L.L.C. | Alternate approach for controlling entertainment equipment |
| US10104122B2 (en)* | 2012-11-30 | 2018-10-16 | Intel Corporation | Verified sensor data processing |
| US11119577B2 (en)* | 2013-02-01 | 2021-09-14 | Samsung Electronics Co., Ltd | Method of controlling an operation of a camera apparatus and a camera apparatus |
| US20190138110A1 (en)* | 2013-02-01 | 2019-05-09 | Samsung Electronics Co., Ltd. | Method of controlling an operation of a camera apparatus and a camera apparatus |
| US20140240342A1 (en)* | 2013-02-26 | 2014-08-28 | Lenovo (Beijing) Limited | Display screen, electronic device and information processing method for the electronic device |
| US9812075B2 (en)* | 2013-02-26 | 2017-11-07 | Beijing Lenovo Software Ltd. | Display screen, electronic device and information processing method for the electronic device |
| US9690403B2 (en) | 2013-03-15 | 2017-06-27 | Blackberry Limited | Shared document editing and voting using active stylus based touch-sensitive displays |
| US20140333671A1 (en)* | 2013-05-10 | 2014-11-13 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
| US9628744B2 (en)* | 2013-05-10 | 2017-04-18 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
| US9494683B1 (en)* | 2013-06-18 | 2016-11-15 | Amazon Technologies, Inc. | Audio-based gesture detection |
| US10884493B2 (en)* | 2013-06-20 | 2021-01-05 | Uday Parshionikar | Gesture based user interfaces, apparatuses and systems using eye tracking, head tracking, hand tracking, facial expressions and other user actions |
| US10137363B2 (en)* | 2013-06-20 | 2018-11-27 | Uday Parshionikar | Gesture based user interfaces, apparatuses and control systems |
| US10254844B2 (en)* | 2013-06-20 | 2019-04-09 | Uday Parshionikar | Systems, methods, apparatuses, computer readable medium for controlling electronic devices |
| US11402902B2 (en)* | 2013-06-20 | 2022-08-02 | Perceptive Devices Llc | Gesture based user interfaces, apparatuses and systems using eye tracking, head tracking, hand tracking, facial expressions and other user actions |
| US11977677B2 (en)* | 2013-06-20 | 2024-05-07 | Uday Parshionikar | Gesture based user interfaces, apparatuses and systems using eye tracking, head tracking, hand tracking, facial expressions and other user actions |
| US20180364810A1 (en)* | 2013-06-20 | 2018-12-20 | Uday Parshionikar | Gesture control via eye tracking, head tracking, facial expressions and other user actions |
| US20160109961A1 (en)* | 2013-06-20 | 2016-04-21 | Uday Parshionikar | Systems, methods, apparatuses, computer readable medium for controlling electronic devices |
| US20220374078A1 (en)* | 2013-06-20 | 2022-11-24 | Uday Parshionikar | Gesture based user interfaces, apparatuses and systems using eye tracking, head tracking, hand tracking, facial expressions and other user actions |
| US10558272B2 (en)* | 2013-06-20 | 2020-02-11 | Uday Parshionikar | Gesture control via eye tracking, head tracking, facial expressions and other user actions |
| US20150201124A1 (en)* | 2014-01-15 | 2015-07-16 | Samsung Electronics Co., Ltd. | Camera system and method for remotely controlling compositions of self-portrait pictures using hand gestures |
| CN103885566A (en)* | 2014-03-07 | 2014-06-25 | 京东方科技集团股份有限公司 | Power supply control method of displaying device and displaying device |
| US9632558B2 (en) | 2014-03-07 | 2017-04-25 | Boe Technology Group Co., Ltd. | Power supply control method for display device and display device |
| US20170182406A1 (en)* | 2014-03-21 | 2017-06-29 | Audience Entertainment Llc | Adaptive group interactive motion control system and method for 2d and 3d video |
| US9727778B2 (en)* | 2014-03-28 | 2017-08-08 | Wipro Limited | System and method for guided continuous body tracking for complex interaction |
| US20150278586A1 (en)* | 2014-03-28 | 2015-10-01 | Wipro Limited | System and method for guided continuous body tracking for complex interaction |
| US20240295922A1 (en)* | 2014-06-20 | 2024-09-05 | Uday Parshionikar | Gesture based user interfaces, apparatuses and systems using eye tracking, head tracking, hand tracking, facial expressions and other user actions |
| US12158987B2 (en)* | 2014-06-20 | 2024-12-03 | Perceptive Devices Llc | Gesture based user interfaces, apparatuses and systems using eye tracking, head tracking, hand tracking, facial expressions and other user actions |
| US9940533B2 (en) | 2014-09-30 | 2018-04-10 | Qualcomm Incorporated | Scanning window for isolating pixel values in hardware for computer vision operations |
| US9977977B2 (en) | 2014-09-30 | 2018-05-22 | Qualcomm Incorporated | Apparatus and method for low-power object-detection in images using computer vision feature computation hardware |
| US10515284B2 (en)* | 2014-09-30 | 2019-12-24 | Qualcomm Incorporated | Single-processor computer vision hardware control and application execution |
| US11068712B2 (en) | 2014-09-30 | 2021-07-20 | Qualcomm Incorporated | Low-power iris scan initialization |
| US9986211B2 (en) | 2014-09-30 | 2018-05-29 | Qualcomm Incorporated | Low-power always-on face detection, tracking, recognition and/or analysis using events-based vision sensor |
| US9696813B2 (en)* | 2015-05-27 | 2017-07-04 | Hsien-Hsiang Chiu | Gesture interface robot |
| US20160350589A1 (en)* | 2015-05-27 | 2016-12-01 | Hsien-Hsiang Chiu | Gesture Interface Robot |
| CN109154858A (en)* | 2016-03-24 | 2019-01-04 | 三星电子株式会社 | Intelligent electronic device and its operating method |
| WO2017164567A1 (en)* | 2016-03-24 | 2017-09-28 | Samsung Electronics Co., Ltd. | Intelligent electronic device and method of operating the same |
| KR20170110919A (en)* | 2016-03-24 | 2017-10-12 | 삼성전자주식회사 | Intelligent electronic device and operating method thereof |
| US10402625B2 (en) | 2016-03-24 | 2019-09-03 | Samsung Electronics Co., Ltd. | Intelligent electronic device and method of operating the same |
| EP3411780A4 (en)* | 2016-03-24 | 2019-02-06 | Samsung Electronics Co., Ltd. | INTELLIGENT ELECTRONIC DEVICE AND METHOD OF OPERATION |
| KR102537543B1 (en)* | 2016-03-24 | 2023-05-26 | 삼성전자주식회사 | Intelligent electronic device and operating method thereof |
| US10614332B2 (en) | 2016-12-16 | 2020-04-07 | Qualcomm Incorportaed | Light source modulation for iris size adjustment |
| US10984235B2 (en) | 2016-12-16 | 2021-04-20 | Qualcomm Incorporated | Low power data generation for iris-related detection and authentication |
| TWI763769B (en)* | 2017-01-23 | 2022-05-11 | 美商高通公司 | Single-processor computer vision hardware control and application execution |
| US11250544B2 (en)* | 2017-08-11 | 2022-02-15 | Samsung Electronics Co., Ltd. | Display device for visualizing contents as the display is rotated and control method thereof |
| US20220080845A1 (en)* | 2019-05-27 | 2022-03-17 | Abb Schweiz Ag | Electric vehicle supply equipment for charging an electrical vehicle |
| EP3813357A1 (en)* | 2019-10-21 | 2021-04-28 | Top Victory Investments Limited | Method and system for automatically switching off a display screen of a television device |
| CN110913190A (en)* | 2019-12-02 | 2020-03-24 | 淄博职业学院 | A digital media playback device capable of human-computer interaction |
| US11614198B2 (en)* | 2019-12-13 | 2023-03-28 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Display and audio systems and methods for controlling positioning of displays and speakers based on viewer and listener attention |
| US20210180740A1 (en)* | 2019-12-13 | 2021-06-17 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Display and audio systems and methods for controlling positioning of displays and speakers based on viewer and listener attention |
| CN113508356A (en)* | 2020-01-24 | 2021-10-15 | 深圳市理邦精密仪器股份有限公司 | System and method for automatically adjusting display system using user tracking |
| US20220375268A1 (en)* | 2020-02-28 | 2022-11-24 | Fujifilm Corporation | Gesture recognition device, operation method for gesture recognition device, and operation program for gesture recognition device |
| US11644928B2 (en)* | 2020-03-23 | 2023-05-09 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
| WO2022021647A1 (en)* | 2020-07-30 | 2022-02-03 | 深圳创维－Rgb电子有限公司 | Smart television control method and apparatus, and rotatable television and readable storage medium |
| CN115113553A (en)* | 2021-09-03 | 2022-09-27 | 博泰车联网科技(上海)股份有限公司 | Control method, control system and control device for vehicle-mounted video and audio playing |
| US20240212358A1 (en)* | 2021-09-03 | 2024-06-27 | Pateo Connect+ Technology (Shanghai) Corporation | Control method, control system, and control device for vehicle video and audio play |
| US12412399B2 (en)* | 2021-09-03 | 2025-09-09 | Pateo Connect+ Technology (Shanghai) Corporation | Control method, control system, and control device for vehicle video and audio play |
| CN114265499A (en)* | 2021-12-17 | 2022-04-01 | 交控科技股份有限公司 | Interaction method and system applied to customer service terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| US20130235179A1 (en) | 2013-09-12 |
| US8614673B2 (en) | 2013-12-24 |
| US20160330505A1 (en) | 2016-11-10 |
| US20120235901A1 (en) | 2012-09-20 |
| US8614674B2 (en) | 2013-12-24 |
| US20120249768A1 (en) | 2012-10-04 |
| US20200186740A1 (en) | 2020-06-11 |
| US10582144B2 (en) | 2020-03-03 |
| WO2010134066A1 (en) | 2010-11-25 |
| US20160139663A1 (en) | 2016-05-19 |
| US20130258113A1 (en) | 2013-10-03 |
| US20160328605A1 (en) | 2016-11-10 |
| US20130044198A1 (en) | 2013-02-21 |
| EP2433199A1 (en) | 2012-03-28 |
| US20160134834A1 (en) | 2016-05-12 |
| US20160330395A1 (en) | 2016-11-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200186740A1 (en) | System and method for control based on face or hand gesture detection | |
| US11445100B2 (en) | Electric shaver with imaging capability |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment | Owner name:MAY PATENTS LTD., ISRAEL Free format text:ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BINDER, YEHUDA;REEL/FRAME:024622/0534 Effective date:20100520 | |
| STCB | Information on status: application discontinuation | Free format text:ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION |