US10156931B2 - Displays and information input devices - Google Patents

Abstract

An integrated display and input device includes a first pixel array operative to provide a visually sensible output, a second pixel array operative to sense at least a position of an object with respect to the first pixel array, and circuitry receiving an output from the second pixel array and providing a non-imagewise input to utilization circuitry.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of and claims priority to U.S. Non-Provisional patent application Ser. No. 12/066,238, filed on Sep. 3, 2008, now U.S. Pat. No. 9,949,972, issued on Nov. 15, 2016, which is a U.S. National Stage Entry of PCT Application No. PCT/IL2006/001047, filed on Sep. 7, 2006, which claims priority to U.S. Provisional Patent Application No. 60/715,546, filed on Sep. 8, 2005, and to U.S. Provisional Patent Application No. 60/734,027 filed on Nov. 3, 2005, the contents of which are hereby incorporated by reference in their entirety.

TECHNICAL FIELD

The present disclosure relates to displays and information input devices.

BACKGROUND

The following published patent documents, the disclosures of which are hereby incorporated by reference, are believed to represent the current state of the art: Great Britain Patent Numbers: GB2299856 and GB2289756; European Patent Number: EP0572182; PCT Patent Application Publication Numbers: WO02/043045 and WO95/02801; and U.S. Pat. Nos. 6,094,188; 6,081,255; 5,926,168; 5,892,501; 5,448,261; 5,227,985; 5,949,402; 5,959,617; 5,122,656; 5,506,605 and 4,320,292.

SUMMARY

The present disclosure seeks describes an integrated display and input device. In accordance with one preferred embodiment of the present disclosure an integrated display and input device including a first pixel array operative to provide a visually sensible output, a second pixel array operative to sense at least a position of an object with respect to the first pixel array and circuitry receiving an output from the second pixel array and providing a non-imagewise input to utilization circuitry.

In accordance with another preferred embodiment of the present disclosure the integrated display and input device also includes utilization circuitry providing one or more of portable communicator functionality, interactive television functionality and portable computer functionality. Preferably, the second pixel array includes a plurality of detector elements arranged in a plane parallel to a viewing plane. Additionally or alternatively, the second pixel array is coplanar with the first pixel array.

In accordance with another preferred embodiment of the present disclosure the first and second pixel arrays include a plurality of elements arranged in parallel planes, parallel to a viewing plane. Preferably, the second pixel array includes a detector assembly arranged at least one edge of a viewing plane defining plate. Additionally, the detector assembly is arranged about the at least one edge of the viewing plane defining plate. Alternatively, the detector assembly is arranged along the at least one edge of the viewing plane defining plate.

In accordance with yet another preferred embodiment of the present disclosure the detector assembly includes a support substrate and an arrangement of detector elements. Preferably the detector assembly also includes a cover layer. Additionally or alternatively, the support substrate is integrated with a housing of the integrated display and input device.

In accordance with still another preferred embodiment of the present disclosure the arrangement of detector elements includes a plurality of discrete single-element detectors. Alternatively, the arrangement of detector elements includes an integrally formed multi-element detector array. As a further alternative, the arrangement of detector elements includes a plurality of discrete multi-element detectors.

In accordance with a further preferred embodiment of the present disclosure the cover layer is formed of a light transmissive material. Alternatively, the cover layer includes a mask having apertures defined therein. As a further alternative the cover layer includes a field-of-view defining mask having light-collimating tunnel-defining apertures. As yet a further alternative the cover layer includes lenses.

In accordance with yet a further preferred embodiment of the present disclosure the at least one edge includes a mask having apertures defined therein. Alternatively, the at least one edge includes a field-of-view defining mask having light-collimating tunnel-defining apertures. As a further alternative the at least one edge includes lenses. Preferably, the second pixel array includes a plurality of generally forward-facing detectors arranged about edges of a display element.

In accordance with still another preferred embodiment of the present disclosure at least one detector in the arrangement detects electromagnetic radiation at a baseline level and senses the position of the object with respect to the first pixel array and the circuitry provides the non-imagewise input according to location of at least one detector in the arrangement for which at least one of the amount of radiation detected and the change in the amount of radiation detected exceed a first predetermined threshold.

In accordance with an additional preferred embodiment of the present disclosure the change in the amount of radiation detected results from at least one detector in the arrangement detecting reflected light from the object in addition to detecting the radiation at the baseline level. Preferably, the reflected light propagates within the viewing plane defining plate to at least one detector in the arrangement. Alternatively, the reflected light propagates above the viewing plane defining plate to at least one detector in the arrangement. As a further alternative, the reflected light is transmitted through the viewing plane defining plate directly to at least one detector in the arrangement.

In accordance with another preferred embodiment of the present disclosure the at least one detector in the arrangement detects radiation at the baseline level, senses the position of the object with respect to the first pixel array and the circuitry provides the non-imagewise input according to location of at least one detector in the arrangement at which the amount of radiation detected is below a second predetermined threshold.

In accordance with yet another preferred embodiment of the present disclosure the integrated display and input device also includes a processing subassembly including detector analyzing processing circuitry operative to receive detector outputs of individual detectors in the arrangement, to determine at least one of whether the amount of radiation detected by the individual detectors exceeds the first predetermined threshold, whether the change in the amount of radiation detected by the individual detectors exceeds the first predetermined threshold and whether the amount of radiation detected by the individual detectors is below the second predetermined threshold, and to provide detector analysis outputs for the individual detectors, array processing circuitry operative to receive the detector analysis outputs of individual detectors in the arrangement and to generate an array detection output therefrom and position determining circuitry operative to receive the array detection output of the arrangement and to determine the position of the object therefrom.

In accordance with still another preferred embodiment of the present disclosure the array detection output includes information corresponding to the location of an impingement point of the object on the viewing plane defining plate. Additionally or alternatively, the array detection output includes information corresponding to the location of the object relative to the viewing plane defining plate.

In accordance with a further preferred embodiment of the present disclosure the radiation at the baseline level is provided by at least one source of illumination external to the integrated display and input device. Preferably the at least one source of illumination includes at least one of sunlight, artificial room lighting and IR illumination emitted from a human body. Additionally, the integrated display and input device also includes an illumination subassembly operative to provide illumination for augmenting the radiation at the baseline level. Alternatively, the integrated display and input device also includes an illumination subassembly operative to provide the radiation at the baseline level.

In accordance with yet a further preferred embodiment of the present disclosure the illumination subassembly includes at least one electromagnetic radiation emitting source. Preferably, the at least one electromagnetic radiation emitting source includes at least one of at least one IR emitting LED and at least one visible light emitting LED.

In accordance with another preferred embodiment of the present disclosure the at least one electromagnetic radiation emitting source is disposed at an intersection of two mutually perpendicular edges of the viewing plane defining plate. Alternatively, the at least one electromagnetic radiation emitting source forms part of a linear arrangement of display backlights underlying the viewing plane defining plate.

In accordance with yet another preferred embodiment of the present disclosure the illumination subassembly includes at least one generally linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of the viewing plane defining plate. Alternatively, at least one of the at least one generally linear arrangement is arranged behind the second pixel array.

There is also provided, in accordance with another preferred embodiment of the present disclosure, a detector assembly including an array of discrete photodiode detectors arranged in mutually spaced relationship in a plane and field-of-view limiting functionality associated with the array of discrete photodiode detectors.

There is further provided, in accordance with a further preferred embodiment of the present disclosure, a position sensing assembly including a detector subassembly including an array of discrete photodiode detectors arranged in mutually spaced relationship in a plane and field-of-view limiting functionality associated with the array of discrete photodiode detectors, and a position sensing subassembly operative to receive outputs from the array of discrete photodiode detectors and to provide an output indication of position of an object from which light is received by the array of discrete photodiode detectors.

In accordance with a preferred embodiment of the present disclosure, the array of discrete photodiode detectors includes a one-dimensional linear array. Additionally or alternatively, the field-of-view limiting functionality limits the field-of-view of at least one of the discrete photodiode detectors to a solid angle of less than or equal to 15 degrees. Preferably, the field-of-view limiting functionality limits the field-of-view of at least one of the discrete photodiode detectors to a solid angle of less than or equal to 7 degrees.

In accordance with another preferred embodiment of the present disclosure, the field-of-view limiting functionality includes an apertured mask having a thickness of less than approximately 200 microns. Alternatively, the field-of-view limiting functionality includes an apertured mask having a thickness of less than 500 microns. As a further alternative, the field-of-view limiting functionality includes an array of microlenses aligned with the array of discrete photodiode detectors.

There is also provided, in accordance with an additional preferred embodiment of the present disclosure, a position sensing assembly including a plate defining a surface and at least one pixel array including a plurality of detector elements detecting electromagnetic radiation at a baseline level, the at least one pixel array being operative to sense a position of an object with respect to the surface according to locations of ones of the plurality of detector elements at which at least one of the amount of radiation detected and the change in the amount of radiation detected exceed a predetermined threshold.

In accordance with a preferred embodiment of the present disclosure, the change in the amount of radiation detected results from ones of the plurality of detector elements detecting reflected light from the object in addition to detecting the radiation at the baseline level. Preferably, the reflected light propagates within the plate to ones of the plurality of detector elements. Alternatively, the reflected light propagates above the surface to ones of the plurality of detector elements. As a further alternative, the reflected light is transmitted through the plate directly to at least one of the plurality of detector elements.

In accordance with another preferred embodiment of the present disclosure, the position sensing assembly also includes a processing subassembly including detector analyzing processing circuitry operative to receive detector outputs of individual ones of the plurality of detector elements, to determine whether at least one of the amount of radiation and the change in the amount of radiation detected by the individual ones of the plurality detector element exceeds the predetermined threshold, and to provide detector analysis outputs for the individual ones of the plurality of detector elements, array processing circuitry operative to receive the detector analysis outputs of the plurality of detector elements of a single one of the at least one pixel array and to generate an array detection output therefrom and position determining circuitry operative to receive the array detection output of the at least one pixel array and to determine the position of the object therefrom.

In accordance with yet another preferred embodiment of the present disclosure, the array detection output includes information corresponding to the location of an impingement point of the object on the surface. Preferably, the array detection output includes information corresponding to the location of the object relative to the surface. Additionally or alternatively, the position of the object includes at least one of a two-dimensional position of the object, a three-dimensional position of the object and angular orientation of the object.

In accordance with still another preferred embodiment of the present disclosure, the radiation at the baseline level is provided by at least one source of radiation external to the position sensing assembly. Preferably the at least one source of radiation includes at least one of sunlight, artificial room lighting and IR illumination emitted from a human body. Additionally, the position sensing assembly also includes an illumination subassembly operative to provide illumination for augmenting the radiation at the baseline level. Alternatively, the position sensing assembly also includes an illumination subassembly operative to provide the radiation at the baseline level to the plurality of detector elements.

In accordance with a further preferred embodiment of the present disclosure, the illumination subassembly includes at least one electromagnetic radiation emitting source. Preferably the at least one electromagnetic radiation emitting source includes at least one of at least one IR emitting LED and at least one visible light emitting LED.

In accordance with yet a further preferred embodiment of the present disclosure, the at least one pixel array includes at least two pixel arrays arranged at mutually perpendicular edges of the plate. Preferably, the illumination subassembly includes an electromagnetic radiation emitting source disposed at an intersection of two of the at least two pixel arrays. Alternatively, the illumination subassembly includes an electromagnetic radiation emitting source disposed at an intersection of two mutually perpendicular edges of the plate, and across from an intersection point of the two of the at least two pixel arrays. As a further alternative, the illumination subassembly includes at least one electromagnetic radiation emitting source forming part of a linear arrangement of display backlights underlying the plate, which are preferably IR emitting LEDs. As yet a further alternative, the illumination subassembly includes at least one generally linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of the plate, preferably arranged such that at least one of the at least one generally linear arrangement is arranged behind at least one of the at least two pixel arrays.

In accordance with still a further preferred embodiment of the present disclosure, the at least one pixel array is arranged in a plane parallel to the surface. Preferably, the illumination subassembly includes at least one generally linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of the plate. Alternatively, the illumination subassembly includes an electromagnetic radiation emitting source disposed at an intersection of two mutually perpendicular edges of the plate.

In accordance with another preferred embodiment of the present disclosure, the at least one pixel array includes a single pixel array arranged along an edge of the plate. Preferably, the illumination subassembly includes an electromagnetic radiation emitting source disposed at an intersection of edges of the plate. Alternatively, the illumination subassembly includes at least one electromagnetic radiation emitting source forming part of a linear arrangement of display backlights underlying the plate, arranged such that the at least one electromagnetic radiation emitting source includes an IR emitting LED. As a further alternative the illumination subassembly includes at least one generally linear arrangement of a plurality of electromagnetic radiation emitting sources arranged in parallel to at least one edge of the plate, arranged such that at least one of the at least one generally linear arrangement is arranged behind the single pixel array.

It is to be appreciated that the phrase “at edges” is to be interpreted broadly as including structures which are located behind edges, as in the embodiments shown inFIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D, about edges as in the embodiments shown inFIGS. 9A-9D and 14A-4D, and along edges as in the embodiments shown inFIGS. 4-7, 8A-8D, 12A-12D and 13A-13D.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure will be more fully understood and appreciated from the following detailed description, taken in conjunction with the drawings in which:

FIGS. 1A, 1B, 1C and 1D are simplified illustrations of four types of integrated display and input devices constructed and operative in accordance with a preferred embodiment of the present disclosure;

FIGS. 2A and 2B are simplified illustrations of portions of two types of integrated display and input devices constructed and operative in accordance with another preferred embodiment of the present disclosure, including detectors arranged in a plane parallel to a viewing plane;

FIGS. 3A and 3B are simplified illustrations of portions of two types of integrated display and input devices constructed and operative in accordance with yet another preferred embodiment of the present disclosure, employing elements arranged in parallel planes, parallel to a viewing plane;

FIG. 4 is a simplified illustration of a portion of an input device constructed and operative in accordance with still another preferred embodiment of the present disclosure, employing detectors arranged along edges of a display element;

FIG. 5 is a simplified illustration of a portion of an input device constructed and operative in accordance with a further preferred embodiment of the present disclosure, employing detectors arranged along edges of a display element;

FIG. 6 is a simplified illustration of a portion of an input device constructed and operative in accordance with a yet further preferred embodiment of the present disclosure, employing detectors arranged along edges of a display element;

FIG. 7 is a simplified illustration of a portion of an input device constructed and operative in accordance with an additional preferred embodiment of the present disclosure, employing detectors arranged along edges of a display element;

FIGS. 8A, 8B, 8C and 8D are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with another preferred embodiment of the present disclosure employing detectors arranged along edges of a display element;

FIGS. 9A, 9B, 9C and 9D are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with yet another preferred embodiment of the present disclosure, employing forward-facing detectors arranged about edges of a display element;

FIGS. 10A, 10B, 10C and 10D are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with still another preferred embodiment of the present disclosure, employing forward-facing detectors arranged behind edges of a display element;

FIGS. 11A, 11B, 11C and 11D are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with a further preferred embodiment of the present disclosure, employing forward-facing detectors arranged behind edges of a display element;

FIGS. 12A, 12B, 12C and 12D are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with a yet further preferred embodiment of the present disclosure, employing detectors arranged along edges of a display element;

FIGS. 13A, 13B, 13C and 13D are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with a still further preferred embodiment of the present disclosure, employing detectors arranged along edges of a display element;

FIGS. 14A, 14B, 14C and 14D are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with an additional preferred embodiment of the present disclosure, employing forward-facing detectors arranged about edges of a display element;

FIGS. 15A, 15B, 15C and 15D are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with another preferred embodiment of the present disclosure, employing forward-facing detectors arranged behind edges of a display element;

FIGS. 16A, 16B, 16C and 16D are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with yet another preferred embodiment of the present disclosure, employing forward-facing detectors arranged behind edges of a display element;

FIGS. 17A, 17B and 17C are simplified illustrations of three alternative embodiments of a detector assembly forming part of an integrated display and input device constructed and operative in accordance with a preferred embodiment of the present disclosure;

FIGS. 18A, 18B, 18C, 18D, 18E and 18F are simplified illustrations of six alternative embodiments of an illumination subassembly forming part of an integrated display and input device constructed and operative in accordance with a preferred embodiment of the present disclosure; and

FIG. 19 is a simplified illustration of an integrated display and input device constructed and operative in accordance with a preferred embodiment of the present disclosure, utilizing electromagnetic radiation from a source external to the integrated display and input device.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Reference is now made toFIGS. 1A, 1B, 1C and 1D, which are simplified illustrations of four types of integrated display and input devices constructed and operative in accordance with a preferred embodiment of the present disclosure.

FIG. 1A illustrates amobile telephone100 having a touch responsive input functionality employing light reflection in accordance with a preferred embodiment of the present disclosure. As seen inFIG. 1A,arrays102 oflight detector elements104 are arranged along at least two mutually perpendicular edge surfaces106 of a viewingplane defining plate108 overlying akeyboard template display110. Suitable detector elements are, for example, Solderable Silicon Photodiodes commercially available from Advanced Photonix Incorporated of Camarillo, Calif., USA under catalog designator PDB-C601-1.Arrays102 may be provided along all or most of edge surfaces106. Alternatively, asingle array102 may be provided along only oneedge surface106 ofplate108. Viewingplane defining plate108 may be a single or multiple layer plate and may have one or more coating layers associated therewith.

Light, preferably including light in the IR band, is reflected from a user's finger, a stylus (not shown) or any other suitable reflective object, touching or located in propinquity toplate108. The light is propagated withinplate108 and is detected bydetector elements104. The source of the reflected light is preferably external to themobile telephone100, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of the reflected light may comprise anillumination subassembly112 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED114. Theillumination subassembly112 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly112 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED114 may be modulated by modulating circuitry (not shown).

FIG. 1B illustrates alarge screen display120, such as a television display, having a light beam responsive input functionality operative in accordance with a preferred embodiment of the present disclosure. As seen inFIG. 1B,arrays122 of generally forward-lookinglight detector elements124 are arranged generally along at least two mutuallyperpendicular edges126 ofdisplay120.Arrays122 may be provided along all or most ofedges126. Alternatively, asingle array122 may be provided along only oneedge126 ofdisplay120. Light, preferably including light in the IR band emitted by alight beam emitter128, is detected directly by one or more ofdetector elements124.

FIG. 1C illustrates atablet computer130 having a light beam responsive input functionality operative in accordance with a preferred embodiment of the present disclosure. As seen inFIG. 1C, a multiplicity oflight detector elements134 are interspersed amonglight emitters136 arranged in aplane138. Examples of such a structure are described in U.S. Pat. No. 7,034,866 and U.S. Patent Application Publication Nos. 2006/0132463A1, 2006/0007222A1 and 2004/00012565A1, the disclosures of which are hereby incorporated by reference. Light, preferably including light in the IR band, emitted by alight beam emitter140, propagates through at least onecover layer142 and is detected by one or more ofdetector elements134.

FIG. 1D illustrates adisplay150 of adigital camera152 having a touch responsive input functionality employing light reflection in accordance with a preferred embodiment of the present disclosure. As seen inFIG. 1D, anarray154 oflight detector elements156 is arranged behind an IRtransmissive display panel158, such as an LCD or OLED, underlying a viewingplane defining plate160. Viewingplane defining plate160 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Thearray154 oflight detector elements156 may be formed of a plurality of discrete detector arrays mounted on a substrate or integrally formed therewith. Alternatively, thearray154 may be formed of one or more CCD or CMOS arrays, or may created by photolithography.

Light, preferably including light in the IR band, is reflected from astylus162, a user's finger (not shown) or any other suitable reflective object, touching or located in propinquity toplate160. The light propagates throughplate160 andpanel158 and is detected bydetector elements156.

The source of the reflected light is preferably external to thedigital camera152, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of the reflected light may comprise an illumination subassembly which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED163. The illumination subassembly preferably forms part of the integrated display and input device. Examples of various suitable configurations of the illumination subassembly are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED163 may be modulated by modulating circuitry (not shown).

Reference is now made toFIGS. 2A and 2B, which are simplified illustrations of portions of two types of integrated display and input devices constructed and operative in accordance with another preferred embodiment of the present disclosure.FIG. 2A shows an integrated display and input device having touch responsive input functionality, which is useful for application selection and operation, such as email communication and internet surfing. The input functionality may incorporate any one or more features of assignee's U.S. Provisional Patent Application Nos. 60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 and PCT Patent Application Publication No. WO 2005/094176, the disclosures of which are hereby incorporated by reference.

FIG. 2A illustrates launching an application, such as an e-mail application, on amobile telephone164, by employing object detection functionality of the type described hereinabove with reference toFIG. 1C. As shown, a position of a user's finger is detected by means of a touch responsive input functionality operative in accordance with a preferred embodiment of the present disclosure.

As seen inFIG. 2A, a multiplicity oflight detector elements165 are interspersed amonglight emitters166 arranged in aplane168. Examples of such a structure are described in U.S. Pat. No. 7,034,866 and U.S. Patent Application Publication Nos. 2006/0132463A1, 2006/0007222A1 and 2004/00012565A1, the disclosures of which are hereby incorporated by reference. Light, preferably including light in the IR band, reflected by the user's finger, propagates through at least onecover layer172 and is detected by one or more ofdetector elements165. The outputs ofdetector elements165 are processed to indicate one or more of the X, Y, or Z positions and/or angular orientation of the user's finger. This detected position is utilized, as taught inter alia in the aforesaid U.S. Provisional Patent Application No. 60/789,188, to launch an application or control any of the other functionalities described in U.S. Provisional Patent Application No. 60/789,188.

The source of the reflected light is preferably external to themobile telephone164, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of the reflected light may comprise anillumination subassembly174 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED176. Theillumination subassembly174 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly174 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED176 may be modulated by modulating circuitry (not shown).

FIG. 2B shows an integrated display and input device having light beam impingement responsive input functionality, which is useful for application selection and operation, such as email communication and internet surfing. The input functionality may incorporate any one or more features of assignee's U.S. Provisional Patent Application Nos. 60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 and PCT Patent Application Publication No. WO 2005/094176, the disclosures of which are hereby incorporated by reference.

FIG. 2B illustrates launching an application, such as an e-mail application, on amobile telephone182, by employing object detection functionality of the type described hereinabove with reference toFIG. 1C. A position of astylus183 is detected by means of a light beam responsive input functionality operative in accordance with a preferred embodiment of the present disclosure. As seen inFIG. 2B, a multiplicity oflight detector elements184 are interspersed amonglight emitters186 arranged in aplane188. Examples of such a structure are described in U.S. Pat. No. 7,034,866 and U.S. Patent Application Publication Nos. 2006/0132463A1, 2006/0007222A1 and 2004/00012565A1, the disclosures of which are hereby incorporated by reference. Light, preferably including light in the IR band, emitted bystylus183, propagates through at least onecover layer190 and is detected by one or more ofdetector elements184. The outputs ofdetector elements184 are processed to indicate one or more of the X, Y or Z positions and/or angular orientation of thestylus183. This detected position is utilized, as taught inter alia in the aforesaid U.S. Provisional Patent Application No. 60/789,188, to launch an application or control any of the other functionalities described in U.S. Provisional Patent Application No. 60/789,188.

Reference is now made toFIGS. 3A and 3B, which are simplified illustrations of portions of two types of integrated display and input devices constructed and operative in accordance with yet another preferred embodiment of the present disclosure, employing elements arranged in parallel planes, parallel to a viewing plane.

FIG. 3A shows an integrated display and input system having touch responsive input functionality, which is useful for application selection and operation, such as email communication and internet surfing. The input functionality may incorporate any one or more features of assignee's U.S. Provisional Patent Application Nos. 60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 and PCT Patent Application Publication No. WO 2005/094176, the disclosures of which are hereby incorporated by reference.

The touch responsive functionality preferably employs an integrated display and input system including anarray200 ofdetector elements202 arranged in a plane, parallel to aviewing plane204. In accordance with a preferred embodiment of the present disclosure thearray200 is formed of a plurality ofdiscrete detector elements204 placed on a plane integrally formed therewith. Alternatively, thearray154 may be formed of one or more CCD or CMOS arrays, or may be created by photolithography.

As seen inFIG. 3A, in one example of a display and input system structure,array200 is arranged behind an IRtransmissive display panel206, such as a panel including LCD or OLED elements, underlying a viewingplane defining plate208. Viewingplane defining plate208 may be a single or multiple layer plate and may have one or more coating layers associated therewith. In one example of an integrated display and input system employing an LCD, there are provided one or more light diffusing layers210 overlying areflector212. One or morecollimating layers214 are typically interposed betweenreflector212 and IRtransmissive display panel206.

FIG. 3A illustrates launching an application, such as an e-mail application, on amobile telephone216, by employing object detection functionality of the type described hereinabove with reference toFIG. 1D. As shown, a position of a user's finger is detected by means of a touch responsive input functionality operative in accordance with a preferred embodiment of the present disclosure. Light, preferably including light in the IR band, reflected by the user's finger, propagates throughplate208 andpanel206 and is detected bydetector elements202. The outputs ofdetector elements202 are processed to indicate one or more of the X, Y or Z positions and/or angular orientation of the user's finger. This detected position is utilized, as taught inter alia in the aforesaid U.S. Provisional Patent Application No. 60/789,188, to launch an application or control any of the other functionalities described in U.S. Provisional Patent Application No. 60/789,188.

The source of the reflected light is preferably external to themobile telephone216, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of the reflected light may comprise anillumination subassembly222 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED224. Theillumination subassembly222 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly222 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED224 may be modulated by modulating circuitry (not shown).

FIG. 3B shows an integrated display and input device having light beam impingement responsive input functionality, which is useful for application selection and operation, such as email communication and internet surfing. The input functionality may incorporate any one or more features of assignee's U.S. Provisional Patent Application Nos. 60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 and PCT Patent Application Publication No. WO 2005/094176, the disclosures of which are hereby incorporated by reference.

The light beam impingement responsive functionality preferably employs an integrated display and input system including anarray250 ofdetector elements252 arranged in a plane, parallel to aviewing plane254. In accordance with a preferred embodiment of the present disclosure thearray250 is formed of a plurality ofdiscrete detector elements252 placed on a plane integrally formed therewith. Alternatively, thearray250 may be formed of one or more CCD or CMOS arrays, or may be created by photolithography.

As seen inFIG. 3B,array250 is arranged behind an IRtransmissive display panel256, such as a panel including LCD or OLED elements, underlying a viewingplane defining plate258. Viewingplane defining plate258 may be a single or multiple layer plate and may have one or more coating layers associated therewith. In another example of an integrated display and input device employing an LCD, interposed betweenarray250 and IRtransmissive display panel256, there are provided one or more light diffusing layers260 overlying anIR transmissive reflector262. One or morecollimating layers264 are typically interposed between IRtransmissive reflector262 and IRtransmissive display panel256.

FIG. 3B illustrates launching an application, such as an e-mail application on amobile telephone266, by employing object detection functionality of the type described hereinabove with reference toFIG. 1D. A position of astylus268 is detected by means of a light beam responsive input functionality operative in accordance with a preferred embodiment of the present disclosure. Light, preferably including light in the IR band, emitted bystylus268, propagates throughplate258,panel256, one or more oflayers264 andlayers260 and throughIR transmissive reflector262, and is detected by one or more ofdetector elements252. The outputs ofdetector elements252 are processed to indicate one or more of the X, Y or Z positions and/or angular orientation of thestylus268. This detected position is utilized, as taught inter alia in the aforesaid U.S. Provisional Patent Application No. 60/789,188, to launch an application or control any of the other functionalities described in U.S. Provisional Patent Application No. 60/789,188.

Reference is now made toFIG. 4, which is a simplified illustration of a portion of an input device constructed and operative in accordance with still another preferred embodiment of the present disclosure, employing detector elements arranged along edges of a display element. In the structure ofFIG. 4, at least onedetector assembly300 is arranged along at least oneedge302 of a viewingplane defining plate304 to sense light impinging onplate304 and propagating within the plate to theedges302 thereof. Viewingplane defining plate304 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Preferably,detector assemblies300 are provided along at least two mutuallyperpendicular edges302, as shown, thoughdetector assemblies300 may be provided along all or most ofedges302. Alternatively asingle detector assembly300 may be provided along only oneedge302 ofplate304.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly300 comprises asupport substrate306 onto which is mounted alinear arrangement308 ofdetector elements310. Interposed betweenlinear arrangement308 andedge302 is acover layer312.Cover layer312 may have multiple functions including physical protection, light intensity limitation, and field-of-view limitation and may have optical power.Cover layer312 may be formed of glass or any other suitable light transparent material, or of a suitably apertured opaque material, such as metal.

Thesupport substrate306 may be mounted onto a display housing (not shown) or may be integrally formed therewith. Thesupport substrate306 may alternatively be mounted onto anedge302 ofplate304. Thesupport substrate306 may be formed of a ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. The support substrate may also provide mounting for and electrical connections to thedetector elements310. Aprocessor314 for processing the outputs of thedetector elements310 may also be mounted on thesupport substrate306.

It is a particular feature of this embodiment of the present disclosure that thedetector assembly300 is extremely thin, preferably under 1 mm overall. Accordingly, thesupport substrate306 is preferably 50-200 microns in thickness, thelinear arrangement308 ofdetector elements310 is preferably 100-400 microns in thickness and thecover layer312 is preferably 100-500 microns in thickness.

The input device shown inFIG. 4 may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly316 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED318. Theillumination subassembly316 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly316 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED318 may be modulated by modulating circuitry (not shown).

Reference is now made toFIG. 5, which is a simplified illustration of a portion of an input device constructed and operative in accordance with a further preferred embodiment of the present disclosure, employing detector elements arranged along edges of a display element. In the structure ofFIG. 5, at least onedetector assembly320 is arranged along at least oneedge322 of a viewingplane defining plate324 to sense light impinging onplate324 and propagating within the plate to theedges322 thereof. Viewingplane defining plate324 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Preferably,detector assemblies320 are provided along at least two mutuallyperpendicular edges322, as shown, thoughdetector assemblies320 may be provided along all or most ofedges322. Alternatively asingle detector assembly320 may be provided along only oneedge322 ofplate324.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly320 comprises asupport substrate326 onto which is mounted alinear arrangement328 ofdetector elements330. Interposed betweenlinear arrangement328 andedge322 is acover layer332. In the illustrated embodiment,cover layer332 is a field-of-view definingmask having apertures333 formed therein, in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements330. Depending on the thickness oflayer332, eachdetector element330 may have associated therewith asingle aperture333 or a plurality of smaller apertures, here designated byreference numeral334. The selection of aperture size and distribution is determined in part by the mechanical strength oflayer332.Layer332 may have multiple functions including physical protection, field-of-view limitation and light intensity limitation, and may have optical power.

Field-of-view limiting functionality may be desirable in this context because it enhances position discrimination by limiting overlap between the fields-of-view ofadjacent detector elements330. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures333 and their locations with respect to and distances fromdetector elements330. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements330 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements330 to a solid angle of less than or equal to 7 degrees.

Thesupport substrate326 may be mounted onto a display housing (not shown) or may be integrally formed therewith. Thesupport substrate326 may alternatively be mounted onto anedge322 ofplate324. Thesupport substrate326 may be formed of a ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. The support substrate may also provide mounting for and electrical connections to thedetector elements330. Aprocessor335 for processing the outputs of thedetector elements330 may also be mounted on thesupport substrate326.

The input device shown inFIG. 5 may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise an illumination subassembly336 which typically includes one or more electromagnetic radiation emitting sources, here shown as a single IR emitting LED338. The illumination subassembly336 preferably forms part of the integrated display and input device. Examples of various suitable configurations of illumination subassembly336 are described herein below inFIGS. 18A-18F. Optionally, the light emitted by LED338 may be modulated by modulating circuitry (not shown).

Reference is now made toFIG. 6, which is a simplified illustration of a portion of an input device constructed and operative in accordance with a yet further preferred embodiment of the present disclosure, employing detector elements arranged along edges of a display element. In the structure ofFIG. 6, at least onedetector assembly340 is arranged along at least oneedge342 of a viewingplane defining plate344 to sense light impinging onplate344 and propagating within the plate to theedges342 thereof. Viewingplane defining plate344 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Preferably,detector assemblies340 are provided along at least two mutuallyperpendicular edges342, as shown, thoughdetector assemblies340 may be provided along all or most ofedges342. Alternatively, asingle detector assembly340 may be provided along only oneedge342 ofplate344.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly340 comprises asupport substrate346 onto which is mounted alinear arrangement348 ofdetector elements350. Interposed betweenlinear arrangement348 andedge342 is acover layer352.

The embodiment ofFIG. 6 differs from that ofFIG. 5 in that thecover layer352 is substantially thicker thancover layer332 and is preferably at least 200 microns in thickness.Layer352 hasapertures353 formed therein, which apertures define light collimating tunnels.Apertures353 are formed inlayer352, in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements350. Depending on the thickness oflayer352, eachdetector element350 may have associated therewith a single tunnel-definingaperture353 as shown or a plurality of smaller tunnel-defining apertures. The selection of aperture size and distribution is determined in part by the mechanical strength oflayer352.Layer352 may have multiple functions including physical protection, field-of-view limitation and light intensity limitation, and may have optical power.

Field-of-view limiting functionality may be desirable in this context because it enhances position discrimination by limiting overlap between the fields-of-view ofadjacent detector elements350. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures353 and their locations with respect to and distances fromdetector elements350. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements350 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements350 to a solid angle of less than or equal to 7 degrees.

Thesupport substrate346 may be mounted onto a display housing (not shown) or may be integrally formed therewith. Thesupport substrate346 may alternatively be mounted onto anedge342 ofplate344. Thesupport substrate346 may be formed of a ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. Thesupport substrate346 may also provide mounting for and electrical connections to thedetector elements350. Aprocessor354 for processing the outputs of thedetector elements350 may also be mounted on thesupport substrate346.

The input device shown inFIG. 6 may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly356 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED358. Theillumination subassembly356 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly356 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED358 may be modulated by modulating circuitry (not shown).

Reference is now made toFIG. 7, which is a simplified illustration of a portion of an input device constructed and operative in accordance with an additional preferred embodiment of the present disclosure, employing detector elements arranged along edges of a display element. In the structure ofFIG. 7, at least onedetector assembly360 is arranged along at least oneedge362 of a viewingplane defining plate364 to sense light impinging onplate364 and propagating within the plate to theedges362 thereof. Viewingplane defining plate364 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Preferably,detector assemblies360 are provided along at least two mutuallyperpendicular edges362, as shown, thoughdetector assemblies360 may be provided along all or most ofedges362. Alternatively, asingle detector assembly360 may be provided along only oneedge362 ofplate364.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly360 comprises asupport substrate366 onto which is mounted alinear arrangement368 ofdetector elements370. Interposed betweenlinear arrangement368 andedge362 is acover layer372.

The embodiment ofFIG. 7 differs from that ofFIGS. 5 and 6 in that apertures in the cover layer inFIGS. 5 and 6 are replaced bylenses373 formed incover layer372.Lenses373 may be integrally formed withlayer372 or may be discrete elements fitted within suitably sized and positioned apertures in an opaque substrate.Lenses373 may be associated with tunnel-defining apertures or may comprise an array of microlenses aligned with one or more ofdetector elements370.

Layer372 may have multiple functions including physical protection, field-of-view limitation and light intensity limitation, and may have optical power. Field-of-view limiting functionality may be desirable in this context because it enhances position discrimination by limiting overlap between the fields-of-view ofadjacent detector elements370.

Thesupport substrate366 may be mounted onto a display housing (not shown) or may be integrally formed therewith. Thesupport substrate366 may alternatively be mounted onto anedge362 ofplate364. Thesupport substrate366 may be formed of a ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. The support substrate may also provide mounting for and electrical connections to thedetector elements370. Aprocessor374 for processing the outputs of thedetector elements370 may also be mounted on thesupport substrate366.

The input device shown inFIG. 7 may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly376 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED378. Theillumination subassembly376 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly376 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED378 may be modulated by modulating circuitry (not shown).

Reference is now made toFIGS. 8A-8D, which are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with another preferred embodiment of the present disclosure, employing detector elements arranged along edges of a display element.

In the structure ofFIGS. 8A-8D, at least onedetector assembly400 is arranged along at least oneedge402 of a viewingplane defining plate404 to sense light impinging onplate404 and propagating within the plate to theedges402 thereof. Viewingplane defining plate404 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Preferably,detector assemblies400 are provided along at least two mutuallyperpendicular edges402, thoughdetector assemblies400 may be provided along all or most ofedges402. Alternatively, asingle detector assembly400 may be provided along only oneedge402 ofplate404.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly400 comprises asupport substrate406 onto which is mounted alinear arrangement408 ofdetector elements410. As distinct from the embodiments ofFIGS. 4-7, in the embodiments ofFIGS. 8A-8D, the cover layer is obviated and its functionality is provided by suitable conditioning ofedge402 of viewingplane defining plate404. This functionality may provide multiple functions including physical protection, light intensity limitation and field-of-view limitation, and may have optical power.

Thesupport substrate406 may be mounted onto a display housing (not shown) or may be integrally formed therewith. Thesupport substrate406 may alternatively be mounted onto anedge402 ofplate404. Thesupport substrate406 may be formed of a ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. The support substrate may also provide mounting for and electrical connections to thedetector elements410. Aprocessor414 for processing the outputs of thedetector elements410 may also be mounted on thesupport substrate406.

It is a particular feature of this embodiment of the present disclosure that thedetector assembly400 is extremely thin, preferably under 1 mm overall. Accordingly, thesupport substrate406 is preferably 50-200 microns in thickness and thelinear arrangement408 ofdetector elements410 is preferably 100-400 microns in thickness.

The input devices shown inFIG. 8A-8D may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly416 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED418. Theillumination subassembly416 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly416 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED418 may be modulated by modulating circuitry (not shown).

In the embodiment ofFIG. 8A,edge402 is uniformly polished for unimpeded light transmission there-through tolinear arrangement408 ofdetector elements410.

Reference is now made toFIG. 8B, in which it is seen thatedge402 is conditioned to define a field-of-view defining mask420 havingapertures433 formed therein in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements410. Eachdetector element410 may have associated therewith asingle aperture433, as shown, or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements410. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures433 and their locations with respect to and distances fromdetector elements410. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements410 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements410 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 8C, which differs from that ofFIG. 8B in that apertures433 inmask420 are replaced by light collimating tunnel-definingapertures440 in amask442.

Eachdetector element410 may have associated therewith a single tunnel-definingaperture440 as shown or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements410. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures440 and their locations with respect to and distances fromdetector elements410. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements410 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements410 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 8D, which differs from that ofFIGS. 5B and 8C in that the apertures inFIGS. 8B and 8C are replaced bylenses453.Lenses453 may be integrally formed atedges402 or may be discrete elements fitted within suitably sized and positioned apertures inplate404.Lenses453 may be associated with tunnel-defining apertures or may comprise an array of microlenses aligned with one or more ofdetector elements410.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements410. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement oflenses453 and their locations with respect to and distances fromdetector elements410. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements410 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements410 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIGS. 9A, 9B, 9C and 9D, which are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with yet another preferred embodiment of the present disclosure, employing forward-facing detector elements arranged about edges of a display element.

In the structure ofFIGS. 9A-9D, at least onedetector assembly500 is arranged about at least one edge502 of a viewingplane defining plate504 to sense light impinging directly ontodetector assembly500. Viewingplane defining plate504 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Light, preferably including light in the IR band, is emitted by a light beam emitter such aslight beam emitter128 in the embodiment ofFIG. 1B or a light reflecting object as in the embodiment ofFIG. 1A. Preferably,detector assemblies500 are provided along at least two mutually perpendicular edges502, thoughdetector assemblies500 may be provided along all or most of edges502. Alternatively, asingle detector assembly500 may be provided along only one edge502 ofplate504.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly500 comprises asupport substrate506 onto which is mounted alinear arrangement508 ofdetector elements510. As distinct from the embodiments ofFIGS. 8A-8D, there is provided acover layer512 and as distinct from the embodiments ofFIGS. 4-7, thedetector assembly500 and thedetector elements510 are generally forward facing, in the sense illustrated generally inFIG. 1B and described hereinabove with respect thereto. Thecover layer512 may provide multiple functions including physical protection, light intensity limitation and field-of-view limitation, and may have optical power.

Thesupport substrate506 may be mounted onto a display housing (not shown) or may be integrally formed therewith. Thesupport substrate506 may alternatively be mounted onto an edge502 ofplate504. Thesupport substrate506 may be formed of a ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. The support substrate may also provide mounting for and electrical connections to thedetector elements510. Aprocessor514 for processing the outputs of thedetector elements510 may also be mounted on thesupport substrate506.

It is a particular feature of this embodiment of the present disclosure that thedetector assembly500 is extremely thin, preferably under 1 mm overall. Accordingly, thesupport substrate506 is preferably 50-200 microns in thickness and thelinear arrangement508 ofdetector elements510 is preferably 100-400 microns in thickness and thecover layer512 is preferably 100-500 microns in thickness.

The input devices shown inFIG. 9A-9D may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly516 which typically includes one or more electromagnetic radiation emitting sources, here shown as a single IR emitting LED518. Theillumination subassembly516 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly516 are described herein below inFIGS. 18A-18F. Optionally, the light emitted by LED518 may be modulated by modulating circuitry (not shown).

In the embodiment ofFIG. 9A,cover layer512 is formed of glass or any other suitable light transparent material.

Reference is now made toFIG. 9B, in which it is seen thatcover layer512 includes a field-of-view defining mask520 havingapertures533 formed therein in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements510. Eachdetector element510 may have associated therewith asingle aperture533, as shown, or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements510. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures533 and their locations with respect to and distances fromdetector elements510. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements510 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements510 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 9C, which differs from that ofFIG. 9B in that apertures533 inmask520 are replaced by light collimating tunnel-definingapertures540 in amask542.

Eachdetector element510 may have associated therewith a single tunnel-definingaperture540 as shown or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements510. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures540 and their locations with respect to and distances fromdetector elements510. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements510 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements510 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 9D, which differs from that ofFIGS. 9B and 9C in that the apertures inFIGS. 9B and 9C are replaced bylenses553.Lenses553 may be integrally formed withcover layer512 or may be discrete elements fitted within suitably sized and positioned apertures incover layer512.Lenses553 may be associated with tunnel-defining apertures or may comprise an array of microlenses aligned with one or more ofdetector elements510.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements510. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement oflenses553 and their locations with respect to and distances fromdetector elements510. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements510 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements510 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIGS. 10A, 10B, 10C and 10D, which are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with still another preferred embodiment of the present disclosure, employing forward-facing detector elements arranged behind edges of a display element.

In the structure ofFIGS. 10A-10D, at least onedetector assembly600 is arranged behind at least oneedge602 of a viewingplane defining plate604 to sense light impinging ontodetector assembly600 after propagating throughplate604. Viewingplane defining plate604 may be a single or multiple layer plate and may have one or more coating layers associated therewith. The light, preferably including light in the IR band, is emitted by a light beam emitter such aslight beam emitter128 in the embodiment ofFIG. 1B or a light reflecting object as in the embodiment ofFIG. 1A. Preferably,detector assemblies600 are provided behind at least two mutuallyperpendicular edges602, thoughdetector assemblies600 may be provided behind all or most ofedges602. Alternatively, asingle detector assembly600 may provided behind only one ofedges602.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly600 comprises asupport substrate606 onto which is mounted alinear arrangement608 ofdetector elements610. Similarly to the embodiments ofFIGS. 9A-9D, there is provided acover layer612 and as distinct from the embodiments ofFIGS. 4-7, thedetector assembly600 and thedetector elements610 are generally forward facing, in the sense illustrated generally inFIG. 1B and described hereinabove with respect thereto. Thecover layer612 may provide multiple functions including physical protection, light intensity limitation and field-of-view limitation, and may have optical power.

Thesupport substrate606 may be mounted onto a display housing (not shown) or may be integrally formed therewith. Thesupport substrate606 may alternatively be mounted onto a rearward facingsurface613 ofplate604 at theedge602 lying in front of thelinear arrangement608. Thesupport substrate606 may be formed of a ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. The support substrate may also provide mounting for and electrical connections to thedetector elements610. Aprocessor614 for processing the outputs of thedetector elements610 may also be mounted on thesupport substrate606.

It is a particular feature of this embodiment of the present disclosure that thedetector assembly600 is extremely thin, preferably under 1 mm overall. Accordingly, thesupport substrate606 is preferably 50-200 microns in thickness and thelinear arrangement608 ofdetector elements610 is preferably 100-400 microns in thickness and thecover layer612 is preferably 100-500 microns in thickness.

The input devices shown inFIG. 10A-10D may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly616 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED618. Theillumination subassembly616 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly616 are described hereinbelow inFIGS. 18A-18F. Optionally, the light emitted byLED618 may be modulated by modulating circuitry (not shown).

In the embodiment ofFIG. 10A,cover layer612 is formed of glass or any other suitable light transparent material.

Reference is now made toFIG. 10B, in which it is seen thatcover layer612 includes a field-of-view defining mask620 havingapertures633 formed therein in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements610. Eachdetector element610 may have associated therewith asingle aperture633 as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements610. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures633 and their locations with respect to and distances fromdetector elements610. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements610 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements610 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 10C, which differs from that ofFIG. 10B in that apertures633 inmask620 are replaced by light collimating tunnel-definingapertures640 in amask642.

Eachdetector element610 may have associated therewith a single tunnel-definingaperture640 as shown or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements610. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures640 and their locations with respect to and distances fromdetector elements610. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements610 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements610 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 10D, which differs from that ofFIGS. 10B and 10C in that the apertures inFIGS. 10B and 10C are replaced bylenses653.Lenses653 may be integrally formed withcover layer612 or may be discrete elements fitted within suitably sized and positioned apertures incover layer612.Lenses653 may be associated with tunnel-defining apertures or may comprise an array of microlenses aligned with one or more ofdetector elements610.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements610. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement oflenses653 and their locations with respect to and distances fromdetector elements610. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements610 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements610 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIGS. 11A, 11B, 11C and 11D, which are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with a further preferred embodiment of the present disclosure, employing forward-facing detector elements arranged behind edges of a display element.

In the structure ofFIGS. 11A-11D, at least onedetector assembly700 is arranged behind at least oneedge702 of a viewingplane defining plate704 to sense light impinging onplate704 and propagating within the plate to theedges702 thereof. Viewingplane defining plate704 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Preferably,detector assemblies700 are provided behind at least two mutuallyperpendicular edges702, thoughdetector assemblies700 may be provided behind all or most ofedges702. Alternatively, asingle detector assembly700 may be provided behindplate704 at only one edge thereof.

In accordance with a preferred embodiment of the present disclosure, thedetector assembly700 comprises asupport substrate706 onto which is mounted alinear arrangement708 ofdetector elements710. As distinct from the embodiments ofFIGS. 4-7, in the embodiments ofFIGS. 11A-11D, thedetector assembly700 and thedetector elements710 are generally forward facing, in the sense illustrated generally inFIG. 1B and described hereinabove with respect thereto. Also as distinct from the embodiments ofFIGS. 10A-10D, the cover layer is obviated and its functionality is provided by suitable conditioning of a rearward facingsurface711 ofplate704 at theedge702 lying in front of thelinear arrangement708. This functionality may provide multiple functions including physical protection, light intensity limitation and field-of-view limitation, and may have optical power.

Thesupport substrate706 may be mounted onto a display housing (not shown) or may be integrally formed therewith. Thesupport substrate706 may alternatively be mounted onto the rearward facingsurface711 ofplate704 at theedge702. Thesupport substrate706 may be formed of a ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. The support substrate may also provide mounting for and electrical connections to thedetector elements710. Aprocessor714 for processing the outputs of thedetector elements710 may also be mounted on thesupport substrate706.

It is a particular feature of this embodiment of the present disclosure that thedetector assembly700 is extremely thin, preferably under 1 mm overall. Accordingly, thesupport substrate706 is preferably 50-200 microns in thickness and thelinear arrangement708 ofdetector elements710 is preferably 100-400 microns in thickness.

The input devices shown inFIG. 11A-11D may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly716 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED718. Theillumination subassembly716 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly716 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED718 may be modulated by modulating circuitry (not shown).

In the embodiment ofFIG. 11A, the rearward facingsurface711 ofplate704 at theedge702 lying in front of thelinear arrangement708 is uniformly polished for unimpeded light transmission there-through tolinear arrangement708 ofdetector elements710.

Reference is now made toFIG. 11B, in which it is seen that the rearward facingsurface711 ofplate704 at theedge702 lying in front of thelinear arrangement708 is conditioned to define a field-of-view defining mask720 havingapertures733 formed therein in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements710. Eachdetector element710 may have associated therewith asingle aperture733 as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements710. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures733 and their locations with respect to and distances fromdetector elements710. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements710 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements710 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 11C, which differs from that ofFIG. 11B in that apertures733 inmask720 are replaced by light collimating tunnel-defining apertures740 in amask742.

Eachdetector element710 may have associated therewith a single tunnel-defining aperture740 as shown or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements710. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement of apertures740 and their locations with respect to and distances fromdetector elements710. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements710 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements710 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 11D, which differs from that ofFIGS. 11B and 11C in that the apertures inFIGS. 11B and 11C are replaced bylenses753.Lenses753 may be integrally formed atedges702 or may be discrete elements fitted within suitably sized and positioned apertures inplate704.Lenses753 may be associated with tunnel-defining apertures or may comprise an array of microlenses aligned with one or more ofdetector elements710.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements710. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement oflenses753 and their locations with respect to and distances fromdetector elements710. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements710 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements710 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIGS. 12A, 12B, 12C and 12D, which are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with a yet further preferred embodiment of the present disclosure, employing detector elements arranged along edges of a display element.

In the structure ofFIGS. 12A-12D, at least onedetector assembly800 is arranged along at least oneedge802 of a viewingplane defining plate804 to sense light impinging onplate804 and propagating within the plate to theedges802 thereof. Viewingplane defining plate804 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Preferably,detector assemblies800 are provided along at least two mutuallyperpendicular edges802, thoughdetector assemblies800 may be provided along all or most ofedges802. Alternatively, asingle detector assembly800 may be provided along only oneedge802 ofplate804.

Thedetector assembly800 includes alinear arrangement808 ofdetector elements810. As distinct from the embodiments ofFIGS. 8A-8D, thedetector assembly800 does not comprise a support substrate onto which is mounted a linear arrangement of detector elements. In the embodiments ofFIGS. 12A-12D, the support substrate ofFIGS. 8A-8D is replaced by a portion of aperipheral housing812. Similarly to the embodiments ofFIGS. 4-7 there is provided acover layer814 which provides multiple functions including physical protection, light intensity limitation and field-of-view limitation, and may have optical power.

Theperipheral housing812 may be formed of any suitable material including, for example, ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. Theperipheral housing812 may also provide mounting for and electrical connections to thedetector elements810. Aprocessor816 for processing the outputs of thedetector elements810 may also be mounted on theperipheral housing812.

It is a particular feature of this embodiment of the present disclosure that thedetector assembly800 is extremely thin, preferably under 1 mm overall. Accordingly, thelinear arrangement808 ofdetector elements810 is preferably 100-400 microns in thickness.

The input devices shown inFIG. 12A-12D may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly817 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED818. Theillumination subassembly817 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly817 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED818 may be modulated by modulating circuitry (not shown).

In the embodiment ofFIG. 12A,cover layer814 provides generally unimpeded light transmission there-through tolinear arrangement808 ofdetector elements810.

Reference is now made toFIG. 12B, in which it is seen thatcover layer814 defines a field-of-view defining mask820 havingapertures833 formed therein in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements810. Eachdetector element810 may have associated therewith asingle aperture833 as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements810. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures833 and their locations with respect to and distances fromdetector elements810. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements810 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements810 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 12C, which differs from that ofFIG. 12B in that apertures833 inmask820 are replaced by light collimating tunnel-definingapertures840 in amask842.

Eachdetector element810 may have associated therewith a single tunnel-definingaperture840 as shown or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements810. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures840 and their locations with respect to and distances fromdetector elements810. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements810 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements810 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 12D, which differs from that ofFIGS. 12B and 12C in that the apertures inFIGS. 12B and 12C are replaced bylenses853.Lenses853 may be integrally formed atedges802 or may be discrete elements fitted within suitably sized and positioned apertures inplate804.Lenses853 may be associated with tunnel-defining apertures or may comprise an array of microlenses aligned with one or more ofdetector elements810.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements810. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement oflenses853 and their locations with respect to and distances fromdetector elements810. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements810 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements810 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIGS. 13A, 13B, 13C and 13D, which are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with a still further preferred embodiment of the present disclosure, employing detector elements arranged along edges of a display element.

In the structure ofFIGS. 13A-13D, at least onedetector assembly860 is arranged along at least oneedge862 of a viewingplane defining plate864 to sense light impinging onplate864 and propagating within the plate to theedges862 thereof. Viewingplane defining plate864 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Preferably,detector assemblies860 are provided along at least two mutuallyperpendicular edges862, thoughdetector assemblies860 may be provided along all or most ofedges862. Alternatively, asingle detector assembly860 may be provided along only oneedge862 ofplate864.

Thedetector assembly860 includes alinear arrangement868 ofdetector elements870. As distinct from the embodiments ofFIGS. 12A-12D, in the embodiments ofFIGS. 13A-13D, the cover layer is obviated and its functionality is provided by suitable conditioning ofedge862 of viewingplane defining plate864. This functionality may provide multiple functions including physical protection, light intensity limitation and field-of-view limitation, and may have optical power.

As in the embodiment ofFIGS. 13A-13D,detector assembly860 does not comprise a support substrate onto which is mounted a linear arrangement of detector elements. In the embodiments ofFIGS. 13A-13D, the support substrate ofFIGS. 8A-8D is replaced by a portion of aperipheral housing872.

Theperipheral housing872 may be formed of any suitable material including, for example, ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. Theperipheral housing872 may also provide mounting for and electrical connections to thedetector elements870. Aprocessor876 for processing the outputs of thedetector elements870 may also be mounted on theperipheral housing872.

It is a particular feature of this embodiment of the present disclosure that thedetector assembly860 is extremely thin, preferably under 1 mm overall. Accordingly, thelinear arrangement868 ofdetector elements870 is preferably 100-400 microns in thickness.

The input devices shown inFIG. 13A-13D may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly877 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED878. Theillumination subassembly877 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly877 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED878 may be modulated by modulating circuitry (not shown).

In the embodiment ofFIG. 13A,edge862 is uniformly polished for unimpeded light transmission there-through tolinear arrangement868 ofdetector elements870.

Reference is now made toFIG. 13B, in which it is seen thatedge862 is conditioned to define a field-of-view defining mask880 havingapertures883 formed therein in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements870. Eachdetector element870 may have associated therewith asingle aperture883 as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements870. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures883 and their locations with respect to and distances fromdetector elements870. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements870 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements870 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 13C, which differs from that ofFIG. 13B in that apertures883 inmask880 are replaced by light collimating tunnel-definingapertures890 in amask892.

Eachdetector element870 may have associated therewith a single tunnel-definingaperture890 as shown or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements870. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures890 and their locations with respect to and distances fromdetector elements870. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements870 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements870 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 13D, which differs fromFIGS. 13B and 13C in that the apertures inFIGS. 13B and 13C are replaced bylenses893.Lenses893 may be integrally formed atedges862 or may be discrete elements fitted within suitably sized and positioned apertures inplate864.Lenses893 may be associated with tunnel-defining apertures or may comprise an array of microlenses aligned with one or more ofdetector elements870.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements870. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement oflenses893 and their locations with respect to and distances fromdetector elements870. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements870 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements870 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIGS. 14A, 14B, 14C and 14D, which are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with an additional preferred embodiment of the present disclosure, employing forward-facing detector elements arranged about edges of a display element.

In the structure ofFIGS. 14A-14D, at least onedetector assembly900 is arranged about at least oneedge902 of a viewingplane defining plate904 to sense light impinging directly ontodetector assembly900. Viewingplane defining plate904 may be a single or multiple layer plate and may have one or more coating layers associated therewith. The light, preferably including light in the IR band, is emitted by a light beam emitter such aslight beam emitter128 in the embodiment ofFIG. 1B or a light reflecting object as in the embodiment ofFIG. 1A. Preferably,detector assemblies900 are provided along at least two mutuallyperpendicular edges902, thoughdetector assemblies900 may be provided along all or most ofedges902. Alternatively, asingle detector assembly900 may be provided along only oneedge902 ofplate904.

Thedetector assembly900 includes alinear arrangement908 ofdetector elements910. As distinct from the embodiments ofFIGS. 9A-9D, thedetector assembly900 does not comprise a support substrate onto which is mounted a linear arrangement of detector elements. In the embodiments ofFIGS. 14A-14D, the support substrate ofFIGS. 9A-9D is replaced by a portion of aperipheral housing912. Similarly to the embodiments ofFIGS. 9A-9D there is provided acover layer914 which provides multiple functions including physical protection, light intensity limitation and field-of-view limitation, and may have optical power.

Theperipheral housing912 may be formed of any suitable material including, for example, ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. Theperipheral housing912 may also provide mounting for and electrical connections to thedetector elements910. Aprocessor916 for processing the outputs of thedetector elements910 may also be mounted on theperipheral housing912.

It is a particular feature of this embodiment of the present disclosure that thedetector assembly900 is extremely thin, preferably under 1 mm overall. Accordingly, thelinear arrangement908 ofdetector elements910 is preferably 100-400 microns in thickness and thecover layer914 is preferably 100-500 microns in thickness.

The input devices shown inFIG. 14A-14D may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly917 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED918. Theillumination subassembly917 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly917 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED918 may be modulated by modulating circuitry (not shown).

In the embodiment ofFIG. 14A,cover layer914 is formed of glass or any other suitable light transparent material.

Reference is now made toFIG. 14B, in which it is seen thatcover layer914 includes a field-of-view defining mask920 having apertures933 formed therein in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements910. Eachdetector element910 may have associated therewith a single aperture933 as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements910. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement of apertures933 and their locations with respect to and distances fromdetector elements910. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements910 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements910 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 14C, which differs from that ofFIG. 14B in that apertures933 inmask920 are replaced by light collimating tunnel-definingapertures940 in amask942.

Eachdetector element910 may have associated therewith a single tunnel-definingaperture940 as shown or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements910. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures940 and their locations with respect to and distances fromdetector elements910. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements910 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements910 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 14D, which differs from that ofFIGS. 14B and 14C in that the apertures inFIGS. 14B and 14C are replaced bylenses953.Lenses953 may be integrally formed withcover layer914 or may be discrete elements fitted within suitably sized and positioned apertures incover layer914.Lenses953 may be associated with tunnel-defining apertures or may comprise an array of microlenses aligned with one or more ofdetector elements910.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements910. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement oflenses953 and their locations with respect to and distances fromdetector elements910. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements910 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements910 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIGS. 15A, 15B, 15C and 15D, which are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with another preferred embodiment of the present disclosure, employing forward-facing detector elements arranged behind edges of a display element.

In the structure ofFIGS. 15A-15D, at least onedetector assembly960 is arranged behind at least oneedge962 of a viewingplane defining plate964 to sense light impinging ontodetector assembly960 after propagating throughplate964. Viewingplane defining plate964 may be a single or multiple layer plate and may have one or more coating layers associated therewith. The light, preferably including light in the IR band, is emitted by a light beam emitter such aslight beam emitter128 in the embodiment ofFIG. 1B or a light reflecting object as in the embodiment ofFIG. 1A. Preferably,detector assemblies960 are provided behind at least two mutuallyperpendicular edges962, thoughdetector assemblies960 may be provided behind all or most ofedges962. Alternatively, asingle detector assembly960 may be provided behind only one ofedges962.

Thedetector assembly960 includes alinear arrangement968 ofdetector elements970. As distinct from the embodiments ofFIGS. 10A-10D, thedetector assembly960 does not comprise a support substrate onto which is mounted a linear arrangement of detector elements. In the embodiments ofFIGS. 15A-15D, the support substrate ofFIGS. 10A-10D is replaced by a portion of aperipheral housing972. Similarly to the embodiments ofFIGS. 10A-10D there is provided acover layer974 which provides multiple functions including physical protection, light intensity limitation and field-of-view limitation, and may have optical power.

Theperipheral housing972 may be formed of any suitable material including, for example, ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. Theperipheral housing972 may also provide mounting for and electrical connections to thedetector elements970. Aprocessor976 for processing the outputs of thedetector elements970 may also be mounted on theperipheral housing972.

It is a particular feature of this embodiment of the present disclosure that thedetector assembly960 is extremely thin, preferably under 1 mm overall. Accordingly, thelinear arrangement968 ofdetector elements970 is preferably 100-400 microns in thickness and thecover layer974 is preferably 100-500 microns in thickness.

The input devices shown inFIG. 15A-15D may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise anillumination subassembly977 which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED978. Theillumination subassembly977 preferably forms part of the integrated display and input device. Examples of various suitable configurations ofillumination subassembly977 are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED978 may be modulated by modulating circuitry (not shown).

In the embodiment ofFIG. 15A,cover layer974 is formed of glass or any other suitable light transparent material.

Reference is now made toFIG. 15B, in which it is seen thatcover layer974 includes a field-of-view defining mask980 havingapertures983 formed therein in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements970. Eachdetector element970 may have associated therewith asingle aperture983 as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements970. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures983 and their locations with respect to and distances fromdetector elements970. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements970 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements970 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 15C, which differs from that ofFIG. 15B in that apertures983 inmask980 are replaced by light collimating tunnel-definingapertures990 in amask992.

Eachdetector element970 may have associated therewith a single tunnel-definingaperture990 as shown or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements970. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures990 and their locations with respect to and distances fromdetector elements970. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements970 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements970 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 15D, which differs from that ofFIGS. 15B and 15C in that the apertures inFIGS. 15B and 15C are replaced bylenses993.Lenses993 may be integrally formed withcover layer974 or may be discrete elements fitted within suitably sized and positioned apertures incover layer974.Lenses993 may be associated with tunnel-defining apertures or may comprise an array of microlenses aligned with one or more ofdetector elements970.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements970. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement oflenses993 and their locations with respect to and distances fromdetector elements970. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements970 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements970 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIGS. 16A, 16B, 16C and 16D, which are simplified illustrations of four alternative embodiments of a portion of an input device constructed and operative in accordance with yet another preferred embodiment of the present disclosure, employing forward-facing detector elements arranged behind edges of a display element.

In the structure ofFIGS. 16A-16D, at least onedetector assembly1000 is arranged behind at least oneedge1002 of a viewingplane defining plate1004 to sense light impinging onplate1004 and propagating within the plate to theedges1002 thereof. Viewingplane defining plate1004 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Preferably,detector assemblies1000 are provided behind at least two mutuallyperpendicular edges1002, thoughdetector assemblies1000 may be provided behind all or most ofedges1002. Alternatively, asingle detector assembly1000 may be provided behindplate1004 at only one edge thereof.

Thedetector assembly1000 includes alinear arrangement1008 ofdetector elements1010. As distinct from the embodiments ofFIGS. 15A-15D, in the embodiments ofFIGS. 16A-16D, the cover layer is obviated and its functionality is provided by suitable conditioning ofedge1002 of viewingplane defining plate1004. This functionality may provide multiple functions including physical protection, light intensity limitation and field-of-view limitation, and may have optical power.

As in the embodiment ofFIGS. 15A-15D,detector assembly1000 does not comprise a support substrate onto which is mounted a linear arrangement of detector elements. In the embodiments ofFIGS. 16A-16D, the support substrate ofFIGS. 11A-11D is replaced by a portion of aperipheral housing1012.

Theperipheral housing1012 may be formed of any suitable material including, for example, ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. Theperipheral housing1012 may also provide mounting for and electrical connections to thedetector elements1010. Aprocessor1016 for processing the outputs of thedetector elements1010 may also be mounted on theperipheral housing1012.

It is a particular feature of this embodiment of the present disclosure that thedetector assembly1000 is extremely thin, preferably under 1 mm overall. Accordingly, thelinear arrangement1008 ofdetector elements1010 is preferably 100-400 microns in thickness.

The input devices shown inFIG. 16A-16D may also include a source of light which is preferably external to the input device, for example as shown inFIG. 19. Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the source of light may comprise an illumination subassembly which typically includes one or more electromagnetic radiation emitting sources, here shown as a singleIR emitting LED1019. The illumination subassembly preferably forms part of the integrated display and input device. Examples of various suitable configurations of the illumination subassembly are described herein below inFIGS. 18A-18F. Optionally, the light emitted byLED1019 may be modulated by modulating circuitry (not shown).

In the embodiment ofFIG. 16A, a rearward facingsurface1018 ofplate1004 at theedge1002 lying in front of thelinear arrangement1008 is uniformly polished for unimpeded light transmission there-through tolinear arrangement1008 ofdetector elements1010.

Reference is now made toFIG. 16B, in which it is seen that the rearward facingsurface1018 ofplate1004 at theedge1002 lying in front of thelinear arrangement1008 is conditioned to define a field-of-view defining mask1020 havingapertures1033 formed therein in sizes and arrangements which provide desired fields-of-view for the variouscorresponding detector elements1010. Eachdetector element1010 may have associated therewith asingle aperture1033 as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements1010. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures1033 and their locations with respect to and distances fromdetector elements1010. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements1010 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements1010 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 16C, which differs from that ofFIG. 16B in thatapertures1033 inmask1020 are replaced by light collimating tunnel-definingapertures1040 in amask1042.

Eachdetector element1010 may have associated therewith a single tunnel-definingaperture1040, as shown, or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements1010. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement ofapertures1040 and their locations with respect to and distances fromdetector elements1010. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements1010 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements1010 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIG. 16D, which differs from that ofFIGS. 16B and 16C in that the apertures inFIGS. 16B and 16C are replaced bylenses1053.Lenses1053 may be integrally formed atedges1002 or may be discrete elements fitted within suitably sized and positioned apertures inplate1004.Lenses1053 may be associated with tunnel-defining apertures or may comprise an array of microlenses aligned with one or more ofdetector elements1010.

Field-of-view limiting functionality may be desirable in this context because it enhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements1010. Extent of field-of-view limiting may be controlled by the size, pitch and arrangement oflenses1053 and their locations with respect to and distances fromdetector elements1010. In accordance with a preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements1010 to a solid angle of less than or equal to 15 degrees. In accordance with another preferred embodiment, the field-of-view limiting functionality limits the field-of-view of at least one ofdetector elements1010 to a solid angle of less than or equal to 7 degrees.

Reference is now made toFIGS. 17A, 17B and 17C, which are simplified illustration of three alternative embodiments of a detector assembly forming part of an integrated display and input device constructed and operative in accordance with a preferred embodiment of the present disclosure.

In the structure ofFIGS. 17A-17C, at least one detector assembly is arranged about at least one edge (not shown) of a viewing plane defining plate (not shown). The detector assemblies ofFIGS. 17A-17C may be employed in any of the embodiments of the present disclosure described hereinabove and illustrated inFIGS. 1A-16D. Preferably, detector assemblies are provided along at least two mutually perpendicular edges of the plate, though detector assemblies may be provided along all or most of the edges. Alternatively, a single detector assembly may be provided along only one edge of the plate.

In accordance with a preferred embodiment of the present disclosure, the detector assembly comprises a support substrate onto which is mounted a linear arrangement of detector elements. Preferably, a cover layer is placed over the arrangement of detector elements and may provide multiple functions including physical protection, light intensity limitation and field-of-view limitation, and may have optical power.

The support substrate may be mounted onto a display housing (not shown) or may be integrally formed therewith. The support substrate may alternatively be mounted onto an edge of the plate. The support substrate may be formed of a ceramic material, a material such as FR-4 which is commonly used for PCBs, glass, plastic or a metal such as aluminum. The support substrate may also provide mounting for and electrical connections to the detector elements. A processor for processing the outputs of the detector elements may also be mounted on the support substrate.

It is a particular feature of this embodiment of the present disclosure that the detector assembly is extremely thin, preferably under 1 mm overall. Accordingly, the support substrate is preferably 50-200 microns in thickness and the linear arrangement of detector elements is preferably 100-400 microns in thickness and the cover layer is preferably 100-500 microns in thickness.

In the embodiment ofFIG. 17A, the detector assembly, here designated byreference numeral1100, includes an integrally formedmulti-element detector array1102. Thedetector array1102 is preferably mounted onto asupport substrate1104 and overlaid with acover layer1106.

In the embodiment ofFIG. 17B, the detector assembly, here designated byreference numeral1110, includes a plurality of discrete single-element detector elements1112 such as Solderable Silicon Photodiodes commercially available from Advanced Photonix Incorporated of Camarillo, Calif., USA under catalog designator PDB-C601-1. Thediscrete detector elements1112 are preferably mounted onto asupport substrate1114 and overlaid with acover layer1116.

In the embodiment ofFIG. 17C, the detector assembly, here designated byreference numeral1120, includes a plurality of discretemulti-element detector elements1122. The discretemulti-element detector elements1122 need not be all of the same size and are preferably all mounted onto asupport substrate1124 and overlaid with acover layer1126.

Reference is now made toFIGS. 18A, 18B, 18C, 18D, 18E and 18F, which are simplified illustrations of four alternative embodiments of an illumination subassembly forming part of an integrated display and input device constructed and operative in accordance with preferred embodiments of the present disclosure. Alternatively or additionally, a touch responsive input functionality may preferably be operative to detect the position of a stylus (not shown) or any other suitable reflective object.

FIGS. 18A-18F show an integrated display and input device having touch responsive input functionality, which is useful for application selection and operation, such as email communication and internet surfing. The input functionality may incorporate any one or more features of assignee's U.S. Provisional Patent Application Nos. 60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 and PCT Patent Application Publication No. WO 2005/094176, the disclosures of which are hereby incorporated by reference.

FIGS. 18A-18F illustrate object detection functionality of the type described hereinabove with reference toFIGS. 1A to 1D. As shown, a position of a user's finger is detected by means of a touch responsive input functionality operative in accordance with preferred embodiments of the present disclosure.

Turning specifically toFIG. 18A, it is seen thatarrays1202 oflight detector elements1204 are arranged at least two mutuallyperpendicular edge surfaces1206 of a viewingplane defining plate1208. Alternatively,detector arrays1202 may be provided along all or most of theedges1206. As a further alternative, asingle detector array1202 may be provided along only oneedge1206 of theplate1208. Viewingplane defining plate1208 may be a single or multiple layer plate and may have one or more coating layers associated therewith.

It is to be appreciated that the phrase “at edges” is to be interpreted broadly as including structures which are located behind edges, as in the embodiments shown inFIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D, about edges as in the embodiments shown inFIGS. 9A-9D and 14A-14D, and along edges as in the embodiments shown inFIGS. 4-7, 8A-8D, 12A-12D and 13A-13D.

Suitable detector elements are, for example, Solderable Silicon Photodiodes commercially available from Advanced Photonix Incorporated of Camarillo, Calif., USA under catalog designator PDB-C601-1.

The integrated display and input device shown inFIG. 18A preferably includes anillumination subassembly1212 which typically includes one or more electromagnetic radiation emitting sources. Theillumination subassembly1212 preferably provides a baseline illumination level which is typically detected bydetector elements1204.

In accordance with a preferred embodiment of the present disclosure, shown inFIG. 18A, a singleIR emitting LED1216 is provided at or generally adjacent to an intersection of the mutuallyperpendicular edges1206 along which detector elements1214 are arranged. TheLED1216 is arranged such that light emitted therefrom is projected generally across the surface ofplate1208. A suitable IR emitting LED is, for example, an IR-emitting SMD-LED commercially available from OSA Opto Light GmbH of Berlin, Germany under catalog designator OIS-210-X-T. It is appreciated that selection of a specific shape and size ofLED1216 may be affected by the specific placement ofLED1216 relative todetector arrays1202 and the interaction between a light beam emitted from theLED1216 and the various components of the integrated display and input device, including theplate1208, thedetector elements1204 and other layers of the integrated display and input device. Optionally, the light emitted byLED1216 may be modulated by modulating circuitry (not shown).

Light, preferably including light in the IR band emitted byillumination subassembly1212, is reflected from a user's finger, a stylus (not shown) or any other suitable reflective object, touching or located in propinquity toplate1208. The reflected light is propagated withinplate1208 and is detected by one or more ofdetector elements1204. Alternatively or additionally, the reflected light is propagated above the surface ofplate1208 and is detected by one or more ofdetector elements1204, which may extend slightly above edge surfaces1206. Furthermore, additionally or alternatively, the reflected light may propagate or be transmitted throughplate1208 directly to one or more ofdetector elements1204 and detected thereby.

When the user's finger touches or is located in propinquity toplate1208, the light reflected from the finger is detected by one or more ofdetector elements1204, as described hereinabove, in addition to the baseline level of light detected by thedetector elements1204. Detector analyzing processing circuitry (not shown) preferably receives outputs of thedetector elements1204 ondetector arrays1202, digitally processes these outputs and determines whether the absolute amount of light detected by each of thedetector elements1204 or the change in the amount of light detected by each of thedetector elements1204 exceeds a predetermined threshold.

The amount of light detected by theindividual detector elements1204 on a givendetector array1202, as determined by the detector analyzing processing circuitry, is further processed to provide an array detection output. The array detection output includes information corresponding to the location of an impingement point of the user's finger relative to the givendetector array1202. Typically, the location of at least onedetector element1204, in which the amount of light measured or the change in the amount of light measured exceeds a predetermined threshold, corresponds to the location of the user's finger along an axis parallel to the givendetector array1202.

In the configuration shown inFIG. 18A, two-dimensional location determining circuitry (not shown) preferably calculates the two-dimensional position of the impingement point of the user's finger on or aboveplate1208 by combining the array detection outputs of at least two detector arrays, typically arranged along at least two mutuallyperpendicular edges1206 ofplate1208.

Reference is now made toFIG. 18B, which showsarrays1222 oflight detector elements1224 arranged at least two mutuallyperpendicular edge surfaces1226 of a viewingplane defining plate1228. Alternatively,detector arrays1222 may be provided along all or most of theedges1226. As a further alternative, asingle detector array1222 may be provided along only oneedge1226 of theplate1228. Viewingplane defining plate1228 may be a single or multiple layer plate and may have one or more coating layers associated therewith.

It is to be appreciated that the phrase “at edges” is to be interpreted broadly as including structures which are located behind edges, as in the embodiments shown inFIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D, about edges as in the embodiments shown inFIGS. 9A-9D and 14A-14D, and along edges as in the embodiments shown inFIGS. 4-7, 8A-8D, 12A-12D and 13A-13D.

Suitable detector elements are, for example, Solderable Silicon Photodiodes commercially available from Advanced Photonix Incorporated of Camarillo, Calif., USA under catalog designator PDB-C601-1.

The integrated display and input device shown inFIG. 18B preferably includes anillumination subassembly1232 which typically includes one or more electromagnetic radiation emitting sources. Theillumination subassembly1232 preferably provides a baseline illumination level which is typically detected bydetector elements1224.

In accordance with a preferred embodiment of the present disclosure, shown inFIG. 18B, a singleIR emitting LED1236 is provided at or generally adjacent to an intersection of mutuallyperpendicular edges1226 along whichdetector elements1224 are not arranged. TheLED1236 is arranged such that light emitted therefrom is projected generally across the surface ofplate1228. A suitable IR emitting LED is, for example, an IR-emitting SMD-LED commercially available from OSA Opto Light GmbH of Berlin, Germany under catalog designator OIS-210-X-T. It is appreciated that selection of a specific shape and size ofLED1236 may be affected by the specific placement ofLED1236 relative todetector arrays1222 and the interaction between a light beam emitted from theLED1236 and the various components of the integrated display and input device, including theplate1228, thedetector elements1224 and other layers of the integrated display and input device. Optionally, the light emitted byLED1236 may be modulated by modulating circuitry (not shown).

Light, preferably including light in the IR band emitted byillumination subassembly1232, is propagated generally across the surface ofplate1228 and is detected by one or more ofdetector elements1224. Alternatively or additionally, the light is propagated above the surface ofplate1228 and is detected by one or more ofdetector elements1224, which may optionally extend slightly above edge surfaces1226. Furthermore, additionally or alternatively, the light may propagate or be transmitted throughplate1228 directly to one or more ofdetector elements1224 and detected thereby.

The light is deflected by a user's finger, a stylus (not shown) or any other suitable object, touching or located in propinquity toplate1228. When the user's finger touches or is located in propinquity toplate1228, the amount of light detected by one or more ofdetector elements1224 is typically reduced relative to the baseline level of light detected by thedetector elements1224. Detector analyzing processing circuitry (not shown) preferably receives outputs of thedetector elements1224 ondetector arrays1222, digitally processes these outputs and determines whether the absolute amount of light detected by each of thedetector elements1224 is below a predetermined threshold, or whether the change in the amount of light detected by each of thedetector elements1224 exceeds a predetermined threshold.

The amount of light detected by theindividual detector elements1224 on a givendetector array1222, as determined by the detector analyzing processing circuitry, is further processed to provide an array detection output. The array detection output includes information corresponding to the location of an impingement point of the user's finger relative to the givendetector array1222. Typically, the location of at least onedetector element1224, in which the amount of light measured is below a predetermined threshold or the change in the amount of light measured exceeds a predetermined threshold, corresponds to the location of the user's finger along an axis parallel to the givendetector array1222.

In the configuration shown inFIG. 18B, two-dimensional location determining circuitry (not shown) preferably calculates the two-dimensional position of the impingement point of the user's finger on or aboveplate1228 by combining the array detection outputs of at least two detector arrays, typically arranged along at least two mutuallyperpendicular edges1226 ofplate1228.

Reference is now made toFIG. 18C, which shows anarray1242 ofdetector elements1244 arranged in a plane, parallel to aviewing plane1246. As seen inFIG. 18C, in one example of a display and input device structure,detector array1242 is arranged behind an IRtransmissive display panel1248, such as a panel including LCD or OLED elements, underlying a viewingplane defining plate1250. In accordance with a preferred embodiment of the present disclosure thearray1242 is formed of a plurality ofdiscrete detector elements1244 placed on a plane integrally formed therewith. Alternatively, thearray1242 may be formed of one or more CCD or CMOS arrays, or may created by photolithography.

Viewingplane defining plate1250 may be a single or multiple layer plate and may have one or more coating layers associated therewith. In one example of an integrated display and input system employing an LCD, there are provided one or morelight diffusing layers1252 overlying areflector1254. One or morecollimating layers1256 are typically interposed betweenreflector1254 and IRtransmissive display panel1248.

The integrated display and input device shown inFIG. 18C preferably includes anillumination subassembly1262 which typically includes one or more electromagnetic radiation emitting sources. Theillumination subassembly1262 preferably provides a baseline illumination level which is typically detected bydetector elements1244.

In accordance with a preferred embodiment of the present disclosure, shown inFIG. 18C, a generally linear arrangement of multipleIR emitting LEDs1266 is provided, in parallel with one or more ofedges1268 of the integrated display and input device. TheLEDs1266 are arranged such that light emitted therefrom is projected generally across the surface ofplate1208. Suitable IR emitting LEDs are, for example, IR-emitting SMD-LEDs commercially available from OSA Opto Light GmbH of Berlin, Germany under catalog designator OIS-210-X-T. It is appreciated that selection of a specific shapes and sizes ofLEDs1266 may be affected by the specific placement of theLEDs1266 relative toarray1242 and the interaction between light beams emitted from theLEDs1266 and the various components of the integrated display and input device, including theplate1250, thedetector elements1244, the diffusinglayers1252,collimating layers1256, reflectinglayers1254 and other layers of the integrated display and input device. Optionally, the light emitted byLEDs1266 may be modulated by modulating circuitry (not shown).

Light, preferably including light in the IR band emitted byillumination subassembly1262, is reflected from a user's finger, a stylus (not shown) or any other suitable reflective object, touching or located in propinquity toplate1250. The reflected light is propagated throughplate1250 and is detected by one or more ofdetector elements1244.

When the user's finger touches or is located in propinquity toplate1250, the light reflected from the finger is detected by one or more ofdetector elements1244, as described hereinabove, in addition to the baseline level of light detected by thedetector elements1244. Detector analyzing processing circuitry (not shown) preferably receives outputs of thedetector elements1244 ondetector array1242, digitally processes these outputs and determines whether the absolute amount of light detected by each of thedetector elements1244 or the change in the amount of light detected by each of thedetector elements1244 exceeds a predetermined threshold.

The amount of light detected by theindividual detector elements1244 as determined by the detector analyzing processing circuitry, is further processed to provide an array detection output. The array detection output includes information corresponding to the location of an impingement point of the user's finger relative toarray1242. Typically, the location of at least onedetector element1244, in which the amount of light measured or the change in the amount of light measured exceeds a predetermined threshold, corresponds to the two-dimensional location of the user's finger in a plane parallel toarray1242.

In the configuration shown inFIG. 18C, optional three-dimensional location determining circuitry (not shown) may be provided to calculate the three-dimensional (X, Y, Z and/or angular orientation) position of the impingement point of the user's finger on or aboveplate1250 by processing the detector element outputs of at least two detector elements to define the shape and size of an impingement area, as described in assignee's U.S. Provisional Patent Application Nos. 60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 and PCT Patent Application Publication No. WO 2005/094176, the disclosures of which are hereby incorporated by reference.

Reference is now madeFIG. 18D, which showsarrays1272 oflight detector elements1274 arranged at least two mutuallyperpendicular edge surfaces1276 of a viewingplane defining plate1278. Alternatively,detector arrays1272 may be provided along all or most of theedges1276. As a further alternative, asingle detector array1272 may be provided along only oneedge1276 of theplate1278. Viewingplane defining plate1278 may be a single or multiple layer plate and may have one or more coating layers associated therewith. Optionally, one or more ofdetector arrays1272 may be arranged such that thedetector elements1274 thereof extend slightly above the surface of viewingplane defining plate1278.

It is to be appreciated that the phrase “at edges” is to be interpreted broadly as including structures which are located behind edges, as in the embodiments shown inFIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D, about edges as in the embodiments shown inFIGS. 9A-9D and 14A-14D, and along edges as in the embodiments shown inFIGS. 4-7, 8A-8D, 12A-12D and 13A-13D.

Suitable detector elements are, for example, Solderable Silicon Photodiodes commercially available from Advanced Photonix Incorporated of Camarillo, Calif., USA under catalog designator PDB-C601-1.

The integrated display and input device shown inFIG. 18D preferably includes anillumination subassembly1282 which typically includes one or more electromagnetic radiation emitting sources. Theillumination subassembly1282 preferably provides a baseline illumination level which is typically detected bydetector elements1274.

In accordance with a preferred embodiment of the present disclosure, shown inFIG. 18D, one or moreIR emitting LEDs1286 is provided at, generally adjacent to, or interspersed among, a linear arrangement of display backlight LEDs (not shown), typically provided underlying and aligned with edges of a plane of an IRtransmissive display panel1288, such as an LCD or OLED, which underlies and is generally parallel to a viewingplane defining plate1278.

A suitable IR emitting LED is, for example, an SMD type IR GaAs LED commercially available from Marubeni America Corporation of Santa Clara, Calif., USA under catalog designator SMC940. It is appreciated that selection of a specific shapes and sizes ofLEDs1286 may be affected by the specific placement ofLEDs1286 relative todetector arrays1272 and the interaction between light beams emitted from theLEDs1286, light beams emitted from other backlight LEDs, and the various components of the integrated display and input device, including backlight LEDs, theplate1278, thedetector elements1274 and other layers of the integrated display and input device. Optionally, the light emitted byLED1286 may be modulated by modulating circuitry (not shown).

In one preferred embodiment of the present disclosure, thedetector elements1274 are operative to detect visible wavelengths of light emitted from visible light-emitting backlight LEDs. In another preferred embodiment of the present disclosure, backlight LEDs are selected to provide both IR and visible light wavelength emanations.

TheIR emitting LEDs1286 are arranged such that light emitted therefrom is projected generally through one or more diffusing and/orcollimating layers1290 typically underlying the IRtransmissive display panel1288. TheIR emitting LEDs1286 may additionally or alternatively be arranged such that light emitted therefrom is reflected by one or more reflectinglayers1292, underlying and generally parallel to the plane of the IRtransmissive display panel1288. Typically, both diffusinglayers1290 and reflectinglayers1292 are provided, to aid in propagating the backlight and IR light through thetransmissive display panel1288.

Light, preferably including light in the IR band emitted byillumination subassembly1282, is reflected from a user's finger, a stylus (not shown) or any other suitable reflective object, touching or located in propinquity toplate1278. The reflected light is propagated withinplate1278 and is detected by one or more ofdetector elements1274. Alternatively or additionally, the reflected light is propagated above the surface ofplate1278 and is detected by one or more ofdetector elements1274, which may extend slightly above edge surfaces1276. Furthermore, additionally or alternatively, the reflected light may propagate or be transmitted throughplate1278 directly to one or more ofdetector elements1274 and detected thereby.

When the user's finger touches or is located in propinquity toplate1278, the light reflected from the finger is detected by one or more ofdetector elements1274, as described hereinabove, in addition to the baseline level of light detected by thedetector elements1274. Detector analyzing processing circuitry (not shown) preferably receives outputs of thedetector elements1274 ondetector arrays1272, digitally processes these outputs and determines whether the absolute amount of light detected by each of thedetector elements1274 or the change in the amount of light detected by each of thedetector elements1274 exceeds a predetermined threshold.

The amount of light detected by theindividual detector elements1274 on a givendetector array1272, as determined by the detector analyzing processing circuitry, is further processed to provide an array detection output. The array detection output includes information corresponding to the location of an impingement point of the user's finger relative to the givendetector array1272. Typically, the location of at least onedetector element1274, in which the amount of light measured or the change in the amount of light measured exceeds a predetermined threshold, corresponds to the location of the user's finger along an axis parallel todetector array1272.

In the configuration shown inFIG. 18D, two-dimensional location determining circuitry (not shown) preferably calculates the two-dimensional position of the impingement point of the user's finger on or aboveplate1278 by combining the array detection outputs of at least two arrays, typically arranged along at least two mutuallyperpendicular edges1276 ofplate1278.

Reference is now made toFIG. 18E, which shows asingle array1302 oflight detector elements1304 arranged at anedge surface1306 of a viewingplane defining plate1308. Viewingplane defining plate1308 may be a single or multiple layer plate and may have one or more coating layers associated therewith.

It is to be appreciated that the phrase “at an edge” is to be interpreted broadly as including structures which are located behind an edge, as in the embodiments shown inFIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D, about an edge as in the embodiments shown inFIGS. 9A-9D and 14A-14D, and along an edge as in the embodiments shown inFIGS. 4-7, 8A-8D, 12A-12D and 13A-13D.

Suitable detector elements are, for example, Solderable Silicon Photodiodes commercially available from Advanced Photonix Incorporated of Camarillo, Calif., USA under catalog designator PDB-C601-1.

The integrated display and input device shown inFIG. 18E preferably includes anillumination subassembly1312 which typically includes one or more electromagnetic radiation emitting sources. Theillumination subassembly1312 preferably provides a baseline illumination level which is typically detected bydetector elements1304.

In accordance with a preferred embodiment of the present disclosure, shown inFIG. 18E, a generally linear arrangement of multipleIR emitting LEDs1316 is provided, in parallel with one or more ofedges1306. TheLEDs1316 are arranged such that light emitted therefrom is projected generally across the surface ofplate1308.Illumination subassembly1312 may be arranged in parallel todetector array1302, at an edge perpendicular todetector array1302, or may be arranged at an edge opposite or otherwise not adjacent or perpendicular todetector array1302.

Suitable IR emitting LEDs are, for example, the IR-emitting SMD-LEDs commercially available from OSA Opto Light GmbH of Berlin, Germany under catalog designator OIS-210-X-T. It is appreciated that selection of a specific shapes and sizes ofLEDs1316 may be affected by the specific placement of theillumination subassembly1312 relative todetector array1302 and the interaction between light beams emitted from theLEDs1316 and the various components of the integrated display and input device, including theplate1308, thedetector elements1304 and other layers of the integrated display and input device. Optionally, the light emitted byLEDs1316 may be modulated by modulating circuitry (not shown).

Light, preferably including light in the IR band emitted byillumination subassembly1312, is reflected from a user's finger, a stylus (not shown) or any other suitable reflective object, touching or located in propinquity toplate1308. The reflected light is propagated withinplate1308 and is detected by one or more ofdetector elements1304. Alternatively or additionally, the reflected light is propagated above the surface ofplate1308 and is detected by one or more ofdetector elements1304, which may extend slightly above edge surfaces1306. Furthermore, additionally or alternatively, the reflected light may propagate or be transmitted throughplate1308 directly to one or more ofdetector elements1304 and detected thereby.

When the user's finger touches or is located in propinquity toplate1308, the light reflected from the finger is detected by one or more ofdetector elements1304, as described hereinabove, in addition to the baseline level of light detected by thedetector elements1304. Detector analyzing processing circuitry (not shown) preferably receives outputs of thedetector elements1304 ondetector array1302, digitally processes these outputs and determines whether the absolute amount of light detected by each of thedetector elements1304 or the change in the amount of light detected by each of thedetector elements1304 exceeds a predetermined threshold.

The amount of light detected by theindividual detector elements1304 onarray1302, as determined by the detector analyzing processing circuitry, is further processed to provide an array detection output. The array detection output includes information corresponding to the location of an impingement point of the user's finger relative todetector array1302. Typically, the location of at least onedetector element1304, in which the amount of light measured or the change in the amount of light measured exceeds a predetermined threshold, corresponds to the location of the user's finger along an axis parallel toarray1302.

In the configuration shown inFIG. 18E, two-dimensional location determining circuitry (not shown) preferably calculates the two-dimensional position of the impingement point of the user's finger on or aboveplate1308 by further utilizing the array detection output and the information corresponding to the location of the impingement point of the user's finger relative to the array included therein, as described herein below.

Whereas the location of at least onedetector element1304 onarray1302, in which the amount of light measured or the change in the amount of light measured exceeds a predetermined threshold, corresponds to the location of the user's finger along an axis parallel toarray1302, the strength of the signal output of thatdetector element1304 decreases as the distance of the impingement point of the user's finger fromarray1302 along an axis generally perpendicular to the axis of thearray1302 increases. Conversely, the strength of the signal output of thedetector element1304 increases as the distance of the impingement point of the user's finger fromarray1302 along an axis generally perpendicular to the axis of thearray1302 decreases. These characteristics of the various components of the integrated display and input device are employed by the two-dimensional location determining circuitry to calculate the two-dimensional position of the impingement point of the user's finger on theplate1308 or above it.

Reference is now made toFIG. 18F, which shows an integrated display and input device having touch responsive input functionality. As seen inFIG. 18F, a multiplicity oflight detector elements1322 are interspersed amonglight emitters1324 arranged in aplane1326 underlying a viewingplane defining plate1328. Examples of such a structure are described in U.S. Pat. No. 7,034,866 and U.S. Patent Application Publication Nos. 2006/0132463A1, 2006/0007222A1 and 2004/00012565A1, the disclosures of which are hereby incorporated by reference.

Viewingplane defining plate1328 may be a single or multiple layer plate and may have one or more coating layers associated therewith. In one example of an integrated display and input system employing light detector elements interspersed among light emitting elements, there are provided one or morelight diffusing layers1330 overlying areflector1332. One or morecollimating layers1334 may be interposed betweenreflector1332 and theplane1326 which includes the light detector and light emitting elements.

The integrated display and input device shown inFIG. 18F preferably includes anillumination subassembly1342 which typically includes one or more electromagnetic radiation emitting sources. Theillumination subassembly1342 preferably provides a baseline illumination level which is typically detected bydetector elements1322.

In accordance with a preferred embodiment of the present disclosure, shown inFIG. 18F, a generally linear arrangement of multipleIR emitting LEDs1346 is provided, generally in parallel with one or more ofedges1348 ofplate1328. TheLEDs1246 are arranged such that light emitted therefrom is projected generally across the surface ofplate1328. Suitable IR emitting LEDs are, for example, IR-emitting SMD-LEDs commercially available from OSA Opto Light GmbH of Berlin, Germany under catalog designator OIS-210-X-T. It is appreciated that selection of a specific shapes and sizes ofLEDs1346 may be affected by the specific placement of theLEDs1346 relative to plane1326 and the interaction between one or more light beams emitted fromLEDs1346 and the various components of the integrated display and input device including theplate1328, thedetector elements1322, diffusinglayers1330,collimating layers1334, reflectinglayers1332 and other layers of the integrated display and input device. Optionally, the light emitted byLEDs1346 may be modulated by modulating circuitry (not shown).

Light, preferably including light in the IR band emitted byillumination subassembly1342, is reflected from a user's finger, a stylus (not shown) or any other suitable reflective object, touching or located in propinquity toplate1328. The reflected light is propagated throughplate1328 and is detected by one or more ofdetector elements1322.

When the user's finger touches or is located in propinquity toplate1328, the light reflected from the finger is detected by one or more ofdetector elements1322, in addition to the baseline level of light detected by thedetector elements1322. Detector analyzing processing circuitry preferably receives outputs of thedetector elements1322, digitally processes these outputs and determines whether the absolute amount of light detected by each of thedetector elements1322 or the change in the amount of light detected by each of thedetector elements1322 exceeds a predetermined threshold.

The amount of light detected by theindividual detector elements1322, as determined by the detector analyzing processing circuitry, is further processed to provide an array detection output. The array detection output includes information corresponding to the location of an impingement point of the user's finger. Typically, the location of at least onedetector element1322, in which the amount of light measured or the change in the amount of light measured exceeds a predetermined threshold, corresponds to the two-dimensional location of the user's finger on or aboveplate1328 and parallel toplane1326.

In the configuration shown inFIG. 18F, optional three-dimensional location determining circuitry (not shown) may be provided to calculate the three-dimensional (X, Y, Z and/or angular orientation) position of the impingement point of the user's finger on or aboveplate1328 by processing the detector element outputs of at least two detector elements to define the shape and size of an impingement area, as described in assignee's U.S. Provisional Patent Application Nos. 60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 and PCT Patent Application Publication No. WO 2005/094176, the disclosures of which are hereby incorporated by reference.

It is appreciated that any of the configurations of the illumination subassemblies shown in the embodiments ofFIGS. 18A-18F may be combined with any of the detector array configurations shown inFIGS. 1-18F.

Reference is now made toFIG. 19, which is a simplified illustration of an integrated display and input device constructed and operative in accordance with a preferred embodiment of the present disclosure, utilizing electromagnetic radiation from a source external to the integrated display and input device.

As seen inFIG. 19,arrays1402 oflight detector elements1404 are arranged at least two mutuallyperpendicular edge surfaces1406 of a viewingplane defining plate1408. Alternatively,detector arrays1402 may be provided along all or most of theedges1406. As a further alternative, asingle detector array1402 may be provided along only oneedge1406 of theplate1408. Viewingplane defining plate1408 may be a single or multiple layer plate and may have one or more coating layers associated therewith.

It is to be appreciated that the phrase “at edges” is to be interpreted broadly as including structures which are located behind edges, as in the embodiments shown inFIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D, about edges as in the embodiments shown inFIGS. 9A-9D and 14A-14D, and along edges as in the embodiments shown inFIGS. 4-7, 8A-8D, 12A-12D and 13A-13D.

Suitable detector elements are, for example, Solderable Silicon Photodiodes commercially available from Advanced Photonix Incorporated of Camarillo, Calif., USA under catalog designator PDB-C601-1.

Light incident upon theviewing plate1408, preferably including light in the IR band emitted by one or more sources of illumination external to the integrated display and input device, is propagated withinplate1408 and is detected by one or more ofdetector elements1404. Alternatively or additionally, the incident light is propagated above the surface ofplate1408 and is detected by one or more ofdetector elements1404, which may extend slightly above edge surfaces1406. Furthermore, additionally or alternatively, the incident light may propagate or be transmitted throughplate1408 directly to one or more ofdetector elements1404 and detected thereby. The detection of incident light bydetector elements1404 defines a baseline illumination level therefore.

Light, preferably including light in the IR band emitted by one or more sources of illumination external to the integrated display and input device, is reflected from a user's finger, a stylus (not shown) or any other suitable reflective object, touching or located in propinquity toplate1408. The reflected light is propagated withinplate1408 and is detected by one or more ofdetector elements1404. Alternatively or additionally, the reflected light is propagated above the surface ofplate1408 and is detected by one or more ofdetector elements1404, which may extend slightly above edge surfaces1406. Furthermore, additionally or alternatively, the reflected light may propagate or be transmitted throughplate1408 directly to one or more ofdetector elements1404 and detected thereby.

Suitable external light sources include sunlight, artificial room lighting and IR illumination emitted from a human body or other heat source. In an alternate preferred embodiment, the quantity or intensity of the reflected light may be augmented by the addition of an illumination subassembly1412 which typically includes one or more electromagnetic radiation emitting sources. Examples of various suitable configurations of illumination subassembly1412 are described hereinabove with reference toFIGS. 18A-18F.

When the user's finger touches or is located in propinquity toplate1408, the light reflected from the finger is detected by one or more ofdetector elements1404, as described hereinabove, in addition to the baseline level of light detected by thedetector elements1404. Detector analyzing processing circuitry (not shown) preferably receives outputs of thedetector elements1404 onarrays1402, digitally processes these outputs and determines whether the absolute amount of light detected by each of thedetector elements1404 or the change in the amount of light detected by each of thedetector elements1404 exceeds a predetermined threshold.

The amount of light detected by theindividual detector elements1404 on a givenarray1402, as determined by the detector analyzing processing circuitry, is further processed to provide an array detection output. The array detection output includes information corresponding to the location of an impingement point of the user's finger relative to the givenarray1402. Typically, the location of at least onedetector element1404, in which the amount of light measured or the change in the amount of light measured exceeds a predetermined threshold, corresponds to the location of the user's finger along an axis parallel toarray1402.

In the configuration shown inFIG. 19, two-dimensional location determining circuitry (not shown) preferably calculates the two-dimensional position of the impingement point of the user's finger on or aboveplate1408 by combining the array detection outputs of at least two arrays, typically arranged along at least two mutuallyperpendicular edges1406 ofplate1408.

It is appreciated by persons skilled in the art that the present disclosure is not limited by what has been particularly shown and described hereinabove. Rather the scope of the present disclosure includes both combinations and sub combinations of various features described hereinabove as well as variations and modifications thereto which would occur to a person of skill in the art upon reading the above description and which are not in the prior art.

Claims (21)

The invention claimed is:

1. A device comprising:

a display panel having a pixel array that defines a display area, the pixel array is configured to visually present digital content;

an Infra-Red (IR) emitter positioned proximate to the display area, the IR emitter illuminating one or more objects in proximity to the device;

a position sensing array positioned proximate to at least one edge of the display area, the position sensing array is configured to receive, through at least one layer of the display panel, at least a portion of light reflected by an object in proximity to the device and generate an output signal that represents an amount of the portion of light; and

a processing unit configured to:

receive the output signal from the position sensing array;

determine the output signal exceeds a predetermined threshold;

calculate, based on the output signal, a position of the object relative to the device when the output signal exceeds the predetermined threshold; and

execute input functionality corresponding to the position of the object.

2. The device ofclaim 1, wherein the processing unit is further configured to:

determine a baseline level of ambient light proximate to the device; and

set the predetermined threshold above the baseline level of ambient light.

3. The device ofclaim 1, wherein the processing unit is further configured to:

determine a change in the output signal; and

calculate movement of the object relative to the display panel based on the output signal.

4. The device ofclaim 1, wherein the processing unit is further configured to:

determine a shape and size of an impingement area relative to the display area based on the output signal; and

calculate a three-dimensional position of the object based on the shape and size of the impingement area.

5. The device ofclaim 1, wherein the processing unit is further configured to:

determine a shape and size of an impingement area relative to the display area based on the output signal; and

calculate an angular orientation of the object relative to the display area based on the shape and size of the impingement area.

6. The device ofclaim 1, wherein the processing unit is further configured to:

determine, based on the output signal, a two-dimensional position of the object relative to the display area.

7. The device ofclaim 1, wherein the display panel comprises at least one of an infra-red (IR) transmissive display layer, a liquid crystal display (LCD) layer, or an organic light emitting diode (OLED) layer.

8. The device ofclaim 1, wherein the display panel comprises at least one of a diffusing layer, a reflector layer, or a collimating layer.

9. The device ofclaim 1, wherein the object comprises at least one of a stylus, a portion of a hand, or a finger.

10. The device ofclaim 1, wherein the IR emitter comprises an IR light emitting diode (LED).

11. The device ofclaim 1, wherein the display panel includes a backlight layer for illuminating at least a portion of the display area.

12. The device ofclaim 1, further comprising:

a backlight for illuminating at least a portion of the display area.

13. A method for determining a position of an object relative to a device, the method comprising:

displaying digital content by a pixel array that defines a display area on a portion of a display panel;

illuminating one or more objects in proximity to the device by an Infra-Red (IR) emitter positioned proximate to the display area;

receiving, by a position sensing array, at least a portion of light reflected by an object in proximity to the device and through at least one layer of the display panel;

generating an output signal by the position sensing array, the output signal representing an amount of the portion of light reflected by the object;

determining, by a processor, the output signal exceeds a predetermined threshold; and

calculating, by the processor, a position of the object relative to the device when the output signal exceeds the predetermined threshold.

14. The method ofclaim 13, further comprising:

determining, by the processor, a baseline level of ambient light proximate the display panel; and

setting the predetermined threshold above the baseline level of ambient light.

15. The method ofclaim 13, further comprising:

determining, by the processor, a change in the output signal; and

calculating, by the processor, movement of the object relative to the display panel based on the change in the output signal.

16. The method ofclaim 13, further comprising:

determining, by the processor, a shape and size of an impingement area relative to the display area based on the output signal; and

calculating, by the processor, a three-dimensional position of the object based on the shape and size of the impingement area.

17. The method ofclaim 13, further comprising:

determining, by the processor, a shape and size of an impingement area relative to the display area based on the output signal; and

calculating, by the processor, an angular orientation of the object relative to the display area based on the shape and size of the impingement area.

18. The method ofclaim 13, further comprising:

determining, based on the output signal, a two-dimensional position of the object relative to the display area.

19. The method ofclaim 13, wherein the display panel comprises at least one of an infra-red (IR) transmissive display layer, a liquid crystal display (LCD) layer, or an organic light emitting diode (OLED) layer.

20. The method ofclaim 13, wherein the object comprises at least one of a stylus, a portion of a hand, or a finger.

21. A system for determining a position of an object relative to a device, the system comprising:

a display panel having a pixel array that defines a display area, the pixel array is configured to visually present digital content;

an Infra-Red (IR) emitter positioned proximate to the display area, the IR emitter illuminating one or more objects in proximity to the device;

a position sensing array positioned proximate to at least one edge of the display area, the position sensing array is configured to receive, through at least one layer of the display panel, at least a portion of light reflected by an object in proximity to the device and generate an output signal that represents an amount of the portion of light; and

a processing unit configured to:

receive the output signal from the position sensing array;

determine the output signal exceeds a predetermined threshold;

calculate, based on the output signal, a position of the object relative to the device when the output signal exceeds the predetermined threshold; and

execute input functionality for the device corresponding to the position of the object.

Images