US20090184942A1 - Optical sensor based user interface for a portable electronic device - Google Patents

Abstract

An apparatus and method are described herein, which simultaneously promotes a positive computing experience for users of portable computer systems and increases overall durability and longevity thereof. In one embodiment, an optical apparatus enhances the user computing experience, in one embodiment by simplifying operation, and is much more durable and long-lasting than mechanical switch and dial type devices it may replace. In one embodiment, the present invention is directed to an apparatus, which enables efficient portable computer device function, field, and data selection, gaming, input, interconnection, and other switching-related functions, simplifying operation and enhancing versatility thereof, yet without exposing the portable computer interior to any degree to incursion of environmental contamination. In one embodiment, an optical apparatus obviates openings in a portable computer package which would otherwise be required. In one embodiment, the apparatus, capable of sensing manipulation and directed by software, has a light source and corresponding light sensor.

Description

RELATED U.S. PATENT APPLICATION
• This Continuation Application claims the benefit and priority of the co-pending, commonly-owned US Patent Application with Attorney Docket No. PALM-3641.5G.CON, application Ser. No. 10/951,537, filed on Sep. 27, 2004, by Wong et al., and titled “OPTICAL SENSOR BASED USER INTERFACE FOR A PORTABLE ELECTRONIC DEVICE,” which is a Continuation Application that claims the benefit of the commonly-owned U.S. patent application Ser. No. 09/871,375 filed on May 30, 2001, now issued as a U.S. Pat. No. 6,816,154, by Wong et al., and titled “Optical Sensor Based User Interface For a Portable Electronic Device,” which are incorporated herein by reference.
BACKGROUND OF THE INVENTION
• 1. Field of the Invention
• The present invention relates to the field of portable electronic devices such as personal digital assistants or pentop computer systems. Specifically, the present invention relates to an apparatus and method for utilizing an optical sensor based user interlace for registering user input.
• 2. Related Art
• Portable computer systems, such as “palmtop” computer systems, or personal digital assistants (PDA) have become commonplace and extraordinarily useful electronic devices. A palmtop computer system includes a hand-held device and a cradle device to which it ports and which connects and synchronizes it to other computers. Owing to their portability, capability, and versatility, hand-held computer devices are designed to be used in a wide variety of environments, for many applications.
• Portable computers are usually robustly packaged devices, designed for simplicity of operation and durability. Few penetrations expose their interiors, wherein their operational components reside. However, function/field selection buttons, on/off, interconnection, and other switching components expose the interior to some degree to allow accessibility for switching and other operations. Mechanical switching components, such as switches, buttons, and, especially, thumbwheels and associated potentiometers, variable capacitors, and the like, while ostensibly durable, have definite physical vulnerabilities and finite operational lifespans. Further, although designed for operational simplicity, using a portable computer system by manipulating these switching components requires some degree of tactile skill.
• Portable computer systems may be used in harsh environments, unlike other computers designed with less of a degree of mobility, such as desktop computer systems. For example, desktop computer systems most often find application in offices, classrooms, and similar milieus, with environments subject to some relatively satisfactory degree of control. Portable computer systems, on the other hand, while indeed they may also be used in such environments, are designed for use almost anywhere, contributing to their versatility and usefulness, e.g., a vehicle, outside, etc.
• Portable computer systems are frequently and reliably deployed in-transit, in private and public modes of transportation of almost every kind. Portable computer systems find operational deployment in the field in, for example, industrial, urban, marine, construction, and even military application. Under these circumstances, their operational environment may vary widely and change rapidly, often subject to little or no control. These environments may also be quite rugged, extreme, wet, dirty, contaminated, and dusty.
• When their operational environment is rugged, extreme, wet, dirty, dusty, or contaminated, operation of the portable computer system may contribute to or cause internal contamination or physical damage. Environmental contaminants such as moisture, dirt, dust, chemicals, and the like, may penetrate even the small openings for exposure of switching components to user manipulation, especially thumbwheels and their associated potentiometers. Once inside the portable computer, or a connector or button, they may cause fouling, damage, or destruction of its internal microelectronic and other components. And while switching components may be designed for durability, they all display some degree of physical vulnerability and aging degradation characteristics.
• Although designed for operational simplicity, portable computer systems require same dexterity to operate properly. To operate the portable computer system to accomplish these tasks, controls and switching components must be manipulated. Manipulation enables, for example, choosing a screen, scrolling through various screens, selecting an on-screen icon, field, menu, listing, or data entry, or “writing to” or “typing on” an on-board touch-sensitive writing pad-like surface with a stylus, or other touch-enabling probe.
• However, also owing to their versatility and portability, portable computer systems may be operated by a user who is purposefully multi-tasking, or otherwise engaged in other activities besides operating the portable computer. Portable computer systems are routinely utilized to, for example, access telephone numbers from an on-board telephone list, reminders from an on-board list of memoranda, gaming, portable internet browsing or email access, and a host of other computer-enabled and/or enhanced activities, all while the user is fully engaged in some other task.
• When the circumstances under which portable computer systems are used become complex and distracting, operation of the portable computer system may become difficult. This may detract from the computing experience of the user, it may cause errors or loss of data, and/or require operational stops to be repeated. This is inconvenient and costly.
• Conventionally, an approach to solving the problem of internal exposure of portable computers to environmental contaminants has been to attempt to minimize the interior exposure. This has been accomplished in one attempted solution by reducing the number and size of penetrations through their cases, and to seal the penetrations. Reducing the number of penetrations requires a concomitant reduction in the number of switching components. This requires switching components to have multiple, selectable functions. However, this has the undesirable effect of increasing operational complexity. Sealing the penetrations increases packaging complexity and increases unit costs, and interferes with switching component operations.
• Conventionally, an approach to solving the problem of making portable computer device operation less complicated for engaged users, especially those simultaneously engaged in activities besides computing, has been to simplify the computer-user interface. This has been attempted, in one approach, by adding switching components. However, this has the undesirable effect of increasing package penetration with resulting increased internal exposure of the computer device to environmental contaminants.
• Another conventional method of attempting to solve this problem has been-to change the characteristics of the switching components. For instance, in one approach, a “jog wheel,” “thumb wheel,” or similar of rotary dial-type mechanism. However, this particular approach is especially vulnerable to environmental contamination problems.
• Rotary dial-type mechanisms rotate about a shaft, which penetrates the package of the portable computer system to actuate the rotationally variable electrical components contained within. This shaft penetration is potentially a route for incursion of environmental contamination to the sensitive interior of the portable computer device. Exacerbating this problem is the size of the rotary dial, itself. Normally, such dials are larger than other switches penetrating the portable computer device package. Further, the dial has a lower surface facing the portable computer device package, yet not quite abutting it.
• The space beneath the dial, between the dial and the portable computer device package is especially susceptible to the accumulation of moisture, detritus, dirt, dust, debris, oil, and chemicals. This is particularly problematic for three reasons. First, because the potential environmental contaminants remain there, proximate to a potential incursion route to the portable computer system interior even after the portable computer system is removed from the contaminating environment. Second, it increases the time of exposure to the potential environmental contaminants, thus increasing the probability of incursion. Third, the space between the dial and the portable computer device package is very hard to clean, and attempts to clean it may actually force contaminants into the shaft incursion route and into the interior of the portable computer.
• The conventional art is problematic therefore for two related reasons. First, because attempts to promote ease of use of portable computer devices threaten increased risk of internal exposure thereof to environmental contamination. Second, because attempts to reduce risk of internal exposure of portable computer devices to environmental contamination complicate their use and increase their cost.
• What is needed is a method and/or apparatus that promotes a positive computing experience for users of portable computer systems and/or increases overall durability an War Longevity thereof. What is also needed is a method and/or apparatus that promotes the operational simplicity of portable computer systems. Further, what is needed is a method and/or apparatus that enables efficient portable computer function, field, and data selection, gaming, input, interconnection, and other switching-related functions without exposing the portable computer interior to any degree to incursion of environmental contamination. Further still, what is needed is a method and/or apparatus that achieves the foregoing accomplishments while allowing the full range of both portability and environmental exposure, and range and ease of use characteristic of portable computer devices, yet without complete redesign.
SUMMARY OF THE INVENTION
• An apparatus and method are described herein, which simultaneously promote a positive computing experience for users of portable computer systems and increases overall durability and longevity thereof. An apparatus and method are described herein, which also promote the operational simplicity of portable computer systems. Further, an apparatus and method are described herein, which enable efficient portable computer function, field, and data selection, gaming, input, interconnection, and other switching-related functions without exposing the portable computer interior to any degree to incursion of environmental contamination. Further still, an apparatus and method are described herein, which achieve the foregoing accomplishments while allowing the full range of bath portability and environmental exposure, and range and ease of use characteristic of portable computer devices, yet without completely redesigning portable computer system packaging and operation.
• In one embodiment, the present invention is directed to an apparatus and method, which promote a positive computing experience for users of portable computer systems. Simultaneously, the present embodiment promotes overall portable computer device durability and longevity. In the present embodiment, an optical apparatus and a method for using it enhance the experience of a user attempting to compute. Further, the optical apparatus is much more durable and long-lasting than mechanical switch and dial type devices it may replace.
• In one embodiment, the present invention is directed to an apparatus and method, which also promote the operational simplicity of portable computer systems. In the present embodiment, an optical apparatus and method of using it simplify operations such as function, field, and data selection, gaming, input, interconnection, browsing, scrolling, and other switching-related functions. This promotes use of the device while engaged in activities beside computing, enhancing versatility.
• In one embodiment, the present invention is directed to an apparatus and method, which enable efficient portable computer device function, field, and data selection, gaming, input, interconnection, and other switching-related functions without exposing the portable computer interior to any degree to incursion of environmental contamination. In the present embodiment, an optical apparatus obviates openings in portable computer which were conventionally required, in the prior art, for mechanically manipulated switches. Advantageously, this deters encroachment of environmental contaminants into the interior of the portable computer device.
• In one embodiment, the present invention is directed to an apparatus and method, which achieve the foregoing advantages while allowing the full range of both portability and environmental exposure, and range and ease of use characteristic of portable computer devices, yet without completely redesigning portable computer system packaging and operation. The same basic portable computer device package is still applicable. In the present embodiment, an optical apparatus obviating mechanically manipulated switch openings deters incursion of contaminants into portable computer device interiors. With no package redesign, portable computer devices may continue to be deployed in all environments, now with greatly reduced risk of damage and/or contamination.
• These and other objects and advantages of the present invention will become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiments, which are illustrated in the various drawing figures.
BRIEF DESCRIPTION OF THE DRAWINGS
• The accompanying drawings which are incorporated in and form a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention,
• FIG. 1 is a system illustration of a portable computing system connected to other computer systems and the Internet via a cradle device.
• FIG. 2A is a perspective illustration of the top face of an exemplary portable computer system.
• FIG. 2B is a perspective illustration of one embodiment of a bottom side of the portable computer system ofFIG. 2A.
• FIG. 3 is a block diagram of exemplary circuitry of a portable computing system in accordance with one embodiment of the present invention.
• FIG. 4 is a perspective view of the cradle device for connecting the portable computing system to other systems via a communication interface.
• FIG. 5A is a perspective view of the top face of an exemplary portable computer device incorporating an optical user interface, in accordance with one embodiment of the present invention.
• FIG. 5B is a perspective view of the side edge of an exemplary portable computer device incorporating an optical user interface, in accordance with one embodiment of the present invention.
• FIG. 5C is a perspective view of the side edge of an exemplary portable computer device, depicting an array of visually formatted information, including text and highlighted text, on a display screen, and incorporating an optical user interface, in accordance with one embodiment of the present invention.
• FIG. 6A is a concentric top view of an exemplary optical user interface, in accordance with one embodiment of the present invention.
• FIG. 6B is a block diagram of electrical elements of an exemplary optical user interface, in accordance with one embodiment of the present invention.
• FIG. 6C is a block diagram of electrical elements of an exemplary combination optical-electromechanical user interface, in accordance with one embodiment of the present invention.
• FIG. 7A is a schematic diagram of an exemplary combination optical-electromechanical user interface, in accordance with one embodiment of the present invention.
• FIG. 7B is a schematic diagram of en exemplary combination optical-electromechanical user interface, incorporating an exemplary flexible digitizer element, in accordance with one embodiment of the present invention.
• FIG. 8 is a flow chart of steps in an exemplary process for implementing an optical user interface for an electronic device, in accordance with one embodiment of the present invention.
• FIG. 9A is a flow chart of steps in an exemplary process for implementing a variable optical scan rate, in accordance with one embodiment of the present invention.
• FIG. 9B is a flow chart of steps in an exemplary process for implementing a scan rate power usage protocol, in accordance with one embodiment of the present invention.
• FIG. 10 is a flow chart of steps in an exemplary process for changing visually formatted information, in accordance with one embodiment of the present invention.
• The drawings referred to in this description should not be understood as being drawn to scale except if specifically noted.
DETAILED DESCRIPTION OF THE INVENTION
• In the following detailed description of the present invention, an optical sensor based user interface for a handheld device, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be recognized by one skilled in the art that the present invention may be practiced without these specific details or with equivalents thereof. In other instances, well-known methods, procedures, components, and circuits have not been described in detail as not to unnecessarily obscure aspects of the present invention.
Notation and Nomenclature
• Some portions of the detailed descriptions, which follow, are presented in terms of procedures, steps, logic blocks, processing, and other symbolic representations of operations on data bits that can be performed on computer memory. These descriptions and representations are the means used by those skilled in the electronic, computer, and data processing arts to most effectively convey the substance of their work to others skilled in the art. A procedure, computer executed step, logic block, process, etc., is here, and generally, conceived to be a self-consistent sequence of steps or instructions leading to a desired result. The steps are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated in a computer system. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.
• It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the following discussions, it is appreciated that throughout the present invention, discussions utilizing terms such as “generating” or “coupling” or “changing” or “scanning” or “sending” or “sensing” or “processing” or “repeating” or “adjusting” or “modifying” or “displaying” or “highlighting” or “scrolling” or “formatting” or “selecting” or “moving” or the like, refer to the action and processes of a computer system or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
• The present invention is discussed in one example in the context of a portable computer system, such as a portable computer device, palmtop computer, or personal digital assistant. However, it is appreciated that the present invention can be used with other types of devices that require user interfacing with a computer, e.g., cell phones, remote control devices, portable web browsers, pagers, etc.
• Reference will now be made in detail to the preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings. While the invention will be described in conjunction with the preferred embodiments, it will be understood that they are not intended to limit the invention to these embodiments. On the contrary, the invention is intended to cover alternatives, modifications and equivalents, which may be included within the spirit and scope of the invention as defined by the appended claims. Furthermore, in the following detailed description of the present invention, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be obvious to one of ordinary skill in the art that the present invention may be practiced without these specific details.
• Although the optical sensor based user interface of the present invention may be implemented in a variety of different electronic systems such as a pager, a mobile phone, a calculator, a personal digital assistant (PDA), etc., one exemplary embodiment includes the optical sensor based user interface with a portable computing system. It should be understood that the descriptions corresponding toFIGS. 1-4 provide some general information about an exemplary portable computing system.
Exemplary Portable Computer System
• FIG. 1 illustrates asystem50 that may be used in conjunction with an exemplaryportable computing device100. Specifically,system50 comprises ahost computer system56 which can either be a desktop unit as shown, or, alternatively, can be alaptop system58. Optionally, one or more host computer systems can be used withinsystem50.Host computer systems56 and58 are shown connected to acommunication bus54, which in one embodiment can be a serial communication bus, but could be of any of a number of well known communication standards and protocols, e.g., a parallel bus, Ethernet, Local Area Network (LAN), and the like. Optionally,bus54 can provide communication with theInternet52 using a number of well known protocols.
• Bus54 is also coupled to acradle60 for receiving and initiating communication withportable computing device100.Cradle60 provides an electrical and mechanical communication interface between bus54 (and anything coupled to bus54) and theportable computer system100 for two way communications.Computer system100 also contains a wirelessinfrared communication mechanism64 for sending and receiving information from other devices.
• FIG. 2A is a perspective illustration of thetop face100aof an exemplaryportable computer system100. Thetop face100acontains adisplay screen105 surrounded by atop cover110. Aremovable stylus80 is also shown. Thedisplay screen105 is a touch screen able to register contact between the screen and the tip of thestylus80. Additionally, thestylus80 can be fabricated of any material to make contact with thescreen105. Thetop face100aalso contains one or more dedicated and/orprogrammable buttons75 for selecting information and causing thecomputer system100 to implement functions. The on/offbutton95 is also shown.
• FIG. 2A also illustrates a handwriting recognition pad or “digitizer” containing tworegions106aand106b. For example,region106ais for the drawing of alpha characters therein for automatic recognition whileregion106bis for the drawing of numeric characters therein for automatic recognition. Thestylus80 is used for stroking a character within one of theregions106aand106b. The stroke information is then fed to an internal processor for automatic character recognition. Once characters are—recognized, they are typically displayed on thescreen105 for verification and/or modification.
• FIG. 2B is a perspective illustration of one embodiment of abottom side100bofportable computer system100. An optionalextendible antenna85 is shown and also a batterystorage compartment door90 is shown. Acommunication interface108 is also shown. In one embodiment of the present invention, thecommunication interface108 is a serial communication port but could also alternatively be of any of a number of well known communication standards and protocols, e.g., parallel, small computer system interface (SCSI), Ethernet, FireWire (IEEE 1394), Universal Serial Bus (USB), etc.
• FIG. 3 is a block diagram of exemplary circuitry ofportable computing system100 in accordance with one embodiment of the present invention. Thecomputer system100 includes an address/data bus99 for communicating information, acentral processor101 coupled with thebus99 for processing information and instructions. It is appreciated thatcentral processor unit101 may be a microprocessor or any other type of processor. Thecomputer system100 also includes data storage features such as a volatile memory102 (e.g., random access memory, static RAM, dynamic RAM, etc.) coupled with thebus99 for storing information and instructions for thecentral processor101 and a non-volatile memory103 (e.g., read only memory, programmable ROM, flash memory, EPROM, EEPROM, etc.) coupled with thebus99 for storing static information and instructions for theprocessor101.Computer system100 may also include an optional data storage device104 (e.g., thin profile removable memory) coupled with thebus99 for storing information and instructions. It should be understood thatdevice104 may be removable. Furthermore,device104 may also be a secure digital (SD) card-reader or equivalent removable memory reader.
• Also included incomputer system100 ofFIG. 3 is analphanumeric input device106 which in one implementation is a handwriting recognition pad (“digitizer”) and may include integrated push buttons in oneembodiment Device106 can communicate information (spatial data and pressure data) and command selections to thecentral processor101. Thedigitizer106 records both the (x, y) coordinate value of the current location of thestylus80 and also simultaneously records the pressure that thestylus80 exerts on the face of thedigitizer pad106. The coordinate values (spatial information) and pressure data are then output on separate channels for sampling by theprocessor101. In one implementation, there are roughly 256 different discrete levels of pressure that can be detected by thedigitizer106. Since the digitizer's channels are sampled serially by theprocessor101, the stroke spatial data are sampled “pseudo” simultaneously with the associated pressure data. The sampled data is then stored in a memory by theprocessor101 for later analysis.
• System100 ofFIG. 3 also includes an optional cursor control or directingdevice107 coupled to thebus99 for communicating user input information and command selections to thecentral processor101. In one implementation,device107 is a touch screen device (also a digitizer) incorporated withscreen105.Device107 is capable of registering a position on thescreen105 where thestylus80 makes contact and the pressure of the contact. The digitizer of106 or107 may be implemented using well known devices, for instance, using the ADS-7846 device by Buff-Brown that provides separate channels for spatial stroke information and pressure information.
• Computer system100 also contains a flatpanel display device105 coupled to thebus99 for displaying information to the computer user. Thedisplay device105 utilized with thecomputer system100 may be a liquid crystal device (LCD), cathode ray tube (CRT), field emission device (FED, also called flat panel CRT), plasma or other display technology suitable for creating graphic images and alphanumeric characters recognizable to the user. In one embodiment, thedisplay105 is a flat panel multi-mode display capable of both monochrome and color display modes.
• Also included incomputer system100 ofFIG. 3 is asignal communication device108 coupled tobus99 that may be a serial port (or USB port) for enablingsystem100 to communicate with thecradle60. As mentioned above, in one embodiment, thecommunication interface108 is a serial communication port, but could also alternatively be of any of a number of well known communication standards and protocols, e.g., parallel, SCSI, Ethernet, FireWire (IEEE 1394), USB, etc. In addition todevice108, wireless communication links can be established between thedevice100 and a host computer system (or another portable computer system) using aBluetooth wireless device112, an infrared (IR)device64, or a Global System for Messaging (GSM)radio device114.System100 may also include awireless modem device114 and/or a wireless radio, e.g., a GSM wireless radio with supporting chip set. Thewireless modem device114 is coupled to communicate with thecentral processor101 but may not be directly coupled toport108.
• In one implementation, the Mobitex wireless communication system may be used to provide two way communication betweencomputer system100 and other networked computers and/or the Internet (e.g., via a proxy server). In other embodiments, transmission control protocol (TCP) can be used or Short Message Service (SMS) can be used.System100 ofFIG. 3 may also contain batteries for providing electrical power.
• In one embodiment,Optical User Interface75 is coupled toProcessor101 bybus99. In one embodiment,processor101 sends an optical signalgeneration demand signal770 tooptical user interface75. In the present embodiment,optical user interface75 generates anoptical signal555 accordingly.Signal770, in one embodiment, controls the optical scan rate ofoptical user interface75. After a user interaction,optical signal555 is redetected byoptical user interface75, which generates acorresponding interface signal771, which is sent toprocessor101, in one embodiment, with a scan ratepower usage signal772. In one implementation,optical user interface75 interacts withdisplay device105 for control of the exhibition of visually formatted information. In one embodiment,optical user interface75 interacts with on-screen cursor control107 anddisplay device105 for control and positioning of an on-screen cursor. In one embodiment,optical user interface75 interacts withdigitizer106. In one embodiment,digitizer106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction viaoptical user interface75, in an optical-electromechanical user interaction enabling implementation. In one embodiment, the optical user interaction is controlled by a program implemented by computer readable and executable instructions distributed to varying degrees in various implementations betweenprocessor101,RAM102,ROM103, andstorage device104.
• FIG. 4 is a perspective illustration of one embodiment of thecradle60 for receiving theportable computer system100. Thecradle60 contains a mechanical andelectrical interface260 for interfacing with communication interlace108 (FIG. 2B) ofcomputer system100 whensystem100 is slid into thecradle60 in an upright position. Once inserted,button270 can be pressed to initiate two way communication betweenportable computer system100 and other computer systems coupled tocommunication bus54.
Exemplary User InterfacesExemplary Optical User Interfaces
• FIG. 5A is a perspective illustration of thetop face100aof one embodiment of apalmtop computer system100, that can be used with the present invention.Optical user interface75 is depicted as mounted, in one embodiment, in the center of the lower portion oftop face100a, belowscreen105 anddigitizer106. In one embodiment,optical user interface75 interacts withdigitizer106, and may be mounted beneath it. In the present embodiment,digitizer106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction viaoptical user interface75, in an optical-electromechanical user interaction enabling implementation.
• It is appreciated that the position depicted foroptical user interface75 herein is not intended to be limiting. For example,optical user interface75 may be mounted in any user accessible position onsystem100. Such positions are illustrated, for example only, and not limited to, possible other positions75p.
• InFIG. 5B, a perspective illustration of the side edge ofexemplary system100 is depicted.Optical User interface75 is depicted, for example only, and not limited, in a position low on theupper face100a.Lower face100bis depicted opposite toupper face100a, for perspective.
• InFIG. 5C, a perspective of thetop face100aof one embodiment of apalmtop computer system100, that can be used with the present invention.Optical user interface75 is depicted as mounted, in one embodiment, in the center of the lower portion oftop face100a, belowscreen105 anddigitizer106. In one embodiment,optical user interface75 interacts withdigitizer106, and may be mounted beneath it.
• Screen105 displays an exemplary array of visually formatted information105d. In the present example, the array of visually formatted information105dincludes text. It is appreciated that array of visually formatted information105dis not limited to text, but may include graphics, combinations of text and graphics, and any other visually formatted information. In the present example, the text constituting array of visually formatted information105dis a portion of an imaginary telephone list including names and corresponding telephone numbers, a common and useful portable computer system feature. It is appreciated that the text constituting array of visually formatted information105dmay include any textual information not to be construed as delimited by the present example. In the present example, the text constituting array of visually formatted information105dincludes a highlightedportion105h. Highlighted portions of text or other forms of visually formatted information may be used to focus a user's attention, to target data for selection, and other purposes. In one embodiment, highlighting can be moved through scrolling. In one embodiment, highlighting and scrolling may be performed by a user interacting withsystem100 through manipulation ofoptical user interface75.
• Referring toFIG. 6A, a detailed concentric top view of an exemplaryoptical user interface75, in accordance with one embodiment of the present invention, is described. A transparent covering75.1 coversoptical user interface75.
• In one embodiment, transparent covering75.1 is flexible and mounted beneathdigitizer106, which, in the present embodiment, is flexible and transparent, likewise. In one embodiment, transparent covering75.1 forms a part of flexible andtransparent digitizer106. In one embodiment, flexible andtransparent digitizer106 constitutes transparent covering75.1. In one embodiment, flexible andtransparent digitizer106 is embedded within transparent cover75.1 (e.g., as depicted inFIG. 7B). In any of the present embodiments,digitizer106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction viaoptical user interface75, in an optical-electromechanical user interaction enabling implementation.
• Importantly, transparent covering75.1 coversoptical user interface75, yet allows optical interaction with a user. Further, transparent covering75.1 sealsoptical user interface75, andsystem100 aboutoptical user interface75. Advantageously, this prevents the incursion of environmental contaminants to sealsoptical user interface75, andsystem100. Optical user interlace enclosure75.2 forms a package aboutoptical user interface75 optical and electrical components to be described next.
• Optical user interface package foundation752 mounts an optical source75.4 and an optical sensor75.5. Further, optical user interlace package foundation75.3 forms an optical portal75.6, such as an optically transmissive channel with precisely reflective and focusing contours capable of coupling optical source75.4 and an optical sensor75.5.
• In one embodiment, optical sensor75.5 is a solid state photosensitive electro-optical device which generates an electrical output corresponding to an optical input. In one embodiment, optical sensor75.5 is a quantum photodetector. In one embodiment, optical sensor75.5 is a radiometer. In one embodiment, optical sensor75.5 is a pyroelectric detector. In one embodiment, optical sensor75.5 works photoconductively. In one embodiment, optical sensor75.5 works photovoltaically.
• In one embodiment, optical source75.4 is a light emitting diode (LED). In one embodiment, optical source75.4 is a laser diode (LD). In one embodiment, optical source75.4 is a quantum dot. For simplicity, optical source75.4 will herein be referred to as an exemplary LED75.4. LED75.4 and optical detector75.5 operate at frequencies which enable their interoperation and coupling. In one embodiment, optical user interface operation is at visible wavelengths. In one embodiment,optical user interface75 operation is in the infrared. In one implementation, operation of theoptical user interlace75 is in the near infrared.
• Optical portal75.6 couples LED75.4 and optical sensor75.5 in such a way that a user interaction, such as touching transparent covering75.1, optically modifies the optical coupling between LED75.4 and optical sensor75.5. Optically coupled scanning between LED75.4 and optical sensor75.5 occurs at a rate controlled by processor101 (FIG. 3). Optically coupled scanning between LED75.4 and optical sensor75.5 enables detection of commencement, progression, development and modification, and termination of interactions with users.
• In one embodiment, the user touches transparent covering75.1. The touch may be implemented by the user's thumb or fingertips, for example. In one embodiment, the changes in optical coupling between LED75.4 and optical detector75.5 corresponding to the touch and detected by scanning result in the generation of an interaction signal (interaction signal771;FIG. 6B). In one embodiment, the optical coupling between LED75.4 and optical detector75.5 corresponding to the touch and detected by scanning can be further, stochastically, and/or continually changed by the user varying the touch to transparent cover75.1, for example, by movement of the thumb or fingertips touching transparent cover75.1 This correspondingly results in the optical scanning tracking the user transaction and further generating aninteraction signal771 accordingly transmitting the scan-tracking information toprocessor101.Processor101 may process the information to generate programmatic response. Scan rates may be variable, in one embodiment. In the present embodiment, variable scan rates may implement a scan rate power usage protocol, transmitted by scan rate power usage signals772. It is appreciated that theoptical user interface75 may also, in one embodiment, enable further and/or other user interaction by, for example, an electromechanical modality.
• InFIG. 63, the optical and electrical interrelationship75E between elements constitutingoptical user interface75,system bus99, andprocessor101 are depicted. Optical user interface package foundation75.3 mounts and electrically interconnects LED75.4 and optical sensor75.5.
• Optical user interface package foundation75.3 mounts LED75.4 and optical sensor75.5 in such a configuration as to delineate optical portal75.6, optically coupling LED75.4 and optical sensor75.5. LED75.4 and optical sensor75.5 are optically coupled through optical portal75.6 such that optical signal655, emitted by LED75.4, may be detected by optical sensor75.5.
• Optical user interface sub-bus75.9 electrically interconnects LED75.4 and optical sensor75.5, through optical user interface packaging foundation75.3, tobus99, which is electrically interconnected withprocessor101. Signals interflow between these elements as follows.
• Optical signalgeneration demand signal770, generated byprocessor101, flows overbusses99 and75.9, through optical user interface packaging foundation75.3 interconnection, to LED75.4, stimulating LED75.4 to emitoptical signal555 accordingly.Processor101 thus controlssignal555 and corresponding optical scanning via optical portal75.6.Interface signal771, generated by optical. sensor75.5 responsive to detection and conversion ofoptical signal555, flows through optical user interface packaging foundation75.3 interconnection, over busses75.9 and99, sequentially, toprocessor101.Processor101processes interface signal771 programmatically.
• Further, in one embodiment,processor101 controls the optical scan rate employed by optical user interface75 (FIG. 6A) by and according to scan ratepower usage signal772. Scan ratepower usage signal772 transmits information corresponding to the scan rate power usage fromoptical user interface75 toprocessor101, and transmits responsive scan rate control fromprocessor101 tooptical user interface75.
• In one embodiment,optical user interface75 functions as an optical sensor operable to sense movement of an object over a surface thereof, and a processor is responsive to said optical sensor for altering said selected item according to said movement, In one embodiment,optical user interface75 functions as an optical sensor operable to sense tactile contact of said object with said surface. In one embodiment˜optical user interface75 functions as an optical sensor operable to sense the speed of said movement of said object. In one embodiment,optical user interface75 functions as an optical sensor operable to sense the direction of said movement of said object. In the present embodiment, control circuitry coupled tooptical user interface75 is operable to vary a rate at which optical sensor75.5 is scanned in response to detected user activity.
• Processor101, in the present embodiment, is responsive to optical sensor75.5 sensing user interactive movement at a first speed to perform a first display update of the array of visually formatted information (e.g., text105.d;FIG. 50) Further,processor101 is responsive to optical sensor75.5 sensing user interactive movement at a second speed to perform a second update of said Information. In the present embodiment, this enables coarse scroll operation, in the first processor response, and a fine scroll operation in the second. The user's finger may establish the optical contact withoptical user interface75 to implement these interactions.
Exemplary Optical-Electromechanical User Interfaces
• With reference toFIG. 6C, the optical and electrical interrelationship 7SEM between elements of an exemplary combination optical-electromechanical user interface75mis depicted, in accordance with one embodiment of the present invention. Optical user interface package foundation75.3 mounts LED75.4 and optical sensor75.5 in such a configuration as to delineate optical portal75.6, optically coupling LED75.4 and optical sensor75.5. LED75.4 and optical sensor75.5 are optically coupled through optical portal75.6 such thatoptical signal555, emitted by LED75.4, may be detected by optical sensor75.5. Optical user interface sub-bus75.9 electrically interconnects LED75.4 and optical sensor75.5, through optical user interface packaging foundation75.3, touser interface mid-bus859, which is electrically interconnected throughbus99 withprocessor101.
• User interface opto-electromechanical package foundation803 mounts opticaluser interface module75, and contains an electromechanical user interface enabling device such as a switch or dial (e.g.,switch804,FIGS. 7A and 7B). User interfaceelectromechanical package foundation803 electrically interconnects the electromechanical user interface (e.g.,switch804,FIGS. 7A and 7B) contained within it viaelectromechanical interface sub-bus809btouser interface mid-bus859, which is electrically interconnected throughbus99 withprocessor101, and transmitselectromechanical interface signal866 thereon.
• With reference toFIG. 7A, an exemplary combination optical-electromechanical user interface enables several modalities of user interaction, in accordance with one embodiment of the present invention. An electronic device, in the present illustration, exemplaryportable computer system100, has atop face100aand abottom face100b. Embedded within and sealingtop face100ais transparent cover75.1.
• Transparent cover75.1 covers optical user interface enclosure75.2 which contains optical user interface package foundation75.3 mount in 9 LED75.4 and optical sensor75.5 (FIG. 6). Further, optical user interface package foundation75.3 forms an optical portal75.6 (FIG. 6C), such as an optically transmissive channel with precisely reflective and focusing contours capable of coupling optical source75.4 (FIG. 6C) and an optical sensor75.5 (FIG. 6C). Optical user interface enclosure75.2 forms a package aboutoptical user interface75 optical and electrical components (FIG. 6C). Optical user interface75 (FIGS. 6B and 6C) generates an optical interface signal711 (FIG. 6B).
• Mounting optical user interface (e.g.,optical user interface75;FIG. 6C) components75.1,75.2, and75.3, opto-electromechanical package foundation803 also houses electromechanical user interface enabling components including, in the present embodiment, aswitch assembly804.
• Switch assembly804 contains a lower, foundational andnon-moving base802b, fixedly mounted on the upper (e.g., inner) surface ofbase110b(e.g., internal to exemplary computer100).Base802bmounts a set of fixedelectrical contacts801b. Anupper plug802amounts movableelectrical contacts801a, is spring supported and guided byspring assembly823.Upper plug802aandcontacts801amove up and down inswitch assembly804 in such a way as to respond to the interaction of a user, for example, pressing down on transparent cover75.1, and make and break contact betweenmovable contacts801aand fixedcontacts801baccordingly.
• Upon contact by a sufficiently forcible user interaction,movable contacts801awill make and wipe sufficiently on and over fixedcontacts801bto ensure a correspondingly sufficient electrical contact. The making and breaking ofmovable contacts801aand fixedcontacts801bin response to a mechanical user interaction generate an electromechanical user interface signal866 (FIG. 6C).
• Opticaluser interface signal771 flows on optical user interface sub-bus75.9 (FIG. 6B). Electromechanical user interface signal866 (FIG. 6C) flows onelectromechanical sub-bus809b. Sub-busses75.9 and809bare electrically interconnected withuser interface mid-bus859.User interface mid-bus859 is electrically interconnected with bus99 (FIGS. 3,6C), enabling optical and electromechanical interface signals771 and866, respectively, to be sent to processor101 (FIGS. 3 and 6C), and control signals to flow fromprocessor101 back to the user interfaces76 and75m(FIG. 6C).
• Referring now toFIG. 7B, one embodiment of the present invention is depicted, whereindigitizer106 is also flexible and transparent. In all other respects, the elements depicted inFIG. 7B are identical in form and function with those depicted inFIG. 7A. In the present embodiment,digitizer106 is integrated with transparent cover75.1. In the present embodiment, the transparency ofdigitizer106, and its proximity to optical user interface package foundation75.3, enables an interaction with a user forexemplary system100 via the optical user interface (e.g.,optical user interface75;FIG. 6C). Further, the flexibility ofdigitizer106, and its proximity to and mechanical integration with opto-electromechanical package foundation803, enables an interaction with a user forexemplary system100 via the electromechanical user interface (e.g., electromechanical user interface75m;FIG. 6C).
• In the present embodiment, flexible andtransparent digitizer106 is embedded within transparent cover75.1 (e.g., as depicted inFIG. 7B). In one embodiment, transparent covering75.1 is flexible and mounted beneathdigitizer106, which, in the present embodiment, is flexible and transparent, likewise. In one embodiment, transparent covering75.1 forms a part of flexible andtransparent digitizer106. In one embodiment, flexible andtransparent digitizer106 constitutes transparent covering75.1. In any of these embodiments,digitizer106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction via optical user interface75 (FIG. 6C) and electromechanical user interface75m(FIG. 6C), in an optical-electromechanical user interaction enabling implementation. Digitizer sub-bus106.1 is electrically interconnected withbus99, interconnectingdigitizer106 with processor101 (FIG. 3).
Exemplary Processes
• FIGS. 8,9A,9B, and10 are flowcharts of the steps performed inprocesses800,900A,900B, and1000, respectively, each individually in accordance with single, separate individual embodiments of the present invention, as discussed separately below. Flowcharted processes800,900A,900B, and1000 each include a single, separate, individual process of the present invention which, in each embodiment, are carried out by processors and electrical components under the control of computer readable and computer executable instructions. The computer readable and computer executable instructions reside, for example, in data storage features such as withinprocessor101, computer usablevolatile memory102, computer usablenon-volatile memory103, and/ordata storage device104, all ofFIG. 3. However, the computer readable and computer executable instructions may reside In any type of computer readable medium. Although specific steps are disclosed in each offlowcharts800,900A,900B, and1000, such steps are exemplary. That is, the present invention is well suited to performing various other steps or variations of the steps recited inFIGS. 8,9A,9B, and10. Within these present embodiments, it should be appreciated that the steps offlowcharts800,900A,900B, and1000 may be performed by software or hardware or any combination of software and hardware.
Exemplary Process for User Interaction
• Referring toFIG. 8, the steps in aprocess800 enable the interaction of a user with a system (e.g.,exemplary system100;FIGS. 1,3,5A,5B,7A, and7B)-using an optical user interface (e.g.,75;FIGS. 2A,3,5A,5B,6A,6B,6C), in accordance with one embodiment of the present invention. Beginning withstep801, an optical signal (e.g.,optical signal555;FIGS. 6B and 6C) is demanded by a processor (e.g.,processor101;FIGS. 3,6B, and6C). The demand may be by a demand signal (e.g.,770;FIG. 6B).
• Instep802, an optical signal (e.g.,optical signal555;FIGS. 6B and 6C) is generated responsive to the demand (step801). The optical signal is generated by an optical source (e.g., optical source75.4;FIGS. 6A,6B, and6C), which in one embodiment, is an LED.
• Instep803, the optical signal is coupled from the optical source into an optical portal (e.g., optical portal75.6;FIGS. 6A,6B, and6C).
• The optical portal is scanned;step804. Scanning₁in one embodiment, may be performed by an optical sensor (e.g., optical detector75.5;FIGS. 6A,6B, and6C).
• Scanning the optical portal (step804) enables the detection of a user interaction;step805. If no user interaction is detected, process800 loops back to demanding an optical signal (step801), and the process repeats itself.
• If, however, a user interaction is detected instep805, the optical coupling characteristics of the optical portal are changed by the interaction of the user. This results in a corresponding change in the optical coupling characteristics of the optical portal coupling the source and detector;step807.
• Any change in optical coupling results in the generation of an interface signal instep808.
• Interface signals are sent to a processor (e.g.,processor101;FIGS. 3,6B, and6C);step809. The interface signals may be sent via an interconnecting bus (e.g.,bus99;FIGS. 3,6B, and6C).
• Instep810, the processor processes the interface signal as information, and process800 loops back to the step of demanding an optical signal (step801).
Exemplary Scan Rate Adjustment Process
• Referring toFIG. 9A, the steps in aprocess900A are depicted wherein the scanning rate of an optical user interface is automatically adjusted, in accordance with one embodiment of the present invention. Beginning withstep901, the optical user interface (OUI) (e.g.,OUI75;FIGS. 3,6A,6B, and6C) under the control of a processor (e.g.,processor101;FIGS. 3,6B, and6C), scans at a first, relatively slow rate.
• If no interaction with a user is detected instep902,process900A continues the scanning at the first rate.
• If however, an interaction with a user is detected instep902, the activation of a user interaction is sensed;step903.
• Upon detecting activation of a user interaction (step903), the scan rate is increased accordingly to an initial, relatively higher rate;step904.
• Instep905, the speed with which the user interaction is occurring and/or varying (for example, the relative speed and any speed variation with which the user's thumb passes, rubs, or flicks over the transparent cover of the optical portal, e.g., cover75.1 and portal75.6, respectively;FIGS. 6A,6B, and6C) is detected. If no variation in the speed with which the user interaction is occurring is detected,process900A loops back to step904, and continues to scan at the initial second rate.
• If, however, a variation in the speed with which the user interaction is occurring is detected instep905, the scan rate is adjusted accordingly; step906. Further, the speed with which the user interaction is occurring and/or varying is continually monitored,process900A looping back to step905.
• This continues as long as no interruption in the user interaction is detected instep907. If an interruption in the user interaction is detected instep907,process900A loops back to step901, with scanning resumed at the relatively slow first scan rate. In one embodiment,process900A enables implementation of a scan rate power usage protocol.
Exemplary Scan Rate Power Usage Information Process
• In one embodiment, aprocess900B enables a processor (e.g.,processor101;FIGS. 3,6B, and6C) to receive information regarding power usage by optical scanning processes (e.g.,process900A;FIG. 9A).
• Process900B begins withstep910, wherein a fixed power usage signal is generated corresponding to a first scan rate (e.g., a relatively low initial scan rate, such as that scan rate generatedinstep901;FIG. 9A).
• Power usage signals generated instep910 is sent to a processor;step940.
• Instep920, the scan rate is monitored, if scanning continues at the first scan rate (e.g., no user interaction is detected, as for example instep902;FIG. 9A), the corresponding power usage signal continues to be generated,process900B looping back to step910.
• If scanning at a second rate is detected instep920, a variable power usage signal corresponding to the second scan rate and its changes is generated; step930.
• Power usage signals generated instep920 is sent to a processor;step940.
• Power usage signals and corresponding control signals (e.g., signals772;FIG. 6B) enable implementation of a scan rate power usage protocol.
Exemplary Process for Display Control
• With reference toFIG. 10, aprocess1000 enables the control of visually formatted information displayed on a screen (e.g.,display screen105;FIGS. 2A,3, and5A). Beginning withstep1010, a user manipulates an optical user interface (e.g.,OUI75;FIGS. 3,5A,53,6A,6B, and6C) according to the user's intent to vary visibly formatted information on the display screen.
• The optical characteristics of the optical user interface are changed accordingly;step1020.
• Resultantly, a display change signal is generated;step1030. Generating a display change signal may be a combination and interaction between integrated activities conducted by different system elements.
• Upon changing optical characteristics in the optical user interface (step1020), a corresponding interface signal (e.g., signal771;FIG. 6B) is generated and sent to the processor (e.g.,processor101;FIGS. 3,6B, and6C). The processor programmatically responds to the interface signal by generating a responsive display control signal, which is transmitted to the display device to change the array of visibly formatted information thereon accordingly;step1040. The programmatic response may be controlled by the processor under the direction of software or data stored, to varying degrees, in the processor itself, in memory, an and/or in a data storage device (e.g.,RAM102,ROM103, and/orstorage104, respectively;FIG. 3). If a cursor and/or scrolling, for example (discussed below insteps1060 through1075), is included in the array of visually formatted information displayed on the screen, an cursor controller (e.g.,cursor control107;FIG. 3) may also be involved.
• Instep1050, it is determined if the user intends to change the highlighting of any portion of the array of visually formatted information, by which portions of the array may be designated or selected for change of selection of displayed information, or a scrolling function. If so, the portion to be highlighted is selected by optical user interfacing;step1051.
• The highlighting (e.g., the highlighted region of the array of visually formatted information on the display), or the highlighting itself, is moved;step1052. At this point,process1000 may be complete.
• If no highlighting was determined for selection (step1050), it is determined if the user intends to change the positioning of a cursor appearing within the array of visually formatted information, by which the attention and action of the user may be directed and/or focused;step1060. If so, the position for placement of the cursor is selected by opticaluser interfacing instep1061.
• The cursor is thus moved to the designated location within the array of visually formatted information;step1062. At this point,process1000 may be complete.
• If no cursor positioning was selected (step1060), it is determined instep1070 if the visually formatted information array is to be scrolled. If not,process1000 may be complete.
• If scrolling is designated (step1060), scrolling is initiated and controlled by optical user interfacing;step1075. At this point,process1000 is complete.
• An embodiment of the present invention, an optical sensor based user interface for a handheld device is thus described. While the present invention has been described in particular embodiments, it should be appreciated that the present invention should not be construed as limited by such embodiments, but rather construed according to the below claims.

Claims (20)

1. A portable electronic device comprising:

an optical sensor operable to detect user interaction with said portable electronic device, wherein said optical sensor detects variation in optics responsive to a user interaction with said portable electronic device;

a display operable to display information, wherein said display is further operable to display information in response to said detected user interaction, wherein said display and said optical sensor are part of a common housing; and

a processor coupled to said optical sensor, wherein said processor is operable to process said detected user interaction, and wherein said processor is responsive to said user interaction to control an operation of said portable electronic device dependent on a speed of said user interaction.

2. The portable electronic device as described inclaim 1, wherein said optical sensor is selected from a group consisting of: a solid state photosensitive electro-optical device; a quantum photodetector; a radiometer; and a pyroelectric detector.

3. The portable electronic device as described inclaim 2 further comprising:

an optical source, wherein said optical source is selected from a group consisting of: a light emitting diode (LED); a laser diode (LD); and a quantum dot.

4. The portable electronic device as described inclaim 1, wherein said operation comprises scrolling, on said display, through a plurality of graphical items rendered on said display.

5. The portable electronic device as described inclaim 1, wherein operation of said optical sensor varies in response to a user's varying touch.

6. The portable electronic device as described inclaim 1, wherein said sensor comprises a surface, and wherein said optical sensor is further operable to detect speed and direction of movement of said user interaction over said surface.

7. The portable electronic device as described inclaim 6, wherein said processor in response to said optical sensor detecting a first movement at a first speed performs a first display update at a first update rate, and wherein said processor in response to said optical sensor detecting a second movement at a second speed performs a second display update at a second update rate faster than said first update rate.

8. A method of optical detection within a mobile electronic device, said method comprising:

optically detecting a user interaction with a display of said mobile electronic device using an optical sensor coupled to said display, wherein said optical sensor and said display are integrated within a same housing;

processing information related to said user interaction; and

in response to said processing, controlling an operation of said mobile electronic device depending on a speed of said user interaction as detected by said optical sensor.

9. The method as described inclaim 8 wherein said optically detecting comprises:

receiving optical signals via said optical sensor; and

determining variation in said optical signals, wherein said variation is in response to said user interaction with a surface of said optical sensor.

10. The method as described inclaim 9 further comprising:

scanning between an optical source and said optical sensor.

11. The method as described inclaim 9, wherein said variation in said optical signals is in response to a user's varying touch.

12. The method as described inclaim 8, wherein said operation comprises scrolling through a plurality of graphical items rendered on said display wherein a speed of said scrolling and a direction of said scrolling depend on a speed and a direction, respectively of said user interaction.

13. The method as described inclaim 8 wherein said processing and said controlling are performed by a processor that is also integrated within the same housing.

14. The method as described inclaim 8 wherein said optically detecting comprises:

detecting speed and direction of movement of said user interaction over a surface of said optical sensor.

15. A portable electronic device comprising:

a display operable to display information comprising graphical items;

a sensor coupled to said display, wherein said display and said sensor are disposed within a same housing, and wherein said sensor is operable to detect a movement of a user's finger over a surface; and

a processor coupled to said sensor, wherein said processor is operable to alter a display of said graphical items in response to said sensor and based on a speed of said movement.

16. The portable electronic device as described inclaim 15, wherein display of said graphical items is altered by scrolling through said graphical items wherein a speed of said scrolling is based on said speed of said movement.

17. The portable electronic device as described inclaim 16, wherein said scrolling updates said display at a first rate responsive to said sensor sensing said movement of said user's finger at a first speed and updates said display at a second rate responsive to said sensor sensing said movement of said user's finger at a second rate.

18. The portable electronic device as described inclaim 15, wherein a portion of said graphical items is user selectable.

19. The portable electronic device as described inclaim 15, wherein said sensor is further operable to detect speed and direction of movement of said user's finger over a surface.

20. The portable electronic device as described inclaim 15, wherein said sensor is optical.

Images