Atouchscreen (ortouch screen) is a type ofdisplay that can detect touch input from a user. It consists of both aninput device (a touch panel) and anoutput device (a visual display). The touch panel is typically layered on the top of theelectronic visual display of a device. Touchscreens are commonly found insmartphones,tablets,laptops, and other electronic devices. The display is often anLCD,AMOLED orOLED display.
A user can give input or control the information processing system through simple ormulti-touch gestures by touching the screen with a specialstylus or one or more fingers.[1] Some touchscreens use ordinary or specially coated gloves to work, while others may only work using a special stylus or pen. The user can use the touchscreen to react to what is displayed and, if the software allows, to control how it is displayed; for example,zooming to increase the text size.
A touchscreen enables the user to interact directly with what is displayed, instead of using amouse,touchpad, or other such devices (other than a stylus, which is optional for most modern touchscreens).[2]
The popularity of smartphones, tablets, and many types ofinformation appliances has driven the demand and acceptance of common touchscreens for portable and functional electronics. Touchscreens are found in the medical field,heavy industry,automated teller machines (ATMs), and kiosks such as museum displays orroom automation, wherekeyboard andmouse systems do not allow a suitably intuitive, rapid, or accurate interaction by the user with the display's content.
Historically, the touchscreen sensor and its accompanying controller-basedfirmware have been made available by a wide array of after-marketsystem integrators, and not by display, chip, ormotherboard manufacturers. Display manufacturers and chip manufacturers have acknowledged the trend toward acceptance of touchscreens as auser interface component and have begun to integrate touchscreens into the fundamental design of their products.
The prototype[4] x-y mutual capacitance touchscreen (left) developed atCERN[5][6] in 1977 byFrank Beck, a British electronics engineer, for the control room of CERN's accelerator SPS (Super Proton Synchrotron). This was a further development of theself-capacitance screen (right), also developed byStumpe at CERN[7] in 1972.
One predecessor of the modern touchscreen includes stylus based systems.
1946 DIRECT LIGHT PEN - A patent was filed byPhilco Company for a stylus designed for sports telecasting which, when placed against an intermediatecathode-ray tube (CRT) display would amplify and add to the original signal. Effectively, this was used for temporarily drawing arrows or circles onto a live television broadcast, as described inUS 2487641A, Denk, William E, "Electronic pointer for television images", issued 1949-11-08.
1962 OPTICAL - The first version of a touchscreen which operated independently of the light produced from the screen was patented byAT&T CorporationUS 3016421A, Harmon, Leon D, "Electrographic transmitter", issued 1962-01-09. This touchscreen utilized a matrix of collimated lights shining orthogonally across the touch surface. When a beam is interrupted by a stylus, thephotodetectors which no longer are receiving a signal can be used to determine where the interruption is. Later iterations of matrix based touchscreens built upon this by adding more emitters and detectors to improve resolution, pulsing emitters to improve opticalsignal to noise ratio, and a nonorthogonal matrix to remove shadow readings when using multi-touch.
1963 INDIRECT LIGHT PEN - Later inventions built upon this system to free telewriting styli from their mechanical bindings. By transcribing what a user draws onto a computer, it could be saved for future use. SeeUS 3089918A, Graham, Robert E, "Telewriting apparatus", issued 1963-05-14.
1965 CAPACITANCE AND RESISTANCE - The first finger driven touchscreen was developed by Eric Johnson, of theRoyal Radar Establishment located inMalvern, England, who described his work on capacitive touchscreens in a short article published in 1965[8][9] and then more fully—with photographs and diagrams—in an article published in 1967.[10]
MID-60s ULTRASONIC CURTAIN -Another precursor of touchscreens, an ultrasonic-curtain-based pointing device in front of a terminal display, had been developed by a team aroundRainer Mallebrein [de] atTelefunkenKonstanz for an air traffic control system.[11] In 1970, this evolved into a device named "Touchinput-Einrichtung" ("touch input facility") for the SIG 50 terminal utilizing a conductively coated glass screen in front of the display.[12][11] This was patented in 1971 and the patent was granted a couple of years later.[12][11] The same team had already invented and marketed theRollkugel mouse RKS 100-86 for the SIG 100-86 a couple of years earlier.[12]
1968 CAPACITANCE - The application of touch technology for air traffic control was described in an article published in 1968.[13]Frank Beck andBent Stumpe, engineers fromCERN (European Organization for Nuclear Research), developed a transparent touchscreen in the early 1970s,[14] based on Stumpe's work at a television factory in the early 1960s. Then manufactured by CERN, and shortly after by industry partners,[15] it was put to use in 1973.[16]
1972 OPTICAL - A group at theUniversity of Illinois filed for a patent on an optical touchscreen[17] that became a standard part of theMagnavox Plato IV Student Terminal and thousands were built for this purpose. These touchscreens had a crossed array of 16×16infrared position sensors, each composed of anLED on one edge of the screen and a matchedphototransistor on the other edge, all mounted in front of a monochromeplasma display panel. This arrangement could sense any fingertip-sized opaque object in close proximity to the screen.
1973 MULTI-TOUCH CAPACITANCE - In 1973, Beck and Stumpe published another article describing their capacitive touchscreen. This indicated that it was capable of multi-touch but this feature was purposely inhibited, presumably as this was not considered useful at the time ("A...variable...called BUT changes value from zero to five when a button is touched. The touching of other buttons would give other non-zero values of BUT but this is protected against by software" (Page 6, section 2.6).[18] "Actual contact between a finger and the capacitor is prevented by a thin sheet of plastic" (Page 3, section 2.3).
1982 MULTI-TOUCH CAMERA -Multi-touch technology began in 1982, when theUniversity of Toronto's Input Research Group developed the first human-input multi-touch system, using a frosted-glass panel with a camera placed behind the glass.
1983 OPTICAL - An optical touchscreen was used on theHP-150 starting in 1983. The HP 150 was one of the world's earliest commercial touchscreen computers.[21] HP mounted theirinfraredtransmitters and receivers around the bezel of a 9-inchSony cathode ray tube (CRT).
1983 MULTI-TOUCH FORCE SENSING TOUCHSCREEN - Bob Boie of AT&T Bell Labs, used capacitance to track the mechanical changes in thickness of a soft, deformable overlay membrane when one or more physical objects interact with it;[22] the flexible surface being easily replaced, if damaged by these objects. The patent states "the tactile sensor arrangements may be utilized as a touch screen".
Many derivative sources[23][24][25] retrospectively describe Boie as making a major advancement with his touchscreen technology; but no evidence has been found that a rugged multi-touch capacitive touchscreen, that could sense through a rigid, protective overlay - the sort later required for a mobile phone, was ever developed or patented by Boie.[26] Many of these citations rely on anecdotal evidence fromBill Buxton of Bell Labs.[27] However, Bill Buxton did not have much luck getting his hands on this technology. As he states in the citation: "Our assumption (false, as it turned out) was that the Boie technology would become available to us in the near future. Around 1990 I took a group from Xerox to see this technology it [sic] since I felt that it would be appropriate for the user interface of our large document processors. This did not work out".
UP TO 1984 CAPACITANCE - Although, as cited earlier, Johnson is credited with developing the first finger operated capacitive and resistive touchscreens in 1965, these worked by directly touching wires across the front of the screen.[9]Stumpe and Beck developed a self-capacitance touchscreen in 1972, and a mutual capacitance touchscreen in 1977. Both these devices could only sense the finger by direct touch or through a thin insulating film.[28] This was 11 microns thick according to Stumpe's 1977 report.[29]
EARLY 80s EVALUATION FOR AIRCRAFT - Touch-sensitivecontrol-display units (CDUs) were evaluated for commercial aircraft flight decks in the early 1980s. Initial research showed that a touch interface would reduce pilot workload as the crew could then select waypoints, functions and actions, rather than be "head down" typing latitudes, longitudes, and waypoint codes on a keyboard. An effective integration of this technology was aimed at helping flight crews maintain a high level ofsituational awareness of all major aspects of the vehicle operations including the flight path, the functioning of various aircraft systems, and moment-to-moment human interactions.[33]
EARLY 80s EVALUATION FOR CARS - also, in the early 1980s,General Motors tasked itsDelco Electronics division with a project aimed at replacing an automobile's non-essential functions (i.e. other thanthrottle,transmission,braking, andsteering) from mechanical or electro-mechanical systems withsolid state alternatives wherever possible. The finished device was dubbed the ECC for "Electronic Control Center", adigital computer andsoftware control system hardwired to variousperipheralsensors,servomechanisms,solenoids,antenna and amonochrome CRT touchscreen that functioned both as display and sole method of input.[34] The ECC replaced the traditional mechanicalstereo, fan, heater andair conditioner controls and displays, and was capable of providing very detailed and specific information about the vehicle's cumulative and current operating status inreal time. The ECC was standard equipment on the 1985–1989Buick Riviera and later the 1988–1989Buick Reatta, but was unpopular with consumers—partly due to thetechnophobia of some traditionalBuick customers, but mostly because of costly technical problems suffered by the ECC's touchscreen which would render climate control or stereo operation impossible.[35]
1985 GRAPHIC TABLET -Sega released the Terebi Oekaki, also known as the Sega Graphic Board, for theSG-1000video game console andSC-3000home computer. It consisted of a plastic pen and a plastic board with a transparent window where pen presses are detected. It was used primarily with a drawing software application.[36]
1985 MULTI-TOUCH CAPACITANCE - The University of Toronto group, including Bill Buxton, developed a multi-touch tablet that used capacitance rather than bulky camera-based optical sensing systems (seeHistory of multi-touch).
1985 USED FOR POINT OF SALE - The first commercially available graphicalpoint-of-sale (POS) software was demonstrated on the 16-bitAtari 520ST color computer. It featured a color touchscreen widget-driven interface.[37] The ViewTouch[38] POS software was first shown by its developer, Gene Mosher, at the Atari Computer demonstration area of the FallCOMDEX expo in 1986.[39]
1987 CAPACITANCE TOUCH KEYS - Casio launched theCasio PB-1000 pocket computer with a touchscreen consisting of a 4×4 matrix, resulting in 16 touch areas in its small LCD graphic screen.
1988 SELECT ON "LIFT-OFF" - Touchscreens had a bad reputation of being imprecise until 1988. Most user-interface books would state that touchscreen selections were limited to targets larger than the average finger. At the time, selections were done in such a way that a target was selected as soon as the finger came over it, and the corresponding action was performed immediately. Errors were common, due to parallax or calibration problems, leading to user frustration. "Lift-off strategy"[40] was introduced by researchers at theUniversity of Maryland Human–Computer Interaction Lab (HCIL). As users touch the screen, feedback is provided as to what will be selected: users can adjust the position of the finger, and the action takes place only when the finger is lifted off the screen. This allowed the selection of small targets, down to a single pixel on a 640×480Video Graphics Array (VGA) screen (a standard of that time).
1988 WORLD EXPO - From April to October 1988, the city ofBrisbane,Australia hostedExpo 88, whose theme was “leisure in the age of technology”. To support the event and provide information to expo visitors, Telecom Australia (nowTelstra) erected 8 kiosks around the expo site with a total of 56 touch screen information consoles, being specially modifiedSonyVideotex Workstations. Each system was also equipped with a videodisc player, speakers, and a 20 MB hard drive. In order to keep up-to-date information during the event, the database of visitor information was updated and remotely transferred to the computer terminals each night. Using the touch screens, visitors were able to find information about the exposition’s rides, attractions, performances, facilities, and the surrounding areas. Visitors could also select between information displayed in English and Japanese; a reflection of Australia’s overseas tourist market in the 1980s. It is worth noting that Telecom’s Expo Info system was based on an earlier system employed atExpo 86 inVancouver,Canada.[41]
1990 TOUCHSCREEN SLIDER AND TOGGLE SWITCHES - HCIL demonstrated a touchscreen slider,[43] which was later cited as prior art in thelock screen patent litigation between Apple and other touchscreen mobile phone vendors (in relation toU.S. patent 7,657,849).[44]
1991 INERTIAL CONTROL - From 1991 to 1992, theSun Star7 prototypePDA implemented a touchscreen withinertial scrolling.[45]
1993 CAPACITANCE MOUSE / KEYPAD - Bob Boie of AT&T Bell Labs, patented a simple mouse or keypad that capacitively sensed just one finger through a thin insulator.[46] Although not claimed or even mentioned in the patent, this technology could potentially have been used as a capacitance touchscreen.
1993 FIRST RESISTIVE TOUCHSCREEN PHONE - IBM released theIBM Simon, which is the first touchscreen phone.
EARLY 90s ABANDONED GAME CONTROLLER - An early attempt at ahandheld game console with touchscreencontrols wasSega's intended successor to theGame Gear, though the device was ultimately shelved and never released due to the expensive cost of touchscreen technology in the early 1990s.
2004 MOBILE MULTI-TOUCH CAPACITANCE PATENT - Apple patents its multi-touch capacitive touchscreen for mobile devices.
2004 VIDEO GAMES WITH TOUCHSCREENS - Touchscreens were not popularly used for video games until the release of theNintendo DS in 2004.[47]
2007 MOBILE PHONE WITH CAPACITANCE - The firstmobile phone with a capacitive touchscreen wasLG Prada, released in May 2007 (which was before the firstiPhone released).[48] By 2009, touchscreen-enabled mobile phones were becoming trendy and quickly gaining popularity in both basic and advanced devices.[49][50] In Quarter-4 2009 for the first time, a majority of smartphones (i.e. not all mobile phones) shipped with touchscreens over non-touch.[51]
2015 FORCE SENSING TOUCHSCREENS - Until recently,[when?] most consumer touchscreens could only sense one point of contact at a time, and few have had the capability to sense how hard one is touching. This has changed with the commercialization of multi-touch technology, and theApple Watch being released with a force-sensitive display in April 2015.
Aresistive touchscreen panel is composed of several thin layers, the most important of which are two transparent electrically resistive layers facing each other with a thin gap between them. The top layer (the layer that is touched) has a coating on the underside surface; just beneath it is a similar resistive layer on top of its substrate. One layer has conductive connections along its sides, while the other along the top and bottom. A voltage is applied to one layer and sensed by the other. When an object, such as a fingertip or stylus tip, presses down onto the outer surface, the two layers touch to become connected at that point.[52] The panel then behaves as a pair ofvoltage dividers, one axis at a time. By rapidly switching between each layer, the position of pressure on the screen can be detected.
Resistive touch is used in restaurants, factories, and hospitals due to its high tolerance for liquids and contaminants. A major benefit of resistive-touch technology is its low cost. Additionally, they may be used with gloves on, or by using anything rigid as a finger substitute, as only sufficient pressure is necessary for the touch to be sensed. Disadvantages include the need to press down, and a risk of damage by sharp objects. Resistive touchscreens also suffer from poorer contrast, due to having additional reflections (i.e. glare) from the layers of material placed over the screen.[53] This type of touchscreen has been used by Nintendo in the DS family, the3DS family, and theWii U GamePad.[54]
Due to their simple structure, with very few inputs, resistive touchscreens are mainly used for single touch operation, although some two touch versions (often described as multi-touch) are available.[55][56] However, there are some true multi-touch resistive touchscreens available. These need many more inputs, and rely on x/y multiplexing to keep the I/O count down.
One example of a true multi-touch resistive touchscreen[57] can detect 10 fingers at the same time. This has 80 I/O connections. These are possibly split 34 x inputs / 46 y outputs, forming a standard 3:4 aspect ratio touchscreen with 1564 x/y intersecting touch sensing nodes.
Surface acoustic wave (SAW) technology usesultrasonic waves that pass over the touchscreen panel. When the panel is touched, a portion of the wave is absorbed. The change in ultrasonic waves is processed by thecontroller to determine the position of the touch event. Surface acoustic wave touchscreen panels can be damaged by outside elements. Contaminants on the surface can also interfere with the functionality of the touchscreen.
Capacitive touchscreen of a mobile phoneThe Casio TC500 Capacitive touch sensor watch from 1983, with angled light exposing the touch sensor pads and traces etched onto the top watch glass surface
A capacitive touchscreen panel consists of aninsulator, such asglass, coated with a transparentconductor, such asindium tin oxide (ITO).[58] As the human body is also an electrical conductor, touching the surface of the screen results in a distortion of the screen'selectrostatic field, measurable as a change incapacitance. Different technologies may be used to determine the location of the touch. The location is then sent to the controller for processing. Some touchscreens use silver instead of ITO, as ITO causes several environmental problems due to the use of indium.[59][60][61][62] The controller is typically acomplementary metal–oxide–semiconductor (CMOS)application-specific integrated circuit (ASIC) chip, which in turn usually sends the signals to a CMOSdigital signal processor (DSP) for processing.[63][64]
Unlike aresistive touchscreen, some capacitive touchscreens cannot be used to detect a finger through electrically insulating material, such as gloves. This disadvantage especially affects usability in consumer electronics, such as touch tablet PCs and capacitive smartphones in cold weather when people may be wearing gloves. It can be overcome with a special capacitive stylus, or a special-application glove with an embroidered patch of conductive thread allowing electrical contact with the user's fingertip.
A low-qualityswitching-mode power supply unit with an accordingly unstable, noisyvoltage may temporarily interfere with the precision, accuracy and sensitivity of capacitive touch screens.[65][66][67]
Some capacitive display manufacturers continue to develop thinner and more accurate touchscreens. Those formobile devices are now being produced with 'in-cell' technology, such as in Samsung'sSuper AMOLED screens, that eliminates a layer by building the capacitors inside the display itself. This type of touchscreen reduces the visible distance between the user's finger and what the user is touching on the screen, reducing the thickness and weight of the display, which is desirable insmartphones.
A simple parallel-plate capacitor has two conductors separated by a dielectric layer. Most of the energy in this system is concentrated directly between the plates. Some of the energy spills over into the area outside the plates, and the electric field lines associated with this effect are called fringing fields. Part of the challenge of making a practical capacitive sensor is to design a set of printed circuit traces which direct fringing fields into an active sensing area accessible to a user. A parallel-plate capacitor is not a good choice for such a sensor pattern. Placing a finger near fringing electric fields adds conductive surface area to the capacitive system. The additional charge storage capacity added by the finger is known as finger capacitance, or CF. The capacitance of the sensor without a finger present is known as parasitic capacitance, or CP.
In this basic technology, only one side of the insulator is coated with a conductive layer. A small voltage is applied to the layer, resulting in a uniform electrostatic field. When a conductor, such as a human finger, touches the uncoated surface, a capacitor is dynamically formed. The sensor's controller can determine the location of the touch indirectly from the change in the capacitance as measured from the four corners of the panel. As it has no moving parts, it is moderately durable but has limited resolution, is prone to false signals from parasiticcapacitive coupling, and needscalibration during manufacture. It is therefore most often used in simple applications such as industrial controls andkiosks.[68]
Although some standard capacitance detection methods are projective, in the sense that they can be used to detect a finger through a non-conductive surface, they are very sensitive to fluctuations in temperature, which expand or contract the sensing plates, causing fluctuations in the capacitance of these plates.[69] These fluctuations result in a lot of background noise, so a strong finger signal is required for accurate detection. This limits applications to those where the finger directly touches the sensing element or is sensed through a relatively thin non-conductive surface.
An electrical signal, imposed on one electrical conductor, can be capacitively "sensed" by another electrical conductor that is in very close proximity, but electrically isolated—a feature that is exploited in mutual capacitance touchscreens. In a mutual capacitive sensor array, the "mutual" crossing of one electrical conductor with another electrical conductor, but with no direct electrical contact, forms acapacitor (seetouchscreen#Construction).
High frequency voltage pulses are applied to these conductors, one at a time. These pulses capacitively couple to every conductor that intersects it.
Bringing a finger or conductive stylus close to the surface of the sensor changes the local electrostatic field, which in turn reduces the capacitance between these intersecting conductors. Any significant change in the strength of the signal sensed is used to determine if a finger is present or not at an intersection.[70]
The capacitance change at every intersection on the grid can be measured to accurately determine one or more touch locations.
Mutual capacitance allows multi-touch operation where multiple fingers, palms or styli can be accurately tracked at the same time.The greater the number of intersections, the better the touch resolution and the more independent fingers that can be detected.[71][72] This indicates a distinct advantage of diagonal wiring over standard x/y wiring, since diagonal wiring creates nearly twice the number of intersections.
A 30 i/o, 16×14 x/y array, for example, would have 224 of these intersections / capacitors, and a 30 i/o diagonal lattice array could have 435 intersections.
Each trace of an x/y mutual capacitance array only has one function, it is either an input or an output. The horizontal traces may be transmitters while the vertical traces are sensors, or vice versa.
Self-capacitance sensors can have the same layout as mutual capacitance sensors, but, with self-capacitance all the traces usually operate independently, with no interaction between different traces. Along with several other methods, the extra capacitive load of a finger on a trace electrode may be measured by a current meter, or by the change in frequency of an RC oscillator.
Traces are sensed, one after the other until all the traces have been sensed. A finger may be detected anywhere along the whole length of a trace (even "off-screen"), but there is no indication where the finger is along that trace. If, however, a finger is also detected along another intersecting trace, then it is assumed that the finger position is at the intersection of the two traces. This allows for the speedy and accurate detection of a single finger.
Although mutual capacitance is simpler for multi-touch, multi-touch can be achieved using self-capacitance.
Self-capacitance is far more sensitive than mutual capacitance and is mainly used for single touch, simple gesturing and proximity sensing where the finger does not even have to touch the glass surface. Mutual capacitance is mainly used for multitouch applications.[74] Many touchscreen manufacturers use both self and mutual capacitance technologies in the same product, thereby combining their individual benefits.[75]
Capacitive touchscreens do not necessarily need to be operated by a finger, but until recently the special styli required could be quite expensive to purchase. The cost of this technology has fallen greatly in recent years and capacitive styli are now widely available for a nominal charge, and often given away free with mobile accessories. These consist of an electrically conductive shaft with a soft conductive rubber tip, thereby resistively connecting the fingers to the tip of the stylus.
Infrared sensors mounted around the display watch for a user's touchscreen input on this PLATO V terminal in 1981. The monochromatic plasma display's characteristic orange glow is illustrated.
Aninfrared touchscreen uses an array of X-Y infraredLED andphotodetector pairs around the edges of the screen to detect a disruption in the pattern of LED beams. These LED beams cross each other in vertical and horizontal patterns. This helps the sensors pick up the exact location of the touch. A major benefit of such a system is that it can detect essentially any opaque object including a finger, gloved finger, stylus or pen. It is generally used in outdoor applications and POS systems that cannot rely on a conductor (such as a bare finger) to activate the touchscreen. Unlikecapacitive touchscreens, infrared touchscreens do not require any patterning on the glass which increases durability and optical clarity of the overall system. Infrared touchscreens are sensitive to dirt and dust that can interfere with the infrared beams, and suffer from parallax in curved surfaces and accidental press when the user hovers a finger over the screen while searching for the item to be selected.
A translucent acrylic sheet is used as a rear-projection screen to display information. The edges of the acrylic sheet are illuminated by infrared LEDs, and infrared cameras are focused on the back of the sheet. Objects placed on the sheet are detectable by the cameras. When the sheet is touched by the user,frustrated total internal reflection results in leakage of infrared light which peaks at the points of maximum pressure, indicating the user's touch location. Microsoft'sPixelSense tablets use this technology.
Optical touchscreens are a relatively modern development in touchscreen technology, in which two or moreimage sensors (such asCMOS sensors) are placed around the edges (mostly the corners) of the screen. Infrared backlights are placed in the sensor's field of view on the opposite side of the screen. A touch blocks some lights from the sensors, and the location and size of the touching object can be calculated (seevisual hull). This technology is growing in popularity due to its scalability, versatility, and affordability for larger touchscreens.
Introduced in 2002 by3M, this system detects a touch by using sensors to measure thepiezoelectricity in the glass. Complex algorithms interpret this information and provide the actual location of the touch.[76] The technology is unaffected by dust and other outside elements, including scratches. Since there is no need for additional elements on screen, it also claims to provide excellent optical clarity. Any object can be used to generate touch events, including gloved fingers. A downside is that after the initial touch, the system cannot detect a motionless finger. However, for the same reason, resting objects do not disrupt touch recognition.
The key to this technology is that a touch at any one position on the surface generates a sound wave in the substrate which then produces a unique combined signal as measured by three or more tiny transducers attached to the edges of the touchscreen. The digitized signal is compared to a list corresponding to every position on the surface, determining the touch location. A moving touch is tracked by rapid repetition of this process. Extraneous and ambient sounds are ignored since they do not match any stored sound profile. The technology differs from other sound-based technologies by using a simple look-up method rather than expensive signal-processing hardware. As with the dispersive signal technology system, a motionless finger cannot be detected after the initial touch. However, for the same reason, the touch recognition is not disrupted by any resting objects. The technology was created by SoundTouch Ltd in the early 2000s, as described by the patent family EP1852772, and introduced to the market byTyco International's Elo division in 2006 as Acoustic Pulse Recognition.[77] The touchscreen used by Elo is made of ordinary glass, giving good durability and optical clarity. The technology usually retains accuracy with scratches and dust on the screen. The technology is also well suited to displays that are physically larger.
There are several principal ways to build a touchscreen. The key goals are to recognize one or more fingers touching a display, to interpret the command that this represents, and to communicate the command to the appropriate application.
Multi-touch capacitance screens
A very simple, low cost way to make a multi-touch capacitance touchscreen, is to sandwich an x/y or diagonal matrix of fine, insulation coated copper or tungsten wires between two layers of clear polyester film. This creates an array of proximity sensing micro-capacitors. One of these micro-capacitors every 10 to 15 mm is probably sufficient spacing if fingers are relatively widely spaced apart, but very high discrimination multi-touch may need a micro-capacitor every 5 or 6 mm. A similar system can be used for ultra-high resolution sensing, such as fingerprint sensing.Fingerprint sensors require a micro-capacitor spacing of about 44 to 50 microns.[78]
Single touch resistive touchscreens
In the resistive approach, which used to be the most popular technique, there are typically four layers:
Top polyester-coated layer with a transparent metallic-conductive coating on the bottom.
Adhesive spacer
Glass layer coated with a transparent metallic-conductive coating on the top
Adhesive layer on the backside of the glass for mounting.
When a user touches the surface, the system records the change in the electric current that flows through the display.
Dispersive signal
Dispersive signal technology measures thepiezoelectric effect—the voltage generated when mechanical force is applied to a material that occurs chemically when a strengthened glass substrate is touched.
Infrared
There are two infrared-based approaches. In one, an array of sensors detects a finger touching or almost touching the display, thereby interrupting infrared light beams projected over the screen. In the other, bottom-mountedinfrared cameras record heat from screen touches.
In each case, the system determines the intended command based on the controls showing on the screen at the time and the location of the touch.
The development of multi-touch screens facilitated the tracking of more than one finger on the screen; thus, operations that require more than one finger are possible. These devices also allow multiple users to interact with the touchscreen simultaneously.
With the growing use of touchscreens, the cost of touchscreen technology is routinely absorbed into the products that incorporate it and is nearly eliminated. Touchscreen technology has demonstrated reliability and is found in airplanes, automobiles, gaming consoles, machine control systems, appliances, and handheld display devices including cellphones; the touchscreen market for mobile devices was projected to produce US$5 billion by 2009.[79][needs update]
The ability to accurately point on the screen itself is also advancing with the emerginggraphics tablet-screen hybrids.Polyvinylidene fluoride (PVDF) plays a major role in this innovation due its high piezoelectric properties, which allow the tablet to sense pressure, making such things as digital painting behave more like paper and pencil.[80]
TapSense, announced in October 2011, allows touchscreens to distinguish what part of the hand was used for input, such as the fingertip, knuckle and fingernail. This could be used in a variety of ways, for example, to copy and paste, to capitalize letters, to activate different drawing modes, etc.[81][82]
For touchscreens to be effective input devices, users must be able to accurately select targets and avoid accidental selection of adjacent targets. The design of touchscreen interfaces should reflect technical capabilities of the system,ergonomics,cognitive psychology andhuman physiology.
Guidelines for touchscreen designs were first developed in the 2000s, based on early research and actual use of older systems, typically using infrared grids—which were highly dependent on the size of the user's fingers. These guidelines are less relevant for the bulk of modern touch devices which use capacitive or resistive touch technology.[83][84]
From the mid-2000s, makers ofoperating systems forsmartphones have promulgated standards, but these vary between manufacturers, and allow for significant variation in size based on technology changes, so are unsuitable from ahuman factors perspective.[85][86][87]
Much more important is the accuracy humans have in selecting targets with their finger or a pen stylus. The accuracy of user selection varies by position on the screen: users are most accurate at the center, less so at the left and right edges, and least accurate at the top edge and especially the bottom edge. TheR95 accuracy (required radius for 95% target accuracy) varies from 7 mm (0.28 in) in the center to 12 mm (0.47 in) in the lower corners.[88][89][90][91][92] Users are subconsciously aware of this, and take more time to select targets which are smaller or at the edges or corners of the touchscreen.[93]
This user inaccuracy is a result ofparallax, visual acuity and the speed of the feedback loop between the eyes and fingers. The precision of the human finger alone is much, much higher than this, so when assistive technologies are provided—such as on-screen magnifiers—users can move their finger (once in contact with the screen) with precision as small as 0.1 mm (0.004 in).[94][dubious –discuss]
Users of handheld and portable touchscreen devices hold them in a variety of ways, and routinely change their method of holding and selection to suit the position and type of input. There are four basic types of handheld interaction:
Holding at least in part with both hands, tapping with a single thumb
Holding with two hands and tapping with both thumbs
Holding with one hand, tapping with the finger (or rarely, thumb) of another hand
Holding the device in one hand, and tapping with the thumb from that same hand
Use rates vary widely. While two-thumb tapping is encountered rarely (1–3%) for many general interactions, it is used for 41% of typing interaction.[95]
In addition, devices are often placed on surfaces (desks or tables) and tablets especially are used in stands. The user may point, select or gesture in these cases with their finger or thumb, and vary use of these methods.[96]
Touchscreens are often used withhaptic response systems. A common example of this technology is the vibratory feedback provided when a button on the touchscreen is tapped. Haptics are used to improve the user's experience with touchscreens by providing simulated tactile feedback, and can be designed to react immediately, partly countering on-screen response latency. Research from theUniversity of Glasgow (Brewster, Chohan, and Brown, 2007; and more recently Hogan) demonstrates that touchscreen users reduce input errors (by 20%), increase input speed (by 20%), and lower their cognitive load (by 40%) when touchscreens are combined with haptics or tactile feedback. On top of this, a study conducted in 2013 by Boston College explored the effects that touchscreens haptic stimulation had on triggering psychological ownership of a product. Their research concluded that a touchscreens ability to incorporate high amounts of haptic involvement resulted in customers feeling more endowment to the products they were designing or buying. The study also reported that consumers using a touchscreen were willing to accept a higher price point for the items they were purchasing.[97]
Touchscreen technology has become integrated into many aspects of customer service industry in the 21st century.[98] The restaurant industry is a good example of touchscreen implementation into this domain. Chain restaurants such as Taco Bell,[99] Panera Bread, and McDonald's offer touchscreens as an option when customers are ordering items off the menu.[100] While the addition of touchscreens is a development for this industry, customers may choose to bypass the touchscreen and order from a traditional cashier.[99] To take this a step further, a restaurant in Bangalore has attempted to completely automate the ordering process. Customers sit down to a table embedded with touchscreens and order off an extensive menu. Once the order is placed it is sent electronically to the kitchen.[101] These types of touchscreens fit under the Point of Sale (POS) systems mentioned in the lead section.
Extended use of gestural interfaces without the ability of the user to rest their arm is referred to as "gorilla arm".[102] It can result in fatigue, and even repetitive stress injury when routinely used in a work setting. Certain early pen-based interfaces required the operator to work in this position for much of the workday.[103] Allowing the user to rest their hand or arm on the input device or a frame around it is a solution for this in many contexts. This phenomenon is often cited as an example of movements to be minimized by proper ergonomic design.
Unsupported touchscreens are still fairly common in applications such asATMs and data kiosks, but are not an issue as the typical user only engages for brief and widely spaced periods.[104]
Touchscreens can suffer from the problem of fingerprints on the display. This can be mitigated by the use of materials withoptical coatings designed to reduce the visible effects of fingerprint oils. Most modern smartphones haveoleophobic coatings, which lessen the amount of oil residue. Another option is to install a matte-finish anti-glarescreen protector, which creates a slightly roughened surface that does not easily retain smudges.
Capacitive touchscreens rarely work when the user wears gloves. The thickness of the glove and the material they are made of play a significant role on that and the ability of a touchscreen to pick up a touch.
Some devices have a mode which increases the sensitivity of the touchscreen. This allows the touchscreen to be used more reliably with gloves, but can also result in unreliable and phantom inputs. However, thin gloves such as medical gloves are thin enough for users to wear when using touchscreens; mostly applicable to medical technology and machines.
^Orr, N. W.; Hopkins, V. D. (1968). "The Role of Touch Display in Air Traffic Control".The Controller.7:7–9.
^Lowe, J. F. (18 November 1974). "Computer creates custom control panel".Design News:54–55.
^Stumpe, Bent; Sutton, Christine (1 June 2010)."CERN touch screen".Symmetry Magazine. A joint Fermilab/SLAC publication. Archived fromthe original on 2016-11-16. Retrieved16 November 2016.
^Biferno, M. A.; Stanley, D. L. (1983).The Touch-Sensitive Control/Display Unit: A Promising Computer Interface. Technical Paper 831532, Aerospace Congress & Exposition, Long Beach, CA: Society of Automotive Engineers.
^Hong, Chan-Hwa; Shin, Jae-Heon; Ju, Byeong-Kwon; Kim, Kyung-Hyun; Park, Nae-Man; Kim, Bo-Sul; Cheong, Woo-Seok (1 November 2013). "Index-Matched Indium Tin Oxide Electrodes for Capacitive Touch Screen Panel Applications".Journal of Nanoscience and Nanotechnology.13 (11):7756–7759.doi:10.1166/jnn.2013.7814.PMID24245328.S2CID24281861.
^"ANSI/HFES 100-2007 Human Factors Engineering of Computer Workstations".Human Factors & Ergonomics Society. Santa Monica, CA. 2007.
^"Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs)–Part 9: Requirements for Non-keyboard Input Devices".International Organization for Standardization. Geneva, Switzerland. 2000.
^Hoober, Steven; Shank, Patti; Boll, Susanne (2014). "Making mLearning Usable: How We Use Mobile Devices". Santa Rosa, CA.{{cite journal}}:Cite journal requires|journal= (help)
^Henze, Niels; Rukzio, Enrico; Boll, Susanne (2011). "100,000,000 Taps: Analysis and Improvement of Touch Performance in the Large".Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services. New York.
^Parhi, Pekka (2006). "Target Size Study for One-Handed Thumb Use on Small Touchscreen Devices".Proceedings of MobileHCI 2006. New York.
^Lee, Seungyons; Zhai, Shumin (2009). "The performance of touch screen soft buttons".Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York. p. 309.doi:10.1145/1518701.1518750.ISBN9781605582467.S2CID2468830.{{cite book}}: CS1 maint: location missing publisher (link)
^Bérard, François (2012). "Measuring the linear and rotational user precision in touch pointing".Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces. New York. p. 183.doi:10.1145/2396636.2396664.ISBN9781450312097.S2CID15765730.{{cite book}}: CS1 maint: location missing publisher (link)
^Brasel, S. Adam; Gips, James (2014). "Tablets, touchscreens, and touchpads: How varying touch interfaces trigger psychological ownership and endowment".Journal of Consumer Psychology.24 (2):226–233.doi:10.1016/j.jcps.2013.10.003.S2CID145501566.
^Zhu, Ying; Meyer, Jeffrey (September 2017). "Getting in touch with your thinking style: How touchscreens influence purchase".Journal of Retailing and Consumer Services.38:51–58.doi:10.1016/j.jretconser.2017.05.006.
^Baker, Rosie (19 May 2011). "FOOD: McDonald's explores digital touchscreens".Marketing Week: 4.GaleA264377887.
^"A Restaurant That Lets Guests Place Orders Via a Touchscreen Table (Touche is said to be the first touchscreen restaurant in India and fifth in the world)".India Business Insight. 31 August 2011.GaleA269135159.
Shneiderman, B. (1991). "Touch screens now offer compelling uses".IEEE Software.8 (2):93–94, 107.doi:10.1109/52.73754.S2CID14561929.
Potter, R.; Weldon, L. & Shneiderman, B. (1988).An experimental evaluation of three strategies. Proc. CHI'88. Washington, DC: ACM Press. pp. 27–32.
Sears, A.; Plaisant, C. & Shneiderman, B. (1992). "A new era for high precision touchscreens". In Hartson, R. & Hix, D. (eds.).Advances in Human-Computer Interaction. Vol. 3. Ablex, NJ. pp. 1–33.{{cite book}}: CS1 maint: location missing publisher (link)
Sears, Andrew; Shneiderman, Ben (April 1991). "High precision touchscreens: design strategies and comparisons with a mouse".International Journal of Man-Machine Studies.34 (4):593–613.doi:10.1016/0020-7373(91)90037-8.hdl:1903/360.S2CID2430120.
