US20140146982A1 - Electronic Devices and Accessories with Media Streaming Control Features - Google Patents

Abstract

An electronic device may play audio content to a user through a pair of earphones. The audio content may be content that is stored locally on the electronic device or may be streaming content that is provided by an online service. Control circuitry in the electronic device may monitor ear presence sensor structures in the earphones to determine whether the earphones are present in the ears of the user. In response to determining that the earphones have been removed from the ears of the user, the control circuitry may communicate with the online service provider. Communicating with the online service provider may include sending media streaming control commands to the online service provider. The media streaming control commands may, for example, include media streaming pause commands that instruct the online service provider to pause the audio content in response to the earphones being removed from the ears of the user.

Description

BACKGROUND
• This relates to electronic devices and, more particularly, to electronic devices with accessories such as earphones.
• Accessories such as earphones are often used with media players, cellular telephones, computers, and other electronic devices. There can be difficulties associated with using earphones. For example, a user who is using earphones to listen to streaming audio content provided by an online service may occasionally need to remove the earphones. When doing so, the user may miss content that is being played. For example, a user may not be able to manually stop audio content before removing the earphones, causing some of the content to be played without the user's full attention. Playing streaming audio content while the user is not listening is not only wasteful of the electronic device's battery life but also wasteful of cellular data usage, of which the user may only be allotted a certain amount per month.
• This type of situation is also undesirable for online service providers, which are typically required to pay for each song played (regardless of whether or not a user is listening).
• It would therefore be desirable to be able to provide improved ways in which to control operation of an electronic device coupled to an accessory.
SUMMARY
• An electronic device may receive audio content from an online service provider such as an internet radio service or other online service provider. The electronic device may play the audio content for a user through a pair of earphones.
• The earphones may have sensor structures that determine whether or not the ears of a user are present in the vicinity of the earphones.
• Control circuitry in the electronic device may monitor the sensor structures to determine whether the earphones are in or on the ears of the user. In response to determining that the earphones have been removed from the ears of the user, the control circuitry may communicate with the online service provider.
• Communicating with the online service provider may include sending media streaming control commands to the online service provider. The media streaming control commands may include a media streaming pause command that instructs the online service provider to pause the streaming audio content in response to the earphones being removed from the ears of the user.
• The audio content provided by the online service provider may include an audio advertisement. The control circuitry may send information to the online service provider indicating that the earphones have been removed from the ears of the user during the audio advertisement.
• The electronic device may communicate with computing equipment associated with the online service provider over a communications network such as the internet.
• Further features of the invention, its nature and various advantages will be more apparent from the accompanying drawings and the following detailed description of the preferred embodiments.
BRIEF DESCRIPTION OF THE DRAWINGS
• FIG. 1 is a diagram of an illustrative system in which an electronic device with wireless communications circuitry may communicate with an online service provider in accordance with an embodiment of the present invention.
• FIG. 2 is a front perspective view of an illustrative electronic device and associated accessory in accordance with an embodiment of the present invention.
• FIG. 3 is a schematic diagram of an illustrative electronic device and associated accessory in accordance with an embodiment of the present invention.
• FIG. 4 is a diagram of an illustrative accessory showing how sensor signals may be conveyed from ear presence sensor structures in the accessory to an audio connector in the accessory in accordance with an embodiment of the present invention.
• FIG. 5 is a perspective view of an illustrative speaker housing such as an earbud speaker housing that has ear presence sensor structures in accordance with an embodiment of the present invention.
• FIG. 6 is a perspective view of an illustrative speaker housing such as an in-ear speaker housing that has ear presence sensor structures in accordance with an embodiment of the present invention.
• FIG. 7 is a perspective view of illustrative earphones such as over-the-ear headphones that have ear presence sensor structures in accordance with an embodiment of the present invention.
• FIG. 8 is a cross-sectional side view of an earphone housing of the type that may be provided with sensor structures for detecting the presence of an ear or other external object in accordance with an embodiment of the present invention.
• FIG. 9 is a flow chart of illustrative steps involved in using an accessory and electronic device in accordance with an embodiment of the present invention.
DETAILED DESCRIPTION
• Electronic device accessories may be provided with the ability to sense the presence of external objects. For example, an earphone accessory may be provided with sensing structures such as user detection sensors that can determine whether or not the earphones (i.e., the earphone speakers) are located in or on the ears of a user.
• Information gathered by the sensor structures may be used to control audio content that is provided to the user through the earphones. For example, information gathered by the sensor structures may be used to control audio content provided by online services such as internet radio and other streaming content providers. Controlling the playback of streaming content from an electronic device based on whether or not the user is wearing earphones associated with the electronic device may optimize the electronic device's battery life, may optimize the electronic device's cellular data usage, and may also prove beneficial for the online service provider by reducing the amount of content played without a user listening.
• An illustrative system in which an electronic device may communicate with an online service provider such as an online streaming content provider is shown inFIG. 1. As shown inFIG. 1,system60 may include a communications network such asnetwork48.Communications network48 may include wired and wireless local area networks and wide area networks (e.g., the internet). Equipment such ascomputing equipment46 may be used in implementing online services.Computing equipment46 may include one or more networked computers (e.g., servers) on which software is run to implement software-based services. The services that are hosted using computing equipment such ascomputing equipment46 may include video server services, audio server services, web page services, communications services, media playback services, online storage services, social networking services, games, etc. Onlineservice computing equipment46 may, for example, include a streaming content provider such as an internet radio service or other streaming content provider). The servers that are used in implanting online services may be implemented using one or more computers that are located at one or more different geographic locations.
• Electronic devices10 may communicate with onlineservice computing equipment46 overcommunications network48. In a typical wired connection arrangement, an electronic device may be connected tonetwork48 using a cable. The cable may connect the electronic device to equipment innetwork48. For example, link such aslink50 ofFIG. 1 may be used to interconnect an electronic device to network48 (e.g., using a modem). Wireless links may also be formed as part oflinks50 or other links insystem60.
• For example, an electronic device may have a wireless local area network adapter that allows the device to communicate wirelessly with wireless local area network equipment such as wireless localarea network equipment52. Wireless localarea network equipment52 may, for example, be a router or access point that supports IEEE 802.11 communications (sometimes referred to as WiFi®). As illustrated inFIG. 1, one or moreelectronic devices10 may be connected to the network by forming a local wireless link such as one oflinks56 withequipment52.
• In addition to forming local wireless links,electronic devices10 may form remote wireless links (i.e., links that may cover distances of a mile or more). Links of this type may be made, for example, with cellular telephone base stations such as cellulartelephone base stations54. In the example ofFIG. 1, one ofcellular base stations54 is shown as forming a remotewireless communications link56 with an associated one ofelectronic devices10.
• Wireless localarea network equipment52 andcellular base stations54 may be connected to other equipment innetwork48 using wired or wireless links (shown aslinks50 inFIG. 1). Because wireless localarea network equipment52 andcellular base stations54 serve to provide access tonetwork48,equipment52 andcellular base stations54 may serve as part ofcommunications network48 and are sometimes referred to as forming wireless network equipment. Other wireless equipment may also be used innetwork48 and in forming wireless connections tonetwork48. The example ofFIG. 1 is merely illustrative.
• A perspective view of a system of the type that may be used insystem60 is shown inFIG. 2. As shown inFIG. 2,system8 may includeelectronic device10 andaccessory20.Device10 ofFIG. 2 may be portable electronic equipment such as a cellular telephone, a tablet computer, a media player, a wrist-watch device, a pendant device, an earpiece device, a notebook computer, other compact portable devices, or other electronic equipment such as a computer monitor with an integrated computer, a computer monitor, a desktop computer, a set-top box, or a television.
• Electronic device10 may include a display such asdisplay14.Display14 may be a touch screen that incorporates a layer of conductive capacitive touch sensor electrodes or other touch sensor components or may be a display that is not touch-sensitive.Display14 may include an array of display pixels formed from liquid crystal display (LCD) components, an array of electrophoretic display pixels, an array of plasma display pixels, an array of organic light-emitting diode display pixels, an array of electrowetting display pixels, or display pixels based on other display technologies. Configurations in which display14 includes display layers that form liquid crystal display (LCD) pixels may sometimes be described herein as an example. This is, however, merely illustrative.Display14 may include display pixels formed using any suitable type of display technology.
• Display14 may be protected using a display cover layer such as a layer of transparent glass or clear plastic. Openings may be formed in the display cover layer. For example, an opening may be formed in the display cover layer to accommodate a button such asbutton16 and an opening such asopening18 may be used to form a speaker port.
• Device10 may have a housing such ashousing12.Housing12, which may sometimes be referred to as an enclosure or case, may be formed of plastic, glass, ceramics, fiber composites, metal (e.g., stainless steel, aluminum, etc.), other suitable materials, or a combination of any two or more of these materials.
• Housing12 may be formed using a unibody configuration in which some or all ofhousing12 is machined or molded as a single structure or may be formed using multiple structures (e.g., an internal frame structure, one or more structures that form exterior housing surfaces, etc.). The periphery ofhousing12 may, if desired, include walls. One or more openings may be formed inhousing12 to accommodate connector ports, buttons, and other components. For example, an opening may be formed in the wall ofhousing12 to accommodateaudio connector24 and other connectors (e.g., digital data port connectors, etc.).Audio connector24 may be a female audio connector (sometimes referred to as an audio jack) that has two pins (contacts), three pins, four pins, or more than four pins (as examples).Audio connector24 may mate with male audio connector22 (sometimes referred to as an audio plug) inaccessory20.
• Accessory20 may be a pair of earphones (e.g., earbuds or earphones with other types of speakers), other audio equipment (e.g., an audio device with a single earphone unit), or other electronic equipment that communicates withelectronic device10. The use of a pair of earphones insystem8 is sometimes described herein as an example. This is, however, merely illustrative.Accessory10 may be implemented using any suitable electronic equipment.
• It should be understood that the term “earphones” may refer to any suitable type of audio headset (e.g., headphones, over-the-ear headphones, earbuds, earbud-type headphones with ear hooks, in-ear headphones that extend partially into the ear canal, etc.).
• As shown inFIG. 2,accessory20 may include a communications path such ascable26 that is coupled toaudio plug22.Cable26 may contain conductive lines (e.g., wires) that are coupled to respective contacts (pins) inaudio connector22. The conductive lines ofcable26 may be used to route audio signals fromdevice10 to speakers inearphone units28. Earphone units28 (which may sometimes be referred to as speakers, speaker housings, or earphone housings) may include sensor structures for determining whenearphone units28 have been placed within the ears of a user. Microphone signals may be gathered using a microphone mounted incontroller unit30.Controller unit30 may also have buttons that receive user input from a user ofsystem8. A user may, for example, manually control the playback of media by pressingbutton30A to play media or increase audio volume, by pressingbutton30B to pause or stop media playback, and by pressingbutton30C to reverse media playback or decrease audio volume (as examples).
• The circuitry ofcontroller30 may communicate with the circuitry ofdevice10 using the wires or other conductive paths in cable26 (e.g., using digital and/or analog communications signals). The paths incable26 may also be coupled to speaker drivers inearphones28, so that audio signals fromdevice10 may be played through the speakers inspeaker housings28.Electronic device10 may regulate the volume of sound produced byearphones20 by controlling the audio signal strength used in driving the speakers inspeaker housings28.
• Sensor signals from sensor structures inearphones20 may be conveyed todevice10 using the conductive paths ofcable26.Electronic device10 may process the sensor signals and take suitable action based on a determination of whether or notearphones20 are in or on the ears of a user.
• A schematic diagram showing illustrative components that may be used indevice10 andaccessory20 ofsystem8 is shown inFIG. 3. As shown inFIG. 3,electronic device10 may includecontrol circuitry32 and input-output circuitry34.Control circuitry32 may include storage and processing circuitry that is configured to execute software that controls the operation ofdevice10.Control circuitry32 may be implemented using one or more integrated circuits such as microprocessors, application-specific integrated circuits, memory, and other storage and processing circuitry.
• Input-output circuitry34 may include components for receiving input from external equipment and for supplying output. For example, input-output circuitry34 may include user interface components for providing a user ofdevice10 with output and for gathering input from a user.
• As shown inFIG. 3, input-output circuitry34 may includecommunications circuitry36.Communications circuitry36 may be used to form local and remote wireless links such aslinks56 ofFIG. 1. Local wireless links may be formed using wireless local area network transceiver64 (e.g., IEEE 802.11 and Bluetooth®). Remote wireless links may be formed usingcellular telephone transceiver62.Communications circuitry36 may be used to handle wireless signals in communications bands such as the 2.4 GHz and 5 GHz WiFi® bands, cellular telephone bands, and other wireless communications frequencies of interest.Communications circuitry36 may also include wired communications circuitry such as circuitry for communicating with external equipment over serial and/or parallel digital data paths.
• Input-output devices38 may include buttons such as sliding switches, push buttons, menu buttons, buttons based on dome switches, keys on a keypad or keyboard, or other switch-based structures. Input-output devices38 may also include status indicator lights, vibrators, display touch sensors, speakers, microphones, camera sensors, ambient light sensors, proximity sensors, and other input-output structures.
• Electronic device10 may be coupled to components inaccessory20 using cables such ascable26 ofaccessory20.Accessory20 may include speakers such as a pair of speaker drivers40 (e.g., a left speaker and a right speaker). If desired,accessory20 may include more than one driver perspeaker housing28. For example, eachspeaker housing28 inaccessory20 may have a tweeter, a midrange driver, and a bass driver (as an example).Speaker drivers40 may be mounted in earbuds or other speaker housings. The use of left and right speaker housings to house respective left andright speaker drivers40 is sometimes described herein as an example.
• If desired,accessory20 may includeuser input devices42 such as buttons (see, e.g., the buttons associated withbutton controller30 ofFIG. 2), touch-based input devices (e.g., touch screens, touch pads, touch buttons), a microphone to gather voice input, and other user input devices.
• To determine whether or not the speaker housings in whichspeaker drivers40 have been mounted are located in or on the ears of a user,accessory20 may be provided with userdetection sensor structures44. Userdetection sensor structures44 may be configured to detect whether or notearphones20 have been placed in or on the ears of a user.User detection sensors44 may be formed from acoustic-based sensors such as ultrasonic acoustic-based sensors, from capacitive sensors, from temperature sensors, from force sensors, from resistance-based sensors, from light-based sensors, and/or from switch-based sensors or other mechanical sensors (as examples).Control circuitry45 in accessory20 (e.g., storage and processing circuits formed from one or more integrated circuits or other circuitry) and/orcontrol circuitry32 ofelectronic device10 may use information fromsensor structures44 in determining which actions should be automatically taken bydevice10.
• In force-based sensor schemes, the resistance of a compressible foam may be measured or a strain gauge output can be monitored. When force is present,electronic device10 can conclude thatearphones20 have been inserted into or mounted on a user's ears, whereas when force is not present,electronic device10 can conclude thatearphones20 are not being worn by the user. Force indicative of a user's ear pressing againstearphones20 may also be monitored using piezo-electric force sensors or other force sensors.
• A diagram ofaccessory20 illustrating how sensor signals may be conveyed from earpresence sensor structures44 to an electronic device such asdevice10 is shown inFIG. 4. As shown inFIG. 4,accessory20 may includeleft speaker driver40L with associated leftear presence sensor44L andright speaker driver40R with associated rightear presence sensor44R. If desired, only one ofspeaker drivers40L and40R may have an associated ear presence sensor. The example ofFIG. 4 in which both left and right speaker drivers have an associated ear presence sensor is merely illustrative.
• Cable26 may includecommon cable segment35 that branches into twocable segments33L and33R.Cable segments33L,33R, and35 may each include any suitable number of wires. For example,cable segment33L may include a first wire associated with left channel audio and a second wire that serves as ground.Cable segment33R may include a first wire associated right channel audio and a second wire that serves as ground.Cable segment35 may, for example, include a first wire associated with left channel audio, a second wire associated with right channel audio, a third wire that serves as ground, and a fourth wire associated with microphone signals (e.g., microphone signals from a voice microphone incontroller unit30 ofFIG. 2).
• If desired, there may be additional wires incable26. For example,segment33L may include a wire associated with sensor signals from leftear presence sensor44L andsegment33R may include a wire associated with sensor signals from rightear presence sensor44R.
• If desired, sensor signals fromear presence sensors44 may be conveyed over the electrical paths used for analog audio. For example, sensor signals may encoded as digital signals using a modulation scheme (e.g., amplitude modulation, frequency modulation, phase modulation, other suitable modulation techniques, etc.). With this type of configuration,accessory20 may include a controller such ascontroller31 having communications circuitry configured to receive sensor signals fromear presence sensors44 and to modulate the sensor signals on the existing audio paths incable segment35. For example,circuitry31 may receive sensor signals fromsensor44L and44R and may modulate the sensor signals on a right channel audio wire, a left channel audio wire, and/or a microphone wire (as examples).
• Audio connector22 may have any suitable number of contacts. For example,connector22 may be a three-contact audio connector (sometimes referred to as a tip-ring-sleeve (TRS) connector) orconnector22 may be a four-contact audio connector (sometimes referred to as a tip-ring-ring-sleeve (TRRS) connector). In configurations wherecable26 includes a designated wire for sensor signals fromear presence sensors44,connector22 may include an additional contact to be used for handling the sensor signals. In configurations where sensor signals are modulated on existing audio wires,connector22 need not include additional contacts for handling sensor signals.
• An illustrative earbud speaker housing with an ear presence sensor is shown inFIG. 5. In the example ofFIG. 5,earbud28 has a housing such ashousing66 in which one or more speaker drivers such asspeakers40 ofFIG. 3 are mounted.
• Conductive structures such asconductive mesh structures68 and70 may be mounted inhousing66. As shown inFIG. 5, for example,mesh structures68 and70 may be mounted in the front ofhousing66 so that sound from the speakers inside earbudhousing66 may pass through the holes of the mesh. If desired,earbud28 may contain microphone structures (e.g., when implementing noise cancellation features in earbud28). The use of mesh when formingelectrode structures68 and70 may allow ambient sound to be picked up by the noise cancellation microphones inhousing66.
• Mesh electrodes68 and70 (e.g., metal screen structures) or other conductive structures inearbud28 may be used as first and second terminals in a resistive (resistance-based) sensor. Control circuitry inhousing66 may be used to apply a voltage across the first and second terminals while measuring how much current flows as a result. The control circuitry may use information on the voltage and current signals that are established betweenelectrodes68 and70 to determine whether or not earbud28 has been placed in the ear of a user. In the absence of the user's ear, the resistance betweenelectrodes68 and70 will be relatively high. When, however, earbud28 has been placed into a user's ear, contact betweenelectrodes68 and70 and the flesh of the ear will give rise to a lower resistance path betweenelectrodes68 and70. To determine whether or not earbud28 has been placed within the user's ear, the control circuitry of earbud28 (and/orcontrol circuitry32 ofFIG. 3) may measure the resistance betweenelectrodes68 and70 and may compare the measured resistance to a predetermined threshold. When the measured resistance is below the predetermined threshold,device10 can conclude thatearbud28 has been placed in the ear of the user. When the measured resistance exceeds the predetermined threshold,device10 can conclude thatearbud28 is out of the ear.
• In addition to or instead of usingmesh68 and70 to measure the resistance of the user's ear,mesh electrodes68 and70 may be used as capacitive sensor electrodes (e.g., to make mutual capacitance measurements or to make self capacitance measurements). Different capacitance values may be detected in the presence and absence of the user's ear in the vicinity ofelectrodes68 and70. This allowsdevice10 to use the capacitance measurements to determine whether or not earbud28 is in, on, or out of the user's ear.
• If desired,earbud28 may include a sealing member such as sealingmember72. Sealingmember72 may be used to form a seal between user's ear andearbud28 that helps block ambient noise while also forming an enclosed cavity adjacent to the ear canal. In addition to or instead of usingmesh68 and70 to detect the presence of a user's ear, an ear presence sensor such asear presence sensor74 may be embedded in or formed on sealingmember72.
• As an example,ear presence sensor74 may be a temperature sensor configured to measure a temperature adjacent to sealingmember72. Different temperature values may be detected in the presence and absence of the user's ear in the vicinity of sealingmember72.Device10 may use temperature information provided bytemperature sensor74 to determine whether or not earbud28 is in, on, or out of the user's ear.
• As an additional example,ear presence sensor74 may be a pressure or force sensor configured to measure a pressure or force against sealingmember72. Different pressure or force values may be detected in the presence and absence of the user's ear in the vicinity of sealingmember72.Device10 may use information provided bysensor74 to determine whether or not earbud28 is in, on, or out of the user's ear.
• These examples are, however, merely illustrative. If desired,sensor74 may be a capacitive sensor, a switch-based sensor (e.g.,sensor74 may be a mechanical switch that is actuated when a user's ear is present or absent), or any other suitable type of sensor configured to detect the presence and/or absence of a user's ear.
• FIG. 6 is a perspective view of an illustrative in-ear speaker housing with an ear presence sensor. In the example ofFIG. 6, in-ear earbud28 includes sealingmembers76 configured to extend partially into the ear canal of a user's ear. Earphones of the type shown inFIG. 6 are sometimes referred to as ear-canal headphones.
• As shown inFIG. 6,ear presence sensor74 may be embedded in or formed on one of sealingmembers76.Ear presence sensor74 may be a temperature sensor, a pressure or force sensor, a capacitive sensor, a switch-based sensor (e.g.,sensor74 may be a mechanical switch that is actuated whenearbud28 is inserted or removed from a user's ear), or any other suitable type of sensor configured to detect the presence and/or absence of a user's ear.
• FIG. 7 is a perspective view of illustrative over-the-ear headphones having one or more user detection sensors. In the example ofFIG. 7,accessory20 includes a headband such asheadband78 with left and right over-the-ear speaker housings28. A sealing member such as sealingmember80 may be a ring or layer of foam or may be any other suitable type of ear pad configured to form a seal around the user's ear to block out ambient noise.
• As shown inFIG. 7,accessory20 may include one or more user detection sensors such asuser detection sensors82 and84.User detection sensors84 may be embedded in or formed on sealingmembers80 and may be configured to detect the presence and absence of a user's ears in the vicinity ofspeaker housings28.User detection sensor82 may be embedded in or formed onheadband portion78 and may be configured to detect the presence and absence of a user's head adjacent to headband78. When information fromsensor82 indicates that a user's head is not present,device10 can conclude that the user is not wearingheadphones20. When information fromsensor82 indicates that a user's head is present,device10 can conclude that the user is wearingheadphones20.
• User detection sensors82 and84 may be temperature sensors, pressure or force sensors, capacitive sensors, acoustic-based sensors, switch-based sensors (e.g., sensors formed form mechanical switches that are actuated when a user's ear or head is present or absent), or any other suitable type of sensor configured to detect the presence and/or absence of a user's ear.
• A cross-sectional side view of an illustrative earbud with a speaker driver and an associated ear presence sensor is shown inFIG. 8. As shown inFIG. 8,earbud28 may have a housing such ashousing66.Speaker40 may be mounted withinhousing66 overlapping an acoustic grill formed from structures such asmesh68 and70 or other acoustic mesh. During operation, sound88 may pass through the acoustic mesh. For example,speaker40 may produce sound that is received by a user's ear or otherexternal object80.
• Whenexternal object80 is sufficiently close toearbud28, the presence ofexternal object80 may be detected. For example, control circuitry45 (orcontrol circuitry32 in device10) may measure the resistance betweenmesh electrodes68 and70 usingconductive paths82 or may use capacitance measurements in monitoring for the presence ofobject80. The measured resistance (or capacitance) may then be used to determine whetherearbud28 is in the user's ear or is out of the user's ear. Control circuitry45 (orcontrol circuitry32 in device10) may also use sensors such assensor44 ofFIG. 8 to monitor for the presence or absence of external objects such as the user's ear. As shown inFIG. 8,sensor44 may have a transmitter such as transmitter44TX and may have a receiver such as receiver44RX. During operation ofsensor44,sensor44 may transmit signals such assignal84 and may gather reflected signals such assignal86. The strength of receivedsignal86 may be used to measure whether or notexternal object80 is in the presence ofearbud28.
• Sensor44 may, for example, be a sensor that emits and receives acoustic signals. For example, transmitter44TX may be a signal transducer that transmitsacoustic signals84. Receiver44RX may be a signal receiver that measures the amount or quality ofacoustic signal84 that is reflected as reflectedsignal86 fromexternal object80. When the amount or quality of acoustic signal that is reflected fromexternal object80 is low or fits a specific profile,circuitry45 can conclude thatearbud28 is not in the user's ear. When the amount or quality of acoustic signal that is reflected fromexternal object80 is high or fits a specific profile,circuitry45 can conclude thatearbud28 is currently in the user's ear.
• Signal transducer44TX may be configured to transmit ultrasonic signals and/or acoustic signals in the audible range. Signal transducer44TX may, for example, transmit ultrasonic signals during audio playback (e.g., whilespeaker driver40 is playing audio content for a user), whereas acoustic signals in the audible range may be transmitted when audio content is not being played by speaker driver40 (e.g., between songs).
• If desired, signal receiver44RX may be used to receive acoustic signals that have been transmitted byspeaker driver40 and reflected fromexternal object80. With this type of configuration, signal transmitter44TX may not be required. The echo of the audio content transmitted byspeaker driver40 and received by receiver44RX may be indicative of whether or not earbud28 is present at the user's ear.
• Device10 may use information from sensor structures44 (FIG. 3) to control audio content that is provided to the user through the earphones. For example,device10 may control content from an online service provider (e.g., onlineservice computing equipment46 ofFIG. 1) based on whether or notearphones20 are being worn by a user.Device10 may communicate with the online service provider in response to receiving information fromsensor structures44. When information fromsensor structures44 indicates thatearphones20 are not in or on a user's ears,device10 may pause, stop, or mute content playback, may lower the playback volume (i.e., audio signal drive strength), may close the application providing the content, and/or may take other suitable actions.
• If desired, information gathered byuser detection sensors44 may be provided to the online service that is providing the audio content. For example,device10 may send user data to the online content provider indicating when a user removesearphones20 while listening to content provided by the online content provider (e.g., during an advertisement, during a particular song, etc.). This type of information may allow the online service provider to optimize the services and advertisements it provides to the user.
• A flow chart of illustrative steps involved in in usingsystem8 is shown inFIG. 9. During the operations ofstep92,earphones20 may be located in or on the ears of a user anddevice10 may be operated normally while usingsensor circuitry44 to monitor for the presence or absence ofspeaker housings28 ofaccessory20 in or on the ears of a user. In configurations whereearphones20 are over-the-ear headphones (FIG. 7),sensor circuitry44 may be used to monitor the presence or absence of the user's head nearheadband78 or the presence or absence of the user's ears near over-the-ear speaker housings28. Circuitry32 (and/orcircuitry45, if desired) may be used in evaluating sensor data and taking appropriate action. Configurations in which controlcircuitry32 is used in taking action based on sensor data are sometimes described herein as an example.
• Examples of operations that may be performed bydevice10 duringstep92 include audio-based operations such as playing media content using an audio signal strength that results in a playback volume that is appropriate for listening throughearphones20, providing a user with audio associated with a telephone call, providing audio associated with a video chat session to the user, or otherwise presenting audio content throughearphones20. Audio may be played in stereo so that left and right earbuds receive corresponding left and right channels of audio, may be played using a multi-channel surround sound scheme, or may be played using a monophonic (mono) sound scheme in which both the left and right channels of audio are identical.
• The media content may be media content that is stored locally onelectronic device10 or may be streaming media content that is provided by an online service (e.g., an online radio service or other internet-based content provider such as onlineservice computing equipment46 ofFIG. 1). For example,electronic device10 may receive streaming audio content from computing equipment associated with an online service provider over a communications network.
• During the monitoring operation ofstep92,device10 can useuser detection sensors44 to determine whether or notearphones20 are in or on the user's ears.
• If, during the operations ofstep92, it is determined thatearphones20 have been removed from the user's ears,device10 may take suitable action atstep94. For example,device10 may communicate with the online service provider in response to determining that the earphones are out of the user's ears. Communicating with the online service provider may include sending media streaming control commands to the online service provider. The media streaming control commands may, for example, include a media streaming pause command that instructs the online service provider to pause the audio content that is being transmitted to the electronic device over the communications network. Communicating with the online service provider may also include sending user data to the online service provider indicating that the earphones have been removed from the user's ears during an audio advertisement.
• Other suitable actions that may be taken bydevice10 in response to theuser removing earphones20 from the user's ears include pausing, stopping, or muting the media playback, adjusting the playback volume (audio signal drive strength), closing the application ondevice10 that is running the online service that is providing the media, and/or sending user data to the online service (as examples). User data that may be sent to the online service may include information about when the user removes earphones20 (e.g., during what type of content the user removesearphones20, how often the user removesearphones20, how long theearphones20 are removed from the user's ears, etc.). For example,electronic device10 may send user data to the online service provider indicating that the earphones have been removed from the user's ears during an audio advertisement. In configurations where the audio content to which the user is listening is received from the online service over a wireless communications link, step94 may include terminating the audio content to which the user is listening in response to the earphones being removed from the user's ears.
• After taking suitable actions atstep94,device10 can be operated in an earphones-off mode (step96). For example,device10 may operate with paused, stopped, or muted audio playback duringstep94. In situations where the actions taken duringstep94 included sending user data to the online service without pausing, stopping, muting, or otherwise adjusting the audio content provided by the online service, step96 may include operatingdevice10 normally (e.g., continuing to provide audio content from the online service).
• During the operations ofstep96, earpresence sensor structures44 may be used to monitor for the presence ofearphones20 in or on the ears of the user.
• If, during the operations ofstep96,sensor structures44 determine thatearphones20 have been placed in or on the user's ears, appropriate action may be taken atstep98. Suitable actions that may be taken bydevice10 in response toearphones20 being placed in or on the user's ears include resuming media playback, restoring a previous volume level of the media playback, opening the application ondevice10 that runs the online service that provides the media, and/or sending user data to the online service (as examples). Operations may then proceed to step92, wheredevice10 may operate in an earphones-on mode while monitoringsensor structures44 to determine whenearphones20 are removed from the user's ears.
• The foregoing is merely illustrative of the principles of this invention and various modifications can be made by those skilled in the art without departing from the scope and spirit of the invention. The foregoing embodiments may be implemented individually or in any combination.

Claims (22)

What is claimed is:

1. A method for operating an electronic device that is configured to play audio for a user from an online service provider through a pair of earphones having sensor structures, comprising:

with control circuitry in the electronic device, receiving information from the sensor structures indicating whether the earphones are present in the ears of the user; and

in response to receiving information from the sensor structures indicating that the earphones are not present in the ears of the user, communicating with the online service provider using the control circuitry.

2. The method defined inclaim 1 wherein communicating with the online service provider comprises sending a media streaming control command to the online service provider.

3. The method defined inclaim 2 wherein the media streaming control command comprises a media streaming pause command that instructs the online service provider to pause the audio that is being played for the user.

4. The method defined inclaim 1 wherein the audio comprises an audio advertisement being played to the user through the earphones and wherein receiving the information from the sensor structures comprises receiving information indicating that the user has removed the earphones while the audio advertisement was being played for the user.

5. The method defined inclaim 1 wherein the sensor structures comprise a temperature sensor and wherein receiving the information from the sensor structures comprises receiving a temperature measurement from the temperature sensor.

6. The method defined inclaim 1 wherein the electronic device comprises cellular telephone transceiver circuitry, the method further comprising:

receiving the audio for the user from the online service provider over a wireless communications link using the cellular telephone transceiver circuitry; and

in response to receiving the information from the sensor structures indicating that the earphones are not present in the ears of the user, terminating the audio that is being played for the user.

7. The method defined inclaim 1 wherein the electronic devices is configured to play the audio from the online service provider via an application on the electronic device, the method further comprising:

in response to receiving the information from the sensor structures indicating that the earphones are not present in the ears of the user, closing the application on the electronic device.

8. A method of using an electronic device of a user listening to audio through earphones that are coupled to the electronic device to communicate with service provider computing equipment over a communications network, comprising:

with ear presence detectors in the earphones, determining whether the earphones are present in the ears of the user; and

in response to determining that the earphones have been removed from the ears of the user, sending information to the service provider computing equipment over the communications network.

9. The method defined inclaim 8 wherein the communications network comprises the internet and wherein sending the information to the service provider comprises sending media streaming commands to the service provider computing equipment over the internet.

10. The method defined inclaim 9 further comprising:

receiving the audio from the service provider computing equipment over the communications network.

11. The method defined inclaim 10 wherein sending the media streaming commands to the service provider computing equipment comprises sending a media streaming pause command that instructs the service provider computing equipment to pause the audio to which the user is listening.

12. The method defined inclaim 8 wherein sending the information to the service provider computing equipment comprises sending user data to the service provider computing equipment indicating that the user has removed the earphones during an audio advertisement provided by the service provider computing equipment.

13. The method defined inclaim 8 wherein the ear presence detectors comprise at least one temperature sensor and wherein determining whether the earphones are present in the ears of the user comprises measuring at least one temperature at the earphones.

14. An electronic device configured to receive audio content from an online service provider, comprising:

an audio connector configured to receive an audio connector of earphones having sensor structures that determine whether the earphones are present in the ears of a user; and

control circuitry configured to:

monitor the sensor structures to determine whether the earphones are present in the ears of the user, and

communicate with the online service provider in response to determining with the sensor structures that the earphones are not present in the ears of the user.

15. The electronic device defined inclaim 14 wherein the electronic device comprises cellular transceiver circuitry and wherein the electronic device is configured to receive the audio content from the online service provider using the cellular transceiver circuitry.

16. The electronic device defined inclaim 14 wherein the online service provider comprises an internet radio service and wherein the electronic device is configured to play the audio content from the internet radio service to the user through the earphones.

17. The electronic device defined inclaim 14 wherein the audio content comprises streaming audio content and wherein communicating with the online service provider comprises sending a pause command that instructs the online service provider to pause the streaming audio content.

18. The electronic device defined inclaim 14 wherein the audio content comprises a streaming audio advertisement and wherein communicating with the online service provider comprises sending user data to the online service provider.

19. The electronic device defined inclaim 18 wherein the user data comprises information indicating that the user has removed the earphones during the streaming audio advertisement.

20. The electronic device defined inclaim 14 wherein the sensor structures comprise temperature sensors and wherein the control circuitry in the electronic device is configured to monitor the temperature sensors to determine whether the earphones are present in the ears of the user.

21. The electronic device defined inclaim 14 wherein the sensor structures comprise ultrasonic acoustic sensors and wherein the control circuitry in the electronic device is configured to monitor the ultrasonic acoustic sensors to determine whether the earphones are present in the ears of the user.

22. The electronic device defined inclaim 14 wherein the sensor structures comprise capacitive sensor electrodes and wherein the control circuitry in the electronic device is configured to monitor the capacitive sensor electrodes to determine whether the earphones are present in the ears of the user.

Images