EP2876902A1 - Adjustable hearing aid device - Google Patents

Abstract

A hearing aid device (2) and a hearing aid system (2, 10) are disclosed. The hearing aid device (2) comprises means for receiving signals (16) representing audio from a person (6). The signals (16) are transmitted from an external device (10, 10') that receives audio from the person (6). The hearing aid device (2) comprises means for analysing the transmitted signals (16). The hearing aid device (2) further comprises means for determining a number of predefined sound characteristics (8, 8', 8") of the audio from the person (6) based on the transmitted signals (16). The hearing aid device (2) comprises means for storing a number the determined sound characteristics (8, 8', 8") either in the hearing aid device or in an external device (10, 10'). The hearing aid device (2) comprises means for identifying when a signal (16) received from the external device (10, 10') comprises audio that originates from a person (6) having sound characteristics (8, 8', 8") stored in the hearing aid device or in an external device (10, 10').

Description

Field of invention
• The present invention generally relates to a hearing aid device capable of communicating with an external device such as a smartphone or smartwatch and to a hearing aid system comprising a hearing aid device and an external device. The present invention more particularly relates to a hearing aid device that is capable of recognising the voice of a person and performing a predefined processing of a sound signal when the voice of the person has been recognised.
Prior art
• Hearing aid devices are to amplify sound for the hearing aid user, normally in order to make speech more intelligible or to correct impaired hearing as measured by audiometry.
• When several persons are talking at the same time, e.g. when a plurality of people are gathered in the same room, it is difficult for a hearing aid user to hear the speech clearly and distinctly, especially if the room is small. In such noisy situations where comfort often has high priority, users may further prefer that the hearing solution provides a softer (less amplified) sound picture for comfort and/or mental energy conservation. Another situation is when listening to streamed audio where the surrounding sound is of secondary importance. The risk is that important voices in the environment may then not be heard.
• In order to be able to prioritise the voice of a specific person among a group of people, the hearing aid somehow needs to be provided with specific information related to the voice of the person of interest.
• Therefore, it is desirable to have a hearing aid device that is capable of providing such user specific information in an easy way.
• It is one object of the present invention to provide a hearing aid device that is capable of prioritising the voice of a specific person among a group of talking people.
• It is also an object of the present invention to provide a hearing aid device that is capable of providing specific information related to the voice of a person of interest in an easy way.
• It is also an object of the present invention to provide a hearing aid device that is capable of automatically prioritising speech from a predefined person or to enhance the speech from a predefined person.
Summary of the invention
• An object of the present invention can be achieved by a hearing aid as defined inclaim 1. Preferred embodiments are defined in the dependent sub claims and explained in the following description and illustrated in the accompanying drawings.
• The hearing aid according to the invention comprising a hearing aid device comprising means for receiving signals representing audio from a person, where the signals are transmitted from an external device that receives audio from the person, where the hearing aid device comprises means for analysing the transmitted signals (as received by the hearing aid device), where the hearing aid device (or the external device) further comprises means for determining a number of predefined sound characteristics of the audio from the person based on the transmitted signals. The hearing aid device (or the external device) comprises means for storing a number the determined sound characteristics either in the hearing aid device or in an external device and that the hearing aid device (or the external device) comprises means for identifying when a signal received from the external device comprises audio that originates from a person having sound characteristics stored in the hearing aid device or in an external device.
• Hereby it is achieved that the hearing aid device can provide specific information related to the voice of a person of interest in an easy way.
• It may be an advantage that the hearing aid device comprises means for receiving signals representing audio from a person during a phone conversation (with the person), where the signals are transmitted from an external device that receives audio from the person. In an embodiment, the external device comprises a cellular phone, e.g. a smartphone. In an embodiment, the external device comprises an auxiliary device, functioning as an intermediate device (e.g. in the form or an audio gateway) between a telephone and the hearing aid device.
• The hearing aid according to the invention may be any type of hearing aid device.
• In the present context, a "hearing aid device" refers to a device, such as e.g. a hearing aid, a listening device or an active ear-protection device, which is adapted to improve, augment and/or protect the hearing capability of a user by receiving acoustic signals from the user's surroundings, generating corresponding audio signals, possibly modifying the audio signals and providing the possibly modified audio signals as audible signals to at least one of the user's ears.
• A "hearing aid device" further refers to a device such as an earphone or a headset adapted to receive audio signals electronically, possibly modifying the audio signals and providing the possibly modified audio signals as audible signals to at least one of the user's ears. Such audible signals may e.g. be provided in the form of acoustic signals radiated into the user's outer ears, acoustic signals transferred as mechanical vibrations to the user's inner ears through the bone structure of the user's head and/or through parts of the middle ear as well as electric signals transferred directly or indirectly to the cochlear nerve and/or to the auditory cortex of the user.
• A hearing aid device may be configured to be worn in any known way, e.g. as a unit arranged behind the ear with a tube leading air-borne acoustic signals into the ear canal or with a loudspeaker arranged close to or in the ear canal, as a unit entirely or partly arranged in the pinna and/or in the ear canal, as a unit attached to a fixture implanted into the skull bone, as an entirely or partly implanted unit, etc. A hearing aid device may comprise a single unit or several units communicating electronically with each other.
• More generally, a hearing aid device comprises an input transducer for receiving an acoustic signal from a user's surroundings and providing a corresponding input audio signal and/or a receiver for electronically receiving an input audio signal, a signal processing circuit for processing the input audio signal and an output means for providing an audible signal to the user in dependence on the processed audio signal. Some hearing aid devices may comprise multiple input transducers, e.g. for providing direction-dependent audio signal processing. A forward path is defined by the input transducer(s), the signal processing circuit, and the output means.
• In some hearing aid devices, the receiver for electronically receiving an input audio signal may be a wireless receiver. In some hearing aid devices, the receiver for electronically receiving an input audio signal may be e.g. an input amplifier for receiving a wired signal. In some hearing aid devices, an amplifier may constitute the signal processing circuit. In some hearing aid devices, the output means may comprise an output transducer, such as e.g. a loudspeaker for providing an air-borne acoustic signal or a vibrator for providing a structure-borne or liquid-borne acoustic signal. In some hearing aid devices, the output means may comprise one or more output electrodes for providing electric signals.
• In some hearing aid devices, the vibrator may be adapted to provide a structure-borne acoustic signal transcutaneously or percutaneously to the skull bone. In some hearing aid devices, the vibrator may be implanted in the middle ear and/or in the inner ear. In some hearing aid devices, the vibrator may be adapted to provide a structure-borne acoustic signal to a middle-ear bone and/or to the cochlea. In some hearing aid devices, the vibrator may be adapted to provide a liquid-borne acoustic signal in the cochlear liquid, e.g. through the oval window. In some hearing aid devices, the output electrodes may be implanted in the cochlea or on the inside of the skull bone and may be adapted to provide the electric signals to the hair cells of the cochlea, to one or more hearing nerves and/or to the auditory cortex.
• A "hearing aid system" refers to a system comprising one or two hearing aid devices, and a "binaural hearing aid system" refers to a system comprising two hearing aid devices and being adapted to cooperatively provide audible signals to both of the user's ears. Hearing aid systems or binaural hearing aid systems may further comprise "auxiliary devices" (here e.g. termed an 'external device'), which communicate with the hearing aid devices and affect and/or benefit from the function of the hearing aid devices. Auxiliary devices may be e.g. remote controls, remote microphones, audio gateway devices, mobile phones (e.g. smartphones), public-address systems, car audio systems or music players. Hearing aid devices, hearing aid systems or binaural hearing aid systems may e.g. be used for compensating for a hearing-impaired person's loss of hearing capability, augmenting or protecting a normal-hearing person's hearing capability and/or conveying electronic audio signals to a person.
• The hearing aid device according to an embodiment of the invention comprises means for receiving signals representing audio from a person. These means may be any suitable means e.g. means for receiving wirelessly transmitted data from a smartphone being applied to conduct a phone conversation.
• The means (in the hearing aid device) for receiving signals representing audio from a person preferably comprises a first wireless interface comprising first antenna and transceiver circuitry adapted for establishing a communication link to the external device (and/or to another hearing aid device) based on near-field communication (e.g. inductive, e.g. at frequencies below 100 MHz) and/or a second wireless interface comprising second antenna and transceiver circuitry adapted for establishing a second communication link to the external device (and/or to another hearing aid device) based on far-field communication (radiated fields (RF), e.g. at frequencies above 100 MHz, e.g. around 2.4 or 5.8 GHz).
• The external device may be any suitable type of device e.g. a phone that receives audio from the person. The external device preferably comprises a wireless interface comprising antenna and transceiver circuitry adapted for establishing a communication link to the hearing aid device. The audio may comprise speech.
• In the present context, a smartphone may also be considered to be a mobile, wearable device having a graphical interface combined with a touch input and the capability to communicate wirelessly with a network for data and/or speech transmission. Further, the external device may a wearable device, such as a watch, smartwatch or the like. Such devices usually have a scaled-down feature list compared to a smartphone, but still offer a graphical user interface combined with an input, often a touch input via a screen. Differences between features and computing power in smartphones and smartwatches may diminish and the two types of devices may eventually provide similar options or features. At least the smartwatch should provide a wireless interface to connect to one or more hearing aids or hearing instruments. This wireless interface is presently preferred based on the Bluetooth protocol and technology, i.e. presently, this means providing inter-device communication in the frequency band around 2.4 GHz. The wireless interface could be based on either Bluetooth Low Energy, marketed under the name Bluetooth Smart, or any other version of the Bluetooth protocol.
• In the present context, a smartphone, may comprise
• a (A) cellular telephone comprising a microphone, a speaker, and a (wireless) interface to the public switched telephone network (PSTN) COMBINED with
• a (B) personal computer comprising a processor, a memory, an operative system (OS), a user interface (e.g. a keyboard and display, e.g. integrated in a touch sensitive display) and a wireless data interface (including a Web-browser), allowing a user to download and execute application programs (APPs) implementing specific functional features (e.g. displaying information retrieved from the Internet, remotely controlling another device, combining information from various sensors of the smartphone (e.g. camera, scanner, GPS, microphone, etc.) and/or external sensors to provide special features, etc.).
• In the present context, the term 'personal computer' is meant to describe the functionality of the device, and to describe that the smartphone is provided with more advanced computing capability and connectivity than basic-feature phones.
• The hearing aid device comprises means for analysing the transmitted signals (as received from the external device by the hearing aid device). These means may be of any suitable type and e.g. embodied in an analysis unit. The means for receiving wirelessly transmitted signals comprise suitable antenna and receiver circuitry.
• The hearing aid device (or the external device) further comprises means for determining a number of predefined sound characteristics of the audio from the person based on the transmitted signals.
• The means may include a processor capable of providing any known type of analysis.
• The hearing aid device (or the external device) comprises means for storing a number the determined sound characteristics either in the hearing aid device or in an external device. The storing means may be of any type and size.
• It is a huge advantage that the hearing aid device comprises means for - in a normal mode of operation - identifying when a signal received from the external device (and/or a signal from an input transducer of the hearing aid device) comprises audio that origins from a person having sound characteristics stored in the hearing aid device or in an external device. This may be done by using any suitable manner as will be explained in the following.
• In an embodiment, a voice (audio) that origins from a specific person is tagged (with a tag). Tagging selected voices of high priority (VIP) allows the hearing aid device to give these voices higher relative priority or amplification making it easier for the hearing impaired to note and understand speech from the VIP persons.
• It may be an advantage that the hearing aid device comprises means for processing a signal in a predefined manner (e.g. a signal processing unit) in order to provide enhancement of audio that originates from a person having sound characteristics stored in the hearing aid device or in an external device.
• Hereby it is achieved that the hearing aid device is capable of prioritising the voice of a specific person among a group of speaking people.
• It is also achieved that the hearing aid device that is capable of automatically prioritising speech from a predefined person or to enhance the speech from the predefined person.
• It may be an advantage that the hearing aid device comprises means for processing a signal (of the forward path), e.g. a signal processing unit, in a predefined manner (in a normal mode of operation) in order to provide attenuation or gain of audio that originates from a person having sound characteristics stored in the hearing aid device or in an external device.
• In an embodiment, comprising a normal mode of operation, the signal of the forward path of the hearing aid device comprises a signal picked up by an input transducer for receiving an acoustic signal from a user's surroundings or a signal received by a receiver for electronically receiving an input audio signal, e.g. from a telephone or a microphone.
• In an embodiment, the hearing aid device comprises an input transducer for receiving an acoustic signal from a user's surroundings and providing a corresponding input audio signal and/or a receiver for electronically receiving an input audio signal, a signal processing circuit for processing the input audio signal and an output means for providing an audible signal to the user in dependence on the processed audio signal, a forward path being defined by the input transducer(s), the signal processing circuit, and the output means, wherein the signal processing unit - (n a normal mode of operation - is configured to process a signal of the forward path in a predefined manner in order to provide attenuation or gain of an input audio signal that originates from a person having sound characteristics stored in the hearing aid device or in an external device.
• It may be beneficial that the hearing aid device comprises means (e.g. a frequency analysis unit) for identifying the fundamental frequency and/or pitch of a person on the basis of the audio from the person.
• Hereby it is possible to identify voice specific characteristics that can be used to identify the voice of a person afterwards.
• It may be advantageous that the hearing aid device (or the external device) comprises means for identifying variations in fundamental frequency or pitch of a person on the basis of the audio from the person.
• In this way it is possible to apply variations in fundamental frequency or pitch as identification parameters when identifying the voice of a person.
• It may be an advantage that the hearing aid device (or the external device) comprises means for identifying the rhythm and/or breathiness and/or the strength of vocal effort of a person on the basis of the audio from the person.
• It may be beneficial that the hearing aid device (or the external device) comprises means for identifying the mean value and/or the standard deviation of the fundamental frequency distribution curve.
• These parameters may be used to establish a more sophisticated picture of the voice of a person and thus a more accurate identification can be achieved afterwards.
• It may be an advantage that the hearing aid device (or the external device) comprises means for analysing the transmitted signals during a phone conversation.
• Hereby it is possible to "train" the hearing aid device in identifying a person during a phone conversation.
• It may be advantageous that the hearing aid device comprises (or the external device) means for storing the sound characteristics of a person and coupling the phone number of the person with the sound characteristics. In an embodiment, the sound characteristics of a person is associated with a tag or label.
• Hereby it is easy to compare the sound characteristic of a person with the data stored in the hearing aid device.
• It may be beneficial that sound characteristics are automatically linked to a person based on the phone number of the person. The phone number may be located from the contact list on the phone.
• It may be an advantage that the hearing aid device (or the external device) comprises means (e.g. an MP3 or MP4 encoder/decoder) for applying the Motion Picture Expert Group (MPEG) standard to encode mixed media data (video, audio, speech).
• Hereby it is possible to allow coding of multiple objects. It is able to manipulate, enhance and prioritise each of a predefined number of objects in a sound scene, separately.
• It may be beneficial that the hearing aid device (or the external device) comprises means for setting at least a subset of the settings of the hearing aid device in dependence of the location of the user of the hearing aid.
• Hereby it is possible to automatically control the hearing aid settings on the basis of the location of the hearing aid user.
• The location of the user may be determined by the position of an external device held by or attached to the user of the hearing aid. This may be done by using a GPS receiver in the external device.
• In this way the settings of a hearing aid device according to an embodiment of the invention may be determined merely on the basis of position data provided by a build-in GPS receiver in the external device or in the hearing aid.
• The settings of a hearing aid device is determined on the basis of position data provided by a GPS receiver in a smartphone and corresponding location dependent set of rules.
• It may be advantageous that the hearing aid device comprises means for communicating with at an external device by means of light or sound.
• Hereby it is possible to establish communication by simple means.
• The light may be light within the visual spectrum or light outside the visible spectrum, e.g. infrared light.
• It may be beneficial that the hearing aid device comprises means for receiving or interfacing to one or more applications (APPs), the one or more applications being e.g. executed on the external device, e.g. a smartphone and/or in the hearing aid device.
• Hereby it is possible to improve/modify the scope of usage of a hearing aid device over time.
• An application may be a feature or function providing a new way of applying or controlling the hearing aid device or treating data received by the hearing aid device.
• By using a hearing aid device according to an embodiment of the invention it may be possible get access to other applications for a specific time, e.g. one week or one month, e.g. for a specific purpose or for testing after which a purchase can be decided. The applications may e.g. be downloaded via the Internet and installed on the hearing aid device and/or the external device.
• In this way, it is possible to update a hearing aid device when required. Over the years, the hearing aid device may be updated to comprise all the applications that the hearing aid user finds useful.
• It may be an advantage that the hearing aid device (or the external device) comprises a sensor member (e.g. a number of individual sensor units) configured to detect a number of predefined parameters.
• Hereby the hearing aid device (or the external device) may detect a parameter that provides useful information about the user of the hearing aid device. Accordingly, this information may be used in the hearing aid device, e.g. immediately or later on, e.g. in order to adjust settings of the hearing aid device.
• The sensor member or unit may comprise means for detecting electromagnetic radiation. The sensor unit may comprise a voice activity detector.
• The sensor unit may be attached to the outside layer of the hearing aid device (e.g. to the outside of the casing of the hearing aid device).
• It may be advantageous that the hearing aid device does not comprise any microphone and that the hearing aid device comprises means for receiving a wirelessly transmitted signal representing audio picked up by one or more microphone(s) of an external device (e.g. a smartphone) transmitting the signal. Further, some of the audiological (user specific) processing of the input audio signal may be performed in the external device before the resulting enhanced signal is transmitted to the hearing aid device (e.g. an (invisible) in-the-canal hearing aid device), thereby saving space and power in the hearing aid device.
• Hereby it is possible to provide a small and compact hearing aid device, e.g. an in-the-canal type hearing aid device.
• In an embodiment, the hearing aid device comprises a microphone unit as well as a wireless receiver unit (e.g. antenna and transceiver circuitry).
• It may be beneficial that the hearing aid device (or the external device) comprises means for recording and storing audio at the hearing aid device or at an external device, where the hearing aid device moreover comprises means for playing the recorded audio.
• Hereby it is possible for the hearing aid user to replaying recorded speech that the hearing aid user did not hear clearly and distinctly.
• It may be beneficial that the hearing aid device comprises means for storing sound characteristics of a person centrally at a predefined location at the Internet and/or at a (dedicated) server.
• Hereby it is possible for several different hearing aid users to store data related to the same person or to different persons centrally. In this way a larger amount of data will be available.
• It may be an advantage that hearing aid device comprises means for continuously recording the last predefined time period, e.g. 15 seconds or more, such as 60 seconds or more.
• It may be beneficial that the hearing aid device comprises means for marking (e.g. tagging or labelling) parts of a recorded sound. Hereafter it is possible to locate the part of a conversation that is marked afterwards. This may be an advantage because it can save the hearing aid user from spending a lot of time trying to locate the part of a conversation that he wants to listen to again.
• It may be advantageous that the hearing aid comprises means for predicting sound that the hearing aid user most likely would like to have repeated (listen to again). These means may include means for locating proper pauses in the speech signal and means for suggesting sentences/words for the hearing aid user.
• Hereby, the hearing aid user will be able to replay a suggested sentence/word on demand.
• It may be an advantage that the hearing aid device comprises or is coupled to an additional device, e.g. the external device, e.g. an audio gateway, a smartphone or other devices capable of recording, storing and playing the recorded soundtrack.
• In a further aspect, a hearing aidsystem is provided. The hearing aid system comprises a hearing aid device and an external device. The hearing aid device comprises means for receiving signals representing audio from a person (e.g. a wireless receiver), where the signals are transmitted from the external device (e.g. a telephone or a microphone) that receives audio from the person, where the hearing aid system comprises means for analysing the transmitted signals (e.g. an analysis unit). The hearing aid system further comprises means for determining a number of predefined sound characteristics of the audio from the person based on the transmitted signals. The hearing aid system comprises means for storing (e.g. a memory) a number of the determined sound characteristics (e.g. a fundamental frequency). The hearing aid device comprises means for identifying when a signal received from the external device comprises audio that originates from a person having sound characteristics stored in the hearing aid system.
• In an embodiment, the hearing aid device comprises an input transducer for receiving an acoustic signal from a user's surroundings and providing a corresponding input audio signal and/or a receiver for electronically receiving an input audio signal, a signal processing circuit for processing the input audio signal and an output means for providing an audible signal to the user in dependence on the processed audio signal, a forward path being defined by the input transducer(s), the signal processing circuit, and the output means, wherein the signal processing unit - in a normal mode of operation - is configured to process a signal of the forward path in a predefined manner in order to provide attenuation or gain of an input audio signal that originates from a person having sound characteristics stored in the hearing aid.
• In an embodiment, the hearing aid device comprises means for processing a signal in a predefined manner in order to provide enhancement or attenuation of audio that originates from a person having sound characteristics stored in the hearing aid system.
• In an embodiment, the hearing aid device and the external device are configured to run an APP allowing a user to control or influence functionality of the hearing aid device or to process or display information related to the hearing aid device. The APP may e.g. be configured to allow a user to identify a currently received audio signal as a signal from a specific person previously identified in the hearing aid system. The APP may e.g. be configured to allow a user to identify a current acoustic environment. The APP may e.g. be configured to allow a user to select times or events (e.g. related to calendar entries, where and how a tinnitus sequence is to be applied to an output signal forwarded to the user).
• In an embodiment, the hearing aid system is configured to enable printing via the external device.
• In a further aspect a wearable device is provided. The wearable device is configured to be fitted to an arm or wrist of a person. The wearable device may comprise a communication unit establishing wireless communication to a hearing aid configured to be placed at or in an ear of the person. The hearing aid may comprise an audio converter for reception of an acoustic signal and conversion of the received acoustic signal into a corresponding electrical audio signal. The hearing aid may comprise a signal processor for processing the electrical audio signal into a processed audio signal so as to compensate a hearing loss of a user of the hearing aid. The hearing aid may comprise a transducer connected to an output of the signal processor for converting the processed audio signal into an output signal. The transducer may be a speaker unit providing an acoustic output or a device providing an electrical output. The wearable device may comprise a transceiver for wireless data communication, wherein the transceiver is connected to an antenna adapted for electromagnetic field emission and electromagnetic field reception. The wearable device may comprise an antenna unit providing wireless communication with the communication device of the wearable device. The wearable device may comprise a processing unit processing data received from the communication unit so as to provide wireless control of the hearing aid. Provision of a wearable device allows the user to gain control of settings of e.g. a hearing aid, or a set of hearing aids or hearing instruments. As sound processing algorithms have some difficulties in detecting sound environments it is an advantage to provide the user with a manual override or setting, e.g. setting of microphone directionality, sound processing settings dealing with reverberation, sound processing dealing with e.g. speech in noisy environments such as parties etc.
• Advantageously a wearable device may further comprise an external communication unit for establishing wireless communication with a mobile phone network, the processing unit may then be adapted to process data so as to establish communication to the hearing aid to provide audio output received from the mobile phone network to the person via the hearing aid. This allows the hearing aid or hearing instrument to be used as an extension of mobile phones functions, e.g. allowing hearing instruments users to use a mobile phone without having the mobile phone placed directly at the ear/cheek.
• The wearable device advantageously comprise a user interface which provides control of setting of the hearing aid, this could be a graphical user interface via a touch display, one or more buttons on the wearable device, voice control or a combination of interfaces.
• A still further aspect relates to a kit comprising wearable device and a hearing aid, wherein the wearable device is configured for being fitted to an arm or wrist of a person. The wearable device may comprise a communication unit establishing wireless communication to a hearing aid configured to be placed at or in an ear of the person. The hearing aid may comprise an audio converter for reception of an acoustic signal and conversion of the received acoustic signal into a corresponding electrical audio signal. The hearing aid may comprise a signal processor for processing the electrical audio signal into a processed audio signal so as to compensate a hearing loss of a user of the hearing aid. The hearing aid may comprise a transducer connected to an output of the signal processor for converting the processed audio signal into an output signal. The hearing aid may comprise a transceiver for wireless data communication, wherein the transceiver may then be connected to an antenna adapted for electromagnetic field emission and electromagnetic field reception. The hearing aid may comprise an antenna unit providing wireless communication with the communication device of the wearable device. The wearable device may a processing unit processing data received from the communication unit so as to provide wireless control of the hearing aid.
• Further, the wearable device may comprise features mentioned throughout the present disclosure, such as input devices and means such as a touch sensitive input device providing touch input to the wearable device. The touch sensitive device may be part of a touch sensitive screen providing a graphical user interface. Providing a wearable device and a hearing aid, or hearing instrument, as a kit is advantageous in that the procurer will not need to match wearable device and hearing aid/instrument. Further, the wearable device and hearing aid/instrument may be pre-programmed to communicate so that they, in this respect at least, work directly out of the box.
• Even further, an aspect relates to a method of controlling settings of a hearing aid via a user interface of a wearable device, wherein the hearing aid comprises:
• an audio converter for reception of an acoustic signal and conversion of the received acoustic signal into a corresponding electrical audio signal,
• a signal processor for processing the electrical audio signal into a processed audio signal so as to compensate a hearing loss of a user of the hearing aid,
• a transducer connected to an output of the signal processor for converting the processed audio signal into an output signal, and
• a transceiver for wireless data communication , wherein the transceiver is connected to an antenna adapted for electromagnetic field emission and electromagnetic field reception,
• an antenna unit providing wireless communication with the communication device of the wearable device,
• the wearable device comprises a communication unit establishing wireless communication to a hearing aid configured to be placed at or in an ear of the person. The method may then comprise the step of displaying, via the user interface, a property of the hearing aid to be set. The method may then comprise the step of receiving via the user interface a value representing a setting of the property to be set. The method may then comprise the step of transmitting the setting via the communication unit from the wearable device to the hearing aid. The method may then comprise the step of applying the setting in the hearing aid for the designated property. The steps are not listed in sequence and may be exchanged or interleaved with other steps.
• Advantageously an external communication unit for establishing wireless communication with a mobile phone network may be provided, the processing unit being adapted to process data so as to establish communication to the hearing aid to provide audio output received from the mobile phone network to the person via the hearing aid. The method may then comprise the step of receiving at the wearable device an incoming call request from a mobile network. The method may then comprise the step of providing a notification the hearing aid of the incoming call request to the user via the wearable device. Notifying the user via the wearable device may further allow the user to accept or reject the call via the wearable device and thus reduce the number of operations needed to handle the call.
• The method may further comprise providing the notification via text displayed on the wearable device and/or via vibration of the wearable device and/or via vibration of the hearing aid, and/or via light at the wearable device.
Description of the Drawings
• The invention will become more fully understood from the detailed description given herein below. The accompanying drawings are given by way of illustration only, and thus, they are not limitative of the present invention. In the accompanying drawings:

Fig. 1

shows a schematic view of a hearing aid user wearing a hearing aid according to an embodiment of the invention and using the hearing aid device during a phone conversation;

Fig. 2

shows a schematic view of the hearing aid user shown inFig. 1 receiving sound inputs from one of several predefined persons;

Fig. 3 a)

shows a schematic view of the steps that can be applied in order to train a hearing aid device according to an embodiment of the invention;

Fig. 3 b)

shows a schematic view of how information from two different hearing aid users talking to the same person can be centrally stored and shared among several users;

Fig. 4

shows a schematic view of one example of how object-based coding can be applied in relation to hearing aid device according to an embodiment of the invention;

Fig. 5 a)

shows an amplitude-time curve;

Fig. 5 b)

shows the fundamental frequency distribution for a male person;

Fig. 5 c)

shows the fundamental frequency distribution for a female person;

Fig. 6 a)

shows a schematic view of how the settings of a hearing aid according to an embodiment of the invention are changed when the hearing aid user is doing sport;

Fig. 6 b)

shows a schematic view of how the settings of a hearing aid according to an embodiment of the invention are changed when the hearing aid user is traveling by bus or train;

Fig. 6 c)

shows a schematic view of how the settings of a hearing aid according to an embodiment of the invention are changed when the hearing aid user is outside walking his dog;

Fig. 7

shows three schematic views of how an external device is communicating with a hearing aid device according to an embodiment of the invention;

Fig. 8

shows a schematic view of additional applications that may be added to a hearing aid device according to an embodiment of the invention;

Fig. 9 a)

shows a schematic view of a hearing aid device according to an embodiment of the invention that is receiving information from an external device;

Fig. 9 b)-d)

show schematic views of a hearing aid device according to an embodiment of the invention that is receiving time dependent information from an external device in the morning (Fig. 9b)), in the afternoon (Fig. 9c)), and at the end of a workday (e.g. during the way back from work) (Fig. 9d));

Fig. 10 a)

shows a schematic view of a person speaking to a hearing aid user wearing a hearing aid device according to an embodiment of the invention;

Fig. 10 b)

shows an example of a recorded soundtrack by using a hearing aid device according to an embodiment of the invention; and

Fig. 11

shows a schematic view of a person speaking to a hearing aid user wearing an in-the-canal hearing aid according to an embodiment of the invention;

Detailed description of the invention
• Referring now in detail to the drawings for the purpose of illustrating preferred embodiments of the present invention, different views of ahearing aid 2 according to an embodiment of the invention is illustrated inFig. 1.
• Fig. 1 is a schematic view of ahearing aid user 4 wearing ahearing aid 2 according to an embodiment of the invention. The hearing aid device is a behind-the-ear (BTE) hearing aid device comprising anear hook 14 that connects the casing with anearmould 12 that has been inserted into theear 18 of thehearing aid user 4.
• Thehearing aid user 4 is using thehearing aid device 2 to have a phone conversation with aperson 6. The phone conversation takes places by using anexternal device 10 in the form of asmartphone 10 that is sendingsignals 16 wirelessly to thehearing aid device 2.
• Thehearing aid user 4 can answer theperson 6 by using thesmartphone 10 on a regular basis by means of the microphone of the smartphone 10 (or alternatively by the microphone(s) of the hearing aid device).
• During the conversation, thehearing aid device 2 detects the sound signals representing the speech of theperson 6. Furthermore, thehearing aid device 2 or thesmartphone 10 comprises means (a speech recogniser, e.g. a frequency analysing unit) for analysing the speech from theperson 6 and means for determining a number ofsound characteristics 8 of theperson 6. In this way the hearing aid device will be able to recognise when theperson 6 is speaking in a future occasion (by comparison of characteristics of a future audio signal comprising speech with stored characteristics of said person 6).
• Thesound characteristics 8 of theperson 6 are stored in thesmartphone 10 or in thehearing aid device 2. In this way, it is possible to give priority to theperson 6 in a later occasion, if desired. Thehearing aid user 4 may select theperson 6 as being "important" (as part of a tag or label) so that theperson 6 will be prioritised in a group of several people talking.
• According to the present disclosure, it is possible to automatically train a speech recogniser during the phone conversation. Since most phones are mainly used by a single person, the phone number may be used for identification of theperson 6. Thesound characteristics 8 of a specific speaker (e.g. person 6) can be trained based on the identification of the phone number e.g. with the purpose of recognising theperson 6 in the future (based on the stored sound characteristics), including conversations that does not involve phones. This has the advantage that the training phase can be 'automatically' performed so that no particular extra training is necessary, thereby saving time.
• Hereby it will be possible to automatically prioritise theperson 6 or to enhance (e.g. by filtering or amplification of specific frequency ranges) the speech of theperson 6 based on the trained data.
• Thesound characteristics data 8 may automatically be linked to theperson 6 based on the phone number, which e.g. is connected to the contact list on thephone 10. Several persons may be trained on the phone during different phone conversations.
• Fig. 2 is a schematic view of thehearing aid user 4 shown inFig. 1 receiving sound inputs from one of several persons, having different (predefined)sound characteristics 8, 8', 8" (here stored in the external device).
• Thehearing aid user 4 wears a pair of BTE (Receiver in the ear, RITE) hearing aid devices 2 (e.g. of a binaural hearing aid system) transmitting sound into the respective ear canals through respective open fittings each comprising a loudspeaker and a flexible dome that are inserted into the respective ear canals. Thehearing aid user 4 receivessignals 16 from anexternal device 10. Theexternal device 10 is amobile phone 10.
• Prior to the shown situation thehearing aid device 2 has been "trained" to recognise theperson 6. Accordingly, thesound characteristics 8 ofperson 6 are stored and available (e.g. stored) in thephone 10. It may be possible to store sound characteristics of persons, animals, or predefined sounds (a door bell signal) in thehearing aid device 2 and/or in an external device (e.g. a smartphone) 10.
• Thesound characteristics 8', 8" of the other two speaking persons have also been detected previously. Accordingly, thesound characteristics 8', 8" of the other two speaking persons are stored and available in either thesmartphone 10 or thehearing aid device 2.
• Therefore, thesmartphone 10 deprioritises the sound input from persons not having available matching characteristics (or deprioritises sound input from personswith available matching characteristics,if such characteristics have been classified (e.g. tagged or labelled) as 'un-interesting'), while thesmartphone 10 provides optimal enhancement of the sound signal of a recognised (not 'negatively tagged')person 6. As a consequence, thehearing aid user 4 can hear theperson 6 clearly and distinctly even though several persons are talking at the same time. Accordingly, the hearing aid according to an embodiment of the invention may be extremely beneficial for thehearing aid user 4 when several persons are talking at the same time.
• Thehearing aid device 2 and/or thesmartphone 10 may comprise means for individually changing the settings including the persons (and/or sounds) to be prioritised.
• Fig. 2 illustrates a situation where thesound characteristics 8 from the audio are picked up by the microphones of the hearing aid or by the microphone of thesmartphone 10. Thesound characteristics 8 are compared to sound characteristics from previously trained phone conversations. Since the voice of theperson 6 is recognised, the hearing aid settings provides optimal enhancement of the recognisedperson 6. A comparison of sound characteristics of a current audio input signal with stored sound characteristics of already recognized voices can e.g. be based on a comparison of a mathematical or statistical distance measure. In an embodiment, a distance measure is determined for each parameter of the sound characteristics. In an embodiment, the fundamental frequencies of a current audio input signal and those of already recognized voices are compared by a regression analysis, e.g. a least squares method. In an embodiment, the comparison comprises a criterion regarding a distance measure, e.g. that a match is detected if the distance measure (DM) is smaller than or equal to a threshold value (DM ≤ DM_th).
• During the fitting process or at home, a hearing care professional (HCP) or a user has the possibility to record specific (VIP) voices considered of special interest to the user. Each voice is characterized by the hearing aid device and the 'fingerprint' (sound characteristics) is saved for future use. During daily use, the hearing aid device constantly analyses the sound environment and compares it with the stored VIP fingerprints to detect if one or more of the VIP voices are present in the sound signal. When this is the case, those voices are given priority (e.g. amplified or the general sound level is raised).
• Alternative or supplemental methods of determining a voice fingerprint may include:
1. 1. dynamic selection and classification of specific voices as having high priority or low priority, e.g. using a directional microphone.
2. 2. training during fitting (e.g. spouse)
3. 3. classification of a specific voice using an APP while the person speaks alone.
4. 4. classification of a specific voice using an APP based on a visual spatial mapping of current speakers/sound sources as high priority or low priority sound sources (for amplification and attenuation, respectively).
• Fig. 3 a) is a schematic view of the steps 22 (A), 24 (B), 26 (C) that can be applied in order to train ahearing aid device 2 or a hearing aid system according to an embodiment of the invention.
• Thetraining process 20 is indicated by means of threeboxes 22, 24, 26 each representing a process step. Thefirst box 22 symbolised with the letter A, contains two steps:
1. a) training the hearing aid device 2 (or the hearing aid system) during phone conversations
   and
2. b) storing thesound characteristics 8 in thehearing aid device 2 or in an external device (e.g. a smartphone) 10.
• Thesecond box 24 symbolised with the letter B, contains the following step:
• c) thesound characteristics 8 of the audio picked up by the microphone(s) of thehearing aid device 2 or by the microphone(s) of the external device (e.g. a smartphone) 10 is compared to storeddata 8, 8', 8" in thehearing aid device 2 or in the external device (e.g. a smartphone) 10.
• Thethird box 2 symbolised with the letter C, contains the following step:
• c) thesound characteristics 8 of the audio picked up by the microphone(s) of thehearing aid device 2 or by the microphone(s) of thesmartphone 10 is compared to storeddata 8 in thehearing aid device 2 or in the external device (e.g. a smartphone 10).
• If the detectedsound characteristics 8 is recognised (matches one of the storedsound characteristics 8, 8', 8"), theperson 6 speaking is prioritised and the hearing aid device signal processing is adapted towards theparticular person 6.
• Fig. 3 b) is a schematic view of how information from two different (first and second) hearingaid users 4, 4' talking to the same person 6 (in a training procedure) can be centrally stored. It is important to underline that the two differenthearing aid users 4, 4' may be talking to theperson 6 at different time periods allthough bothhearing aid users 4, 4' are shown atFig. 3 b).
• The first (and second) hearing aid user 4 (4') is wearing a BTE hearing aid device 2 (2') attached behind theear 18 of the hearing aid user 2 (2'). The sound is transmitted to the ear canal of the hearing aid user 2 (2') through anearmould 12 arranged in the ear canal. The hearing aid device 2 (2') communicates wirelessly with an external device 10 (10') such as a smartphone 10 (10').
• The hearing aid user 4 (4') is having a phone conversation with aperson 6. The phone conversation takes place by means of the smartphone 10 (10') that is sendingsignals 16 wirelessly to the hearing aid device 2 (2'). The speech from theperson 6 is received by the smartphone 10 (10') that wirelessly transmits asignal 16 representative thereof to the hearing aid device 2 (2'). The hearing aid device 2 (2') generates audio that is transmitted to the ear canal of the hearing aid user via theear mould 12.
• During the conversation the hearing aid device 2 (2') and/or the smartphone 10 (10') detects audio from theperson 6. The audio is analysed by the hearing aid device 2 (2') and/or the smartphone 10 (10') and hereby thesound characteristics 8 of theperson 6 are determined.
• Thesound characteristics 8 of theperson 6 are stored locally in the smartphone 10 (10') and/or in the hearing aid device 2 (2'). Thesound characteristics 8 of theperson 6 are also stored centrally at a predefined location on theInternet 30 and/or on a (dedicated)server 28. In this way, it is possible to recognize and/or prioritise theperson 6 later on.
• Accordingly,characteristics 8 of theperson 6 are theperson 6 are provided by both the firsthearing aid device 2 and by the second hearing aid device 2'. In this way the amount of "training data",characteristics 8, can be increased.
• Fig. 4 is a schematic view of one example of how object-based coding can be applied in relation to a hearing aid device 2 (or a hearing aid system) according to an embodiment of the invention.Fig. 4 shows acoding procedure 32 that is suitable of being used when applying ahearing aid device 2 according to an embodiment of the invention.
• Asound scene 42 is shown at the left side ofFig. 4. Thesound scene 42 containsseveral objects 34, 36, 38, 40, 58. Theuser 4 of ahearing aid 2 according to an embodiment of the invention may be allowed to enhance eachobject 34, 36, 38, 40, 58 in asound scene 42 separately, hereby manipulating thewhole sound scene 42.
• Thefirst object 34 is a building, theSupreme Court 34 of the United States of America. Thesound scene 42 covers an event taking place in theSupreme Court 34 of the United States. The event is covered by television (TV) and a journalist reports the event in aTV reportage 36 as indicated in the (upper) left side ofFig. 4. Other comments 38 to the event andmusic 40 are provided as separate sound channels. Acurve 58 showing financial trends, a logo and a picture frame are presented as a separate video scene.
• Thehearing aid device 4 or hearing aid system (e.g. the external device 10) may apply an encoding scheme, e.g. a Motion Picture Expert Group (MPEG) standard that has the ability to encode (compress) media data (video, audio, speech) from each individual sound and/or video scene (34, 36, 38, 40) and to e.g. create a mixed video and sound scene 42 (or 60).
• Thehearing aid device 4 or the hearing aid system may preferably use the so-called "MPEG-4 standard" (MP4) that allows coding ofmultiple objects 34, 36, 38, 40, 58. One way to code different speakers (or other sounds) in a sound scene would be through the MPEG-4 standard. By displaying the different objects (separate speakers, music, babble etc.) 34, 36, 38, 40, 58 from asound scene 42 theuser 4 of thehearing aid device 2 is able to manipulate, enhance and prioritise each of theobjects 34, 36, 38, 40, 58 in thesound scene 42, separately.
• Each of theobjects 34, 36, 38, 40, 58 are coded by means ofcompressors 48, 48', 48", 48"' (e.g. MP4) connected to adelivery interface 50. Thescene descriptor 44 is indicated at the lower left side ofFig. 4. The scene descriptor is compressed by means of acompressor 46 that is connected to thedelivery interface 50.
• Fig. 4 comprises a second delivery interface 50' receiving data (e.g. wirelessly) from thefirst delivery interface 50. The data received by the second delivery interface 50' is decompressed by means ofdecompressors 52, 52', 52", 52" (e.g. MP4) corresponding to theobjects 34, 36, 38, 40, 58, respectively.
• Thedecompressors 52, 52', 52", 52" and thedecompressor 54 send decompressed data to acompositor 56 that generates theoutput multimedia scene 60 on a user interface (e.g. an external device, e.g. a smartphone) of a hearing aid device or a hearing aid system. Theoutput 60 contains the objects 34', 36', 40', 58' mixed corresponding to the manipulation applied to thesound scene 42.
• The "manipulated" objects 34', 36', 40', 58' shown on the user interface includes: a "manipulated" curve 58' showing financial trends presented with corresponding audio, the "manipulated" Supreme Court 34' of the United States feature accompanied by speech and video, the "manipulated" TV reportage 36' with audio and video and the "manipulated" music feature 40'.
• Fig. 5 a) schematically illustrates an amplitude-time curve 66 of a speaking person. Thecurve 66 depictsamplitude 62 versustime 64. It can be seen that the curve contains periodic portions of basically equal time periods T₁, T₂, T₃.
• The fundamental frequency is defined as thelowest frequency 62 of a periodic waveform. Expressed in terms of a superposition of sinusoids (e.g. Fourier series), the fundamental frequency is the lowest frequency sinusoidal in the sum. Human voiced speech of a typical adult male has a fundamental frequency in the range between 85 and 180 Hz. A typical adult female has a fundamental frequency in the range between 165 and 255 Hz. A hearing aid device adapted to a specific type of voice is e.g. described inEP 2 081 405 A1.
• The fundamental frequency, F, can be determined as the inverse of the time periods T₁, T₂, T₃ indicated inFig. 5a). Assuming that T₂ represents the time period it follows that:$$F=\frac{1}{\mathit{Time\; period}}=\frac{1}{{\mathrm{<figure-callout\; label="T"\; filenames="imgf0001.png,imgf0002.png"\; state="\{\{state\}\}">T</figure-callout>}}_2}$$

  
• Thus if T₂ is 10 milliseconds the fundament frequency, F, is given by:$$F=\frac{1}{\mathit{Time\; period}}=\frac{1}{0.01\sec }=100Hz$$

  
• This would correspond to a male voice.
• Fig. 5 b) schematically illustrates a fundamentalfrequency distribution curve 70 for amale person. The fundamentalfrequency distribution curve 70 shows theprobability 68 as function of frequency (measured in Hz). The mean value µ_m as well as the standard deviation σ_m are indicated. Moreover, thefrequency range 74 of the fundamentalfrequency distribution curve 70 is indicated. It is possible to determine the first derivative or the second derivative of a predefined point or portion of the fundamentalfrequency distribution curve 70 and use this as a user specific parameter.
• The above mentioned parameters may be significant for a person and thus, these parameters may be part of thesound characteristics 8 that are stored for a person (as classifiers of the voice of the person in question).
• Fig. 5c) schematically illustrates afundamental frequency distribution 72 for afemale person. The fundamentalfrequency distribution curve 72 depictsprobability 68 as function offrequency 62 like inFig. 5 b). The mean value µ_f and the standard deviation σ_f are shown in the figure. Besides, thefrequency range 76 of the fundamentalfrequency distribution curve 72 is shown.
• When comparingFig. 5 b) and Fig. 5c) it can be seen that the mean value µ_m for the male person is lower than the mean value µ_f for the female person.
• Fig. 6 a) is a schematic view of how the settings of ahearing aid device 2 according to an embodiment of the invention are changed when the hearing aid user is doing sport in asport location 78. Thelocation 78 may be a training ground, a training hall or any suitable location for doing sport.
• Thehearing aid user 4 is wearing ahearing aid device 2. When thehearing aid user 4 arrives to thesport location 78, thesmartphone 10 of thehearing aid user 4 and/or asensor 80 communicates wirelessly with thehearing aid 2. Hereby, thesmartphone 10 and/or thesensor 80 sendssignals 16, 16' to thehearing aid device 4 in order to set the settings of thehearing aid device 4 according to predefined rules or schemes. As long as thehearing aid user 4 stays within thesport location 78, these settings are maintained.
• Thesmartphone 10 may use a build-in GPS (Global Positioning System) receiver to determine the position of theuser 4 of thehearing aid 2. The settings of ahearing aid device 2 according to an embodiment of the invention may be defined in dependence of the position of theuser 4 of thehearing aid 2. In this way the settings of ahearing aid device 2 according to an embodiment of the invention may be determined merely on the basis of position data provided by a build-in GPS receiver (e.g. a GPS receiver of the user's smartphone).
• Fig. 6 b) is a schematic view of how the settings of ahearing aid device 2 according to an embodiment of the invention are changed when the hearing aid user is traveling with bus or train.
• The location 78' may be a bus or a train by way of example. The location may alternatively be the car of thehearing aid user 4. A sensor may be provided in the car of thehearing aid user 4.
• Thehearing aid user 4 is wearing ahearing aid device 2. When thehearing aid user 4 comes into a predefined location (e.g. during the ride home from work) the user'ssmartphone 10 or asensor 80 communicates wirelessly with thehearing aid 2. Thesmartphone 10 or thesensor 80 sendssignals 16, 16' to thehearing aid device 4 and sets the settings of thehearing aid device 4 according to predefined setting rules. As long as thehearing aid user 4 is in the bus or train the settings are maintained.
• When thehearing aid user 4 leaves the bus or the train he is no longer in the location 78' and thus, a new set of predefined setting rules may be applied. The settings of ahearing aid device 2 may be determined on the basis of position data provided by a build-in GPS receiver and corresponding location dependent setting rules.
• Fig. 6 c) is a schematic view of how the settings of ahearing aid 2 according to an embodiment of the invention can be changed when thehearing aid user 4 is outside walking his dog.
• Thehearing aid user 4 is wearing ahearing aid device 2. Thehearing aid user 4 moreover has asmartphone 10 that is configure to communicate wirelessly with thehearing aid 2. The smartphone transmitssignals 16 to thehearing aid device 2 and sets the settings of thehearing aid device 4 according to predefined setting rules.
• The settings of ahearing aid device 2 is determined on the basis ofposition data 78" provided by a GPS receiver in thesmartphone 10 and corresponding location dependent setting rules.
• When thehearing aid user 4 is back from the walk, the position data triggers thesmartphone 10 to sendsignals 16 to thehearing aid device 2 in order to change the settings.
• Other environments may likewise be identified by external sensors and/or environment detection units or the hearing aid device/system and/or a positioning system (e.g. GPS) of the hearing aid device/system and used to apply specific hearing aid settings for the detected environment. Such environments may e.g. include watching TV at home or at a cinema, attending a lecture (church, school, etc.), driving a car. Alternatively or additionally, the external device (e.g. a smartphone) is configured to run an APP allowing a user to indicate which environment he or she is currently in.
• Fig. 7 a) is a schematic view of a BTEhearing aid device 2 according to an embodiment of the invention that communicates with an external device 10 (e.g. a mobile phone 10). The communication may be conducted by means of a wireless technology standard for exchanging data, such as Bluetooth or another suitable (e.g. digital) standard. Anotherexternal device 80 such as asensor 80 may communicate with the hearing aid device 2 (directly or via the smartphone). The communication link between thesensor 80 and thehearing aid device 2 may e.g. be defined by the Bluetooth Low Energy standard. The communication link between themobile phone 10 and thehearing aid device 2 may e.g. be defined by the Bluetooth Low Energy standard (e.g. appropriately modified to include an audio layer).
• The communication may be two-way as indicated inFig. 7 a).Signals 16 are transmitted from thephone 10 and from thesensor 80, while other signals 16' are transmitted from thehearing aid device 2 to thephone 10 and thesensor 80, respectively.
• Fig. 7 b) is a schematic view of another BTEhearing aid device 2 according to an embodiment of the invention. TheBTE hearing aid 2 communicates with amobile phone 10 by means oflight 82. The light may have any suitable frequency (e.g. IR) and intensity. Thehearing aid device 2 comprises a light sensor (not shown) for detecting the transmitted light signals 82.
• Similarly, asensor 80 is sendinglight signals 82 to thehearing aid device 2. The light sensor (not shown) of thehearing aid device 2 receives the transmittedlight 82 and interprets thesignal 82.
• Thehearing aid device 2 may also communicate with thephone 10 and thesensor 80 by means of light 82'. The transmission of light 82' from the hearing aid device to thephone 10 and to thesensor 80, respectively, is indicated onFig. 7 b). The communication may be one-way or two-way.
• Fig. 7 c) illustrates a schematic view of another BTEhearing aid device 2 according to an embodiment of the invention. TheBTE hearing aid 2 communicates with at amobile phone 10 by means ofsound 84 of any suitable frequency (e.g. ultra sound) and intensity. Thehearing aid device 2 comprises a sound sensor (e.g. a microphone) for detecting the transmitted sound signals 84.
• Anexternal sensor 80 is sendssound signals 84 to thehearing aid device 2. The sound sensor (not shown) of thehearing aid device 2 receives the transmittedsound 84 and interprets thesignal 84.
• Thehearing aid device 2 may also communicate with thephone 10 and thesensor 80 by means of sound 84'. The transmission of sound 84' from thehearing aid device 2 to thephone 10 and thesensor 80, respectively, is indicated onFig. 7 c). The communication may be one-way or two-way.
• Fig. 8 illustrates a schematic view of additional applications (comprising e.g. APPs or firmware updates to provide specific further features of the hearing aid device/system) that may be added to ahearing aid device 2 or a hearing aid system according to an embodiment of the invention.Fig. 8 illustrates fiveapplication packages 98 listed next to each other. The highest ranging application package hasnumber 9 and comprises 15applications 86 graphically illustrated in the uppermost box next to the box withnumber 9.
• Below this box, the second highest ranging applicationpackage having number 7 is arranged. It comprises 11applications 86 graphically illustrated in the box next to the box withnumber 7.
• Below this box the third highest ranging application package having number 5 is arranged. It comprises 8applications 86 graphically illustrated in the box next to the box with number 5. The twofirst applications 94, 96 from the right are indicated inFig. 8.
• Below this box the second lowest ranging applicationpackage having number 3 is arranged. It comprises 5 applications graphically illustrated in the box next to the box withnumber 3.
• At the bottom ofFig. 8, the lowest ranging applicationpackage having number 1 is arranged. It comprises 3applications 88, 90, 92 graphically illustrated in the box next to the box withnumber 1.
• If a hearing aid user has ahearing aid device 2 with a specific number of features (e.g. corresponding to application package number 1) the hearing aid user may after a while realise that some of the other applications are useful.
• By using a hearing aid device or a hearing aid system according to an embodiment of the invention it is possible to buy access to other applications for a specific time, e.g. one week or one month for testing and then you may decide whether or not you want the applications or not. The applications may be downloaded via the Internet and installed on the hearing aid device and/or an external device (e.g. a smartphone).
• In this way, it is possible to update your hearing aid device when required. Over the years, the hearing aid device may be updated to comprise all the applications that the hearing aid user finds useful. Accordingly, it is possible to update the hearing aid device to comprise some or all of the applications in anycategory 1, 3, 5, 7 or 9.
• Fig. 9 a) is a schematic view of ahearing aid device 2 according to an embodiment of the invention that is receiving information from anexternal device 10. Theexternal device 10 is asmartphone 10 that sendssignals 16 wirelessly to thehearing aid device 2.
• Thehearing aid device 2 comprises an elongate body member and asensor member 112 configured to detect a number of predefined parameters, e.g. parameters related to the hearing aid user. Thesensor member 112 may comprise means for detecting electromagnetic radiation.
• Thehearing aid device 2 is an in-the-canal hearing aid 2 that has been inserted into theear canal 100 of the hearing aid user. A pull-outstring 104 is attached to the proximal end of the body member of thehearing aid device 2. Adome 102 is attached to a loudspeaker provided in the distal end of the hearing aid device 2 (e.g. to centrally locate the sound outlet in the ear canal).
• Thehearing aid device 2 may receiveinformation 16 from thesmartphone 10 regarding the activity of the hearing aid user, e.g. that the hearing aid user is: a) preparing himself for going to work in the morning (seeFig. 9 b), b) is at work (seeFig. 9 c) or is on his way back from work (seeFig. 9 d). Likewise information from a calendar function in the smartphone may be relied on, e.g. whether the current day is a workday or a holiday, and/or indications of current (planned) activities as reflected by the user's calendar entries (e.g. his private or working activities at a given point in time). In this way thesmartphone 10 may keep the hearing aid device updated with information about the user of the hearing aid. Moreover, this information may be used to adjust a building tinnitus masker. In this way it is possible to add natural or artificial sound into hear(s) of the hearing aid user, in order to suppress or mask tinnitus. A specific tinnitus APP to be executed on the Smartphone may provide a user with an appropriate interface to control the points in time and or the activities where the playback of a tinnitus masking sequence is desirable. Such indication may e.g. be inserted via the calendar, e.g. by adding a 'tinnitus playback' icon to calendar activities, if such playback is desirable. If no playback of tinnitus sequence is desirable, no icon is inserted (or vice versa, whichever is the more convenient for the user). In a preferred embodiment, the user can customize the tinnitus sequence via the tinnitus APP (e.g. by selecting between a number of options via a touch sensitive screen on the smartphone, adjust the output level, e.g. make its level and or the sequence dependent on the current activity or the time of day, etc.). In an embodiment, the control of the tinnitus masker is dependent on one or more sensors, e.g. a movement sensor, e.g. an accelerometer.
• Fig. 9 b) is a schematic view of a BTEhearing aid device 2 according to an embodiment of the invention. Thehearing aid device 2 is receiving timedependent information 16 from an external device 10 (a smartphone 10) at seven o'clock in the morning (indicated by the clock 106). Thesmartphone 10 may have information related to the habit of the user during morning time. Thereby it is possible to change settings in thehearing aid device 2 in order to meet user specific demands e.g. specific processing settings (such as filtering settings or attenuation of specific frequencies, applying a tinnitus masker sequence, playing particular pieces of music, etc.).
• Fig. 9 c) is a schematic view of a BTEhearing aid device 2 receiving timedependent information 16 from asmartphone 10 at 2 o'clock in the afternoon (indicated by the clock 106).
• If the day is a working day, the hearing aid user will probably be at work. Thus, use specific settings may be applied in order to meet user specific requirements (e.g. further specified by the user's calendar entries, if located in or accessible to the smartphone).
• If the day is a holiday, another set of settings may be applied.
• Thesmartphone 10 may be adapted to provide time specific data to thehearing aid device 2 so that different settings can be applied on working days and on holidays by way of example. Similarly, thesmartphone 10 may comprise information (e.g. calendar entries) about specific activities of the user and information about in which time periods the user performs these activities (e.g. sport).
• Fig. 9 d) is a schematic view of a BTEhearing aid device 2 according to an embodiment of the invention. Thehearing aid device 2 receives time dependent information from asmartphone 10 in the same manner as explained with reference toFig. 9 b) and Fig. 9 c), however, the time is five in the afternoon (indicated by the clock 106) and the hearing aid user may be on the way back from work.
• Applying this knowledge, it is possible to use thesmartphone 10 to make sure that the settings of thehearing aid device 2 match the requirement (preferably predefined, e.g. via an APP running on the smartphone) of the hearing aid user.
• Fig. 10 a) is a schematic view of aperson 6 speaking to ahearing aid user 4 wearing ahearing aid 2 according to an embodiment of the invention. Thehearing aid device 2 is a BTE hearing aid device attached behind theear 18 of thehearing aid user 4.
• Speech 16 from the speakingperson 6 is picked up by thehearing aid device 2 and transmitted to the user's ear canal. During the conversation, thehearing aid user 4 may have difficulties to hear theperson 6 clearly and distinctly. Thehearing aid device 2 comprises means for recording the conversation or part of the conversation.
• The hearing aid device 2 (or an external device, e.g. a smartphone, of a hearing aid system) comprises means for playing the recorded conversation or part of the conversation. Hereby it is possible for the hearing aid user to avoid saying: "I beg your pardon", if the hearing aid user misses a sentence or a word from the conversation. Instead, the hearing aid user is able to replay parts of the conversation.
• The hearing aid device (or a hearing aid system) may comprise means for continuously recording the last predefined time period, e.g. 60 seconds.
• Fig. 10 b) illustrates an example of a recordedsoundtrack 110. Thesoundtrack 110 is recorded by using thehearing aid device 2 shown inFig. 10 a) (or by an external device of a hearing aid system). The recordedsoundtrack 110 is depicted as function oftime 64.
• Amarked time period 108 is indicated with dotted lines. Themarked time period 108 corresponds to a time bookmark or a time stamp made by thehearing aid user 4. Hereafter it is possible to locate the part of a conversation that is marked. This may save thehearing aid user 4 from spending a lot of time trying to locate the part of a conversation that he wants to hear again. Such activation of recording and marking of sound bookmarks to ease the finding of relevant segments to repeat may preferably be performed via an external device, e.g. via an APP of a smartphone.
• The hearing aid 2 (or an external device of a hearing aid system) may comprise means for predicting what thehearing aid user 4 would like to have repeated. The means may include a method to locate proper pauses in the speech signal and suggest a sentence/word for thehearing aid user 4. Hereby, thehearing aid user 4 will be able to replay a suggested sentence/word on demand.
• Thehearing aid device 2 or hearing aid system may comprise an additional device, e.g. an audio gateway, a smartphone or other devices capable of recording, storing and playing the recordedsoundtrack 110.
• Thehearing aid device 2 may comprise various signal processing means e.g. means for providing noise suppression. Thehearing aid device 2 or the external device may comprise means for adjusting the suggested sentence e.g. by applying a longer or shorter replay time.
• In an embodiment, the activation of the recording, storing and replay of the audio signal or a part thereof can be performed from the hearing aid device (e.g. using an activation element, e.g. a button) or a from a user interface on the external device, e.g. a smart phone. In an embodiment, the external device comprises various signal processing algorithms to enhance the input audio signal, e.g. level and frequency dependent amplification, noise suppression, etc.
• Fig. 11 is a schematic view of aperson 6 speaking to a hearing aid user wearing an in-the-canal hearing aid 2 according to an embodiment of the invention. Thehearing aid device 2 has an elongated body member and a pull-outstring 104 attached thereto. In the distal end of the body member a loudspeaker (not shown inFig. 11) is provided. Adome 102 is attached to the loudspeaker. Thehearing aid device 2 has been inserted into theear canal 100 of the hearing aid user.
• Thehearing aid device 2 has no integrated microphone. Instead the sound 84 from the speakingperson 6 is detected by the microphone of asmartphone 10. Thesmartphone 10 transmits awireless signal 16 to thehearing aid device 2. The transmittedsignal 16 is detected by thehearing aid device 2 that generates a sound signal that is transmitted to theear drum 114 by means of a loudspeaker covered by adome 102. Hereby it is possible to provide a more simple and compacthearing aid device 2. Omitting the microphone will make it possible to save space and thus bring thehearing aid device 2 deeply into thecanal 10.
• In an embodiment, the hearing aid system is configured to enable printing via an external device, e.g. a smartphone.
• Once the hearing aid device is connected to a smartphone, the smartphone can be used to print information to paper, e.g.:
• via a printer that can be connected to the smartphone directly;
• via a printer connected to a PC that is connected to the smartphone;
• via a printer in the cloud;
• The printing can e.g. be initiated:
• o by an APP on the smartphone;
• o by an application on the PC that is connected to the smartphone;
• o by the hearing aid (e.g. triggered by a push button or remote control action).
• The following data can e.g. be printed:
• All kinds of information that can be printed from the fitting software;
• All kinds of information that can be printed from service software today;
• Some information that is targeted at the end-user (e.g. date of next
• Fig. 12 schematically illustrates ahearing aid 2 and a wearable device in the form of asmartwatch 108 in wireless communication, indicated by thelines 110. Thesmartwatch 108 includes a communication device for establishing wireless communication with thehearing aid 2 to transmit data, including control data and speech data, from thesmartwatch 108 to thehearing aid 2. Thesmartwatch 108 could include a microphone unit for picking up sounds so that a phone conversation may be established utilizing the microphone in thesmartwatch 108 and the receiver in thehearing aid 2. The figure includes asingle hearing aid 2, but thehearing aid 2 could e.g. be part of a binaural hearing aid system where two hearing aid are arranged one at each ear thereby providing sound to each ear of the person. The hearing aid or aids may be of the behind-the-ear type as illustrated, but may also be in-the-ear, completely-in-the-ear, bone anchored or implanted, i.e. comprise a cochlear implant part.
• The wearable device may be provided to a user as part of a kit along with one or two hearing aids.
• The wearable device provides a graphical interface via a touch sensitive screen allowing the user, via use of a specific application executed on the wearable device, to control certain or all settings of the hearing aid; this may include selecting a pre-defined scheme of settings and/or individual settings. This could include settings or schemes optimizing the hearing aid performance in specific situations, e.g. parties, rooms with reverberance and the like, or allowing the person to modify e.g. amplification level. The use of a wearable device, especially as a smartwatch, allows the person to, in an unobtrusive way, modify settings of the hearing aid without requiring the user to locate a button or wheel on the hearing aid while in the company of others. The user is allowed to optimise performance using his or her device preferably located on the wrist or in a pocket.
• The wearable device may in some cases be used as bridge between the hearing aid and a mobile phone. This bridge could be achieved by using Bluetooth Low Energy between the hearing aid and the Wearable device and Bluetooth from the wearable device and a mobile phone.
• In embodiment where the wearable device include mobile phone access, i.e. the wearable device may be used for establishing a telephone conversation using one or more hearing aids or hearing instruments as speaker unit for the conversation and/or microphone. In this way, the user receives the sounds with the appropriate sound processing specific for his or her hearing loss.
• The wearable device also includes appropriate power source, such as a rechargeable battery, data storage and one or more processors, e.g. for rendering graphics and/or identifying touch input and other data processing.
• The data processing power of the wearable device may be used for alleviating processing in one or both hearing aids.
• The invention is defined by the features of the independent claim(s). Preferred embodiments are defined in the dependent claims. Any reference numerals in the claims are intended to be non-limiting for their scope.
• Some preferred embodiments have been shown in the foregoing, but it should be stressed that the invention is not limited to these, but may be embodied in other ways within the subject-matter defined in the following claims and equivalents thereof.
• The present invention may also be characterized by the following items:Items
1. 1. A hearing aid device (2) comprising means for receiving signals (16) representing audio from a person (6), where the signals (16) are transmitted from an external device (10, 10') that receives audio from the person (6), where the hearing aid device (2) comprises means for analysing the transmitted signals (16), where the hearing aid device (2) further comprises means for determining a number of predefined sound characteristics (8, 8', 8") of the audio from the person (6) based on the transmitted signals (16),characterised in that the hearing aid device (2) comprises means for storing a number the determined sound characteristics (8, 8', 8") either in the hearing aid device or in an external device (10, 10') and that the hearing aid device (2) comprises means for identifying when a signal (16) received from the external device (10, 10') comprises audio that originates from a person (6) having sound characteristics (8, 8', 8") stored in the hearing aid device or in an external device (10, 10').
2. 2. A hearing aid device (2) according toitem 1,characterised in that the hearing aid device (2) comprises means for processing a signal (16) in a predefined manner in order to provide enhancement of audio that originates from a person (6) having sound characteristics (8, 8', 8") stored in the hearing aid device or in an external device (10, 10').
3. 3. A hearing aid device (2) according toitem 1,characterised in that the hearing aid device (2) comprises means for processing a signal (16) in a predefined manner in order to provide attenuation of audio that originates from a person (6) having sound characteristics (8, 8', 8") stored in the hearing aid device or in an external device (10, 10').
4. 4. A hearing aid device (2) according toitem 1,characterised in that the hearing aid device (2) comprises means for identifying the fundamental frequency (F) and/or pitch of a voice of a person (6) on the basis of the audio from the person (6).
5. 5. A hearing aid device (2) according toitem 1,characterised in that the hearing aid device (2) comprises means for identifying variations in fundamental frequency or pitch of a voice of a person (6) on the basis of the audio from the person (6).
6. 6. A hearing aid device (2) according to one of the preceding items,characterised in that the hearing aid device (2) comprises means for analysing the transmitted signals (16) during a phone conversation.
7. 7. A hearing aid device (2) according toitem 6,characterised in that the hearing aid device (2) comprises means for storing the sound characteristics (8, 8', 8") of a person (6) and coupling the phone number of the person (6) with the sound characteristics (8, 8', 8").
8. 8. A hearing aid device (2) according to any one of the preceding items comprising an input transducer for receiving an acoustic signal from a user's surroundings and providing a corresponding input audio signal and/or a receiver for electronically receiving an input audio signal, a signal processing circuit for processing the input audio signal and an output means for providing an audible signal to the user in dependence on the processed audio signal, a forward path being defined by the input transducer(s), the signal processing circuit, and the output means, wherein the signal processing unit - in a normal mode of operation - is configured to process a signal of the forward path in a predefined manner in order to provide attenuation or gain of an input audio signal that originates from a person having sound characteristics stored in the hearing aid device or in an external device.
9. 9. A hearing aid device (2) according to one of the preceding items,characterised in that the hearing aid device (2) comprises means for setting at least a subset of the settings of the hearing aid device (2) in dependence of the location of the user (4) of the hearing aid (2).
10. 10. A hearing aid device (2) according to one of the preceding items,characterised in that the hearing aid device (2) comprises means for communicating with an external device (10) by means of light (82, 82') or sound (84, 84').
11. 11. A hearing aid device (2) according to one of the preceding items,characterised in that the hearing aid device (2) comprises means for receiving additional applications (86, 88, 90, 92, 94, 96).
12. 12. A hearing aid device (2) according to one of the preceding items,characterised in that the hearing aid device (2) comprises a sensor member (112) configured to detect a number of predefined parameters.
13. 13. A hearing aid device (2) according to one of the preceding items,characterised in that the hearing aid device (2) does not comprise any microphone and that the hearing aid device (2) comprises means for receiving a wirelessly transmitted signal (16) representing audio picked up by one or more microphone(s) of an external device (10, 10') transmitting the signal (16).
14. 14. A hearing aid device (2) according to one of the preceding items,characterised in that the hearing aid device (2) comprises means for recording and storing audio at the hearing aid device (2) or at an external device (10, 10'), where the hearing aid device (2) moreover comprises means for playing the recorded audio.
15. 15. A hearing aid device (2) according to one of the preceding items,characterised in that the hearing aid device (2) comprises means for storing sound characteristics (8) of a person (6) centrally at a predefined location at the Internet (30) and/or at a (dedicated) server (28).
16. 16. A hearing aid device system (2, 10) comprising a hearing aid device (2) and an external device, wherein the hearing aid device (2) comprises means for receiving signals (16) representing audio from a person (6), where the signals (16) are transmitted from the external device (10) that receives audio from the person (6), where the hearing aid system (2, 10) comprises means for analysing the transmitted signals (16), where the hearing aid system (2, 10) further comprises means for determining a number of predefined sound characteristics (8, 8', 8") of the audio from the person (6) based on the transmitted signals (16),characterised in that the hearing aid system (2, 10) comprises means for storing a number of the determined sound characteristics (8, 8', 8") and that the hearing aid device (2) comprises means for identifying when a signal (16) received from the external device (10, 10') comprises audio that originates from a person (6) having sound characteristics (8, 8', 8") stored in the hearing aid system (2, 10).
17. 17. A hearing aid system (2, 10) according toitem 16,wherein the hearing aid device (2) comprises means for processing a signal in a predefined manner in order to provide enhancement or attenuation of audio that originates from a person (6) having sound characteristics (8, 8', 8") stored in the hearing aid system (2, 10).
18. 18. A hearing aid system (2, 10) according toitem 16 or 17 wherein the hearing aid device and the external device are configured to run an APP allowing a user to control or influence functionality of the hearing aid device or to process or display information related to the hearing aid device.
19. 19. A hearing aid system (2, 10) according to any one of items 16-18 configured to enable printing via the external device.
List of reference numerals

2, 2'

- Hearing aid device

4, 4'

- Hearing aid user

6

- Person

8, 8', 8"

- Sound characteristics

10, 10'

- External device

12

- Earmould

14

- Ear hook

16

- Signal

18

- Ear

20

- Process

22, 24, 26

- Step

28

- Server

30

- Internet

32

- Coding procedure

34, 34'

- Building

36, 36'

- TV reportage

38

- Interview

40, 40'

- Music

42

- Sound scene

44

- Scene descriptor

46

- Compressor

48, 48', 48", 48"'

- Compressor

50, 50'

- Delivery interface

52, 52', 52", 52'"

- Decompressor

54

- Decompressor

56

- Compositor

58, 58'

- Curve

60

- Output

62

- Frequency

64

- Time

66

- Curve

68

- Probability

T₁, T₂, T₃

- Time period

µ_f, µ_m

- Mean value

σ_f, σ_m

- Standard deviation

F

- Fundamental frequency

70

- Male curve

72

- Female curve

74, 76

- Range

78, 78', 78"

- Location

80

- Sensor

82, 82'

- Light

84, 84'

- Sound

86, 88, 90

- Application

92, 94, 96

- Application

98

- Application package

100

- Ear canal

102

- Dome

104

- Pull-out string

106

- Clock

108

- Marked time period

110

- Soundtrack

112

- Sensor member

114

- Ear drum

Claims (7)

1. A wearable device configured to be fitted to an arm or wrist of a person, the wearable device comprising:

   - a communication unit establishing wireless communication to a hearing aid configured to be placed at or in an ear of the person,
   the hearing aid comprising:

   an audio converter for reception of an acoustic signal and conversion of the received acoustic signal into a corresponding electrical audio signal,

   a signal processor for processing the electrical audio signal into a processed audio signal so as to compensate a hearing loss of a user of the hearing aid,

   a transducer connected to an output of the signal processor for converting the processed audio signal into an output signal, and

   a transceiver for wireless data communication , wherein the transceiver is connected to an antenna adapted for electromagnetic field emission and electromagnetic field reception,

   an antenna unit providing wireless communication with the communication device of the wearable device,

   - a processing unit processing data received from the communication unit so as to provide wireless control of the hearing aid.
2. The wearable device according to claim 1, further comprising an external communication unit for establishing wireless communication with a mobile phone network, the processing unit being adapted to process data so as to establish communication to the hearing aid to provide audio output received from the mobile phone network to the person via the hearing aid.
3. The wearable device according to claim 1 or 2, wherein a user interface provides control of setting of the hearing aid.
4. A kit comprising wearable device and a hearing aid, wherein the wearable device is configured for being fitted to an arm or wrist of a person, the wearable device comprising:

   - a communication unit establishing wireless communication to a hearing aid configured to be placed at or in an ear of the person,
   the hearing aid comprising:

   an audio converter for reception of an acoustic signal and conversion of the received acoustic signal into a corresponding electrical audio signal,

   a signal processor for processing the electrical audio signal into a processed audio signal so as to compensate a hearing loss of a user of the hearing aid,

   a transducer connected to an output of the signal processor for converting the processed audio signal into an output signal, and

   a transceiver for wireless data communication , wherein the transceiver is connected to an antenna adapted for electromagnetic field emission and electromagnetic field reception,

   an antenna unit providing wireless communication with the communication device of the wearable device,

   - a processing unit processing data received from the communication unit so as to provide wireless control of the hearing aid.
5. A method of controlling settings of a hearing aid via a user interface of a wearable device, wherein the hearing aid comprises:

   an audio converter for reception of an acoustic signal and conversion of the received acoustic signal into a corresponding electrical audio signal,

   a signal processor for processing the electrical audio signal into a processed audio signal so as to compensate a hearing loss of a user of the hearing aid,

   a transducer connected to an output of the signal processor for converting the processed audio signal into an output signal, and

   a transceiver for wireless data communication , wherein the transceiver is connected to an antenna adapted for electromagnetic field emission and electromagnetic field reception,

   an antenna unit providing wireless communication with the communication device of the wearable device,

   the wearable device comprises a communication unit establishing wireless communication to a hearing aid configured to be placed at or in an ear of the person, the method comprising:

   displaying, via the user interface, a property of the hearing aid to be set,

   receiving via the user interface a value representing a setting of the property to be set,

   transmitting the setting via the communication unit from the wearable device to the hearing aid, and

   applying the setting in the hearing aid for the designated property.
6. The method according to claim 5, wherein the comprising an external communication unit for establishing wireless communication with a mobile phone network, the processing unit being adapted to process data so as to establish communication to the hearing aid to provide audio output received from the mobile phone network to the person via the hearing aid, the method further comprising:

   receiving at the wearable device an incoming call request from a mobile network,

   providing a notification the hearing aid of the incoming call request to the user via the wearable device.
7. The method according to claim 6, further comprising:

   providing the notification via text displayed on the wearable device and/or via vibration of the wearable device and/or via vibration of the the hearing aid, and/or via light at the wearable device.

Images