Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, it is an object of the present invention to provide a cochlear implant speech processing apparatus, a mobile terminal, and a cochlear implant, which solve the above-mentioned problems in the prior art.
In order to achieve the above objects and other related objects, the present invention provides a cochlear implant speech processing apparatus, which is mounted on a mobile terminal communicatively connected to a cochlear implant transmitter module; wherein the cochlear implant transmitting module is in communication connection with a cochlear implant; the device comprises: the sound collection module is used for enabling a pickup component of the mobile terminal to collect sound information; the sound processing module is connected with the sound acquisition module and is used for carrying out noise reduction processing and speech strategy coding processing on the sound information acquired by the sound acquisition module and/or generating parameter information for the artificial cochlea implant to work; and the information transmission module is connected with the sound processing module and used for enabling the communication component of the mobile terminal to send the information output by the sound processing module to the cochlear implant emission module so that the cochlear implant emission module can send the information to the cochlear implant.
In an embodiment of the invention, the communication component and the cochlear implant emission module respectively comprise bluetooth; the information transmission module enables the mobile terminal to send the information output by the sound processing module to the cochlear implant emission module through Bluetooth.
In an embodiment of the present invention, the causing, by the information transmission module, the communication component of the mobile terminal to send the information output by the sound processing module to the cochlear implant launching module further includes: and adopting the unique identification code of the cochlear implant as a communication key.
In an embodiment of the present invention, the apparatus further includes: the entertainment audio module and/or the communication module are/is respectively connected with the sound processing module; the entertainment audio module is used for acquiring local entertainment audio information of the mobile terminal and/or entertainment audio information acquired by the mobile terminal through a network; the call module is used for acquiring conversation information generated when a user calls through the mobile terminal; the sound processing module is further used for performing noise reduction processing and speech strategy coding processing on the sound information acquired by the entertainment audio module and/or the communication module, and/or generating parameter information for the cochlear implant to work.
In an embodiment of the present invention, the apparatus further includes: the voice training module is connected with the information transmission module and used for converting voice frequency information of the voice training materials into electric signals; the information transmission module is further used for enabling the communication component of the mobile terminal to send the electric signal to the cochlear implant emission module so that the cochlear implant can stimulate auditory nerve fibers of a patient with the electric signal after receiving the electric signal.
In an embodiment of the present invention, the cochlear implant delivery module includes a battery; the device further comprises: the electric quantity counting module is connected with the information transmission module; the information transmission module is also used for receiving battery power information sent by the cochlear implant emission module; and the electric quantity counting module is used for analyzing the battery electric quantity information so as to enable the mobile terminal to display the use state of the current electric quantity and prompt when the electric quantity is insufficient.
In an embodiment of the present invention, the apparatus further includes: one or more combinations of a monitoring module, a remote dispatching module, a fault detection module, a loss prevention module and an online customer service module; the monitoring module is used for detecting whether the functions of pickup components of the mobile terminal are normal or not; the remote call-tuning module is used for enabling the mobile terminal to be in network connection with a service background and obtaining a remote online call-tuning service of the service background through a camera of the mobile terminal; the fault detection module, the loss prevention module and the online customer service module are used for enabling the mobile terminal to be connected with a service background through a network, so that the fault detection service, the loss prevention service and the online customer service provided by the service background are obtained.
To achieve the above and other related objects, the present invention provides a mobile terminal including: a cochlear implant speech processing apparatus as claimed in any of the above.
In an embodiment of the present invention, the mobile terminal is in communication connection with the wireless intelligent wearable adapter to receive wireless remote control of the wireless intelligent wearable adapter and/or receive an audio signal sent by the wireless intelligent wearable adapter.
To achieve the above and other related objects, the present invention provides a cochlear implant, comprising: the artificial cochlea comprises an implant, a transmitting module and the artificial cochlea voice processing device; the transmitting module includes: the artificial cochlea speech processing device comprises an RF module used for communicating with an implant and a Bluetooth module used for communicating with a mobile terminal carrying the artificial cochlea speech processing device.
In an embodiment of the present invention, the transmitting module is further in communication connection with the wireless intelligent wearable adapter through the bluetooth module to receive wireless remote control of the wireless intelligent wearable adapter.
As described above, according to the cochlear implant speech processing device, the mobile terminal and the cochlear implant of the present invention, by designing the cochlear implant speech processing device installed on the mobile terminal, the mobile terminal can completely replace the existing cochlear implant speech processor in terms of functions, thereby omitting the dorsum auricular machine structure and the transmission cable structure of the existing cochlear implant, only the transmission module is reserved for the external part of the cochlear implant, and the original MIC, the noise reduction module, the speech coding and other modules are all completed by the cochlear implant speech processing device in the mobile terminal, thereby greatly improving the user experience while saving the cost.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
As shown in fig. 4, the present invention provides a novel cochlear implant system architecture, which enables a mobile terminal (such as a smart phone, a tablet computer, a smart watch, etc.) to completely replace the existing cochlear implant speech processor in terms of functions, thereby omitting the structure of the dorsum auricular unit and the structure of the transmission cable of the existing cochlear implant, and only retaining the transmission module in the external structure, and the MIC, the noise reduction module, the speech coding module, etc. in the external structure are all completed by the cochlear implant speech processing device in the mobile terminal, thereby greatly improving the user experience while saving the cost. Furthermore, the cochlear implant system architecture of the present invention may further incorporate a wireless intelligent wearable adapter (such as a smart watch, etc.), so that the wireless intelligent wearable adapter can wirelessly remotely control the mobile terminal and the cochlear implant emission module in the cochlear implant system architecture, thereby expanding the functional range of the cochlear implant system architecture.
As shown in fig. 5, the cochlear implant system architecture of the present embodiment includes three parts: the mobile terminal, the cochlear implant emission module and the cochlear implant. Besides MIC and Bluetooth modules, the mobile terminal is also provided with an artificial cochlea speech processing device (APP). The cochlear implant emission module is internally provided with a Bluetooth module, an RF power module (an RF power integrated circuit, an RF antenna and the like) and a battery module, wherein the Bluetooth module is used for realizing communication (the communication distance is adjustable and the range is 0.5-15 meters) with a mobile terminal, the RF power module is used for realizing communication with the cochlear implant, and the battery module is used for supplying power to the cochlear implant emission module. Since the present embodiment does not improve the structure of the cochlear implant, it will not be described in detail.
The following describes the structure of the cochlear implant speech processing device mounted on the mobile terminal and the operation principle thereof in detail by an embodiment.
Referring to fig. 6, the cochlear implant speech processing apparatus of the present embodiment includes: the voice acquisition module, the voice processing module and the information transmission module. The sound acquisition module is used for enabling the MIC of the mobile terminal to acquire sound information; the sound processing module is used for carrying out noise reduction processing and speech strategy coding processing on the sound information acquired by the sound acquisition module so as to generate parameter information for the artificial cochlea implant to work; the information transmission module is used for enabling the Bluetooth module of the mobile terminal to send the parameter information to the cochlear implant emission module so that the cochlear implant emission module can send the parameter information to the cochlear implant. Optionally, in the information transmission process between the information transmission module and the cochlear implant transmission module, the unique identification code of the cochlear implant is used as a communication key, so that the communication security is improved.
In another embodiment, the cochlear implant speech processing apparatus further includes: the entertainment audio module and the communication module are respectively connected with the sound processing module. The entertainment audio module is used for acquiring local entertainment audio information of the mobile terminal, acquiring entertainment audio information acquired by the mobile terminal through a network and the like. The call module is used for acquiring the conversation information generated when the user calls through the mobile terminal. At this time, the sound processing module is further configured to perform noise reduction processing and speech strategy coding processing on the sound information acquired by the entertainment audio module and the communication module, so as to generate parameter information for the cochlear implant to work.
In another embodiment, the cochlear implant speech processing apparatus further includes: and a language training module. The language training module is connected with the information transmission module and used for converting the audio information of the language training materials into electric signals. At this time, the information transmission module is further configured to enable the bluetooth module of the mobile terminal to send the electrical signal to the cochlear implant emission module, so that the cochlear implant can stimulate auditory nerve fibers of the patient with the electrical signal after receiving the electrical signal.
In another embodiment, the cochlear implant speech processing apparatus further includes: and an electric quantity counting module. And the electric quantity counting module is connected with the information transmission module. And when the cochlear implant emission module sends the battery power information, the information transmission module receives the battery power information. At the moment, the electric quantity counting module is used for analyzing the electric quantity information of the battery so as to enable the mobile terminal to display the use state of the current electric quantity, and prompt, alarm and the like are carried out when the electric quantity is insufficient.
In another embodiment, the cochlear implant speech processing apparatus further includes: one or more combinations of a monitoring module, a remote dispatching module, a fault detection module, a loss prevention module and an online customer service module. In detail: the monitoring module is used for detecting whether the functions of pickup components of the mobile terminal are normal or not; the remote call-tuning module is used for enabling the mobile terminal to be in network connection with a service background and obtaining a remote online call-tuning service of the service background through a camera of the mobile terminal; the fault detection module is used for enabling the mobile terminal to be in network connection with a service background so as to obtain fault detection service provided by the service background; the loss prevention module is used for enabling the mobile terminal to be in network connection with a service background so as to obtain loss prevention service provided by the service background; and the online customer service module is used for enabling the mobile terminal to be connected with a service background through a network so as to obtain the online customer service provided by the service background.
In the embodiment shown in fig. 7, the cochlear implant system architecture proposed by the present invention further includes a wireless intelligent wearable adapter, which at least includes: the Bluetooth module, the power module and the remote control module are used for establishing communication connection with the mobile terminal in the embodiment through Bluetooth or establishing communication connection with the cochlear implant emission module in the embodiment so as to carry out wireless remote control on the mobile terminal and the cochlear implant emission module. In other embodiments, the wireless intelligent wearable adapter sends the collected external audio signal to the mobile terminal so as to be utilized by the mobile terminal. Besides, the wireless intelligent wearable adapter may further include a built-in microphone, an FM module, an audio connector, and the like, which are not listed here.
It should be noted that, the cochlear implant system architecture in the foregoing embodiment adopts a bluetooth mode to implement communication connection between the mobile terminal and the cochlear implant transmitter module, but the invention is not limited thereto. Those skilled in the art can completely replace the GPRS module, the WIFI module, etc., and it should be understood that such a replacement is also within the scope of the present invention.
In summary, the cochlear implant speech processing apparatus, the mobile terminal, and the cochlear implant of the present invention have the following features:
1. the advanced technology of the mobile terminal and the flexible development technology of the APP are fully utilized, the hardware system of the artificial cochlear outer machine is simplified, a special integrated circuit of algorithms such as speech strategies is omitted, an otoback machine is omitted, the miniaturization and invisibility of the artificial cochlear outer machine are realized, and the wearing convenience is brought to users.
2. The noise reduction technology of the voice processor is simplified, so that software and hardware of an original noise reduction processing module are completely replaced by APP of the mobile terminal.
3. And no special integrated circuit with a coding strategy exists, so that the power consumption of the artificial cochlear outer machine is greatly reduced.
4. Greatly expand the function of artifical cochlea for artifical cochlea is more intelligent, has got rid of the problem of the function singleness of original artifical cochlea, from this point on, user's diversified demand realizes more easily, includes: the voice quality can be greatly improved by the voice training function, the entertainment audio, the mobile phone and the like.
5. The system is simple, the hardware system cost, the hardware cost of the communication cable, the maintenance cost and the like are reduced, and the use cost of a patient is also reduced.
6. The original artificial cochlea speech processor is replaced by the APP, so that the speech strategy algorithm is more convenient to upgrade.
7. Realize monitoring function, transmitting coil battery's electric quantity demonstration, suggestion, warning through APP, can utilize mobile terminal's screen to carry out the visual expression of state.
8. The cochlear implant system can also realize fault detection and code notification, including the implant and the external transmitting coil part, and the on-line automatic feedback submission of fault information and the like.
9. Can realize long-range accent quick-witted function through APP to utilize the mobile terminal camera to carry out long-range online accent machine.
10. An online customer service system can be realized through APP.
Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.