Specific implementation mode
This disclosure relates to the system for carrying out speech capture via nose vibration-sensing.It may by the system that user wearsElectronic signal can be generated by user's nose sense vibrations, based on the vibration sensed and be based on the electricity when user talksSubsignal generates voice data.By this method, the system can capture user speech for for example dictating, telephone communication etc., togetherWhen also filter out external noise (for example, natural sound rejection characteristic based on mankind's skull).Example system may include wearableFrame (for example, frame), is equipped with equipment and at least one sensor on the frame.At least one sensor can senseIt vibration in user's nose and the vibration can be based on generates electronic signal.Equipment can receive e-mail from least one sensorNumber and based on the electronic signal generate voice data.Other features may include for example the case where to cannot wherein sense vibrationCompensation, the sound based on received audio data generate for such as telephone communication etc..
In at least one embodiment, frame can be included at least for capturing the example system of user speech, be installed to thisAt least one sensor of frame and the equipment for being installed to the frame.The frame can be dressed by user.At leastOne sensor can be used for generating electronic signal based on the vibration sensed in user's nose when user speaks.EquipmentIt can be used at least receiving electronic signal from least one sensor and handle the electronic signal to generate voice data.
Frame can be used for glasses.In this example implementation, at least one sensor can be incorporated into that at least one nose of glassesIn roof beam structure.Two sensors may also be embedded into the both sides of the nose-bridge frame.For example, the two sensors can be coupled in seriesAnd equipment is for receiving the combination electronic signal generated by the two sensors.Alternatively, equipment can be used for select processing fromThe electronic signal that a sensor in the two sensors generates.
At least one sensor may include piezoelectric diaphragm, for generating electronic signal.Equipment can include at least control circuit,For generating voice data from electronic signal.The control circuit can also be used to determine whether voice data includes local command, andAnd if it is determined that include local command, then based at least one activity of local command execution.Equipment may further comprise at least communicationCircuit, for voice data to be sent to external equipment；And user interface circuit is included at least, for running user and systemInteraction.In at least one embodiment, user interface circuit is used for based on the audio received from external equipment via telecommunication circuitData generate sound.According to the disclosure, the exemplary method for capturing voice data from user may include activating wearable systemIt is generated to the sensing of nose vibration, using the vibration of at least one of wearable system sensor sensing nose, based on nose vibration in systemElectronic signal and based on the electronic signal generate voice data.
Fig. 1 is exemplified according at least one embodiment of the disclosure for carrying out speech capture via nose vibration-sensingExample system 100.Although specific implementation (for example, in glasses) and/or technology will be used (for example, piezoelectric transducer, indigo plant hereinTooth wireless communication etc.) example, but these examples are only rendered for providing understandable visual angle, are therefrom appreciated that this paper institutesThe equipment more typically changed, system, method for instructing etc..Other applications, configuration, technology etc. can generate and religion presented hereinLead the realization being consistent.
System 100 may include frame 102, the 104 (example of mountable device 106 and at least one sensor on the frame 102Such as, hereinafter referred to as " sensor 104 ")." installation " may include sensor 104 and equipment 106 via mechanical attachment (for example, spiral shellNail, nail or other fasteners), adhesive attachment (for example, glue, epoxy resin etc.) is attached to frame 102 or is incorporated into frameIn 102 structure.Frame 102 is disclosed as a pair of glasses, this is merely to be easy to for the sake of explanation.Glasses form suitable basePlinth, on this basis, it can be achieved that according to the various features of the disclosure.Further, since glasses, sunglasses, safety glasses etc. areBy the daily wearing of people, therefore this also means that using the technology almost without obstacle.User is not needed to be worn or carried by only speciallyAdditional equipment for speech capture.Although the glasses of type mentioned above provide aforementioned advantages, religion disclosed hereinLead alternatively that the factor embodies in different shapes, these form factors include such as touching or at least adjacent to nose simultaneouslyAnd any structure for the platform that various systems described herein, equipment, component may be potentially acted as etc..
Sensor 104 may include vibration-sensing circuit.In at least one embodiment, which may include for example allSuch as the piezoelectric element of diaphragm etc.Vibration (for example, mechanical pressure ripple) can be converted into electronic signal by piezoelectric diaphragm.According to this public affairsOpen, the vibration-sensing circuit in sensor 104 can with wear frame 102 user nasal contact or be at least adjacent to wearingThe nose of the user of frame 102.For example, the bridge of the nose of user is bone, when user talks, the bridge of the nose will produce sympathetic response.Sensor104 can detect and be vibrated caused by the nasal bone empathized with user speech, and by the vibration sensed be converted intoIt is provided to the electronic signal of equipment 106 afterwards.
Equipment 106 can be configured to the activity in execution system 100, such as from the e-mail generated by sensor 104Number voice data is generated, which is sent to external equipment 116, audio data is received from external equipment 116, is based on instituteAudio data is received to generate sound, mark and handle local command etc..Equipment 106 may include such as control circuit 108, communication electricityRoad 110, user interface 112 and power circuit 114.Control circuit 108 can include at least data processing resources and memory resource.Data processing resources may include for example positioned at one or more of separated component processor, or alternatively be embodied in groupOne or more process cores and any processor associated support circuitry (example of (for example, in system on chip (SOC) configuration) in partSuch as, bridge interface etc.).Example processor may include but be not limited to, from various micro- based on x86 that can be obtained from Intel companyReason device (including PentiumTo strongAnthemCeleronIt insultsIt is dynamicQuarkMicroprocessor those of in Duo (Core) i series of products family), advanced RISC(for example, reduced instruction set computing) machine or " ARM " processor, etc..The example of support circuits may include for providing interfaceChipset (for example, north bridge, the south bridge etc. that can be obtained from Intel company), by this interface, data processing resources can withIn equipment 106 may just at different rates, the other systems component of the operations such as on different buses interacts.Usually withSome or all of associated function of support circuits also be included in physical package identical with processor (for example,Such as in Sandy Bridge (Sha Qiao) processor family that can be obtained from Intel company).
Data processing resources can be configured to execute the various instructions in equipment 106.Instruction may include program code, instituteProgram code is stated to be configured to that data processing resources is made to execute and read data, write-in data, processing data, formulate data, conversionThe relevant activities such as data, transformation data.Information (for example, instruction, data etc.) can be stored in memory resource.MemoryResource may include the random access memory (RAM) or read-only memory (ROM) of fixed or removable format.RAM may include byIt is configured to keep the nonvolatile memory of information, such as, static RAM (SRAM) or dynamic during the operation of equipment 106State RAM (DRAM).ROM may include configuring to provide the non-volatile of instruction when equipment 106 is activated based on BIOS, UEFI etc.Property (NV) memory circuit, such as programmable storage of electrically programmable ROM (EPROM) etc, flash memory, etc..Other are fixedFormula/removable memory may include but be not limited to：Magnetic memory (such as, floppy disk, hard disk drive etc.), electronic memory(such as, solid state flash memory (for example, embedded multi-media card (eMMC) etc.)), removable memory card or stick are (for example, micro- storage is setStandby (uSD), USB etc.)), optical memory (such as, the ROM based on compact-disc (CD-ROM), digital video disc (DVD), Blu-ray disc)Etc..
The communication relevant operation of 110 manageable device 106 of telecommunication circuit, the equipment 106 may include being configured to support haveThe resource of line and/or wireless communication.Equipment 106 may include multi-unit message circuit 110 (e.g., including for wire line protocols and/orThe independent physical interface circuit of wireless radio).Wire communication may include serial and concurrent wire medium, such as, etherNet, universal serial bus (USB), firewire, Thunderbolt (thunder and lightning), digital visual interface (DVI), high-definition multimediaInterface (HDMI), etc..Wireless communication may include for example, neighbour's wireless medium is (for example, such as based on RF marks (RFID) or closelyThe radio frequency (RF) of communication (NFC) standard, infrared (IR) or the like), short range wireless mediums (for example, bluetooth, WLAN, Wi-Fi,Etc.), long-range wireless medium (for example, cellular wide area radio communication, it is satellite-based communication, etc.), via the electricity of sound waveSon communication etc..In one embodiment, telecommunication circuit 110 can be configured to prevent from wirelessly communicating interfering with each other.Executing thisWhen function, telecommunication circuit 110 can the relative priority based on the message to be transmitted such as example come schedule communication activities.
User interface circuit 112 may include the hardware and/or software that allow user to be interacted with equipment 106, such as exampleSuch as, various input mechanisms are (for example, microphone, switch, button, knob, keyboard, loud speaker, touch sensitive surface, be configured to capture imageAnd/or the one or more sensors etc. of the induction degree of approach, distance, movement, gesture, orientation, biometric data etc.) andVarious output mechanism (for example, loud speaker, display, luminous/flashing indicator, electromechanical assemblies etc. for vibrating, moving).Hardware in user interface circuit 112 can be incorporated into that in equipment 106 and/or can be coupled to via wired or wireless communication mediumEquipment 106.Power circuit 114 may include internal power source (for example, battery, fuel cell etc.) and/or external power source (exampleSuch as, power grid, electromechanics or solar generator, outer fuel cell etc.) and be configured to will operation needed for power supply toThe interlock circuit of equipment 106.
External equipment 116 may include the equipment that can at least handle the voice data generated by equipment 106.External equipment116 example may include but be not limited to：Such as based on from Google (Google) companyOS, Apple is come from(apple) companyOr MacFrom Microsoft (Microsoft) companyOS, Linux bases are come fromGold meetingOS、OS and/or it is considered asOther similar operations systems of the derived product of OS are comeFrom Mozilla projectsOS, Blackberry (blackberry, blueberry) company is come fromOS, it comes fromHewlett-Packard (Hewlett-Packard) companyOS, Symbian (Saipan) foundation is come fromOS's etc.The mobile communication equipment of cellular handset or smart phone etc；Such as similar to from Apple companiesIt comes fromMicrosoft CorporationGalaxy from Samsung (Samsung) companyFrom Amazon (Amazon)CompanyDeng tablet computer, from Intel (Intel) company include low-power chipsetThe mobile computing device of net book, notebook, laptop computer, palmtop computer or the like；Such asSimilar to the Galaxy from SamsungWatch form factor computing device, from Apple Inc.Etc wearable device；Such as desktop computer, server, with high-performance calculation (HPC) framework tissueComputing device group, smart television or other kinds of " intelligence " equipment etc the fixed computing device of typical case；Similar to fromThe small form factor of Next Unit of Computing (the following computing unit) (NUC) platform of Intel Company calculates solutionCertainly scheme (for example, the limited application in space, TV set-top box etc.) etc.；Or combinations of the above.
In the example of operation, system 100 can be worn and can by the interaction of user and user interface circuit 112 comeBe manually activated, or external equipment 116 is activated by user, 116 application on external equipment is activated, tells local command etc.Automatically it activates.When telling local command, equipment 106 is likely to be at power saving mode, and tells certain sound, listWord, phrase etc. can be identified that (for example, in the form of electronic signal or after being converted into voice data) is for swashing by equipment 106The local command of live system 100 (for example, equipment 106 is transformed into active mode from power saving mode).Other local commandsCan such as deactivation system 100, make system 100 it is mute (for example, temporarily cease sensing operation or transmission operation), increased or decreaseSpeaker volume etc..After activation system 100, sensor 104 can sense the nose (for example, bone bridge of user's nose) of userIn vibration, and can be based on the vibration generate electronic signal.Electronic signal can be received by equipment 106, which can be based onThe electronic signal generates voice data.For example, analog electronic signal can be converted into digital voice data by control circuit 108.UnderThe case where one operation is being used depending on system 100.For example, in case of simple dictation, then control circuit 108 can be by languageSound data store in memory for later retrieval.If carrying out call, telecommunication circuit 110 can pass voice dataThe related external equipment 116 of another party to external equipment 116 (for example, mobile communication equipment) and from calling is sent to receive soundFrequency evidence.User interface circuit 112 then can generate sound via such as loud speaker 118 so that user can be with another callerInteraction.In at least one embodiment, the sound of the voice of user oneself can be generated by loud speaker 118, with to system 100User provide audio feedback.
Fig. 2 exemplifies the example arrangement of the sensor 104 ' of at least one embodiment according to the disclosure.Fig. 2 shows earphonesSensor 104 ' in 200.Earphone 200 can for example, at least include the sensing circuit 202 for being adhered to structural support 204.SensingCircuit 202 may include such as piezoelectric diaphragm, and electronic signal is converted into for that will vibrate 206.Vibration 206 can be due to skull and userIt speaks sympathetic response and occurs.This effect has double advantage, because it allows to capture user speech, while being also based on mankind's skullThe native abilities of external noise are inhibited to filter out external noise.The use of piezoelectric diaphragm is beneficial, because they can be accurateGround generates the electronic signal of instruction voice without external power (for example, pressure wave compressible press transistor generates electronicsSignal).
Although Fig. 2 shows the line 208 for electronic signal to be conveyed to equipment 106, transmitted using wireless signalElectronic signal is also possible.It can realize that various sensors configure according to the disclosure.For example, being deposited to being scheduled in a secondary common spectaclesIn two nose-bridge frames 200, then at least one of two nose-bridge frames 200 may include sensor 104 '.In another example implementation,Two nose-bridge frames 200 may comprise sensor 104 '.Sensor 104 ' in each nose-bridge frame 200 can be by series connection ground wire even with lifeAt stronger electronic signal.In another embodiment, the sensor 104 ' in each nose-bridge frame 200 can be connected by individual ground wire, andResource (for example, control circuit 108) in equipment 106 then can be based on the strong of the electronic signal received from each sensor 104 'The degree selection sensor 104 ' to be used.By this method, system 100 can count and each user's nasal bone in details (exampleSuch as, rupture, the natural deformation of such as deviation of nasal septum etc) and selection can provide most by force and most clearly electronic signal is come in lifeAt the particular sensor 104 ' used in voice data.
Fig. 3 is exemplified according at least one embodiment of the disclosure for carrying out speech capture via nose vibration-sensingExemplary operations.Operation shown in Fig. 3 with dotted outline can be selectable, these details based on the details of realization(for example, system inner sensor, equipment etc.) ability, the configuration of system, the purposes etc. of system including such as system.It is operatingIn 300, nose vibration-sensing can be activated.Activation can be manually (for example, by system user initiate) or automatically (for example,It is triggered by external equipment activity, local command etc.).It whether can be vibrated in operation 302 by least one in system about noseA sensor, which senses, decisions making.If the vibration of judgement nose is not sensed in operation 302, in operation 304, at leastOne corrective action can occur.The example of corrective action may include：Generate, visible and/or tactile notification audible to user；As led toIt crosses and returns to such restarting systems illustrated by the arrow of operation 300；Another sensor in selection system is (for example, when beingWhen system is glasses, the sensor in opposite nose-bridge frame is selected) etc..
If in operation 302, the vibration of judgement nose is sensed, then in operation 306, can be based on by least one sensingThe electronic signal that device generates generates voice data.In operation 308, whether can be wrapped about electronic signal and/or voice dataLocal command is included to decision making.For example, one group of local command can be configured in systems, and the control circuit in system can will be electricSubsignal and/or voice data determine whether there is matching compared with this group of local command.If judging to connect in operation 308Local command is received, then in operation 310, at least one activity can be executed based on the local command sensed.It can be performedMovable example includes but not limited to the system that opens/closes, adjusts system sound volume, is temporarily disabled speech capture and/or voice numberAccording to transmission etc..Judge to follow after not receiving local command in operation 308 and is sent to voice data in operation 312External equipment (for example, as mobile communication equipment of smart phone etc).In operation 314, audio can be received from external equipmentData (for example, voice data corresponding with other participants in call).In operation 316, it can be based on being receivedAudio data generates sound, and it is to return to operation 302 to continue nose vibration-sensing to follow after operation 316.
Voice capture via nose vibration and generation
According to the disclosure, equipment 106 can also make sensor 104 for carrying out " inverse " operation with by causing user's noseSound is communicated to user by the vibration in (for example, nasal bone).The vibration caused in nasal bone is communicated to inner ear by skullIn sound sensing organ (for example, cochlea), which is construed to sound by the vibration caused.Even if user hasThere is (for example, myringoruptures) such as some defects that can generally prevent user from hearing sound, damages, this operation can also occur.GenerallyFor, equipment 106 can have audio data or receivable audio data, the audio data be used to make sensor 104 withCause audio frequency vibration in the nose of family.The communication can be unidirectional (for example, wherein user only listens to incoming sound) or two-way(for example, wherein user had both listened to incoming sound, and sound can be captured from user).For benefiting two-way communication notIt will be discussed herein with pattern, these patterns include but not limited to single and signal modulation pattern.
In at least one embodiment, it is wearable can to include at least such as user for the system for capturing and generating soundFrame, at least one sensor for being installed to the frame and the equipment for being also mounted to the frame.Sensing circuit can be used for sensingThe speech fluctuations that are caused in the nose of user by user speech, generated based on the speech fluctuations sensed electronic signal andCause audio frequency vibration in nose based on audio data.Equipment at least can be used to control the operation of sensing circuit.
In at least one embodiment, frame can be frame, include at least one nose-bridge frame of contact nose, shouldAt least one nose-bridge frame includes at least sensing circuit.Sensing circuit may include at least one piezoelectric diaphragm, for generating e-mailNumber and cause audio frequency vibration.In at least one example implementation, sensing circuit may include the first sense vibrated for sense speechSlowdown monitoring circuit and the second sensing circuit for causing audio frequency vibration.
In at least one embodiment, whether example apparatus can include at least control circuit, just initiated for decision-making systemOr carry out two-way communication.If two-way communication is not initiated or carried out to control circuit decision-making system, control circuit then can baseIt generates voice data in electronic signal or sensing circuit is made to be based on audio data and cause audio frequency vibration.If it is determined that system is just initiatedOr carrying out two-way communication, then control circuit can be operated with single or signal modulation pattern.Under single, controlCircuit can make sensing circuit at least generate instruction when audio data is passed to, and so that sensing circuit is based on audio data initiation audio and shakeIt moves also, when not having audio data to be passed to, voice data is generated based on electronic signal.Under signal modulation pattern, control electricityThe modulated audio data in road makes sensing circuit be based on modulated data and causes audio frequency vibration, electronic signal received, from the electronicsTarget signal filter audio frequency vibration and based on the electronic signal generate voice data.Equipment can further be included at least in followingThe telecommunication circuit of at least one：Voice data is sent to external equipment；Or receive audio data from external equipment.According to thisOpen, the exemplary method for capturing and generating sound may include whether the system for activating user wearable, decision-making system are just being sent outTwo-way communication is played or carries out, based on the sensing circuit in judgement control system at least one of following operation：SensingThe speech fluctuations that are caused by user speech in the nose of user simultaneously generate electronic signal based on speech fluctuations；Or it is based on soundFrequency evidence causes audio frequency vibration in nose.
Fig. 4 is exemplified according at least one embodiment of the disclosure as energy converter come the sensor of further operatingExample arrangement.In each embodiment illustrated by Fig. 1 to 3, only relies on sensor 104 ' and be locally generated by user to captureSound (for example, voice).Fig. 4 shows that an embodiment, wherein sensor 104' can be used as energy converter (for example, for both capturing thisGround sound in the nose of user causes audio frequency vibration again) it operates, in order to which user can hear sound based on audio data.SoundFrequency evidence may include being stored in equipment 106 or times received by equipment 106, for making sensor 104 ' generate audio frequency vibrationWhat data.Audio data is described as the voice of another party in the call of user's participation of system 100 by above example.SoAnd this is only an example of audio data.According to the disclosure, system 100 can support one-way or bi-directional communication.One-way communicationIt may include that the user of system 100 captures voice data (for example, record is dictated, record is reminded etc.) or listens to by nose vibration initiationSound.When such as user is just listening to music, dictation (message, audio books, speech or other similar statements for such as recording)When, they can only listen to sound.Audio data can be stored in equipment 106 (for example, the memory in control circuit 108In) or can be received in equipment 106 (for example, via telecommunication circuit 110).In the example of operation, user can be with equipmentUser interface circuit 112 and/or external equipment 116 (for example, with voice applications in external equipment 116) in 116 interact withSelection audio data and the playback for triggering audio data.No matter audio data is stored in equipment 106 still from external source(for example, from external equipment 116) streaming, if necessary (for example, shaking to be based on such as initiation of sensor 104 ' audioDynamic mode is come volume, frequency, pitch, the tone etc. that adjust audio data), control circuit 108 can handle the audio data,And generate the signal (for example, drive signal) for making sensor 104 ' cause audio frequency vibration in user's nose.Two-way communication canIt is related to capturing the sound locally generated by user and both audio frequency vibrations is caused based on audio data.The most typically of two-way communicationExample is that the user of system 100 makes a phone call.
Fig. 4 is exemplified, it (is hereinafter referred to as " speech fluctuations 206 ") in addition to capturing the vibration 206 generated by user speechOutside, sensor 104 ' can be further able to cause audio frequency vibration 400 (for example, being based on audio data).The example of audio frequency vibration existsIt is shown with 400A and 400B in Fig. 4.In at least one realization, single sense circuit 202 can not only sense speech vibration 206 ' but alsoCause audio frequency vibration 400A.This can occur, because real sensor (for example, piezoelectric diaphragm) can be in a manner of substantially passiveContinue sense speech vibration 206 ' makes piezoelectric diaphragm activate and causes audio to shake until providing from equipment 106 to the real sensorThe signal of dynamic 400A.Therefore, be converted to from passive sensing speech fluctuations 206 ' actively cause audio frequency vibration 400A can be mainly by settingStandby 106 control, which optionally receives by passively sensing generated electronic signal or generation for causingThe drive signal of audio frequency vibration 400A.In different implementations, sensor 104 ' may include more than one sensing circuit 202.For example,Multiple piezoelectric diaphragms can be incorporated into that or can at least be coupled to one or two nose-bridge frame 200 (for example, depending on nose-bridge frameAnd/or diaphragm size, shape etc.).Multiple piezoelectric diaphragms can be coupled in series to be generated more in sense speech vibration 206 'Strong electronic signal and/or cause stronger audio frequency vibration 400.In at least one embodiment, nose-bridge frame 200 can be wrapped eachPiezoelectric diaphragm is included, to generate audio frequency vibration 400A and 400B respectively.Audio frequency vibration 400A and 400B can be initiated into shakingWidth difference and phase difference so that can determine the source of each in caused audio frequency vibration.Source instruction can be used for for example calibrating, adjustExamination etc..In another possible realization, each in multiple piezoelectric diaphragms can be exclusively used in only sense speech vibration 206 ' or causeAudio frequency vibration 400.For example, sensing circuit 202 can be exclusively used in only sense speech vibration 206, and the sensing in another nose-bridge frame 200Circuit 402 can be exclusively used in only causing audio frequency vibration 400B.In this example, second 404 (for example, additional wires) of coupling can be used forCouple the sensing circuit 402 in another nose-bridge frame 200 to equipment 106.Although being illustrated as line, coupling 404 can also beIt is wirelessly connected (for example, via bluetooth, NFC etc.).
No matter actual configuration, is the operation of management of sensor 104 ' by least one challenge that bidirectional operation is constituted.BySpeech fluctuations 206 ' caused by user speech and the audio frequency vibration 400 caused based on incoming audio data can be predictedGround concurrently occurs, and therefore may be interfering with each other.For example, single piezoelectric diaphragm cannot sense and generate simultaneously vibration.KnotFruit, speech fluctuations 206 ' will be missed when audio frequency vibration 400A is initiated.Moreover, sensor 104 ' includes only special whereinIn the configuration of sense vibrations or the multiple piezoelectric diaphragms for causing vibration, sensing piezoelectric diaphragm can be in speech fluctuations 206 ' and audioVibration 400B senses both when concurrently occurring.It is given birth to using the mixing of the speech fluctuations 206' and audio frequency vibration 400B of this captureAt voice data may be chaotic, can not understand, and be therefore disabled.
According to the disclosure, the control circuit 108 in equipment 106 can be helped by being operated under the pattern for avoiding case aboveBeneficial two-way communication.Although in various operation modes disclosed herein, these operation modes are only as the side for avoiding the above problemThe example of method provides, and is not intended to the disclosed embodiments being limited to any particular manner of operation.First example of operationPattern is single channel operation.In single channel operation, sensor 104 ' can be limited to be only used for sense speech to shake by control circuit 108It moves 206 ' or generates audio frequency vibration 400.Such as minor tune, short vibration are (for example, the machine in user interface circuit 512Circuit) etc instruction can at least be indicated to the user that when audio data is passed to.Incoming audio instruction can help to prevent userAttempt to speak during audio frequency vibration, that can cause user speech not to be recorded.In at least one embodiment, another instruction canIt informs the user and has presented all audio datas (for example, via audio frequency vibration 400), caught to allow user to continue voiceIt catches.
Under signal modulation pattern, 108 modulated audio data of control circuit, or be used for from what the audio data generatedDrive sensor 104 ' to cause the signal of audio frequency vibration 400 so that the noise including audio frequency vibration 400 can be later to languageIt is filtered out in the capture of sound vibration 206'.As quoted in this article, modulation is generally comprised at least one attribute of waveform moreChange.For example, the frequency of signal driving sensor 104 ' can be modified so that it is more high or low than the expected frequency of speech fluctuations 206 '.As a result, although both speech fluctuations 206 ' and simultaneous audio frequency vibration 400, low pass or high-pass filtering may be capturedIt can be used for filtering out captured noise (example from desired waveform (for example, speech fluctuations 206 ') by control circuit 108 laterSuch as, audio volume control 400).Waveform can be converted into voice data for storing, transmitting.
Fig. 5 is exemplified according at least one embodiment of the disclosure for carrying out voice capture and life via nose vibrationAt exemplary operations.Operation illustrated by Fig. 5 is related to available different operation modes in system.For all operation modesSpeech, and not all operation is all needed.Therefore, although whole operation stream shown in Fig. 5 allows system from available action mouldFormula selects certain operational modes, but the subset of these operations can be used in the system operated using less operation mode.
It, can activation system in operation 500.Then in operation 502, whether can just initiate or carrying out two-way about systemCommunication is decision making.It, in operation 504, can be about whether if decision-making system does not carry out two-way communication in operation 502The voice of only capture user, which is made, to be further determined.It will can be followed in Fig. 3 after the judgement for only capturing user speech in operation 504Operation 300 to 312 for capturing user speech via nose vibration-sensing.What can be followed after operation 312 is to be back to operation502.It is back to operation 504, operation 506 will can be followed after the judgement for not capturing user speech, wherein can be connect from external equipmentIt receives and is passed to audio data.The dotted outline of operation 506 indicates that the operation can be executed only if necessary (for example, if audio dataIt is not downloaded, streams from external equipment, then it may be already present in system).In operation 508, audio can be based onData cause audio frequency vibration in the nose (for example, nasal bone) of user.What can be followed after operation 508 is to be back to operation 502.
It is back to operation 502, it, can in operation 510 if making the judgement that two-way communication was just being initiated or carried out to systemIt is further determined about whether system will be made using single channel operation mode.If decision-making system will utilize in operation 510Single then can be passed to audio data (for example, from the another of call is participated in about whether existing in operation 512One people) it decisions making.It can follow after the judgement for not having incoming audio data in operation 512 in Fig. 3 and feel for being vibrated via noseSurvey the operation 300 to 312 for capturing user speech.What can be followed after operation 312 is to be back to operation 502.It is back to operation512, if it is decided that audio data is just incoming, then in operation 514, system may indicate to the user that the incoming audio data (for example,Utilize tone, vibration etc.).Then in operation 516, audio data is can receive, and in operation 518, the audio can be based onData cause audio frequency vibration in the nose of user.In optional operation 520, the ending (example of audio data may indicate to the user thatSuch as, tone, vibration etc. are utilized), it can speak (for example, speech capture can restart) in order to inform the user him/her.The operation 300 to 312 for capturing user speech via nose vibration-sensing in Fig. 3 can be followed after operation 520.Operation 312 itWhat can be followed afterwards is to be back to operation 502.
It is back to operation 510, the judgement that system will work without single channel operation mode can follow operation 522 later, whereinIt can be further determined about whether system will be made using signal modulation pattern.If decision-making system will utilize in operation 524Signal modulation pattern can then further determine in operation 524 about whether there is any incoming audio data to make.Operation 524In there is no that the operation in Fig. 3 for capturing user speech via nose vibration-sensing can be followed after the judgement of incoming audio data300 to 312.What can be followed after operation 312 is to be back to operation 502.If being determined with incoming audio number in operation 534According to, then in operation 526, it can receive and modulate the incoming audio data, or alternatively, it is modulated in drive systemSensing circuit is to generate the signal of audio frequency vibration.In operation 528, modulated audio data can be used to carry out the nose in userMiddle initiation audio frequency vibration.Given system includes the individual sensing circuit for being respectively used to cause audio frequency vibration and sense speech vibration(for example, piezoelectric diaphragm) group, then the user of system talks during the generation of audio frequency vibration can cause user speech and audio to shakeIt is dynamic to be both captured.The electronic signal generated by the sensing circuit of sense speech vibration then may include the voice and sound of combinationFrequency evidence.Then in operation 530, can receive may include the electronic signal of voice and both audio.In operation 532In, it only includes language that (for example, passing through the control circuit in system) can filter out modulated audio data to generate from electronic signalThe electronic signal of sound data.It can follow and be used in Fig. 3 in processing operation 532 from mixing voice and audio frequency vibration after operation 532The operation 306 to 312 of the remaining voice data of signal extraction.What can be followed after operation 312 is to be back to operation 502.It returnsValue Operations 522, if it is decided that will work without signal modulation pattern, then traffic operation can be completed.Operation 522 after can follow beOperation 500 is back to the activation next time of waiting system.
Although Fig. 3 and 5 instantiates the operation according to different embodiments, it will be understood that not being described in Fig. 3 and 5All operations be all required for other embodiment.In fact, contemplating other realities in the disclosure completely hereinIt applies in example, discribed operation and/or other operations described herein can be with special timess in the accompanying drawings in Fig. 3 and 5One mode shown in the accompanying drawings combines, but still complies fully with the disclosure.It is directed to and is not shown definitely in an attached drawing as a result,Feature and/or the claim of operation be considered as in the scope of the present disclosure and content.
As the bulleted list used in the application and claims, connected by term "and/or" can be meanedAny combinations for the item listed.For example, phrase " A, B and/or C " may mean that A；B；C；A and B；A and C；B and C；Or A, BAnd C.As used in the application and claims, by term, " at least one " bulleted list of connection may mean thatAny combinations for the item listed.For example, phrase " at least one of A, B or C " may mean that A；B；C；A and B；A and C；B andC；Or A, B and C.
As used in any embodiment herein, term " module ", which can refer to, is disposed for executing aforementionedSoftware, firmware and/or the circuit of meaning operation.Software can be presented as be recorded in it is soft in non-transient computer readable storage mediumPart packet, code, instruction, instruction set and/or data.Firmware may be implemented to set in memory such as hard coded (for example, non-volatile)Code, instruction or instruction set and/or data in standby.As used in any embodiment herein, " circuit " can be independentOr in any combination including such as：Hard-wired circuit；Programmable circuit is such as handled including one or more independent instructionsThe computer processor of core；State machine circuit；And/or store the firmware of the instruction executed by programmable circuit.These modules canIt is collectively or individually presented as to form the circuit of a part for larger system, such as integrated circuit (IC), system on chip(SoC), desktop computer, laptop computer, tablet computer, server, smart phone etc..
Any operation described herein can including one or more storage mediums (for example, non-transient storage be situated betweenMatter) system in be implemented, the storage medium is stored with instruction on it either individually or in combination, and described instruction is by oneOr multiple processors execute the method when executing.Here, processor may include such as server CPU, mobile device CPU and/Or other programmable circuits.Moreover, operation described here is intended to be distributed across multiple physical equipments, such as in more than oneThe processing structure of different physical locations.Storage medium may include any kind of tangible medium, for example, including hard disk, floppy disk,It is any kind of disk including CD, aacompactadisk read onlyamemory (CD-ROM), rewritable compact-disc (CD-RW), magneto-optic disk, allAs the semiconductor devices of read-only memory (ROM) etc, such as RAM of dynamic and static RAM (RAM) etc,Erasable Programmable Read Only Memory EPROM (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, solid-state disk(SSD), embedded multi-media card (eMMC), secure digital input/output (SDIO) card, magnetic or optical card or electric suitable for storageAny kind of medium of sub-instructions.Other embodiment can be implemented as the software module executed by programmable control device.
Therefore, this disclosure relates to the system for being used to carry out voice capture and generation via nose vibration.For capturing and giving birth toAt the example system of sound can include at least the wearable frame of user, be installed to the frame at least one sensor andThe equipment for being installed to the frame.Sensing circuit can sense speech fluctuations, the base caused in the nose of user by user speechElectronic signal is generated in the speech fluctuations sensed and audio frequency vibration is caused in nose based on audio data.Equipment can be at leastOperation for controlling sensing circuit.Sensing circuit may include at least one piezoelectric diaphragm, for generating electronic signal and causingAudio frequency vibration.In at least one example implementation, frame can be used for glasses and may include for contacting nose at least oneA nose-bridge frame structure, which includes sensing circuit.
Following example is related to further embodiment.Example below the disclosure may include theme material, such as setStandby, method, (when executed, described instruction makes machine base at least one machine readable media for storing instructionExecute action in method), the device for executing action based on method, and/or for via nose vibrate carry out sound catchThe system caught and generated, what following article was provided.
According to example 1, a kind of system for capturing and generating sound is provided.The system may include that user is wearableFrame；It is installed to the sensing circuit of frame, wherein the sensing circuit is for sensing by the voice of user the institute in the nose of userThe speech fluctuations of initiation generate electronic signal based on the speech fluctuations sensed and cause sound in nose based on audio dataFrequency vibration；And the equipment for being installed to frame, wherein operation of the equipment at least controlling sensing circuit.
Example 2 may include that the element of example 1, middle frame are frames, which includes contacting nose extremelyA few nose-bridge frame, at least one nose-bridge frame include at least sensing circuit.
Example 3 may include the element of any one of example 1 to 2, and wherein sensing circuit includes at least one piezoelectric diaphragm, shouldAt least one piezoelectric diaphragm is for generating electronic signal and causing audio frequency vibration.
Example 4 may include that the element of example 3, wherein at least one piezoelectric diaphragm are coupled to equipment via at least one line.
Example 5 may include the element of any one of example 3 to 4, and wherein at least one piezoelectric diaphragm is via Radio Link couplingIt is bonded to equipment.
Example 6 may include the element of any one of example 3 to 5, and wherein sensing circuit includes multiple piezoelectricity of series coupledDiaphragm.
Example 7 may include the element of any one of example 3 to 6, and wherein sensing circuit includes being vibrated for sense speechFirst sensing circuit and the second sensing circuit for causing audio frequency vibration.
Example 8 may include the element of example 7, wherein the first sensing circuit be configured to engagement nose the first side and secondSensing circuit is configured to the second side of engagement nose.
Example 9 may include the element of any one of example 7 to 8, wherein the second sensing circuit includes being configured to operate as changingAt least one piezoelectric diaphragm of energy device operation.
Example 10 may include that the element of any one of example 1 to 9, wherein equipment include at least control circuit, control electricityTwo-way communication whether is just being initiated or is carrying out for decision-making system in road.
Example 11 may include the element of example 10, wherein if two-way is not initiated or carried out to control circuit decision-making systemBelieve, then control circuit is used to generate voice data based on electronic signal or sensing circuit is made to be based on audio data initiation audio and shakesIt is dynamic.
Example 12 may include the element of example 11, wherein if two-way is just initiated or carried out to control circuit decision-making systemLetter, then control circuit with single for being operated.
Example 13 may include the element of example 12, wherein under single, control circuit is used for：Make sensing circuit extremelyIt is few that instruction is generated when audio data is passed to；So that sensing circuit is based on audio data and causes audio frequency vibration；And work as no audioWhen data are passed to, voice data is generated based on electronic signal.
Example 14 may include the element of example 13, wherein instruction includes at least one of audible notice or tactile notification.
Example 15 may include the element of any one of example 13 to 14, wherein can further comprise control circuit, the controlCircuit makes sensing circuit generate the second instruction when incoming audio data is completed.
Example 16 may include the element of any one of example 11 to 15, wherein if control circuit decision-making system just initiate orTwo-way communication is carried out, then control circuit with single for operating, and wherein control circuit is for making sensing circuit at least existInstruction is generated when audio data is incoming, so that sensing circuit is based on audio data and is caused audio frequency vibration, and works as no audio dataWhen incoming, voice data is generated based on electronic signal.
Example 17 may include the element of any one of example 11 to 16, wherein if control circuit decision-making system just initiate orTwo-way communication is carried out, then control circuit is used to operate with signal modulation pattern.
Example 18 may include the element of example 17, wherein under signal modulation pattern, control circuit is used for modulation tone frequencyAccording to, make sensing circuit be based on modulated data cause audio frequency vibration, receive electronic signal, filter out audio from electronic signal and shakeIt is dynamic, and voice data is generated based on electronic signal.
Example 19 may include the element of any one of example 11 to 18, wherein if control circuit decision-making system just initiate orTwo-way communication is carried out, then control circuit is used to operate with signal modulation pattern, and wherein control circuit is used for modulating audio frequency data, makesSensing circuit is based on modulated data and causes audio frequency vibration, receives electronic signal, audio frequency vibration is filtered out from electronic signal, andVoice data is generated based on electronic signal.
Example 20 may include the element of any one of example 1 to 19, wherein equipment include at least in following at leastThe telecommunication circuit of one：Voice data is sent to external equipment or receives audio data from external equipment.
According to example 21, a kind of method for capturing and generating sound is provided.This method may include activating user canThe system of wearing；Two-way communication is just being initiated or carried out to decision-making system whether；Based on judgement control sensing circuit in followingAt least one：It senses the speech fluctuations caused in user's nose by the voice of user and generates e-mail based on speech fluctuationsNumber；Or audio frequency vibration is caused in nose based on audio data.
Example 22 may include the element of example 21, wherein can further comprise generating voice data based on electronic signal.
Example 23 may include the element of any one of example 21 to 22, if it is determined that wherein system is just being initiated or carried out two-wayCommunication, then further comprise operating with single.
Example 24 may include the element of example 23, wherein including with single operation：Make sensing circuit at least in soundFrequency is according to generation instruction when being passed to；So that sensing circuit is based on audio data and causes audio frequency vibration；And when no audio data passesIt is fashionable, voice data is generated based on electronic signal.
Example 25 may include the element of example 24, wherein instruction includes at least one of audible notice or tactile notification.
Example 26 may include the element of any one of example 24 to 25, and can further comprise making sensing circuit incomingThe second instruction is generated when audio data is completed.
Example 27 may include the element of any one of example 21 to 26, if it is determined that wherein system is just being initiated or carried out two-wayCommunication then further comprises operating with signal modulation pattern.
Example 28 may include the element of example 27, wherein including with the operation of signal modulation pattern：Modulating audio frequency data；Make senseSlowdown monitoring circuit is based on modulated data and causes audio frequency vibration；Receive electronic signal；Audio frequency vibration is filtered out from electronic signal；And baseVoice data is generated in electronic signal.
Example 29 may include the element of any one of example 21 to 28, wherein can further comprise it is following at least onePerson：Voice data is sent to external equipment or receives audio data from external equipment.
According to example 30, a kind of system for capturing and generating sound, including at least one equipment, the system are providedIt is arranged to the method executed described in any one of above example 21 to 29.
According to example 31, a kind of chipset is provided, the chipset, which is arranged to execute in above example 21 to 29, appointsMethod described in one.
According to example 32, at least one machine readable media, including a plurality of instruction are provided, a plurality of instruction is in response to countingIt calculates and is performed in equipment, computing device is made to execute the method according to any one of above example 21 to 29.
According to example 33, a kind of at least one equipment for being disposed for capturing and generating sound is provided, this at least oneA equipment is arranged to the method executed described in any one of above example 21 to 29.
According to example 34, a kind of system for capturing and generating sound is provided.The system may include using for activatingWhether the device of the wearable system in family is just initiating or is carrying out the device of two-way communication for decision-making system, for based on judgementSensing circuit is controlled at least one of following device：Sense the language caused in user's nose by the voice of userSound, which vibrates and is based on speech fluctuations, generates electronic signal；Or audio frequency vibration is caused in nose based on audio data.
Example 35 may include the element of example 34, wherein can further comprise for generating voice data based on electronic signalDevice.
Example 36 may include the element of any one of example 34 to 35, if it is determined that wherein system is just being initiated or carried out two-wayCommunication, then further comprise the device for being operated with single.
Example 37 may include the element of example 36, wherein the device for being operated with single includes：For making senseSlowdown monitoring circuit at least generates the device of instruction when audio data is passed to；It shakes for making sensing circuit be based on audio data initiation audioDynamic device；And the device for generating voice data based on electronic signal when not having audio data incoming.
Example 38 may include the element of example 37, wherein instruction includes at least one of audible notice or tactile notification.
Example 39 may include the element of any one of example 37 to 38, and can further comprise for making sensing circuit existIncoming audio data generates the device of the second instruction when completing.
Example 40 may include the element of any one of example 34 to 39, if it is determined that wherein system is just being initiated or carried out two-wayCommunication, then further comprise the device for being operated with signal modulation pattern.
Example 41 may include the element of example 40, wherein the device for being operated with signal modulation pattern includes：For adjustingThe device of audio data processed；For making sensing circuit based on the device of modulated data initiation audio frequency vibration；For receiving electricityThe device of subsignal；Device for filtering out audio frequency vibration from electronic signal；And for generating voice number based on electronic signalAccording to device.
Example 42 may include the element of any one of example 34 to 41, wherein can further comprise it is following at least onePerson：Device for voice data to be sent to external equipment or the device for receiving audio data from external equipment.
The terms and expressions used herein the term unrestricted with the term being described, and using suchWhen terms and expressions, it is not intended to exclude shown and described feature any equivalent scheme (or part thereof), should recognizeKnow, in the range of claims, various modifications are all possible.Correspondingly, claims be intended to cover it is all thisClass equivalent scheme.