CN112914189A - Sole sensing insole, tumble detection system and tumble detection method - Google Patents

Abstract

A sole sensing insole, a fall detection system and a fall detection method combine machine learning and sole sensing technologies, and integration of functions of human body sole information acquisition, fall detection, burst alarm, insole temperature control, sole massage and the like is achieved, so that technical problems of real-time fall detection, emergency help seeking, temperature control, massage control and the like of a human body are solved, and accuracy of fall detection based on sole information is greatly improved.

Description

Sole sensing insole, tumble detection system and tumble detection method

Technical Field

The invention relates to a sole sensing insole, a tumble detection system and a tumble detection method.

Background

Although some professional old people shoe products appear in the market, only one aspect of sole skid resistance is actually involved, and machine learning algorithm is not utilized to realize tumble detection. The following problems are generally present in the current sole sensing insole 1:

problem one, a fall detection algorithm aiming at plantar pressure sensing is lacked.

The second problem is that a sole sensing insole 1 specially used for fall detection of the old and a massage insole used for special people are lacked.

Problem three, sole perception shoe-pad 1 system is incomplete, for example sole information acquisition, the detection of falling down of server end and the emergent distress call of cell-phone end of shoe-pad main part end do not obtain fine combination and design.

Disclosure of Invention

The invention aims to provide a sole sensing insole, a fall detection system and a fall detection method, which realize fall detection by combining machine learning and a sole pressure sensing technology, thereby solving the technical problems of inaccurate fall detection, untimely emergency warning and the like.

In order to achieve the above object, the present invention provides a sole sensing insole, comprising: the insole comprises an insole body, and a sole information acquisition module, an information processing module and an information transmission module which are arranged in the insole body, wherein the sole information acquisition module acquires sole sensing information by using a sensor, the information processing module processes the sole sensing information, and the information transmission module sends the sole sensing information.

The insole body comprises: the protruding layer of massage and the foraminiferous layer of range upon range of nested setting, contain the multiunit massage subassembly in the protruding layer of massage, the massage subassembly contains the flexible gasbag and the massage arch that correspond the setting, the massage arch stretches out through-hole on the foraminiferous layer contacts with user's sole, plays according to the effect of rubbing, flexible gasbag sets up the protruding below of massage, in order to control the bellied up-and-down motion of massage reaches better massage effect.

The massage components are arranged according to the distribution of the plantar reflecting area and the plantar acupuncture points of the human body.

The sole information acquisition module includes: a plurality of piezoresistive sensors, at least one thermistor sensor, and at least one heating sensor disposed within the apertured layer;

at least one piezoresistive sensor is arranged in each area of the sole at a first metatarsophalangeal area, a second metatarsophalangeal area, a midfoot area, a medial heel area, a lateral heel area, a fifth metatarsophalangeal area, a fourth metatarsophalangeal area, a third metatarsophalangeal area and 2-5 toe areas; at least 2 piezoresistor sensors are arranged at the first toe area of the sole;

the thermistor sensor is arranged in the middle area of the heel of the sole;

the heating sensor is arranged in the central area of the sole of the foot in front of the sole of the foot.

The information processing module comprises a signal enhancement module and a microprocessor which are arranged in the perforated layer;

the signal enhancement module is arranged in the middle foot area of the sole and is connected to the piezoresistor sensor and the thermistor sensor;

the microprocessor is arranged in the central area of the vertical connecting line of the center of the sole of foot and the middle part of foot and is connected to the heating sensor.

The information transmission module comprises a Bluetooth module arranged in the porous layer.

The invention also provides a fall detection system, comprising: the sole sensing insole, a mobile phone end control system communicated with the sole sensing insole and a server end tumble detection system communicated with the mobile phone end control system are arranged on the sole sensing insole;

the mobile phone end control system receives sole sensing information sent by the sole sensing insole and synchronizes the sole sensing information to the server end tumble detection system, and the mobile phone end control system regulates and controls the heating sensor in the sole sensing insole;

the server-side fall detection system detects falls according to the sole sensing information and controls the mobile phone-side control system to execute corresponding operations.

The mobile phone end control system comprises: the system comprises an emergency call module, a temperature control module and a voice prompt module;

the emergency call module is used for sending emergency help-seeking information;

the temperature control module is used for controlling a heating sensor in the sole sensing insole;

the voice prompt module is used for broadcasting danger warning.

The invention also provides a tumble detection method, wherein the pressure data is collected by the piezoresistor sensor in the sole sensing insole, the sole sensing information sent by the sole sensing insole is received by the mobile phone end control system and is synchronized to the server end tumble detection system, the server end tumble detection system judges the pressure data collected in real time according to the sample training model obtained by the support vector machine, and when the pressure value is reduced to zero or is lower than the set threshold value within the set time, the tumble event is judged.

When a tumble event occurs, the emergency call module in the mobile phone end control system sends emergency help information, and the voice prompt module broadcasts danger warning.

The invention combines machine learning and sole sensing technologies, realizes integration of functions of human body sole information acquisition, fall detection, burst alarm, insole temperature control, sole massage and the like, solves the technical problems of real-time fall detection, emergency help seeking, temperature control, massage control and the like of a human body, and greatly improves the accuracy of fall detection based on sole information.

Drawings

Fig. 1 is a block diagram of a fall detection system according to the present invention.

Fig. 2 is a schematic structural diagram of a sole sensing insole.

Fig. 3 is a structural schematic diagram of the insole body.

Fig. 4 is a schematic view of the plantar reflex region.

Fig. 5 is a plantar acupoint map.

Fig. 6 is a schematic distribution diagram of the sensors in the sole information acquisition module.

Fig. 7 is a schematic diagram of a mobile phone end control system.

Fig. 8 is a schematic diagram of a server-side fall detection system.

Detailed Description

The preferred embodiment of the present invention will be described in detail below with reference to fig. 1 to 8.

As shown in fig. 1, the present invention provides a fall detection system, comprising: sole perception shoe-pad 1, cell-phone end control system 2 and server end fall detection system 3. The sole sensing insole 1 is connected with a mobile phone end control system 2, and is used for transmitting sole sensing information such as temperature and pressure; and the second is to receive the instruction from the mobile phone control end 2, which is mainly used for regulating and controlling the heating sensor. The server-side fall detection system 3 is connected with the mobile phone-side control system 2, and mainly detects falls according to the sole sensing information, and the detection result can automatically regulate and control the emergency call module 21, the temperature control module 22 and the voice prompt module 23 of the mobile phone control system 2. In this embodiment, sole perception shoe-pad 1 communicates through the bluetooth with cell-phone end control system 2, server end tumble detecting system 3 carries out socket communication with cell-phone end control system 2, and this kind of communication mode belongs to long connection, and customer end and server keep connecting always, and the data that real-time transmission shoe-pad data acquisition end transmitted to real-time identification detects.

As shown in fig. 2, the sole sensing insole 1 includes an insole body (not shown), and a sole information collecting module 11, an information processing module 12 and an information transmitting module 13 disposed in the insole body. The sole information acquisition module 11 uses a sensor to acquire sole sensing information, the information processing module 12 is connected with the sole information acquisition module 11 to amplify and filter signals transmitted by the sole information acquisition module 11, an analog-to-digital converter is used to convert analog signals into digital signals, and the information transmission module 13 is connected with the information processing module 12 to send the sole sensing information to the mobile phone end control system 2.

As shown in fig. 3, the insole body comprises: theprotruding layer 102 of massage and theforaminiferous layer 101 of range upon range of nested setting, contain the multiunit massage subassembly in theprotruding layer 102 of massage, the massage subassembly contains theflexible gasbag 1021 and themassage arch 1022 of corresponding setting,massage arch 1022 stretches out through-hole on theforaminiferous layer 101, with user's sole contact, plays the massage effect,flexible gasbag 1021 sets upmassage arch 1022 below, can controlmassage arch 1022's activity from top to bottom to this reaches better massage effect.

The massage components are arranged according to the distribution of human acupuncture points, the massage modes are divided into a common massage mode and a special crowd massage mode, if massage is needed, themassage convex layer 102 is only needed to be placed under the band-hole layer 101 according to the hole positions. In the common massage mode, the massage components are arranged near the basic acupuncture points, and in the special crowd massage mode, the massage components are arranged according to the sole reflection areas as shown in fig. 4 and the sole acupuncture points as shown in fig. 5, so that the hardness of the corresponding acupuncture point massage bulges 1022 can be further enhanced according to the physical conditions of special crowds, for example, the reflection areas of various organs of the abdomen are in the middle of the sole, and the hardness of the bulge massage points can be enhanced for crowds with frequent pain in the abdomen; organs such as stomach, pancreas, duodenum, small intestine and the like at the midline have reflecting areas on the left foot and the right foot, and the corresponding strengthening can be carried out in the reflecting areas; the reflecting areas of the left kidney and the spleen are positioned on the left foot, and the reflecting areas of the right kidney, the liver and the gallbladder are positioned on the right foot; the reflection area of each organ of the pelvic cavity is on the heel, and comprises reproductive organs (uterus, ovary, testis, prostate), bladder, urethra, vagina, anus, etc.; the body below the head corresponds to the reflex zone: the left foot corresponds to the left half body, and the right foot corresponds to the right half body in a positive corresponding state.

As shown in fig. 2, the sole information collecting module 11 includes: a plurality ofpiezoresistive sensors 111, at least onethermistor sensor 112, and at least oneheat sensor 113 disposed within thetape orifice layer 101. As shown in fig. 6, in the embodiment of the present invention, the pressure data of the human body in different states are recorded in real time by the piezo-resistor sensor 111 embedded in the insole, and the pressure data are transmitted to the information processing module 12 for further data processing. The 11 piezoresistor sensors are placed according to the pressure division of the sole of the human body and the characteristics of the sole of the old, so that the pressure sensors are better aimed at the groups of the old. Wherein, 10 piezoresistance sensors are respectively arranged in 10 subareas according to the sole pressure subarea, the 10 subareas are respectively a first toe, a first metatarsophalangeal, a second metatarsophalangeal, a middle part of a foot, an inner side of a heel, an outer side of the heel, a fifth metatarsophalangeal, a fourth metatarsophalangeal, a third metatarsophalangeal and 2-5 toes of the sole according to the clockwise sequence, and according to two prominent characteristics of the foot type of the old: firstly, the flat feet are abundant; the phalange of the first toe can be subjected to rotary extrusion of the internal force, and hallux valgus is more, so that the 11 th piezoresistor sensor and the 1 st piezoresistor sensor are arranged in the first toe area of the sole side by side to prevent poor extrusion contact. The 11 piezoresistive sensors are connected to each other and finally to thesignal enhancement module 121 in the information processing module 12. Thethermistor sensor 112 is placed at the medial heel position and is connected to thesignal enhancement module 121 in the information processing module 12 for obtaining temperature information. Theheating sensor 113 is disposed at the center of the forefoot and is connected to themicroprocessor 122 of the information processing module 12 for controlling the temperature.

As shown in fig. 2 and 6, the information processing module 12 includes asignal enhancement module 121 and amicroprocessor 122 disposed within theapertured layer 101. Thesignal enhancement module 121 is placed in the middle of the foot, and performs data enhancement, such as signal amplification and filtering, on the data acquired by the sole information acquisition module 11 by using a signal conditioning circuit, and then converts the analog signal into a digital signal by using an analog-to-digital converter, and finally transmits the digital signal to themicroprocessor 122. Themicroprocessor 122 is disposed at the center of the vertical connection line between the center of the front sole and the midfoot, and is configured to provide a high-quality data source for the server-side fall detection system 3.

As shown in fig. 2, in this embodiment, the information transmission module 13 is disposed in the band-pass layer 101 and includes bluetooth 131, and the information processing module 12 packages the processed digital signals into a standard data packet format and sends the information to the mobile phone-side control system 2 according to a bluetooth communication protocol through the bluetooth 131. Bluetooth transmission has the advantages of low power, ease of operation of the battery powered device, cheapness, applicability to low cost devices, simultaneous management of data and voice transmission and low latency, and the system will also synchronize the received data to the server side fall detection system 3, taking into account these advantages to select the more advantageous bluetooth.

As shown in fig. 7, the mobile phone end control system 2 includes: the emergency call module 21, the temperature control module 22 and the voice prompt module 23, the emergency call module 21 and the temperature control module 22 are both divided into an automatic mode and a manual mode, the two modes are complementary to each other, and the voice prompt module 23 can manually adjust the volume.

The emergency call module 21: when the server-side fall detection system 3 analyzes and detects a fall event according to pressure data sensed by the sole of a foot, the emergency call module 21 sends emergency call information to an emergency contact person, and the old people in an emergency can also call for help manually by one key;

the temperature control module 22: the module wearer can press the heating button according to the temperature desired by the wearer to realize sole heating, and the system can also be set to be self-adaptive. Under the manual regulation and control mode, the temperature control heating instruction sent by the temperature control module 22 in the mobile phone end control system 2 is sent to the plantar sensing insole 1 through the bluetooth, and themicroprocessor 122 controls theheating sensor 113 to heat after receiving the instruction. In the adaptive mode, the temperature control module 22 forms an appropriate temperature threshold according to the difference between the human body temperature and the external temperature, when thethermistor sensor 112 detects that the sole temperature of the human body is too low, the temperature control module 22 sends a temperature control heating instruction to control theheating sensor 113 to heat until the sole temperature approaches the appropriate temperature set in advance;

the voice prompt module 23: the server-side tumble detection system 3 detects that a tumble event can send an emergency instruction to control the voice prompt module 23 to broadcast a danger warning, and a wearer can adjust the volume of the voice prompt by himself.

As shown in fig. 8, the server-side fall detection system 3 includes: a raw data presentation module 31, and a fall detection Support Vector Machine (SVM) training classification module 32. The original data display module 31 is connected with the fall detection SVM training classification module 32 for fall detection, the test samples from the sole sensing insole 1 are directly sent to theclassifier 323 to generate classification results, and the classification results are sent to the mobile phone end control system 2.

The original data display module 31 is used for receiving, storing and analyzing the pressure and temperature data transmitted by the information transmission module 13, and displaying the sole information data and the dynamic change waveform curve in real time in an original data recording window.

In the fall detection Support Vector Machine (SVM) training classification module 32, a standing posture reference line and a sitting posture reference line of each person are calculated and obtained according to training samples and are marked, thecharacteristic extraction module 321 performs characteristic extraction on marked training data based on gait characteristics to obtain a fall detection characteristic vector, the fall detection characteristic vector is transmitted to theSVM training module 322, theSVM training module 322 inputs the extracted characteristic vector into a support vector machine model, continuous training is performed, model parameters are finally obtained, and the updated training model is transmitted and stored to theclassifier 323. The training data is classified by aclassifier 323, theresult evaluation module 324 evaluates theresult 324 by using three evaluation indexes of false alarm rate, missed detection rate and correct rate, the goal is to obtain a model with low false alarm rate, missed detection rate and high correct rate, otherwise, the threshold is automatically modified by theresult modification module 325, and the data after parameter modification is sent to theSVM training module 322 to be trained again until the model is optimal. When a fall event occurs, the plantar pressure curve exhibits two characteristics: firstly, the plantar pressure curve is changed violently, and the pressure value is reduced to be close to zero; secondly, the pressure value of the sole is maintained at a lower pressure value in one stage, so that the falling event is judged after the two characteristics occur. When the server-side fall detection system 3 receives new data, theclassifier 323 determines whether a fall event occurs, and sends the classification result to the mobile phone-side control system 2.

The invention also provides a tumble detection method, which comprises the following detailed steps:

after the old people wear the shoes with the sole sensing insoles 1, 11 thinfilm piezoresistor sensors 111 arranged in the sole sensing insoles 1 in the sole information acquisition module 11 can acquire and record pressure data generated by each movement.

After the information processing module 12 receives the pressure data from the sole information acquisition module 11, thesignal enhancement module 121 will filter and amplify the signal, convert the analog signal into a digital signal by using an analog-to-digital converter, store the digital signal in themicroprocessor 122, and package the data into a standard data format through a serial port and send the data format to the bluetooth module 131 of the information transmission module 13 according to a bluetooth transmission protocol, thereby completing the data acquisition.

The mobile phone end control system 2 is connected with the Bluetooth 131 of the information transmission module 13 of the sole sensing insole 1 to receive pressure data, and the data are synchronized to the server end tumble detection system 3 through the mobile phone end control system 2. After the server-side tumble detection system 3 receives the data, the original data display module 31 can display the data in two ways, the sole information data displays original pressure data, the change waveform curve displays a dynamic change curve, and the pressure change is displayed visually.

After receiving the labeled plantar pressure information, the fall prediction SVM training classification module 32 passes through thefeature extraction module 321 to show two features according to the plantar pressure curve under the condition of a fall: firstly, the plantar pressure curve is changed violently, and the pressure value is reduced to be close to zero; secondly, the sole pressure value is maintained at a lower pressure value marking sample in one stage, the standing posture reference line and the sitting posture reference line of each person are obtained through calculation, feature extraction is carried out on the data based on gait features, a feature vector of tumble detection is obtained, and the feature vector is transmitted to theSVM training module 322. TheSVM training module 322 trains the extracted feature vectors, the models are stored, the training data are classified by theclassifier 323 to obtain classification results, and then the results are evaluated 324 by using three evaluation indexes of false alarm rate, missed detection rate and accuracy, the goal is to obtain the models with low false alarm rate, missed detection rate and high accuracy, otherwise, the data after parameter correction are sent to theSVM training module 322 by theresult correction module 325 to be retrained until the models are optimal.

The server-side tumble detection system 3 classifies the behavior of the wearer by using theclassifier 323 of the optimal model each time, and sends the classification result to the mobile phone-side control system 2. When the classification result is a fall, the voice prompt module 23 of the mobile phone end control system 2 sends out "someone falls down and requests help! The emergency call module 21 also sends emergency information to the associated emergency contact, and the wearer can ask for help through the emergency call module 21 when encountering other emergency. In addition, the wearer may adjust the alert volume at the voice alert module 23.

In the aspect of temperature control function, athermistor sensor 112 is arranged in the sole information acquisition module 11 of the sole sensing insole 1, and can detect the sole temperature of a wearer in real time. Cell-phone end control system 2 is connected with the bluetooth 131 of the information transmission module 13 of sole perception shoe-pad 1 for transmit temperature information, cell-phone end control system 2 can synchronous data to server end fall detection system 3, and the display module 31 of this system can show temperature data with two kinds of modes, and sole information data shows original temperature data, and the wave form curve that changes shows dynamic variation curve, the temperature change of directly perceived show. The temperature regulation and control module 22 of the mobile phone end control system 2 can calculate the optimal temperature of the insole according to the difference between the temperature of the wearer and the ambient temperature, under the condition of over-cooling and over-heating, the mobile phone end control system 2 can send a control instruction to themicroprocessor 122 of the sole sensing insole 1 to control theheating sensor 113 arranged in the insole so as to achieve the effect of regulating the temperature, and the wearer can also select a manual mode to regulate and control the temperature of the insole.

Compared with the prior art, the invention has the following advantages:

1. the system is complete, and the sole sensing insole 1, the mobile phone end control system 2 and the server end tumble detection system 3 are controlled and coordinated with each other.

2. The server-side fall detection system 3 can predict falls, a fall detection classification model is formed by analyzing and training the collected sole information by using an SVM algorithm, and emergency alarm measures are taken in time when falls occur.

3. The thin film piezoresistor sensor is arranged according to two outstanding characteristics of the foot shape of the old, and is more targeted.

4. The liftable protruding massage point divide into ordinary version and special crowd's version, satisfies special crowd's demand, and the massage point sets up according to sole acupuncture point, and it is healthy to dress the shoe-pad for a long time.

It should be noted that in the embodiments of the present invention, the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", and the like indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, which is only for convenience of describing the embodiments, and do not indicate or imply that the referred device or element must have a specific orientation, be configured and operated in a specific orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

While the present invention has been described in detail with reference to the preferred embodiments thereof, it should be understood that the above description should not be taken as limiting the invention. Various modifications and alterations to this invention will become apparent to those skilled in the art upon reading the foregoing description. Accordingly, the scope of the invention should be determined from the following claims.

Claims (10)

1. A plantar sensing insole, comprising: the insole comprises an insole body, and a sole information acquisition module, an information processing module and an information transmission module which are arranged in the insole body, wherein the sole information acquisition module acquires sole sensing information by using a sensor, the information processing module processes the sole sensing information, and the information transmission module sends the sole sensing information.

2. The plantar sensing insole of claim 1, wherein the insole body comprises: the protruding layer of massage and the foraminiferous layer of range upon range of nested setting, contain multiunit massage subassembly in the protruding layer of massage, the massage subassembly contains the flexible gasbag and the massage arch that correspond the setting, the massage arch stretches out through-hole on the foraminiferous layer contacts with user's sole, plays the massage effect, flexible gasbag sets up the protruding below of massage, in order to control the bellied up-and-down motion of massage reaches better massage effect.

3. The plantar sensing insole of claim 2, wherein the massage assemblies are arranged according to the plantar reflex region and plantar acupuncture point distribution of the human body.

4. The sole sensing insole of claim 2, wherein said sole information collection module comprises: a plurality of piezoresistive sensors, at least one thermistor sensor, and at least one heating sensor disposed within the apertured layer;

at least one piezoresistive sensor is arranged in each area of the sole at a first metatarsophalangeal area, a second metatarsophalangeal area, a midfoot area, a medial heel area, a lateral heel area, a fifth metatarsophalangeal area, a fourth metatarsophalangeal area, a third metatarsophalangeal area and a 2-5 toe area; at least 2 piezoresistor sensors are arranged at the first toe area of the sole;

the thermistor sensor is arranged in the middle area of the heel of the sole;

the heating sensor is arranged in the central area of the sole of the foot in front of the sole of the foot.

5. The plantar sensing insole according to claim 4, wherein the information processing module comprises a signal enhancement module and a microprocessor disposed within the perforated layer;

the signal enhancement module is arranged in the middle foot area of the sole and is connected to the piezoresistor sensor and the thermistor sensor;

the microprocessor is arranged in the central area of the vertical connecting line of the center of the sole of foot and the middle part of foot and is connected to the heating sensor.

6. The plantar sensing insole of claim 5, wherein the information transmission module comprises a Bluetooth module disposed within the perforated layer.

7. A fall detection system, comprising: the sole sensing insole of any one of claims 1-6, a mobile phone end control system in communication with the sole sensing insole, and a server end fall detection system in communication with the mobile phone end control system;

the mobile phone end control system receives sole sensing information sent by the sole sensing insole and synchronizes the sole sensing information to the server end tumble detection system, and the mobile phone end control system regulates and controls the heating sensor in the sole sensing insole;

the server-side fall detection system detects falls according to the sole sensing information and controls the mobile phone-side control system to execute corresponding operations.

8. The fall detection system of claim 7, wherein said mobile phone end control system comprises: the system comprises an emergency call module, a temperature control module and a voice prompt module;

the emergency call module is used for sending emergency help-seeking information;

the temperature control module is used for controlling a heating sensor in the sole sensing insole;

the voice prompt module is used for broadcasting danger warning.

9. The fall detection method based on the fall detection system according to claim 8, characterized in that the pressure sensors in the sole sensing insole collect pressure data, the mobile phone control system receives sole sensing information sent by the sole sensing insole and synchronizes to the server-side fall detection system, the server-side fall detection system judges the pressure data collected in real time according to a sample training model obtained by the support vector machine, and when the pressure value drops to zero or is lower than a set threshold within a set time, the server-side fall detection system judges the fall event.

10. A fall detection method as claimed in claim 9, wherein in the event of a fall, the emergency call module in the mobile phone terminal control system sends out emergency information, and the voice prompt module broadcasts a danger warning.

Images