Summary of the invention
The elderly house overall view monitoring nursing system and side that the purpose of the present invention is to provide a kind of based on artificial intelligenceMethod is monitored and nurses to the house life of the elderly, utilize artificial intelligence solution in conjunction with the analytical judgment technology of artificial intelligenceIt analyses image and row state captures, the exception of old man is judged by calculating, and speech recognition is combined to carry out a variety of judgements, solve existing rankThe elderly of section monitors nurse problem.
To achieve the above object, the embodiment of the present invention provides a kind of the elderly house overall view monitoring based on artificial intelligence and seesProtecting system, the overall view monitoring nursing system include microprocessor, and overall view monitoring nursing system is arranged in the place of house, describedOverall view monitoring nursing system further includes abnormal sound detection module, human figure analysis module, track morphological analysis module, leads and take the photographAs module and sub- photographing module；
The abnormal sound detection module establishes a connection with the microprocessor, abnormal sound detection module pass through byThe abnormal sound state of the elderly's voice signal of acquisition and preset normal sound signal contrast detection the elderly；
The human figure analysis module establishes a connection with the microprocessor, human figure analysis module for pairThe elderly's morphological image information of acquisition carries out human body attitude analytical judgment；
The track morphological analysis module establishes a connection with the microprocessor, and morphological analysis module in track is used for willThe position parameter data association of the elderly of acquisition in different time period analyzes and determines the track form of the elderly；
The main photographing module establishes a connection with the microprocessor, and the main photographing module is taken the photograph configured with several mastersAs head, main camera is laid in house place locating for the elderly in parlor, and main photographing module is obtained old by main cameraImage information of the people in the place of house in parlor；
The sub- photographing module establishes a connection with the microprocessor, and the sub- photographing module is taken the photograph configured with several sonsAs head, sub- camera is laid in house place locating for the elderly in bedroom, kitchen or toilet, and sub- photographing module is taken the photograph by sonAs head obtains image information of the elderly in the place of house in bedroom, kitchen or toilet.
As the preferred embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the abnormal sound inspectionIt surveys in module, the voice signal that when abnormal sound state of contrasting detection the elderly is analyzed includes wavelength of sound, wave crest or troughParameter；In the human figure analysis module, the human body attitude of analytical judgment includes sitting posture, stance, prone position and lying posture.
As the preferred embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the main photographing moduleIt is each configured with location parameter with sub- photographing module, the location parameter of several main cameras and several sub- cameras is stored in advance,By carrying out judging to determine the corresponding the elderly's location parameter of image information to the camera identity information for obtaining image information.
As the preferred embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the overall view monitoring is seenProtecting system further includes sound output module, and sound output module establishes a connection with the microprocessor, sound output moduleConfigured with loudspeaker, sound output module is used to carry out the preset acoustic information of overall view monitoring nursing system by the loudspeakerOutput；
The overall view monitoring nursing system further includes memory module, and memory module and the microprocessor establish connection passSystem, memory module are used to store image, sound, track or the human figure information of overall view monitoring nursing system.
As the preferred embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the overall view monitoring is seenProtecting system further includes holder module, and the holder module establishes a connection with the microprocessor, and holder module is used for masterSeveral main cameras of photographing module configuration and several sub- cameras of sub- photographing module configuration are manipulated.
As the preferred embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the overall view monitoring is seenProtecting system further includes door lock interlocking module, and door lock interlocking module establishes a connection with the microprocessor, door lock interlocking moduleLinkage control is carried out for the discrepancy electronic lock to house place locating for the elderly.
As the preferred embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the overall view monitoring is seenProtecting system further includes WiFi module and 4G module, and the WiFi module establishes a connection with the microprocessor, WiFi moduleThe docking, cloud docking or short message server docking of mobile device are carried out for overall view monitoring nursing system；
The 4G module establishes a connection with the microprocessor, and 4G module is for overall view monitoring nursing system in old ageCall is carried out when human hair life abnormal conditions.
The present invention also provides a kind of, and the elderly house overall view monitoring based on artificial intelligence sees maintaining method, the overall view monitoringSee that maintaining method is realized using above-mentioned overall view monitoring nursing system, what the overall view monitoring saw random order in maintaining method executes stepRapid a, b, c, in which:
A, image, sound, track or the human figure information parameter of memory module storage overall view monitoring nursing system are called,Location parameter is respectively configured to main photographing module and sub- photographing module, several main cameras and several sub- cameras is stored in advanceLocation parameter determines the corresponding the elderly of image information by judging the camera identity information for obtaining image informationLocation parameter；
B, main camera is laid in house place locating for the elderly in parlor, main photographing module is called to pass through main camera shootingHead obtains image information of the elderly in the place of house in parlor；
C, sub- camera is laid in house place locating for the elderly in bedroom, kitchen or toilet, calls son camera shootingModule obtains image information of the elderly in the place of house in bedroom, kitchen or toilet by sub- camera；
After step a, b, c for being finished above-mentioned, execution step d, e, f of random order, in which:
D, human figure analysis module is called to carry out human body attitude analytical judgment to the elderly's morphological image information of acquisition；
E, the position parameter data association of the elderly for calling morphological analysis module in track will acquire in different time periodThe track form of the elderly is analyzed and determined；
F, abnormal sound detection module is called to pass through the elderly's voice signal that will acquire and preset normal sound signalThe abnormal sound state of contrasting detection the elderly.
The preferred embodiment of maintaining method, the abnormal sound inspection are seen as the elderly house overall view monitoring based on artificial intelligenceIt surveys in module, the voice signal that when abnormal sound state of contrasting detection the elderly is analyzed includes wavelength of sound, wave crest or troughParameter；In the human figure analysis module, the human body attitude of analytical judgment includes sitting posture, stance, prone position and lying posture.
See that the preferred embodiment of maintaining method, the overall view monitoring are seen as the elderly house overall view monitoring based on artificial intelligenceIt further include that WiFi module is called to dock overall view monitoring nursing system with mobile device, cloud or short message server in maintaining method；4G module is called to carry out call when the elderly is abnormal situation.
The embodiment of the present invention is had the advantages that be run using high performance micro embedded processor as system and be carriedBody, carries out video acquisition with 360 degree of cameras, carries out voice collecting with high-performance sound pick-up, passes through WiFi and 4G/5G technologyIt realizes calling, data transmission, storage, APP, WEB access of data is showed using proprietary mysorethorn, is made of main equipment and sub- equipment,Installation may be selected in user, can extend intelligent door lock linkage, the automatic opening door lock when old solitary people needs first aid, expansible distal endManipulating visual dialog can also be by distally directly opening the screen of old man and adjusting camera even if old man is ignorant of operating, and progress canDepending on dialogue, image is parsed using artificial intelligence and row state captures, the exception of old man is judged by calculating, and combine speech recognitionA variety of judgements are carried out, solves the problems, such as that the elderly at this stage monitors nurse, so that the elderly is timely succoured, reduce meaningThe danger that outer situation causes.
Specific embodiment
The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention..
Referring to Fig. 1, a kind of the elderly house overall view monitoring nursing system based on artificial intelligence, the overall view monitoring nurseSystem includes microprocessor 1, and microprocessor 1 can monitor circuit using MAX705, and MAX705 is a kind of micro- place easy to useIt manages device and monitors circuit, output reset signal when power-up, power down and voltage reduce, independent suvveiuant tvacker timer output.In 1.6sInterior suvveiuant tvacker timer input terminal is not triggered, and it is effective that suvveiuant tvacker timer output becomes low level.1.25V threshold supervisionDevice, for the Power Supply Monitoring other than power failure alarm, low voltage test or+5V.Stabilization, the low level of TTL/CMOS compatibilityEffectively.
Overall view monitoring nursing system is arranged in the place of house, and the overall view monitoring nursing system further includes abnormal sound inspectionSurvey module 2, human figure analysis module 3, track morphological analysis module 4, main photographing module 5 and sub- photographing module 6；The exceptionSound detection module 2 establishes a connection with the microprocessor 1, and abnormal sound detection module 2 passes through the elderly that will acquireThe abnormal sound state of voice signal and preset normal sound signal contrast detection the elderly；The human figure analysis module3 establish a connection with the microprocessor 1, and human figure analysis module 3 is used for the elderly's morphological image information to acquisitionCarry out human body attitude analytical judgment；The track morphological analysis module 4 establishes a connection with the microprocessor 1, track shapeTrack shape of the position parameter data association of the elderly that state analysis module 4 is used to will acquire in different time period to the elderlyState is analyzed and determined；The main photographing module 5 establishes a connection with the microprocessor 1, and the main photographing module 5 configuresThere are several main cameras, main camera is laid in house place locating for the elderly in parlor, and main photographing module 5 passes through main camera shootingHead obtains image information of the elderly in the place of house in parlor；The sub- photographing module 6 is established with the microprocessor 1 to be connectedRelationship is connect, the sub- photographing module 6 is configured with several sub- cameras, and sub- camera is laid in house place locating for the elderly and crouchesIn room, kitchen or toilet, sub- photographing module 6 obtains the elderly by sub- camera and bedroom, kitchen or defends in the place of houseImage information between life.
In one embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the abnormal sound inspectionIt surveys in module 2, the voice signal that when abnormal sound state of contrasting detection the elderly is analyzed includes wavelength of sound, wave crest or troughParameter；Since when the elderly is abnormal situation, the size and intonation of sound can change, the sound acquired under abnormalityThe data that sound wave length, wave crest or trough parameter can be acquired with normal condition change, so as to by seeing in overall view monitoringThe elderly's wavelength of sound, wave crest or the trough parameter of preset normal condition acquisition in protecting system, by being adopted during comparison monitoringThe elderly's wavelength of sound, wave crest or the trough parameter of collection judge whether to be abnormal situation.
In the human figure analysis module 3, the human body attitude of analytical judgment includes sitting posture, stance, prone position and lying posture.ByIn under normal circumstances, the elderly will not be sitting in or lie on the floor, such as the places such as bottom plate, kitchen in parlor, so as to pass throughThe location of the posture of posture analysis and the elderly to the elderly judges whether to be abnormal situation, when the elderly is inParlor, kitchen, toilet playground in (discharge sofa, there are normal sitting position or the places of prone position for closestool etc.) there is prone positionOr when lying posture, it is possible to determine that unusual condition has occurred in the elderly.
Analytical judgment for posture also can realize posture by machine learning algorithm using in the prior artJudgement, is able to solve human body attitude problem analysis, such as Stacked Hourglass algorithm by full convolutional network.
In one embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the main photographing module5 and sub- photographing module 6 be each configured with location parameter, the position ginseng of several main cameras and several sub- cameras is stored in advanceNumber judges to determine that the corresponding the elderly position of image information is joined by carrying out to the camera identity information for obtaining image informationNumber.By carrying out the increase of position attribution to camera, so as to obtain the location parameter in photographic image header, such as kitchenCamera shooting the corresponding location parameter of image be exactly kitchen.
In one embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the overall view monitoring is seenProtecting system further includes sound output module 7, and sound output module 7 establishes a connection with the microprocessor 1, and sound exports mouldBlock 7 is configured with loudspeaker, and sound output module 7 is used to carry out the preset sound letter of overall view monitoring nursing system by the loudspeakerThe output of breath.
In one embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the overall view monitoring is seenProtecting system further includes memory module 8, and memory module 8 establishes a connection with the microprocessor 1, and memory module 8 is for storingImage, sound, track or the human figure information of overall view monitoring nursing system.
In one embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the overall view monitoring is seenProtecting system further includes holder module 9, and the holder module 9 establishes a connection with the microprocessor 1, and holder module 9 is used forSeveral sub- cameras that several main cameras and sub- photographing module 6 to the configuration of main photographing module 5 configure manipulate.Holder mouldBlock 9 can use BSP-15, cradle head control information is sent to 87LPC764 by I2C bus first, 87LPC764 will be controlledAfter code is explained, RS485 interface chip MAX487 is forwarded to by serial port, so that control code is sent to by RS485 interfacePTZ camera.When PTZ camera receives control code, according to requiring to carry out corresponding holder operation.In addition, 87LPC764An interrupt line being connected in pci bus can be interrupted to BSP-15 application to notify BSP-15 cradle head control state, Yi JixiangBSP-15 application sends other data.
In one embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the overall view monitoring is seenProtecting system further includes door lock interlocking module 10, and door lock interlocking module 10 establishes a connection with the microprocessor 1, door lock interlockingModule 10 is used to carry out linkage control to the discrepancy electronic lock in house place locating for the elderly.Intelligent door lock is to be different from traditionIt is improved on the basis of mechanical lock, user security, identification, the more intelligent easy of managerial aspect lockset.It is such as distantControl lock realizes the chain of door lock and mobile phone or remote control by wireless signals such as network, bluetooths using wireless technology and technology of Internet of thingsIt connects.Most common is exactly to be unlocked by Bluetooth of mobile phone/APP, WIFI, entrance guard intercommunication system etc..
In one embodiment of the elderly house overall view monitoring nursing system based on artificial intelligence, the overall view monitoring is seenProtecting system further includes WiFi module 11 and 4G module 12, and the WiFi module 11 establishes a connection with the microprocessor 1,WiFi module 11 carries out the docking of mobile device, cloud docking or short message server docking for overall view monitoring nursing system；InstituteIt states 4G module 12 to establish a connection with the microprocessor 1,4G module 12 is for overall view monitoring nursing system in old human hairCall is carried out when raw abnormal conditions.
Referring to Fig. 1 and Fig. 2, the present invention also provides a kind of the elderly house overall view monitoring nurse side based on artificial intelligenceMethod, the overall view monitoring see that maintaining method is realized using above-mentioned overall view monitoring nursing system, and the overall view monitoring is seen in maintaining methodExecution step a, b, c of random order, in which:
A, memory module 8 is called to store image, sound, track or the human figure information ginseng of overall view monitoring nursing systemNumber, is respectively configured location parameter to main photographing module 5 and sub- photographing module 6, several main cameras is stored in advance and several sons are taken the photographAs the location parameter of head determines that image information is corresponding by judging the camera identity information for obtaining image informationThe elderly's location parameter；
B, main camera is laid in house place locating for the elderly in parlor, main photographing module 5 is called to take the photograph by masterAs head obtains image information of the elderly in the place of house in parlor；
C, sub- camera is laid in house place locating for the elderly in bedroom, kitchen or toilet, calls son camera shootingModule 6 obtains image information of the elderly in the place of house in bedroom, kitchen or toilet by sub- camera；
After step a, b, c for being finished above-mentioned, execution step d, e, f of random order, in which:
D, it calls the elderly's morphological image information of 3 pairs of human figure analysis module acquisitions to carry out human body attitude analysis to sentenceIt is disconnected；
E, the position parameter data association of the elderly for calling track morphological analysis module 4 will acquire in different time periodThe track form of the elderly is analyzed and determined；
F, abnormal sound detection module 2 is called to pass through the elderly's voice signal that will acquire and preset normal sound signalThe abnormal sound state of contrasting detection the elderly.
The elderly house overall view monitoring based on artificial intelligence sees in one embodiment of maintaining method that the abnormal sound is examinedIt surveys in module 2, the voice signal that when abnormal sound state of contrasting detection the elderly is analyzed includes wavelength of sound, wave crest or troughParameter；In the human figure analysis module 3, the human body attitude of analytical judgment includes sitting posture, stance, prone position and lying posture.
The elderly house overall view monitoring based on artificial intelligence sees in one embodiment of maintaining method that the overall view monitoring is seenIt further include calling WiFi module 11 by overall view monitoring nursing system and mobile device, cloud or short message server pair in maintaining methodIt connects；4G module 12 is called to carry out call when the elderly is abnormal situation.
The elderly house overall view monitoring based on artificial intelligence is seen in one embodiment of maintaining method, it is contemplated that sub- cameraInstallation it is more troublesome, for this situation, head may can also be taken the photograph with a master by the repulsion of client, be equipped with a frame withoutMan-machine (being integrated on unmanned plane relative to by sub- camera), main head of taking the photograph still complete task before it, take the photograph head in addition, main and existThink that monitored people is likely to occur in unexpected situation, control unmanned plane takes off to specified region (it is believed that monitored people is eachWhat the door in a room was open) carry out image or sound signal collecting, and it is sent to main camera, complete monitored people's stateArtificial intelligence judgement.
The embodiment of the present invention can find in time the elderly fall down to the ground for a long time do not rise, into toilet for a long time do not come out,Go out non-return home for a long time, daily getting up early time has no the abnormal morphologies such as get up, and carries out row state analytical judgment by image, passes throughVoice calls house old man that can dial older mobile phone or home phone number such as without response, such as continues unmanned response, can contact old manHousehold, or calling community, property etc. may provide department and the personnel of salvage service, have reached the mesh of relief house old man in time, dangerous generation is avoided as far as possible.The calling for help of the elderly can also be identified, and exhale in time by speech recognition and dialog speechIt is salvor, provides relief to house the elderly.General dialogue can be realized with house the elderly, the elderly is reminded to take medicine,It the functions such as has a meal, rest.The present invention by using high performance micro embedded processor as system operation carrier, with 360It spends camera and carries out video acquisition, voice collecting is carried out with high-performance sound pick-up, exhaled by the realization of WiFi and 4G/5G technologyIt cries, data transmission, storage, APP, WEB access of data is showed using proprietary mysorethorn, is made of main equipment and sub- equipment, Yong HukeSelection installation can extend intelligent door lock linkage, and the automatic opening door lock when old solitary people needs first aid, expansible distal end manipulation canIt, can also be by distally directly opening the screen of old man and adjusting camera even if old man is ignorant of operating depending on dialogue, it is visual right to carry outWords parse image using artificial intelligence and row state capture, and the exception of old man are judged by calculating, and speech recognition is combined to carry outA variety of judgements solve the problems, such as that the elderly at this stage monitors nurse, the elderly are enable timely to be succoured, reduce unexpected feelingsThe danger that condition causes.
Although above having used general explanation and specific embodiment, the present invention is described in detail, at thisOn the basis of invention, it can be made some modifications or improvements, this will be apparent to those skilled in the art.Therefore,These modifications or improvements without departing from theon the basis of the spirit of the present invention are fallen within the scope of the claimed invention.