Embodiment
Below, present embodiment is described.In addition, below the present embodiment of explanation is not that the content that is used for claim of the present invention is put down in writing is carried out irrational qualification.In addition, the formation that illustrates in the present embodiment all is not a necessary structure important document of the present invention.
1. aggregation system
Use Fig. 1 that the aggregation system of present embodiment is described.As shown in Figure 1, aggregation system is made of a plurality of subsystems such as mover system, family's subsystem or car intra subsystems.In addition, the subsystem of present embodiment is not limited thereto, for example, can also be susceptible to the vehicles (electric car, aircraft) beyond the company's intra subsystem, shop intra subsystem, car subsystem etc., have the various subsystems of sensor and controlling object equipment.
As shown in Figure 1, user (user) is carrying portable electric appts 20 (mobile gateway).In addition, near the eyes of head one side, worn Wearable display 93 (mobile display), as mobile controlling object equipment.And, on one's body with as the various sensors of Wearable sensor (movable sensor).Particularly, worn indoor and outdoor sensor 510, ambient temp sensor 511, periphery humidity sensor 512, periphery luminance sensor 513, wrist formula motion determination sensor 520, pulse (heart rate) sensor 521, body temperature trans 522, subcutaneous temperature sensor 523, perspiration sensor 524,foot pressure sensor 530, speak/chew sensor 540, (Global Position System: GPS) sensor 550 to be arranged on GPS on the portableelectric appts 20, be arranged on color sensor 560 on the Wearable display 500 and pupil size sensor 561 etc.Constitute mover system (broadly being called first subsystem) by these portableelectric appts 20, mobile controlling object equipment and Wearable sensor.
Personal digital assistant), portable information terminal such as notebook PC portable electric appts 20 (mobile computer) is PDA (Personal Digital Assistant:, for example have processor (CPU), storer, guidance panel, communicator or display (sub-display) etc.This portableelectric appts 20 for example can have with inferior function: the function of the sensor information of the autobiography sensor of collecting; Carry out the function of calculation process according to collected sensor information; Controlling object equipment (Wearable display etc.) is controlled (show control etc.) or read the function of information from external data base according to operation result; And the function that communicates with the outside.In addition, portableelectric appts 20 can also be also used as mobile phone, wrist-watch or pocket audio frequency apparatus etc.
Wearable display 93 is worn near user's eyes, and it is littler than pupil size to be configured to the size of its display part, as the information display section performance function of so-called perspective view finder (see through viewer).In addition, can use earphone, Vib. to wait at user's information indicating carries out.In addition, as mobile controlling object equipment, exceptWearable display 93, for example can also be susceptible to various devices such as wrist-watch, mobile phone or pocket audio frequency apparatus.
Indoor and outdoor sensor 510 is to detect the user to be positioned at indoor or outdoor sensor, for example radiates ultrasound wave, measures the time till ceiling etc. is returned ultrasonic reflections.But, indoor and outdoor sensor 510 is not limited to the ultrasound wave mode, also can be the sensor of active smooth mode, passive ultraviolet mode, passive infrared mode, passive noisy mode.
Ambient temp sensor 511 for example uses thermistor, radiation thermometer, focus equity to measure ambient temperature.Periphery humidity sensor 512 for example utilizes resistance to measure humidity on every side with the variation of humidity.Periphery luminance sensor 513 for example uses photovalve to measure brightness on every side.
Wrist formula motion determination sensor 520 utilizes acceleration transducer and angular acceleration transducer to measure user's list action.Can come to measure more exactly user's everyday actions, walking state by using this motion determination sensor 520 and foot pressure sensor 530.Pulse (heart rate) sensor 521 is worn on finger or ear, utilizes the variation of ultrared transmissivity and reflectivity to measure the variation of blood flow with pulsation.Body temperature trans 522, subcutaneous temperature sensor 523 use thermistor, radiation thermometer, thermoelectric equity to measure user's body temperature and subcutaneous temperature.Perspiration sensor 524 is for example measured the perspiration of skin according to the variation of skin surface impedance.Foot pressure sensor 530 detects the distribution of sole to the footwear applied pressure, and mensuration is also judged user's standing state, the state of sitting down, walking state etc.
Speak/chew sensor 540 and be and be used to measure the user and speak (dialogue) or chewing the ear type sensor of the possibility of (having a dinner), in its housing, be built-in with bone-conduction microphone and external sound microphone.Bone-conduction microphone detects speak/chews the vibration that produces and propagate in vivo in the Shi Congti, i.e. sound in the body.The external sound microphone detects because of speaking to the vibration of external propagation,, comprises the external sound of voice and neighbourhood noise that is.And, compare processing etc. by the power in the unit interval of sound that bone-conduction microphone and external sound microphone are captured, measure in a minute possibility and chew possibility.
GPS sensor 550 is the sensors that detect customer location.In addition, also can use the positional information server of mobile phone to replace GPS sensor 550.Color sensor 560 for example disposes optical sensor near facial, to comparing by the brightness behind a plurality of optical band pass filters, measure color.Pupil size sensor 561 for example disposes camera near pupil, the signal of camera is analyzed, and measures the pupil size.
Family's subsystem for example has following family's controlling object equipment: family's displays such as TV monitor, PC monitor; The AV of family such as audio frequency apparatus, Disc player equipment; Dog shape, cat shape, humanoid etc. robot; Regulate the air-conditioning of room temperature; Regulate the working flare of brightness etc.In addition, as family's controlling object equipment, for example can also be susceptible to following various device: home appliance such as game machine, suction cleaner, electric cooker, refrigerator, micro-wave oven and safety feature etc.
In addition, family's subsystem for example has following tame chamber sensor: the environmental sensor of measuring temperature, humidity, brightness, noise, the user session in the family and having a dinner etc.; The robot that is built in the robot carries sensor; Each that is arranged on family within doors, the people detection sensor on the door etc.; Be arranged on uroscopy in the toilet with sensor etc.In addition, in addition,, for example can also be susceptible to various sensors such as safety sensor (theft-proof sensor, heat/cigarette/gas security etc.), seismic sensor, power consumpting determining sensor, pollen sensor as tame chamber sensor.And, constitute family's subsystem (broadly being called second subsystem) by these family's controlling object equipment and tame chamber sensor.
The car intra subsystem has following car inner control object-based device: the automobile navigation instrument (guider) that carries out the road guiding; Automobile such as audio frequency apparatus, Disc player AV equipment; And the air-conditioning of adjusting vehicle interior temperature etc.In addition, in addition,, for example can also be susceptible to safety equipment, seat adjustment equipment such as air bag, adopt the various devices such as lock/unlock equipment, communication facilities and truck-mounted computer of the car door of smart entry system as car inner control object-based device.
In addition, the car intra subsystem has following car inner sensor: the transport condition sensor of measuring the speed of a motor vehicle, displacement etc.; Measure user's driver behavior, the operational state sensors of operation of equipment; And the environmental sensor of temperature, humidity, brightness and user session etc. in the mensuration car etc.In addition, in addition,, for example can also be susceptible to various sensors such as theft-proof sensor, people detection sensor, pollen sensor as the car inner sensor.And, constitute car intra subsystem (broadly being called the 3rd subsystem) by these car inner control object-based devices and car inner sensor.
In the aggregation system of Fig. 1, be in the user under the situation of outdoor grade (situation of mobile environment), obtain (collection) sensor information (secondary information that comprises sensor), upgrade user history information according to obtained sensor information from the Wearable sensor (movable sensor) of mover system.And, carry out the control of mobile controlling object equipment according to user history information etc.In addition, user history information is at least one the historical information (log information) in action, state and the environment about the user.
On the other hand, be under the situation in the family (situation of home environment), obtain sensor information, upgrade user history information according to obtained sensor information from the tame chamber sensor of family's subsystem the user.That is, under the situation in transferring to home environment, the user history information of upgrading in mobile environment also can (seamless) be upgraded by seamlessly.In addition, according to user history information etc. family's controlling object equipment is controlled.
In addition, under the situation in the user is in car (situation of environment inside car), obtain sensor information, upgrade user history information according to obtained sensor information from the car inner sensor of car intra subsystem.That is, under the situation in transferring to environment inside car, the user history information of upgrading in mobile environment or home environment also will seamlessly be upgraded.In addition, according to user history information etc. car inner control object-based device is controlled.
For example, the user takes off Wearable sensor (indoor and outdoor sensor etc.), mobile controlling object equipment (Wearable display etc.) when getting home or when moving in the car possibly.In this case,, also can use tame chamber sensor or car inner sensor to replace the Wearable sensor and obtain sensor information, therefore can seamlessly upgrade user history information according to the aggregation system of Fig. 1.For example, having a dinner in the having a dinner and being in when going out, except can obtain continuously have a dinner constantly and the history of meal time etc., can also carry out the accumulation calculation process etc. of energy consumption and pressure according to inside and outside status of action and heart rate state.
In addition, can mobile controlling object equipment not controlled, but family's controlling object equipment or car inner control object-based device are controlled, can improve user convenience thus.For example, on the less Wearable display in viewing area, do not show, but on bigger family's display in viewing area or auto navigation display, show information based on user history information etc., perhaps can control, can improve convenience out of contior controlling object equipment in the mobile environment (for example air-conditioning, working flare, automobile navigation instrument etc.).
2. control system
Fig. 2 shows the structure example of control system 25 of the present embodiment of the aggregation system that is applicable to Fig. 1.In addition, control system 25 is not limited to the structure of Fig. 2, can realize various distortion: for example omit the part (for example information obtaining section, information storage medium etc.) in its textural element, perhaps append other textural elements etc.
Information obtaining section 230 obtains the sensor information from a plurality of sensors of a plurality of subsystems.For example, obtain the sensor information of Wearable sensor 12 (broadly being called first sensor) from the mover system, from the sensor information of the tame chamber sensor 14 (broadly being called second sensor) of family's subsystem, from the sensor information of the car inner sensor 16 (broadly being called the 3rd sensor) of car intra subsystem.Particularly, obtain from sensor information as lower sensor: measure user's action (walking, talk with, have a dinner, trick action, emotion performance or sleep etc.) the action sensor, measure User Status (tired, nervous, on an empty stomach, the state of mind, condition or occur in user's incident on one's body etc.) state sensor, measure the environmental sensor of user environment (place, brightness, temperature or humidity etc.).
In addition, sensor can be a sensor component itself, also can be the sensor device that also comprises control part and Department of Communication Force etc. except sensor component.In addition, sensor information can be the sensor primary information that directly obtains from sensor, also can be by the sensor primary information being processed the sensor secondary information that processing (information processing) obtains.
Information obtaining section 230 for example can be waited by Department of Communication Force 232 or sensor I/F (interface) portion 234 and realize.For example, in that (Bluetooth: registered trademark) such near radio or WLAN etc. obtain under the situation of (reception) sensor information from sensor, use Department of Communication Force 232 by infrared ray or bluetooth.On the other hand, obtaining from sensor under the situation of sensor information, using sensor I/F portion 234 by USB, IEEE1394, the such wired electric signal of card I/F.
The sensor informations that handling part 240 is obtained according to information obtaining section 230 etc. are carried out required various processing in action of control system 25 etc.The function of this handling part 240 can wait by various processors (CPU etc.), ASIC hardware such as (gate arrays etc.) or the program in the information storage medium 284 of being stored in and realize.
Handling part 240 can comprise historical information renewal portion 248 and incident detection unit 250.In addition, can omit the part in these textural elements, or append other textural elements.
Historical information renewal portion 248 carries out the renewal of historical information and handles.Particularly, when taken place second subsystem can use incident (sensor can use incident, controlling object equipment can use incident) time, according to from sensor information, user history information is upgraded as second sensor of the sensor of second subsystem.That is, upgrade user history information according to the sensor information that obtains by information obtaining section 230.For example, carried out the historical user's (using the user of first subsystem) who upgrades of user for the sensor information that according to sensor is first sensor (for example Wearable sensor) from first subsystem (for example mover system), when this user can newly use second subsystem (for example family's subsystem) (when for example transferring to the environment of second subsystem), according to sensor information, further be updated in the user history information after upgrading in first subsystem from second sensor of second subsystem.Then, the user history information after upgrading is stored in the historical information storage part 262.
In this case,, when storing new historical information, can delete old historical information, the new historical information of storage in the storage area that empties by deletion in order to save the memory size of historical information storage part 262.Perhaps, can give priority (weight coefficient) to each historical information, when storing new historical information, the lower historical information of deletion priority.In this case, can determine according to following situation that is: whether once user history information was carried out renewal, whether once based on this historical information controlling object equipment carried out control based on this historical information at the priority level initializing of each historical information.That is,, set higher priority for the historical information of the control of renewal that once was used for user history information or controlling object equipment.Like this, both can the conserve memory capacity, can in historical information storage part 262, keep again based on the renewal of sensor information and the effective historical information of control of controlling object equipment.Certainly, also can upgrade (covering) historical information by stored historical information and new historical information are carried out computing.
Incident detection unit 250 carries out the determination processing of variety of event.Particularly, judgement can be used the generation of incident, and this can use representations of events to use the user of first subsystem newly to become the state that can use second subsystem.For example, judge that whether sensor has taken place can be used incident (can access sensors incident, can obtain the sensor information incident), this can use Sensor Events to be meant: become the sensor that can use second subsystem according to carried out the user that user history information upgrades from the sensor information of the sensor of first subsystem, i.e. second sensor.Perhaps, judge whether device events taken place to use (can access means incident, can opertaing device incident) that this can use device events to be meant to become the controlling object equipment that can use second subsystem, the i.e. second controlling object equipment.Perhaps, judge whether taken place to become can not use second subsystem (second sensor, the second controlling object equipment) can not use incident.For example, during near the place of (moving to) second subsystem, incident detection unit 250 can be judged to be and take place to use incident the user.Perhaps, when carrying out information transmission, can judge the generation that to use incident by wireless by detecting wireless strengths.Perhaps, when the equipment (for example portable electric appts) of first subsystem and the breakout box (cradle) (being arranged on the breakout box in the place of second subsystem) that can in second subsystem, use when linking to each other, be judged to be and taken place to use incident.
Then, when having taken place to use incident, historical information renewal portion 248 obtains the sensor information from second sensor of second subsystem, upgrades user history information according to obtained sensor information.
Storage part 260 is workspaces of handling part 240 and information obtaining section 230 etc., and its function can wait by storeies such as RAM or HDD (hard disk drive) and realize.The historical information storage part 262 storage user history information that storage part 260 is comprised, this user history information is by at least one historical information at least one sensor action, state and the environment that obtain, about the user in the environmental sensor of the action sensor of measuring user's action, the state sensor of measuring User Status and mensuration user environment.
Information storage medium (computer-readable medium) 284 stored programmes and data etc., its function can wait and realize by CD (CD, DVD).Handling part 240 carries out the various processing of present embodiment according to the program (data) that is stored in the information storage medium 284.That is, in information storage medium 284, store the functional programs (being used to make computing machine to carry out the program that each several part is handled) that is used for making computing machine (device that possesses operating portion, handling part, storage part, efferent) performance present embodiment each several part.
Fig. 3 illustrates the detailed structure example of the control system 25 of present embodiment.In addition, control system 25 is not limited to the structure of Fig. 3, can implement various distortion.
In Fig. 3, handling part 240 also comprises sensor selection portion 242, controlling object choice of equipment portion 244, operational part 246 and control and treatment portion 252 except comprising historical information renewal portion 248 and incident detection unit 250.In addition, can omit the part in these textural elements, perhaps append other textural elements.
Sensor selection portion 242 is carried out the selection of sensor and is handled.Particularly, the subsystem (the residing subsystem of user) of selecting the user using from a plurality of sensors of a plurality of subsystems can use the sensor of (can visit, can obtain information).For example, when the user moves to the place of family's subsystem (second subsystem), thetame chamber sensor 14 that selection can be used in family's subsystem (second sensor, second sensor groups).In addition, when the user moves to the place of car intra subsystem (the 3rd subsystem), the carinner sensor 16 that selection can be used in the car intra subsystem (the 3rd sensor, the 3rd sensor groups).
More specifically, sensor selection portion 242 can according to temporal information (year, month, week, day, constantly etc.), at least one information in customer site information (position, affiliated area, distance etc.) and the user's condition information (spirit/condition, on one's body the user event etc.), be TPO (Time Place Occasion: time place occasion) information, the sensor that selection can be used from a plurality of sensors.That is,, also to select different sensors according to TPO information even in same subsystem.
In addition, TPO information can be obtained according to the sensor information from sensor, also can or come the data download of automatic network to wait and obtain according to subscription table data (calendar information).In addition, the selection of sensor directly (initiatively) is carried out, and also (passive) carries out indirectly.For example, can directly not select sensor itself, but by selecting resulting sensor information to select sensor indirectly.For example, when utilizing wireless sensor information when communication of carrying out, wait according to label information additional in each sensor information and to select the sensor information that to use, come to select indirectly sensor thus.
For example, in position probing, do not adopt the GPS sensor, but adopt the inertial navigation method of having utilized acceleration transducer indoor.Therefore, when detecting in user's inlet chamber according to sensor information when obtaining representing to be positioned at indoor information (for example can not accurately obtain from the positional information of GPS sensor or by the indoor and outdoor sensor), do not select sensor information, but select to carry out the position computing from the sensor information of acceleration transducer from the GPS sensor.At this moment,, can realize economize on electricity, alleviate wireless traffic, alleviate the load that sensor information is handled by stopping the GPS sensor.
Controlling object choice of equipment portion 244 carries out the selection of controlling object equipment and handles.Particularly, select controlling object equipment from a plurality of controlling object equipment of a plurality of subsystems, this controlling object equipment is subjected to using the control of user history information.In other words, from a plurality of controlling object equipment of a plurality of subsystems, the subsystem (the residing subsystem of user) of selecting the user using can use the controlling object equipment of (can visit, can control).For example, when the user moves to the place of family's subsystem (second subsystem), family'scontrolling object equipment 94 that selection can be used in family's subsystem (broadly being called the second controlling object equipment).In addition, when the user moves to the place of car intra subsystem (the 3rd subsystem), the car inner control object-based device 96 that selection can be used in the car intra subsystem (broadly being called the 3rd controlling object equipment).
And when having taken place to use incident, the second controlling object equipment of second subsystem is selected by controlling object choice of equipment portion 244.In addition, even taken place to use incident, if but do not need to select controlling object equipment, then also can not select controlling object equipment.That is, not only judge whether can use, whether also will judge needs to select.
More specifically, the controlling object equipment that can use can be selected according to TPO information by controlling object choice of equipment portion 244 from a plurality of controlling object equipment.That is,, also to select different controlling object equipment according to TPO information even in same subsystem.
In addition, the selection of controlling object equipment directly (initiatively) is carried out, and also (passive) carries out indirectly.For example, can directly not select controlling object equipment itself, and select this controlling object equipment indirectly by the required information (data, signal) of output controlling object equipment.
For example, do not need the control and the air-conditioning control of the illumination/AV equipment in living room when having a bath, and the control of water temperature and bus TV (TV) helps the user, therefore selects these controlling object equipment.In this case, can send image to bus TV, also can only send the channel information of playing the program of being liked from home server.
Operational part 246 carries out the Screening Treatment (selecting to handle) and the required various calculation process of analyzing and processing of the sensor information that obtained by information obtaining section 230.Particularly, operational part 246 carries out the multiplication process and the addition process of sensor information.For example, carry out measured value X as shown in the formula shown in (1)jWith coefficient AIjLong-pending and computing, measured value XjBe the value that obtains having carried out digitizing from a plurality of sensor informations of a plurality of sensors, coefficient AIjEach coefficient storage in coefficient storage portion (not shown), represent with two-dimensional matrix.Then, shown in (2), the result of long-pending and computing as multidimensional coordinate, is calculated n n dimensional vector n YiWherein, i is the i coordinate of n-dimensional space, and j distributes to each number of sensor.
[formula 1]
[formula 2]
Yi=A00X0+......+AijXj......+AnmXm ......(2)
By carrying out the calculation process of following formula (1) (2), can realize from the sensor information that obtains, removing the Screening Treatment of unwanted sensor information and discern user's action, state, analyzing and processing of environment (TPO information) etc. according to sensor information.For example, if the coefficient A that will multiply each other with the measured value X of pulse (heart rate), volume of perspiration, body temperature is set at than the big value of coefficient at the measured value of other sensor informations, the numerical value Y that then utilizes following formula (1) (2) to calculate represents " excitement levels " as User Status.In addition, by the coefficient that will multiply each other with the measured value X of the amount of speaking and with coefficient settings that the measured value X of foot pressure multiplies each other be suitable value, the action that can identify the user is the dialogue or speak while walking or thinking or be in sleep state etc. silently of being seated.Control and treatment portion 252 is used for various processing that controlling object equipment is controlled.For example, when having taken place to use incident and having selected the second controlling object equipment, begin the control action second controlling object equipment, that use user history information.For example, make the control part of the second controlling object equipment begin controlling object is controlled.In this case, also can begin the second controlling object equipment, use from the sensor information of second sensor of second subsystem and the control action of user history information.Perhaps, when having taken place to use incident, can make the control (indication) of the power connection (recovery normal operation mode) of the second controlling object equipment.Perhaps, when taken place the user can't re-use the second controlling object equipment can not use incident the time, can make the control of the power-off (transferring to low-power consumption mode) of the second controlling object equipment.
The output information that output information storage part 264 storages that storage part 260 is comprised are transmitted to controlling object equipment by information transport unit 270.
Information transport unit (information output part) 270 is to transmission information such as mobile controlling object equipment, family's controlling object equipment and car inner control object-baseddevices 92,94,96, and its function can wait and realize by Department of Communication Force 272 or equipment I/F portion 274.For example, when controlling object equipment transmits (transmission) information (data), use Department of Communication Force 272 in the communication that utilizes wireless grade.On the other hand, utilizing wired electric signal when controlling object equipment transmits (output) information (control signal), use equipment I/F portion 274.
Next, use Fig. 4 A, Fig. 4 B that the action of present embodiment is described.Fig. 4 A is the process flow diagram that upgrades about user history information.Here, with following situation is that example describes, that is: using user's (is that the sensor information of first sensor has been carried out the user that user profile is upgraded according to the sensor from first subsystem) of first subsystem to transfer to the state that can use second subsystem (second sensor).
At first, incident detection unit 250 judges whether to use second subsystem (second sensor) (step S1).For example, when the user moves to the place of second subsystem, can use second subsystem.Then, under situation about can use, the sensor (second sensor) (step S2) that 242 selections of sensor selection portion can be used in second subsystem.In this case, also can select sensor according to user's TPO information.
So information obtaining section 230 obtains the sensor information (step S3) from selected sensor.Then, historical information renewal portion 248 upgrades user history information according to obtained sensor information, and the user history information after upgrading is stored in (step S4) in the historical information storage part 262.In addition, when being judged as in step S1 still can not use second subsystem time, proceeding based on the sensor from first subsystem is that the user history information of the sensor information of first sensor is upgraded.
Fig. 4 B is the process flow diagram about the control and treatment of controlling object equipment.Here, with following situation is that example describes, that is: using user's (the controlling object equipment that is carrying out first subsystem is the user of the control of first controlling object) of first subsystem to transfer to the state that can use second subsystem (the second controlling object equipment).
At first, incident detection unit 250 judges whether to use second subsystem (the second controlling object equipment) (step S11).Then, under situation about can use, the controlling object equipment (step S12) that 244 selections of controlling object choice of equipment portion can be used.In this case, can select the controlling object equipment that can use according to user's TPO information.So, from historical information storage part 262, read user history information (step S13).Then, information transport unit 270 is selected from output information storage part 264 according to the user history information of being read will be to the output information (step S14) of selected controlling object equipment transmission, export selected output information to controlling object equipment, the control action (step S15) of beginning controlling object equipment.In addition, in step S11, be judged as in the time of still can not using second subsystem, continue the control of the controlling object equipment (the first controlling object equipment) of first subsystem.
For example in Fig. 4 A, if selection and user's TPO information corresponding sensor then can be selected different sensors according to place, time, situation.Therefore, can realize that the sensor information of intelligence obtains processing more according to being that the sensor information that obtains makes sensor information have different implications under which place, time, situation.In addition, by selection and place, time, appropriate sensor that state is corresponding, can upgrade user history information exactly.
In addition, being used for obtaining the sensor selection that TPO judges the sensor information of usefulness, judge effective sensor or select the sensor that can detect the TPO variation as long as select for TPO.For example, in above-mentioned example,, select for indoor location determination (TPO judgement) effective sensor, i.e. acceleration transducer indoor.But, only depend on acceleration transducer, move to the outdoor situation that can use the GPS sensor thereby can't detect from indoor, can not select sensor once more.Therefore, in this case, the preferred also prior above-mentioned indoor and outdoor sensor of selecting.
In addition, for example in family's subsystem, when the user is in the living room, select luminance sensor and temperature sensor in order to throw light on the control of control and air-conditioning.On the other hand, when the user is in the toilet,, select the uroscopy sensor in order to generate user's health status historical information.In addition, when the user when the robot, for robot being made a response to the user or using robot to upgrade user's action historical information, select robot lift-launch sensor.In addition, in the time period by day, select temperature sensor in order to carry out air-conditioning control; In the time period at night, for measure the user in sleep body temperature and generate user health situation historical information, the selective body temperature sensor is perhaps selected theft-proof sensor for the purpose of safety.In addition, when the user is in the situation of having much to do,, the illumination that makes the user obtain loosening selects luminance sensor for controlling; When the user is in the leisure during situation, for the robot control of dismissing user time and select robot to carry sensor.
In addition, in Fig. 4 B,, then can select different controlling object equipment, can realize the device control of intelligence more according to place, time, situation if selected the controlling object equipment corresponding with user's TPO information.
For example in family's subsystem, be in the user under the situation in living room or in the time period after the user gets up, in order to dismiss user's time, select controlling object equipment such as family's display, AV equipment or robot.Perhaps, as user during near family display, AV equipment or robot, select the user close equipment.On the other hand, be in the user under the situation in bedroom or in the time period at night,, select controlling object equipment such as air-conditioning and working flare in order to realize user's comfortable sleep.In addition,, then select robot for the user is cheered up if the user is in bloodless situation, and if the user is in busy situation, then make the music that the user obtains loosening and select the AV of family equipment in order to play.
In Fig. 5, more specifically show from family via car, outdoor, indoor and move to the sensor selected according to TPO under the situation of company and the example of controlling object equipment.During driver's seat in the user moves to car, select transport condition sensor, operational state sensors, environment inside car sensor etc.In addition, as controlling object equipment, select automobile navigation instrument, automobile AV equipment, air-conditioning, Drowse-proof device etc.
Move in the car under the situation of outdoor and walking the user, select the Wearable sensor of GPS, acceleration, pulse etc.In addition, select the controlling object equipment of Wearable display, mobile AV equipment, mobile phone, wrist-watch etc.On the other hand, as user during, select the Wearable sensor of GPS, acceleration, pulse etc. and be installed in indoor environmental sensor indoor stopping.In addition, as controlling object equipment, select hithermost terminal of user or display.
When the user arrives company and when taking one's seat, select the Wearable sensor of pulse etc., the sensor that is installed in the environment/state sensor on indoor or the unit desk and monitors the operation history of PC.In addition, as controlling object equipment, the terminal/PC on the selection desk, working flare, air-conditioning etc.
According to the method for above present embodiment, when the user is mobile between a plurality of subsystems, can realize the seamless renewal of user history information.
For example in Fig. 6 A, the user in going back home is connected on portableelectric appts 20 and charges on thebreakout box 21 etc.By being connected of this andbreakout box 21, can select and startrobot 300 as the controlling object equipment of family's subsystem, become the state that can use this robot 300.In this case, the user history information of upgrading in mobile environment is stored in the historical information storage part of portableelectric appts 20, comescontrol robot 300 according to this user history information.Particularly, judge the user has got on to drink meeting and talked with the colleague on the road of coming home from work lively atmosphere according to userhistory information.So robot 300 for example carries out " atmosphere of the meeting of drinking today is as awfully hot strong " such speech act when the user is close.Thus, the user torobot 300 known own inrobot 300 place not on the scene action and feel novel, can produce the feelings of liking torobot 300, can realize the control of unprecedented robot.In addition, for example tired out or out of spirits the time,robot 300 encourages user's speech act when judge user job according to user history information.Thus, the user can like more just as the situation of realizing oneself and therobot 300 that gives encouragement.
In addition, like this, in the time of in the user goes back home, can using therobot 300 of family's subsystem, can also use robot to carry sensor.And, can be updated in the user history information of upgrading in the mobile environment according to the sensor information of carrying sensor from robot.
Particularly, shown in Fig. 6 B, inrobot 300, for example be equipped with feeler 319, the sensor 320 of speaking, pulse transducer 321, body temperature trans 322, perspiration sensor 323 etc.And,, can judge the state of the spirit, health etc. of user when getting home by the reaction that the detection users such as feeler 319 of being carried by robot speak torobot 300.
For example, for " atmosphere of the meeting of drinking today is as awfully hot strong " this inquiry among Fig. 6 A fromrobot 300, shown in Fig. 6 B, when feeler 319 or the sensor 320 of speaking detect subscriber's meter sure reaction are shown, it is correct can judging " having gone the meeting of drinking after the work " this estimation result, can generate user history information more accurately.
In addition, in the present embodiment, shown in Fig. 6 A, 6B, when the user for example takes off Wearable sensors such as speak/chewing sensor 540, pulse transducer 521, body temperature trans 522, perspiration sensor 523 after family, use speak sensor 320, pulse transducer 321, body temperature trans 322 and the perspiration sensor 323 that carry inrobot 300, replace these Wearable sensors.Then, use the sensor information of carrying sensor from these robots, in mobile environment, upgrading according to the user history information of upgrading from the sensor information of Wearable sensor.Promptly, shown in the D1 of Fig. 6 C, speak amount, pulse, volume of perspiration etc. according to measure the user from the sensor information of carrying speak sensor 320, pulse transducer 321 and perspiration sensor 323 inrobot 300 continue the user history information that obtains in the mobile environment is upgraded.According to this mode,, also can seamlessly upgrade user history information even take off the user under the situation of Wearable sensor.
In Fig. 7 A, user in riding in car is installed in portableelectric appts 20 when having set up communication path on thebreakout box 21 that is provided with in the car or based near radios such as bluetooths, can communicate between as theguider 700 of the controlling object equipment of car intra subsystem and portable electric appts 20.Thus, the user history information of upgrading in mobile environment or home environment is sent to guider 700 from portableelectric appts 20, can carry out demonstration control of auto navigation display etc. according to the user history information that sends.
Particularly, when the amount of exercise of judging the user according to user history information (walking amount) is not enough, shown in Fig. 7 B, on the auto navigation display ofguider 700, show the guide picture of recommending healthy dining room.Thus, the user can thing that make a response feels novel and surprised to the action of knowing oneself unexpectedly is historical, andunprecedented guider 700 can be provided.In addition, historical for example the shifting to an earlier date under the situation of the consumer premise arrangement of determining according to reservation table that take action according to the definite user of user history information, can also carry out as inferior Navigation Control: the road path of navigation that setting has surplus.
In addition, also can not use the built-in GPS sensor 550 of the portableelectric appts 20 that receiving sensitivity reduces in the car, but utilize the GPS sensor 720 ofguider 700 or gyro sensor 721 inner sensor of waiting for bus, discern user's accurate mobile route etc., upgrade user history information.Particularly, in environment inside car, shown in the E1 of Fig. 7 C, according to upgrading user history information from the sensor information of car inner sensor (GPS).In addition, when the user gets off and when environment inside car turns back to mobile environment, shown in E2, the E3 of Fig. 7 C, current according to upgrading user history information from the sensor information of Wearable sensor.Therefore, can realize that the seamless renewal of user history information is handled, can access more appropriately and user history information accurately.
In addition, the application examples of the method for present embodiment is not limited to Fig. 6 A~Fig. 7 C.For example, can also be: when the user goes back home, takes off Wearable display and close family display, the control action of beginning family display, on family's display rather than on the Wearable display, the explicit user historical information reaches the information based on this.In addition, can detect the user to the image that shows on family's display or the selection operation history of program, upgrade user history information according to detected operation history by operation sensor.
In addition, can also be: when the user went back home, according to the user history information relevant with temperature that is obtained by the ambient temp sensor as the Wearable sensor, the control action of air-conditioning in the beginning man carries out air-conditioning control.For example, be under the situation about emitting in hot the going back home judge the user according to user history information, carry out air-conditioning control to reduce temperature in the family.Perhaps, user in going back home has taken off under the situation of Wearable sensors such as ambient temp sensor and peripheral luminance sensor, ambient temp sensor and the peripheral luminance sensor that can select to be installed in family's subsystem environment replace these Wearable sensors, continue user history information is upgraded.
In addition, can also be: in the time of in the user moves to car, if judge user's mental fatigue according to the user history information in mobile environment or the home environment (state parameter), then begin the control action of automobile AV equipment, for example carry out the control of the broadcast etc. of therapeutic type music.In addition, can also be according to upgrading user history information from the operation information of the controlling object equipment of car intra subsystem or from the sensor information of the sensor of car intra subsystem.Particularly, according to from the sensor information of environment inside car sensor, user operation information (information of for example bearing circle operation, auto navigation operation), continue user history information such as state of user parameter are upgraded at controlling object equipment such as car and automobile navigation instruments.
3. user history information
Next, the renewal processing of user history information and the concrete example of user history information are described.Fig. 8 is the process flow diagram that the example that the renewal of user history information handles is shown.
At first, information obtaining section 230 obtains sensor information (step S21).Then, 246 pairs of sensor informations that obtain of operational part are screened and the calculation process (step S22) of parsing etc.Then, infer user's action, state, environment etc. (TPO, emotion) (step S23) according to operation result.Then, historical information renewal portion 248 is stored in the historical information storage part 262 with time on date (year, month, week, day, constantly) etc. the user of action, state etc. who infers the user who is historical relatedly, and user history information is upgraded (step S24).
The concrete example of the schematically illustrated user history information of Fig. 9.The data structure of the user history information of Fig. 9 is associated with the time period, the moment etc. for the history of user action etc.For example, 8 of users walked to station from oneself from family in 8 o'clock to 8: 20 time period, arrived the A station of leaving home nearest in 8: 20.Then, assign in time period of 8: 45 8: 20 and to take electric car, getting off from the nearest B station of company in 8: 45,9 arrival companies start working.10 o'clock to 11 o'clock time period,, in 12 o'clock to 13 o'clock time period, have lunch with corporator's meeting.
Like this, in Fig. 9, be associated with the time period and the moment etc., construct user history information thus according to the history of inferring user's action of etc. from the information of sensor etc.
Among this external Fig. 9, the measured value of the measuring in a minute of the user who is determined by sensor etc., the amount of having a dinner, pulse, volume of perspiration etc. is also with the time period with constantly be associated.For example, in 8 o'clock to 8: 20 time period, the user walks to A station from family, by the walking amount of sensor determination this moment etc., and is associated with time period of 8 o'clock to 8: 20.In this case, the measured value of the sensor information beyond all right further related walking speed, volume of perspiration etc., the walking amount.Can grasp the amount of exercise of user in this time period etc. thus.
In 10 o'clock to 11 o'clock time period, user and colleague carry out meeting, are associated by the amount of speaking of sensor determination this moment and with time period of 10 o'clock to 11 o'clock.In this case, the further measured value of the sensor information of associated sound state, pulse etc.Thus, can grasp speak amount and the tensity etc. of user in this time period.
Assign in the time period of 21: 45 and 22 o'clock to 23 o'clock 20: 45, the user is playing games or is seeing TV, and the pulse of this moment, volume of perspiration etc. were associated with these time periods.Thus, can grasp the excitement levels etc. of user in these time periods.
In 23 o'clock 30 fens later time periods, the user is in the sleep, and this moment, user's body temperature variation was associated with this time period.Thus, user's health status in the time of can grasping sleep.
In addition, user history information is not limited to the mode of Fig. 9.Also can implement distortion, for example under situation the about history of user action etc. and time on date etc. not being associated, construct user history information.
For example in Figure 10 A, according to speak amount, sound status, pulse, volume of perspiration etc. as the measured value of sensor information, arithmetic expression is according to the rules come computing user's state of mind parameter.For example, if the amount of speaking is many, then state of mind parameter height represents that user's the state of mind is good.In addition, according to as the walking amount of the measured value of sensor information, walking speed, body temperature etc., arithmetic expression is according to the rules come the parameter (amount of exercise parameter) of computing user's condition (health status).For example, if amount of exercise is many, then condition parameter height represents that user's condition is good.
Shown in Figure 10 B, utilize histogram etc. that user's the state of mind, the parameter of condition (broadly being called state parameter) is visual, above-mentioned parameter is presented on Wearable display, family's display or the auto navigation display thus.Therefore, according to present embodiment, for example can use the state of mind of in mobile environment, upgrading, the user history information such as parameter of condition, shown in Figure 10 B that parameter is visual and be presented on the family's display or the auto navigation display in the environment inside car in the home environment.Perhaps, can be according to the parameter of the state of mind of upgrading in the mobile environment, condition etc., the robot in the control home environment, the action that makes robot encourage the user or make suggestions to the user.Perhaps, can also in environment inside car, carry out and user's mental status, the corresponding navigation or the music of parameter of health.
In addition, when the user is mobile between a plurality of subsystems (move, family, car in etc.), can obtain sensor information, continue User Status parameters such as the state of mind, condition are carried out seamless renewal from the sensor that can in each subsystem, use.
4. system architecture
Next, the various system architecture examples to present embodiment are specifically described.In addition, hereinafter, for convenience of explanation, be that mover system etc., second subsystem are that the situation of family's subsystem (robot) or car intra subsystem (guider) is that example describes mainly, but present embodiment is not limited thereto with first subsystem.
4.1 the first system architecture example
Figure 11 illustrates the first system architecture example.In Figure 11, portableelectric appts 20 utilizes WLAN or breakout box etc. to communicate withrobot 300 to be connected.And the processing of the control system 25 of the present embodiment of explanation can realize by the handlingpart 340 ofrobot 300 among Fig. 2, Fig. 3 etc.Perhaps, can be by realizing by the handlingpart 40 of portableelectric appts 20, the dispersion treatment that thehandling part 340 ofrobot 300 carries out.
In Figure 11, when according to having carried out from the sensor information of the sensor of mover system that the more capable user of user history information goes back home and duringnear robot 300,incident detection unit 350 be judged as robot 300 (the second controlling object equipment of second subsystem) taken place can use incident.
In addition,information transport unit 370 is carried out the transmission of user history information and is handled between the historical information storage part 362 (the second historical information storage part) of the historical information storage part 62 (the first historical information storage part) of portable electric appts 20 (first subsystem) and robot 300 (second subsystem).Thus, the user history information of upgrading in mobile environment is transmitted and is stored in the historical information storage part 362.In addition, also can carry out information synchronization and handle, that is: will be stored in the historicalinformation storage part 62 user history information be stored in user history information in the historicalinformation storage part 362 and remain the information of identical content.
In addition, when takenplace robot 300 can use incident the time, the control action of beginningrobots 300 of control and treatment portion 352.Particularly, bring into use the control action that is sent to the user history information in the historical information storage part 362.That is, 386 beginnings of robot control part makerobot 300 carry out exercises such as speech act as the control of the robot motion mechanism 390 (actuator, loudspeaker, LED etc.) of controlling object.
In addition, historicalinformation renewal portion 348 upgrades processing according to the sensor information of carrying sensor 310 (second sensor of second subsystem) from robot to the user history information that is sent in the historicalinformation storage part 362.
According to this mode, for example as shown in Figure 6A, when the user who goes back home links portableelectric appts 20 on thebreakout box 21 and duringnear robot 300, can userobot 300 and with its starting.Then,robot 300 carries out the actions such as speech act corresponding with the user history information in the mobile environment.In addition, shown in Fig. 6 B, when the user made a response to the speech act ofrobot 300 etc., this reaction was carried sensor 310 (319~323) by robot and is detected.Then, shown in the D1 of Fig. 6 C,, seamlessly upgrade user history information according to the sensor information of carryingsensor 310 from robot.
In addition, whether the judgement that can use incident ofrobot 300 can be carried out near robot 300 (family's subsystem) according to the user.Particularly, by detecting the wireless strengths of communicating by letter of carrying out between portable electric appts 20 (mover system) and the robot 300 (family's subsystem), can judge the generation that to use incident.For example,, be judged as incident (can visit, can control event) has taken place to use nearrobot 300 and wireless strengths is higher than under the situation of defined threshold the user.Perhaps, also can be under portable electric appts 20 (equipment of first subsystem) be connected to situation on thebreakout box 21 of Fig. 6 A in the place that is arranged in family's subsystem (second subsystem), be judged to berobot 300 taken place can use incident.
In addition, can use under the situation of incident having taken place like this, can carry out following control: the power supply of connectingrobot 300 makes its starting, or makesrobot 300 return to normal operation mode from low-power consumption mode.Perhaps, no longer can use under the situation that can not use incident ofrobot 300 in that the user has been taken place, can carry out following control: closingmachine people 300 power supply stops it, or makes robot 30 transfer to low-power consumption mode from normal operation mode.
4.2 the second system architecture example
Figure 12 illustrates the second system architecture example.Be provided with the home server of family's subsystem in Figure 12, promptly home server 120.Thishome server 120 carries out the required processing of control of various controlling object equipment in family's subsystem (for example robot, air-conditioning or working flare etc.), carries out and outside (information transmission) processing etc. of communicating by letter.
And in the system of Figure 12, portableelectric appts 20 utilizes WLAN or breakout box etc. to communicate withhome server 120 to be connected, andhome server 120 utilizes WLAN etc. to communicate withrobot 300 to be connected.And the processing of the control system 25 among Fig. 2, Fig. 3 etc. can realize by the handlingpart 140 of home server 120.Perhaps, can be by realizing by the handlingpart 40 of portableelectric appts 20, the handlingpart 140 ofhome server 120, the dispersion treatment that thehandling part 340 ofrobot 300 carries out.
In the time of near the user who is carrying portableelectric appts 20 is positioned at house, can utilize WLAN to carry out communicating by letter between portableelectric appts 20 and the home server 120.Perhaps, by being placed on the breakout box, portableelectric appts 20 communicates.
Then, when having set up communication path, transmit historical informations to the historicalinformation storage part 162 of family's side from the historicalinformation storage part 62 of mobile side.Particularly, between historicalinformation storage part 62 and historicalinformation storage part 162, carry out the synchronous processing of user history information.Then,robot 300 moves under the control of home server 120.That is, according to the user history information in the historicalinformation storage part 162 that is stored inhome server 120, beginning control action and moving.With Fig. 6 A is example, and the user history information in 152 pairs of historicalinformation storage parts 162 of the control and treatment portion ofhome server 120 is analyzed, androbot 300 is indicated control, so that it carries out the speech act corresponding with user history information etc.According to this mode, under the very big situation of the size of data of user history information, can the historical information storage part be arranged in therobot 300, therefore, can realize the low cost and the miniaturization of robot 300.In addition, can be inhome server 120, transmission and the calculation process with the leading subscriber historical information handled on monobasic ground, therefore can realize the robot control of intelligence more.
In addition, system according to Figure 12, take place robot 300 can the use incident before (for example detect user near or when moving to the place of second subsystem), information transport unit 170 can transmit user history information from historical information storage part 62 to historical information storage part 162 in advance.For example, the user to family and near before the robot 300 (particularly, at the information table from the GPS sensor of one of Wearable sensor of carrying as the user user being shown arrives the opportunity at nearest station or is being shown from the information table as the door switching sensor of one of tame chamber sensor opportunity etc. that the user opens the door of entry), in advance the user history information of upgrading in the mobile environment is transmitted and is written in the historical information storage part 162 of home server 120.Then, when the user has taken place to use incident near robot 300, beginning robot 300, use the control action be sent to the user history information in the historical information storage part 162 in advance.That is, starting robot 300,386 pairs of robot motion mechanisms 390 of robot control part control, and make it carry out the action shown in Fig. 6 A for example etc.According to this mode, after robot 300 startings, can begin robot control immediately based on user history information, make the control high efficiency.
In addition, in Figure 12, be arranged on the judgement thatincident detection unit 150 in the home server 120 (home server) of family's subsystem (second subsystem) carries out using incident.Particularly, as user during, be judged to be and taken place to use incident near the place of family subsystem.Then, be arranged on the control action of the 152 beginningrobots 300 of control and treatment portion in the home server 120.In addition, the historicalinformation renewal portion 148 in thehome server 120 of being arranged on upgrades user history information according to the sensor information of carryingsensor 310 grades from robot.In addition, also can upgrade user history information according to the sensor information of the Wearable sensor of carrying from other family's chamber sensors or user.
Ifincident detection unit 150, control andtreatment portion 152, historicalinformation renewal portion 148 etc. are set in family's subsystem in this wise,, also can reflect the control of up-to-date user's history all the time even then carried out the switching of subsystem.In addition, needs can be carried out poll etc., handle heavy processing such as incident judgement of load and distribute to the high home server ofprocessing power 120, the processing that therefore can alleviate portable electric appts 20 (mover system) is loaded.In addition,, then other each several parts can be set at low-power consumption mode (sleep state), can realize economize on electricity if only make theincident detection unit 150 and 170 actions of information transport unit ofhome server 120.
4.3 the 3rd system architecture example
Figure 13 illustrates tertiary system system structure example.In Figure 13, be provided withexternal server 620 as the master server of aggregation system.Thisexternal server 620 constitutes the required processing of the control of controlling object equipment of a plurality of subsystems of aggregation system and the communication between the subsystem (information transmission) to be handled etc.
And in the system of Figure 13, portableelectric appts 20 utilizes wireless WAN such as PHS to communicate to be connected withexternal server 620, andexternal server 620 also utilizes wireless WAN such as PHS to communicate to be connected with robot 300.And the processing of control system 25 can realize by the handlingpart 640 of external server 620.Perhaps, by realizing by the handlingpart 40 of portableelectric appts 20, the handlingpart 640 ofexternal server 620, the dispersion treatment that thehandling part 340 ofrobot 300 carries out.
Portableelectric appts 20 androbot 300 wait each unit suitably to communicate withexternal server 620, carry out the synchronous processing (transmit and handle) of user history information.For example, the opportunity that stops in the unit, historicalinformation storage part 662 from from these unit toexternal server 620 is uploaded user history information, on the opportunity of user's starting, from the user history information ofexternal server 620 to these unit download historical information storage parts 662.These are uploaded, download process is waited byinformation transport unit 670 and realizes.In addition, in Figure 13, externally be provided withincident detection unit 650 and historicalinformation renewal portion 648 in theserver 620, can unify to carry out to use the determination processing of incident and the renewal of user history information to handle.
In addition, in Figure 13, can not judge that whether approaching the user is with family according to wireless strengths.Therefore, in this case, for example can wait the position of judging the user according to the position register information of the base station of PHS, judge the user whether be positioned at family near.Perhaps, also can judge according to the GPS sensor of Wearable sensor 12.And, when be judged as the user be in the family near the time, can utilize the control ofexternal server 620 grades to startrobot 300.
4.4 Quaternary system system structure example
Figure 14 illustrates the structure example of Quaternary system system.In Figure 14, be provided with as theexternal server 620 of master server with as thehome server 120 of home server.
In the system of Figure 14, portableelectric appts 20 utilizes wireless WAN such as PHS to communicate to be connected withexternal server 620,external server 620 utilizes wired WAN such as ADSL to communicate to be connected withhome server 120,home server 120 utilizes WLAN etc. to communicate withrobot 300 to be connected.And the processing of the control system of present embodiment can wait by the handlingpart 640 ofexternal server 620 and realize.Perhaps can be by realizing by the handlingpart 40 of portableelectric appts 20, the handlingpart 640 ofexternal server 620, the handlingpart 140 ofhome server 120, the dispersion treatment that thehandling part 340 ofrobot 300 carries out.
Suitably communicating by letter withexternal server 620 in each unit such as portableelectric appts 20,home server 120, carries out the synchronous processing (transmit and handle) of user history information.In addition, utilize position register information, GPS sensor, the microphone of PHS to wait to judge the user whether be positioned at family near, be positioned at when neighbouring when being judged as, the user history information of the historicalinformation storage part 662 ofexternal server 620 is downloaded to thestorage part 160 ofhome server 120, the control action of beginningrobot 300.
According to the system of Figure 14, therefore monobasic ground leading subscriber historical information and upgrade to handle in theserver 620 externally can provide the control system that is suitable for the aggregation system that is made of a plurality of subsystems.
4.5 the 5th system architecture example
Figure 15 illustrates the 5th system architecture example.In Figure 15, portableelectric appts 20 utilizes near radios such as bluetooth or breakout box etc. to communicate to be connected with guider 700.And the processing of control system 25 can realize by the handlingpart 740 of guider 700.Perhaps, can be by realizing by the handlingpart 40 of portableelectric appts 20, the dispersion treatment that thehandling part 740 ofguider 700 carries out.In addition, the processing of handlingpart 740 can also realize by the handling part of truck-mounted computer.
In Figure 15, when according to having carried out user that user history information upgrades from the sensor information of the sensor of mover system or family's subsystem when moving in the car,incident detection unit 750 be judged as guider 700 (the second controlling object equipment of second subsystem) taken place can use incident.
In addition,information transport unit 770 is between the historical information storage part 762 (the second historical information storage part) of the historical information storage part 62 (the first historical information storage part) of portable electric appts 20 (first subsystem) and guider 700 (second subsystem), carrying out the transmission of user history information handles, thus, the user history information of upgrading in mobile environment or home environment is transmitted and is stored in the historicalinformation storage part 762.
In addition, when having taken place to use incident, the control action of control andtreatment portion 752 beginning auto navigation displays, 790 grades.Particularly, 786 pairs of auto navigation displays 790 as controlling object of control part are controlled, and use the user history information that is sent in the historicalinformation storage part 762 to carry out display action etc. thus.
In addition, historicalinformation renewal portion 748 upgrades user history information according to from the sensor information of the car inner sensor 16 (GPS sensor, gyro sensor, touch sensor etc.) of guider 700 (car intra subsystem) etc.
According to this mode, for example shown in Fig. 7 A, when the user after getting on the bus receives portableelectric appts 20 on thebreakout box 21 or detects the user and got on the bus by near radio, set up communication path, transmit user history information from portableelectric appts 20 navigation device 700.Then, shown in Fig. 7 B, carry out the demonstration control of auto navigation display according to user history information.In addition, according to the sensor information of theinner sensor 16 of waiting for bus from GPS sensor, gyro sensor, touch sensor, the history of the action of identification user in the car intra subsystem, state etc.Then, shown in the E1 of Fig. 7 C,, seamlessly upgrade user history information according to sensor information from car inner sensor 16 (GPS sensor etc.).In addition, after the user got off, for example the historicalinformation storage part 762 fromguider 700 transmitted user history information to the historicalinformation storage part 62 of portable electric appts 20.Then, shown in E2, the E3 of Fig. 7 C,, also to seamlessly upgrade user history information walking around from environment inside car when moving on to the mobile environment.
5. the selection of sensor, controlling object equipment
Next, the concrete example of the system of selection of sensor and controlling object equipment is described.
For example, in Figure 16 A, be in the user under the situation of mobile environment, whenincident detection unit 50 is judged to be can useWearable sensor 12, mobile controllingobject equipment 92 time,sensor selection portion 42 is selectedWearable sensor 12, and mobilecontrolling object equipment 92 is selected by controlling object choice of equipment portion 44.Then, historicalinformation renewal portion 48 is according to from the sensor information ofWearable sensor 12 user history information being upgraded.In addition, control andtreatment portion 52 begins the control action of mobilecontrolling object equipment 92.
On the other hand, in Figure 16 B, the user moves to the home environment from mobile environment, andincident detection unit 50 is judgedtame chamber sensor 14, the family'scontrolling object equipment 94 of whether can using.And under situation about can use,sensor selection portion 42 is selectedtame chamber sensor 14, and family'scontrolling object equipment 94 is selected by controlling object choice of equipment portion 44.In addition, historicalinformation renewal portion 48 is according to from the sensor information oftame chamber sensor 14 user history information being upgraded.And, the action control of control andtreatment portion 52 beginning family controllingobject equipment 94.
Like this, in Figure 16 A, 16B, no matter the user is in the mobile environment still is in the home environment, portableelectric appts 20 all can carry out the renewal of historical information and the control of controlling object according to sensor information, has to have realized that terminal device is shared and do not needed the synchronous advantage of user history information.
But, under the user is in situation in the home environment, take off portableelectric appts 20 probably.In addition, when portableelectric appts 20 is moved all the time, the electric power of meeting unnecessary consumption portableelectric appts 20.
Therefore, in Figure 17 A~Figure 18, when the user when mobile environment (the first subsystem environment) moves to the home environment (the second subsystem environment), carry out portableelectric appts 20 is stopped the control to wait.
For example in Figure 17 A, because the user is in the mobile environment, therefore mobile side is in power connection state (or normal operation mode), and family'scontrolling object equipment 94 is in power down state (or low-power consumption mode).In addition, theinformation transport unit 170 of theinformation transport unit 70 of mobile side and family's side is in power connection state (normal operation mode) all the time.
And mobilecontrolling object equipment 92 is selected by the controlling object choice ofequipment portion 44 of mobile side, and selected mobilecontrolling object equipment 92 is controlled.In addition, thesensor selection portion 42 of mobile side is selectedWearable sensor 12, and the historicalinformation renewal portion 48 of mobile side is according to upgrading user history information from the sensor information ofWearable sensor 12.
On the other hand, in Figure 17 B, the user moves to the home environment from mobile environment.In this case, judge whether to use family'scontrolling object equipment 94, under situation about can use, family'scontrolling object equipment 94 becomes power connection state (normal operation mode).Then, theinformation transport unit 70 of mobile side is read user history information from historicalinformation storage part 62, is sent to family's side.So theinformation transport unit 170 of family's side receives this user history information and writes historical information storage part 162.Then, selecttame chamber sensor 14, beginning is upgraded based on the user history information from the sensor information of tame chamber sensor 14.In addition, control beginning family controllingobject equipment 94, that use user history information.Then, mobile side becomes power down state (low-power consumption mode).
In Figure 18, the user turns back to the mobile environment from home environment.In this case, mobile side becomes power connection state (normal operation mode).Then, theinformation transport unit 170 of family's side is read user history information from historicalinformation storage part 162, is sent to mobile side.So theinformation transport unit 70 of mobile side receives this user history information, writes historical information storage part 62.Then, family'scontrolling object equipment 94 becomes power down state (low-power consumption mode).
Method according to Figure 17 A~Figure 18, under the user is in situation in the mobile environment, family's controlling object equipment 94 (or family's subsystem) is in power down state (low-power consumption mode), under the user is in situation in the home environment, mobile side becomes power down state, has therefore realized the low-power consumption of mobile side and family's side.And, in this case,,,, also can carry out the seamless renewal of user history information between subsystem even then the user moves as long as transmitted user history information as Figure 17 B and shown in Figure 180.In addition, no matter the user is in mobile environment still is in the home environment, information transport unit 70,170 is in power connection state (normal operation mode) all the time, therefore can realize the transmission processing of user history information and the supervision processing that user environment changes exactly.
Figure 19 is the process flow diagram of detailed process example that the method for Figure 17 A~Figure 18 is shown.At first, judge whether to use family's controlling object equipment 94 (step S31).Then, under situation about can use, select this family's controlling object equipment 94 (step S32), connect the power supply (step S33) of selected family controlling object equipment 94.Perhaps, make it return to normal operation mode from low-power consumption mode.
Next, transmit user history information (step S34) from historicalinformation storage part 62 to the historicalinformation storage part 162 of family's subsystem.Then, begin to use from the user history information of the sensor information oftame chamber sensor 14 and upgrade (step S35).And, begin to carry out control action (step S36) family'scontrolling object equipment 94, that use user history information.
Next, close the power supply (step S37) of portable electric appts 20.Perhaps, make it transfer to low-power consumption mode.But information transport unit (Department of Communication Force) 70 remains power connection state (normal operation mode).
So, next, judge whether to use family's controlling object equipment 94 (step S38).Can use family'scontrolling object equipment 94 during, proceed to use control action from the user history information of the sensor information oftame chamber sensor 14 is upgraded and this user history information of use of family'scontrolling object equipment 94 is upgraded.Then, under out of use situation, connect the power supply (step S39) of portable electric appts 20.Perhaps, make it return to normal operation mode from low-power consumption mode.Then, the historicalinformation storage part 162 from family's subsystem transmits user history information (step S40) to the historicalinformation storage part 62 of portable electric appts 20.Then, close the power supply (step S41) of family's controlling object equipment 94.Perhaps make it transfer to low-power consumption mode.
6. utilize wireless user history information to transmit
Next, the transfer approach that utilizes wireless user history information is described.Figure 20 shows the structure example of the system of this method of realization.
In Figure 20, in portableelectric appts 20, be provided withinformation transport unit 70, inrobot 300, be provided withinformation transport unit 370, undertaken transmitting by their Department of Communication Force (communication module) 72,372 based on wireless information.For example, when taken place as therobot 300 of controlling object equipment can use incident the time,information transport unit 70,information transport unit 370 are carried out following processing: will be stored in the historical information storage part 362 (the second historical information storage part) that user history information in the historicalinformation storage part 62 of mobile side is sent to family's side.
In this case,information transport unit 70,information transport unit 370 are carried out the information synchronization processing of user history information.Particularly, carrying out following information synchronization handles: make user history information and the user history information in the historicalinformation storage part 362 that is stored in family's side in the historicalinformation storage part 62 that is stored in mobile side remain the information of identical content.Information synchronization is handled and to be carried out in the following way: the historical information that newly becomes subsystem that can user mode with the historical information covering of the current subsystem that is using.For example, currently use mobile side, in the time can newly using family's side, covering the historical information of family's side with the historical information of mobile side.Under opposite situation, cover the historical information of mobile side with the historical information of family's side.According to this mode, in historical information storage part 62,362, storing up-to-date user history information all the time, even the user moves, also can realize seamless, the suitable renewal of user history information between a plurality of subsystems.
In addition, in Figure 20, information transmits is undertaken by wireless mode.Particularly, by WLAN, wait realization information to transmit as weak wireless, the bluetooth or the infrared ray of wireless near field communication.And, in this case, can judge the generation that can use incident of robot 300 (controlling object equipment) by detecting wireless strengths.Particularly, when portableelectric appts 20 androbot 300 near the time, wireless strengths strengthens, and can be judged as thus and can use robot 300.On the other hand, when portableelectric appts 20 separated withrobot 300, wireless strengths weakened, and can be judged as thus and can not use robot 300.As long as adopt this method, the required wireless judgment processing that can use incident and can not use incident that is used in information can being transmitted.
In Figure 21 A, the user moves to family in order to go home.In this case, shown in Figure 21 B, setting with the family is the zone 1,2,3 at center.
Here, zone 1 is the zone outside the effective range of WLAN etc. (in order to be different from wireless near field communication, being called remote-wireless communication below), is the zone of portableelectric appts 20 single movements.Zone 2 is interior zones of effective range of remote-wireless communication, is the zone of carrying out the transmission processing (information synchronization processing) of user history information.Zone 3 is the zones in the effective range of wireless near field communication such as bluetooth, is the zone of robot 300 (broadly being called family's controlling object equipment) single movement.In addition, zone 2 is the zones outside the effective range of wireless near field communication.
For example, when the user enters regionally 2 the time from zone 1,robot 300 startings transmit (loading) user history information from the historicalinformation storage part 62 of mobile side to the historicalinformation storage part 362 of family's side.In addition, when the user enters regionally 3 the time from zone 2, portableelectric appts 20 stops, and switches to the single movement ofrobot 300.
On the other hand, when the user enters regionally 2 the time from zone 3, portableelectric appts 20 startings transmit user history information from the historicalinformation storage part 362 of family's side to the historicalinformation storage part 62 of mobile side.In addition, when the user enters regionally 1 the time from zone 2,robot 300 stops, and switches to the single movement of portableelectric appts 20.
That is, in Figure 21 B,incident detection unit 350 grades judge the user with respect to the place of family's subsystem (second subsystem) near state.Then, when near state from first near state (zone 1) become degree of closeness than first near state high second during near state (regional 2),information transport unit 370 is handled, and the user history information that this processing is used for being stored in historicalinformation storage part 62 is sent to the historicalinformation storage part 362 of family's side.Then, when the user near state from second near state (zone 2) become degree of closeness than second near state high the 3rd during near state (zone 3),control action 352 beginning robots 300 (the second controlling object equipment) of control and treatment portion, the use user history information.
Then, the user near state be second near state (zone 2) during,information transport unit 370 is carried out information synchronization and is handled, that is: will be stored in the historicalinformation storage part 62 user history information be stored in user history information in the historicalinformation storage part 362 and remain the information of identical content.Promptly, become second during near state (zone 2) near state from first near state (zone 1) as the user, transmit user history information from mobile side direction family side, when becoming second during, be displaced sideways side from family and transmit user history information near state (zone 2) from the 3rd near state (zone 3).In addition, when the user become first during near state from second near state (zone 2) near state (zone 1), stop the control action of the use user history information ofrobot 300.
In addition, these first, second, third for example can be judged by remote-wireless communication and wireless near field communication near state (zone 1,2,3).That is, when detecting user's (handheld electronic apparatus), can be judged as the user and be in zone 3 (the 3rd near states) by near radio and remote-wireless.In addition, when detecting the user, can be judged as the user and be in zone 2 (second near states) when failing to detect the user but by remote-wireless by near radio.In addition, when all failing to detect the user, can be judged as the user and be in zone 1 (first near state) by near radio and remote-wireless.Like this, by utilizing accepting state because of the different at least two kinds of radio communications of distance (for example effectively arriving at least two kinds of different radio communications of distance), can realize efficiently portableelectric appts 20,robot 300 starting, stop to control and the transmission of user history information is handled.
Figure 22 is the process flow diagram of detailed process example that the method for Figure 21 A, Figure 21 B is shown.At first, judge whether change (step S61) near state, under situation about not changing, the time is carried out poll (polling) (step S62) according to the rules.On the other hand, taking place under the situation about changing, judging whether the user enters into zone 2 (step S63), under the situation that enters into zone 2, judging whether it is to enter into zone 2 (step S64) from regional 1 side.
Be to enter into from regional 1 side under the situation in zone 2, robot side starting (each several part beyond the Department of Communication Force) (step S65).Then, carry out the synchronous exchange (handshake) (step S66) between the unit, transmit user history information (step S67) from mobile side direction robot side.
On the other hand, not to enter under the situation in zone 2 mobile side starting (step S68) from regional 1 side but from regional 3 sides.Then, carry out the synchronous exchange (step S69) between the unit, be displaced sideways side from robot and transmit user history information (step S70).
In step S63, be judged as the user and do not enter under the situation in zone 2, judge whether to enter into zone 1 (step S71).Then, under the situation that enters into zone 1, machine side (beyond the Department of Communication Force) stops (step S72).On the other hand, do not enter under 1 the situation of zone the user, be judged to be and be in the zone 3, mobile side (beyond the Department of Communication Force) stops (step S73).
In addition, though top present embodiment is had been described in detail, those skilled in the art can easily understand, can not break away from the various deformation of essence from novel point of the present invention and effect.Therefore, these variation all within the scope of the present invention.For example, for in instructions and the accompanying drawing at least once with the different terms (first of broad sense or synonym more, second, the 3rd subsystem, first, second, the 3rd sensor, first, second, the 3rd controlling object equipment, state parameter etc.) term (the mover system that puts down in writing together, family's subsystem, the car intra subsystem, the Wearable sensor, family's chamber sensor, the car inner sensor, mobile controlling object equipment, family's controlling object equipment, car inner control object-based device, spirit/condition parameter etc.), in the optional position of instructions or accompanying drawing, all it can be replaced to its different terms.In addition, the structure of control system, subsystem, robot, guider etc., action are not limited to the illustrated content of present embodiment, can implement various distortion.For example, can implement to omit the distortion of any one party in historical information renewal portion and the control and treatment portion.