US20230105048A1 - Robot control method and information providing method - Google Patents

Abstract

A method for a first server, which controls a robot, includes: acquiring, from a second server, request information that indicates a request for an action of the robot after the second server determines that it is required to encourage the user to exercise; if it is confirmed that the second server has an access right to make the robot perform the request, making a decision for one of an action group including at least two of execution, suspension, or rejection of the request; and after the decision to execute the request is made, transmitting, to the robot, instruction information that causes the robot to take an action for encouraging the user to exercise.

Description

BACKGROUND1. Technical Field
• The present disclosure relates to a technique that provides robot capabilities to the outside.
2. Description of the Related Art
• Japanese Patent No. 6495486 (referred to as PTL 1) discloses a method, as an autonomous robot that considers physical conditions of a user, of measuring body temperatures of the user and determining the user's condition based on a cycle of the measured body temperatures, and a method of changing an amount of operation of the robot when a basal temperature cycle reaches a predetermined timing.
SUMMARY
• The technique ofPTL 1 needs further improvement, however.
• In one general aspect, the techniques disclosed here feature a method for a first server that communicates with a robot and controls the robot, including: acquiring, from a second server, request information that indicates a request for an action of the robot and that includes urgency degree information indicating a first urgency degree for the user to exercise, wherein the second server determines whether or not it is required to encourage a user to exercise based on biological activity information acquired from an information terminal of the user, the biological activity information indicating biological activity of the user, and wherein the request information is transmitted from the second server after the second server determines that it is required to encourage the user to exercise; if it is confirmed at the first server that the second server has an access right to make the robot perform the request indicated by the request information, making a decision for one of an action group including at least two of execution, suspension, or rejection of the request based on i) the urgency degree information and ii) necessary urgency degree information that is managed at the first server, wherein the necessary urgency degree information indicates a second urgency degree that is required for the robot to execute the request; and after the decision to execute the request is made, transmitting, to the robot, instruction information that causes the robot to take an action for encouraging the user to exercise.
• According to the present disclosure, further improvement is possible.
• Additional benefits and advantages of the disclosed embodiments will become apparent from the specification and drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the specification and drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.
BRIEF DESCRIPTION OF THE DRAWINGS
• FIG.1 is a block diagram illustrating an example of an overall configuration of an information system according to an embodiment of the present disclosure;
• FIG.2 is a block diagram illustrating an example of the configuration of the information system according to the embodiment of the present disclosure;
• FIG.3 is a block diagram illustrating an example of an overall configuration of an information system according to a form of one form of the present disclosure;
• FIG.4 is a flowchart illustrating an example of processing when a non-robot company (company A) works with a robot;
• FIG.5 is a table illustrating an example of setting information of an access right about a robot;
• FIG.6 is a table illustrating an example of level of urgency degree for determining whether or not it is possible to execute a requested task;
• FIG.7 is a flowchart illustrating an example of processing in which the non-robot company requests a task from the robot;
• FIG.8 is a flowchart illustrating an example of processing in which the non-robot company requests a task from the robot;
• FIG.9 is a flowchart illustrating an example of processing of a company B server; and
• FIG.10 is a table illustrating an example of setting of necessary urgency degree.
DETAILED DESCRIPTIONS(Underlying Knowledge Forming Basis of the Present Disclosure)
• Our daily lives have been increasingly digitalized. For example, many people have smartphones that are information communication terminals dedicated for private use. Users have come to install in smartphones and to use various applications (an application is hereinafter referred to as an app), such as an app for performing their health management, an app for family budget management, a social communication app for supporting real-time communications with acquaintances, and a news app that curates news in the world in accordance with interests of an individual.
• On the other hand, but gradually, a movable device (hereinafter referred to as a robot) capable of autonomously performing various operations or tasks has been put into practice. Those robots are robots that assemble or adjust parts in factories, robots that perform accurate and quick sorting at physical distribution bases, robots that fulfill specific tasks in light of surrounding circumstances, or the like. These robots also include robots that perform work in cooperation with humans or that perform a specific task on behalf of humans.
• The present disclosure proposes a technique for assisting users so that the users can lead a healthy, happy, comfortable, secured, safe, enjoyable, and/or clean life, by a smartphone and a robot, which is a mobile device, operating in cooperation with each other, the smartphone being an information processing device capable of performing various information processing, and the mobile device capable of executing tasks that handle various operations and objects.
• If biological activity information of a user is collected and it is confirmed from the collected biological activity information that the user lacks exercise, it is possible to urge the user to exercise by presenting a message inducing the user to exercise through the user's smartphone. A message prompting the users to change their behavior in this manner is called a nudge.
• However, it is not easy to cause the users who do not have an exercise habit to change their behavior. Simply presenting the nudge to the users is not sufficient and a stronger motivation than the nudge is needed.
• InPTL 1 described above, there is disclosed a technique for estimating, from owner's body temperatures, timing of consideration when a robot should give consideration to an owner, in view of an owner's menstrual cycle and for causing the robot, which usually behaves on its own, to behave considerately, such as staring at the owner at the estimated consideration timing, thereby enhancing sympathy of the owner for the robot.
• As such, sincePTL 1 is the technique of enhancing the sympathy between the owner and the robot, it is not possible to give users a strong motivation for exercise.
• The present disclosure has been made to solve such a problem and aims to provide a technique that can give users a strong motivation for exercise.
• A method according to one aspect of the present disclosure is a method for a first server that communicates with a robot and controls the robot, including: acquiring, from a second server, request information that indicates a request for an action of the robot and that includes urgency degree information indicating a first urgency degree for the user to exercise, wherein the second server determines whether or not it is required to encourage a user to exercise based on biological activity information acquired from an information terminal of the user, the biological activity information indicating biological activity of the user, and wherein the request information is transmitted from the second server after the second server determines that it is required to encourage the user to exercise; if it is confirmed at the first server that the second server has an access right to make the robot perform the request indicated by the request information, making a decision for one of an action group including at least two of execution, suspension, or rejection of the request based on i) the urgency degree information and ii) necessary urgency degree information that is managed at the first server, wherein the necessary urgency degree information indicates a second urgency degree that is required for the robot to execute the request; and after the decision to execute the request is made, transmitting, to the robot, instruction information that causes the robot to take an action for encouraging the user to exercise.
• According to the aspect described above, it is possible, through the access right, to cause the second server that does not manage the robot to temporarily utilize capabilities of the robot managed by the first server. This allows the second server to encourage the user to exercise through the robot managed by the first server when it is determined that it is required to encourage the user to exercise. As a result, the second server can cause the robot to perform the operation to encourage the user to exercise even though the second server itself does not manage the robot. Therefore, it is possible to give the user the stronger motivation to exercise, for example, when compared with a case where a message prompting the user to exercise is merely displayed on the display of the user's information terminal.
• In the method described above, the decision to execute the request may be made, if the first urgency degree indicated by the urgency degree information is equal to or higher than the second urgency degree indicated by the necessary urgency degree information.
• According to the aspect described above, a request is executed if the urgency degree indicated by the urgency degree information is equal to or higher than the urgency degree indicated by the necessary urgency degree information. Thus, the robot can perform the action to urge the user to exercise, in a time zone other than the time zone during which the user concentrates on working, for example. This can prevent the robot from taking the action to urge the user to exercise at a timing when the user cannot exercise.
• In the method described above, a decision to suspend or reject the request may be made, if the first urgency degree indicated by the urgency degree information is less than the second urgency degree indicated by the necessary urgency degree information.
• According to the aspect described above, if the urgency degree indicated by the urgency degree information is less than the urgency degree indicated by the necessary urgency degree information, the request is suspended or rejected. This makes it possible to prevent the robot from taking the action to urge the user to exercise, in a situation where the user does not have time to care about the robot, such as when the user concentrates on working.
• In the method described above, the request information may further include suspension period information indicating a suspension period during which a decision on the request indicated by the request information can be suspended, and a decision to reject the request may be made, if, during the suspension period, the first urgency degree indicated by the urgency degree information is not equal to or higher than the second urgency degree indicated by the necessary urgency degree information.
• According to the aspect described above, the request is rejected if the urgency degree indicated by the urgency degree information in not equal to or higher than the urgency degree indicated by the necessary urgency degree information during the suspension period. Thus, it is possible to prevent the robot from taking the action to urge the user to exercise in a situation where the user's state is not appropriate for the urging of exercise. For example, it is possible to prevent the robot from taking the action to urge the user to exercise after late at night.
• In the method described above, the request information may further include suspension period information indicating a suspension period during which a decision on the request indicated by the request information can be suspended, and the decision to execute the request may be made, if, during the suspension period, the first urgency degree indicated by the urgency degree information is equal to or higher than the second urgency degree indicated by the necessary urgency degree information.
• According to the aspect described above, the request is executed when the urgency degree indicated by the urgency degree information is equal to or higher than the urgency degree indicated by the necessary urgency degree information. Thus, it is possible to cause the robot to take the action to urge the user to exercise when the user's state is appropriate for the urging. In addition, since such a determination is made in the suspension period, the robot can urge exercise only in the suspension period, rather than urging exercise indefinitely.
• In the method described above, the second urgency degree may be determined based on information indicating a statement made by the user toward the robot, the statement being obtained based on a sensing result of a sensor provided on the robot, and if the statement includes a word with an intention of not communicating with the robot, the second urgency degree may be increased to a predetermined level.
• According to the aspect described above, when the user makes the statement with an intention of not communicating with the robot, the urgency degree indicated by the necessary urgency degree information is increased. Thus, it becomes difficult to execute the request. Consequently, if the user is in the situation where the user is busy and does not have time to care about the robot, it is possible to avoid execution of the request by the robot simply by making the statement with the intention of not communicating.
• In the method described above, the second urgency degree may be determined based on information indicating an answer made by the user to a question, the information being acquired by the robot, and the question may be outputted from a speaker of the robot and is a question to confirm with the user the second urgency degree.
• According to the aspect described above, the urgency degree indicated by the necessary urgency degree information is determined according to the answer to the question for confirming with the user the urgency degree indicated by the necessary urgency degree information. Thus, it is possible to avoid the execution of the request by the robot, for example, in a situation where the user does not want to be involved with the robot.
• In the method described above, the second urgency degree may be determined based on behavior of the user that is obtained by analyzing an image of the user acquired from the sensor provided on the robot, and when the behavior of the user is being on the phone or operating a personal computer, the second urgency degree may be increased to a predetermined level.
• According to the aspect described above, when the user is on the phone or operating the computer and thus in the situation where the user does not care about the robot, it is possible to avoid the execution of the request by the robot.
• In the method described above, the instruction information may further include validity period information indicating a period of validity of the instruction information.
• According to the aspect described above, it is possible to cause the robot to take the action to urge the user to exercise only within the period of validity.
• In the method described above, if time elapsed from the determined timing exceeds the period of validity, the robot may cancel the instruction information without encouraging the user to exercise.
• According to the aspect described above, if time elapsed from timing when it was decided to execute the request exceeds the period of validity, the instruction information is cancelled. Thus, it is possible to prevent the robot from taking the action to urge the user to exercise indefinitely.
• The method described above may further include transmitting, to the second server, taken exercise amount information indicating an amount of exercise taken by the user, after obtaining, from the robot, information indicating that the robot has taken the action indicated in the instruction information to encourage the user to exercise.
• According to the aspect described above, the second server can manage the taken exercise amount information indicating the amount of exercise taken by the user in response to the encouragement by the robot.
• In the method described above, the first server may be managed by a first operator that manages the robot, the second server may be managed by a second operator that manages the biological activity information acquired from the information terminal of the user, and the second operator may be different from the first operator.
• According to the aspect described above, it is possible to cause the second operator that manages the biological activity information of the user to utilize the capabilities of the robot managed by the first operator.
• A method according to another aspect of the present disclosure is a method for a second server that communicates with a first server associated with a robot and communicates with an information terminal of a user, the method including: acquiring biological activity information indicating biological activity of the user from the information terminal of the user; based on the biological activity information, determining whether or not it is required to encourage the user to exercise; and transmitting, to the first server, request information that indicates a request for an action of the robot and that includes urgency degree information indicating a first urgency degree for the user to exercise, after it is determined at the second server that it is required to encourage the user to exercise, wherein if the first server confirms that the second server has an access right to make the robot perform the request by the request information, a decision for one of an action group including at least two of execution, suspension, or rejection of the request is made based on i) the urgency degree information and ii) necessary urgency degree information that is managed by the first server, the necessary urgency degree information indicating a second urgency degree that is required for the robot to execute the request, and wherein instruction information that causes the robot to take an action for encouraging the user to exercise is transmitted from the first server to the robot after the decision to execute the request is made at the first server.
• According to the aspect described above, it is possible to ask the robot to urge the user, from outside of the robot, based on the biological activity of the user, and to cause the robot to encourage the user at an appropriate timing in accordance with the user's state, while dynamically monitoring the user's state via the robot. Consequently, it is possible to utilize the robot to promote the user's exercise beyond the capabilities the robot is provided with, and realize the encouragement for the user to exercise while giving consideration so as not to cause any discomfort to the user.
• In the method described above, the request information may include exercise amount information indicating an amount of exercise required for the user, the amount being calculated based on the biological activity information, the method may include: after the user exercises as a result of the robot encouraging the user to exercise based on the request information, acquiring taken exercise amount information indicating the amount of exercise that the user has taken; creating an evaluation message that evaluates the exercise of the user based on the exercise amount information and the taken exercise amount information, and transmitting the evaluation message to the information terminal of the user.
• According to the aspect described above, if the user exercises after being urged by the robot to exercise, the user can share information related to that exercise.
• In the method described above, if it is determined based on the exercise amount information and the taken exercise amount information that the amount of exercise taken by the user may be equal to or larger than an amount of exercise targeted by the user, a message that user has achieved the target amount of exercise is created, as the evaluation message.
• According to the aspect described above, the user can share the message that the user has achieved the target amount of exercise.
• A method according to still another aspect of the present disclosure is a method for a first server that communicates with a robot and controls the robot, including: acquiring, from a second server, request information indicating a request for an action of the robot, wherein the second sever determines whether or not it is required to encourage a user to exercise based on biological activity information acquired from an information terminal of the user, the biological activity information indicating biological activity of the user, and wherein the request information is transmitted from the second server after the second server determines that it is required to encourage the user to exercise; acquiring, from the robot, state data that is detected by the robot and that dynamically changes in relation to a state of the user, and transmitting to the robot, instruction information for causing the robot to take an action for encouraging the user to exercise in response to the request information, after it is determined at the first server that the user is in a state in which the user can be encouraged to exercise based on the request information and the dynamic changes in the state data.
• According to the aspect described above, it is possible to ask the robot to encourage the user, from outside of the robot, thus urging the user to exercise, based on the biological activity of the user, and to cause the robot to encourage the user at an appropriate timing in relation to the user's state, while dynamically monitoring the user's state via the robot. Consequently, it is possible to utilize the robot to promote the user's exercise, and realize the encouragement for the user to exercise while giving consideration so as not to cause any discomfort to the user.
• In the method described above, the request information may further include suspension period information indicating a suspension period during which a determination on the instruction information in response to the request information can be suspended, and a decision to transmit the instruction information may be made, when the user is in the state in which the user can be encouraged to exercise in the suspension period.
• According to the aspect described above, it is possible to cause the robot to take the action to urge the user to exercise when the user is in the appropriate state in which the user may be urged to exercise, within the suspension period. In addition, since such a determination is made during the suspension period, it is possible to urge exercise only within the suspension period, rather than using the robot and urging the exercise indefinitely.
• In the method described above, a decision not to transmit the instruction information may be made, if the user is not in the state in which the user may be encouraged to exercise in the suspension period.
• It is possible to prevent the robot from taking the action to urge the user to exercise, in the state in which it is not appropriate to urge the user to exercise. For example, it is possible to prevent the robot from taking the action to urge the user to exercise, after late at night.
• In the method described above, the request information may include urgency degree information that indicates a first urgency degree for the user to exercise, and the state data may include necessary urgency degree information i) that depends on the dynamic changes in the state data acquired from the robot and ii) that indicates a second urgency degree that is required for the robot to execute the request.
• According to the aspect described above, the request information includes the urgency degree information that indicates the urgency degree for the user to exercise. In addition, since the state data includes the necessary urgency degree information that varies depending on the dynamic change in the state data acquired from the robot, it is possible to cause the robot to take the action to urge the user to exercise, taking into consideration the urgency of the user's exercise.
• In the method described above, it may be determined whether or not the user is in the state in which the user can be encouraged to exercise, based on the urgency degree information and the necessary urgency degree information.
• According to the aspect described above, it is possible to determine whether or not the user is in the state in which the user may be encouraged to exercise, based on the urgency degree information included in the request information as a fixed value based on the user's biological activity acquired from the second server and the necessary urgency degree information that varies depending on a dynamic change in the state data acquired from the robot.
• In the method described above, a decision to transmit the instruction information may be made, when the first urgency degree indicated by the urgency degree information is equal to or higher than the second urgency degree indicated by the necessary urgency degree information.
• According to the aspect described above, a decision to transmit the instruction information can be made if the urgency degree indicated by the urgency degree information is equal to or higher than the urgency degree indicated by the necessary urgency degree information, based on the urgency degree information included in the request information as a fixed value based on the user's biological activity acquired from the second server and the necessary urgency degree information that varies depending on a dynamic change in the state data acquired from the robot. For example, since the instruction information is transmitted to the robot in a time zone other than the time zone during which the user concentrates on working, it is possible to prevent the robot from urging the user to exercise at the timing that the user cannot exercise.
• In the method described above, a decision to suspend the transmission of the instruction information may be made, when the first urgency degree indicated by the urgency degree information is less than the second urgency degree indicated by the necessary urgency degree information.
• According to the aspect described above, a decision to suspend the transmission of the instruction information can be made, when the urgency degree indicated by the urgency degree information is less than the urgency degree indicated by the necessary urgency degree information. For example, since the instruction information is not transmitted to the robot while the user is concentrating on working, the robot does not urge the user to exercise.
• The method described above may further include transmitting the instruction information to the robot, if it is confirmed that the second server has the access right to make the robot perform the request by the request information.
• According to the aspect described above, it is possible to prevent a remote instruction from the outside without the access right to the robot.
• In the method described above, the first server may register registration information indicating whether or not the second server has the access right, and the first server may confirm based on the registration information that the second server has the access right.
• According to the aspect described above, it is possible to prevent a remote instruction from the outside without the access right to the robot.
• A method according to still another aspect of the present disclosure is a method for a second server that communicates with a first server associated with a robot and communicates with an information terminal of a user, the method including: acquiring biological activity information indicating biological activity of the user from the information terminal of the user; based on the biological activity information, determining whether or not it is required to encourage the user to exercise; and transmitting, to the first server, request information indicating a request for an action of the robot after it is determined at the second server that it is required to encourage the user to exercise, wherein, at the first server, state data that is detected by the robot and that dynamically changes in relation to a state of the user is acquired from the robot, and wherein instruction information that causes the robot to take an action for encouraging the user to exercise is transmitted from the first server to the robot in response to the request information after it is determined at the first server based on the request information and the dynamic changes in the state data that the state of the user is a state in which the user can be encouraged to exercise.
• According to the aspect described above, it is possible to ask the robot to encourage the user, from outside of the robot, thus urging the user to exercise, based on the biological activity of the user, and to cause the robot to encourage the user at an appropriate timing in response to the user's state, while dynamically monitoring the user's state via the robot. Consequently, it is possible to utilize the robot to promote the user's exercise beyond the capabilities the robot is provided with, and realize the encouragement for the user to exercise while giving consideration so as not to cause any discomfort to the user.
• In the method described above, the request information may include exercise amount information indicating an amount of exercise required for the user, the amount being calculated based on the biological activity information, the method may include:
• after the user exercises as a result of the robot encouraging the user to exercise based on the request information, acquiring taken exercise amount information indicating the amount of exercise that the user has taken; creating an evaluation message that evaluates the exercise of the user based on the exercise amount information and the taken exercise amount information, and transmitting the evaluation message to the information terminal of the user.
• According to the aspect described above, if the user exercises after being urged by the robot to exercise, the user can share information related to that exercise.
• In the method described above, if it is determined based on the exercise amount information and the taken exercise amount information that the amount of exercise taken by the user is equal to or larger than an amount of exercise targeted by the user, a message that user has achieved the target amount of exercise may created, as the evaluation message.
• According to the above aspect, the user can share the message that the user has achieved the targeted amount of exercise.
• Note that the present disclosure can also realize a program for causing a computer to execute respective characteristic configurations in the method which is used here, or a system operated by this program. In addition, it is needless to say that such a computer program can be distributed through a non-transitory computer readable storage medium such as a CD-ROM or the like, or through a communication network such as Internet or the like.
• Note that any of embodiments described below illustrates a specific example of the present disclosure. Numeric values, shapes, components, steps, or a sequence of steps depicted in the following embodiments are an example, and do not limit the present disclosure. In addition, among components in the following embodiments, components not described in independent claims that represent the highest-level concept are described as arbitrary components. In addition, in all of the embodiments, contents of the respective embodiments can be combined.
Embodiments
• It is expected that in our society, Internet will further spread and various types of sensors will be familiar. As a result, it is expected that our society will be in a state where information on an internal state and activities of individuals or the like as well as information on an entire city including buildings and transportation networks or the like will be digitalized and become available to computer systems. Digitalized data regarding individuals (personal information) will be safely managed as big data in a cloud server such as information banks, via communication networks, and utilized for various purposes for individuals and the society.
• Such an advanced information society is called Society 5.0 in Japan. The advanced information society has an information infrastructure (cyber physical system) that highly integrates a real space (physical space), which is a material world surrounding individuals and a virtual space (cyber space) where computers cooperate with each other to perform various processes related to the physical space. The advanced information society is a society where economic growth and solution of social issues are expected.
• In such an advanced information society, by analyzing communications (including acquisition and provision of information, as well as a method of expressing the information) or behaviors by an individual in various scenes of his or her daily life, and analyzing the big data including the accumulated personal information, it is possible to provide information or services necessary for that individual, in a way of communication that seems most suitable for that individual, according to the scene.
• Hereinafter, given the advanced information society where such a cyber physical system works, a description is given of specific aspects that enhance health and happiness of users, with support for daily life close to individual users as a theme.
• FIG.1 is a block diagram illustrating an example of an overall configuration of an information system according to an embodiment of the present disclosure.FIG.1 illustrates a cyber space in an upper half and a physical space in a lower half. On the left side, resources related to company A that is a non-robot provider company are lined up. Acompany A server101 is in the cyber space and a company A app running on asmartphone100 is in the physical space. Thecompany A server101 operates as a pair with the company A app. On the right side resources related to company B that is a robot provider are lined up. Acompany B server111 is in the cyber space, and arobot110, which is a movable device, and a company B app running on thesmartphone100 are in the physical space. Thecompany B server111 operates as a pair with therobot110 and/or the company B app. In the middle of the physical space, there is a user who handles the company A app and the company B app installed on thesmartphone100, and therobot110. Thesmartphone100, therobot110, thecompany A server101, and thecompany B server111 are connected by a wide area communication network such as the Internet, so that they can communicate with each other.
• As illustrated inFIG.1, the company A and the company B have contact points with users through their respective apps and robots. The company A only has the contact points via the app on thesmartphone100, which is a form of a customer contact that is often seen today. On the other hand, the company B inFIG.1 also has the contact points via therobot110, in addition to the contact points via the app on thesmartphone100. Companies that have contact points with users (general consumers) via therobot110, which is an autonomous movable device, are unprecedented except for some toy manufacturers, and are expected to emerge in the future.
• Note that here, although an illustration of a dog-shaped robot is used as an example of therobot110, therobot110 may have a form based on any other living creatures including humans or may have an inorganic and non-living form. As far as therobot110 has autonomous motor abilities (ability to change posture and ability to move, or the like) and/or an ability to operate (ability to move other objects, such as pressing a button or lifting an object) in the physical space, the robot is not limited in its form.
• In an information system which is an embodiment of the present disclosure, therobot110, and home appliances and housing equipment operated by therobot110, or the like which are contact points of each customer are more highly linked than ever before. It can be said that it is an information system that expands the range of improvement in the quality of its own services and provides the users with a higher value while utilizing information and capabilities held by others. The cognitive and motor abilities of robots are evolving day by day. If such a versatile robot is realized, a mechanism is to be built that allows other companies to access unique abilities held by the robot. It is believed that doing so will be a basis for creating a wide variety of value collaborations for users, non-robot companies that provide services, and robot companies that provide robots.
• FIG.2 is a block diagram illustrating an example of a configuration of the information system according to the embodiment of the present disclosure. Thesmartphone100 includes acommunication unit100a,acalculation unit100b,asensor100c,amemory100d,an operation unit100e,and a videoaudio output unit100f.Thesensor100cis a device that acquires video information, audio information, and/or surrounding environment information. Thesensor100cincludes, for example, an image sensor and a microphone.
• The videoaudio output unit100fis a device that outputs video and audio. The videoaudio output unit100fincludes, for example, a display and a speaker. The operation unit100eis a device that receives a button press or a touch operation from the user. The operation unit100eincludes, for example, a touch panel and a button. Thecalculation unit100bis a device that performs information processing such as voice recognition, voice synthesis, information search, and information drawing, that is performed in thesmartphone100. Thecalculation unit100bis, for example, a central processing unit. Thememory100dholds data processed by thecalculation unit100b.Thememory100dis, for example, a semiconductor memory such as a flash memory. Thecommunication unit100ais a communication circuit that performs information communications with other computers on a network. When both the company A app and the company B app are installed, a program and necessary data are recorded in thememory100dof thesmartphone100, and that program is executed by thecalculation unit100b.
• Thecompany A server101 operates in cooperation with the company A app installed on thesmartphone100. Thecompany A server101 includes acommunication unit101a,acalculation unit101b,and amemory101c.Thecommunication unit101ais a communication circuit for performing information communications with the other computers on the network. Thememory101crecords information related to the company A app and the user. Thememory101cis, for example, a mass storage such as a hard disk drive and a solid state drive. Thecalculation unit101bperforms processing of data exchanged with the outside. Thecalculation unit101bis, for example, a processor such as a central processing unit.
• Thecompany B server111 operates in cooperation with the company B app installed on thesmartphone100. Thecompany B server111 includes acommunication unit111a,acalculation unit111b,and amemory111c.Thecommunication unit111ais a communication circuit for performing information communications with the other computers on the network. Thememory111crecords information related to the company B app, therobot110, and the user. Thememory111cis, for example, a mass storage such as a hard disk drive and a solid-state drive. Thecalculation unit111bperforms processing of the data exchanged with the outside. Thecalculation unit111bis, for example, a processor such as a central processing unit.
• Therobot110 includes acommunication unit110a,acalculation unit110b,asensor110c,amemory110d,amovable unit110e,and anaudio output unit110f.Thesensor110cis a device that acquires video information, audio information, and/or surrounding environment information. Thesensor110cincludes, for example, an image sensor and a microphone. Theaudio output unit110fis, for example, a speaker and outputs audio. Therobot110 may include an operation unit (not illustrated) that receives a button press or a touch operation from the user. Themovable unit110eis a device that controls the posture of therobot110 under the control of thecalculation unit110b,and moves the robot itself and provides dynamic actions on other objects. Themovable unit110eis, for example, an actuator such as a motor. Thecalculation unit110bperforms various calculation processes that are performed in therobot110. Thecalculation unit110bis, for example, a processor such as a central processing unit. Thememory110dholds data processed by thecalculation unit110b.Thememory110dis, for example, a semiconductor memory such as a flash memory. Thecommunication unit110ais a communication circuit for performing information communications with the other computers on the network.
• Note that although thecompany A server101, thesmartphone100, therobot110, and thecompany B server111 are connected via the wide area communication network so that they can communicate with each other, they may be connected by a dedicated communication network or Near Field Communication or the like, when low-latency communications, strong security, or local paring is requested, or the like.
(Providing Robot Capabilities in Health Management)
• Hereinafter, a description is given of an embodiment in which health management of the user is carried out more effectively by using thefamiliar robot110.
• FIG.3 is a block diagram illustrating an example of an overall configuration of an information system according to an embodiment of the present disclosure. In this form, the company A, which is the non-robot company, is a health insurance company with which the user has a contract. To improve health of the user, the company A, which is an insurance company, has the user install a healthcare app, which is provided by the company A, on thesmartphone100 and use the app every day. The company A healthcare app continuously collects the biological activity information of the user (heartbeat, pulse, blood pressure, body temperature, body water content, breathing, sweating amount, activity amount (consumed calories), an intake amount (calorie intake), number of steps, posture, and a type of exercise, or the like) by a wearable sensor or the like on a daily basis. The company A healthcare app records the biological activity information in thememory100dof thesmartphone100, and, at the same time, periodically uploads the biological activity information to the company A server101 (“(a) Biological activity information” inFIG.3).
• The biological activity information collected in this manner is strictly managed by thecompany A server101 as personal information of the user. Thecompany A server101 periodically analyzes health risk of the user based on the biological activity information of the user (“(b) Health risk analysis” inFIG.3). Furthermore, when it is determined that the amount of exercise taken by the user is insufficient, thecompany A server101 transmits a nudge to the user in order to recommend the exercise. For example, a message “Let's exercise.” causing a behavior change so that the user takes a desirable action is displayed via the company A app (“(c) Recommendation of exercise” inFIG.3). However, generally speaking, behavior change urged by this type of approach easily fails to give a sufficient motivation and often cannot solve the user's lack of exercise (“(d) No exercise” inFIG.3).
• Conventional services provided in the information society until now (also called Society4.0 society) have been realized for a loop of (a) to (d), which are described here. With the conventional services, the cyber space and the physical space can cooperatively work to have a continuous contact with users and promote health improvement. In the conventional services, however, the biological activity information and the services are confined only in the services of the company A, and there is no cooperation with any entity other than the company A. The conventional services are in a silo state, so to speak. It seems that even though the company A slightly changes the expressions of the message displayed on thesmartphone100, there are still many users who cannot easily change their behaviors. Therefore, the conventional services are not sufficient to be services that widely improve the health of users. In the present embodiment, the robot that is familiar to the user and has the autonomous motor abilities is used, and the autonomous motor abilities that are not held by the company A app but held by the robot are used to envision services for improving the health of the user. Forms to realize the services are described. Now, continuation ofFIG.3 is described.
• If thecompany A server101 determines from the periodically uploaded biological activity information that the user has not taken sufficient exercise even after the company A server101 (one example of the second server) transmits the nudge to recommend exercise, thecompany A server101 transmits request information for requesting therobot110 to execute a task of encouraging the user to exercise (walk, for example) to the company B server111 (one example of the first server) with which cooperation has been set in advance (“(e) Requesting exercise (walk)” inFIG.3). More specifically, the request information is transmitted after it is determined in thecompany B server111 that the it is necessary to encourage the user to exercise. A description of the advance cooperation setting between the servers is given below.
• When thecompany B server111 that has received the request information confirms that thecompany A server101 has the access right to the requested task, thecompany B server111 decides to execute, suspend, or reject the request. Then, if thecompany B server111 decides to execute the request, thecompany B server111 outputs, to therobot110 held by that user, instruction information that induces the user to exercise (walk) (“(f) Inducing and instructing to exercise (walk)” inFIG.3). This instruction information includes an instruction for therobot110 to specifically present in a form understandable by the user how the robot behaves and what the robot requests of the user. For example, in the case of the dog-shaped robot, the instruction information for inducing to exercise that is received by therobot110 includes an instruction for therobot110 to directly tell the user “Let's go for a walk” or to bring a lead used for a walk and ask the user to go for a walk (showing its willingness to go for a walk), or the like. Contents of these specific instructions are included in the instruction information for inducing to exercise that is transmitted from thecompany B server111 to therobot110, and the instruction is executed by the robot110 (“(g) Inducing to exercise (walk)” inFIG.3).
• The user who is thus asked by the dog-shaped robot to exercise (walk) together may be motivated more strongly than the nudge regarding the exercise received via thesmartphone100. As a result, the user finally exercises (takes a walk) (“(h) Taking exercise (a walk)” inFIG.3). Here, a variety of methods for inducing by therobot110 is possible and the foregoing is merely an example thereof. For example, if therobot110 held by the user is too small to go for a walk together, or if therobot110 imitates a living object (for example, a frog) that is unlikely to go for a walk, an inducing method for causing the frog-shaped robot to say “I want to see the nearby river”, or the like, and guiding the user on the route thereto with the frog-shaped robot resting on the user's hand can be employed.
• When the task requested by the instruction information ends, therobot110 notifies thecompany B server111 of information indicating that the user took exercise (a walk) and taken exercise amount information that includes a travel distance thereof or a walking speed. Thecompany B server111 that has received the taken exercise amount information notifies thecompany A server101 of the taken exercise amount information (for example, a walking distance) as a final result for “(e) Requesting for exercise (walk)” (“(i) Notifying the amount of exercise (walking distance)” inFIG.3).
• Thecompany A server101 records the taken exercise amount information (“(j) Recording the amount of exercise (walking distance)” inFIG.3), praises the user's exercise based on the taken exercise amount information, and presents to the user an evaluation message that evaluates the user's exercise, such as “You have achieved 5000 steps” or the like, through the company A app, in order to increase the user's motivation to exercise (“(k) Evaluation of exercise” inFIG.3).
• Note that the company A app or thecompany A server101 may feed back to the user the evaluation message like “(k) Evaluation of exercise” inFIG.3, without being based on the taken exercise amount information that is obtained from thecompany B server111. For example, thecompany A server101 may display the evaluation message on the screen of thesmartphone100 by obtaining the biological activity information “(a) Biological activity information inFIG.3” from a step sensor worn by the user.
• It was difficult to cause the behavior change that increases the amount of exercise of the user, only by messages such as video information and audio information on thesmartphone100, which is the customer contact point of the company A. By the company A asking for a walk via the dog-shaped robot provided by the company B and the dog-shaped robot further walking together, it is possible to lower the user's psychological barrier to exercise (walk) and increase the amount of exercise of the user. Moreover, the user can expect that this will allow the user to better maintain the health.
• When therobot110 asks the user to change his/her behavior in this manner, and therobot110 conveys its own intention or desire (wishing to go for a walk) to the user as if it were a living system, the user may want to let that living system (robot) do what it wants. This is because the user is requested to change his/her behavior based on the altruistic desire to meet the request of the robot, which is the living system with one will, rather than being requested to change his/her behavior solely based on the user's selfish desire to maintain the health. The service for maintaining the user's health disclosed here is an approach that combines the approach based on the selfish desire that can be independently realized by the company A with the altruistic desire that can only be realized through cooperation with thecompany B robot110.
• It can also be said that this information system is an information system in which the apps or therobot110, which are respective customer contact points, are linked at a higher level, and improve the quality of their services while utilizing the information and the capabilities held by others, thereby providing the users with higher values. The cognitive and motor abilities of robots are evolving day by day. If such a versatile robot is realized, a mechanism is to be built that allows other companies to access unique abilities held by the robot. Doing so will be a basis for creating a wide variety of value collaborations for users, non-robot companies (company A) that provide services, and robot companies (company B) that providerobots110.
• FIG.4 is a flowchart illustrating an example of processing when the non-robot company (company A) cooperates with therobot110. For the company A app or thecompany A server101 as illustrated inFIG.3 to access the information and the capabilities of therobot110 operated by the company B, it is necessary to appropriately set its access right in advance.FIG.4 illustrates an example of a process to set the access right in advance.
• Using the company B app installed in thesmartphone100, the user sets the company B app to cooperate with the company A app. Specifically, based on the user's input, the company B app acquires a unique ID of the company A app used by the user (step S1). The company B app transmits a registration request for registering with thecompany B server111 the acquired unique ID of the company A app together with a unique ID of the company B app (step S2). Thecompany B server111 that has received the registration request registers pair information of the company A app and the company B app. In this registration process, the access right is simultaneously registered, the access right indicating to what extent the company A is granted a right to access which of the unique capabilities of the robot110 (step S3). Details of the access right is described below with reference toFIG.5. The pair information including the robot ID of therobot110 and the unique ID of the company B app has been registered in advance in thecompany B server111. This registration is performed, for example, by the user inputting the unique ID of therobot110 on an initial setting screen of the company B app.
• Thecompany B server111 that has received the registration of the company A app notifies thecompany A server101 of setting information on the access right for which the company A app is permitted (step S4). Specifically, thecompany B server111 notifies thecompany A server101 of the access right setting information, in addition to the pair information of the unique ID of the company A app and the unique ID of the company B app.
• Thecompany A server101 registers with thememory101cthe pair information of the unique ID of the company A app and the unique ID of the company B app, and the access right setting information (step S5). When the company A app or thecompany A server101 uses its unique capabilities for therobot110 provided by the company B, the information is used to identify atarget robot110 and to determine whether or not the unique capabilities can be used.
• Here, it suffices if the access right to therobot110 provided by the company B is correctly set for the company A app or thecompany A server101. The foregoing is merely an example thereof. Any registration method other than the above may be used.
• FIG.5 is a table illustrating an example of the access right setting information for therobot110. The company A can request various tasks from therobot110 of the company B. Furthermore, therobot110 is provided withvarious sensors110cand the motor abilities (movable unit110e). The access rights thereto from the company A are registered in thecompany B server111 as well as thecompany A server101 that is user side. Hereinafter, types of the access rights and permission levels thereof are described below. The setting of the access rights is performed by the user in step S3 ofFIG.4.
• The types of the access rights are classified into “Task”, “Sensor”, and “Motor Ability”. The “Task” is further classified into “Inducing to exercise” and “Conversation”. The “Sensor” is further classified into “Camera image”, “Ranging sensor”, “Infrared sensor”, “Microphone sound”, “Tactile sensor”, “Air temperature/humidity/barometric pressure sensor”, and “Position sensor”. The “Motor Ability” is further classified into “Ability to change facial expressions”, “Ability to vocalize”, “Ability to change a posture”, and “Ability to move”.
• The “Inducing to exercise” that belongs to the “Task” is the access right indicating to what extent the non-robot company (company A) can request therobot110 for the task of encouraging the user to exercise. The exercise mentioned here is, for example, walk, jogging, squats, push-ups, swimming, and yoga, or the like, and may be of any type. Here, for convenience of explanation, it is expressed that the access right is given when a request can be made, and that the access right is not given when a request cannot be made. The access right to “Inducing to exercise” is set in a stepwise manner as follows: from “0” without access right to “2” with the access right without limitation. For example, in response to a request for the “Inducing to exercise” task from the non-robot company (company A) whose permission level of this access right is “1”, a robot operating company (company B) permits a request for light exercise that is less than or equal to predetermined exercise load, and controls therobot110 and/or thecompany B server111 within the permitted range.
• 0: Not permitted
• 1: Only light exercise permitted
• 2: All permitted
• The “Conversation” that also belongs to the “Task” is the access right that indicates to which extent the non-robot company (company A) can request for talking with the user via therobot110. The access rights to the “Conversation” can be set by selecting from the following two choices: “0” without access right or “1” with access right. For example, the robot operating company (company B) gives a permission to the request for the “Conversation” from the non-robot company (company A) whose permission level is “1”, as having the access right. The robot operating company (company B) sets the microphone (“Microphone Sound” of thesensor110c) and the speaker (“Ability to vocalize” of the Motor ability) to be accessible to the non-robot company (company A). Consequently, the non-robot company (company A) controls therobot110 and/or thecompany B server111 so that the user and therobot110 can have a conversation. Therefore, if the access right to the “Conversation” task is also given, in conjunction therewith, the robot operating company (company B) also sets as if the non-robot company (company A) has the access right to the “Microphone sound” of thesensor110cand the “Ability to vocalize” of the Motor ability.
• 0: Not permitted
• 1: Permitted
• As described above, the task is used to determine whether or not to execute the request when the robot company receives the request for therobot110 to execute some task, from the non-robot company. Therefore, the access right setting information inFIG.5 is set for each non-robot company.
• Note that in the present disclosure, a series of autonomous operations for therobot110 to perform some encouragement or perform action on the user and/or a target object (for example, a TV remote controller, a lighting switch, or a door knob) in the real space, based on a request from the non-robot company is referred to as a task.
• The “Camera image” is the access right to an image sensor (for example, an RGB image sensor) included in the robot (110). This may be an image sensor that is provided in a place that is apparently perceived as eyes of the robot. The access right to the “Camera image” can be set in a stepwise manner as follows: from “0” without access right to “3” with the access right given without limitation. For example, in response to the access request from the non-robot company (company A) whose permission level is “2”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to return a low-quality moving image.
• 0: Not permitted
• 1: Only still images permitted
• 2: Up to low-quality moving images permitted
• 3: All permitted
• The “Ranging sensor” is the access right to thesensor110c(for example, a TOF sensor, a LIDAR, or the like) capable of measuring a distance to an object included in therobot110. The access right to the “Ranging sensor” can be set by selecting from the following two choices: “0” without access right or “1” with access right. For example, in response to the access request from the non-robot company (company A) whose permission level is “1”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to return data (for example, a depth image) acquired by the ranging sensor.
• 0: Not permitted
• 1: Permitted
• The “Infrared sensor” is the access right to a sensor included in therobot110 and capable of measuring infrared rays. An infrared sensor is used to recognize a subject in the dark in a near-infrared region and to measure a temperature distribution of the subject in a far-infrared region. The access right to the “Infrared sensor” can be set by selecting from the following two choices: “0” without access right or “1” with access right. For example, in response to the access request from the non-robot company (company A) whose permission level is “1”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to return data (for example, a thermography image) acquired by the infrared sensor.
• 0: Not permitted
• 1: Permitted
• The “Microphone sound” is the access right to the microphone included in therobot110. The access right to the “Microphone sound” can be set by selecting from the following two choices: “0” without access right or “1” with access right. For example, in response to the access request from the non-robot company (company A) whose permission level is “1”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to return audio data acquired by the microphone.
• 0: Not permitted.
• 1: Permitted
• The “Tactile sensor” is the access right to a sensor (for example, a MEMS silicon hair device sensor) included in therobot110 and capable of measuring tactile sensation on a surface of the robot. The access right to the “Tactile sensor” can be set in a stepwise manner as follows: from “0” without access right to “2” with the access right given without limitation. For example, in response to a request from the non-robot company (company A) whose permission level is “1”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to return only data on a part (for example, a head) of the robot, of data (for example, a pressure distribution image) acquired by the tactile sensor.
• 0: Not permitted
• 1: Only partially permitted
• 2: All permitted
• The “Air temperature/humidity/barometric pressure sensor” is the access right to an air temperature sensor, a humidity sensor, and a barometric pressure sensor included in therobot110. The access right to the “Air temperature/humidity/barometric pressure sensor” can be set by selecting from the following two choices: “0” without access right or “1” with access right. For example, in response to the access request from the non-robot company (company A) whose permission level is “1”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to return data acquired by the air temperature sensor, the humidity sensor, and the barometric pressure sensor, respectively.
• 0: Not permitted
• 1: Permitted
• The “Position sensor” is the access right to a sensor included in therobot110 and measuring a current position of the robot. The access right to the “Position sensor” can be set by selecting from the following two choices: “0” without access right or “1” with access right. For example, in response to the access request from the non-robot company (company A) whose permission level is “1”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to return data indicating information on the robot's current position that is acquired by the position sensor.
• 0: Not permitted
• 1: Permitted
• The above is the explanation on the access rights to thesensors110cincluded in therobot110. Then, the access rights to the motor abilities the robot is provided with are described below.
• The “Ability to change facial expressions” is the access right to the ability of therobot110 to change external characteristics of a face. When therobot110 has a section that can be apparently perceived as a face, this may be an ability to move parts making up that face or an ability to change a part color. The access right to the “Ability to change facial expressions” can be set by selecting from the following two choices: “0” without access right or “1” with access right. For example, in response to the access request from the non-robot company (company A) whose permission level is “1”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to change the facial expressions according to the request for changing the facial expressions.
• 0: Not permitted
• 1: Permitted
• The “Ability to vocalize” is the access right to the audio output capability provided in therobot110. When therobot110 has a section that can be apparently perceived as a mouth, this may be an ability to move parts making up the mouth or an ability to output sound from a periphery of the mouth. The access right to the “Ability to vocalize” can be set by selecting from the following two choices: “0” without access right or “1” with access right. For example, in response to the access request from the non-robot company (company A) whose permission level is “1”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to output the sound from the periphery of the mouth according to audio information that should be vocalized.
• 0: Not permitted
• 1: Permitted
• The “Ability to change posture” is the access right to an ability to change a posture that is included in therobot110. This may be an ability to change angles of a plurality of joint mechanism parts in themovable unit110eof therobot110. However, this is not an ability to change a position of therobot110 itself. The access right to the “Ability to change posture” can be set in a stepwise manner as follows: from “0” without access right to “2” with the access right given without limitation. For example, in response to the access request from the non-robot company (company A) whose permission level is “1”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to move only the head according to the request.
• 0: Not permitted
• 1: Only head permitted
• 2: All permitted
• The “Ability to move” is the access right to the ability to move included in therobot110. This may be the ability to change the angles of the plurality of joint mechanism parts in themovable unit110eof therobot110. However, the “Ability to move” is an ability to change the position of therobot110 itself. The access right to the “ability to move” can be set in a stepwise manner as follows: from “0” without access right to “4” with the access right given without limitation. For example, in response to the access request from the non-robot company (company A) whose permission level is “1”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to allow the robot to move at low speed in an area permitted by the user in the user's house. For example, in response to the access request from the non-robot company (company A) whose permission level is “3”, the robot operating company (company B) controls therobot110 and/or thecompany B server111 to allow the robot to move at high speed only inside and outside the area of house permitted by the user. Here, the area permitted by the user is one of conditions set by the user in advance. For example, it is possible to set in advance so that the robot cannot approach an area (for example, a bathroom) where the user's privacy may be violated.
• 0: Not allowed
• 1: Permitted to move at low speed only within the permitted house
• 2: Permitted to move at low speed to inside/outside the permitted house
• 3: Permitted to move at high speed to inside/outside the permitted house
• 4: All permitted
• FIG.6 is a table illustrating an example of the level of urgency degree for determining whether or not the requested task can be executed. The description onFIG.3 includes the scene in which thecompany A server101 transmits the request information for requesting exercise to the company B server111 (“(e) Requesting exercise (walk)”), and in response to this, thecompany B server111 transmits to therobot110 the instruction information requesting exercise (“(f) Inducing and instructing to exercise (walk)”). The request information transmitted in this scene includes urgency degree information. The urgency degree information is information indicating degree of urgency (urgency degree) for the user to exercise. Thecompany B server111 that receives the request information manages necessary urgency degree information. The necessary urgency degree information is information indicating urgency degree (necessary urgency degree) that becomes necessary for therobot110 to execute the requested task.
• The necessary urgency degree is used to cancel a request with a low urgency degree for the user, the request being made by other company (for example, the company A) via therobot110, such as while the user is concentrating on some specific work, or to suspend execution of the request till a timing when the encouragement is appropriate. The necessary urgency degree information is information held by thecompany B server111 or therobot110 and used by thecompany B server111 or therobot110. The urgency degree indicated by the urgency degree information included in the request information that is requested to therobot110 by another company (for example, the company A) is also set in accordance with the same criteria as those for the necessary urgency degree information. As illustrated inFIG.6, the necessary urgency degree may be set in stages such as high, medium, and low.
• “High”: When the necessary urgency degree is “high”, a request that notifies the user of information with high urgency concerning life, health, danger, or risk of property loss is processed. Otherwise, the request is suspended or rejected.
• “Medium”: When the necessary urgency degree is “medium”, a request that notifies the user of important information in the daily life is processed, in addition to the request whose necessary urgency degree is classified as “high”. Otherwise, the request is suspended or rejected. The important information in the daily life includes, for example, information for notifying the user of a next schedule, and information for notifying the user of a state at risk of significant loss (for example, leaving a gas oven on).
• “Low”: When the necessary urgency degree is “low”, all requests are executed.
• As such, when the necessary urgency degree is set high, among requests received by thecompany B server111 from the server of another company (the company A server101), only a request that is critical and urgent to the user is processed immediately. Any other requests are suspended or rejected. The urgency degree information included in the request information that is critical and urgent to the user is given by the other company (company A), which is the source, in accordance with the definition of the necessary urgency degree as described above.
• More specifically, if the urgency degree information (high, medium, or low) included in the request information transmitted by the server of the other company (for example, the company A server101) is equal to or higher than the necessary urgency degree information (high, medium, or low) set for the company B (for example, the company B server111), a request indicated by that request information is processed immediately. Otherwise, the request is not executed immediately and suspended till the appropriate timing or rejected.
• As noted above, in order to realize the scenario of providing the capabilities of therobot110 in the health management as illustrated inFIG.3, a description has been given of the cooperation setting between the company A and the company B, the access rights to the robot capabilities of the company A, and the urgency degree of the requests. Hereinafter, an overall flow of processing for realizing this scenario by using them is described.
• FIG.7 is a flowchart illustrating an example of a process in which the non-robot company requests a task from therobot110. In particular,FIG.7 illustrates a case where the request is immediately executed.
• As also illustrated inFIG.3, the application of the insurance company A (the company A app) that is installed in thesmartphone100 continuously detects the biological activity information of the user and accumulates the detected biological activity information in the memory in the smartphone100 (step S11). Furthermore, the company A app periodically uploads the accumulated biological activity information to the company A server101 (step S12). Thecompany A server101 that has received the biological activity information determines a need to transmit a message (nudge) recommending the user to exercise, based on an insurance contract between the user and the company A (step S13). If it is determined that there is the need to transmit the nudge, thecompany A server101 transmits the nudge (step S14). On the contrary, if it is determined that there is no need to transmit the message recommending exercise, thecompany A server101 continues a process of accumulating the biological activity information of the user that is uploaded from the company A app.
• In step S15, thesmartphone100 displays the message recommending exercise. This presents the message recommending exercise to the user.
• In step S16, even after displaying the message recommending exercise, the company A app and/or thecompany A server101 continuously detects the biological activity information of the user, calculates the amount of exercise taken by the user based on the detected biological activity information, and evaluates the calculated amount of exercise.
• Thecompany A server101 determines a need to encourage the user to exercise more strongly, based on the insurance contract between the user and the company A. Here, if a state is observed more than or equal to a predetermined number of times in which the amount of exercise taken by the user calculated in step S16 is less than the target amount of exercise, the company A app and/or thecompany A server101 determines that stronger encouragement is needed since the nudge did not improve the amount of exercise taken by the user. Here, it is assumed that the determination is made that the stronger encouragement is needed. On the contrary, if it is determined that the stronger encouragement is not needed, thecompany A server101 continues the process of accumulating the biological activity information of the user that is uploaded from the company A app. Here, for example, if the state is not observed more than or equal to a predetermined number of times in which the amount of exercise taken by the user calculated in step S16 is less than the target amount of exercise, the company A app and/or thecompany A server101 determines that stronger engagement is not needed
• Thecompany A server101 that determined in step S17 that the stronger encouragement is needed transmits to thecompany B server111 the request information requesting therobot110 for the task of encouraging the user to exercise.
• The request information includes the unique ID of the company A app of the user, the urgency degree information indicating urgency degree of the request, suspension period information indicating a suspension period till the request is executed, and content of the request. The content of the request indicates, for example, a task that is requested to therobot110. Thecompany B server111 that has received the request information can identify the unique ID of the company B app corresponding to the unique ID of the company A app, from the unique ID of the company A app included in the request information. Since thecompany B server111 manages the robot ID of therobot110 corresponding to the unique ID of the company B app, it is possible to uniquely identify therobot110 that is to execute the task requested by the company A.
• Furthermore, the request information includes the target amount of exercise needed by the user. The target amount of exercise is, for example, 5000 steps per day or 150 Kcal of calories burned in a day, or the like. In this example, the target amount of exercise is 5000 steps per day, and the current amount of exercise by user is 2000 steps per day. To urge the user to take a walk of 5000 steps per day, thecompany A server101 transmits the request information to thecompany B server111. In addition, the urgency degree indicated by the urgency degree information included in this request information is “low”.
• In step S18, thecompany B server111 that has received the request information determines whether or not response to the request is possible. Thecompany B server111 has set the necessary urgency degree indicated by the necessary urgency degree information to “low” before receiving this request information (step S10). Thus, thecompany B server111 compares the urgency degree indicated by the urgency degree information included in the received request information with the necessary urgency degree indicated by the preset necessary urgency degree information to determine whether or not response to the request is possible. Here, since the urgency degree indicated by the urgency degree information included in the request information is “low”, the necessary urgency degree indicated by the necessary urgency degree information is “low”, and the urgency degree indicated by the urgency degree information is equal to or higher than the necessary urgency degree indicated by the necessary urgency degree information, thecompany B server111 determines that the request indicated by this request information be immediately executed. Therefore, thecompany B server111 transmits to thecompany A server101 response possible information indicating that the request will be responded (step S19). The request information and the necessary urgency degree information are examples of the first information.
• Thecompany B server111 that has transmitted the response possible information transmits to therobot110 the instruction information instructing therobot110 to take an inducing action to urge the user to exercise that is equal to or larger than the target amount of exercise (step S20). This inducing action is the action of therobot110 such as telling the user “Let's go for a walk” or bringing the lead and asking for going for a walk, as described above. Depending on the appearance and motor abilities of therobot110, various forms of the inducing actions are used.
• The instruction information may include validity period information indicating the period of validity. The period of validity is, for example, 10 minutes. If therobot110 continues to ask the user to go for a walk for the period of validity based on the instruction information but the user does not respond, therobot110 may automatically stop the inducing action. Furthermore, if the behavior change of the user does not succeed in this manner, therobot110 may take the inducing action again after a certain period of time has elapsed, or while the user is relaxing. In addition, the period of validity of the inducing action in this case may be shorter than the period of validity of the last inducing action that failed. The reason for setting the period of validity shorter is that a relationship between the user and the robot may deteriorate if the failed inducing action is repeated in the same manner.
• Therobot110 that has received the instruction information from thecompany B server111 takes the inducing action to take the user out for exercise (taking a walk of 5000 steps per day) according to the instruction information (step S21). In this example, since therobot110 is the dog-shaped robot, it takes the inducing action of wagging its tail while barking “bow-wow”. This inducing action can remind the user of walk. Besides, therobot110 may repeat the inducing action of talking to the user in a language understandable by the user, such as “Let's take a walk” or “I want to go for a walk” or the like, and/or the inducing action of showing the intention of going for a walk by bringing the lead used for the walk, during the period of validity.
• If thecompany A server101 has the access right to thesensor110cor the motor abilities of therobot110 and seeks direct access to the motor abilities, thecompany A server101 analyzes a surrounding situation of therobot110, and, based on a result of the analysis, may transmit a command to control the facial expressions, the vocalization, the posture, and the movement of therobot110 to therobot110 directly or via thecompany B server111. Consequently, thecompany A server101 can directly control therobot110.
• In response to these inducing actions from therobot110, the user makes a decision to take a walk and takes exercise (a walk) with the robot (step S22). According to the instruction information from thecompany B server111 that instructs the walk of 5000 steps, therobot110 proposes a walking course to the user, and/or may lead the walking by itself, so that the number of steps of the walk will be 5000 steps.
• In a case where therobot110 does not have the ability to walk with the user, such as being small or having no function to walk, therobot110 may propose the walking course to the user, so that the number of steps of the walk will be 5000 steps. In this case, therobot110 may take the inducing action to encourage the user so that the use achieves the target amount of exercise. For example, therobot110 may speak such as “Let's stop by the nearby supermarket newly opened ” or “If you climb the hill tonight, you may be able to see a shooting star”. This adjusts the number of steps of the walk (amount of exercise).
• In this manner, if therobot110 senses by the camera image or the position sensor or the like that the user has returned home after successfully taking exercise (a walk), therobot110 transmits to thecompany B server111 an end notice indicating that the exercise (walk) with the user has ended and the taken exercise amount information indicating the amount of exercise taken in the exercise (step S23). The taken exercise amount information includes information indicating, for example, the number of steps, the walking course, and a pace of the walk.
• Thecompany B server111 transmits the end notice of the request and the taken exercise amount information to the company A server101 (step S24). Thecompany A server101 that has received the end notice and the taken exercise amount information records, in thememory101c,information indicating the requested exercise was taken and the taken exercise amount information, as an implementation record (step S25).
• If thecompany A server101 determines that the amount of taken exercise indicated by the taken exercise amount information is equal to or larger than the target amount of exercise indicated by target exercise amount information, thecompany A server101 transmits to thesmartphone100 the evaluation message indicating that the user has achieved the target amount of exercise (step S26). Thesmartphone100 that has received the evaluation message displays the evaluation message indicating that the target amount of exercise has been achieved, through the company A app (step S27). As a result, the user can obtain a certain sense of achievement and reduce the sense of resistance to exercise (walk). Note that if the amount of taken exercise is less than the target amount of exercise, thecompany A server101 may transmit an evaluation message indicating accordingly to thesmartphone100.
• Here, although the case where the request inducing to exercise is immediately executed is described, there is a case where the user cannot immediately respond to encouragement from therobot110 during a business meeting or the like.
• FIG.8 is a flowchart illustrating an example of a process in which the non-robot company requests a task from therobot110. In particular,FIG.8 illustrates a case where a request is not executed immediately.FIG.8 differs fromFIG.7 in the necessary urgency degree information when thecompany B server111 receives the request information. InFIG.7, the necessary urgency degree indicated by the necessary urgency degree information is “low” where any request is immediately executed by therobot110. On the other hand, inFIG.8, the necessary urgency degree indicated by the necessary urgency degree information is “medium”. Unless the urgency degree indicated by the urgency degree information included in the request information is “medium” or “high”, the request is not immediately executed. In this case, the request is suspended till an appropriate timing or rejected.FIG.8 exemplarily illustrates a case where the request is suspended till the appropriate timing.
• The process in which the company A continuously detects the biological activity information of the user using the company A app and thecompany A server101 and transmits to thecompany B server111 the request information with “low” urgency degree requesting the user to exercise (equivalent to 5000 steps in a walk) is same as that ofFIG.7 and thus a description thereof is omitted. A difference lies before the process (step S17) in which this request information is transmitted.
• In step S801, therobot110 determines on a statement of the user who has an intention of not communicating with therobot110 or the user's situation. In step S802, therobot110 updates the necessary urgency degree to “medium” (one example of a predetermined level) based on a result of the determination on the statement or the situation.
• For example, when the user makes a statement to therobot110 with the intention of not communicating with therobot110, such as “Keep quiet” or “Don't talk to me”, therobot110 only has to change the necessary urgency degree from “low” to “medium”. Alternatively, when therobot110 has recognized from sensing data of thesensor110cthat the user is talking or driving a car, therobot110 may change the necessary urgency degree from “low” to “medium”. Therobot110 that has changed the necessary urgency degree to “medium” transmits an update request for updating the necessary urgency degree to “medium” to thecompany B server111. Thecompany B server111 that has received this update request updates the necessary urgency degree from “low” to “medium” (step S802).
• Thecompany B server111 that has received the request information from thecompany A server101 determines whether or not response is possible, based on the urgency degree and the necessary urgency degree included in the request information (step S18). Here, since the “low” urgency degree is lower than the “medium” necessary urgency degree, thecompany B server111 determines that the request cannot be executed immediately. Thecompany B server111 that has determined that the request cannot be executed immediately transmits to thecompany A server101 suspension information indicating that the request has been suspended (step S803).
• Subsequently, therobot110 continuously performs a process to determine whether or not it is necessary to change the necessary urgency degree, based on the user's statement and the sensing data from thesensor110c(step S804). When the user expressly makes a statement that lowers the necessary urgency degree, when the user makes a statement including a topic which is not urgent, or when it is determined that the user takes on behavior with low urgency, therobot110 may set the necessary urgency degree to “low”. The behavior with low urgency is, for example, behavior such as watching TV, operating a smartphone, or the like.
• When the necessary urgency degree is updated from “medium” to “low”, therobot110 transmits to thecompany B server111 the update request for updating the necessary urgency degree to “low” (step S805).
• Thecompany B server111 hat has received the update request changes the necessary urgency degree from “medium” to “low”. Next, thecompany B server111 determines again whether or not response to the request that is being suspended is possible (step S806). Here, since the urgency degree indicated by the urgency degree information included in the request information transmitted from thecompany A server101 in step S803 is “low”, the necessary urgency degree indicated by the current necessary urgency degree information is “low”, and the urgency degree is equal to or higher than the necessary urgency degree, thecompany B server111 transmits the response possible information to the company A server101 (step S807).
• Since subsequent processing is the same as that ofFIG.7, a description thereof is omitted.
• As described with reference toFIG.7 andFIG.8, the mechanism of thecompany B server111 is summarized as follows. Thecompany B server111 causes therobot110 of the company B, which is familiar to the user, to execute a request that needs the motor abilities of thesensor110cor therobot110 that are not held by the company A (company A app). Thecompany B server111 performs the cooperation setting between the company A and the company B for each user. Based on the user's advance input, thecompany B server111 registers in advance the access right setting information that defines to what extent the respective capabilities of therobot110 of the company B are to be used by the company A. When the user is in the situation in which the user cannot care about therobot110, thecompany B server111 suspends or rejects a request with a low urgency degree. Thecompany B server111 re-executes the suspended request at an appropriate timing, in response to a request from the user or any change in the user's situation.
• FIG.9 is a flowchart illustrating an example of processing of thecompany B server111. In the processing ofFIG.9, thecompany B server111 determines whether or not the non-robot company (company A) has the access right necessary for carrying out a requested task, whether or not there is urgency to immediately execute the task requested for the user, and whether or not the request execution of which is suspended exceeds the suspension period, and responds to the request of the non-robot company (company A) based on the determination result. Specifically, the processing is as follows.
• In step S101, thecompany B server111 receives from thecompany A server101 the request information requesting therobot110 for the task of encouraging the user to exercise.
• In step S102, thecompany B server111 confirms the access right of the company A to the requested task. First, thecompany B server111 determines whether or not the pair information in which the unique ID of the company A app that is included in the request information is associated with the unique ID of the company B app has been pre-registered in thememory111c.Then, when thecompany B server111 determines that the pair information has been pre-registered, thecompany B server111 confirms based on the access right setting information illustrated inFIG.5 whether or not the company A holds the access right to the task requested by the request information. Here, since the permission level of the access right of the company A for the task of “Inducing to exercise” illustrated inFIG.5 is set to “1” or “2”, it is determined that the company A has the access right to the requested task. Note that if the permission level of the access right of the company A to the task of “Inducing to exercise” is “0”, it is determined that the company A has no access right.
• If it is determined that the company A has no access right (NO in step S103), thecompany B server111 transmits to thecompany A server101 a message indicating that the company A has no access right to execute the requested task (step S104), and the processing ends.
• On the other hand, if it is determined that the company A has the access right (YES in step S103), thecompany B server111 compares the urgency degree indicated by the urgency degree information included in the request information that is received in step S101 with the corresponding necessary urgency degree of the user currently set, and determines whether or not to execute the request indicated by the request information immediately (step S105).
• If the urgency degree is less than the necessary urgency degree (NO in step S105), thecompany B server111 determines whether or not time elapsed since receipt of the requested information is within the suspension period (step S109).
• The suspension period is time information indicating how long the request execution of which is suspended is to be suspended. When the elapsed time from receipt of the request information exceeds the suspension period (NO in step S109), thecompany B server111 rejects the request indicated by that request information (step S111). Thecompany B server111 that has rejected the request transmits to thecompany A server101 that made the request, a message that the request has been rejected as the suspension period was exceeded, and the processing ends.
• This prevents a large number of accumulated requests with the “low” urgency degree from being executed all at once at the moment when the necessary urgency degree is updated to “low”. Furthermore, it prevents execution of requests which is currently meaningless because a long time has passed since the requests were received. Rejection of such requests is needed to maintain the effect of encouragement to the user by therobot110.
• On the other hand, when the elapsed time from receipt of the request information is within the suspension period (YES in step S109), thecompany B server111 acquires state data of the user via therobot110 and re-evaluates the current necessary urgency degree via therobot110, based on the acquired state data (step S110). Alternatively, therobot110 may acquire the state data of the user, set the current necessary urgency degree by itself based on the acquired state data, and notify thecompany B server111. When the processing of step S110 ends, the processing returns to step S105. As a result, the loop processing illustrated in steps S105, S109, and S110 is performed. With this loop processing, only requests with the urgency degree that is equal to or higher than the necessary urgency degree that becomes necessary for encouraging the user are executed as needed, and execution of requests that do not have the urgency degree that is equal to or higher than the necessary urgency degree that becomes necessary for encouraging the user continues to be suspended during the suspension period. The state data is data that dynamically varies in relation to the user's state sensed by therobot110. Specifically, as illustrated inFIG.9 below, the state data includes the necessary urgency degree information that is set based on the sensing data by thesensor110cof therobot110.
• When the urgency degree indicated by the urgency degree information included in the request from thecompany A server101 is equal to or higher than the necessary urgency degree managed by thecompany B server111 or the robot110 (YES in step S105), the processing proceeds to step S106.
• In step S106, when the user is in a state in which the user may be encouraged to exercise, thecompany B server111 transmits the instruction information instructing therobot110 to execute the task requested from thecompany A server101. Therobot110 that has received the instruction information executes the task according to the instruction information. As a result, therobot110 takes the inducing action to take the user out for a walk. The user who has decided to take a walk by this inducing action takes a walk with therobot110. Therobot110 that has returned from the walk transmits to thecompany B server111 a task execution result, the end notice informing the end of the walk, and the taken exercise amount information in the walk. As a result, thecompany B server111 receives the end notice and the taken exercise amount information (step S107).
• In step S108, thecompany B server111 transmits the received end notice and taken exercise amount information to thecompany A server101.
• Note that if thecompany A server101 has the access rights to thesensor110c,the ability to change facial expressions, the ability to vocalize, the ability to change posture, and/or the ability to move, which are the motor abilities, for therobot110, the company A server may directly control the facial expressions, the voice utterance, the posture, and/or the movement of therobot110, according to the surrounding conditions of therobot110 via thecompany B server111. Also in this case, therobot110 instructed by thecompany B server111 to execute the task may transmit the task execution result to thecompany B server111. That is, although thecompany A server101 remotely controls therobot110, it is thecompany B server111 that directly controls therobot110, and the relationship between therobot110 and thecompany B server111 is the same as the aspect described above.
• It is expected that remote control of therobot110 by thecompany A server101 will be realized in the future by establishing high-speed and low-latency wireless communication infrastructure called “5G” or “Beyond 5G”, or the like. Thecompany B server111 that has received the task execution result transmits the execution result to thecompany A server101, which is the request source of the task, and the processing ends.
• FIG.10 is a table illustrating an example of setting of the necessary urgency degree.FIG.10 illustrates a transition in the user's states from 8′oclock in the morning to 8′oclock in the evening. Although in the following description, a description is given assuming that therobot110 sets the necessary urgency degree, this is an example, and thecompany B server111 may set. In this case, thecompany B server111 may set the necessary urgency degree based on the sensing data acquired via therobot110.
• Therobot110 continuously senses the user's state, detects the user's state from the sensing result, as needed, and updates the necessary urgency degree appropriately based on the detection result.
• During a time zone from 8:00 to 10:00, the user is talking with another person face-to-face. Using thesensor110csuch as the camera and the microphone or the like, therobot110 determines that the user is talking with the other person. A neural network has been developed that determines or explains human behavior and states from still images, moving images, or audio. Therefore, using an image recognition technique or an audio recognition technique based on such a neural network, therobot110 may detect the user's state. After determining that the user's state is talking, therobot110 sets the necessary urgency degree to “medium”. As a result, unless a request has the “medium” or higher urgency degree, the request will no longer be executed. Then, therobot110 shares the set necessary urgency degree with thecompany B server111.
• Further in this determination, therobot110 may also perform a sentiment analysis of the user from conversation content and voice tone, or the like, included in the facial expressions and gestures acquired from the camera and/or audio information acquired from the microphone. Here, results of the sentiment analysis are classified to, for example, “positive”, “neutral”, and “negative”. In the case of conversations for which the result of the sentiment analysis is “positive” or “neutral”, it is highly likely that the user will tolerate interruptions by therobot110 to the conversation to execute the task. In this case, therobot110 may lower the necessary urgency degree set above. In addition, in the case of the conversation for which the result of the sentiment analysis is “negative”, it is highly likely that the user will not tolerate the interruptions to the conversation. Thus, therobot110 may maintain or increase the necessary urgency degree set above. When the necessary urgency degree is changed, therobot110 shares the changed necessary urgency degree with thecompany B server111.
• Adding the sentiment analysis of the user to the determination on the user's state in this manner enables therobot110 to process the task in a more appropriate timing for the user.
• Here, although the results of the sentiment analysis are classified to three categories, the present disclosure is not limited thereto. The results of the sentiment analysis may be classified to more categories such as “delight, anger, sorrow, and pleasure” or fewer categories such as two categories of “positive” and “negative”. In addition, therobot110 may estimate a degree of user's stress and adjust the necessary urgency degree according to a numerical range of the estimated degree of stress.
• During the time zone from 10:00 to 12:00, the user is working (working) at a computer. Using thesensor110csuch as the camera, the microphone, or the like, therobot110 detects that the user is operating the computer. After determining that the user is working at the computer, therobot110 maintains the necessary urgency degree at “medium”. In this case, unless a request has the “medium” or higher urgency degree, the request will not be executed. Then, therobot110 shares the set necessary urgency degree with thecompany B server111.
• During the time zone from 12:00 to 13:00, the user is sitting on a chair and having a meal. Using thesensor110csuch as the camera, the microphone, or the like, therobot110 detects that the user is having a meal. After determining that the user is having a meal, therobot110 sets the necessary urgency degree to “low” which is the lowest. Then, therobot110 shares the set necessary urgency degree with thecompany B server111.
• During the time zone of 13:00 to 15:00, the user is on the phone or in a meeting. Using thesensor110csuch as the camera, the microphone, or the like, therobot110 detects that the user is talking over a mobile phone (on the phone) or talking over the computer (in the meeting). After determining that the user is on the phone or in the meeting, therobot110 sets the necessary urgency degree to “medium”. In this case, unless a request has the “medium” or higher urgency degree, the request will not be executed. Then, therobot110 shares the set necessary urgency degree with thecompany B server111.
• During the time zone from 15:00 to 16:00, the user is exercising. Using thesensor110csuch as the camera, the microphone, or the like, therobot110 detects that the user is exercising. After determining that the user is exercising, therobot110 maintains the necessary urgency degree at “medium”.
• Further in this determination, the robot may measure a periodic change in the user's skin color based on the image acquired from the camera or may measure the user's heart rate by using a smart watch, or the like. When the heart rate measured here is lower than a predetermined value, it is highly likely that the user will tolerate the interruptions by therobot110 to the exercise to execute the task. In this case, therobot110 may lower the necessary urgency degree. On the other hand, when the heart rate is higher than the predetermined value, it is highly likely that the user will not tolerate the interruptions by therobot110 to exercise to execute the task. Therefore, therobot110 may maintain the necessary urgency degree or increase the necessary urgency degree. When the necessary urgency degree is changed, therobot110 shares the changed necessary urgency degree with thecompany B server111.
• When it is determined that the user's state is exercising in this manner, adding the user's heart rate enables therobot110 to process the task in a more appropriate timing for the user.
• During the time zone of 16:00 to 20:00, the user is lying down and relaxing. Using thesensor110csuch as the camera, the microphone, or the like, therobot110 detects that the user is in a relaxing state. After determining that the user is in the relaxing state, therobot110 sets the necessary urgency degree to “low” which is the lowest. Then, therobot110 shares the necessary urgency degree with thecompany B server111.
• In this manner, the user's state is changing from moment to moment. Utilizing thesensor110c,therobot110 senses the user's state and determines the user's state, as needed. Furthermore, therobot110 updates the necessary urgency degree based on the determination result. When updating the necessary urgency degree, therobot110 notifies thecompany B server111 of the updated necessary urgency degree and shares the most recent necessary urgency degree with thecompany B server111. In this manner, the necessary urgency degree varies depending on the user's state, as needed.
• As such, according to the present embodiment, when determining that it is necessary to encourage the user to exercise, thecompany A server101 can encourage the user to exercise through therobot110 managed by thecompany B server111.
• Consequently, even though thecompany A server101 itself does not control therobot110, thecompany A server101 can cause therobot110 to take the action to encourage the user to exercise. Therefore, it is possible to give the user the stronger motivation to exercise than a case where the videoaudio output unit100fof the user'ssmartphone100 merely displays a message urging the user to exercise.
• Note that the present embodiment can be employed in the following modification examples.
• (1) In step S801 ofFIG.8, therobot110 may ask the user a question, such as “May I talk to you now?” or “May I bother you a bit?” to confirm he user's current necessary urgency degree, and cause the user to answer. Therobot110 directly asks the user of the questions as described above if the number of requests that have not been executed at a predetermined timing or yet, and/or when the urgency degree thereof meets predetermined conditions, or the like. With these questions, therobot110 may acquire information for setting the necessary urgency degree, from content of the user's answer. In the case of this method, since therobot110 can directly confirm with the user about the necessary urgency degree, therobot110 can set and update the necessary urgency degree information as recognized by the user.
• Here, when the user gives a positive answer such as “OK” to the above question, therobot110 may set the necessary urgency degree to the low level such as “low”. In addition, when the user answers such as “Please come later” or when no answer can be obtained, therobot110 may set the necessary urgency degree to the high level such as “medium” or “high”, assuming that it is not the right time to encourage the user.
• (2) Thesmartphone100 is an example of an information terminal, and in the present disclosure, the information terminal is not limited to thesmartphone100. The information terminal may be a tablet computer and a portable information terminal may be employed.
• According to the present disclosure, it is possible to safely realize the demand or direct control of sensors or motor abilities held by devices of other companies. This makes it possible to perform some kind of action from cyber space to physical space through software by fusing the cyber space and the physical space, from the conventional distribution of information only in the cyber space, which can thus be expected as a basic technique for a wide variety of industrial uses.

Claims (27)

What is claimed is:

1. A method for a first server that communicates with a robot and controls the robot, comprising:

acquiring, from a second server, request information that indicates a request for an action of the robot and that includes urgency degree information indicating a first urgency degree for the user to exercise, wherein the second server determines whether or not it is required to encourage a user to exercise based on biological activity information acquired from an information terminal of the user, the biological activity information indicating biological activity of the user, and wherein the request information is transmitted from the second server after the second server determines that it is required to encourage the user to exercise;

if it is confirmed at the first server that the second server has an access right to make the robot perform the request indicated by the request information, making a decision for one of an action group comprising at least two of execution, suspension, or rejection of the request based on i) the urgency degree information and ii) necessary urgency degree information that is managed at the first server, wherein the necessary urgency degree information indicates a second urgency degree that is required for the robot to execute the request; and

after the decision to execute the request is made, transmitting, to the robot, instruction information that causes the robot to take an action for encouraging the user to exercise.

2. The method according toclaim 1, wherein

the decision to execute the request is made, if the first urgency degree indicated by the urgency degree information is equal to or higher than the second urgency degree indicated by the necessary urgency degree information.

3. The method according toclaim 1, wherein

a decision to suspend or reject the request is made, if the first urgency degree indicated by the urgency degree information is less than the second urgency degree indicated by the necessary urgency degree information.

4. The method according toclaim 1, wherein

the request information further includes suspension period information indicating a suspension period during which a decision on the request indicated by the request information can be suspended, and

a decision to reject the request is made, if, during the suspension period, the first urgency degree indicated by the urgency degree information is not equal to or higher than the second urgency degree indicated by the necessary urgency degree information.

5. The method according toclaim 1, wherein

the request information further includes suspension period information indicating a suspension period during which a decision on the request indicated by the request information can be suspended, and

the decision to execute the request is made, if, during the suspension period, the first urgency degree indicated by the urgency degree information is equal to or higher than the second urgency degree indicated by the necessary urgency degree information.

6. The method according toclaim 1, wherein

the second urgency degree is determined based on information indicating a statement made by the user toward the robot, the statement being obtained based on a sensing result of a sensor provided on the robot, and

if the statement includes a word with an intention of not communicating with the robot, the second urgency degree is increased to a predetermined level.

7. The method according toclaim 1, wherein

the second urgency degree is determined based on information indicating an answer made by the user to a question, the information being acquired by the robot, and

the question is outputted from a speaker of the robot and is a question to confirm with the user the second urgency degree.

8. The method according toclaim 1, wherein

the second urgency degree is determined based on behavior of the user that is obtained by analyzing an image of the user acquired from the sensor provided on the robot, and

when the behavior of the user is being on the phone or operating a personal computer, the second urgency degree is increased to a predetermined level.

9. The method according toclaim 1, wherein

the instruction information further includes validity period information indicating a period of validity of the instruction information.

10. The method according toclaim 9, wherein

if time elapsed from the determined timing exceeds the period of validity, the robot cancels the instruction information without encouraging the user to exercise.

11. The method according toclaim 1, further comprising

transmitting, to the second server, taken exercise amount information indicating an amount of exercise taken by the user, after obtaining, from the robot, information indicating that the robot has taken the action indicated in the instruction information to encourage the user to exercise.

12. The method according toclaim 1, wherein

the first server is managed by a first operator that manages the robot,

the second server is managed by a second operator that manages the biological activity information acquired from the information terminal of the user, and

the second operator is different from the first operator.

13. A method for a second server that communicates with a first server associated with a robot and communicates with an information terminal of a user, the method comprising:

acquiring biological activity information indicating biological activity of the user from the information terminal of the user;

based on the biological activity information, determining whether or not it is required to encourage the user to exercise; and

transmitting, to the first server, request information that indicates a request for an action of the robot and that includes urgency degree information indicating a first urgency degree for the user to exercise, after it is determined at the second server that it is required to encourage the user to exercise, wherein if the first server confirms that the second server has an access right to make the robot perform the request by the request information, a decision for one of an action group comprising at least two of execution, suspension, or rejection of the request is made based on i) the urgency degree information and ii) necessary urgency degree information that is managed by the first server, the necessary urgency degree information indicating a second urgency degree that is required for the robot to execute the request, and wherein instruction information that causes the robot to take an action for encouraging the user to exercise is transmitted from the first server to the robot after the decision to execute the request is made at the first server.

14. The method according toclaim 13, wherein

the request information includes exercise amount information indicating an amount of exercise required for the user, the amount being calculated based on the biological activity information,

the method comprising:

after the user exercises as a result of the robot encouraging the user to exercise based on the request information, acquiring taken exercise amount information indicating the amount of exercise that the user has taken;

creating an evaluation message that evaluates the exercise of the user based on the exercise amount information and the taken exercise amount information, and

transmitting the evaluation message to the information terminal of the user.

15. The method according toclaim 14, wherein

if it is determined based on the exercise amount information and the taken exercise amount information that the amount of exercise taken by the user is equal to or larger than an amount of exercise targeted by the user, a message that user has achieved the target amount of exercise is created, as the evaluation message.

16. A method for a first server that communicates with a robot and controls the robot, comprising:

acquiring, from a second server, request information indicating a request for an action of the robot, wherein the second sever determines whether or not it is required to encourage a user to exercise based on biological activity information acquired from an information terminal of the user, the biological activity information indicating biological activity of the user, and wherein the request information is transmitted from the second server after the second server determines that it is required to encourage the user to exercise;

acquiring, from the robot, state data that is detected by the robot and that dynamically changes in relation to a state of the user, and

transmitting to the robot, instruction information for causing the robot to take an action for encouraging the user to exercise in response to the request information, after it is determined at the first server that the user is in a state in which the user can be encouraged to exercise based on the request information and the dynamic changes in the state data.

17. The method according toclaim 16, wherein

the request information further includes suspension period information indicating a suspension period during which a determination on the instruction information in response to the request information can be suspended, and

a decision to transmit the instruction information is made, when the user is in the state in which the user can be encouraged to exercise in the suspension period.

18. The method according toclaim 17, wherein

a decision not to transmit the instruction information is made, if the user is not in the state in which the user may be encouraged to exercise in the suspension period.

19. The method according toclaim 16, wherein

the request information includes urgency degree information that indicates a first urgency degree for the user to exercise, and

the state data includes necessary urgency degree information i) that depends on the dynamic changes in the state data acquired from the robot and ii) that indicates a second urgency degree that is required for the robot to execute the request.

20. The method according toclaim 19, wherein

it is determined whether or not the user is in the state in which the user can be encouraged to exercise, based on the urgency degree information and the necessary urgency degree information.

21. The method according toclaim 19, wherein

a decision to transmit the instruction information is made, when the first urgency degree indicated by the urgency degree information is equal to or higher than the second urgency degree indicated by the necessary urgency degree information.

22. The method according toclaim 21, wherein

a decision to suspend the transmission of the instruction information is made, when the first urgency degree indicated by the urgency degree information is less than the second urgency degree indicated by the necessary urgency degree information.

23. The method according toclaim 16, further comprising:

transmitting the instruction information to the robot, if it is confirmed that the second server has the access right to make the robot perform the request by the request information.

24. The method according toclaim 23, wherein

the first server registers registration information indicating whether or not the second server has the access right, and

the first server confirms based on the registration information that the second server has the access right.

25. A method for a second server that communicates with a first server associated with a robot and communicates with an information terminal of a user, the method comprising:

acquiring biological activity information indicating biological activity of the user from the information terminal of the user;

based on the biological activity information, determining whether or not it is required to encourage the user to exercise; and

transmitting, to the first server, request information indicating a request for an action of the robot after it is determined at the second server that it is required to encourage the user to exercise, wherein, at the first server, state data that is detected by the robot and that dynamically changes in relation to a state of the user is acquired from the robot, and wherein instruction information that causes the robot to take an action for encouraging the user to exercise is transmitted from the first server to the robot in response to the request information after it is determined at the first server based on the request information and the dynamic changes in the state data that the state of the user is a state in which the user can be encouraged to exercise.

26. The method according toclaim 25, wherein

the request information includes exercise amount information indicating an amount of exercise required for the user, the amount being calculated based on the biological activity information,

the method comprising:

after the user exercises as a result of the robot encouraging the user to exercise based on the request information, acquiring taken exercise amount information indicating the amount of exercise that the user has taken;

creating an evaluation message that evaluates the exercise of the user based on the exercise amount information and the taken exercise amount information, and

transmitting the evaluation message to the information terminal of the user.

27. The method according toclaim 26, wherein

if it is determined based on the exercise amount information and the taken exercise amount information that the amount of exercise taken by the user is equal to or larger than an amount of exercise targeted by the user, a message that user has achieved the target amount of exercise is created, as the evaluation message.

Images