US20160045170A1 - Information processing device, image output method, and program - Google Patents

Abstract

There is provided an information processing device including: a storage unit that stores a plurality of exercise models each including one or more kinds of measured values measured in time series for a person doing exercise and exercise description data specifying exercise recognized based on the measured values; a selection unit that selects one or more exercise models from the plurality of exercise models stored in the storage unit according to a designated condition; and an output unit that outputs a series of output images representing the measured values and exercise specified by the exercise description data in time series for the exercise model selected by the selection unit.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
• This application claims the benefit under 35 U.S.C. §120 of U.S. application Ser. No. 13/071,789, entitled “INFORMATION PROCESSING DEVICE, IMAGE OUTPUT METHOD, AND PROGRAM” filed on Mar. 25, 2011, which claims priority under 35 U.S.C. §119 to Japanese Patent Application No. JP2010-078892, filed in the Japan Patent Office on Mar. 30, 2010, the entire contents of each of which are incorporated herein by reference.
BACKGROUND OF THE INVENTION
• 1. Field of the Invention
• The present invention relates to an information processing device, an image output method, and a program.
• 2. Description of the Related Art
• Physical exercises aiming to maintain or improve health, enhance athletic ability and so on are performed on a routine basis today. Jogging, walking, cycling, swimming or the like is among examples of such physical exercises. As techniques to support exercise of a user, there are techniques to measure biometric information of a user doing exercise, techniques to manage measured information, techniques to recommend some type of exercise to a user and so on. For example, Japanese Unexamined Patent Application Publication No. 2002-291952 discloses a technique that delivers exercise program data indicating the content of exercise recommended based on physical data of a user from a server to a wrist watch of the user, so that even a person with no expert knowledge on exercise can do appropriate exercise.
SUMMARY OF THE INVENTION
• However, the technique disclosed in Japanese Unexamined Patent Application Publication No. 2002-291952 merely presents the content of exercise and the duration or the number of times of exercise which are specified in the exercise program data to a user on a screen of a wrist watch. Thus, the technique may not allow a user for comparing between the present and past exercises of the user or comparing between exercise of the user and exercise of another user. Further, there seems to be no technique that allows a user to easily make the above-described comparison of exercise while doing exercise.
• In light of the foregoing, it is desirable to provide novel and improved information processing device, image output method and program that allow a user to easily recognize exercise for comparison while doing exercise.
• According to an embodiment of the present invention, there is provided an information processing device including: a storage unit that stores a plurality of exercise models each including one or more kinds of measured values measured in time series for a person doing exercise and exercise description data specifying exercise recognized based on the measured values; a selection unit that selects one or more exercise models from the plurality of exercise models stored in the storage unit according to a designated condition; and an output unit that outputs a series of output images representing the measured values and exercise specified by the exercise description data in time series for the exercise model selected by the selection unit.
• The output image may be an image displaying a character as an avatar of a 15 person doing exercise specified by the exercise description data.
• The output unit may vary a state of the character in time series according to the measured values in the selected exercise model.
• The exercise model may include position data indicating a position of a person doing exercise, the information processing device may further include a position acquisition unit that acquires a current position of a user, and the output unit may vary a display position or a size of the character in time series according to the position of the person indicated by the position data of the selected exercise model and the current position of the user acquired by the position acquisition unit.
• The output image may be an image further displaying at least one kind of the measured values.
• A condition for selecting an exercise model of a person being the same as a user doing exercise may be included as an option of the condition.
• A condition for selecting an exercise model of a well-known person may be included as an option of the condition.
• A condition for selecting an exercise model of a person with at least one attribute of age, sex, height and weight being common or similar to a user doing exercise may be included as an option of the condition.
• The information processing device may further include: a measurement unit that outputs the one or more kinds of measured values for a user doing exercise; and an exercise recognition unit that recognizes exercise of a user based on the measured values output by the measurement unit, wherein when current exercise of the user recognized by the exercise recognition unit is different from exercise specified by the exercise description data of the exercise model being processed by the output unit, the selection unit may select another exercise model to be processed by the output unit.
• The information processing device may further include: a measurement unit that outputs the one or more kinds of measured values for a user doing exercise; an exercise recognition unit that recognizes exercise of a user based on the measured values output by the measurement unit; and an exercise model creation unit that creates the exercise model for the user using a recognition result by the exercise recognition unit.
• According to another embodiment of the present invention, there is provided an image output method using an information processing device including a storage unit that stores a plurality of exercise models each including one or more kinds of measured values measured in time series for a person doing exercise and exercise description data specifying exercise recognized based on the measured values, the method including steps of: selecting one or more exercise models from the plurality of exercise models stored in the storage unit according to a designated condition; and outputting a series of output images representing the measured values and exercise specified by the exercise description data in time series for the selected exercise model.
• According to another embodiment of the present invention, there is provided a program causing a computer that controls an information processing device including a storage unit that stores a plurality of exercise models each including one or more kinds of measured values measured in time series for a person doing exercise and exercise description data specifying exercise recognized based on the measured values to function as: a selection unit that selects one or more exercise models from the plurality of exercise models stored in the storage unit according to a designated condition; and an output unit that outputs a series of output images representing the measured values and exercise specified by the exercise description data in time series for the exercise model selected by the selection unit.
• According to the embodiments of the present invention described above, it is possible to provide the information processing device, image output method and program that allow a user to easily recognize exercise for comparison while doing exercise.
BRIEF DESCRIPTION OF THE DRAWINGS
• FIG. 1 is a first schematic view showing an overview of an information processing system according to one embodiment;
• FIG. 2 is a second schematic view showing an overview of an information processing system according to one embodiment;
• FIG. 3 is a third schematic view showing an overview of an information processing system according to one embodiment;
• FIG. 4 is a block diagram showing an example of a configuration of an30 information processing device according to one embodiment;
• FIG. 5 is an explanatory view to explain registration of user data according to one embodiment;
• FIG. 6 is an explanatory view to explain an exercise recognition process according to One embodiment;
• FIG. 7 is an explanatory view to explain creation of an exercise model according to one embodiment;
• FIG. 8 is an explanatory view to explain a type of a person regarding an exercise model according to one embodiment;
• FIG. 9 is an explanatory view to explain a selection condition designation screen according to one embodiment;
• FIG. 10 is a first explanatory view to explain creation of a character image according to one embodiment;
• FIG. 11 is a second explanatory view to explain creation of a character image according to one embodiment;
• FIG. 12 is a third explanatory view to explain creation of a character image according to one embodiment;
• FIG. 13 is an explanatory view showing an example of an output image according to one embodiment;
• FIG. 14 is an explanatory view showing another example of an output image according to one embodiment;
• FIG. 15 is a flowchart showing an example of an overall flow of information processing according to one embodiment;
• FIG. 16 is a flowchart showing an example of a flow of a model creation process according to one embodiment; and
• FIG. 17 is a flowchart showing an example of a flow of a model display process according to one embodiment.
DETAILED DESCRIPTION OF THE EMBODIMENT(S)
• Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
• Preferred embodiments of the present invention will be described hereinafter in the following order.
• 1. Overview of System
• 2. Configuration of Information Processing Device according to Embodiment
• 2-1. Registration of User Data
• 2-2. Measurement and Recognition of Exercise
• 2-3. Creation of Exercise Model
• 2-4. Display of Exercise Model
• 3. Flow of Process according to Embodiment
• 3-1. Overall Flow
• 3-2. Model Creation Process
• 3-3. Model Display Process
• 4. Summary
1. OVERVIEW OF SYSTEM
• An overview of an information processing system according to one embodiment of the present invention is described hereinafter with reference toFIGS. 1 to 3.
• FIG. 1 is a schematic view showing an overview of aninformation processing system1aaccording to one embodiment of the present invention. Referring toFIG. 1, a user Ua of theinformation processing system1ais running. Theinformation processing system1aincludes aninformation processing device100a, a sensor set102a, and adisplay device104a.
• The sensor set102ais worn by the user Ua. While the user Ua is doing exercise, the sensor set102aperiodically acquires one or more kinds of measured values for the user Ua and transmits the acquired measured values to theinformation processing device100a.FIG. 1 shows only the sensor set102awhich is worn on the wrist of the user for simplification of the figure. However, sensors included in the sensor set102amay be worn on other parts of the body of a user or carried by a user. The sensor set102amay include an acceleration sensor that acquires the acceleration of each part of the body of the user Ua, a gyro sensor that acquires the posture of each part, an myoelectric sensor that acquires the myoelectric potential of each part, a heart beat meter that acquires the heart beat of the user Ua, a respirometer that acquires the breathing rate, a clinical thermometer that acquires the body temperature, a sudorometer that acquires the sweating or the like.
• Thedisplay device104ais worn by the user Ua. Thedisplay device104areceives an output image created by theinformation processing device100aand displays the received output image for the user Ua. In the example ofFIG. 1, thedisplay device104ais a head-mounted display.
• Theinformation processing device100ais a device that processes the measured values received from the sensor set102aand creates the output image to be displayed for the user Ua. Theinformation processing device100amay be a general-purpose computer having a connection interface (i.e. a wireless or wired communication interface) to make connection with the sensor set102aand thedisplay device104a, for example. Further, it is not limited to the example ofFIG. 1, and theinformation processing device100amay be a device which is physically integral with any one or both of the sensor set102aand thedisplay device104a.
• FIG. 2 is a schematic view showing an overview of aninformation processing system1baccording to another embodiment of the present invention. Referring toFIG. 2, a user Ub of theinformation processing system1bis running on a treadmill. Theinformation processing system1bincludes aninformation processing device100b, asensor set102b, and adisplay device104b.
• Somesensor102b-1 of the sensor set102bis worn by the user Ub. On the other hand,other sensor102b-2 of the sensor set102bis not worn by the user Ub. While the user Ub is doing exercise, the sensor set102bperiodically acquires one or more kinds of measured values for the user Ub and transmits the acquired measured values to theinformation processing device100b, just like the sensor set102aofFIG. 1. Thesensor102b-1 which is worn by the user may include a sensor similar to that of the sensor set102aofFIG. 1, such as an acceleration sensor that acquires the acceleration of each part of the body of the user Ub. Further, thesensor102b-2 may include a clinical thermometer that acquires the body temperature of the user Ub by detecting infrared rays emitted from the body of the user Ub, a concentration meter that acquires the carbon dioxide levels of the expired air of the user Ub or the like.
• Thedisplay device104ais mounted on the treadmill being used by the user Ub. Thedisplay device104areceives an output image created by theinformation processing device100band displays the received output image for the user Ub.
• Theinformation processing device100bis a device that processes the measured values received from the sensor set102band creates the output image to be displayed for the user Ub, just like theinformation processing device100aofFIG. 1. The information processing device10013 may be a general-purpose computer having a connection interface to make connection with the sensor set102band thedisplay device104b, for example. Further, it is not limited to the example ofFIG. 2, and theinformation processing device100bmay be a device which is physically integral with any one or both of the sensor set102band thedisplay device104b.
• FIG. 3 is a schematic view showing an overview of an information processing system1caccording to yet another embodiment of the present invention. Referring toFIG. 3, a user Uc of the information processing system1cis swimming in a swimming pool. The information processing system1cincludes aninformation processing device100c, a sensor set102a, and adisplay device104c. The sensor set102ais the same as the sensor set which is described earlier with reference toFIG. 1.
• Thedisplay device104cis a projector capable of projecting an image on the bottom surface of the swimming pool where the user Uc is swimming. Thedisplay device104creceives an output image created by theinformation processing device100cand projects the received output image on the bottom surface of the swimming pool. Note that, in the information processing system1c, a screen of the display device may be mounted on the bottom surface of the swimming pool, rather than projecting an image on the bottom surface of the swimming pool using the projector.
• Theinformation processing device100cis a device that processes the measured values received from the sensor set102aand creates the output image to be projected by thedisplay device104c, just like theinformation processing device100aofFIG. 1. Theinformation processing device100cmay be a general-purpose computer having a connection interface to make connection with the sensor set102aand thedisplay device104c, for example.
• Thus, any of theinformation processing devices100ato100cdescribed with reference toFIGS. 1 to 3 is a device that measures one or more kinds of measured values for a user doing exercise and creates an output image to be displayed for the user. In the following description of this specification, when there is no need to distinguish among theinformation processing devices100a,100band100c, they are collectively referred to as theinformation processing device100 by omitting the alphabetical letter at the end of the symbol. The same applies to the information processing system1 (1a,1band1c), the sensor set102 (102aand102b), and the display device104 (104a,104band104c).
2. CONFIGURATION OF INFORMATION PROCESSING DEVICE ACCORDING TO EMBODIMENT
• A specific configuration of theinformation processing device100 according to one embodiment of the present invention is described hereinafter with reference toFIGS. 4 to 14.FIG. 4 is a bock diagram showing an example of the configuration of theinformation processing device100 according to one embodiment. Referring toFIG. 4, theinformation processing device100 includes auser interface110, a userdata management unit120, ameasurement unit130, anexercise recognition unit140, aposition acquisition unit150, astorage unit160, amodel creation unit170, aselection unit180, and anoutput unit190.
[2-1. Registration of User Data]
• Theuser interface110 provides an interface for theinformation processing device100 to accept an instruction or information input from a user. Theuser interface110 may be GUI (Graphical User Interface) using a screen displayed by thedisplay device104, or an audio input interface or the like. Theuser interface110 is used not only for registration of user data, which is described in this section, but also for input of conditions when displaying an exercise model, which is described later.
• The userdata management unit120 manages user data for a user of theinformation processing device100. The user data is input by a user through a user data registration screen W1 as shown inFIG. 5, for example.
• Referring toFIG. 5, the user data registration screen W1 is shown at the left. The user data registration screen W1 contains an attribute input field for inputting a nickname, height, weight, sex and age of one user and a designation field for designating a face picture, for example. The userdata management unit120 acquires attribute values of each user through the user data registration screen W1 and stores user data containing the acquired attribute values into thestorage unit160.
• User data122 as an example stored in thestorage unit160 is shown at the right ofFIG. 5. Theuser data122 contains six attribute items of nickname (name), height, weight, sex, age and file pass (facePic) of an image file of a face picture in addition to a user ID for identifying each user. The attribute values for those attribute items may be updatable by a user using a user data update screen (not shown) provided by the userdata management unit120, for example.
[2-2. Measurement and Recognition of Exercise]
• Processing by theinformation processing device100 after the user data is registered is broadly divided into measurement and recognition of exercise, creation of exercise model, and display of exercise model. In this section, the measurement and recognition of exercise are described. The measurement and recognition of exercise mainly involve themeasurement unit130, theexercise recognition unit140, theposition acquisition unit150 and thestorage unit160.
• Themeasurement unit130 measures one or more kinds of parameters for a user doing exercise with use of the sensor set102 and outputs measured values as a result of the measurement to theexercise recognition unit140 and thestorage unit160. The measured values output from themeasurement unit130 may be measured values for various parameters such as the acceleration and posture of parts (e.g. both hands, both feet, hip etc.) of the body of a user, and the heart beat and breathing rate of a user. The output of the measured values by themeasurement unit130 is typically performed periodically while the user is doing exercise. As a result, a time-series of measured values are output for a series of exercises by the user.
• Theexercise recognition unit140 recognizes the user's exercise based on the measured values output from themeasurement unit130. The exercise recognition process by theexercise recognition unit140 may be a process on the basis of HMM (Hidden Markov Model) as disclosed in Japanese Unexamined Patent Application Publication No. 2006-340903 and Japanese Unexamined Patent Application Publication No. 2009-118513, for example. In this case, the type of exercise by a user may be specified from candidates such as “walking”, “running” and “resting” by using output values of the acceleration sensor and the posture sensor (gyro sensor). Further, the exercise recognition process by theexercise recognition unit140 may be a process using a discriminant function which is obtained in advance by known supervised learning (e.g. learning on the basis of SVM (Support Vector outputs position data indicating the acquired position to thestorage unit160. Theposition acquisition unit150 may acquire the current position of a user by GPS (Global Positioning System) function, for example. Alternatively, theacquisition unit150 may acquire the current position of a user by summation of a speed vector obtained by integrating the acceleration of a user measured by themeasurement unit130, for example.
• It should be noted that, in theinformation processing system1bdescried with reference toFIG. 2, a user does not move from the treadmill. In this case, a10 virtual movement of the user from the start of exercise is calculated by summation of a running speed output from a speed sensor mounted on the treadmill. Then, theposition acquisition unit150 acquires the position of the user (e.g. the displacement from the start point) in the virtual space according to the calculated virtual movement.
• Thestorage unit160 stores the measureddata132 input from themeasurement unit130, theexercise description data142 input from theexercise recognition unit140, and the position data input from theposition acquisition unit150 in a time series manner using hard disk or semiconductor memory. Using those data stored in thestorage unit160, an exercise model that models a series of exercises by a user is created.
[2-3. Creation of Exercise Model]
• In this specification, the exercise model is model data that includes one or more kinds of measured values measured in time series for a person doing exercise (including a person being a user of theinformation processing system1 and another person) and exercise description data specifying exercise of a person recognized based on the measured values. The creation of the exercise model mainly involves thestorage unit160 and themodel creation unit170.
• Themodel creation unit170 creates the exercise model using the Machine) or neural network etc.). In this case, using measured values output from themeasurement unit130 for exercise whose type of exercise is known, the discriminant function for identifying the type of exercise from the measured values is obtained by an advance learning process. Then, when new measured values are output from themeasurement unit130 for unknown exercise, theexercise recognition unit140 applies the discriminant function obtained in advance to the new measured values.
• FIG. 6 is an explanatory view to explain an example of the exercise recognition process by theexercise recognition unit140.Measured data132 that contains a set of measured values which are periodically output from themeasurement unit130 is shown at the left ofFIG. 6. The measureddata132 contains a time stamp indicating the time of measurement and measured values for one or more kinds of parameters (e.g. heart beat, breathing rate, three-axis acceleration etc.). Theexercise recognition unit140 applies the discriminant function obtained in advance to the measureddata132 to thereby calculate a score for each type of exercise. The data applied to the discriminant function may be one set of measureddata132 associated with one time stamp or a plurality of sets of measureddata132 over a given past period (several seconds etc.). The calculated score indicates the probability that exercise as a target of recognition is exercise of a type identified by each context ID (Context ID: Exercise ID). For example, at the right ofFIG. 6, the score for context ID=E1 (“Walking”) is 0.20, the score for context ID=E2 (“Running”) is 0.65, and the score for context ID=En (“Swimming”) is 0.02. In this case, for exercise as a target of recognition, it is recognized that the possibility that a user is running (“Running”) is the highest. Theexercise recognition unit140 outputs such scores or the context ID specifying the type of exercise which is recognized as being most likely asexercise description data142 to thestorage unit160.
• Theposition acquisition unit150 periodically acquires the current position of a user while the user is doing exercise. Then, theposition acquisition unit150 recognition result by theexercise recognition unit140 described above. The creation of the exercise model may be performed at the point of time when the measurement and recognition of exercise, which are described in the previous section, end for a series of exercises by a user, for example. Alternatively, the creation of the exercise model may be performed at regular periods for data accumulated in thestorage unit160 over a given period, for example.
• FIG. 7 is an explanatory view to explain creation of an exercise model according to the embodiment. The measureddata132, theexercise description data142 and theposition data152 which are stored in time series in thestorage unit160 are shown at the top ofFIG. 7. In the example ofFIG. 7, theposition data152 contains the latitude, longitude and altitude indicating the current position of a user which are acquired by the GPS function. Themodel creation unit170 specifies a series of data corresponding to one (one set of) exercise of a user among those data and assigns one model ID for identifying an exercise model, for example. Further, themodel creation unit170 assigns a sequence number (Seq. Nurn) to each time stamp of the specified series of data. Then, themodel creation unit170 associates data to be used for creation of an output image with each time stamp. In the example ofFIG. 7, the values of time stamp, position, speed vector, heard beat and breathing rate are associated with each sequence number. Further, themodel creation unit170 associates those data with the exercise description data (which is the context ID in the example ofFIG. 7). Although one representative context ID (“E2”) is associated with one model ID (“M1”) in the example ofFIG. 7, the context ID may be associated one by one with the sequence number. Themodel creation unit170 outputs theexercise model172 created in this manner to thestorage unit160.
• Thestorage unit160 accumulates one or more exercise models created by themodel creation unit170 by using storage medium. The exercise models accumulated in thestorage unit160 are then selectively output from thestorage unit160 at the time of displaying the exercise model, which is described in the following section.
[2-4. Display of Exercise Model](2-4-1 Selection of Model to be Displayed)
• In this embodiment, a user of theinformation processing system1 can select either one of model creation mode or model display mode at the time of doing exercise. When a user selects the model creation mode, theinformation processing device100 performs the measurement and recognition of exercise and the creation of exercise model, which are described above. On the other hand, when a user selects the model display mode, theinformation processing device100 performs display of exercise model, which is described in this section. The display of exercise model mainly involves thestorage unit160, theselection unit180 and theoutput unit190. Note that the above-described measurement and recognition of exercise can be performed in parallel during the display of exercise model.
• Theselection unit180 selects one or more exercise models to be displayed for a user doing exercise from the plurality of exercise models stored in thestorage unit160 according to a condition designated by the user or the system. The condition for selecting an exercise model is classified into a pre-condition designated before the start of exercise and a post-condition designated after the start of exercise. For example, the type of a person, the attribute of a person, the type of exercise, the range of a measured value, the created time of an exercise model or the like may be designated as the pre-condition.
• FIG. 8 is an explanatory view to explain a type of a person regarding an exercise model according to one embodiment. Referring toFIG. 8, three exercise models accumulated by thestorage unit160 are shown. The exercise model with the model ID “M1” is referred to as an exercise model M1, the exercise model with the model ID “M2” is referred to as an exercise model M2, and the exercise model with the model ID “M3” is referred to as an exercise model M3. Further, it is assumed that a user U01 intends to use theinformation processing system1 at the selection of the exercise model.
• In the example ofFIG. 8, the exercise model M1 is an exercise model that models exercise by the user U01. Thus, for the user U01 who intends to use theinformation processing system1, the exercise model M1 is an exercise model for the past exercise of him/herself On the other hand, the exercise model M2 is an exercise model that models exercise by a user UO2. For the user U01, the exercise model M2 is an exercise model for exercise of another use. Further, the user ID of the exercise model M3 is “X11”. This user ID indicates a well-known athlete such as a marathon runner, for example. The exercise model M3 for such a well-known athlete provides the model of exercise which many users target on, for example. In this manner, from the viewpoint of a user who intends to use theinformation processing system1, each exercise model may be classified into three kinds of types, the exercise model of oneself, the exercise model of another user, and the exercise model of a well-known person. In this embodiment, theselection unit180 selects a specific type of exercise model designated by a user among the plurality of types as the exercise model to be displayed.
• FIG. 9 is an explanatory view to explain a selection condition designation screen provided to a user by theselection unit180 according to the embodiment. Referring toFIG. 9, a selection condition designation screen W2 as an example is shown. The selection condition designation screen W2 includes a model number designation field F21, a target period designation field F22, a type designation field F23, and an additional condition designation field F24. The model number designation field F21 is a field for designating the maximum value of the number of exercise models to be displayed at the same time. The target period designation field F22 is a field for designating the created time of the exercise model to be selected.
• The type designation field F23 is a field for designating a type of a person of the exercise model to be selected. For example, when “you” is designated as the type of a person, theselection unit180 selects the exercise model created in the past for the same person as the user doing exercise.
• Further, when “other user” is designated as the type of a person, theselection unit180 selects the exercise model created in the past for a user different from the user doing exercise. At this time, it is preferred that theselection unit180 preferentially selects the exercise model for another user having the attribute designated in the additional condition designation field F24 being common or similar to a user doing exercise, for example. For example, when “age” is designated in the additional condition designation field F24, the exercise model for a user of near age can be preferentially selected. Further, the attribute which can be designated in the additional condition designation field F24 may include at least one of age, sex, height and weight, for example.
• Furthermore, when “well-known person” is designated as the type of a person, theselection unit180 selects the exercise model for “well-known person”. Further, as shown inFIG. 9, the name of a specific well-known person (e.g. “person A”), not “well-known person”, may be designated as the type of a person.
• In addition, although not shown inFIG. 9, the type of exercise (e.g. any or walking, running and swimming), the range of measured value (e.g. 3 to 5 [km] as the total distance of running) designated by the exercise description data of the exercise model or the like may be designated as the pre-condition.
• As the post-condition, a condition according to the measured value measured in parallel with the display of exercise model, the current position of a user, the type of exercise recognized in parallel with the display of exercise model or the like may be used. For example, after a user starts exercise, theselection unit180 may select the exercise model for the same type of exercise as the type of exercise recognized by theexercise recognition unit140. Further, when there are a plurality of candidates for the exercise model to be selected, theselection unit180 may select the exercise model with the measured values such as heart beat or breathing rate being closer to the current measured values of the user, for example. Furthermore, theselection unit180 may select the exercise model for exercise done in the position close to the current position of the user, for example.
• In addition, when the current exercise of the user recognized by theexercise recognition unit140 is different from exercise specified by the exercise description data of the exercise model being processed by theoutput unit190, theselection unit180 selects another exercise model to be processed by theoutput unit190. For example, in the case where the exercise model selected according to the pre-condition only for the type of person is “walking” model, when the current exercise of the user recognized by theexercise recognition unit140 has changed to “running”, theselection unit180 newly selects “running” model. The model to act as an appropriate comparison target for exercise of the user can be thereby dynamically displayed.
(2-4-2 Display of Selected Model)
• Theoutput unit190 creates a series of output images that represent the measured values contained in the exercise model and the exercise specified by the exercise description data in time series for the exercise model selected by theselection unit180. Theoutput unit190 then outputs the created output images to thedisplay device104.
• In this embodiment, the output image created by theoutput unit190 is an image that displays a character as an avatar of a person doing the exercise specified by the exercise description data. Specifically, if the exercise specified by the exercise description data is running (context ID=E2 (“Running”) as in the exercise model M1 shown inFIG. 7, for example, theoutput unit190 creates the output image displaying the running character.
• FIG. 10 is a first explanatory view to explain creation of a character image by theoutput unit190 according to the embodiment.
• Referring toFIG. 10, a character image CO1 at time t is created according to the time stamp T1 and the position P1 corresponding to thesequence number #1 of the exercise model M2 shown at the left. Further, a character image C04 at time t+(T2−T1) is created according to the time stamp T2 and the position P2 corresponding to thesequence number #2 of the exercise model M2. Furthermore, as character images at time points between the time t and the time t+(T2−T1), two character images CO2 and CO3 are created. In this mariner, theoutput unit190 not only creates the character images corresponding to the time-series data contained in the exercise model but alto interpolates the character images at time points between the two successive data, thereby creating a series of character images (i.e. video) serving as an avatar of a person moving along the time axis.
• Note that theoutput unit190 may vary the body shape, costume or the like of such a character image depending on the attributes of the corresponding person such as age, sex, height and weight, or the type of the corresponding person. Further, the face picture of a user registered as user data may be displayed at the head of the character image. This allows a user to more easily recognize by intuition which person each character represents.
• Further, in this embodiment, theoutput unit190 varies the display position or the size of the character in a time-series manner according to the position of a person indicated by the position data of the selected exercise model and the current position of a user.
• FIG. 11 is a second explanatory view to explain creation of a character image by theoutput unit190 according to the embodiment.
• A character image C11 generated at time t1 is shown at the left ofFIG. 11 (cf.FIG. 11a). In theinformation processing system1 illustrated inFIG. 1, for example, the display position of the character image C11 may be determined based on the position of a person at time t1 of the selected exercise model, the current position of a user, and the orientation (direction) of a user's line of sight which is detected by a direction sensor mounted on thedisplay device104a. In this case, when a user looks forward, the user can view a person ahead of him/her. Further, when a user looks back, the user can view a person behind him/her. Further, in theinformation processing system1billustrated inFIG. 2, the display position of the character image C11 may be determined based on the position of a person at time t1 in the virtual space and the current position of a user, for example. Furthermore, in the information processing system1cillustrated inFIG. 3, the display position of the character image C11 may be determined based only on the position of a person at time t1 of the selected exercise model, for example (in this case, a swimming character is displayed instead of a running character).
• Further, the size of the character image C11 is determined according to the position of a person indicated by the position data of the selected exercise model and the current position of a user. For example, it is assumed that the distance between the person displayed at time t1 and the user is D1, and the distance between the person displayed at time t2 and the user is D2. Because D2>D1, the character image C11 displayed at time t1 (cf.FIG. 11a) is larger than the character image C12 displayed at time t2 (cf.FIG. 11b).
• By looking at such images, the user can recognize by intuition the status of exercise of him/herself in the past, another user or a well-known person as a target of
• comparison while doing exercise. For example, the feeling of distance sensed by the above-described output image indicates a difference in the amount of exercise or the level of exercise between the current exercise of the user and the model.
• Further, theoutput unit190 may vary the state of the character image in time series according to the measured values contained in the selected exercise model. For example, it is assumed that the exercise model contains the measured values about heart beat and breathing rate. In this case, it can be considered that, as the values of heart beat and breathing rate are greater, a person associated with the exercise model felt more fatigue at the point of time. In light of this, theoutput unit190 may vary the state of the character image in time series according to the level of fatigue estimated from the values of heart beat and breathing rate, for example. Further, theoutput unit190 may vary the state of the character image according to the speed, body temperature, or other kinds of measured values contained in the exercise model, for example.
• FIG. 12 is a third explanatory view to explain creation of a character image by theoutput unit190 according to the embodiment.
• Referring toFIG. 12, at the time point of thesequence number #1 of the exercise model M2, the heart beat of the user UO2 is 110, and the breathing rate is 20. On the other hand, at the time point of the sequence number #k of the exercise model M2, the heart beat of the user UO2 is 150, and the breathing rate is 50. Therefore, it is estimated that the level of fatigue of the user UO2 at the time point of the sequence number #k was relatively higher than the level of fatigue of the user UO2 at the time point of thesequence number #1. Thus, theoutput unit190 adds animation of sweat dropping which represents the fatigue to the character image C22 at the time point of the sequence number #k, for example. Note that, instead of such animation, the state of the character (the state of the person in the exercise model) may be represented using the color of the character image, the text or indicator associated with the character image or the like.
• In this embodiment, theoutput unit190 displays information for displaying at least one kind of measured value in the exercise model and information for displaying the current measured value for the user in the output image, in addition to the character image as described above.
(2-4-3 Example of Output Image)
• FIGS. 13 and 14 are explanatory views respectively showing an example of an output image according to the embodiment.
• Referring toFIG. 13, anoutput image192ais shown as an example. Theoutput image192aincludes a character image C3,user information194, andmodel information196. The character image C3 is an image of a character as an avatar of a person corresponding to the exercise model selected by theselection unit180. Theuser information194 indicates measured values such as the moving distance of a user from the start of exercise, the user's current speed, heart beat and breathing rate in addition to general information such as the date, current time and elapsed time from the start of exercise and so on. On the other hand, themodel information196 indicates measured values such as the moving distance of a person serving as a model from the start of exercise, the person's current speed, heart beat and breathing rate.
• Referring toFIG. 14, anoutput image192bis shown as another example. Theoutput image192bincludes a character image C3,user information194,additional information197,map information198, and bearinginformation199. Theadditional information197 indicates supplementary information such as the current distance between a person serving as a model and a user. Themap information198 indicates the position of a person serving as a model and the current position of a user on a map. The bearinginformation199 indicates the direction of movement of a user recognized from a speed vector and the direction of the line of sight of a user acquired by a direction sensor mounted on thedisplay device104a. By checking theadditional information197, themap information198 and the bearinginformation199, a user can grasp a difference between the current state of him/herself and the state of a person serving as a model more easily while doing exercise.
3. FLOW OF PROCESS ACCORDING TO EMBODIMENT[3-1. Overall Flow]
• FIG. 15 is a flowchart showing an example of an overall flow of information processing according to the embodiment. The flowchart ofFIG. 15 shows the overall flow of processing from the start of use to the end of use of theinformation processing system1.
• First, the userdata management unit120 determines whether use data has been registered or not (step S102). When user data has not been registered, the userdata management unit120 presents the registration screen W1 as illustrated inFIG. 5 to a user and accepts registration of user data (step S104). The process then proceeds to step S106.
• Then, a user selects either one of the model creation mode or the model display mode (step S106). When the model creation mode is selected, the process proceeds to step S108 and performs the model creation process. On the other hand, when the model display mode is selected, the process proceeds to step S110 and performs the model display process.
[3-2. Model Creation Process]
• FIG. 16 is a flowchart showing an example of a flow of the model creation process according to the embodiment. In the following, the case where the model creation process is performed at the point of time when a series of exercises by a user are finished is described by way of illustration.
• Referring toFIG. 16, exercise by a user is started (step S202). After that, the processing from step S204 to step S212 is repeated at a certain period, such as several times in one second or once in several seconds, for example, during exercise by the user.
• First, themeasurement unit130 measures one or more kinds of parameters for a user doing exercise with use of the sensor set102 and outputs measured values as a result of the measurement (step S204). Then, theexercise recognition unit140 recognizes the user's exercise based on the measured values output from the measurement unit130 (step S206). Theposition acquisition unit150 then acquires the user's current position (step S208). Then, thestorage unit160 stores one frame of data which contains exercise description data and position data (step S210).
• After that, when exercise by the user continues, the process returns to the step S204. On the other hand, when exercise by the user is finished, the process proceeds to step S214 (step S212).
• In the step S214, themodel creation unit170 creates the exercise model which includes one or more kinds of measured values contained in the measured data and exercise description data as a result of recognition by theexercise recognition unit140 described above (step S214).
[3-3. Model Display Process]
• FIG. 17 is a flowchart showing an example of a flow of the model display process according to the embodiment.
• Referring toFIG. 17, theselection unit180 determines a pre-condition in response to a user input to the selection condition designation screen W2 illustrated inFIG. 9, for example (step S302). Then, exercise by a user is started (step S304). After that, the processing from step S306 to step S322 is repeated at a certain period, such as several times in one second or once in several seconds, for example, during exercise by the user.
• First, theselection unit180 selects one or more exercise models to be displayed for the user doing exercise from a plurality of exercise models stored in the storage unit160 (step S306). Next, themeasurement unit130 measures one or more kinds of parameters for the user doing exercise with use of the sensor set102 and outputs measured values as a result of the measurement (step S308). Then, theexercise recognition unit140 recognizes the user's exercise based on the measured values output from the measurement unit130 (step S310). Theposition acquisition unit150 then acquires the user's current position (step S312). Theoutput unit190 then creates a character image using the user's current position and the measured values, the exercise description data and the position data included in the exercise model (step S314).
• Then, theselection unit180 determines whether reselection of the exercise model is necessary or not by comparing the type of exercise of the exercise model selected in the step S306 and the type of exercise of the user recognized in the step S310 (step S316). When reselection of the exercise model is necessary, the process returns to the step S306, and reselection of the exercise model using a post-condition is performed. On the other hand, when reselection of the exercise model is not necessary, the process proceeds to step S318.
• In the step S318, theoutput unit190 creates an output image including a character image and display information (e.g. theuser information194 and themodel information196 illustrated inFIG. 13) (step S318). Then, theoutput unit190 displays the created output image with use of the display device104 (step S320).
• After that, when exercise by the user continues, the process returns to the steps S308 and S312. On the other hand, when exercise by the user is finished, the model display process ends. Note that, in parallel with the model display process shown inFIG. 17, the storing of data in the step S210 shown inFIG. 16 may be performed, and further the creation of the exercise model in the step S214 may be performed after exercise by the user is finished.
4. SUMMARY
• Embodiments of the present invention are described above with reference toFIGS. 1 to 17. According to an embodiment, in theinformation processing device100, a plurality of exercise models, each of which includes one or more kinds of measured values measured in time series for a person doing exercise and exercise description data specifying exercise recognized based on the measured values, are stored in advance. Then, a series of output images that represent the measured values and the exercise specified by the exercise description data in time series for the exercise model selected according to a designated condition are output to be visible to the user doing exercise. The user can thereby easily recognize the type of exercise and the status of exercise in time series for the exercise model to be compared with.
• Further, according to this embodiment, the output image displayed for a user is an image that displays a character as an avatar of a person doing exercise specified by the exercise description data. Displaying such a character in the output image brings out the user's desire to compete to thereby maintain or enhance the motivation for exercise. Particularly, in this embodiment, the display position or the size of the character varies according to the position of a person included in the exercise model and the current position of a user. A user can thereby easily grasp whether the user is ahead of or behind the person serving as a model and the extent that the user is ahead of or behind the person. This enables intuitive comparison between the exercise of the user and the exercise of the person serving as a model, and it is expected to further enhance the user's motivation.
• Further, according to this embodiment, a user can select an exercise model for the past exercise of him/herself among a plurality of exercise models. Furthermore, a user can also select an exercise model for a well-known person whom the user targets on, for example, among a plurality of exercise models. In addition, a user can select an exercise model for another user with similar attributes such as age and sex among a plurality of exercise models. With such various options provided, a user can flexibly make comparison about exercise according to the purpose.
• Further, a according to this embodiment, the sense of game upon exercise, such as competition with a person serving as a model, is offered to a user. Further, comparison with the exercise model for a user in the ideal state in the past, another person or a well-known person, for example, enables effective learning of the pace of exercise or the like, and improvement of exercise capacity of a user can be also expected.
• The series of processes by theinformation processing device100 described in this specification is typically implemented using software. A program composing the software that implements the series of processes may be prestored in a storage medium mounted internally or externally to theinformation processing device100, for example. Then, each program is read into RAM (Random Access Memory) of theinformation processing device100 and executed by a processor such as CPU (Central Processing Unit).
• Although preferred embodiments of the present invention are described in detail above with reference to the appended drawings, the present invention is not limited thereto. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
• The present application contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2010-078892 filed in the Japan Patent Office on Mar. 30, 2010, the entire content of which is hereby incorporated by reference.

Claims (30)

What is claimed is:

1. An information processing apparatus comprising:

a memory;

a display screen; and

circuitry configured to:

determine an exercise model from a plurality of exercise models stored in the memory;

receive motion data from a motion sensor and location data from a location sensor; and

control display of an output image, including a character image indicating the exercise model, on the display screen,

wherein the circuitry is configured to change the output image in time series so as to indicate a difference in an amount of exercise or level of exercise between a user and the exercise model.

2. The information processing apparatus according toclaim 1, wherein the circuitry is configured to change the output image so as to represent whether the user is ahead of or behind the character image.

3. The information processing apparatus according toclaim 1, wherein the circuitry is configured to display supplementary information regarding the difference.

4. The information processing apparatus according toclaim 1, wherein the circuitry is configured to display user information including a moving distance of the user from a start of exercise, user's current speed, user's heartbeat, user's breathing rate, date, current time and/or elapsed time from the start of exercise.

5. The information processing apparatus according toclaim 4, wherein the circuitry is configured to simultaneously display the user information together with the character image on the display screen.

6. The information processing apparatus according toclaim 1, wherein the sensor is configured to perform measurement of the motion data and the location data in parallel during the display of the output image.

7. The information processing apparatus according toclaim 1, wherein the motion sensor includes an acceleration sensor, a gyro sensor and/or a heart beat meter.

8. The information processing apparatus according toclaim 1, further comprising the motion sensor and the location sensor.

9. The information processing apparatus according toclaim 1, wherein the circuitry is configured to receive the motion data from the motion sensor of an external device.

10. The information processing apparatus according toclaim 9, wherein the external device is a wearable device.

11. The information processing apparatus according toclaim 10, wherein the external device has a wrist-band shape.

12. The information processing apparatus according toclaim 1, wherein the circuitry is configured to determine the exercise model from the plurality of exercise models stored in the memory based on a condition designated by the user or the information processing apparatus.

13. The information processing apparatus according toclaim 12, wherein the condition includes a type of a person, an attribute of a person, a type of exercise, a range of a measured value and/or a created time of an exercise model.

14. The information processing apparatus according toclaim 1, wherein the circuitry is configured to control display of a user location position on a map image of the display screen based on the location data.

15. The information processing apparatus according toclaim 1, wherein the circuitry is configured to change the output image in time series based on the location data.

16. The information processing apparatus according toclaim 1, wherein the circuitry is configured to change the output image in time series so that a distance between the character image and the user, represented by the output image, indicates a difference in an amount of exercise or level of exercise between the user and the exercise model.

17. An image output method using an information processing apparatus including a memory and a display screen, the method comprising:

determining an exercise model from a plurality of exercise models stored in the memory;

receiving motion data from a motion sensor and location data from a location sensor; and

controlling display of an output image, including a character image indicating the exercise model, on the display screen, wherein controlling includes changing the output image in time series so as to indicate a difference in an amount of exercise or level of exercise between a user and the exercise model.

18. The method according toclaim 17, comprising changing the output image so as to represent whether the user is ahead of or behind the character image.

19. A computer-readable storage device encoded with computer-executable instructions that, when executed by a processor, perform an image output method comprising:

determining an exercise model from a plurality of exercise models stored in a memory;

receiving motion data from a motion sensor and location data from a location sensor; and

controlling display of an output image, including a character image indicating the exercise model, on a display screen, wherein controlling includes changing the output image in time series so as to indicate a difference in an amount of exercise or level of exercise between a user and the exercise model.

20. The computer-readable medium according toclaim 19, wherein the image output method comprises changing the output image so as to represent whether the user is ahead of or behind the character image.

21. The computer-readable medium according toclaim 19, wherein the image output method comprises displaying supplementary information regarding the difference.

22. The computer-readable medium according toclaim 19, wherein the image output method comprises displaying user information including a moving distance of the user from a start of the exercise, user's current speed, user's heartbeat, user's breathing rate, date, current time and/or elapsed time from the start of exercise.

23. The computer-readable medium according toclaim 19, wherein the image output method comprises determining the exercise model from the plurality of exercise models stored in the memory based on a condition designated by the user or an information processing apparatus.

24. The computer-readable medium according toclaim 19, wherein the image output method comprises controlling display of a user location position on a map image of the display screen based on the location data.

25. The computer-readable medium according toclaim 19, wherein the image output method comprises changing the output image in time series based on the location data.

26. The computer-readable medium according toclaim 19, wherein the image output method comprises changing the output image in time series so that a distance between the character image and the user, represented by the output image, indicates a difference in an amount of exercise or level of exercise between the user and the exercise model.

27. An information processing apparatus comprising:

a memory;

a display screen; and

circuitry configured to:

determine an exercise model from a plurality of exercise models stored in the memory;

receive first sensor data from a first sensor; and

control display of an output image, including a character image indicating the exercise model, on the display screen,

wherein the circuitry is configured to change the output image in time series so as to indicate a difference between a user and the exercise model based on the first sensor data.

28. The information processing apparatus according toclaim 27, wherein the first sensor is a location measuring sensor and the first sensor data is location position data of the user.

29. The information processing apparatus according toclaim 27, further comprising a second sensor,

wherein the circuitry is configured to receive acceleration data from the second sensor.

30. The information processing apparatus according toclaim 27, wherein the circuitry is configured to change the output image so as to represent whether the user is ahead of or behind the character image.

Images