US20180081451A1 - Head-mounted display, program for controlling head-mounted display, and method of controlling head-mounted display - Google Patents

Abstract

A head-mounted display comprising a display and a detector. The detector is configured to detect a direction of at least one of the head-mounted display and a line of vision. The display is configured to display an output image of an application, wherein the application is selected based on the direction being outside a range of a front direction.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
• This application is a continuation of U.S. application Ser. No. 15/355,784, filed Nov. 18, 2016, which is a continuation of U.S. application Ser. No. 14/376,026, filed Jul. 31, 2014, which claims the benefit of International Application No. PCT/JP2013/000557, filed Feb. 1, 2013, which claims priority to Japanese Application No. 2012-032647, filed Feb. 17, 2012, the disclosures of each of which are hereby incorporated by reference herein.
BACKGROUND
• The present disclosure relates to a head-mounted display that switches and displays an output image of an application, a program for controlling the head-mounted display, and a method of controlling the head-mounted display.
• A known head-mounted display (hereinafter referred to as HMD) is mounted on the head of the user and displays an image on a display unit arranged in front of the eyes of the user. The HMD includes a non-see-through HMD that does not allow outside light to pass through a display unit and allows only a display image to be visually recognized by the user and a see-through HMD that allows outside light to pass through a display unit and allows a display image to be superimposed on a field of vision of the user. For example, PTL 1 below discloses a “visual apparatus” as the non-see-through HMD.
CITATION LISTPatent Literature
• [PTL 1] Japanese Patent Application Laid-open No. HEI 06-78248
SUMMARYTechnical Problem
• In general, an HMD such as the one described in PTL 1 above can be operated by a controller. However, a person wearing an HMD has a limited field of vision in many cases, and an operation of the HMD by the controller causes a problem in usability.
• In view of the above circumstances, it is desirable to provide a head-mounted display excellent in usability, a program for controlling the head-mounted display, and a method of controlling the head-mounted display.
Solution to Problem
• A head-mounted display comprising a display and a detector. The detector is configured to detect a direction of at least one of the head-mounted display and a line of vision. The display is configured to display an output image of an application, wherein the application is selected based on the direction being outside a range of a front direction.
Advantageous Effect of Invention
• As described above, according to the embodiments of the present disclosure, it is possible to provide a head-mounted display excellent in usability, a program for controlling the head-mounted display, and a method of controlling the head-mounted display.
BRIEF DESCRIPTION OF DRAWINGS
• FIG. 1 is a schematic view showing the appearance of a head-mounted display according to a first embodiment of the present disclosure.
• FIG. 2 is a block diagram showing the functional configuration of the head-mounted display.
• FIG. 3 is a sequence diagram showing operations of the head-mounted display.
• FIG. 4 is a schematic view showing directions of the head-mounted display and examples of output images of displayed applications.
• FIG. 5 is a schematic view showing directions of the head-mounted display and an output image of an application displayed in a sliding manner.
• FIGS. 6A to 6C are schematic views showing applications displayed in menu form in the head-mounted display.
• FIG. 7 is a block diagram showing the functional configuration of a head-mounted display according to a second embodiment of the present disclosure.
• FIG. 8 is a sequence diagram showing operations of the head-mounted display.
• FIG. 9 is a schematic view showing transitions of applications to be displayed on the head-mounted display
DETAILED DESCRIPTIONFirst Embodiment
• A head-mounted display (hereinafter referred to as HMD) according to a first embodiment will be described.
• [Configuration of Head-Mounted Display]
• FIG. 1 is a schematic view showing the appearance of anHMD100, andFIG. 2 is a block diagram showing the functional configuration of theHMD100.
• As shown inFIG. 1, the HMD100 has amounting member102, adisplay unit103, and ahousing104. Thedisplay unit103 and thehousing104 are supported by themounting member102. Further, themounting member102 is equipped withearphones121. As shown inFIG. 2, thehousing104 accommodates aninformation management unit141, anapplication selector142, and adetector143 therein.
• Themounting member102 is mounted on the head of the user and supports thedisplay unit103 in front of the eyes of the user. Themounting member102 is not particularly limited in shape and can be formed into any shape other than a glass shape shown inFIG. 1 so long as it is capable of supporting thedisplay unit103.
• Thedisplay unit103 can be a display capable of displaying an image in front of the eyes of the user and be a see-through display allowing outside light to pass through. Examples of the see-through display include a video see-through type that displays a surrounding image captured by a camera thereon to allow visual recognition of surroundings and include an optical see-through type that has light transmissivity per se. In this embodiment, any type of these see-through displays may be used.
• Thedisplay unit103 is connected to theinformation management unit141 accommodated in thehousing104 and capable of displaying an image generated by theinformation management unit141 thereon. A detailed description of an image displayed on thedisplay unit103 will be given later.
• Thehousing104 accommodates theinformation management unit141, theapplication selector142, and thedetector143 therein. Theinformation management unit141 and theapplication selector142 are realized by the cooperation between hardware such as a processor and a memory and a program. As will be described in detail later, theapplication selector142 selects an application based on an output from thedetector143, and theinformation management unit141 displays an image generated by a selected application on thedisplay unit103.
• Thedetector143 detects its direction (i.e., direction of the HMD100) and supplies an output of the detection to theapplication selector142 via theinformation management unit141. A transition of a direction of the HMD100 takes place when the user wearing theHMD100 changes a direction of the head or the body. Specifically, thedetector143 can be a motion sensor constituted of an acceleration sensor, a gyrosensor, and a magnetic field sensor. In addition, thedetector143 is not limited to a motion sensor but can be a sensor capable of detecting a direction of theHMD100, e.g., a sensor that detects a direction of the HMD100 by performing image processing on a surrounding image captured by a camera.
• Note that in this embodiment, theinformation management unit141, theapplication selector142, and thedetector143 are accommodated in thehousing104. However, they are not necessarily accommodated in thehousing104. For example, theinformation management unit141 and theapplication selector142 may be incorporated in another information processing apparatus (such as personal computer (PC) and smart phone) and connected to thedetector143 and thedisplay unit103 in a wired or wireless manner.
[Operations of Head-Mounted Display]
• Operations of the HMD100 thus configured will be described.FIG. 3 is a sequence diagram showing the operations of the HMD100.
• It is now assumed that an output image of an application A is displayed on thedisplay unit103 in a state where the user wears theHMD100. If thedisplay unit103 is a see-through display, the user may be in a state of seeing an outside through thedisplay unit103 because no image is displayed on thedisplay unit103. A direction of the HMD100 at this time is defined as a “front direction.”
• Theinformation management unit141 acquires a sensor value indicating a direction of theHMD100 from thedetector143 every predetermined time. Then, theinformation management unit141 supplies the sensor value to theapplication selector142.
• Theapplication selector142 selects an application based on the sensor value. Specifically, if the sensor value is included in the range of values indicating the “front direction,” theapplication selector142 selects the application A as it is. On the other hand, if the sensor value is not included in the range of the values indicating the “front direction” (i.e., “non-front direction”), theapplication selector142 can select another application (application B).
• Next, theapplication selector142 notifies theinformation management unit141 of the application B thus selected. Then, theinformation management unit141 acquires a display image from the notified application B and displays the acquired display image on thedisplay unit103.
• From the viewpoint of the user, the above operations are performed as follows. That is, when the user wears theHMD100 and turns on power or performs a predetermined input operation, a direction of theHMD100 is defined as the “front direction.” At this time, the output image of the application A is displayed on thedisplay unit103.
• When the user turns the head in any direction, a transition of the direction of theHMD100 also takes place. At this time, if the direction of theHMD100 exceeds the range of the front direction, the output image of the application B is displayed on thedisplay unit103 instead of the output image of the application A. For example, in a state where a moving-image reproduction application is set as the application A and a time display application is set as the application B, the user can confirm a time by changing a direction of the head and directing theHMD100 in the non-front direction during reproduction of a moving image. When the user restores the head in the front direction, the output image of the application A is displayed on thedisplay unit103 again.
• In addition, if thedisplay unit103 is a see-through display, no image (including the output image of the application A) may be displayed on thedisplay unit103 of theHMD100. In this case, the user is in a state of seeing an outside through thedisplay unit103, and then the user can visually recognize the output image of the application B by changing the direction of theHMD100.
• Examples of the application (application B) whose output image can be visually recognized by changing the direction of theHMD100 include the following applications. That is, such applications include those for displaying weather, a clock, a one-sentence news, a stock price, a foreign exchange, a schedule, a calendar, a photo frame, an auction price, a frequently searched word, a map and information for a current location, etc.
• In the above description, the output image of the application B is displayed on thedisplay unit103 when the transition of the direction of theHMD100 takes place from the front direction to the non-front direction. However, an output image of a different application may also be displayed on thedisplay unit103 for each of transition directions of theHMD100 to another non-front direction.FIG. 4 is a schematic view showing directions of theHMD100 and examples of output images of displayed applications.
• Theapplication selector142 can select a different application for each of the transition directions of theHMD100. For example, theapplication selector142 can select the application B when theHMD100 is directed from the front direction to a right-hand direction, select an application C when theHMD100 is directed from the front direction to a left-hand direction, and select an application D when theHMD100 is directed from the front direction to an upper direction. Thus, the user can see output images of different applications by directing the head in various directions.
• In addition, in the above description, the output image of the application B or the like is displayed on thedisplay unit103 if the direction of theHMD100 exceeds the range of the front direction. However, an effect may be produced at this time.FIG. 5 is a schematic view showing directions of theHMD100 and an example of an image displayed on thedisplay unit103.
• When the application B is selected by theapplication selector142, theinformation management unit141 can display the output image of the application B from the outside of a screen in a sliding manner depending on a degree of the direction of theHMD100. Thus, the output image of the application B is gradually displayed depending on a turning degree of the head of the user, and the user can feel as if he/she were naturally accessing the information.
• Similarly, when theHMD100 is restored in the front direction, theinformation management unit141 can display the output image of the application B outside of the screen in a sliding manner. In addition, once the direction of theHMD100 exceeds the range of the front direction, theinformation management unit141 may display the output image of the application B from the outside of the screen in a sliding manner regardless of a degree of the direction of theHMD100.
• Moreover, in the above description, an application to be displayed on thedisplay unit103 is selected depending on a direction of theHMD100. However, the user may select an application from a menu.FIGS. 6A to 6C are schematic views showing an example of selecting an application from a menu.
• When theHMD100 is directed from the front direction to a predetermined direction (e.g., upper direction) as shown inFIG. 6A, a plurality of applications are displayed (displayed in menu form) side by side on thedisplay unit103. When the user tilts the head to incline theHMD100, the applications displayed in menu form are displayed in a sliding manner as shown inFIG. 6B. The user can intuitively select one of the applications with a feeling as if a menu were slid with gravity. Alternatively, when theHMD100 is directed in a predetermined direction (e.g., right-hand direction), the applications may be displayed in a sliding manner. When the user restores the head to direct theHMD100 in the front direction, one of the applications is selected as shown inFIG. 6C.
• As described above, according to this embodiment, the user can switch an application to be displayed on thedisplay unit103 by turning the head and changing a direction of theHMD100. Therefore, it can be said that theHMD100 is excellent in usability.
Second Embodiment
• A head-mounted display (HMD) according to a second embodiment will be described. In this embodiment, the same configurations as those of the first embodiment will be denoted by the same signs, and descriptions thereof will be omitted.
[Configuration of Head-Mounted Display]
• FIG. 7 is a block diagram showing the functional configuration of anHMD200 according to the second embodiment. Note that theHMD200 can have the same appearance as that of theHMD100 according to the first embodiment.
• TheHMD200 has atimer244 besides aninformation management unit241, anapplication selector242, and adetector243. Thetimer244 is connected to theinformation management unit241. Upon receiving a request from theinformation management unit241, thetimer244 starts counting a time and returns a timer value to theinformation management unit241.
• In the above first embodiment, theapplication selector142 selects an application based on a sensor value output from thedetector143. In this embodiment, however, theapplication selector242 selects an application based on a timer value output from thetimer244 besides a sensor value.
• Theinformation management unit241, theapplication selector242, and thetimer244 may be accommodated in a housing as in the first embodiment or may be incorporated in another information processing apparatus (such as PC and smart phone) and connected to thedetector243 and adisplay unit203 in a wired or wireless manner.
[Operations of Head-Mounted Display]
• Operations of theHMD200 thus configured will be described.FIG. 8 is a sequence diagram showing the operations of theHMD200.
• It is now assumed that an output image of an application A is displayed on thedisplay unit203 in a state where the user wears theHMD200. If thedisplay unit203 is a see-through display, the user may be in a state of seeing an outside through thedisplay unit203 because no image is displayed on thedisplay unit203. A direction of theHMD200 at this time is defined as a “front direction.”
• Theinformation management unit241 acquires a sensor value indicating a direction of theHMD200 from thedetector243 every predetermined time. Then, theinformation management unit241 supplies the sensor value to theapplication selector242. In addition, theapplication selector242 acquires a timer value from thetimer244.
• Theapplication selector242 selects an application based on the sensor value and the timer value. Specifically, if the sensor value is not included in the range of values indicating the “front direction” (“non-front direction”), theapplication selector242 selects another application (application B). On the other hand, if the sensor value is included in the range of the values indicating the “front direction,” theapplication selector242 refers to the timer value. Then, theapplication selector242 selects the application B if the timer value exceeds a predetermined time or selects the application A if the timer value is less than or equal to the predetermined time.
• Simultaneously with the selection of the application, theapplication selector242 instructs thetimer244 to start counting a time. The timer value that theapplication selector242 acquires from thetimer244 is a time started to be counted at this time. That is, if the application B is selected over the predetermined time, theapplication selector242 selects the application B even if the sensor value is included in the range of the values indicating the “front direction.”
• In other words, if theHMD200 is directed in the non-front direction and a time during which the application B is selected by theapplication selector242 continues for the predetermined time, the application B is selected (fixed) instead of the application A even if theHMD200 is restored in the front direction. This is because, if the predetermined time elapses in a state where theHMD200 is directed in the non-front direction, it can be determined that the user is carefully seeing an output image of the application B.
• On the other hand, if theHMD200 is directed in the front direction and the predetermined time elapses in a state where the application B is fixed, fixation of the application B is released and the original application A is selected.
• Next, theapplication selector242 notifies theinformation management unit241 of the application B thus selected. Then, theinformation management unit241 acquires a display image from the notified application B and displays the acquired display image on thedisplay unit203.
• From the viewpoint of the user, the above operations are performed as follows.FIG. 9 is a schematic view showing transitions of applications to be displayed on thedisplay unit203. When the user wears theHMD200 and turns on power or performs a predetermined input operation, a direction of theHMD200 is defined as the “front direction.” At this time, the output image of the application A is displayed on the display unit203 (T1). If the user keeps the head in the front direction, the output image of the application A is continuously displayed (T1→T1).
• When the user turns the head in any direction, a transition of the direction of theHMD200 also takes place. At this time, if the direction of theHMD200 exceeds the range of the front direction (“non-front direction”), the output image of the application B is displayed on thedisplay unit203 instead of the output image of the application A (T1→T2). If theHMD200 is restored in the front direction before a predetermined time elapses, the display image of the application A is displayed again (T2→T1).
• Here, if the user directs theHMD200 in the non-front direction over the predetermined time (stop time of the timer), the application B is fixed as described above (T2→T3). If the predetermined time (stop time of the timer) elapses in this state, the output image of the application A is displayed on thedisplay unit203 instead of the output image of the application B (T3→T5). On the other hand, if theHMD200 is directed in the front direction before the predetermined time elapses, the output image of the application B is continuously displayed on thedisplay unit203 because the application B is fixed (T3→T4).
• If the predetermined time (stop time of the timer) elapses in a state where theHMD200 is directed in the front direction, the fixation of the application B is released and the output image of the application A is displayed on thedisplay unit203 again (T4→T1). Then, when theHMD200 is directed in another non-front direction as in the first embodiment, an output image of another application (application C or the like) is displayed on the display unit203 (T2→T2, T4→T2).
• Examples of the application (application B) whose output image can be visually recognized by changing the direction of theHMD200 include the same applications as those of the first embodiment. That is, such applications include those for displaying weather, a clock, a one-sentence news, a stock price, a foreign exchange, a schedule, a calendar, a photo frame, an auction price, a most frequently searched word, a map and information for a current location, etc.
• In this embodiment, if the predetermined time elapses in a state where theHMD200 is directed in the non-front direction, an application being displayed is fixed. Accordingly, this embodiment is excellent in usability if the user wishes to carefully see an output image of the application. Note that as in the first embodiment, selection of applications displayed in menu form, a slide effect, or the like may also be applied to this embodiment.
(Modifications)
• In the above first and second embodiments, the selection of an application is performed based on a direction of the HMD. However, information on a line of vision of the user may also be used. Specifically, the application selector can use a line of vision of the user as a gesture at the fixation and the release of an application described above. Thus, it becomes possible to easily reflect an intension of the user on the selection of an application. Recognition of a line of vision of the user can be made by performing, for example, image processing on an image of the eyeballs of the user captured by a camera provided in the HMD.
• In addition, position information on the HMD may also be used for the selection of an application. Specifically, when detecting that the HMD is moving at a constant speed or faster (i.e., the user is moving), the application selector stops selecting an application and can display no image on the display unit. Thus, it becomes possible to prevent the user from being put in danger during movement. Position information may be acquired from, for example, an output of a GPS (Global Positioning System) and an acceleration sensor provided in the HMD.
• In the above second embodiment, the fixation and the release of an application are determined by a stop time counted by the timer. However, a stop time of the timer may be determined depending on a transition speed of a direction of the HMD. In addition, a stop time of the timer may be different for each application.
• Moreover, the fixation and the release of an application may be performed by an input operation unit (such as button and touch sensor) provided in the HMD. Furthermore, the fixation and the release of an application may also be performed by a gesture made when the user moves the head. Specifically, for example, an application is fixed when the user nods the head, fixed when the user further turns up the head, fixed when the user tilts the head, released when the user quickly shakes the head, not released when the user slowly shakes the head, and released when the user moves the head in a state where the head is fixed in the front direction.
• Furthermore, the fixation and the release may be performed based on information on a line of vision of the user. That is, the fixation and the release are performed by a gesture based on a line of vision of the user or the like. For example, an application is fixed or released when the user closes the eyes for a while, fixed when the user returns the head with the eyes closed, fixed when the user adjusts the focus of the eyes, and released when the user takes the eyes out of focus. Furthermore, the fixation or the release may be performed by a physical action of the user such as flicking off with the hand, biting, stamping, and jumping. Furthermore, the fixation or the release may be performed depending on outside circumstances. For example, an application is released when an automobile or a person turns up in front of the user.
(Applications)
• Applications of the HMD according to the embodiments of the present disclosure will be described.
[Dictionary]
• When the HMD is directed in the front direction in a state where the user wearing the HMD reads a sentence of a document or the like, no image is displayed on the display unit (see-through display). However, a camera provided in the HMD performs character recognition to extract words in the sentence. When the HMD is directed in the non-front direction, output results (such as meanings and translations of the words) of a dictionary application are displayed on the display unit. Words at positions carefully seen by the user may be extracted in combination with a line of vision of the user.
[Subtitles]
• When the HMD is directed in the front direction, a moving image such as a movie is displayed on the display unit. Then, when the HMD is directed in the non-front direction, subtitles corresponding to a reproduced scene of the moving image are displayed. Note that when the HMD is directed in the front direction, no image may be displayed on the display unit (see-through display) such that the user watches an actual moving image through the display unit. In this case, subtitles are acquired by image recognition or via a network.
[Learning]
• When the HMD is directed in the front direction, a “question” is displayed on the display unit. Then, when the HMD is directed in the non-front direction, an answer to the question or a hint for the question is displayed on the display unit. For example, it is possible to display the hint for the question when the HMD is directed from the front direction to the upper direction and display the answer to the question when the HMD is directed from the front direction to the lower direction.
[Notification]
• When the HMD is directed in the front direction, no image is displayed on the display unit or an output image of any application is displayed thereon. With reception of an electronic mail (e-mail) or a social networking service (SNS), notification of the reception is displayed on the display unit. When the user directs the HMD in the non-front direction, a message of the E-mail or the SNS is displayed on the display unit. The message may be displayed only at the end of the display unit rather than being displayed on the entirety of the display unit. Further, when no new message is arrived, no change may be made in the display of the display unit even if the HMD is directed in the non-front direction.
[Rear-Side Recognition]
• When the HMD is directed in the front direction, the user can visually recognize the front side through the display unit (see-through display) because no image is displayed on the display unit. When the HMD is directed in the non-front direction, a rear-side image captured by a provided camera is displayed on the display unit. The rear-side image may be a highlighted image of a moving object obtained by motion recognition or may be a thermographic image. In addition, each of these images may be displayed depending on a transition direction from the front direction to the non-front direction.
[Work Assistance]
• When the HMD is directed in the front direction, the user can visually recognize the front side through the display unit (see-through display) because no image is displayed on the display unit. When the HMD is directed in the non-front direction, a work procedure (such as recipe) is displayed on the display unit. Because the work procedure is not displayed in a state where the HMD is directed in the front direction, a user's work is not prevented.
[Other]
• A display range of a thesaurus (diagram where words are arranged based on their relationships) is moved depending on a direction of the HMD such that the user is allowed to easily search for related words. In addition, a display range of a star map is moved depending on a direction of the HMD such that the user is allowed to perform pseudo astronomic observation. Moreover, it is also possible to provide a game where the user inclines a virtual game plate depending on a direction of the HMD.
• The present disclosure is not limited to the above respective embodiments but may be modified without departing from the sprit of the present disclosure.
• Note that the present disclosure may also employ the following configurations.
• (1) A head-mounted display comprising:
• a detector configured to detect a direction of at least one of the head-mounted display and a line of vision; and
• a display configured to display an output image of an application,
• wherein the application is selected based on the direction being outside a range of a front direction.
• (2) A head-mounted display according to (2), wherein the range of the front direction is set at least large enough to encompass the display when the head-mounted display is facing the front direction.
• (3) A head-mounted display according to (1) or (2), wherein the range of the front direction is set at least large enough to encompass a part of the display when the head-mounted display is facing the front direction.
• (4) A head-mounted display according to any one of (1) to (3), wherein the part of the display displays the output image of the application.
• (5) A head-mounted display according to any one of (1) to (4), wherein the front direction is set as a direction of the head-mounted display when the head-mounted display is powered on or when a predetermined input operation is performed.
• (6) A head-mounted display according to any one of (1) to (5), wherein the display is a see-through display.
• (7) A head-mounted display according to any one of (1) to (6), further comprising:
• a processor; and
• a memory device storing instructions which when executed by the processor, causes the processor to select the application.
• (8) A head-mounted display according to any one of (1) to (7), wherein the detector is configured to detect the direction of the head-mounted display.
• (9) A head-mounted display according to any one of (1) to (8), wherein a first application is selected based on the direction being a first direction outside the range of the front direction, and a second application is selected based on the direction being a second direction outside the range of the front direction, and wherein the first application and second application are different.
• (10) A head-mounted display according to any one of (1) to (9), wherein the application is selected based on the direction and a timer value.
• (11) A head-mounted display according to any one of (1) to (10), wherein
• a first application is selected based on the direction moving from inside the range of the front direction to outside the range of the front direction, and the display is configured to display an output image of the first application.
• (12) A head-mounted display according to any one of (1) to (11), wherein a second application is selected or no application is selected based on the direction moving from outside the range of the front direction to inside the range of the front direction, and the display is configured to display an output image of the second application or to display no output image.
• (13) A head-mounted display according to any one of (1) to (12), wherein a selection of the first application is fixed based on a timer value and the direction moving from outside the range of the front direction to inside the range of the front direction, and the display is configured to continue to display the output image of the first application.
• (14) A head-mounted display according to any one of (1) to (13), wherein a fixation of the first application is released based on a timer value.
• (15) A head-mounted display according to any one of (1) to (14), wherein the application is selected based on an output of at least one of a GPS and an acceleration sensor included in the head-mounted display.
• (16) A head-mounted display according to any one of (1) to (15), wherein the output image of the application is at least one of text, a moving image, and a still image.
• (17) A head-mounted display according to any one of (1) to (16), wherein the display displays a plurality of applications in menu form.
• (18) A head-mounted display according to any one of (1) to (17), wherein the plurality of applications displayed in menu form are displayed in a sliding manner based on the direction detected by the detector.
• (19) A method of operating a head-mounted display comprising:
• detecting a direction of at least one of the head-mounted display and a line of vision; selecting an application based on the direction being outside a range of a front direction; and
• displaying an output image of the application.
• (20) A non-transitory computer readable storage medium storing a computer program for causing a head-mounted display to:
• detect a direction of at least one of the head-mounted display and a line of vision;
• select an application based on the direction being outside a range of a front direction; and
• display an output image of the application.
• The present application contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2012-032647 filed in the Japan Patent Office on Feb. 17, 2012, the entire content of which is hereby incorporated by reference.
REFERENCE SIGNS LIST
• 102 mounting member
• 103,203 display unit
• 104 housing
• 121 earphone
• 141,241 information management unit
• 142,242 application selector
• 143,243 detector
• 244 timer
• 100,200 HMD

Claims (20)

1. An information processing apparatus comprising:

a motion sensor configured to send a sensor value indicating a direction of the information processing apparatus;

a display configured to display an output image of at least one of a first application or a second application different from the first application; and

at least one processor configured to:

acquire the sensor value from the motion sensor;

control, when the sensor value indicates that the direction of the the information processing apparatus is a front direction, the display to display the output image of the first application; and

control, when the sensor value indicates that the direction is an upper direction or a lower direction, the display to display the output image of the second application.

2. The information processing apparatus according toclaim 1, wherein

the at least one processor is configured to control, when the direction, which is indicated by the sensor value, changes from the front direction to the upper direction or the lower direction, the display to display the output image of the second application instead of the output image of the first application.

3. The information processing apparatus according toclaim 2, wherein

the output image of the first application includes a moving image, and

the output image of the second application includes an image indicting time information.

4. The information processing apparatus according toclaim 1, wherein

the at least one processor is configured to control, when the direction, which is indicated by the sensor value, changes from the front direction to the upper direction or the lower direction, the display to slide the output image of the second application from outside of a display region of the display into the display region of the display.

5. The information processing apparatus according toclaim 4, wherein

the at least one processor is configured to control the display to increase a displayed amount of the output image of the second application as the direction of the information processing apparatus moves upward or downward.

6. The information processing apparatus according toclaim 1, wherein

the at least one processor is further configured to control, when the direction, which is indicated by the sensor value, changes from the front direction to a left-hand direction or a right-hand direction, the display to display an output image of a third application that is different from the output image of the first application and the output image of the second application.

7. The information processing apparatus according toclaim 1, wherein

the output image of the second application includes a plurality of output images of a plurality of applications displayed side by side, the plurality of applications being different from each other.

8. The information processing apparatus according toclaim 7, wherein

the at least one processor is further configured to control, when the sensor value indicates that the information processing apparatus is inclined laterally, the display to move the plurality of output images of the plurality of applications toward outside of a display region of the display.

9. The information processing apparatus according toclaim 8, wherein

the at least one processor is further configured to:

control, when the sensor value indicates that the information processing apparatus is inclined rightward, the display to move the plurality of output images of the plurality of applications rightward in the display region, or

control, when the sensor value indicates that the information processing apparatus is inclined leftward, the display to move the plurality of output images of the plurality of applications leftward in the display region.

10. The information processing apparatus according toclaim 8, wherein

the at least one processor is further configured to control, when the sensor value indicates that there is substantially no lateral inclination of the information processing apparatus, the display to display one of the plurality of output images of the plurality of applications.

11. The information processing apparatus according toclaim 1, wherein

the at least one processor is further configured to control, when the sensor value indicates that a time during which the direction is the upper direction or the lower direction continues to a predetermined time, the display to perform a fixation in which the output image of the second application is displayed even if the direction indicated by the sensor value changes from the upper direction or the lower direction to the front direction.

12. The information processing apparatus according toclaim 1, wherein

the at least one processor is further configured to:

control, when the sensor value indicates that a first head gesture is performed by a user of the information processing apparatus, the display to perform a fixation in which the output image of the second application is displayed even if the direction indicated by the sensor value changes from the upper direction or the lower direction to the front direction, and

control, when the sensor value indicates that a second head gesture, which is different from the first head gesture, is performed by a user of the information processing apparatus, the display to release the fixation of the output image of the second application.

13. The information processing apparatus according toclaim 1, wherein

the second application includes at least one of an e-mail application or a SNS application, and

the at least one processor is further configured to control, when the sensor value indicates that the direction of the information processing apparatus is the front direction, the display to display the output image of the first application but not display the output image of the second application even if receiving a message of an e-mail or a SNS notification.

14. The information processing apparatus according toclaim 13, wherein

the at least one processor is further configured to control the display to display the message at an end of a display region of the display.

15. The information processing apparatus according toclaim 1, further comprising:

a housing that contains the motion sensor, and

a smartphone that contains the at least one processor.

16. The information processing apparatus according toclaim 1, wherein the information processing apparatus is a head mounted display.

17. The information processing apparatus according toclaim 1, wherein the display is an optical see-through display that has light transmissivity.

18. The information processing apparatus according toclaim 1, further comprising:

a camera configured to capture a surrounding image of the information apparatus,

wherein the at least one processor is configured to control the display to display the captured surrounding image to allow a user of the information processing apparatus to recognize surroundings of a real space, and the at least one of the output image of the first application or the output image of the second application.

19. The information processing apparatus according toclaim 1, wherein the motion sensor includes an acceleration sensor, a gyrosensor, and a magnetic field sensor.

20. An information processing method comprising:

acquiring a sensor value which is sent from a motion sensor, the sensor value indicating a direction of an information processing apparatus;

controlling, when the sensor value indicates that the direction of the information processing apparatus is a front direction, a display to display an output image of a first application, the display being connected to the motion sensor; and

controlling, when the sensor value indicates that the direction is an upper direction or a lower direction, the display to display an output image of the second application different from the first application.

Images