US20220210344A1 - Image display apparatus - Google Patents

Abstract

An image display apparatus has: a synthesizing device (132) for synthesizing a rear image (111B) captured by a rear imaging device (11B) for imaging a rear area of the vehicle (1) and a first rear side image (111BL, 111BR) captured by a first rear side imaging device (11BL, 11BR) for imaging a first rear side area of the vehicle to generate a synthesized image (111C); and a displaying device (14) for displaying the synthesized image. The synthesizing device varies a proportion of an area of each of the rear image and the first rear side image to the synthesized image on the basis of a first information relating to a first turn indicator configured to operate to inform that the vehicle travels rightward or leftward.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
• This application is a continuation of U.S. application Ser. No. 16/194,984 filed Nov. 19, 2018 (allowed), which claims benefit from Japanese Patent Application No. 2017-250901 filed Dec. 27, 2017. The entire disclosures of the prior applications are considered part of the disclosure of the accompanying continuation application, and are hereby incorporated herein by reference in its entirety.
TECHNICAL FIELD
• The present invention relates to a technical field of an image display apparatus that is configured to synthesize images that are captured by a plurality of imaging devices placed at a vehicle and to display the synthesized image, for example.
BACKGROUND ART
• Each of aPatent Literature 1 and aPatent Literature 2 discloses one example of an image display apparatus. Specifically, thePatent Literature 1 discloses an image display apparatus that is configured to generate a synthesized image by synthesizing a rear side image (a rear and lateral image) that is captured by a camera configured to image a rear side area (a rear and lateral area) of a target vehicle and a rear image that is captured by a camera configured to image a rear area of the target vehicle seamlessly at the rear of the target vehicle so that the synthesized image is an image obtained by taking a view of the rear surroundings of the target vehicle from a virtual viewpoint and to display the generated synthesized image on a display apparatus of a vehicle interior mirror. ThePatent Literature 2 discloses an image display apparatus that is configured to trim (crop) a rear right image that is captured by a camera configured to image a rear right area of a target vehicle and a rear left image that is captured by a camera configured to image a rear left area of the target vehicle on the basis of a distance between the target vehicle and a rear vehicle that travels at the rear of the target vehicle, to generate a synthesized image by synthesizing the trimmed rear left image and the trimmed rear right image and to display the generated synthesized image.
CITATION LISTPatent Literature
• [Patent Literature 1] Japanese Unexamined Patent Application Publication No. 2008-230558
• [Patent Literature 2] Japanese Unexamined Patent Application Publication No. 2006-338566
SUMMARY OF INVENTIONTechnical Problem
• The image display apparatus disclosed in thePatent Literature 1 synthesizes the rear side image and the rear image without considering a traveling direction of the target vehicle. Therefore, the image display apparatus disclosed in thePatent Literature 1 has a technical problem that there is a possibility that the image display apparatus is not capable of generating the synthesized image that allows an occupant of the target vehicle to understand an surrounding circumstance of the target vehicle appropriately when the target vehicle travels rightward or leftward (for example, the target vehicle turns to the right or the left or the target vehicle makes a lane change).
• The above described technical problem is one example of the technical problem to be solved by the present invention. It is therefore an object of the present invention to provide, for example, an image display apparatus that is configured to generate a synthesized image by synthesizing a plurality of images that are captured by a plurality of imaging devices placed at a vehicle, respectively, and that is configured to generate the synthesized image that allows an occupant of the vehicle to understand a surrounding circumstance of the vehicle appropriately when the vehicle travels rightward or leftward.
Solution to Problem
• A first aspect of an image display apparatus of the present invention is provided with: a synthesizing device that is configured to synthesize a rear image and a first rear side image to generate a synthesized image, wherein the rear image is captured by a rear imaging device that is configured to image a rear area located at the rear of a vehicle and the first rear side image is captured by a first rear side imaging device that is configured to image a first rear side area located at the rear and either one of the right and the left of the vehicle; and a displaying device that is configured to display the synthesized image, the synthesizing device being configured to vary a proportion of each of a rear image area and a first rear side image area to the synthesized image on the basis of a first information when the synthesizing device generates the synthesized image, wherein the rear image area is an area in which the rear image is displayed in the synthesized image, the first rear side image area is an area in which the first rear side image is displayed in the synthesized image and the first information is an information relating to a first turn indicator that is configured to operate to inform that the vehicle travels toward either one of the right and the left.
• A second aspect of an image display apparatus of the present invention is provided with: a synthesizing device that is configured to synthesize a rear image and a first rear side image to generate a synthesized image, wherein the rear image is captured by a rear imaging device that is configured to image a rear area located at the rear of a vehicle and the first rear side image is captured by a first rear side imaging device that is configured to image a first rear side area located at the rear and either one of the right and the left of the vehicle; and a displaying device that is configured to display the synthesized image, the synthesizing device being configured to vary an image angle of at least one of a first image part and a second image part on the basis of a first information when the synthesizing device generates the synthesized image, wherein the first image part is an image part that is one portion of the synthesized image and that corresponds to the rear image, the second image part is an image part that is one portion of the synthesized image and that corresponds to the first rear side image, and the first information is an information relating to a first turn indicator that is configured to operate to inform that the vehicle travels toward either one of the right and the left.
BRIEF DESCRIPTION OF DRAWINGS
• FIG. 1 is a block diagram that illustrates a structure of a vehicle in a present embodiment.
• FIG. 2A is a planer view that illustrates positions at which a rear camera, a rear left camera and a rear right camera are placed, respectively, and an imaging range of each of the rear camera, the rear left camera and the rear right camera in the vehicle in the present embodiment, andFIG. 2B is a side view that illustrates the positions at which the rear camera, the rear left camera and the rear right camera are placed, respectively, and the imaging range of each of the rear camera, the rear left camera and the rear right camera in the vehicle in the present embodiment.
• FIG. 3 is a planar view that illustrates a synthesized image generated by an image synthesizing process in the present embodiment.
• FIG. 4 is a flowchart that illustrates a flow of an image display operation in the present embodiment.
• FIG. 5 is a planar view that conceptually illustrates a rear image angle.
• FIG. 6A is a planar view that illustrates a rear left image corresponding to a normal image angle, andFIG. 6B is a planar view that illustrates the rear left image corresponding to a large image angle.
• FIG. 7A is a planar view that illustrates a rear right image corresponding to a normal image angle, andFIG. 7B is a planar view that illustrates the rear right image corresponding to a narrow image angle.
• FIG. 8A is a planar view that illustrates one example of a synthesized image generated when a turn indicator does not operate, andFIG. 8B is a planar view that illustrates one example of the synthesized image generated when a right turn indicator operates.
• FIG. 9 Each ofFIG. 9A andFIG. 9B is a graph that illustrates a relationship between a steering angle and the large image angle.
• FIG. 10 is a planar view that illustrates the adjusted imaging range of each of the rear camera, the rear left camera and the rear right camera when the vehicle turns to the left, the adjusted imaging range of each of the rear camera, the rear left camera and the rear right camera when the vehicle turns to the right and the adjusted imaging range of each of the rear camera, the rear left camera and the rear right camera when the vehicle does not turn to the left and the right.
• FIG. 11 is a planar view that illustrates the imaging range of each of the rear camera, the rear left camera and the rear right camera selected when the vehicle turns to the left, the imaging range of each of the rear camera, the rear left camera and the rear right camera selected when the vehicle turns to the right and the imaging range of each of the rear camera, the rear left camera and the rear right camera selected when the vehicle does not turn to the left and the right.
• FIG. 12 Each ofFIG. 12A andFIG. 12B is a planar view that illustrates one example of the synthesized image.
DESCRIPTION OF EMBODIMENTS
• Hereinafter, with reference to drawings, one embodiment of the image display apparatus of the present invention will be described. In the following description, avehicle1 to which one embodiment of the image display apparatus of the present invention is adapted will be described.
(1) Structure ofVehicle1
• Firstly, with reference toFIG. 1 andFIG. 2A toFIG. 2B, the structure of thevehicle1 in the present embodiment will be explained. FIG.1 is a block diagram that illustrates the structure of thevehicle1 in a present embodiment.FIG. 2A is a planer view that illustrates positions at which arear camera11B, a rear left camera11BL and a rear right camera11BR are placed, respectively, and an imaging range of each of therear camera11B, the rear left camera11BL and the rear right camera11BR in thevehicle1 in the present embodiment.FIG. 2B is a side view that illustrates the positions at which therear camera11B, the rear left camera11BL and the rear right camera11BR are placed, respectively, and the imaging range of each of therear camera11B, the rear left camera11BL and the rear right camera11BR in thevehicle1 in the present embodiment. Note that the “right”, the “left” and the “rear” mean the “right”, the “left” and the “rear” based on a traveling direction of thevehicle1, respectively, in the below described description, if there is no annotation. Moreover, in the below described description, the embodiment will be described by using an XYZ coordinate system in which rightward corresponds to “toward +Y direction”, leftward corresponds to “toward −Y direction”, backward (rearward) corresponds to “toward −X direction”, frontward corresponds to “toward +X direction”, upward corresponds to “toward +Z direction”, and downward corresponds to “toward −Z direction”.
• As illustrated inFIG. 1, thevehicle1 has: therear camera11B that is one example of a “rear imaging device” or a “rear imager” in a below described additional statement; the rear left camera11BL that is one example of either one of a “first rear side imaging device” and a “second rear side imaging device” or either one of a “first rear side imager” and a “second rear side imager” in the below described additional statement; the rear right camera11BR that is one example of the other one of the “first rear side imaging device” and the “second rear side imaging device” or the other one of the “first rear side imager” and the “second rear side imager” in the below described additional statement; aturn indicator121; asteering angle sensor122; an ECU (Electronic Control Unit)13 that is one example of the “controller” in the below described additional statement; and adisplay14 that is one example of a “displaying device” or a “display” in the below described additional statement.
• Therear camera11B is an imaging device that is configured to image (in other words, capture an image of) a rear area located at the rear (especially, just at the rear) of the vehicle1 (namely, located at a backward position viewed from the vehicle1), as illustrated inFIG. 2A andFIG. 2B. The rear area corresponds to an area including at least one portion of an area that is reflected in a back mirror, under the assumption that the back mirror is placed in the vehicle interior (in other words, a cabin) of thevehicle1. Namely, therear camera11B is used as a substitute of the back mirror placed at the vehicle interior of thevehicle1 and constitutes one portion of what we call an electronic mirror, in the present embodiment. An imaging center of therear camera11B is just at the rear of thevehicle1, in order to image the rear area of thevehicle1. Namely, an optical axis of an optical system such as a lens of therear camera11B extends backwardly and straightforwardly from thevehicle1. As a result, an imaging range (in other words, an angle of an imaging field) IRB that is imaged by therear camera11B is set to include the rear area.
• The rear left camera11BL is an imaging device that is configured to image a rear left area located at the rear of the vehicle1 (especially, at the rear of thevehicle1 and at the left of thevehicle1, namely, at a backward and leftward position viewed from the vehicle1), as illustrated inFIG. 2A andFIG. 2B. The rear left area corresponds to an area including at least one portion of an area that is reflected in a door mirror placed at a left door when the left door is in the closed state (in other words, the left door is closed), under the assumption that the door mirror is placed at the left door of thevehicle1 that is placed at the left side of thevehicle1. Namely, the rear left camera11BL is used as a substitute of the door mirror placed at the left door of thevehicle1 and constitutes one portion of what we call an electronic mirror, in the present embodiment. An imaging center of the rear left camera11BL is at the left ofvehicle1 and at the rear of thevehicle1, in order to image the rear left area of thevehicle1. In other words, the imaging center of the rear left camera11BL is at the left of the imaging center of therear camera11B. Namely, an optical axis of an optical system such as a lens of the rear left camera11BL extends backward at the left of the above described optical axis of the optical system of therear camera11B. As a result, an imaging range (in other words, angle of imaging field) IRBL that is imaged by the rear left camera11BL is set to include the rear left area. Note that the imaging range IRBL may overlaps partially with the imaging range IRB.
• The rear right camera11BR is an imaging device that is configured to image a rear right area located at the rear of the vehicle1 (especially, at the rear of thevehicle1 and at the right of thevehicle1, namely, at a backward and rightward position viewed from the vehicle1), as illustrated inFIG. 2A andFIG. 2B. The rear right area corresponds to an area including at least one portion of an area that is reflected in a door mirror placed at a right door when the right door is in a closed state (in other words, the right door is closed), under the assumption that the door mirror is placed at the right door of thevehicle1 that is placed at the right side of thevehicle1. Namely, the rear right camera11BR is used as a substitute of the door mirror placed at the right door of thevehicle1 and constitutes one portion of what we call an electronic mirror, in the present embodiment. An imaging center of the rear right camera11BR is at the right ofvehicle1 and at the rear of thevehicle1, in order to image the rear right area of thevehicle1. In other words, the imaging center of the rear right camera11BR is at the right of the imaging center of therear camera11B. Namely, an optical axis of an optical system such as a lens of the rear right camera11BR extends backward at the right of the above described optical axis of the optical system of therear camera11B. As a result, an imaging range (in other words, an angle of an imaging field) IRBR that is imaged by the rear right camera11BR is set to include the rear right area. Note that the imaging range IRBR may overlaps partially with the imaging range IRB.
• Theturn indicator121 is an apparatus that is configured to operate to inform someone around thevehicle1 of the traveling direction of thevehicle1 when thevehicle1 travels rightward or the leftward (for example, thevehicle1 turns to the right, turns to the left or makes a lane change). Theturn indicator121 includes aleft turn indicator121L that is configured to operate when thevehicle1 travels leftward (namely, toward the left) and aright turn indicator121R that is configured to operate when thevehicle1 travels rightward (namely, toward the right). The present embodiment uses an example in which theleft turn indicator121L is a lamp placed at the relatively left side of thevehicle1. Moreover, the present embodiment uses an example in which theright turn indicator121R is a lamp placed at the relatively right side of thevehicle1. In this case, when thevehicle1 turns or makes the lane change rightward, theright turn indicator121R blinks on and off and theleft turn indicator121L is turned off. On the other hand, when thevehicle1 turns or makes the lane change leftward, theleft turn indicator121L blinks on and off and theright turn indicator121R is turned off. Note that an information relating to an operating state of theleft turn indicator121L is outputted from theleft turn indicator121L to theECU13. Similarly, an information relating to an operating state of theright turn indicator121R is outputted from theright turn indicator121R to theECU13.
• Thesteering angle sensor122 is configured to detect a steering angle that is a rotational angle of a steering wheel. An occupant (in other words, a person or a driver) of thevehicle1 operates the steering wheel in order to control the traveling direction of thevehicle1. When the occupant operates the steering wheel, a steered wheel of thevehicle1 is steered in response to the rotation of the steering wheel. Therefore, the steering angle is equivalent to a steered angle of the steered wheel. An information relating to a detection result of the steering angle sensor122 (namely, an information relating to the steering angle) is outputted from thesteering angle sensor122 to theECU13.
• TheECU13 is configured to control entire operation of thevehicle1. Especially in the present embodiment, theECU13 is configured to execute an image display operation for displaying, at thedisplay14, arear image111B, a rear left image111BL and a rear right image111BR. Therear image111B is an image that is captured by therear camera11B (namely, an image indicating a circumstance of the rear area). The rear left image111BL is an image that is captured by the rear left camera11BL (namely, an image indicating a circumstance of the rear left area). The rear right image111BR is an image that is captured by the rear right camera11BR (namely, an image indicating a circumstance of the rear right area). In order to perform the image display operation, theECU13 includes, as processing blocks that are logically realized in theECU13, animage collecting unit131 and animage synthesizing unit132 that is one example of a “synthesizing device” in the below described additional statement.
• Theimage collecting unit131 is configured to collect therear image111B, the rear left image111BL and the rear right image111BR from therear camera11B, the rear left camera11BL and the rear right camera11BR, respectively.
• Theimage synthesizing unit132 is configured to generate asynthesized image111C by executing an image synthesizing process for synthesizing therear image111B, the rear left image111BL and the rear right image111BR. Specifically, theimage synthesizing unit132 is configured to extract, from therear image111B, arear image112B corresponding to an image part that is at least one portion of therear image111B by trimming (in other words, cropping) therear image111B. Moreover, theimage synthesizing unit132 is configured to extract, from the rear left image111BL, a rear left image112BL corresponding to an image part that is at least one portion of the rear left image111BL by trimming the rear left image111BL. Moreover, theimage synthesizing unit132 is configured to extract, from the rear right image111BR, a rear right image112BR corresponding to an image part that is at least one portion of the rear right image111BR by trimming the rear right image111BR. Then, theimage synthesizing unit132 is configured to generate thesynthesized image111C in which the rear left area is located on the left of the rear area and the rear right area is located on the right of the rear area. Namely, theimage synthesizing unit132 is configured to generate thesynthesized image111C in which the rear left image112BL is located on the left of therear image112B and the rear right image112BR is located on the right of therear image112B, as illustrated inFIG. 3.
• Furthermore, theimage synthesizing unit132 is configured to control thedisplay14 to display the generatedsynthesized image111C. Note that thedisplay14 is placed in the vehicle interior of thevehicle1 and is configured to display thesynthesized image111C to the occupant of thevehicle1 in the vehicle interior.
(2) Flow of Image Display Operation
• Next, with reference toFIG. 4, a flow of the image display operation in the present embodiment will be described in detail.FIG. 4 is a flowchart that illustrates the flow of the image display operation in the present embodiment.
• As illustrated inFIG. 4, theimage synthesizing unit132 determines whether or not theleft turn indicator121L operates (a step S11). Namely, theimage synthesizing unit132 determines whether or not theleft turn indicator121L blinks on and off (the step S11).
• As a result of the determination at the step S11, if it is determined that theleft turn indicator121L operates (namely, blinks on and off) (the step S11: Yes), theimage synthesizing unit132 determines whether or not the steering angle is larger than a predetermined threshold value TH1 (a step S12). The steering angle used at the step S12 means a rotational angle of the steering wheel in a counterclockwise direction (namely, in a direction that allows the steered wheel to be steered leftward) from a neutral position of the steering wheel. The threshold value TH1 is set to an appropriate value that allows theimage synthesizing unit132 to distinguish, on the basis of the steering angle, a state where the occupant intends to drive thevehicle1 so that thevehicle1 turns to the left from a state where the occupant intends to drive thevehicle1 so that thevehicle1 makes the lane change to an adjacent driving lane that is adjacently at the left of a driving lane on which thevehicle1 currently travels. When the occupant intends to drive thevehicle1 so that thevehicle1 turns to the left, there is a higher possibility that the steering angle becomes larger (in other words, wider), compared to the case where the occupant intends to drive thevehicle1 so that thevehicle1 makes the lane change. Thus, a state where the steering angle is larger than the threshold value TH1 corresponds to the state where there is a relatively high possibility that the occupant intends to drive thevehicle1 so that thevehicle1 turns to the left. On the other hand, a state where the steering angle is smaller than the threshold value TH1 corresponds to the state where there is a relatively high possibility that the occupant intends to drive thevehicle1 so that thevehicle1 makes the lane change.
• As a result of the determination at the step S12, if it is determined that the steering angle is larger than the threshold value TH1 (the step S12: Yes), it is estimated that the occupant intends to drive thevehicle1 so that thevehicle1 turns to the left. In this case, theimage synthesizing unit132 sets a rear image angle θB that is a parameter relating to therear image112B to a predetermined normal image angle θB_N (a step S15). Moreover, theimage synthesizing unit132 sets a rear left image angle θBL that is a parameter relating to the rear left image112BL to a predetermined large image angle (in other words, a wide image angle) θBL_L that is larger (in other words, wider) than a below described predetermined normal image angle θBL_N (the step S15). Moreover, theimage synthesizing unit132 sets a rear right image angle θBR that is a parameter relating to the rear right image112BR to zero (the step S15).
• The rear image angle θB is a parameter that represents, as an angle from a virtual viewpoint, a range of a scene included in therear image112B. Considering that therear image112B is at least one portion of therear image111B, it can be said that the rear image angle θB is a parameter that represents, as the angle from the virtual viewpoint, an extracted area of therear image112B in therear image111B (namely, an area in therear image111B from which therear image112B is extracted), as described later. Specifically, as illustrated inFIG. 5, therear image112B corresponds to an image part that is at least one portion of therear image111B. Namely, therear image112B corresponds to a residual image part after at least one portion of therear image111B is trimmed. The extracted area of therear image112B (namely, the range of the scene in therear image112B) can be expressed by an angle between virtual lines or virtual planes that extend from the virtual viewpoint P to an outer edge of the extracted area. This angle corresponds to the rear image angle θB. As illustrated inFIG. 5, the rear image angle θB typically includes an angle (namely, an angle in the horizontal direction) θBh between virtual lines or virtual planes that extend from the virtual viewpoint P to a pair of vertical outer edges of the extracted area of therear image112B and an angle (namely, an angle in the vertical direction) θBv between virtual lines or virtual planes that extend from the virtual viewpoint P to a pair of horizontal outer edges of the extracted area of therear image112B. In the present embodiment, the rear image angle θB means the rear image angle θBh that corresponds to the horizontal angle. However, the rear image angle θB may mean the rear image angle θBv that corresponds to the vertical angle, in addition to or instead of the rear image angle θBh. When the rear image angle θB means both of the rear image angle θBh and the rear image angle θBv, a process of setting the rear image angle θB to the normal image angle θB_N at the step S15 includes a process of setting the rear image angle θBh to the normal image angle θBh_N that corresponds to the horizontal angle and a process of setting the rear image angle θBv to the normal image angle θBv_N that corresponds to the vertical angle.
• Same applies to the rear left image angle θBL and the rear right image angle θBR, as with the rear image angle θB. Namely, the rear left image angle θBL is a parameter that represents, as an angle (an angle in the horizontal direction in the present embodiment) from the virtual viewpoint, an extracted area of the rear left image112BL in the rear left image111BL (in other words, a range of a scene included in the rear left image112BL). Similarly, the rear right image angle θBR is a parameter that represents, as an angle (an angle in the horizontal direction in the present embodiment) from the virtual viewpoint, an extracted area of the rear right image112BR in the rear right image111BR (in other words, a range of a scene included in the rear right image112BR).
• Again inFIG. 4, on the other hand, as a result of the determination at the step S12, if it is determined that the steering angle is equal to or smaller than the threshold value TH1 (the step S12: No), it is estimated that the occupant intends to drive thevehicle1 so that thevehicle1 makes the lane change. Alternatively, it is estimated that the occupant mistakenly operates theleft turn indicator121L in some cases, although the occupant does not intend to drive thevehicle1 so that thevehicle1 travels leftward. In this case, theimage synthesizing unit132 sets the rear image angle θB to the normal image angle θB_N (a step S17). Moreover, theimage synthesizing unit132 sets the rear left image angle θBL to the normal image angle θBL_N (the step S17). Moreover, theimage synthesizing unit132 sets the rear right image angle θBR to a predetermined normal image angle θBR_N (the step S17).
• On the other hand, as a result of the determination at the step S11, if it is determined that theleft turn indicator121L does not operate (namely, is turned off) (the step S11: No), theimage synthesizing unit132 determines whether or not theright turn indicator121R operates (a step S13). Namely, theimage synthesizing unit132 determines whether or not theright turn indicator121R blinks on and off (the step S13).
• As a result of the determination at the step S13, if it is determined that theright turn indicator121R operates (namely, blinks on and off) (the step S13: Yes), theimage synthesizing unit132 determines whether or not the steering angle is larger than a predetermined threshold value TH2 (a step S14). The steering angle used at the step S14 means a rotational angle of the steering wheel in a clockwise direction (namely, in a direction that allows the steered wheel to be steered rightward) from the neutral position of the steering wheel. The threshold value TH2 is set to an appropriate value that allows theimage synthesizing unit132 to distinguish, on the basis of the steering angle, a state where the occupant intends to drive thevehicle1 so that thevehicle1 turns to the right from a state where the occupant intends to drive thevehicle1 so that thevehicle1 makes the lane change to an adjacent driving lane that is adjacently at the right of the driving lane on which thevehicle1 currently travels. When the occupant intends to drive thevehicle1 so that thevehicle1 turns to the right, there is a higher possibility that the steering angle becomes larger, compared to the case where the occupant intends to drive thevehicle1 so that thevehicle1 makes the lane change. Thus, a state where the steering angle is larger than the threshold value TH2 corresponds to the state where there is a relatively high possibility that the occupant intends to drive thevehicle1 so that thevehicle1 turns to the right. On the other hand, a state where the steering angle is smaller than the threshold value TH2 corresponds to the state where there is a relatively high possibility that the occupant intends to drive thevehicle1 so that thevehicle1 makes the lane change. The threshold value TH2 is usually same as the threshold value TH1. However, a value that is different from the threshold value TH1 may be used as the threshold value TH2.
• As a result of the determination at the step S14, if it is determined that the steering angle is larger than the threshold value TH2 (the step S14: Yes), it is estimated that the occupant intends to drive thevehicle1 so that thevehicle1 turns to the right. In this case, theimage synthesizing unit132 sets the rear image angle θB to the normal image angle θB_N (a step S16). Moreover, theimage synthesizing unit132 sets the rear left image angle θBL to zero (the step S16). Moreover, theimage synthesizing unit132 sets the rear right image angle θBR to a predetermined large image angle θBR_L that is larger than the normal image angle θBR_N (the step S16).
• On the other hand, as a result of the determination at the step S14, if it is determined that the steering angle is equal to or smaller than the threshold value TH2 (the step S14: No), it is estimated that the occupant intends to drive thevehicle1 so that thevehicle1 makes the lane change. Alternatively, it is estimated that the occupant mistakenly operates theright turn indicator121R in some cases, although the occupant does not intend to drive thevehicle1 so that thevehicle1 travels rightward. In this case, theimage synthesizing unit132 sets the rear image angle θB, the rear left image angle θBL and the rear right image angle θBR to the normal image angle θB_N, the normal image angle θBL_N and the normal image angle θBR_N, respectively (the step S17).
• On the other hand, as a result of the determination at the step S13, if it is determined that theright turn indicator121R does not operate (namely, is turned off) (the step S13: No), theimage synthesizing unit132 sets the rear image angle θB, the rear left image angle θBL and the rear right image angle θBR to the normal image angle θB_N, the normal image angle θBL_N and the normal image angle θBR_N, respectively (the step S17).
• Then, theimage synthesizing unit132 extracts, as therear image112B, an image part corresponding to the rear image angle θB set at the step S15, S16 or S17 from therear image111B (a step S21). Note that the rear image angle θB is set to the normal image angle θB_N in an example illustrated inFIG. 4. Thus, theimage synthesizing unit132 extracts, as therear image112B, the image part corresponding to the normal image angle θB_N from therear image111B.
• Moreover, theimage synthesizing unit132 extracts, as the rear left image112BL, an image part corresponding to the rear left image angle θBL set at the step S15, S16 or S17 from the rear left image111BL (the step S21). For example, when the rear left image angle θBL is set to the normal image angle θBL_N, theimage synthesizing unit132 extracts, as the rear left image112BL, a relatively small image part corresponding to the normal image angle θBL_N from the rear left image111BL, as illustrated inFIG. 6A. For example, when the rear left image angle θBL is set to the large image angle θBL_L, theimage synthesizing unit132 extracts, as the rear left image112BL, a relatively large image part corresponding to the large image angle θBL_L from the rear left image111BL, as illustrated inFIG. 6B. For example, when the rear left image angle θBL is set to zero, theimage synthesizing unit132 does not extract the rear left image112BL from the rear left image111BL.
• It is preferable that theimage synthesizing unit132 extract the rear left image112BL so that a position of a left side1121_L (namely, a side opposite to a right side1122_L that forms a boundary with therear image112B) of the rear left image112BL corresponding to the large image angle θBL_L is away leftward from a position of a left side1121_N of the rear left image112BL corresponding to the normal image angle θBL_N in the rear left image111BL. As a result, the rear left image112BL corresponding to the large image angle θBL_L includes a scene that is at the left of a scene included in the rear left image112BL corresponding to the normal image angle θBL_N. On the other hand, theimage synthesizing unit132 extracts the rear left image112BL so that a position of the right side1122_L (namely, the side that forms the boundary with therear image112B) of the rear left image112BL corresponding to the large image angle θBL_L is same as or different from a position of a right side1122_N of the rear left image112BL corresponding to the normal image angle θBL_N in the rear left image111BL.
• Moreover, theimage synthesizing unit132 extracts, as the rear right image112BR, an image part corresponding to the rear right image angle θBR set at the step S15, S16 or S17 from the rear right image111BR (the step S21). For example, when the rear right image angle θBR is set to the normal image angle θBR_N, theimage synthesizing unit132 extracts, as the rear right image112BR, a relatively small image part corresponding to the normal image angle θBR_N from the rear right image111BR, as illustrated inFIG. 7A. For example, when the rear right image angle θBR is set to the large image angle θBR_L, theimage synthesizing unit132 extracts, as the rear right image112BR, a relatively large image part corresponding to the large image angle θBR_L from the rear right image111BR, as illustrated inFIG. 7B. For example, when the rear right image angle θBR is set to zero, theimage synthesizing unit132 does not extract the rear right image112BR from the rear right image111BR.
• It is preferable that theimage synthesizing unit132 extract the rear right image112BR so that a position of a right side1123_L (namely, a side opposite to a left side1124_L that forms a boundary with therear image112B) of the rear right image112BR corresponding to the large image angle θBR_L is away rightward from a position of a right side1123_N of the rear right image112BR corresponding to the normal image angle θBR_N in the rear right image111BR. As a result, the rear right image112BR corresponding to the large image angle θBR_L includes a scene that is at the right of a scene included in the rear right image112BR corresponding to the normal image angle θBR_N. On the other hand, theimage synthesizing unit132 extracts the rear right image112BR so that a position of the left side1124_L (namely, the side that forms the boundary with therear image112B) of the rear right image112BR corresponding to the large image angle θBR_L is same as or different from a position of a left side1124_N of the rear right image112BR corresponding to the normal image angle θBR_N in the rear right image111BR.
• Then, theimage synthesizing unit132 generates thesynthesized image111C in which the rear left image112BL is located on the left of therear image112B and the rear right image112BR is located on the right of therear image112B by using therear image112B, the rear left image112BL and the rear right image112BR extracted at the step S21 (a step S22). However, when the rear left image angle θBL is set to zero, theimage synthesizing unit132 does not extract the rear left image112BL, as described above. In this case, theimage synthesizing unit132 generates thesynthesized image111C in which the rear right image112BR is located on the right of therear image112B and the rear left image112BL is not included. Similarly, when the rear right image angle θBR is set to zero, theimage synthesizing unit132 does not extract the rear right image112BR, as described above. In this case, theimage synthesizing unit132 generates thesynthesized image111C in which the rear left image112BL is located on the left of therear image112B and the rear right image112BR is not included.
• Theimage synthesizing unit132 may execute, as one portion of the image synthesizing process, at least one of an observing point converting process, an image rotating process, a scaling process and an image shape forming process so that therear image112B, the rear left image112BL and the rear right image112BR are seamlessly connected in the synthesizingimage111C when theimage synthesizing unit132 generates thesynthesized image111C. The observing point converting process is a process for converting an observing point (in other words, a viewpoint) of at least one of therear image111B, therear image112B, the rear left image111BL, the rear left image112BL, the rear right image111BR and the rear right image112BR. The image rotating process is a process for rotating at least one of therear image111B, therear image112B, the rear left image111BL, the rear left image112BL, the rear right image111BR and the rear right image112BR. The scaling process is a process for scaling (in other words, expanding and/or minifying) at least one of therear image111B, therear image112B, the rear left image111BL, the rear left image112BL, the rear right image111BR and the rear right image112BR. The image shape forming process is a process for converting (changing) a shape of at least one of therear image111B, therear image112B, the rear left image111BL, the rear left image112BL, the rear right image111BR and the rear right image112BR.
• The rear left image112BL when the rear left image angle θBL is set to the large image angle θBL_L is larger than the rear left image112BL when the rear left image angle θBL is set to the normal image angle θBL_N. Thus, theimage synthesizing unit132 generates thesynthesized image111C so that a proportion of an area of the rear left image112BL to thesynthesized image111C (in other words, a proportion of a rear left image area to thesynthesized image111C, wherein the rear left image area is one portion of thesynthesized image111C and is an area in which the rear left image112BL is displayed) when the rear left image angle θBL is set to the large image angle θBL_L is larger than the proportion of the area of the rear left image112BL to thesynthesized image111C when the rear left image angle θBL is set to the normal image angle θBL_N. Namely, theimage synthesizing unit132 generates thesynthesized image111C so that the proportion of the area of the rear left image112BL to thesynthesized image111C becomes larger as the rear left image angle θBL becomes larger. For the same reason, theimage synthesizing unit132 generates thesynthesized image111C so that a proportion of an area of the rear right image112BR to thesynthesized image111C becomes larger as the rear right image angle θBR becomes larger. Note thatFIG. 8A illustrates one example of thesynthesized image111C generated when the rear image angle θB, the rear left image angle θBL and the rear right image angle θBR are set to the normal image angle θB_N, the normal image angle θBL_N and the normal image angle θBR_N, respectively. On the other hand,FIG. 8B illustrates one example of thesynthesized image111C generated when the rear image angle θB, the rear left image angle θBL and the rear right image angle θBR are set to the normal image angle θB_N, zero and the large image angle θBR_L, respectively (namely, when thevehicle1 turns to the right).
• Then, thedisplay14 displays thesynthesized image111C generated at the step S22 (a step S23).
• In the above described description, if it is determined that the steering angle is same as the threshold value TH1 as a result of the determination at the step S12, theimage synthesizing unit132 executes the process that is executed when it is determined that the steering angle is smaller than the threshold value TH1. However, if it is determined that the steering angle is same as the threshold value TH1, theimage synthesizing unit132 may execute the process that is executed when it is determined that the steering angle is larger than the threshold value TH1. Similarly, in the above described description, if it is determined that the steering angle is same as the threshold value TH2 as a result of the determination at the step S14, theimage synthesizing unit132 executes the process that is executed when it is determined that the steering angle is smaller than the threshold value TH2. However, if it is determined that the steering angle is same as the threshold value TH2, theimage synthesizing unit132 may execute the process that is executed when it is determined that the steering angle is larger than the threshold value TH2.
(3) Technical Effect
• As described above, the image display operation in the present embodiment is capable of generating thesynthesized image111C that allows the occupant to understand the surrounding circumstance of thevehicle1 more appropriately when thevehicle1 turns to the right or the left, compared to an image display operation in a comparison example in which the rear image angle θB, the rear left image angle θBL and the rear right image angle θBR are fixed and the proportion of the area of each of therear image112B, the rear left image112BL and the rear right image112BR to thesynthesized image111C is fixed regardless of the operating state of theturn indicator121.
• Specifically, when thevehicle1 turns to the right (namely, when it is estimated that the occupant intends to drive thevehicle1 so that thevehicle1 turns the right, in other words, when theright turn indicator121R operates and the steering angle is larger than the threshold value TH2), it is preferable that the occupant pay more attention to the circumstance of the rear right area of thevehicle1. In the present embodiment, the rear right image angle θBR when thevehicle1 turns to the right is larger than the rear right image angle θBR when thevehicle1 does not turn to the right. When the rear right image angle θBR is relatively large, the rear right image112BR corresponding to the rear right image angle θBR includes a scene spreading in the wider or larger field, as illustrated inFIG. 8B. Namely, a blind area that is not included in the rear right image112BR becomes relatively small. As a result, there is a relatively high possibility that an object (for example, a pedestrian), which might be in the blind area of the rear right image112BR if the rear right image angle θBR does not vary, is included in the rear right image112BR. Thus, the occupant can understand the circumstance of the rear right area of thevehicle1 more easily. Namely, the occupant can pay more attention to the circumstance of the rear right area of thevehicle1. Thus, the image display operation in the present embodiment is capable of generating thesynthesized image111C that allows the occupant to understand the surrounding circumstance of the vehicle1 (especially, the circumstance of the rear right area of the vehicle1) appropriately when thevehicle1 turns to the right.
• Moreover, the proportion of the area of the rear right image112BR to thesynthesized image111C when thevehicle1 turns to the right is larger than the proportion of the area of the rear right image112BR to thesynthesized image111C when thevehicle1 does not turn to the right. Namely, as illustrated inFIG. 8B, the rear right image112BR is displayed in thesynthesized image111C by using a relatively large displaying area. When the rear right image112BR is displayed by using the relatively large displaying area, the occupant can pay more attention to the circumstance of the rear right area of thevehicle1. Thus, the image display operation in the present embodiment is capable of generating thesynthesized image111C that allows the occupant to understand the surrounding circumstance of the vehicle1 (especially, the circumstance of the rear right area of the vehicle1) appropriately when thevehicle1 turns to the right.
• Note that the image display operation in the present embodiment is capable of generating thesynthesized image111C that allows the occupant to understand the surrounding circumstance of the vehicle1 (especially, the circumstance of the rear left area of the vehicle1) appropriately when thevehicle1 turns to the left (namely, when it is estimated that the occupant intends to drive thevehicle1 so that thevehicle1 turns the left, in other words, when theleft turn indicator121L operates and the steering angle is larger than the threshold value TH1), for the same reason as the case where thevehicle1 turns to the right.
• In addition, the present embodiment is capable of appropriately preventing the occupant from being annoyed by an undesired change of a displayed content of thesynthesized image111C (for example, a change of the displayed content from a displayed content illustrated inFIG. 8A to a displayed content illustrated inFIG. 8B). Specifically, as described above, when the steering angle is equal to or smaller than the threshold value TH1 although theleft turn indicator121L operates, it is estimated that thevehicle1 makes the lane change or the occupant mistakenly operates theleft turn indicator121L. Namely, it is estimated that the occupant does not intend to drive thevehicle1 so that thevehicle1 turns to the left. In this situation, if theimage synthesizing unit132 determines on the basis of only the operatingleft turn indicator121L that the occupant intends to drive thevehicle1 so that thevehicle1 turns to the left and then varies the rear left image angle θBL and the proportion of the area of the rear left image112BL to thesynthesized image111C, the displayed content of thesynthesized image111C is changed to the displayed content that allows the occupant to appropriately understand the circumstance of the rear left area of thevehicle1 although the occupant does not intend to drive thevehicle1 so that thevehicle1 turns to the left. Thus, there is a possibility that the undesired change of the displayed content of thesynthesized image111C annoys the occupant. On the other hand, in the present embodiment, when it is estimated that the occupant does not intend to drive thevehicle1 so that thevehicle1 turns to the left (namely, when the steering angle is equal to or smaller than the threshold value TH1) although theleft turn indicator121L operates, the rear left image angle θBL is kept to be the normal image angle θBL_N and the proportion of the area of the rear left image112L to thesynthesized image111C is kept to be a proportion corresponding to the normal image angle θBL_N. Thus, it is possible to prevent the occupant from being annoyed by the undesired change of the displayed content of thesynthesized image111C. Note that same applies to the case where it is estimated that the occupant does not intend to drive thevehicle1 so that thevehicle1 turns to the right (namely, when the steering angle is equal to or smaller than the threshold value TH2) although theright turn indicator121R operates.
• In addition, the image display operation in the present embodiment generates thesynthesized image111C that does not include the rear right image112BR when thevehicle1 turns to the left. Thus, the image display operation in the present embodiment is capable of generating thesynthesized image111C in which the proportion of the area of the rear left image112BL to thesynthesized image111C become larger, compared to the case where thesynthesized image111C including the rear right image112BR is generated. Namely, the image display operation in the present embodiment is capable of displaying the rear left image112BL by using the larger displaying area. Thus, the image display operation in the present embodiment is capable of generating thesynthesized image111C that allows the occupant to understand the surrounding circumstance of the vehicle1 (especially, the circumstance of the rear left area of the vehicle1) more appropriately when thevehicle1 turns to the left. Note that the image display operation in the present embodiment generates thesynthesized image111C that does not include the rear left image112BL when thevehicle1 turns to the right. Thus, the image display operation in the present embodiment is capable of generating thesynthesized image111C that allows the occupant to understand the surrounding circumstance of the vehicle1 (especially, the circumstance of the rear right area of the vehicle1) more appropriately when thevehicle1 turns to the right, for the same reason as the case where thevehicle1 turns to the left.
(4) Modified Example
• Next, modified examples will be described.
(4-1) First Modified Example of Image Display Operation
• Theimage synthesizing unit132 may vary a magnitude of the large image angle θBL_L on the basis of the steering angle (especially, the rotational angle of the steering wheel in the counterclockwise direction from the neutral position of the steering wheel). Specifically, theimage synthesizing unit132 may vary the magnitude of the large image angle θBL_L so that the large image angle θBL_L becomes larger as the steering angle becomes larger, as illustrated inFIG. 9A toFIG. 9B. Note thatFIG. 9A illustrates an example in which the large image angle θBL_L becomes larger sequentially andFIG. 9B illustrates an example in which the large image angle θBL_L becomes larger in a stepwise manner. In this case, the large image angle θBL_L becomes larger as occupant rotates the steering wheel in the counterclockwise direction more in order to drive thevehicle1 so that thevehicle1 turns to the left. Thus the first modified example of the image display operation is capable of displaying, at the displaying area having an appropriate size, the rear left image112L including the scene in an appropriate field while considering how an operation by the occupant for turning thevehicle1 to the left is progressing.
• For the same reason, theimage synthesizing unit132 may vary a magnitude of the large image angle θBR_L on the basis of the steering angle (especially, the rotational angle of the steering wheel in the clockwise direction from the neutral position of the steering wheel).
(4-2) Second Modified Example of Image Display Operation
• In the above described description, theimage synthesizing unit132 varies the extracted area of the rear left image112BL in the rear left image111BL and the extracted area of the rear right image112BR in the rear right image111BR, in order to generate thesynthesized image111C corresponding to the rear left image angle θBL and the rear right image angle θBR (namely, thesynthesized image111C including the rear left image112BL and the rear right image112BR that correspond to the rear left image angle θBL and the rear right image angle θBR, respectively). Namely, theimage synthesizing unit132 generate thesynthesized image111C corresponding to the rear left image angle θBL and the rear right image angle θBR by executing an image process (an image processing) corresponding to the rear left image angle θBL and the rear right image angle θBR on the rear left image111BL and the rear right image111BR. However, theimage synthesizing unit132 may generate thesynthesized image111C corresponding to the rear left image angle θBL and the rear right image angle θBR by using another method. One example of another method of generating the synthesized image corresponding to the rear left image angle θBL and the rear right image angle θBR will be described.
• Theimage synthesizing unit132 may generate thesynthesized image111C corresponding to the rear left image angle θBL and the rear right image angle θBR by controlling the rear left camera11BL and the rear right camera11BR. For example, theimage synthesizing unit132 may generate thesynthesized image111C corresponding to the rear left image angle θBL and the rear right image angle θBR by controlling an optical parameter of each of the rear left camera11BL and the rear right camera11BR so that the imaging range IRBL and the imaging range IRBR vary. In this case, varying the optical parameter of the rear left camera11BL and varying the optical parameter of the rear right camera11BR are equivalent to varying the rear left image angle θBL and varying the rear right image angle θBR, respectively. A focal length of an optical system (for example, a lens or the like) of each of the rear left camera11BL and the rear right camera11BR is one example of the optical parameter. In this case, theimage synthesizing unit132 may control the rear left camera11BL so that the imaging range IRBL of the rear left camera11BL is same as a relatively large imaging range IRBL_L corresponding to the large image angle θBL_L, as illustrated in a left-lower part ofFIG. 10, when thevehicle1 turns to the left. On the other hand, theimage synthesizing unit132 may control the rear right camera11BR so that the imaging range IRBR of the rear right camera11BR is same as a relatively large imaging range IRBR_L corresponding to the large image angle θBR_L, as illustrated in a right-lower part ofFIG. 10, when thevehicle1 turns to the right. On the other hand, theimage synthesizing unit132 may control the rear left camera11BL and the rear right camera11BR so that the imaging range IRBL of the rear left camera11BL is same as an imaging range IRBL_N corresponding to the normal image angle θBL_N and the imaging range IRBR of the rear right camera11BR is same as an imaging range IRBR_N corresponding to the normal image angle θBR_N, as illustrated in a upper part ofFIG. 10, when thevehicle1 does not turn to the left and the right. In this case, the rear left image111BL captured by the rear left camera11BL is substantially same as the rear left image112BL. Similarly, the rear right image111BR captured by the rear right camera11BR is substantially same as the rear right image112BR.
• Note thatFIG. 10 illustrate an example in which the imaging range IRB of therear camera11B is always set to an imaging range IRB_N corresponding to the normal image angle θB_N, because the rear image angle θB is always set to the normal image angle θBR_N in the above described description. However, if the rear image angle θB is allowed to be varied as described later, the imaging range IRB of therear camera11B may be varied in response to the variation of the rear image angle θB.
• Alternatively, when thevehicle1 is provided with a plurality of rear left cameras11BL having different imaging ranges IRBL, theimaging synthesizing unit132 may generate thesynthesized image111C corresponding to the rear left image angle θBL by selecting one rear left camera11BL that is used to actually capture the rear left image111BL from the plurality of rear left cameras11BL on the basis of the operating state of theturn indicator121 and the steering angle. In this case, changing the used rear left camera11BL is equivalent to varying the rear left image angle θBL. Specifically, thevehicle1 may be provided with a rear left camera11BL_N and a rear left camera11BL_L. The imaging range IRBL of the rear left camera11BL_N is the imaging range IRBL_N corresponding to the normal image angle θBL_N. The imaging range IRBL of the rear left camera11BL_L is the imaging range IRBL_L corresponding to the large image angle θBL_L. In this case, theimage synthesizing unit132 may control the rear left camera11BL_N and the rear left camera11BL_L so that the rear left camera11BL_L captures the rear left image111BL as illustrated in a left-lower part ofFIG. 11 when thevehicle1 turns to the left and the rear left camera11BL_N captures the rear left image111BL as illustrated in an upper part ofFIG. 11 when thevehicle1 does not turns to the left and the right.
• Similarly, when thevehicle1 is provided with a plurality of rear right cameras11BR having different imaging ranges IRBR, theimaging synthesizing unit132 may generate thesynthesized image111C corresponding to the rear right image angle θBR by selecting one rear right camera11BR that is used to actually capture the rear right image111BR from the plurality of rear right cameras11BR on the basis of the operating state of theturn indicator121 and the steering angle. In this case, changing the used rear right camera11BR is equivalent to varying the rear right image angle θBR. Specifically, thevehicle1 may be provided with a rear right camera11BR_N and a rear right camera11BR_L. The imaging range IRBR of the rear right camera11BR_N is the imaging range IRBR_N corresponding to the normal image angle θBR_N. The imaging range IRBR of the rear right camera11BR_L is the imaging range IRBR_L corresponding to the large image angle θBR_L. In this case, theimage synthesizing unit132 may control the rear right camera11BR_N and the rear right camera11BR_L so that the rear right camera11BR_L captures the rear right image111BR as illustrated in a right-lower part ofFIG. 11 when thevehicle1 turns to the right and the rear right camera11BL_N captures the rear right image111BR as illustrated in the upper part ofFIG. 11 when thevehicle1 does not turns to the left and the right. In this case, the rear right image111BR captured by the rear right camera11BR is substantially same as the rear right image112BR.
• Note that theFIG. 11 illustrates an example in which therear camera11B having an imaging range IRB_N corresponding to the normal image angle θB_N captures therear image111B, because the rear image angle θB is always set to the normal image angle θB_N in the above described description. However, if the rear image angle θB is allowed to be varied as described later, theimaging synthesizing unit132 may select onerear camera11B that is used to actually capture therear image111B from a plurality ofrear cameras11B of thevehicle1.
(4-3) Third Modified Example of Image Display Operation
• In the above described description, theimage synthesizing unit132 sets the rear right image angle θBR to the large image angle θBR_L and increases the proportion of the area of the rear right image112BR to thesynthesized image111C, when thevehicle1 turns to the right. However, theimage synthesizing unit132 increases the proportion of the area of the rear right image112BR to thesynthesized image111C without varying the rear right image angle θBR (namely, with the rear right image angle θBR being fixed), when thevehicle1 turns to the right. In this case, as illustrated inFIG. 12A, theimage synthesizing unit132 may expand (in other words, scale up) the rear right image112BR in the horizontal direction and, and then generate thesynthesized image111C by using the expanded rear right image112BR. Alternatively, theimage synthesizing unit132 may set the rear right image angle θBR to the large image angle θBR_L without varying the proportion of the area of the rear right image112BR to thesynthesized image111C, when thevehicle1 turns to the right. In this case, as illustrated inFIG. 12B, theimage synthesizing unit132 may minify (in other words, scale down) the rear right image112BR in the horizontal direction, and then generate thesynthesized image111C by using the minified rear right image112BR. Even in these cases, the variation of the rear right image angle θBR or the variation of the proportion of the area of the rear right image112BR to thesynthesized image111C allows thedisplay14 to display thesynthesized image111C that includes the rear right image112BR in which the scene spreading in the relatively wide field is included or thesynthesized image111C that displays the rear right image112BR by using the relatively large displaying area. Thus, the fact remains that the occupant can pay more attention to the circumstance of the rear right area of thevehicle1. Therefore, an effect that is same as the above described effect can be achieved. Same applies to the case where thesynthesized image111C generated when thevehicle1 turns to the left.
(4-4) Anther Modified Example
• In the above described description, theimage synthesizing unit132 sets the rear right image angle θBR to zero, when thevehicle1 turns to the left. However, theimage synthesizing unit132 may set the rear right image angle θBR to a value that is larger than zero, when thevehicle1 turns to the left. For example, theimage synthesizing unit132 may set the rear right image angle θBR to a predetermined small image angle (in other words, a narrow image angle) θBR_S that is smaller than the normal image angle θBR_N. Similarly, in the above described description, theimage synthesizing unit132 sets the rear left image angle θBL to zero, when thevehicle1 turns to the right. However, theimage synthesizing unit132 may set the rear left image angle θBL to a value that is larger than zero, when thevehicle1 turns to the right. For example, theimage synthesizing unit132 may set the rear left image angle θBL to a predetermined small image angle θBL_S that is smaller than the normal image angle θBL_N.
• In the above described description, theimage synthesizing unit132 sets the rear image angle θB to the normal image angle θB, when thevehicle1 turns to the right or the left. However, theimage synthesizing unit132 may set the rear image angle θB to a predetermined large image angle θB_L that is larger than the normal image angle θB_N or a predetermined small image angle θB_S that is smaller than the normal image angle θB_N, when thevehicle1 turns to the right or the left. Note that theimage synthesizing unit132 may vary the proportion of the area of therear image112B to thesynthesized image111C in response to the variation of the rear image angle θB.
• In the above described description, theimage synthesizing unit132 does not set the rear left image angle θBL to the large image angle θBL_L, when the steering angle is equal to or smaller than the threshold value TH1 although theleft turn indicator121L operates. However, theimage synthesizing unit132 may set the rear left image angle θBL to the large image angle θBL_L, when theleft turn indicator121L operates even if the steering angle is equal to or smaller than the threshold value TH1. Similarly, in the above described description, theimage synthesizing unit132 does not set the rear right image angle θBR to the large image angle θBR_L, when the steering angle is equal to or smaller than the threshold value TH2 although theright turn indicator121R operates. However, theimage synthesizing unit132 may set the rear right image angle θBR to the large image angle θBR_L, when theright turn indicator121R operates even if the steering angle is equal to or smaller than the threshold value TH2.
• In the above described description, the threshold value TH1 that is compared with the steering angle is set to the appropriate value that allows theimage synthesizing unit132 to distinguish the state where the occupant intends to drive thevehicle1 so that thevehicle1 turns to the left from the state where the occupant intends to drive thevehicle1 so that thevehicle1 makes the lane change to the adjacent driving lane that is adjacently at the left of the driving lane on which thevehicle1 currently travels. However, the fact remains that it is preferable that the occupant pay attention to the circumstance of the rear left area of thevehicle1 to some extent when thevehicle1 makes the lane change to the adjacent driving lane that is adjacently at the left of the driving lane on which thevehicle1 currently travels. Thus, the threshold value TH1 may be set to an appropriate value that allows theimage synthesizing unit132 to distinguish a state where the occupant intends to drive thevehicle1 so that thevehicle1 travels leftward (for example, thevehicle1 turns to the left or thevehicle1 makes the lane change to the adjacent driving lane that is adjacently at the left of the driving lane on which thevehicle1 currently travels) from a state where the occupant does not intend to drive thevehicle1 so that thevehicle1 travels leftward (for example, the occupant intends to drivevehicle1 so that thevehicle1 travels straightforwardly). As a result, the image display operation is capable of generating thesynthesized image111C that allows the occupant to understand the surrounding circumstance of the vehicle1 (especially, the circumstance of the rear left area of the vehicle1) appropriately not only when thevehicle1 turns to the left but also when thevehicle1 makes the lane change. For the same reason, the threshold value TH2 that is compared with the steering angle may be set to an appropriate value that allows theimage synthesizing unit132 to distinguish a state where the occupant intends to drive thevehicle1 so that thevehicle1 travels rightward (for example, thevehicle1 turns to the right or thevehicle1 makes the lane change to the adjacent driving lane that is adjacently at the right of the driving lane on which thevehicle1 currently travels) from a state where the occupant does not intend to drive thevehicle1 so that thevehicle1 travels rightward (for example, the occupant intends to drivevehicle1 so that thevehicle1 travels straightforwardly).
(5) Additional Statement
• Relating to the above described embodiment, following additional statements will be disclosed.
(5-1)Additional Statement 1
• An image display apparatus according to theadditional statement 1 is provided with: a synthesizing device that is configured to synthesize a rear image and a first rear side image to generate a synthesized image, wherein the rear image is captured by a rear imaging device that is configured to image a rear area located at the rear of a vehicle and the first rear side image is captured by a first rear side imaging device that is configured to image a first rear side area located at the rear and either one of the right and the left of the vehicle; and a displaying device that is configured to display the synthesized image, the synthesizing device being configured to vary a proportion of each of a rear image area and a first rear side image area to the synthesized image on the basis of a first information when the synthesizing device generates the synthesized image, wherein the rear image area is an area in which the rear image is displayed in the synthesized image, the first rear side image area is an area in which the first rear side image is displayed in the synthesized image and the first information is relating to a first turn indicator that is configured to operate to inform that the vehicle travels toward either one of the right and the left.
• Alternatively, an image display apparatus according to theadditional statement 1 may be provided with: a controller that is programmed to synthesize a rear image and a first rear side image to generate a synthesized image, wherein the rear image is captured by a rear imager that is configured to image a rear area located at the rear of a vehicle and the first rear side image is captured by a first rear side imager that is configured to image a first rear side area located at the rear and either one of the right and the left of the vehicle; and a display that is configured to display the synthesized image, the controller being programmed to vary a proportion of each of a rear image area and a first rear side image area to the synthesized image on the basis of a first information when the controller generates the synthesized image, wherein the rear image area is an area in which the rear image is displayed in the synthesized image, the first rear side image area is an area in which the first rear side image is displayed in the synthesized image and the first information is an information relating to a first turn indicator that is configured to operate to inform that the vehicle travels toward either one of the right and the left.
• The first turn indicator is configured to operate when the vehicle travels toward either one of the right and the left (for example, the vehicle turns to the right, turns to the left or makes a lane change). Thus, the image display apparatus according to theadditional statement 1 is capable of generating the synthesized image that allows an occupant of the vehicle to understand a surrounding circumstance of the vehicle more appropriately when the vehicle travels toward either one of the right and the left (namely, rightward or leftward), compared to an image display apparatus in a comparison example that is configured not to vary the proportion of each of the rear image area and the first rear side image area to the synthesized image on the basis of the first information (namely, in which the proportion of each of the rear image area and the first rear side image area to the synthesized image is fixed).
(5-2)Additional Statement 2
• An image display apparatus according to theadditional statement 2 is the image display apparatus according to theadditional statement 1, wherein the synthesizing device is configured to (alternatively, the controller is programmed to) vary the proportion of the first rear side image area to the synthesized image so that the proportion of the first rear side image area to the synthesized image when the first information shows that the first turn indicator operates is larger than the proportion of the first rear side image area to the synthesized image when the first information shows that the first turn indicator does not operate.
• When the vehicle travels toward either one of the right and the left, it is preferable that the occupant of the vehicle pay more attention to a circumstance at the rear and either one of the right and the left of the vehicle. In the image display apparatus according to theadditional statement 2, the proportion of the first rear side image area to the synthesized image becomes relatively large when the first turn indicator operates. As a result, the occupant of the vehicle can pay more attention to the circumstance at the rear and either one of the right and the left of the vehicle.
(5-3)Additional Statement 3
• An image display apparatus according to theadditional statement 3 is the image display apparatus according to theadditional statement 1 or 2, wherein the synthesizing device is configured to (alternatively, the controller is programmed to) vary the proportion of the first rear side image area to the synthesized image so that the proportion of the first rear side image area to the synthesized image becomes larger as a steered angle of a steered wheel of the vehicle toward either one of the right and the left becomes larger.
• The image display apparatus according to theadditional statement 3 is allowed to adjust the proportion of the first rear side image to the synthesized image on the basis of a progress of the traveling of the vehicle toward either one of the right and the left. Thus, the image display apparatus according to theadditional statement 3 is capable of displaying, in the synthesized image, the first rear side image at a displaying area having an appropriate size based on the progress of the traveling of the vehicle toward either one of the right and the left.
(5-4) Additional Statement 4
• An image display apparatus according to the additional statement 4 is the image display apparatus according to any one of theadditional statements 1 to 3, wherein the synthesizing device is configured to (alternatively, the controller is programmed to) vary the proportion of each of the rear image area and the first rear side image area to the synthesized image on the basis of the first information when a steered angle of a steered wheel of the vehicle toward either one of the right and the left is larger than a predetermined first threshold value, and the synthesizing device is configured not to (alternatively, the controller is programmed not to) vary the proportion of each of the rear image area and the first rear side image area to the synthesized image when the steered angle is smaller than the first threshold value.
• The image display apparatus according to the additional statement 4 is capable of preventing the occupant of the vehicle from being annoyed by an undesired change of a displayed content of the synthesized image.
(5-5) Additional Statement 5
• An image display apparatus according to the additional statement 5 is the image display apparatus according to any one of the additional statements 1 to 4, wherein the synthesizing device is configured to (alternatively, the controller is programmed to) synthesize the rear image, the first rear side image and a second rear side image to generate the synthesized image, wherein the second rear side image is captured by a second rear side imaging device (alternatively, a second rear side imager) that is configured to image a second rear side area located at the rear and the other one of the right and the left of the vehicle, the synthesizing device is configured to (alternatively, the controller is programmed to) vary a proportion of each of the rear image area, the first rear side image area and a second rear side image area to the synthesized image on the basis of the first information and a second information when the synthesizing device (alternatively, the controller) generates the synthesized image, wherein the second rear side image area is an area in which the second rear side image is displayed in the synthesized image and the second information is an information relating to a second turn indicator that is configured to operate to inform that the vehicle travels toward the other one of the right and the left, the synthesizing device is configured to (alternatively, the controller is programmed to) vary the proportion of the second rear side image area to the synthesized image so that the proportion of the second rear side image area to the synthesized image becomes zero when the first information shows that the first turn indicator operates and the second information shows that the second turn indicator does not operate.
• In the image display apparatus according to the additional statement 5, the synthesized image does not include the second rear side area when the first turn indicator operates and the second turn indicator does not operate. As a result, the proportion of the first rear side image area to the synthesized image is allowed to be larger, compared to the case where the proportion of the second rear side image area to the synthesized image does not become zero (namely, the synthesized image includes the second rear side area).
(5-6) Additional Statement 6
• An image display apparatus according to the additional statement 6 is the image display apparatus according to any one of theadditional statements 1 to 5, wherein the synthesizing device (alternatively, the controller is programmed to) vary an image angle of at least one of a first image part and a second image part on the basis of the first information when the synthesizing device (alternatively, the controller) generates the synthesized image, wherein the first image part is an image part that is one portion of the synthesized image and that corresponds to the rear image and the second image part is an image part that is one portion of the synthesized image and that corresponds to the first rear side image.
• The image display apparatus according to the additional statement 6 is capable of generating the synthesized image that allows the occupant of the vehicle to understand the surrounding circumstance of the vehicle more appropriately when the vehicle travels toward either one of the right and the left, compared to an image display apparatus in a comparison example that is configured not to vary the image angle of each of the first image part and the second image part on the basis of the first information (namely, in which the image angle of each of the first image part and the second image part is fixed). Note that the “image angle of a certain image part” in the additional statement means an index value that represents, as an angle from a virtual viewpoint, a range of a scene included in the certain image part displayed by the displaying device or the display.
(5-7) Additional Statement 7
• An image display apparatus according to the additional statement 7 is provided with: a synthesizing device that is configured to synthesize a rear image and a first rear side image to generate a synthesized image, wherein the rear image is captured by a rear imaging device that is configured to image a rear area located at the rear of a vehicle and the first rear side image is captured by a first rear side imaging device that is configured to image a first rear side area located at the rear and either one of the right and the left of the vehicle; and a displaying device that is configured to display the synthesized image, the synthesizing device being configured to vary an image angle of at least one of a first image part and a second image part on the basis of a first information when the synthesizing device generates the synthesized image, wherein the first image part is an image part that is one portion of the synthesized image and that corresponds to the rear image, the second image part is an image part that is one portion of the synthesized image and that corresponds to the first rear side image, and the first information is an information relating to a first turn indicator that is configured to operate to inform that the vehicle travels toward either one of the right and the left.
• Alternatively, an image display apparatus according to the additional statement 7 may be provided with: a controller that is programmed to synthesize a rear image and a first rear side image to generate a synthesized image, wherein the rear image is captured by a rear imager that is configured to image a rear area located at the rear of a vehicle and the first rear side image is captured by a first rear side imager that is configured to image a first rear side area located at the rear and either one of the right and the left of the vehicle; and a display that is configured to display the synthesized image, the controller being programmed to vary an image angle of at least one of a first image part and a second image part on the basis of a first information when the controller generates the synthesized image, wherein the first image part is an image part that is one portion of the synthesized image and that corresponds to the rear image, the second image part is an image part that is one portion of the synthesized image and that corresponds to the first rear side image, and the first information is an information relating to a first turn indicator that is configured to operate to inform that the vehicle travels toward either one of the right and the left.
• The image display apparatus according to the additional statement 7 is capable of generating the synthesized image that allows the occupant of the vehicle to understand the surrounding circumstance of the vehicle more appropriately when the vehicle travels toward either one of the right and the left, compared to the image display apparatus in the comparison example that is configured not to vary the image angle of each of the first image part and the second image part on the basis of the first information.
(5-8)Additional Statement 8
• An image display apparatus according to theadditional statement 8 is the image display apparatus according to the additional statement 6 or 7, wherein the synthesizing device is configured to (alternatively, the controller is programmed to) vary the image angle of the second image part so that the image angle of the second image part when the first information shows that the first turn indicator operates is larger than the image angle of the second image part when the first information shows that the first turn indicator does not operate.
• In the image display apparatus according to theadditional statement 8, the image angle of the second image part becomes relatively large when the first turn indicator operates. If the image angle of the second image part becomes relatively large, the second image part includes the scene spreading in the wider or larger field (namely, a blind area that is not included in the second image part becomes relatively small). As a result, the occupant of the vehicle can pay more attention to the circumstance at the rear and either one of the right and the left of the vehicle. Thus, the image display apparatus is capable of generating the synthesized image that allows the occupant of the vehicle to understand the surrounding circumstance of the vehicle more appropriately when the vehicle travels toward either one of the right and the left.
(5-9) Additional Statement 9
• An image display apparatus according to the additional statement 9 is the image display apparatus according to any one of the additional statements 6 to 8, wherein the synthesizing device is configured to (alternatively, the controller is programmed to) vary the image angle of the second image part so that the image angle of the second image part becomes larger as a steered angle of a steered wheel of the vehicle toward either one of the right and the left becomes larger.
• The image display apparatus according to the additional statement 9 is allowed to adjust the image angle of the second image part on the basis of the progress of the traveling of the vehicle toward either one of the right and the left. Thus, the image display apparatus according to the additional statement 9 is capable of displaying, in the synthesized image, the second image part having an appropriate image angle based on the progress of the traveling of the vehicle toward either one of the right and the left.
(5-10) Additional Statement 10
• An image display apparatus according to the additional statement 10 is the image display apparatus according to any one of the additional statements 6 to 9, wherein the synthesizing device is configured to (alternatively, the controller is programmed to) vary the image angle of at least one of the first image part and the second image part so that the synthesized image generated when the first information shows that the first turn indicator operates includes a second scene that is at either one of the right and the left of a first scene, wherein the first scene is a scene included in the synthesized image generated when the first information shows that the first turn indicator does not operate.
• The image display apparatus according to the additional statement 10 is capable of generating the synthesized image including the second image part that shows the circumstance of a wider or larger field at the rear and either one of the right and the left of the vehicle.
(5-11)Additional Statement 11
• An image display apparatus according to theadditional statement 11 is the image display apparatus according to the additional statement 10, wherein the synthesizing device is configured to (alternatively, the controller is programmed to) vary the image angle of the second image part so that the second scene included in the synthesized image includes a scene that is more distant from the first scene toward either one of the right and the left as a steered angle of a steered wheel of the vehicle toward either one of the right and the left becomes larger.
• The image display apparatus according to theadditional statement 11 is allowed to adjust a range of the scene included in the second image part on the basis of the progress of the traveling of the vehicle toward either one of the right and the left. Thus, the image display apparatus according to theadditional statement 11 is capable of displaying, in the synthesized image, the second image part having an appropriate image angle based on the progress of the traveling of the vehicle toward either one of the right and the left.
(5-12)Additional Statement 12
• An image display apparatus according to theadditional statement 12 is the image display apparatus according to any one of the additional statements 7 to 11, wherein the synthesizing device is configured to (alternatively, the controller may be programmed to) vary the image angle of at least one of the first image part and the second image part on the basis of the first information when a steered angle of a steered wheel of the vehicle toward either one of the right and the left is larger than a predetermined second threshold value, and the synthesizing device is configured not to (alternatively, the controller may be programmed not to) vary the image angle of each of the first image part and the second image part when the steered angle is smaller than the second threshold value.
• The image display apparatus according to theadditional statement 12 is capable of preventing the occupant of the vehicle from being annoyed by the undesired change of the displayed content of the synthesized image. Note that the second threshold value may be same as or different from the above described first threshold value.
(5-13)Additional Statement 13
• An image display apparatus according to the additional statement 13 is the image display apparatus according to any one of the additional statements 6 to 12, wherein the synthesizing device is configured to (alternatively, the controller is programmed to) synthesize the rear image, the first rear side image and a second rear side image to generate the synthesized image, wherein the second rear side image is captured by a second rear side imaging device (alternatively, a second rear side imager) that is configured to image a second rear side area located at the rear and the other one of the right and the left of the vehicle, the synthesizing device is configured to (alternatively, the controller is programmed to) vary an image angle of at least one of the first image part, the second image part area and a third image part on the basis of the first information and a second information, when the synthesizing device (alternatively, the controller) generates the synthesized image, wherein the third image part is an image part that is one portion of the synthesized image and that corresponds to the second rear side image and the second information is an information relating to a second turn indicator that is configured to operate to inform that the vehicle travels toward the other one of the right and the left, the synthesizing device is configured to (alternatively, the controller is programmed to) vary the image angle of the third image part so that the image angle of the third image part becomes zero when the first information shows that the first turn indicator operates and the second information shows that the second turn indicator does not operate.
• As described above, when the first turn indicator operates and the second turn indicator does not operate, it is preferable that the occupant of the vehicle pay more attention to the circumstance at the rear and either one of the right and the left of the vehicle than to the circumstance at the rear and the other one of the right and the left of the vehicle. In the image display apparatus according to theadditional statement 13, the image angle of the third image part becomes zero when the first turn indicator operates and the second turn indicator does not operate. Namely, the synthesized image does not include the second rear side image. As a result, the image angle of the second image part is allowed to be larger, compared to the case where the image angle of the third image part does not become zero (namely, the synthesized image includes the second rear side area). Thus, the image display apparatus is capable of generating the synthesized image that allows the occupant of the vehicle to understand the surrounding circumstance of the vehicle more appropriately when the vehicle travels toward either one of the right and the left.
(5-14)Additional Statement 14
• An image display apparatus according to theadditional statement 14 is the image display apparatus according to any one of the additional statements 7 to 13, the synthesizing device is configured to (alternatively, the controller may be programmed to) vary the image angle of at least one of the first image part and the second image part without varying a proportion of each of a rear image area and a first rear side image area to the synthesized image, wherein the rear image area is an area in which the rear image is displayed in the synthesized image and the first rear side image area is an area in which the first rear side image is displayed in the synthesized image.
(5-15)Additional Statement 15
• An image display apparatus according to theadditional statement 15 is the image display apparatus according to any one of the additional statements 6 to 14, wherein the synthesizing device is configured to (alternatively, the controller is programmed to) extract the first image part that is at least one portion of the rear image and the second image part that is at least one portion of the first rear side image and to generate the synthesized image by synthesizing the first image part and the second image part, the synthesizing device is configured to (alternatively, the controller is programmed to) vary the image angle of at least one of the first image part and the second image part by varying an area in the rear image from which the first image part is extracted and an area in the first rear side image from which the second image part is extracted on the basis of the first information.
(5-16)Additional Statement 16
• An image display apparatus according to theadditional statement 16 is the image display apparatus according to any one of the additional statements 6 to 15, wherein the synthesizing device is configured to vary the image angle of at least one of the first image part and the second image part by controlling at least one of the rear imaging device and the first rear side imaging device on the basis of the first information so that an imaging range of at least one of the rear imaging device and the first rear side imaging device varies.
• Alternatively, an image display apparatus according to theadditional statement 16 may be the image display apparatus according to any one of the additional statements 6 to 15, wherein the controller is programmed to vary the image angle of at least one of the first image part and the second image part by controlling at least one of the rear imager and the first rear side imager on the basis of the first information so that an imaging range of at least one of the rear imager and the first rear side imager varies.
(5-17)Additional Statement 17
• An image display apparatus according to theadditional statement 17 is the image display apparatus according to any one of the additional statements 6 to 16, wherein the vehicle is provided with a plurality of rear imaging devices having different imaging ranges, respectively, the synthesizing device is configured to vary the image angle of the first image part by selecting, as one rear imaging device that should capture the rear image used for generating the synthesized image, one of the plurality of rear imaging devices on the basis of the first information.
• Alternatively, an image display apparatus according to theadditional statement 17 may be the image display apparatus according to any one of the additional statements 6 to 16, wherein the vehicle is provided with a plurality of rear imagers having different imaging ranges, respectively, the controller is programmed to vary the image angle of the first image part by selecting, as one rear imager that should capture the rear image used for generating the synthesized image, one of the plurality of rear imagers on the basis of the first information.
(5-18) Additional Statement 18
• An image display apparatus according to the additional statement 18 is the image display apparatus according to any one of the additional statements 6 to 17, wherein the vehicle is provided with a plurality of first rear side imaging devices having different imaging ranges, respectively, the synthesizing device is configured to vary the image angle of the second image part by selecting, as one first rear side imaging device that should capture the first rear side image used for generating the synthesized image, one of the plurality of first rear side imaging devices on the basis of the first information.
• Alternatively, an image display apparatus according to the additional statement 18 may be the image display apparatus according to any one of the additional statements 6 to 17, wherein the vehicle is provided with a plurality of first rear side imagers having different imaging ranges, respectively, the controller is programmed to vary the image angle of the second image part by selecting, as one first rear side imager that should capture the first rear side image used for generating the synthesized image, one of the plurality of first rear side imagers on the basis of the first information.
• At least one portion of the feature in the above described embodiment and the modified example may be eliminated or modified accordingly. At least one feature in the above described embodiment and the modified example may be combined with another one feature in the above described embodiment and the modified example.
• This application is based upon and claims the benefit of priority of the prior Japanese Patent Application No. 2017-250901, filed on Dec. 27, 2017, the entire contents of which are incorporated herein by reference. In addition, the entire contents of the above describedPatent Literatures 1 to 2 are incorporated herein by reference.
• All examples and conditional language recited herein are intended for pedagogical purposes to aid the reader in understanding the invention and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions, nor does the organization of such examples in the specification relate to a showing of the superiority and inferiority of the invention. Although the embodiments of the present invention have been described in detail, it should be understood that the various changes, substitutions, and alterations could be made hereto without departing from the spirit and scope of the invention. An image display apparatus, which involve such changes, are also intended to be within the technical scope of the present invention.
REFERENCE SIGNS LIST
• 1 vehicle
• 11B rear camera
• 11BL,11BL_N,11BL_L rear left camera
• 11BR,11BR_N,11BR_L rear right camera
• 121 turn indicator
• 121L left turn indicator
• 121R right turn indicator
• 122 steering angle sensor
• 13 ECU
• 131 image collecting unit
• 132 image synthesizing unit
• 14 display
• 111B,112B rear image
• 111BL,112BL rear left image
• 111BR,112BR rear right image
• 111C synthesized image
• IRB, IRB_N, IRBL, IRBL_N, IRBL_L, IRBR, IRBR_N, IRBR_L imaging range
• θB, θBh, θBv rear image angle
• θBL rear left image angle
• θBR rear right image angle
• θB_N, θBL_N, θBR_N normal image angle
• θB_L, θBL_L, θBR_L large image angle
• θB_S, θBL_S, θBR_S small image angle

Claims (6)

1. An image display apparatus comprising:

a controller that is programmed to synthesize a rear image and a rear side image to generate a synthesized image, wherein the rear image is captured by a rear camera, which is configured to capture a rear area located at the rear of a vehicle, wherein the rear side image is captured by a rear side camera, which is configured to capture a rear side area located at the rear and one of the left and the right of the vehicle; and

a display that is configured to display the synthesized image,

the controller that is further programmed to make a first proportion, which is a proportion of the rear side image to the synthesized image in a first state, and a second proportion, which is a proportion of the rear side image to the synthesized image in a second state, be different from each other, wherein the first state is a state in which an occupant of the vehicle intends to drive the vehicle so that the vehicle turns to the one of the left and the right, wherein the second state is a state which is not the first state.

2. The image display apparatus according toclaim 1, wherein the first proportion is larger than the second proportion.

3. The image display apparatus according toclaim 1, wherein the controller is further programmed to:

acquire first information indicating a state of a turn indicator and second information indicating a steering angle, wherein the turn indicator indicates that the vehicle turns to the one of the left and the right,

determine that it is the first state when the first information indicating that the turn indicator operates, and the steering angle indicated by the second information is greater than a predetermined threshold value, and

determine that it is the second state when the first information indicating that the turn indicator operates, and the steering angle indicated by the second information is less than the predetermined threshold value.

4. An image display apparatus comprising:

a controller that is programmed to synthesize a rear image and a rear side image to generate a synthesized image, which includes a first image portion corresponding to the rear image and a second image portion corresponding to the rear side image, wherein the rear image is captured by a rear camera, which is configured to capture a rear area located at the rear of a vehicle, wherein the rear side image is captured by a rear side camera, which is configured to capture a rear side area located at the rear and one of the left and the right of the vehicle; and

a display that is configured to display the synthesized image,

the controller that is further programmed to make a first image angle, which is an image angle of the second image portion of the synthesized image in a first state, and a second image angle, which is an image angle of the second image portion of the synthesized image in a second state, be different from each other, wherein the first state is a state in which an occupant of the vehicle intends to drive the vehicle so that the vehicle turns to the one of the left and the right, wherein the second state is a state which is not the first state.

5. The image display apparatus according toclaim 4, wherein the first image angle is larger than the second image angle.

6. The image display apparatus according toclaim 4, wherein the controller is further programmed to:

acquire first information indicating a state of a turn indicator and second information indicating a steering angle, wherein the turn indicator indicates the vehicle turns to the one of the left and the right,

determine that it is the first state when the first information indicating that the turn indicator operates, and the steering angle indicated by the second information is greater than a predetermined threshold value, and

determine that it is the second state when the first information indicating that the turn indicator operates, and the steering angle indicated by the second information is less than the predetermined threshold value.

Images