TW202008778A - Image display system and image display method - Google Patents

Abstract

An image display system is provided. The image display system includes a control device, an image capturing device, a processor and a display. The control device obtains a control signal. The image capturing device moves to an observation point according to the control signal and captures a first image at the observation point. The processor generates an indoor image based on a three-dimensional (3D) house interior model, an observation position being in the 3D house interior model and corresponding to the observation point, and the first image, where the observation point moves with the observation position in the 3D house interior model synchronously. The display displays the indoor image. In addition, an image display method is also provided.

Description

Translated fromChinese

影像顯示系統與影像顯示方法Image display system and image display method

本發明是有關於一種影像顯示方法，且特別是有關於一種可模擬室內影像的影像顯示系統與影像顯示方法。The present invention relates to an image display method, and particularly to an image display system and image display method that can simulate indoor images.

建商在販售預售屋時常會設立展售中心或接待中心來向客戶展示房屋的環境、建造方式或內外空間等等。一般來說，在製作預售屋模型時建商常會把預售屋隔壁的鄰地以綠地的方式呈現。然而，預售屋隔壁的鄰地可能是同期建案的另一棟大樓、加油站、電塔甚至是墓地，這些可能性都會成為購屋者心中的疑慮。When selling pre-sale houses, builders often set up exhibition and sales centers or reception centers to show customers the environment, construction methods, internal and external spaces, and so on. Generally speaking, when making a pre-sale house model, the builder often presents the neighboring land next to the pre-sale house as a green space. However, the neighboring area next to the pre-sale house may be another building, gas station, electric tower or even a cemetery built during the same period. These possibilities will all become doubts in the minds of home buyers.

除了周圍環境之外，房屋實際建成後的高度、窗外景色與採光都是重要的考量。舉例來說，實際建成後的房屋高度與窗外景色可能與鄰房的棟距有關，而棟距過近容易產生壓迫感。此外，好的採光會提升整體室內的好感度，而不好的採光可能會導致光線不充足或西曬等問題。因此，一種能夠表現出房屋實際建成後，使用者在屋內真實感受的系統，是房屋的買賣雙方所共同追求的目標。In addition to the surrounding environment, the height of the house after the actual completion, the scenery outside the window and the lighting are all important considerations. For example, the height of the house after the actual completion and the scenery outside the window may be related to the distance between the adjacent buildings, and the distance between the buildings is too close to easily produce a sense of oppression. In addition, good lighting will increase the overall favorability of the room, and poor lighting may cause problems such as insufficient light or western sunlight. Therefore, a system that can show the real feelings of the user in the house after the house is actually built is the goal pursued by both the buyer and seller of the house.

有鑑於此，本發明提供一種影像顯示系統與影像顯示方法，能夠模擬出真實的室內影像。In view of this, the present invention provides an image display system and an image display method, which can simulate a real indoor image.

本發明的影像顯示系統，包括控制裝置、影像擷取裝置、處理器以及顯示器。控制裝置取得控制訊號。影像擷取裝置耦接於控制裝置，並根據控制訊號移動至觀察點並且在觀察點擷取第一影像。處理器耦接於影像擷取裝置，並根據立體房屋室內模型、立體房屋室內模型中對應觀察點的觀察位置以及第一影像產生室內影像。顯示器耦接於處理器並顯示室內影像。其中，觀察點與立體房屋室內模型中的觀察位置是同步移動。The image display system of the present invention includes a control device, an image capturing device, a processor and a display. The control device obtains the control signal. The image capturing device is coupled to the control device, and moves to the observation point according to the control signal and captures the first image at the observation point. The processor is coupled to the image capturing device, and generates an indoor image according to the three-dimensional house indoor model, the observation position of the corresponding observation point in the three-dimensional house indoor model, and the first image. The display is coupled to the processor and displays indoor images. Among them, the observation point and the observation position in the indoor model of the three-dimensional house move synchronously.

在本發明的一實施例中，上述的室內影像包括窗戶影像以及非窗戶影像，窗戶影像對應於第一影像，而非窗戶影像對應於立體房屋室內模型。In an embodiment of the invention, the indoor image includes a window image and a non-window image, the window image corresponds to the first image, and the non-window image corresponds to the three-dimensional house indoor model.

在本發明的一實施例中，上述的處理器在產生室內影像時，根據立體房屋室內模型中的窗戶位置以及觀察位置決定立體房屋室內模型的窗戶視野部分與非窗戶視野部分，根據第一影像產生窗戶影像，並且根據非窗戶視野部分產生非窗戶影像。In an embodiment of the present invention, when the above-mentioned processor generates an indoor image, the window view portion and the non-window view portion of the three-dimensional house indoor model are determined according to the window position and the observation position in the three-dimensional house indoor model, based on the first image A window image is generated, and a non-window image is generated based on the non-window field of view.

在本發明的一實施例中，上述的處理器根據時間資訊、影像擷取裝置的當前位置以及立體房屋室內模型中的窗戶位置將室內光線渲染於室內影像中。In an embodiment of the present invention, the aforementioned processor renders the indoor light in the indoor image based on the time information, the current position of the image capturing device, and the window position in the indoor model of the three-dimensional house.

在本發明的一實施例中，上述的控制訊號包括對應觀察點的位置參數以及對應視線角度的角度參數。控制裝置包括定位裝置以及方向感測器，其中定位裝置用以取得位置參數，並且方向感測器用以取得角度參數。In an embodiment of the invention, the above control signal includes a position parameter corresponding to the observation point and an angle parameter corresponding to the line-of-sight angle. The control device includes a positioning device and a direction sensor, wherein the positioning device is used to obtain a position parameter, and the direction sensor is used to obtain an angle parameter.

在本發明的一實施例中，當處理器判斷第一影像中包括另一影像擷取裝置，處理器根據所述另一影像擷取裝置在第一影像中的位置將虛擬人物渲染於室內影像中。In an embodiment of the present invention, when the processor determines that the first image includes another image capturing device, the processor renders the virtual character in the indoor image according to the position of the another image capturing device in the first image in.

本發明的影像顯示方法包括以下步驟：取得控制訊號；根據控制訊號控制影像擷取裝置移動至觀察點；利用影像擷取裝置在觀察點擷取第一影像；根據立體房屋室內模型、立體房屋室內模型中對應觀察點的觀察位置以及第一影像產生室內影像，其中觀察點與觀察位置同步移動；以及顯示室內影像。The image display method of the present invention includes the following steps: obtaining a control signal; controlling the image capturing device to move to the observation point according to the control signal; using the image capturing device to capture the first image at the observation point; according to the three-dimensional house interior model, the three-dimensional house interior The observation position and the first image of the corresponding observation point in the model generate an indoor image, wherein the observation point moves synchronously with the observation position; and the indoor image is displayed.

在本發明的一實施例中，上述的室內影像包括窗戶影像以及非窗戶影像，窗戶影像對應於第一影像，並且非窗戶影像對應於立體房屋室內模型。In an embodiment of the present invention, the indoor image includes a window image and a non-window image, the window image corresponds to the first image, and the non-window image corresponds to the indoor model of the three-dimensional house.

在本發明的一實施例中，上述的根據立體房屋室內模型、立體房屋室內模型中對應觀察點的觀察位置以及第一影像產生室內影像的步驟包括：根據立體房屋室內模型中的窗戶位置以及觀察位置決定立體房屋室內模型的窗戶視野部分與非窗戶視野部分；根據第一影像產生窗戶影像；以及根據非窗戶視野部分產生非窗戶影像。In an embodiment of the present invention, the step of generating an indoor image based on the three-dimensional house indoor model, the observation position of the corresponding observation point in the three-dimensional house indoor model, and the first image includes: according to the window position and observation in the three-dimensional house indoor model The position determines the window view portion and the non-window view portion of the three-dimensional house interior model; the window image is generated based on the first image; and the non-window image is generated based on the non-window view portion.

在本發明的一實施例中，上述的影像顯示方法更包括：根據時間資訊、影像擷取裝置的當前位置以及立體房屋室內模型中的窗戶位置將室內光線渲染於該室內影像中。In an embodiment of the invention, the above image display method further includes: rendering indoor light in the indoor image based on time information, the current position of the image capture device, and the window position in the indoor model of the three-dimensional house.

在本發明的一實施例中，上述的控制訊號包括對應觀察點的位置參數以及對應視線角度的角度參數，其中取得控制訊號的步驟包括：利用定位裝置取得位置參數；以及利用方向感測器取得角度參數。In an embodiment of the invention, the above control signal includes a position parameter corresponding to the observation point and an angle parameter corresponding to the line-of-sight angle, wherein the step of obtaining the control signal includes: using a positioning device to obtain the position parameter; and using a direction sensor to obtain Angle parameter.

在本發明的一實施例中，上述的影像顯示方法更包括：判斷第一影像中是否包括另一影像擷取裝置；以及當第一影像中包括另一影像擷取裝置，根據所述另一影像擷取裝置在第一影像中的位置將虛擬人物渲染於室內影像中。In an embodiment of the invention, the above image display method further includes: determining whether the first image includes another image capturing device; and when the first image includes another image capturing device, according to the other The position of the image capturing device in the first image renders the virtual character in the indoor image.

基於上述，本發明實施例所提出的影像顯示系統與影像顯示方法利用控制裝置來控制影像擷取裝置取得觀察點的實際影像，在合成實際影像與立體房屋室內模型以產生室內影像。據此，能夠模擬出在觀察點看到的實際景象。Based on the above, the image display system and the image display method proposed in the embodiments of the present invention use the control device to control the image capture device to obtain the actual image of the observation point, and then synthesize the actual image and the three-dimensional house indoor model to generate the indoor image. According to this, the actual scene seen at the observation point can be simulated.

為讓本發明的上述特徵和優點能更明顯易懂，下文特舉實施例，並配合所附圖式作詳細說明如下。In order to make the above-mentioned features and advantages of the present invention more obvious and understandable, the embodiments are specifically described below in conjunction with the accompanying drawings for detailed description as follows.

圖1繪示本發明一實施例中影像顯示系統的概要方塊圖；圖2繪示本發明一實施例中影像顯示系統的使用情境示意圖。FIG. 1 is a schematic block diagram of an image display system in an embodiment of the present invention; FIG. 2 is a schematic diagram of usage scenarios of the image display system in an embodiment of the present invention.

請參照圖1與圖2，影像顯示系統100包括控制裝置110、影像擷取裝置120、處理器130以及顯示器140。在一些實施例中，控制裝置110、處理器130以及顯示器140位於展售中心SC，影像擷取裝置120位於建築預定地BD_RSV上方。使用者USR可在展售中心SC透過控制裝置110來控制其在模擬蓋好後的預售屋（例如採三維建模方式，以建立立體房屋）中的觀察位置與視線角度，透過影像擷取裝置120與處理器130的協作，顯示器140會對應地顯示出在蓋好後的預售屋中，從所述觀察位置與視線角度所能觀看到的室內影像。由於立體房屋室內模型可以包括不同的室內裝潢，且具體應用可根據實際情況進行配置，並可用不同方式取得，故在此不贅述。然而，本發明並不限於上述實施例的使用情境。1 and 2, theimage display system 100 includes acontrol device 110, animage capture device 120, aprocessor 130, and adisplay 140. In some embodiments, thecontrol device 110, theprocessor 130, and thedisplay 140 are located in the exhibition and sales center SC, and the image capturingdevice 120 is located above the predetermined building site BD_RSV. The user USR can use thecontrol device 110 in the exhibition and sales center SC to control the observation position and line-of-sight angle in the simulated pre-sale house (for example, adopting a three-dimensional modeling method to create a three-dimensional house) through image capture. With the cooperation of thedevice 120 and theprocessor 130, thedisplay 140 will correspondingly display the indoor image that can be viewed from the viewing position and line of sight in the pre-sold house after the cover is built. Since the interior model of the three-dimensional house can include different interior decorations, and the specific application can be configured according to the actual situation, and can be obtained in different ways, it will not be repeated here. However, the present invention is not limited to the usage scenarios of the above embodiments.

控制裝置110耦接於影像擷取裝置120，用以接收和傳送控制訊號S，以控制影像擷取裝置120移動到指定的觀察點來拍攝影像。在一些實施例中，控制訊號S包括用以控制使用者USR所欲觀看的位置的位置參數，位置參數例如包括樓層參數與屋內觀察位置的二維座標參數等。當使用者USR透過控制裝置110輸入樓層參數來調整其所欲觀看的樓層時，影像擷取裝置120會移動到建築預定地BD_RSV上方對應於該樓層的高度；當使用者USR透過控制裝置110輸入座標參數來在特定樓層中移動觀察位置時，影像擷取裝置120會固定高度地在建築預定地BD_RSV上方對應地平移位置。在一些實施例中，控制訊號S更包括用以控制使用者USR的視線角度的角度參數。當使用者USR透過控制裝置110輸入角度參數來調整其所欲觀看的視線角度時，影像擷取裝置120則會對應地轉動。然而，本發明並不在此限制用以控制影像擷取裝置120移動或轉動的控制參數的具體型式。在其他實施例中，控制訊號S亦可例如是僅包括一個經度、緯度與高度的三維座標參數。Thecontrol device 110 is coupled to the image capturingdevice 120 for receiving and transmitting the control signal S to control the image capturingdevice 120 to move to a designated observation point to capture an image. In some embodiments, the control signal S includes position parameters for controlling the position that the user USR wants to view. The position parameters include, for example, floor parameters and two-dimensional coordinate parameters of the observation position in the room. When the user USR inputs the floor parameters through thecontrol device 110 to adjust the floor he wants to view, theimage capture device 120 will move to the height of the floor above the predetermined building site BD_RSV; when the user USR inputs through thecontrol device 110 When the coordinate parameter is used to move the observation position on a specific floor, the image capturingdevice 120 will shift the position correspondingly above the predetermined building location BD_RSV at a fixed height. In some embodiments, the control signal S further includes an angle parameter used to control the line-of-sight angle of the user USR. When the user USR inputs the angle parameter through thecontrol device 110 to adjust the line-of-sight angle he wants to view, the image capturingdevice 120 will rotate accordingly. However, the present invention does not limit the specific types of control parameters used to control the movement or rotation of the image capturingdevice 120 here. In other embodiments, the control signal S may also include a three-dimensional coordinate parameter including only one longitude, latitude, and altitude.

在一些實施例中，控制裝置110包括輸入裝置，例如鍵盤、滑鼠、搖桿、麥克風或觸控式螢幕等，使用者USR可使用輸入裝置來控制其所欲觀看的樓層、觀察位置或視線角度，而影像擷取裝置120則會對應地移動或轉動。In some embodiments, thecontrol device 110 includes an input device, such as a keyboard, a mouse, a joystick, a microphone, or a touch screen. The user USR can use the input device to control the floor, observation position, or line of sight that he wants to watch Angle, and theimage capture device 120 will move or rotate accordingly.

在一些實施例中，控制裝置110包括定位裝置以及方向感測器等，其中定位裝置用以偵測使用者USR在展售中心SC中的位置與高度，而方向感測器用以偵測使用者USR的朝向（orientation）。在一些實施例中，定位裝置例如是包括設置在展售中心的多個影像擷取裝置以及處理器，藉由多個影像擷取裝置所擷取包括使用者USR的影像以及各個影像擷取裝置的位置，處理器便能夠計算得到使用者USR在展售中心SC中的位置與高度，以取得位置參數。舉例來說，當使用者USR在展售中心SC從樓層F1移動到樓層F2時，定位裝置可以取得位置參數，進而控制影像擷取裝置120從對應於樓層F1的高度移動到對應於樓層F2的高度。在一些實施例中，方向感測器例如是以陀螺儀來實作，當使用者將方向感測器配戴在身上並旋轉時，陀螺儀便能夠取得角度參數。在一些實施例中，定位裝置與方向感測器例如是以九軸感測器來實作，當使用者USR將九軸感測器配戴在身上並在展售中心SC中移動或轉動時，九軸感測器便能夠根據使用者USR的移動或轉動來提供位置參數或角度參數。然而，本發明並不限於此。In some embodiments, thecontrol device 110 includes a positioning device and a direction sensor, etc., wherein the positioning device is used to detect the position and height of the user USR in the exhibition center SC, and the direction sensor is used to detect the user The orientation of the USR. In some embodiments, the positioning device includes, for example, a plurality of image capturing devices and a processor disposed in the exhibition and sales center, and the images including the user USR and each image capturing device captured by the plurality of image capturing devices The processor can calculate the position and height of the user USR in the exhibition and sales center SC to obtain the position parameter. For example, when the user USR moves from floor F1 to floor F2 in the exhibition and sales center SC, the positioning device can obtain position parameters, and then control the image capturingdevice 120 to move from the height corresponding to floor F1 to the floor F2. height. In some embodiments, the direction sensor is implemented as a gyroscope, for example. When the user wears the direction sensor on the body and rotates it, the gyroscope can obtain the angle parameter. In some embodiments, the positioning device and the direction sensor are implemented as a nine-axis sensor, for example, when the user USR wears the nine-axis sensor on his body and moves or rotates in the exhibition center SC , The nine-axis sensor can provide position parameters or angle parameters according to the movement or rotation of the user USR. However, the present invention is not limited to this.

影像擷取裝置120耦接於處理器130，用以取得其視野範圍內的影像，並且將其所取得的影像傳送至處理器130。在一些實施例中，影像擷取裝置120例如以無人機來實作，無人機受控制裝置110的控制而可移動到指定的觀察點OB以在該處取得影像。在一些實施例中，影像擷取裝置120例如是以無人機搭載全景攝像機，用以根據控制訊號移動到指定觀察點OB取得全視角影像。而在一些實施例中，例如可以是以無人機搭載旋轉平台與非全景攝像機，用以根據控制訊號移動到指定觀察點OB，並且轉動到指定角度來取得非全視角的影像。Theimage capture device 120 is coupled to theprocessor 130 for obtaining images within its field of view and transmitting the images obtained to theprocessor 130. In some embodiments, the image capturingdevice 120 is implemented by a drone, for example, and the drone can be moved to a designated observation point OB under the control of thecontrol device 110 to obtain an image there. In some embodiments, the image capturingdevice 120 is, for example, a panoramic camera equipped with an unmanned aerial vehicle, which is used to move to a designated observation point OB according to the control signal to obtain a full-view image. In some embodiments, for example, a UAV equipped with a rotating platform and a non-panoramic camera may be used to move to a specified observation point OB according to the control signal and rotate to a specified angle to obtain a non-full-view image.

處理器130耦接於顯示器140，其可例如是中央處理單元（Central Processing Unit，CPU），或是其他可程式化之一般用途或特殊用途的微處理器（Microprocessor）、數位訊號處理器（Digital Signal Processor，DSP）、可程式化控制器、特殊應用積體電路（Application Specific Integrated Circuits，ASIC）、可程式化邏輯裝置（Programmable Logic Device，PLD）或其他類似裝置或這些裝置的組合，用以接收來自影像擷取裝置120的影像，並且進行計算以將該影像與立體房屋室內模型進行結合，以模擬出較貼近真實環境的室內影像。Theprocessor 130 is coupled to thedisplay 140, and may be, for example, a central processing unit (Central Processing Unit, CPU), or other programmable general-purpose or special-purpose microprocessor (Microprocessor), digital signal processor (Digital signal processor) Signal Processor (DSP), programmable controller, application specific integrated circuits (ASIC), programmable logic device (Programmable Logic Device, PLD) or other similar devices or a combination of these devices for The image from the image capturingdevice 120 is received, and calculation is performed to combine the image with the indoor model of the three-dimensional house to simulate an indoor image closer to the real environment.

顯示器140包括多個顯示像素，其例如是液晶顯示器（Liquid-Crystal Display，LCD）、發光二極體（Light-Emitting Diode，LED）顯示器或其他合適種類的顯示器，用以接收來自處理器130的訊號以顯示二維或三維的室內影像，本發明不在此限。Thedisplay 140 includes a plurality of display pixels, such as a liquid crystal display (Liquid-Crystal Display, LCD), a light-Emitting Diode (LED) display, or other suitable types of displays, for receiving from theprocessor 130 The signal is used to display two-dimensional or three-dimensional indoor images, and the invention is not limited to this.

在一些實施例中，控制裝置100、影像擷取裝置120、處理器130以及顯示器140例如分別實作成獨立的裝置。在一些實施例中，顯示器140例如是與控制裝置110、處理器130整合來實作為移動式電子裝置，例如，以智慧型手機的應用程式來實作。在一些實施例中，顯示器140例如是與控制裝置110整合來實作為頭戴式顯示器，例如，將九軸感測器整合在頭戴式顯示器中。然而，本發明並不限制影像顯示系統100的具體實作方式。In some embodiments, thecontrol device 100, the image capturingdevice 120, theprocessor 130, and thedisplay 140 are implemented as independent devices, for example. In some embodiments, thedisplay 140 is, for example, integrated with thecontrol device 110 and theprocessor 130 to be implemented as a mobile electronic device, for example, implemented as an application of a smart phone. In some embodiments, thedisplay 140 is integrated with thecontrol device 110 as a head-mounted display, for example, a nine-axis sensor is integrated in the head-mounted display. However, the present invention does not limit the specific implementation of theimage display system 100.

圖3繪示本發明一實施例中影像顯示方法的流程圖。FIG. 3 is a flowchart of an image display method in an embodiment of the invention.

圖3實施例中的影像顯示方法可藉由圖1實施例中的影像顯示系統100的各項元件來協作完成，故以下將引用影像顯示系統100的各項元件來說明本實施例的影像顯示方法。The image display method in the embodiment of FIG. 3 can be completed by the various components of theimage display system 100 in the embodiment of FIG. 1, so the following will refer to the various components of theimage display system 100 to explain the image display of this embodiment method.

在步驟S110中，控制裝置110會收發控制訊號S。控制裝置110取得控制訊號S的細節已於前述段落舉實施例說明，故以下不再重複贅述。在步驟S120中，影像擷取裝置120會根據控制訊號S移動至觀察點OB，並且在步驟S130中，影像擷取裝置120會在觀察點OB擷取第一影像IMG1。在步驟S140中，處理器130會根據立體房屋室內模型、立體房屋室內模型中對應觀察點OB的觀察位置OB’以及第一影像IMG1來產生結合室外真實環境影像的室內影像。在步驟S150中，顯示器140會顯示該室內影像，以讓使用者USR能看到更貼近真實的樣貌。In step S110, thecontrol device 110 sends and receives the control signal S. The details of thecontrol device 110 obtaining the control signal S have been described in the foregoing paragraphs by way of examples, so the details will not be repeated below. In step S120, theimage capturing device 120 moves to the observation point OB according to the control signal S, and in step S130, theimage capturing device 120 captures the first image IMG1 at the observation point OB. In step S140, theprocessor 130 generates an indoor image combined with an outdoor real environment image according to the three-dimensional house indoor model, the observation position OB' corresponding to the observation point OB in the three-dimensional house indoor model, and the first image IMG1. In step S150, thedisplay 140 displays the indoor image, so that the user USR can see a closer appearance.

在一些實施例中，立體房屋室內模型例如是不包括家具或擺設的室內格局的立體模型。在一些實施例中，立體房屋室內模型例如是包括家具及擺設的立體模型。值得一提的是，本發明並不在此限制立體房屋室內模型的細節與來源，應用本發明者可依其需求來實作之。舉例而言，立體房屋室內模型可以是唯一記錄在儲存裝置（未繪示）中，也可以是對應於不同位置參數而記錄有多個立體房屋室內模型在儲存裝置中。例如，多個第一位置參數對應於第一立體房屋室內模型，而多個第二位置參數對應於第二立體房屋室內模型等等。舉另一例而言，立體房屋室內模型可以是處理器130透過網路模組（未繪示）來下載得到。In some embodiments, the three-dimensional house interior model is, for example, a three-dimensional model that does not include furniture or furnishings. In some embodiments, the three-dimensional house interior model is, for example, a three-dimensional model including furniture and furnishings. It is worth mentioning that the present invention does not limit the details and sources of the interior model of the three-dimensional house here, and the present inventors can implement it according to their needs. For example, the indoor model of the three-dimensional house may be uniquely recorded in the storage device (not shown), or a plurality of indoor models of the three-dimensional house may be recorded in the storage device corresponding to different location parameters. For example, multiple first position parameters correspond to the first three-dimensional house indoor model, while multiple second position parameters correspond to the second three-dimensional house indoor model, and so on. For another example, the interior model of the three-dimensional house may be downloaded by theprocessor 130 through a network module (not shown).

此外，值得一提的是，指定的觀察點OB對應於在立體房屋室內模型中的觀察位置OB’。舉例來說，當觀察點OB位於預售屋蓋好後，樓層F2的大門入口時，觀察位置OB’會位於對應樓層F2的立體房屋室內模型中的大門入口處。此外，使用者USR在透過控制裝置110控制立體房屋室內模型中的觀察位置OB’時，影像擷取裝置120會跟著移動到對應的觀察點OB。因此，在立體房屋室內模型中的觀察位置OB’與觀察點OB是同步地移動。In addition, it is worth mentioning that the designated observation point OB corresponds to the observation position OB' in the indoor model of the three-dimensional house. For example, when the observation point OB is located at the gate entrance of the floor F2 after the pre-sale roof is built, the observation position OB' will be located at the gate entrance in the interior model of the three-dimensional house corresponding to the floor F2. In addition, when the user USR controls the observation position OB' in the indoor model of the three-dimensional house through thecontrol device 110, theimage capturing device 120 will move to the corresponding observation point OB accordingly. Therefore, the observation position OB' in the three-dimensional house indoor model moves in synchronization with the observation point OB.

以下將舉實施例說明處理器130產生室內影像的方式。為了方便表示，圖 4到圖6中將以二維的橫切面來表示立體房屋室內模型。Hereinafter, an embodiment will be used to describe the manner in which theprocessor 130 generates an indoor image. For convenience of presentation, FIGS. 4 to 6 will represent the three-dimensional house interior model in a two-dimensional cross section.

圖4繪示本發明一實施例中產生室內影像的示意圖。FIG. 4 illustrates a schematic diagram of generating indoor images in an embodiment of the invention.

在一些實施例中，影像擷取裝置120例如搭載全景攝像機的無人機。影像擷取裝置120會根據控制訊號S移動到指定的觀察點OB擷取全視角影像作為第一影像IMG1。In some embodiments, theimage capturing device 120 is, for example, a drone equipped with a panoramic camera. Theimage capturing device 120 moves to the designated observation point OB according to the control signal S to capture a full-view image as the first image IMG1.

如圖4所示，處理器130例如根據立體房屋室內模型sect中的觀察位置OB’與窗戶位置W1、W2、W3，將立體房屋室內模型sect區分為窗戶視野部份R1與非窗戶視野部份R2。詳細來說，在觀察位置OB’朝向窗戶視野部分R1的任一處看去的視線都能夠看到窗戶位置W1、W2、W3，而不會被其他障礙物所阻擋；而在觀察位置OB’朝向非窗戶視野部分R2的任一處看去的視線都無法看到窗戶位置W1、W2、W3，可能是因為該方向沒有窗戶或是被立體房屋室內模型的家具、擺設或格局所阻擋。隨後，處理器130會計算觀察點OB與觀察位置OB’重合，且第一影像IMG1的朝向對齊立體房屋室內模型sect的朝向時，將非窗戶視野部分R2投影並疊加到第一影像IMG1上所產生的第二影像IMG2。更明確地說，所產生的第二影像IMG2也是全視角影像，且其中包括原第一影像IMG1所構成的窗戶影像以及立體房屋室內模型sect的非窗戶視野部分所構成的非窗戶影像。接著，處理器130會根據控制訊號S中的角度參數，來從第二影像IMG2中擷取出對應於視野範圍FOV的部分影像以作為室內影像，以提供顯示器140來顯示。As shown in FIG. 4, theprocessor 130 divides the three-dimensional house indoor model sect into a window view part R1 and a non-window view part according to the observation position OB′ and the window positions W1, W2, W3 in the three-dimensional house indoor model sect, for example R2. In detail, the line of sight looking at any position of the window view portion R1 at the observation position OB' can see the window positions W1, W2, W3 without being blocked by other obstacles; while at the observation position OB' The line of sight towards any part of the non-window field of view R2 cannot see the window positions W1, W2, W3, possibly because there is no window in this direction or it is blocked by the furniture, furnishings or layout of the three-dimensional house interior model. Subsequently, when theprocessor 130 calculates that the observation point OB coincides with the observation position OB', and the orientation of the first image IMG1 is aligned with the orientation of the three-dimensional house interior model sect, the non-window view portion R2 is projected and superimposed on the first image IMG1. The generated second image IMG2. More specifically, the generated second image IMG2 is also a full-view image, and includes the window image formed by the original first image IMG1 and the non-window image formed by the non-window view portion of the three-dimensional house interior model sect. Then, theprocessor 130 extracts a part of the image corresponding to the FOV of the field of view from the second image IMG2 according to the angle parameter in the control signal S as an indoor image to provide thedisplay 140 for display.

明確地說，上述的視野範圍FOV例如是顯示器140所顯示的室內影像的視野範圍。因此，視野範圍FOV的尺寸是關聯於顯示器140的規格，而視野範圍FOV的方向則是關聯於角度參數。如此一來，使用者可以藉由調整角度參數來控制視野範圍FOV的方向，進而看到不同的室內影像。Specifically, the aforementioned field of view FOV is, for example, the field of view of the indoor video displayed on thedisplay 140. Therefore, the size of the field of view FOV is related to the specifications of thedisplay 140, and the direction of the field of view FOV is related to the angle parameter. In this way, the user can control the direction of the FOV of the field of view by adjusting the angle parameter, and then see different indoor images.

圖5繪示本發明第二實施例中產生室內影像的示意圖。FIG. 5 illustrates a schematic diagram of generating indoor images in the second embodiment of the present invention.

在一些實施例中，影像擷取裝置120例如為搭載全景攝像機的無人機。影像擷取裝置120會根據控制訊號S移動到指定的觀察點OB擷取全視角影像作為第一影像IMG1。In some embodiments, theimage capturing device 120 is, for example, a drone equipped with a panoramic camera. Theimage capturing device 120 moves to the designated observation point OB according to the control signal S to capture a full-view image as the first image IMG1.

如圖5所示，處理器130例如會先根據控制訊號S中的角度參數，來從第一影像IMG1中擷取出對應於視野範圍FOV的部分影像。隨後，將觀察點OB與觀察位置OB’重合，並且使第一影像IMG1的朝向對齊立體房屋室內模型sect的朝向後，再根據立體房屋室內模型sect中的觀察位置OB’、窗戶位置W1、W2、W3以及視野範圍FOV來取得立體房屋室內模型sect的窗戶視野部份R1與非窗戶視野部份R2。最後，將上述的立體房屋室內模型sect的非窗戶視野部分R2投影並疊加到從第一影像IMG1擷取的對應於視野範圍FOV的部分影像上，以形成室內影像，以供顯示器140顯示。詳細來說，室內影像中包括部分的第一影像IMG1所構成的窗戶影像以及立體房屋室內模型sect的非窗戶視野部分R2所構成的非窗戶影像。As shown in FIG. 5, theprocessor 130 first extracts a partial image corresponding to the FOV of the field of view from the first image IMG1 according to the angle parameter in the control signal S, for example. Subsequently, after observing the observation point OB and the observation position OB', and aligning the orientation of the first image IMG1 with the orientation of the three-dimensional house indoor model sect, then according to the observation position OB' and the window positions W1 and W2 in the three-dimensional house indoor model sect , W3 and FOV to obtain the window view part R1 and the non-window view part R2 of the three-dimensional house interior model sect. Finally, the non-window view part R2 of the above-mentioned three-dimensional house interior model sect is projected and superimposed on the part image corresponding to the view range FOV captured from the first image IMG1 to form an indoor image for display by thedisplay 140. In detail, the indoor image includes a window image formed by a part of the first image IMG1 and a non-window image formed by the non-window view portion R2 of the three-dimensional house indoor model sect.

圖6繪示本發明第三實施例中產生室內影像的示意圖。FIG. 6 is a schematic diagram of generating indoor images in the third embodiment of the present invention.

在一些實施例中，影像擷取裝置120例如為搭載旋轉平台與非全景的攝像機的無人機。影像擷取裝置120會根據控制訊號S的位置參數移動到指定的觀察點OB，並利用旋轉平台根據控制訊號S的角度參數旋轉到特定角度（例如，使用者USR的視線角度）來擷取非全視角的第一影像IMG1。In some embodiments, theimage capturing device 120 is, for example, a drone equipped with a rotating platform and a non-panoramic camera. Theimage capturing device 120 will move to the designated observation point OB according to the position parameter of the control signal S, and use the rotating platform to rotate to a specific angle (for example, the line-of-sight angle of the user USR) according to the angle parameter of the control signal S to capture Full-view first image IMG1.

圖6的非全視角的第一影像IMG1例如相同於圖5實施例中從第一影像IMG1所擷取的對應於視野範圍FOV的部分影像，而圖6中的非全視角的第一影像IMG1的影像範圍則例如為視野範圍FOV。如圖6所示，處理器130會使第一影像IMG1的朝向對齊立體房屋室內模型sect的朝向後，再根據立體房屋室內模型sect中的觀察位置OB’、窗戶位置W1、W2、W3以及視野範圍FOV來取得立體房屋室內模型sect中的窗戶視野部份R1與非窗戶視野部份R2。最後，將上述的立體房屋室內模型sect的非窗戶視野部分R2投影並疊加到第一影像IMG1上，以形成室內影像，以供顯示器140顯示。詳細來說，室內影像中包括部分的第一影像IMG1所構成的窗戶影像以及立體房屋室內模型sect的非窗戶視野部分R2所構成的非窗戶影像。The non-full-view first image IMG1 of FIG. 6 is, for example, the same as the partial image captured from the first image IMG1 in the embodiment of FIG. 5 corresponding to the field of view FOV, and the non-full-view first image IMG1 of FIG. 6 The image range of is for example the field of view FOV. As shown in FIG. 6, theprocessor 130 aligns the orientation of the first image IMG1 with the orientation of the three-dimensional house indoor model sect, and then according to the observation position OB', the window positions W1, W2, W3 and the field of view in the three-dimensional house indoor model sect Scope FOV to obtain the window view part R1 and the non-window view part R2 in the three-dimensional house interior model sect. Finally, the non-window view portion R2 of the three-dimensional house indoor model sect is projected and superimposed on the first image IMG1 to form an indoor image for display by thedisplay 140. In detail, the indoor image includes a window image formed by a part of the first image IMG1 and a non-window image formed by the non-window view portion R2 of the three-dimensional house indoor model sect.

如此一來，顯示器140能夠同時以立體房屋室內模型來顯示出室內影像中非窗戶影像的部分，以及以影像擷取裝置120所拍攝的第一影像IMG1來顯示出室內影像中窗戶影像的部分。In this way, thedisplay 140 can simultaneously display the non-window image part of the indoor image with the three-dimensional house indoor model, and the window image part of the indoor image with the first image IMG1 captured by theimage capturing device 120.

在一些實施例中，在建立室內影像時，處理器130會先根據時間資訊、影像擷取裝置120的當前位置以及立體房屋室內模型中的窗戶位置來將光線渲染於室內影像中。In some embodiments, when creating an indoor image, theprocessor 130 first renders the light in the indoor image according to the time information, the current position of theimage capturing device 120, and the window position in the indoor model of the three-dimensional house.

舉例來說，處理器130會根據當前時間或使用者USR所輸入的時間來取得時間資訊，並且根據位置參數或設置於影像擷取裝置120的定位系統（例如但不限於，全球定位系統）來取得影像擷取裝置120的當前位置。據此，處理器130便能夠估算出對應於時間資訊與影像擷取裝置120的當前位置的日照方向，並進一步使用光線追蹤（ray tracing）等演算法來根據日照方向以及立體房屋室內模型中的窗戶位置來將光線渲染於立體房屋室內模型中，例如改變立體房屋室內模型的色溫、產生立體房屋室內模型中的光影等等。接著，處理器130可例如再根據圖4至圖6實施例所介紹的方法，來使用加入光線後的立體房屋室內模型產生室內影像，以貼近真實的日照情況。For example, theprocessor 130 obtains time information according to the current time or the time entered by the user USR, and according to position parameters or a positioning system (such as, but not limited to, a global positioning system) installed in theimage capturing device 120 Obtain the current position of theimage capturing device 120. According to this, theprocessor 130 can estimate the sunshine direction corresponding to the time information and the current position of theimage capturing device 120, and further use algorithms such as ray tracing to determine the sunshine direction and the indoor model of the three-dimensional house according to the sunshine direction The position of the window is used to render light in the interior model of the three-dimensional house, for example, to change the color temperature of the interior model of the three-dimensional house, to generate light and shadow in the interior model of the three-dimensional house, and so on. Then, theprocessor 130 may use, for example, the method described in the embodiments of FIG. 4 to FIG. 6 to generate an indoor image using the indoor model of the three-dimensional house after adding the light, so as to be close to the real sunshine situation.

在一些實施例中，處理器130更判斷影像擷取裝置110 所拍攝的第一影像IMG1中是否有其他影像擷取裝置。若有，則根據第一影像IMG1中的其他影像擷取裝置在第一影像IMG1中的位置，決定是否將虛擬人物渲染於室內影像中。In some embodiments, theprocessor 130 further determines whether there is another image capturing device in the first image IMG1 captured by theimage capturing device 110. If so, it is determined whether to render the virtual character in the indoor image based on the position of the other image capturing device in the first image IMG1 in the first image IMG1.

圖7繪示本發明一實施例中影像擷取裝置拍攝到另一影像擷取裝置的示意圖。7 is a schematic diagram of another image capturing device captured by the image capturing device in an embodiment of the invention.

請參照圖7，當影像擷取裝置120所拍攝的第一影像IMG1中出現另一台影像擷取裝置120’時，表示可能有另一個使用者USR’也正在觀看對應同一個建築預定地BD_RSV的房屋的室內影像，也就是有另外一個使用者USR’也一起在看同一間房屋。Please refer to FIG. 7, when another image capturing device 120' appears in the first image IMG1 captured by theimage capturing device 120, it means that another user USR' may be watching the corresponding building BD_RSV The indoor image of the house, that is, another user USR' is looking at the same house together.

因此，在一些實施例中，處理器130例如會判斷所述另一台影像擷取裝置120’是否進入第一影像IMG1中對應視野範圍FOV的部分，若是，則在室內影像中對應所述另一台影像擷取裝置120’的位置渲染上虛擬人物，以覆蓋另一台影像擷取裝置120’的影像並且模擬出其他使用者正在一起看屋的效果。Therefore, in some embodiments, theprocessor 130 may determine, for example, whether the other image capturing device 120' enters the portion of the first image IMG1 corresponding to the field of view FOV, and if so, corresponds to the other image in the indoor image A virtual character is rendered at the position of one image capturing device 120' to cover the image of another image capturing device 120' and simulate the effect that other users are watching the house together.

以圖4實施例為例，如前段落所述，處理器130例如會根據控制訊號S中的角度參數來擷取出第一影像IMG1中對應於視野範圍FOV的部分。當另一影像擷取裝置120’ 出現在全視角的第一影像IMG1的某一位置，且此位置位於第一影像IMG1中對應於視野範圍FOV的部分內（例如，第一影像IMG1中對應於視野範圍FOV部分的正中央），處理器130便會根據所述另一影像擷取裝置120’在第一影像IMG1中的位置，將虛擬人物渲染到室內影像中對應的位置（例如，室內影像的正中央）。Taking the embodiment of FIG. 4 as an example, as described in the previous paragraph, theprocessor 130 may extract the portion of the first image IMG1 corresponding to the FOV of the field of view according to the angle parameter in the control signal S, for example. When another image capturing device 120' appears at a position of the first image IMG1 in full view, and this position is located in the portion of the first image IMG1 corresponding to the field of view FOV (for example, the first image IMG1 corresponds to The center of the FOV part of the field of view), theprocessor 130 will render the virtual character to the corresponding position in the indoor image (eg, indoor image) according to the position of the other image capturing device 120' in the first image IMG1 Right in the center).

綜上所述，本發明實施例所提出的影像顯示系統與影像顯示方法利用控制裝置來控制影像擷取裝置取得觀察點的實際影像，再合成實際影像與立體房屋室內模型以產生室內影像，因此能夠模擬出在觀察點看到的實際景象。在本發明的一些實施例中，更根據當前的日照資訊將窗外的光線渲染到室內影像中，以模擬出更加真實地具光影的室內影像。此外，在本發明的一些實施例中，更將所拍攝到的另一台影像擷取裝置模擬為虛擬人物，因此能夠避免在室內影像中突兀地出現另一台影像擷取裝置，使室內影像更加自然。基於本發明的數個實施例，消費者得以享受由擴增實境（Augmented Reality，AR）技術來實現的「遠端看屋」的良好體驗。In summary, the image display system and the image display method proposed in the embodiments of the present invention use the control device to control the image capture device to obtain the actual image of the observation point, and then synthesize the actual image and the three-dimensional house indoor model to generate the indoor image, so Can simulate the actual scene seen at the observation point. In some embodiments of the present invention, the light outside the window is rendered into the indoor image according to the current sunshine information, so as to simulate a more realistic indoor image with light and shadow. In addition, in some embodiments of the present invention, the captured another image capture device is simulated as a virtual person, so it is possible to avoid the abrupt appearance of another image capture device in the indoor image, so that the indoor image More natural. Based on several embodiments of the present invention, consumers can enjoy the good experience of "remote viewing of houses" realized by Augmented Reality (AR) technology.

雖然本發明已以實施例揭露如上，然其並非用以限定本發明，任何所屬技術領域中具有通常知識者，在不脫離本發明的精神和範圍內，當可作些許的更動與潤飾，故本發明的保護範圍當視後附的申請專利範圍所界定者為準。Although the present invention has been disclosed as above with examples, it is not intended to limit the present invention. Any person with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. The scope of protection of the present invention shall be subject to the scope defined in the appended patent application.

100‧‧‧影像顯示裝置110‧‧‧控制裝置120、120’‧‧‧影像擷取裝置130‧‧‧處理器140‧‧‧顯示器BD_RSV‧‧‧建築預定地F1、F2‧‧‧樓層FOV‧‧‧視野範圍IMG1‧‧‧第一影像IMG2‧‧‧第二影像OB‧‧‧觀察點OB’‧‧‧觀察位置R1‧‧‧立體房屋室內模型的窗戶視野部分R2‧‧‧立體房屋室內模型的非窗戶視野部分S‧‧‧控制訊號sect‧‧‧以橫切面表示的立體房屋室內模型S110、S120、S130、S140、S150‧‧‧影像顯示方法的步驟SC‧‧‧展售中心USR、USR’‧‧‧使用者W1、W2、W3‧‧‧窗戶位置100‧‧‧Image display device 110‧‧‧Control device 120, 120′‧‧‧Image capture device 130‧‧‧Processor 140‧‧‧Display BD_RSV‧‧‧Floor F1, F2‧‧‧Floor FOV ‧‧‧ Field of view IMG1‧‧‧First image IMG2‧‧‧‧Second image OB‧‧‧Observation point OB'‧‧‧Observation position R1‧‧‧Room view of the interior model of the three-dimensional house R2‧‧‧Three-dimensional house The non-window view part of the indoor model S‧‧‧Control signal sect USR, USR'‧‧‧User W1, W2, W3‧‧‧Window position

圖1繪示本發明一實施例中影像顯示系統的概要方塊圖。 圖2繪示本發明一實施例中影像顯示系統的使用情境示意圖。 圖3繪示本發明一實施例中影像顯示方法的流程圖。 圖4繪示本發明第一實施例中產生室內影像的示意圖。 圖5繪示本發明第二實施例中產生室內影像的示意圖。 圖6繪示本發明第三實施例中產生室內影像的示意圖。 圖7繪示本發明一實施例中影像擷取裝置拍攝到另一影像擷取裝置的示意圖。FIG. 1 is a schematic block diagram of an image display system according to an embodiment of the invention. FIG. 2 is a schematic diagram illustrating the usage situation of the image display system in an embodiment of the invention. FIG. 3 is a flowchart of an image display method in an embodiment of the invention. FIG. 4 is a schematic diagram of generating indoor images in the first embodiment of the present invention. FIG. 5 illustrates a schematic diagram of generating indoor images in the second embodiment of the present invention. FIG. 6 is a schematic diagram of generating indoor images in the third embodiment of the present invention. 7 is a schematic diagram of another image capturing device captured by the image capturing device in an embodiment of the invention.

S110、S120、S130、S140、S150‧‧‧影像顯示方法的步驟S110, S120, S130, S140, S150 ‧‧‧ video display method steps

Claims (12)

Translated fromChinese

一種影像顯示系統，包括： 一控制裝置，用以收發一控制訊號； 一影像擷取裝置，耦接於該控制裝置，根據該控制訊號移動至一觀察點並且在該觀察點擷取一第一影像； 一處理器，耦接於該影像擷取裝置，根據一立體房屋室內模型、該立體房屋室內模型中對應該觀察點的一觀察位置以及該第一影像產生一室內影像，其中該觀察點與該觀察位置同步移動；以及 一顯示器，耦接於該處理器，顯示該室內影像。An image display system includes: a control device for sending and receiving a control signal; an image capturing device, coupled to the control device, moving to an observation point according to the control signal and capturing a first point at the observation point An image; a processor, coupled to the image capturing device, generates an indoor image based on a three-dimensional house indoor model, an observation position corresponding to an observation point in the three-dimensional house indoor model, and the first image, wherein the observation point Move synchronously with the observation position; and a display, coupled to the processor, displays the indoor image.如申請專利範圍第1項所述的影像顯示系統，其中該室內影像包括一窗戶影像以及一非窗戶影像，該窗戶影像對應於該第一影像，而該非窗戶影像對應於該立體房屋室內模型。The image display system as described in item 1 of the patent application scope, wherein the indoor image includes a window image and a non-window image, the window image corresponds to the first image, and the non-window image corresponds to the three-dimensional house indoor model.如申請專利範圍第2項所述的影像顯示系統，其中該處理器在產生該室內影像時，根據該立體房屋室內模型中的一窗戶位置以及該觀察位置決定該立體房屋室內模型的一窗戶視野部分與一非窗戶視野部分，根據該第一影像產生該窗戶影像，並且根據該非窗戶視野部分產生該非窗戶影像。The image display system as described in item 2 of the patent application range, wherein the processor determines a window view of the three-dimensional house interior model according to a window position and the observation position in the three-dimensional house interior model when generating the indoor image Part and a non-window view part, the window image is generated based on the first image, and the non-window image is generated based on the non-window view part.如申請專利範圍第1項所述的影像顯示系統，其中該處理器根據一時間資訊、該影像擷取裝置的一當前位置以及該立體房屋室內模型中的一窗戶位置將一光線渲染於該室內影像中。The image display system as described in item 1 of the patent application scope, wherein the processor renders a light into the room based on time information, a current position of the image capture device, and a window position in the indoor model of the three-dimensional house In the image.如申請專利範圍第1項至第4項任一項所述的影像顯示系統，其中該控制訊號包括對應該觀察點的一位置參數以及對應一視線角度的一角度參數，其中該控制裝置包括： 一定位裝置，用以取得該位置參數；以及 一方向感測器，用以取得該角度參數。The image display system according to any one of claims 1 to 4, wherein the control signal includes a position parameter corresponding to the observation point and an angle parameter corresponding to a line-of-sight angle, wherein the control device includes: A positioning device is used to obtain the position parameter; and a direction sensor is used to obtain the angle parameter.如申請專利範圍第5項所述的影像顯示系統，其中當該處理器判斷該第一影像中包括另一影像擷取裝置，根據該另一影像擷取裝置在該第一影像中的位置將一虛擬人物渲染於該室內影像中。The image display system as described in item 5 of the patent application scope, wherein when the processor determines that the first image includes another image capture device, the image capture device according to the position of the other image capture device in the first image A virtual character is rendered in the indoor image.一種影像顯示方法，包括： 取得一控制訊號； 根據該控制訊號控制一影像擷取裝置移動至一觀察點； 利用該影像擷取裝置在該觀察點擷取一第一影像； 根據一立體房屋室內模型、該立體房屋室內模型中對應該觀察點的一觀察位置以及該第一影像產生一室內影像，其中該觀察點與該觀察位置同步移動；以及 顯示該室內影像。An image display method includes: obtaining a control signal; controlling an image capturing device to move to an observation point according to the control signal; using the image capturing device to capture a first image at the observation point; according to a three-dimensional house interior The model, an observation position corresponding to the observation point in the three-dimensional house indoor model, and the first image generate an indoor image, wherein the observation point moves synchronously with the observation position; and the indoor image is displayed.如申請專利範圍第7項所述的影像顯示方法，其中該室內影像包括一窗戶影像以及一非窗戶影像，該窗戶影像對應於該第一影像，而該非窗戶影像對應於該立體房屋室內模型。The image display method as described in item 7 of the patent application range, wherein the indoor image includes a window image and a non-window image, the window image corresponds to the first image, and the non-window image corresponds to the three-dimensional house indoor model.如申請專利範圍第8項所述的影像顯示方法，其中根據該立體房屋室內模型、該立體房屋室內模型中對應該觀察點的該觀察位置以及該第一影像產生該室內影像的步驟包括： 根據該立體房屋室內模型中的一窗戶位置以及該觀察位置決定該立體房屋室內模型的一窗戶視野部分與一非窗戶視野部分； 根據該第一影像產生該窗戶影像；以及 根據該非窗戶視野部分產生該非窗戶影像。The image display method according to item 8 of the patent application scope, wherein the step of generating the indoor image based on the indoor model of the three-dimensional house, the observation position corresponding to the observation point in the indoor model of the three-dimensional house and the first image includes: A window position and the observation position in the three-dimensional house interior model determine a window view portion and a non-window view portion of the three-dimensional house interior model; generate the window image according to the first image; and generate the non-window view portion according to the non-window view portion Window image.如申請專利範圍第7項所述的影像顯示方法，更包括： 根據一時間資訊、該影像擷取裝置的一當前位置以及該立體房屋室內模型中的一窗戶位置將一光線渲染於該室內影像中。The image display method as described in item 7 of the patent application scope further includes: rendering a light on the indoor image based on time information, a current position of the image capturing device and a window position in the indoor model of the three-dimensional house in.如申請專利範圍第7項至第10項任一項所述的影像顯示方法，其中該控制訊號包括對應該觀察點的一位置參數以及對應一視線角度的一角度參數，其中取得該控制訊號的步驟包括： 利用一定位裝置取得該位置參數；以及 利用一方向感測器取得該角度參數。The image display method according to any one of items 7 to 10 of the patent application range, wherein the control signal includes a position parameter corresponding to the observation point and an angle parameter corresponding to a line-of-sight angle, wherein the control signal is acquired The steps include: using a positioning device to obtain the position parameter; and using a direction sensor to obtain the angle parameter.如申請專利範圍第11項所述的影像顯示方法，更包括： 判斷該第一影像中是否包括另一影像擷取裝置；以及 當該第一影像中包括該另一影像擷取裝置，根據該另一影像擷取裝置在該第一影像中的位置將一虛擬人物渲染於該室內影像中。The image display method as described in item 11 of the patent application scope further includes: determining whether the first image includes another image capturing device; and when the first image includes the other image capturing device, according to the Another image capturing device renders a virtual character in the indoor image at the position in the first image.

Images