本發明係與一種不動產領域中之看屋系統有關，特別是指一種互動式擴增實境影音看屋系統The invention relates to a housekeeping system in the field of real estate, in particular to an interactive augmented reality video house viewing system.
按，隨著社會的變遷，世代不斷的進步，民眾生活的水準不斷地提昇，擁有自己的住家已成為許多人所建立的目標之一。According to the changes of society, the continuous improvement of the generations, the level of people's lives is constantly improving, and having their own home has become one of the goals established by many people.
惟，一般購屋者必須透過房仲網站或實體店面中的看屋資訊系統，進一步於房屋物件資訊系統進行初步看屋及搜尋的動作。又，現有房屋仲介使用的影像技術多半是將為數眾多的房屋物件影像資料按照房仲自訂的影像分類進行分類，並排列成影像清單供用戶從中選擇想要播放的影像資料。其次，因傳統的影像資料提供用戶選擇購屋的參考依據，多半都是以敘述性文字的形式呈現，頂多再加上影像資料的若干縮圖及影片作為輔助資料。However, the general purchasers must further carry out preliminary house and search operations on the Housing Information System through the Housing Information System or the Housing Information System in the physical storefront. Moreover, most of the image technologies used by existing housing agencies are to classify a large number of housing object image data according to the image classification customized by Fang Zhong, and arrange them into a list of images for the user to select the image data to be played. Secondly, because the traditional image data provides users with reference to purchase houses, most of them are presented in the form of narrative text. At the same time, some thumbnails and videos of the image data are used as auxiliary materials.
因此，購屋者受限於傳統影像資料能提供的參考依據相當有限且單調乏味，購屋者往往難以迅速找到心中理想的房屋物件，從而徒然浪費許多時間在影像檢索及文字資料閱覽。Therefore, home buyers are limited by the fact that traditional video materials can provide a relatively limited reference basis and tedious. It is often difficult for home buyers to quickly find the ideal house objects in their hearts, thus wasting a lot of time in image retrieval and text reading.
再者，因目前的平面影像技術已臻成熟，其不僅可提供基本空間的影像資訊，當然亦可提供做為決策支援之用。但因於房地產領域中仍僅維持在基本的影像平面化及搭配影音功能，故，讓購屋者缺少身歷其境之感受；同時傳統的看屋資訊系統係缺少同時整合空間及動態的技術，從而使購屋者無法準確得知預搜尋或購買的房屋物件之屋況。Furthermore, as the current planar imaging technology is mature, it not only provides image information of the basic space, but can also be provided as a decision support. However, because the real estate industry still only maintains the basic image flattening and the function of matching audio and video, it makes the home buyers lack the experience.The feeling of the environment; at the same time, the traditional housekeeping information system lacks the technology to integrate space and dynamics at the same time, so that the buyers can not accurately know the condition of the pre-searched or purchased house objects.
是以，本案發明人在觀察到上述缺失後，認為習知看屋資訊系統仍有進一步改良之必要，而遂有本發明之產生。Therefore, after observing the above-mentioned defects, the inventor of the present invention considered that there is still a need for further improvement of the conventional house information system, and the present invention is produced.
本發明之目的係在提供一種互動式擴增實境影音看屋系統，其係能提供使用者進行立體影像及聲音之互動，從而讓使用者於影音看屋的虛擬實境中迅速掌握房屋內空間之相對位置關係，同時更能於房屋物件的虛擬實境中更換情境，以及套入相關擴增實境物件。The object of the present invention is to provide an interactive augmented reality video viewing house system, which can provide a user with interaction between stereoscopic images and sounds, so that the user can quickly grasp the inside of the house in the virtual reality of the audio-visual viewing house. The relative positional relationship of the space, at the same time, it is more able to change the situation in the virtual reality of the house object, and to insert the relevant augmented reality objects.
為達上述目的，本發明所提供之互動式擴增實境影音看屋系統，其係應用於不動產中房屋資訊服務環境，該互動式擴增實境影音看屋系統係包含有：一影音看屋平台，其係應用於資料傳輸環境中，並用以接收至少一搜尋訊息；一資料庫模組，其係耦接該影音看屋平台，且該資料庫模組係儲存有複數影音看屋虛擬實境資料及複數擴增實境物件資料；一虛擬實境處理模組，其係耦接該資料庫模組，而該虛擬實境處理模組係用以將該等影音看屋虛擬實境資料予以影像及聲音效果之整合與處理；一擴增實境處理模組，其係分別耦接於該虛擬實境處理模組及該資料庫模組，而該擴增實境處理模組係用以識別該等影音看屋虛擬實境資料，並進一步將該等影音看屋虛擬實境資料與該等擴增實境物件資料予以連結；一選擇模組，其係分別耦接該虛擬實境處理模組及該擴增實境處理模組，該選擇模組係根據該搜尋訊息於該虛擬實境處理模組中選擇特定之至少一影音看屋虛擬實境資料；一顯示模組，其係分別耦接於該影音看屋平台及該選擇模組，該顯示模組係將該選擇模組選出之至少一影音看屋虛擬實境資料，進一步透過該影音看屋平台將該影音看屋虛擬實境資料以及連結該影音看屋虛擬實境資料之該等擴增實境物件資料予以展現。In order to achieve the above objective, the interactive augmented reality video and audio viewing room system provided by the present invention is applied to a housing information service environment in real estate, and the interactive augmented reality video and audio viewing system system includes: The housing platform is used in a data transmission environment and is configured to receive at least one search message; a database module coupled to the audio-visual viewing platform, and the database module stores a plurality of audio-visual viewing houses. The virtual reality processing module is coupled to the database module, and the virtual reality processing module is used to view the audio visual reality in the virtual reality processing module. The data is integrated and processed by the image and sound effects; an augmented reality processing module is coupled to the virtual reality processing module and the database module, and the augmented reality processing module is The utility model is configured to identify the virtual reality data of the audio-visual viewing room, and further link the virtual reality material of the audio-visual viewing house with the augmented reality object data; a selection module is coupled to the virtual reality Environment processing module and An augmented reality processing module, the selection module is configured to select at least one video and audio virtual reality material in the virtual reality processing module according to the search message; a display module is coupled to the display module The video viewing platform and the choiceThe module is a virtual reality material selected by the selection module, and the virtual reality material is viewed through the audio-visual viewing platform, and the virtual reality material is viewed and connected to the virtual reality. The augmented reality object data of the data is presented.
較佳地，其中該等擴增實境物件資料係由複數3D傢俱影像資料、複數文字標籤資料及複數情境資料。Preferably, the augmented reality object data is composed of plural 3D furniture image data, plural text label data and plural situation data.
較佳地，其中該擴增實境處理模組係包含有一連結單元及一執行單元，該連結單元係將該等3D傢俱影像資料及該等文字圖形資料與該等影音看屋虛擬實境資料予以資料連結，而該執行單元係依據使用者觀看該等影音看屋虛擬實境資料中3D房屋物件影像，進一步套入該等文字標籤資料以及一情境資料。Preferably, the augmented reality processing module includes a link unit and an execution unit, and the link unit is to view the 3D furniture image data and the text graphic data and the audio-visual house virtual reality data. The data is linked, and the execution unit further inserts the text label information and a situational material according to the user viewing the 3D housing object image in the virtual reality data of the house.
較佳地，其中該等影音看屋虛擬實境資料係由複數3D建構房屋影像資料、複數語音資料所構成，且該等3D建構房屋影像資料係為實際房屋物件內部或外部空間所拍攝及錄製構成的虛擬實境影像。Preferably, the audio-visual virtual reality data of the house is composed of a plurality of 3D building house image data and plural voice data, and the 3D building house image data is taken and recorded for the internal or external space of the actual house object. A virtual reality image composed.
較佳地，其中該虛擬實境處理模組係具有一剖析單元、一描繪單元、一媒體單元及感測單元，該剖析單元係剖析該3D建構房屋影像資料之場景，而該描繪單元係依據該剖析單元剖析後之該3D建構房屋影像資料予以3D影像處理，又，該媒體單元係將對應之語音資料與該3D建構房屋影像資料結合，以供該虛擬實境處理模組整合出該影音看屋虛擬實境資料，另，該感測單元係用以感測及觸發該影音看屋虛擬實境資料中之該等語音資料。Preferably, the virtual reality processing module has a parsing unit, a drawing unit, a media unit and a sensing unit, and the parsing unit parses the scene of the 3D building house image data, and the drawing unit is based on The 3D construction house image data analyzed by the analysis unit is subjected to 3D image processing, and the media unit combines the corresponding voice data with the 3D construction house image data, so that the virtual reality processing module integrates the video and audio. Looking at the virtual reality data of the house, the sensing unit is configured to sense and trigger the voice data in the virtual reality material of the video.
較佳地，其中該顯示模組係包含有一3D影音介面，該3D影音介面係設有複數操作標籤及連結點，而該等操作標籤及該連結點係連結該等影音看屋虛擬實境資料與該等擴增實境物件資料。Preferably, the display module includes a 3D audio and video interface, and the 3D audio and video interface is provided with a plurality of operation labels and connection points, and the operation labels and the connection points are connectedThese audio and video views are used to view the virtual reality data of the house and the data of the augmented reality objects.
較佳地，其中更包含至少一頭戴式顯示裝置，其傳送該搜尋訊息至該影音看屋平台，該頭戴式顯示裝置係與該影音看屋平台訊號連接，且該頭戴式顯示裝置係展現該影音看屋虛擬實境資料及該等該等擴增實境物件資料，而該頭戴式顯示裝置係供使用者之視覺處於該影音看屋虛擬實境資料之虛擬實境影像中。Preferably, the method further includes at least one head mounted display device that transmits the search message to the video viewing platform, the head mounted display device is connected to the video viewing platform signal, and the head mounted display device Displaying the virtual reality data of the audio-visual viewing house and the augmented reality object data, and the head-mounted display device is for the user's vision to be in the virtual reality image of the virtual reality material of the video viewing house. .
較佳地，其中更包含有至少一電子裝置，其傳送該搜尋訊息至該影音看屋平台，且該電子裝置係接受該顯示模組展現該影音看屋虛擬實境資料。Preferably, the method further includes at least one electronic device that transmits the search message to the audio-visual viewing platform, and the electronic device accepts the display module to display the audio-visual virtual reality material.
較佳地，其中該電子裝置係選自桌上型電腦、筆記型電腦、平板電腦及智慧型手機其中之一。Preferably, the electronic device is selected from one of a desktop computer, a notebook computer, a tablet computer and a smart phone.
本發明所提供之互動式擴增實境影音看屋系統，其中主要係藉由該虛擬實境處理模組整合處理該等影音看屋虛擬實境資料之影像及聲音效果，以及該擴增實境處理模組將該等影音看屋虛擬實境資料與與該等擴增實境物件資料予以連結。以供使用者透過連結該影音看屋平台進行3D影音觀看房屋物件時，使用者係能於該等影音看屋虛擬實境資料中套入對應之該等擴增實境物件資料。The interactive augmented reality video viewing house system provided by the present invention mainly integrates the image and sound effects of the virtual reality data of the audio and video viewing room by the virtual reality processing module, and the amplification effect The environment processing module links the visual reality material of the audio-visual house to the augmented reality object data. When the user views the house object through the connection of the video and audio viewing platform, the user can insert the corresponding augmented reality object data into the virtual reality material of the video and audio viewing room.
藉此，本發明之互動式擴增實境影音看屋系統係能提供使用者進行立體影像及聲音之互動，從而讓使用者於影音看屋的虛擬實境中迅速掌握房屋內空間之相對位置關係，以及清楚得知房屋物件之格局及屋況。同時更能於房屋物件的虛擬實境中更換情境，以及套入相關擴增實境物件，藉以達到使用者能將自己遊走在虛擬影音看屋的世界之中，並進行相關擴增實境物件資料之互動模擬控制。Therefore, the interactive augmented reality video viewing room system of the present invention can provide a user to interact with the stereoscopic image and the sound, so that the user can quickly grasp the relative position of the space in the house in the virtual reality of the audio-visual viewing house. Relationship, and a clear understanding of the structure and condition of the house. At the same time, it is better to change the situation in the virtual reality of the house object, and to insert the relevant augmented reality objects, so that the user can walk in the world of virtual video and watch the house, and carry outInteractive simulation control of related augmented reality object data.
100‧‧‧看屋系統100‧‧‧ housekeeping system
10‧‧‧影音看屋平台10‧‧‧ audio and video viewing platform
20‧‧‧資料庫模組20‧‧‧Database module
21‧‧‧影音看屋虛擬實境資料21‧‧‧Audio viewing virtual reality materials
211‧‧‧3D建構房屋影像資料211‧‧‧3D construction of housing imagery
212‧‧‧語音資料212‧‧‧Voice data
22‧‧‧擴增實境物件資料22‧‧‧Augmented reality object data
221‧‧‧3D傢俱影像資料221‧‧3D furniture imagery
222‧‧‧文字標籤資料222‧‧‧Text label information
223‧‧‧情境資料223‧‧‧Scenario information
30‧‧‧虛擬實境處理模組30‧‧‧Virtual Reality Processing Module
31‧‧‧剖析單元31‧‧‧analysis unit
32‧‧‧描繪單元32‧‧‧Drawing unit
33‧‧‧媒體單元33‧‧‧Media Unit
34‧‧‧感測單元34‧‧‧Sensor unit
40‧‧‧擴增實境處理模組40‧‧‧Augmented Reality Processing Module
41‧‧‧連結單元41‧‧‧Link unit
42‧‧‧執行單元42‧‧‧Execution unit
50‧‧‧選擇模組50‧‧‧Selection module
60‧‧‧顯示模組60‧‧‧ display module
61‧‧‧3D影音介面61‧‧‧3D video interface
611‧‧‧操作標籤611‧‧‧ operation label
612‧‧‧連結點612‧‧‧Connected points
70‧‧‧頭戴式顯示裝置70‧‧‧ head-mounted display device
80‧‧‧電子裝置80‧‧‧Electronic devices
81‧‧‧桌上型電腦81‧‧‧ desktop computer
82‧‧‧筆記型電腦82‧‧‧Note Computer
83‧‧‧平板電腦83‧‧‧ tablet
84‧‧‧智慧型手機84‧‧‧Smart mobile phone
第1圖係本發明之第一實施例之系統方塊圖。Figure 1 is a block diagram of the system of the first embodiment of the present invention.
第2圖係本發明之第一實施例之系統示意圖。Figure 2 is a schematic view of the system of the first embodiment of the present invention.
第3圖係本發明之第一實施例之使用示意圖。Figure 3 is a schematic view showing the use of the first embodiment of the present invention.
第4圖係本發明之第一實施例之頭戴式顯示裝置之影像顯示示意圖。Fig. 4 is a view showing the image display of the head mounted display device of the first embodiment of the present invention.
第5圖係本發明之第一實施例之使用狀態時之影像顯示示意圖。Fig. 5 is a view showing the image display in the state of use of the first embodiment of the present invention.
第6圖係本發明之第一實施例之使用狀態時之影像顯示示意圖。Fig. 6 is a view showing the image display in the state of use of the first embodiment of the present invention.
第7圖係本發明之第一實施例之使用狀態時之影像顯示示意圖。Fig. 7 is a view showing the image display in the state of use of the first embodiment of the present invention.
第8圖係本發明之第二實施例之使用示意圖。Figure 8 is a schematic view showing the use of the second embodiment of the present invention.
請參閱第1圖、第2圖及第3圖所示，係為本發明之第一實施例之系統方塊圖、系統示意圖及使用示意圖，其係揭露有一種互動式擴增實境影音看屋系統100，其係應用於不動產中房屋資訊服務環境，而該互動式擴增實境影音看屋系統100係包含有：一影音看屋平台10，其係應用於資料傳輸環境中，並用以接收至少一搜尋訊息(圖未示)。於本實施例中，該影音看屋平台10係設於伺服器中。且該搜尋訊息(圖未示)係為使用者針對預搜尋的房屋物件而下的搜尋條件。Please refer to FIG. 1 , FIG. 2 and FIG. 3 , which are system block diagrams, system diagrams and usage diagrams of the first embodiment of the present invention, which disclose an interactive augmented reality video viewing house. The system 100 is applied to a real estate information service environment, and the interactive augmented reality video house system 100 includes: an audio-visual viewing platform 10, which is used in a data transmission environment and is used for receiving At least one search message (not shown). In this embodiment, the video viewing platform 10 is installed in the server. And the search message (not shown) is a search condition for the user to search for the pre-searched house object.
一資料庫模組20，其係耦接該影音看屋平台10，且該資料庫模組20係儲存有複數影音看屋虛擬實境資料21及複數擴增實境物件資料22。於本實施例中，關於該等影音看屋虛擬實境資料21係由複數3D建構房屋影像資料211及複數語音資料212所構成，且該等3D建構房屋影像資料211係為實際房屋物件內部空間或外部空間所拍攝及錄製所構成虛擬實境之影像。該等3D建構房屋影像資料211係可為房屋物件中之客廳、廚房、臥室、浴室、樓梯、陽台、儲藏室…等等與房屋物件相關之空間。該等語音資料212係對應於該等3D建構房屋影像資料211，並予以房屋物件適切說明。A database module 20 is coupled to the audio-visual viewing platform 10, and the database module 20 stores a plurality of audio-visual viewing virtual reality data 21 and a plurality of augmented reality objects.twenty two. In this embodiment, the virtual reality data 21 of the audio-visual house is composed of a plurality of 3D building house image data 211 and a plurality of voice data 212, and the 3D building house image data 211 is an actual house object internal space. Or the external space to capture and record the image of the virtual reality. The 3D construction house image data 211 can be a space related to the house object such as a living room, a kitchen, a bedroom, a bathroom, a staircase, a balcony, a storage room, and the like in the house object. The voice data 212 corresponds to the 3D construction house image data 211, and the housing object is appropriately described.
另外，該資料庫模組20中之該等擴增實境物件資料22係由複數3D傢俱影像資料221、複數文字標籤資料222及複數情境資料223。又，該等3D傢俱影像資料221係為3D立體影像之傢俱，例如床、衣櫃、桌子…等等。另，該文字標籤資料222係為一房價行情數據、一屋齡數據、一房屋坪數數據及一房屋格局數據其中之一或其組合。而該等情境資料223可將該等3D建構房屋影像資料211中房屋物件空間轉換成不同種之風格，例如現代風、古典風、鄉村風、東方風或北歐風等等。In addition, the augmented reality object data 22 in the database module 20 is composed of a plurality of 3D furniture image data 221, plural text label data 222, and plural context data 223. Moreover, the 3D furniture image data 221 is a 3D stereoscopic image furniture such as a bed, a wardrobe, a table, and the like. In addition, the text label information 222 is one of a house price data, a house age data, a house number data, and a house pattern data. The contextual information 223 can convert the housing object space in the 3D building house image data 211 into different kinds of styles, such as modern style, classical style, rural style, oriental style or Nordic style.
一虛擬實境處理模組30，其係耦接該資料庫模組20，而該虛擬實境處理模組30係用以將該等影音看屋虛擬實境資料21予以影像及聲音效果之整合與處理。於本實施例中，該虛擬實境處理模組30係具有一剖析單元31、一描繪單元32、一媒體單元33及一感測單元34。該剖析單元31係剖析該3D建構房屋影像資料211之場景，而該描繪單元32係依據該剖析單元31剖析後之該3D建構房屋影像資料211予以3D影像處理。又，該媒體單元33係將對應之語音資料212與該3D建構房屋影像資料211結合，以供該虛擬實境處理模組30整合出該影音看屋虛擬實境資料21。另，該感測單元34係用以感測及觸發該影音看屋虛擬實境資料21中之該等語音資料212。A virtual reality processing module 30 is coupled to the database module 20, and the virtual reality processing module 30 is configured to integrate the video and sound effects of the video and virtual reality data 21 And processing. In this embodiment, the virtual reality processing module 30 has a parsing unit 31, a drawing unit 32, a media unit 33, and a sensing unit 34. The analyzing unit 31 analyzes the scene of the 3D building house image data 211, and the drawing unit 32 performs 3D image processing according to the 3D building house image data 211 analyzed by the analyzing unit 31. Moreover, the media unit 33 combines the corresponding voice data 212 with the 3D building house image data 211, so that the virtual reality processing module 30 integrates the video viewing house virtual reality material 21. another,The sensing unit 34 is configured to sense and trigger the voice data 212 in the virtual reality material 21 of the video.
一擴增實境處理模組40，其係分別耦接於該虛擬實境處理模組30及該資料庫模組20，而該擴增實境處理模組40係用以識別該等影音看屋虛擬實境資料21，並進一步將該等影音看屋虛擬實境資料21與該等擴增實境物件資料22予以連結。且該擴增實境處理模組40係包含有一連結單元41及一執行單元42，該連結單元41係將該等3D傢俱影像資料221及該等文字圖形資料與該等影音看屋虛擬實境資料21予以資料連結。另外，該執行單元42係依據使用者觀看該等影音看屋虛擬實境資料21中3D房屋物件影像，進一步套入該等文字標籤資料222以及一情境資料223。An augmented reality processing module 40 is coupled to the virtual reality processing module 30 and the database module 20, and the augmented reality processing module 40 is configured to recognize the audio and video processing modules 40. The house virtual reality data 21 is further linked to the audio visual reality material 21 and the augmented reality object data 22. The augmented reality processing module 40 includes a linking unit 41 and an executing unit 42. The connecting unit 41 is used to view the 3D furniture image data 221 and the text graphics and the audio visuals. Information 21 is linked to the information. In addition, the execution unit 42 further inserts the text label information 222 and a context data 223 according to the user viewing the 3D house object image in the virtual reality material 21 of the video.
一選擇模組50，其係分別耦接該虛擬實境處理模組30及該擴增實境處理模組40，該選擇模組50係根據該搜尋訊息(圖未示)於該虛擬實境處理模組30中選擇特定之至少一影音看屋虛擬實境資料21。A selection module 50 is coupled to the virtual reality processing module 30 and the augmented reality processing module 40, and the selection module 50 is based on the search message (not shown) in the virtual reality. The processing module 30 selects at least one of the at least one video viewing virtual reality material 21 .
一顯示模組60，其係分別耦接於該影音看屋平台10及該選擇模組50，該顯示模組60係將該選擇模組50選出之至少一影音看屋虛擬實境資料21，進一步透過該影音看屋平台10將該影音看屋虛擬實境資料21以及連結該影音看屋虛擬實境資料21之該等擴增實境物件資料22予以展現。於本實施例中，該顯示模組60係包含有一3D影音介面61，該3D影音介面61係設有複數操作標籤611及連結點612。該等操作標籤611及該連結點612係連結該等影音看屋虛擬實境資料21與該等擴增實境物件資料22。A display module 60 is coupled to the audio-visual viewing platform 10 and the selection module 50, and the display module 60 is configured to select at least one audio-visual virtual reality material 21 of the selection module 50. Further, the audio-visual viewing platform 10 displays the audio-visual reality material 21 and the augmented reality object data 22 connected to the audio-visual virtual reality data 21. In the embodiment, the display module 60 includes a 3D video interface 61, and the 3D video interface 61 is provided with a plurality of operation tags 611 and a connection point 612. The operation tags 611 and the connection points 612 are coupled to the audio-visual house virtual reality data 21 and the augmented reality object data 22.
一頭戴式顯示裝置70，其傳送該搜尋訊息(圖未示)至該影音看屋平台10，該頭戴式顯示裝置70係與該影音看屋平台10訊號連接，且該頭戴式顯示裝置70係展現該影音看屋虛擬實境資料21及該等該等擴增實境物件資料22，而該頭戴式顯示裝置70係供使用者之視覺處於該影音看屋虛擬實境資料21之虛擬實境影像中。a head mounted display device 70 that transmits the search message (not shown) to the videoLooking at the roof platform 10, the head mounted display device 70 is connected to the video viewing platform 10 signal, and the head mounted display device 70 displays the audiovisual viewing virtual reality data 21 and the likes. The object data 22 is provided, and the head-mounted display device 70 is used for the user's vision to be in the virtual reality image of the virtual reality material 21 of the video.
至少一電子裝置80，其傳送該搜尋訊息(圖未示)至該影音看屋平台10，且該電子裝置80係接受該顯示模組60展現該影音看屋虛擬實境資料21。該電子裝置80係選自桌上型電腦81、筆記型電腦82、平板電腦83及智慧型手機84其中之一。At least one electronic device 80 transmits the search message (not shown) to the video viewing platform 10, and the electronic device 80 accepts the display module 60 to display the audio-visual virtual reality material 21. The electronic device 80 is selected from one of a desktop computer 81, a notebook computer 82, a tablet computer 83, and a smart phone 84.
為供進一步瞭解本發明構造特徵、運用技術手段及所預期達成之功效，茲將本發明使用方式加以敘述，相信當可由此而對本發明有更深入且具體之瞭解，如下所述：請參閱第3圖及第4圖所示，係為本發明第一實施例之頭戴式顯示裝置70之使用示意圖及影像顯示示意圖。於穿戴狀態時，使用者係將該頭戴式顯示裝置70套設於頭部，且使用者之眼睛係對應於該頭戴式顯示裝置70之顯示螢幕。當使用狀態時，使用者係能將該頭戴式顯示裝置70係與該影音看屋平台10以有線或無線之方式進行網路訊號連接，同時該頭戴式顯示裝置70係可連接一操控裝置(圖未示)，例如Leap motion、Kinect、無線體感手套或滑鼠等等。其中，由於該資料庫模組20存有該等影音看屋虛擬實境資料21及該等擴增實境物件資料22，並藉由該虛擬實境處理模組30整合處理該等影音看屋虛擬實境資料21之影像及聲音效果，以及該擴增實境處理模組40將該等影音看屋虛擬實境資料21與與該等擴增實境物件資料22予以連結。以供使用者透過連結該影音看屋平台10進行3D影音觀看房屋物件時，使用者係能於該等影音看屋虛擬實境資料21中套入對應之該等擴增實境物件資料22。For a further understanding of the structural features of the present invention, the application of the technical means, and the intended effect, the present invention will be described. It is believed that the present invention may be further understood and understood as follows: 3 and 4 are schematic diagrams showing the use of the head mounted display device 70 of the first embodiment of the present invention and a schematic view of the image display. In the worn state, the user sets the head mounted display device 70 to the head, and the user's eyes correspond to the display screen of the head mounted display device 70. When in the use state, the user can connect the head-mounted display device 70 to the video viewing platform 10 in a wired or wireless manner, and the head-mounted display device 70 can be connected to a control device. Devices (not shown), such as Leap motion, Kinect, wireless somatosensory gloves or a mouse. The virtual reality data 21 and the augmented reality object data 22 are stored in the database module 20, and the virtual reality processing module 30 is integrated to process the audio-visual viewing room. The image and sound effects of the virtual reality material 21 and the augmented reality processing module 40 link the audio-visual house virtual reality data 21 with the augmented reality object data 22. For the user to view the roof platform 10 for 3D video viewing by connecting the video and audioWhen the object is housed, the user can insert the corresponding augmented reality object data 22 into the virtual reality material 21 of the video.
請再繼續配合參閱5至7圖所示，係為本發明第一實施例之使用狀態時之影像顯示示意圖。於使用狀態時，第5圖係為其中一顯示於3D影音介面61中之3D影音房屋物件的影像顯示示意圖，同時該3D影音介面61係顯示複數操作標籤611及連結點612。其中，該等操作標籤611係對應連結該等擴增實境物件資料22之3D傢俱影像資料221、文字標籤資料222及情境資料223，而該等連結點612係為觀看房屋物件格局空間之連結轉換之用。又，關於第6圖係為使用者實際使用該等操作標籤611對應拉出所需求之3D傢俱影像資料221，並進一步置放於虛擬實境房屋空間內，以達擴增實境互動之效果。此外，使用者係更能使用該等操作標籤611讓虛擬實境房屋空間進行情境之變換。另，請再參閱第7圖所示，其係為使用者依據本身之需求佈置的虛擬實境房屋空間，同時該等語音資料212係對應於該3D建構房屋影像資料211，並予以房屋物件適切說明。Please continue to cooperate with reference to Figures 5 to 7, which are schematic diagrams of image display in the state of use of the first embodiment of the present invention. In the state of use, FIG. 5 is a schematic diagram showing the image display of one of the 3D audio and video house objects displayed in the 3D video interface 61, and the 3D video interface 61 displays the plurality of operation tags 611 and the joint point 612. The operation tags 611 are corresponding to the 3D furniture image data 221, the text tag data 222, and the context data 223 that are connected to the augmented reality object data 22, and the connection points 612 are links to view the object object space. For conversion purposes. In addition, in the sixth figure, the user actually uses the operation labels 611 to pull out the required 3D furniture image data 221, and further places them in the virtual reality housing space to achieve the effect of augmenting the reality interaction. . In addition, the user is more able to use the operational tags 611 to change the context of the virtual reality housing space. In addition, please refer to FIG. 7 , which is a virtual reality housing space arranged by the user according to the needs of the user, and the voice data 212 corresponds to the 3D construction house image data 211, and the housing object is suitable. Description.
本發明之互動式擴增實境影音看屋系統100係能提供使用者進行立體影像及聲音之互動，從而讓使用者於影音看屋的虛擬實境中迅速掌握房屋內空間之相對位置關係，以及清楚得知房屋物件之格局及屋況。同時更能於房屋物件的虛擬實境中更換情境，以及套入相關擴增實境物件，藉以達到使用者能將自己遊走在虛擬影音看屋的世界之中，並進行相關擴增實境物件資料22之互動模擬控制。The interactive augmented reality video viewing house system 100 of the present invention can provide a user to interact with the stereoscopic image and the sound, so that the user can quickly grasp the relative positional relationship of the space in the house in the virtual reality of the audio-visual viewing house. And clearly understand the structure and condition of the house. At the same time, it is better to change the situation in the virtual reality of the house object, and to insert the relevant augmented reality objects, so as to achieve the user can walk in the world of virtual video and watch the house, and carry out related augmented reality objects. Data 22 interactive simulation control.
請再繼續參參閱第8圖所示，係為本發明第二實施例之使用示意圖。該影音看屋平台10係連接至少一電子裝置80，其中，該電子裝置80係傳送該搜尋訊息(圖未示)至該影音看屋平台10，且該電子裝置80係接收該顯示模組60展現該影音看屋虛擬實境資料21及該擴增實境物件資料22，並予以展現於該3D影音介面61。於第二實施例中，係以桌上型電腦81為例，由於該等影音看屋虛擬實境資料21係顯示於該桌上型電腦81之螢幕，且該等影音看屋虛擬實境資料21為720度虛擬實境影音檔。Please refer to FIG. 8 for further reference to the second embodiment of the present invention. The video viewing platform 10 is connected to at least one electronic device 80, wherein the electronic deviceThe 80 series transmits the search message (not shown) to the video viewing platform 10, and the electronic device 80 receives the display module 60 to display the video viewing virtual reality material 21 and the augmented reality object data 22 And presented to the 3D video interface 61. In the second embodiment, the desktop computer 81 is taken as an example, and the virtual reality data 21 is displayed on the screen of the desktop computer 81, and the virtual reality materials are viewed in the audio-visual house. 21 is a 720-degree virtual reality video file.
同時本實施例係可如同第一實施例之實施方式，係能於該影音看屋虛擬實境資料21中套入對應之該等擴增實境物件資料22。藉以達到於使用者能於在虛擬影音看屋的世界之中進行相關擴增實境之互動模擬控制。同時本實施例一樣能利用該影音看屋虛擬實境資料21之語音資料212，進一步提供使用者於觀看房屋物件3D虛擬實境影像時之語音介紹。At the same time, the embodiment can be inserted into the corresponding augmented reality object data 22 in the virtual reality material 21 of the audio-visual viewing room, as in the embodiment of the first embodiment. In order to achieve interactive simulation control of the relevant augmented reality in the world of virtual video and audio viewing. At the same time, the voice data 212 of the virtual reality material 21 of the house can be used to further provide a voice introduction when the user views the 3D virtual reality image of the house object.
茲，再將本發明之特徵及其可達成之預期功效陳述如下：本發明之互動式擴增實境影音看屋系統100，主要係藉由該虛擬實境處理模組30整合處理該等影音看屋虛擬實境資料21之影像及聲音效果，以及該擴增實境處理模組40將該等影音看屋虛擬實境資料21與與該等擴增實境物件資料22予以連結。以供使用者透過連結該影音看屋平台10進行3D影音觀看房屋物件時，使用者係能於該等影音看屋虛擬實境資料21中套入對應之該等擴增實境物件資料22。The features of the present invention and the achievable expected effects are as follows: The interactive augmented reality video viewing system 100 of the present invention mainly integrates the audio and video processing modules 30 to process the audio and video. The image and sound effects of the virtual reality data 21 are viewed, and the augmented reality processing module 40 links the audio visual reality material 21 to the augmented reality object data 22. When the user views the house object through the connection of the video and audio viewing platform 10, the user can insert the corresponding augmented reality object data 22 into the virtual reality material 21 of the video.
藉此，本發明之虛擬實境影音看屋系統100係具有以下優點：其一，本發明係能提供使用者進行立體影像及聲音之互動，從而讓使用者於影音看屋的虛擬實境中迅速掌握房屋內空間之相對位置關係，以及清楚得知房屋物件之格局及屋況。其二，本發明更能相對的大幅減少於閱讀房屋物件內部文字敘述的時間。其三，使用者無須頻繁切換影像，便能透過虛擬實境之影像呈現，以精準地取得對於房屋物件更全面及更豐富了解。其四，使用者能將自己遊走在虛擬影音看屋的世界之中，並進行相關擴增實境物件資料22之互動模擬控制，以供使用者作為準確選購房屋件之參考決策。Therefore, the virtual reality video viewing and television viewing system 100 of the present invention has the following advantages: First, the present invention can provide a user with interaction between stereoscopic images and sounds, thereby allowing users to view the virtual reality in the house. Quickly grasp the relative positional relationship of the space inside the house, and clearly understand the pattern and condition of the house objects. Second, the present invention can be relatively significantly reduced in the time of reading the narrative inside the house object. Third, users do not need to switch images frequently.Through the imagery of virtual reality, it is possible to accurately obtain a more comprehensive and richer understanding of the objects of the house. Fourth, the user can walk himself in the world of virtual video and watch the house, and carry out interactive simulation control of the related augmented reality object data 22 for the user to make a reference decision for accurate purchase of the house piece.
綜上所述，本發明在同類產品中實有其極佳之進步實用性，同時遍查國內外關於此類結構之技術資料，文獻中亦未發現有相同的構造存在在先，是以，本發明實已具備發明專利要件，爰依法提出申請。In summary, the present invention has excellent advancement and practicability in similar products, and at the same time, the technical materials of such structures are frequently investigated at home and abroad, and the same structure is not found in the literature. The invention already has the invention patent requirements, and the application is filed according to law.
惟，以上所述者，僅係本發明之較佳可行實施例而已，故舉凡應用本發明說明書及申請專利範圍所為之等效結構變化，理應包含在本發明之專利範圍內。However, the above-mentioned embodiments are merely preferred embodiments of the present invention, and the equivalent structural changes of the present invention and the scope of the patent application are intended to be included in the scope of the present invention.
100‧‧‧看屋系統100‧‧‧ housekeeping system
10‧‧‧影音看屋平台10‧‧‧ audio and video viewing platform
20‧‧‧資料庫模組20‧‧‧Database module
21‧‧‧影音看屋虛擬實境資料21‧‧‧Audio viewing virtual reality materials
211‧‧‧3D建構房屋影像資料211‧‧‧3D construction of housing imagery
212‧‧‧語音資料212‧‧‧Voice data
22‧‧‧擴增實境物件資料22‧‧‧Augmented reality object data
221‧‧‧3D傢俱影像資料221‧‧3D furniture imagery
222‧‧‧文字標籤資料222‧‧‧Text label information
223‧‧‧情境資料223‧‧‧Scenario information
30‧‧‧虛擬實境處理模組30‧‧‧Virtual Reality Processing Module
31‧‧‧剖析單元31‧‧‧analysis unit
32‧‧‧描繪單元32‧‧‧Drawing unit
33‧‧‧媒體單元33‧‧‧Media Unit
34‧‧‧感測單元34‧‧‧Sensor unit
40‧‧‧擴增實境處理模組40‧‧‧Augmented Reality Processing Module
41‧‧‧連結單元41‧‧‧Link unit
42‧‧‧執行單元42‧‧‧Execution unit
50‧‧‧選擇模組50‧‧‧Selection module
60‧‧‧顯示模組60‧‧‧ display module
61‧‧‧3D影音介面61‧‧‧3D video interface
70‧‧‧頭戴式顯示裝置70‧‧‧ head-mounted display device
80‧‧‧電子裝置80‧‧‧Electronic devices
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW104130169ATW201710982A (en) | 2015-09-11 | 2015-09-11 | Interactive augmented reality house viewing system enabling users to interactively simulate and control augmented reality object data in the virtual house viewing system |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW104130169ATW201710982A (en) | 2015-09-11 | 2015-09-11 | Interactive augmented reality house viewing system enabling users to interactively simulate and control augmented reality object data in the virtual house viewing system |
| Publication Number | Publication Date |
|---|---|
| TW201710982Atrue TW201710982A (en) | 2017-03-16 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW104130169ATW201710982A (en) | 2015-09-11 | 2015-09-11 | Interactive augmented reality house viewing system enabling users to interactively simulate and control augmented reality object data in the virtual house viewing system |
| Country | Link |
|---|---|
| TW (1) | TW201710982A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI633500B (en)* | 2017-12-27 | 2018-08-21 | 中華電信股份有限公司 | Augmented reality application generation system and method |
| CN108984087A (en)* | 2017-06-02 | 2018-12-11 | 腾讯科技（深圳）有限公司 | Social interaction method and device based on three-dimensional avatars |
| US11989232B2 (en) | 2020-11-06 | 2024-05-21 | International Business Machines Corporation | Generating realistic representations of locations by emulating audio for images based on contextual information |
| TWI890533B (en)* | 2023-08-14 | 2025-07-11 | 日商開創日本股份有限公司 | Object information sending system, object information sending device, object information sending program and object information sending method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108984087A (en)* | 2017-06-02 | 2018-12-11 | 腾讯科技（深圳）有限公司 | Social interaction method and device based on three-dimensional avatars |
| CN108984087B (en)* | 2017-06-02 | 2021-09-14 | 腾讯科技（深圳）有限公司 | Social interaction method and device based on three-dimensional virtual image |
| TWI633500B (en)* | 2017-12-27 | 2018-08-21 | 中華電信股份有限公司 | Augmented reality application generation system and method |
| US11989232B2 (en) | 2020-11-06 | 2024-05-21 | International Business Machines Corporation | Generating realistic representations of locations by emulating audio for images based on contextual information |
| TWI890533B (en)* | 2023-08-14 | 2025-07-11 | 日商開創日本股份有限公司 | Object information sending system, object information sending device, object information sending program and object information sending method |
| Publication | Publication Date | Title |
|---|---|---|
| US11823256B2 (en) | Virtual reality platform for retail environment simulation | |
| US10515163B2 (en) | Systems and methods for improving visual attention models | |
| KR20180014195A (en) | Emotion detection system | |
| CN112017300B (en) | Mixed reality image processing method, device and equipment | |
| CN112596694B (en) | Method and device for processing house source information | |
| US20170263035A1 (en) | Video-Associated Objects | |
| TW201710982A (en) | Interactive augmented reality house viewing system enabling users to interactively simulate and control augmented reality object data in the virtual house viewing system | |
| US20240104863A1 (en) | Contextual presentation of extended reality content | |
| TW201319981A (en) | System and method for displaying information of television advertised product and recording media thereof | |
| CN202142050U (en) | Interactive customer reception system | |
| JP6466363B2 (en) | Fixtures | |
| Perla et al. | Google cardboard dates augmented reality: Issues, challenges and future opportunities | |
| Yu et al. | Mapping the Viewer Experience in Cinematic Virtual Reality: A Systematic Review | |
| TWM514071U (en) | Interactive augmented reality audio/video house browsing system | |
| Aiordachioae et al. | Lifelogging in mixed reality | |
| TWI672042B (en) | Intelligent product introduction system and method thereof | |
| TWM513420U (en) | Virtual reality audio/video house browsing system | |
| TWI687904B (en) | Interactive training and testing apparatus | |
| TW201710983A (en) | Virtual reality audiovisual house viewing system applied in a house information service environment for real estate | |
| JP6794740B2 (en) | Presentation material generation device, presentation material generation system, computer program and presentation material generation method | |
| JP2015179390A (en) | Sales promotion device, sales promotion method, and program | |
| KR20160108103A (en) | Use terminal device, digital signage device and control methods thereof | |
| TW201917676A (en) | System device with virtual reality and mixed reality house purchase experiences capable of providing a user with virtual reality or mixed reality house viewing by mixing reality, augmented reality, enhanced virtualizing and virtual reality | |
| KR20230059934A (en) | Residential space improvement system using psychological information and augmented reality contents and operating method thereof | |
| US20130293780A1 (en) | Display device and method for presenting information on entities displayed on video content |