技术领域technical field
本发明是有关于一种多媒体处理装置，且特别是有关于一种多媒体处理装置与多媒体通信系统。The present invention relates to a multimedia processing device, and in particular to a multimedia processing device and a multimedia communication system.
背景技术Background technique
随着科技的进步，机顶盒或多媒体播放器的数据处理能力已大幅的提升。此外，随着智能家庭的概念逐渐普及，家中的电子装置可以利用一个家庭局域网来相互串联。With the advancement of technology, the data processing capability of a set-top box or a multimedia player has been greatly improved. In addition, with the gradual popularization of the concept of a smart home, electronic devices in a home can be connected in series with each other through a home local area network.
然而，机顶盒或多媒体播放器的强大数据处理能力与家庭中普遍会有的电视机，却没有在智能家庭中给出更多、更独特的贡献。例如，机顶盒或多媒体播放器仍然只是被用来播放电视节目、影片或者音乐。特别是，虽然部分的机顶盒或多媒体播放器可能具有上网功能，但是，对于远端音/视频通信这方面，却因机顶盒或多媒体播放器普遍不具有摄像机及/或收音器而无法享受家中多人同乐的乐趣。However, the powerful data processing capabilities of set-top boxes or multimedia players and the TV sets commonly found in families have not given more and more unique contributions to smart homes. For example, a set-top box or multimedia player is still only used to play TV programs, movies or music. Especially, although some set-top boxes or multimedia players may have Internet access capabilities, for remote audio/video communication, it is impossible to enjoy multiple people at home because set-top boxes or multimedia players generally do not have cameras and/or radios. Fun with fun.
发明内容Contents of the invention
有鉴于此，本发明提供一种多媒体处理装置与多媒体通信系统，可利用外部设备即时撷取的影像或声音来供多媒体处理装置进行远端通信。In view of this, the present invention provides a multimedia processing device and a multimedia communication system, which can use images or sounds captured by external devices in real time for the multimedia processing device to perform remote communication.
本发明的一范例实施例提供一种多媒体处理装置，其适于外接至显示装置，其特征在于，所述多媒体处理装置包括设备配置模块、设备驱动模块、应用程序储存模块、应用程序执行模块及播放模块。设备配置模块用以提供设备清单，其中设备清单用以记录至少一外部设备的设备信息。设备驱动模块用以接收所述外部设备中的第一外部设备即时产生的第一多媒体信号，并且用以根据第一多媒体信号产生本地数据。应用程序储存模块用以储存第一通信应用程序。应用程序执行模块用以根据本地数据执行第一通信应用程序。播放模块用以提供第一通信应用程序的第一操作介面至显示装置进行显示。An exemplary embodiment of the present invention provides a multimedia processing device, which is suitable for external connection to a display device, wherein the multimedia processing device includes a device configuration module, a device driver module, an application program storage module, an application program execution module and Play module. The device configuration module is used to provide a device list, wherein the device list is used to record the device information of at least one external device. The device driver module is used to receive a first multimedia signal generated immediately by a first external device among the external devices, and to generate local data according to the first multimedia signal. The application storage module is used for storing the first communication application. The application executing module is used for executing the first communication application according to the local data. The playing module is used for providing the first operation interface of the first communication application program to the display device for display.
本发明的一范例实施例提供一种多媒体通信系统，其特征在于，所述多媒体通信系统包括至少一外部设备及多媒体处理装置。所述多媒体处理装置适于外接至显示装置，并且包括设备配置模块、设备驱动模块、应用程序储存模块、应用程序执行模块及播放模块。设备配置模块用以提供设备清单，其中设备清单用以记录所述外部设备的设备信息。设备驱动模块用以接收所述外部设备中的第一外部设备即时产生的第一多媒体信号，并且用以根据第一多媒体信号产生本地数据。应用程序储存模块用以储存第一通信应用程序。应用程序执行模块用以根据本地数据执行第一通信应用程序。播放模块用以提供第一通信应用程序的第一操作介面至显示装置进行显示。An exemplary embodiment of the present invention provides a multimedia communication system, wherein the multimedia communication system includes at least one external device and a multimedia processing device. The multimedia processing device is suitable for being externally connected to a display device, and includes a device configuration module, a device driver module, an application program storage module, an application program execution module and a playback module. The device configuration module is used to provide a device list, wherein the device list is used to record the device information of the external device. The device driver module is used to receive a first multimedia signal generated immediately by a first external device among the external devices, and to generate local data according to the first multimedia signal. The application storage module is used for storing the first communication application. The application executing module is used for executing the first communication application according to the local data. The playing module is used for providing the first operation interface of the first communication application program to the display device for display.
在本发明的一范例实施例中，所述的第一外部设备具有第一摄像头及/或第一收音器，并且第一多媒体信号是转换第一摄像头即时撷取到的第一影像及/或第一收音器即时撷取到的第一声音而获得。In an exemplary embodiment of the present invention, the first external device has a first camera and/or a first receiver, and the first multimedia signal is converted from the first image captured by the first camera in real time and /or obtained by the first sound captured by the first radio in real time.
在本发明的一范例实施例中，所述的应用程序执行模块用以执行第一通信应用程序以发送本地数据至至少一远端装置，其中所述远端装置安装有对应于第一通信应用程序的第二通信应用程序。In an exemplary embodiment of the present invention, the application program execution module is used to execute a first communication application program to send local data to at least one remote device, wherein the remote device is installed with the corresponding first communication application program's second communication application.
在本发明的一范例实施例中，所述的应用程序执行模块更用以执行第一通信应用程序以从所述远端装置接收至少一远端数据，其中第一操作介面上显示有所述远端数据所分别对应的远端影像。In an exemplary embodiment of the present invention, the application execution module is further used to execute a first communication application to receive at least one remote data from the remote device, wherein the first operation interface displays the The remote images corresponding to the remote data.
在本发明的一范例实施例中，所述的设备驱动模块更用以发送第一控制指令，其中第一控制指令用以指示第一外部设备开始或停止传送第一多媒体信号。In an exemplary embodiment of the present invention, the device driver module is further configured to send a first control command, wherein the first control command is used to instruct the first external device to start or stop transmitting the first multimedia signal.
在本发明的一范例实施例中，所述的设备驱动模块更用以接收所述外部设备中的第二外部设备即时产生的第二多媒体信号，并且更用以根据第二多媒体信号产生本地数据。In an exemplary embodiment of the present invention, the device driver module is further used to receive a second multimedia signal generated immediately by a second external device among the external devices, and is further used to Signals generate local data.
在本发明的一范例实施例中，所述的第一外部设备具有第一摄像头及/或第一收音器，并且第一多媒体信号是转换第一摄像头即时撷取到的第一影像及/或第一收音器即时撷取到的第一声音而获得，所述的第二外部设备具有第二摄像头及/或第二收音器，并且第二多媒体信号是转换第二摄像头即时撷取到的第二影像及/或第二收音器即时撷取到的第二声音而获得。In an exemplary embodiment of the present invention, the first external device has a first camera and/or a first receiver, and the first multimedia signal is converted from the first image captured by the first camera in real time and / or the first sound captured by the first radio in real time, the second external device has a second camera and / or a second radio, and the second multimedia signal is converted to the second camera in real time The obtained second image and/or the second sound captured by the second receiver in real time.
在本发明的一范例实施例中，所述的设备驱动模块更用以从第一外部设备接收第二控制指令，并且更用以根据第二控制指令决定本地数据所对应的至少一本地影像及/或一远端装置的至少一远端影像在第一操作介面上的显示模式。In an exemplary embodiment of the present invention, the device driver module is further used to receive a second control command from the first external device, and is further used to determine at least one local image and corresponding local data according to the second control command. /or a display mode of at least one remote image of a remote device on the first operation interface.
在本发明的一范例实施例中，所述的设备驱动模块更用以从第一外部设备接收第三控制指令，并且更用以根据第三控制指令决定本地数据所对应的至少一本地影像在远端装置的第二操作介面上的显示模式。In an exemplary embodiment of the present invention, the device driver module is further used to receive a third control command from the first external device, and is further used to determine the location of at least one local image corresponding to the local data according to the third control command. The display mode on the second operation interface of the remote device.
在本发明的一范例实施例中，所述的外部设备的设备信息包括第一外部设备的连线信息，所述的设备驱动模块更用以在一本地网络上搜寻外部设备，在搜寻到第一外部设备之后，设备配置模块更用以将第一外部设备的连线信息记录至设备清单中。In an exemplary embodiment of the present invention, the device information of the external device includes the connection information of the first external device, and the device driver module is further configured to search for the external device on a local network, and when the first external device is found After an external device, the device configuration module is further configured to record the connection information of the first external device into the device list.
基于上述，在本发明的一范例实施例中，即使多媒体处理装置本身不具有摄像头或收音器，透过外部设备即时撷取的影像或声音，多媒体处理装置即可进行音频、视频或音视频远端通信。Based on the above, in an exemplary embodiment of the present invention, even if the multimedia processing device itself does not have a camera or a radio, the multimedia processing device can perform audio, video or audio-video telemetry through the image or sound captured by the external device in real time. terminal communication.
为让本发明的上述特征和优点能更明显易懂，下文特举实施例，并配合所附图式作详细说明如下。In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail together with the accompanying drawings.
附图说明Description of drawings
图1是根据本发明的一范例实施例所绘示的多媒体通信系统的示意图。FIG. 1 is a schematic diagram of a multimedia communication system according to an exemplary embodiment of the present invention.
图2是根据本发明的一范例实施例所绘示的多媒体通信系统的概要方块图。FIG. 2 is a schematic block diagram of a multimedia communication system according to an exemplary embodiment of the present invention.
图3是根据本发明的一范例实施例所绘示的外部设备与多媒体处理装置之间的通信的示意图。FIG. 3 is a schematic diagram illustrating communication between an external device and a multimedia processing device according to an exemplary embodiment of the present invention.
图4与图5是根据本发明的一范例实施例所绘示的第一操作介面的示意图。FIG. 4 and FIG. 5 are schematic diagrams of a first operation interface according to an exemplary embodiment of the present invention.
图6与图7是根据本发明的一范例实施例所绘示的第二操作介面的示意图。FIG. 6 and FIG. 7 are schematic diagrams of a second operation interface according to an exemplary embodiment of the present invention.
图8是根据本发明的一范例实施例所绘示多媒体通信系统的使用情境示意图。FIG. 8 is a schematic diagram of a usage scenario of a multimedia communication system according to an exemplary embodiment of the present invention.
图9是根据本发明的一范例实施例所绘示的多媒体通信方法的示意图。FIG. 9 is a schematic diagram of a multimedia communication method according to an exemplary embodiment of the present invention.
具体实施方式detailed description
图1是根据本发明的一范例实施例所绘示的多媒体通信系统的示意图。FIG. 1 is a schematic diagram of a multimedia communication system according to an exemplary embodiment of the present invention.
请参照图1，多媒体通信系统10包括显示装置11、多媒体处理装置12及外部设备1301～1308。Referring to FIG. 1 , the multimedia communication system 10 includes a display device 11 , a multimedia processing device 12 and external devices 1301 - 1308 .
显示装置11例如是任意具有显示功能的电视或显示器。其中，电视可以是传统电视或者具有特殊功能的智能电视或网络电视等，而显示器可以是液晶显示器(LiquidCrystalDisplay,LCD)、发光二极管(Light-EmittingDiode,LED)显示器、场发射显示器(FieldEmissionDisplay，FED)或其它种类的显示器。在另一范例实施例中，显示装置11也可以独立在多媒体通信系统10外。The display device 11 is, for example, any television or monitor with a display function. Among them, the TV can be a traditional TV or a smart TV with special functions or a network TV, etc., and the display can be a liquid crystal display (Liquid Crystal Display, LCD), a light-emitting diode (Light-Emitting Diode, LED) display, a field emission display (Field Emission Display, FED) or other types of displays. In another exemplary embodiment, the display device 11 can also be independent from the multimedia communication system 10 .
在本范例实施例中，多媒体处理装置12适于外接至显示装置11。例如，多媒体处理装置12可以是机顶盒(set-topbox,STB)、电视棒、电视卡或多媒体播放器(例如，CD/DVD播放器等)等具有多媒体处理功能的电子装置。在此提及的多媒体包括影像(即，视频)及声音(即，音频)。在一范例实施例中，若多媒体处理装置12是机顶盒、电视棒或电视卡等用来观看电视节目的装置，则多媒体处理装置12可以接收有线或无线的电视信号，将接收到的电视信号处理成视频串流与音频串流，并且透过显示装置11来播放相对应的影像与声音。在一范例实施例中，若多媒体处理装置12是CD/DVD播放器等多媒体播放器，则多媒体处理装置12可以从储存媒体(例如，CD/DVD)中读取多媒体数据，并且透过显示装置11来播放此多媒体数据。或者，在一范例实施例中，多媒体处理装置12可以具有上述部份或全部功能。此外，在一范例实施例中，多媒体处理装置12也可以是配置在显示装置11内部，并且电性连接至显示装置11的显示器。In this exemplary embodiment, the multimedia processing device 12 is adapted to be externally connected to the display device 11 . For example, the multimedia processing device 12 may be an electronic device having a multimedia processing function such as a set-top box (set-topbox, STB), a TV stick, a TV card, or a multimedia player (eg, CD/DVD player, etc.). The multimedia mentioned here includes image (ie, video) and sound (ie, audio). In an exemplary embodiment, if the multimedia processing device 12 is a set-top box, a TV stick or a TV card, etc., which are used to watch TV programs, the multimedia processing device 12 can receive wired or wireless TV signals, and process the received TV signals into a video stream and an audio stream, and play the corresponding video and audio through the display device 11 . In an exemplary embodiment, if the multimedia processing device 12 is a multimedia player such as a CD/DVD player, the multimedia processing device 12 can read the multimedia data from the storage medium (for example, CD/DVD) and display it through the display device. 11 to play the multimedia data. Alternatively, in an exemplary embodiment, the multimedia processing device 12 may have some or all of the functions described above. In addition, in an exemplary embodiment, the multimedia processing device 12 may also be a display configured inside the display device 11 and electrically connected to the display device 11 .
外部设备1301～1308包括任意可以与多媒体处理装置12一起使用的信号输入装置。外部设备1301～1308中的部份或全部可以用来撷取环境中的声音及/或影像，并且将即时撷取到的声音或影像透过实体线路或以无线的方式传送至多媒体处理装置12。例如，如图1所示，外部设备1301是智能手机，外部设备1302是平板电脑，外部设备1303是耳机麦克风，外部设备1304是麦克风，外部设备1305是笔记本电脑，外部设备1306与1307是摄像机，并且外部设备1308是遥控器。然而，外部设备1301～1308的类型并不限于上述，任何可以即时撷取所在环境中的影像及/或声音及/或具有信号传输功能的电子装置都可以作为外部设备1301～1308的其中之一。外部设备1301～1308中的部份或全部可以分别配置在不同的地方(例如，不同的房间或同一房间中的不同位置)，以撷取不同地方的影像或声音。此外，外部设备1301～1308的数量也可以是更多或更少。External devices 1301 - 1308 include any signal input device that may be used with multimedia processing device 12 . Some or all of the external devices 1301-1308 can be used to capture the sound and/or images in the environment, and transmit the captured sounds or images to the multimedia processing device 12 through physical lines or wirelessly. . For example, as shown in FIG. 1 , external device 1301 is a smart phone, external device 1302 is a tablet computer, external device 1303 is a headset microphone, external device 1304 is a microphone, external device 1305 is a notebook computer, external devices 1306 and 1307 are video cameras, And the external device 1308 is a remote controller. However, the types of external devices 1301-1308 are not limited to the above, any electronic device that can capture images and/or sounds in the environment in real time and/or has signal transmission functions can be used as one of the external devices 1301-1308 . Some or all of the external devices 1301-1308 can be respectively configured in different places (for example, different rooms or different positions in the same room), so as to capture images or sounds in different places. In addition, the number of external devices 1301-1308 may also be more or less.
多媒体处理装置12可以透过互联网(Internet)14连接至远端装置15，以与远端装置15进行远端通信。在此提及的远端通信特别是指透过交换网络封包来执行的网络通信、通话及/或会议，但也不排除使用任意其他形式、协定(例如，电话系统)来执行的通信。特别是，根据外部设备1301～1308的至少其中之一所即时撷取到的声音及/或影像，多媒体处理装置12可以作为一个处理平台以与远端装置15进行远端通信。远端装置15可以是智能手机、平板电脑、摄像机、笔记本电脑、台式电脑、网络电视或智能电视等同样可用来执行此远端通信的电子装置。或者，远端装置15也可以包括另一多媒体处理装置12，并且组成类似于多媒体通信系统10的另一多媒体通信系统，以与多媒体通信系统10中的多媒体处理装置12进行所述远端通信。此外，远端装置15的数量也可以是更多，例如，2个或3个等等，多媒体处理装置12可以同时或分别与此些远端装置15进行远端通信。The multimedia processing device 12 can be connected to the remote device 15 through the Internet 14 to perform remote communication with the remote device 15 . The remote communication mentioned here especially refers to network communication, call and/or conference performed by exchanging network packets, but does not exclude communication performed using any other form, protocol (eg, telephone system). In particular, according to the sound and/or image captured by at least one of the external devices 1301-1308 in real time, the multimedia processing device 12 can serve as a processing platform to perform remote communication with the remote device 15 . The remote device 15 may be a smart phone, a tablet computer, a video camera, a notebook computer, a desktop computer, an Internet TV or a smart TV, and other electronic devices that can also be used to perform the remote communication. Alternatively, the remote device 15 may also include another multimedia processing device 12 and form another multimedia communication system similar to the multimedia communication system 10 to perform the remote communication with the multimedia processing device 12 in the multimedia communication system 10 . In addition, the number of remote devices 15 may also be more, for example, 2 or 3, etc., and the multimedia processing device 12 may perform remote communication with these remote devices 15 simultaneously or separately.
图2是根据本发明的一范例实施例所绘示的多媒体通信系统的概要方块图。FIG. 2 is a schematic block diagram of a multimedia communication system according to an exemplary embodiment of the present invention.
请参照图2，多媒体通信系统10包括显示装置11、多媒体处理装置12及外部设备201～203。Referring to FIG. 2 , the multimedia communication system 10 includes a display device 11 , a multimedia processing device 12 and external devices 201 - 203 .
外部设备201～203分别具有影像撷取功能及/或声音撷取功能。例如，在本范例实施例中，外部设备201具有摄像头2011，外部设备202具有收音器2022，外部设备203具有摄像头2031与收音器2032。其中，摄像头2011与2031可提供影像撷取功能，而收音器2022与2032则可提供声音撷取功能。例如，外部设备201可以是摄像机(例如，图1的外部设备1306或1307)，外部设备202可以耳机麦克风(例如，图1的外部设备1303)，外部设备203是智能手机或平板电脑(例如，图1的外部设备1301或1302)。然而，本发明并不以此为限，外部设备201～203可以分别是任何可以即时撷取所在环境中的影像及/或声音及/或具有信号传输功能的电子装置。此外，外部设备201～203的数量可以更多或更少。The external devices 201-203 respectively have an image capture function and/or a sound capture function. For example, in this exemplary embodiment, the external device 201 has a camera 2011 , the external device 202 has a radio 2022 , and the external device 203 has a camera 2031 and a radio 2032 . Wherein, the cameras 2011 and 2031 can provide image capture function, and the receivers 2022 and 2032 can provide sound capture function. For example, the external device 201 can be a video camera (for example, the external device 1306 or 1307 of FIG. 1 ), the external device 202 can be a headset microphone (for example, the external device 1303 of FIG. external device 1301 or 1302 of FIG. 1). However, the present invention is not limited thereto, and the external devices 201 - 203 may be any electronic devices that can capture images and/or sounds in the environment in real time and/or have signal transmission functions. In addition, the number of external devices 201-203 can be more or less.
多媒体处理装置12包括通信接口21、储存媒体22及处理器23。通信接口21包括有线及/或无线网络接口卡，并且用以提供有线及/或无线通信功能。例如，通信接口21可支持全球移动通信系统(GlobalSystemforMobileCommunication，GSM)、个人手持式电话系统(PersonalHandy-phoneSystem，PHS)、码分多址(CodeDivisionMultipleAccess，CDMA)系统、无线保真(WirelessFidelity，WiFi)系统、全球微波互联接入(WorldwideInteroperabilityforMicrowaveAccess，WiMAX)系统、第三代无线通信技术(3G)、长期演进技术(LongTermEvolution,LTE)、红外线(Infrared)传输的其中之一或其组合。此外，通信接口21也可以支持任意的无线传输协定，而不限于上述。值得一提的是，在本范例实施例中，用来接收有线或无线的电视信号的电视信号通信接口(未绘示)是独立在通信接口21外，然而，在另一范例实施例中，通信接口21也包括用来接收有线或无线的电视信号的电视信号通信接口，并且可用来接收所述电视信号。The multimedia processing device 12 includes a communication interface 21 , a storage medium 22 and a processor 23 . The communication interface 21 includes a wired and/or wireless network interface card, and is used to provide wired and/or wireless communication functions. For example, the communication interface 21 may support Global System for Mobile Communication (GSM), Personal Handy-phone System (PHS), Code Division Multiple Access (CDMA) system, Wireless Fidelity (Wireless Fidelity, WiFi) system , Worldwide Interoperability for Microwave Access (WiMAX) system, third-generation wireless communication technology (3G), long-term evolution technology (Long Term Evolution, LTE), infrared (Infrared) transmission, or one or a combination thereof. In addition, the communication interface 21 may also support any wireless transmission protocol, not limited to the above. It is worth mentioning that, in this exemplary embodiment, the television signal communication interface (not shown) used to receive wired or wireless television signals is independent of the communication interface 21, however, in another exemplary embodiment, The communication interface 21 also includes a TV signal communication interface for receiving wired or wireless TV signals, and can be used to receive the TV signals.
储存媒体22可以包括只读存储器(read-onlymemory,ROM)、闪存(flashmemory)、硬盘、光盘和外接式储存装置(如存储卡、随身盘等)等储存媒体的其中之一或其组合。储存媒体22用以储存多媒体处理装置12运行所需的系统数据与使用者数据。处理器23可以是微处理器(micro-processor)、微控制器(micro-controller)、嵌入式控制器(embeddedcontroller)和中央处理器(centralprocessingunit,CPU)的至少其中之一或其组合，且处理器23的种类不限于此。处理器23负责多媒体处理装置12的整体运作。储存媒体22储存有多个软件模块与多个固件模块，其中每一个软件模块或固件模块是由程序码组成。在多媒体处理装置12开机后，处理器23会从储存媒体22中读取并且载入此些软件模块及/或固件模块，以执行相对应的操作。The storage medium 22 may include one or a combination of storage media such as read-only memory (ROM), flash memory (flash memory), hard disk, optical disk, and external storage devices (such as memory cards, pen drives, etc.). The storage medium 22 is used for storing system data and user data required by the operation of the multimedia processing device 12 . The processor 23 may be at least one of a microprocessor (micro-processor), a microcontroller (micro-controller), an embedded controller (embedded controller) and a central processing unit (central processing unit, CPU) or a combination thereof, and processes The type of device 23 is not limited thereto. The processor 23 is responsible for the overall operation of the multimedia processing device 12 . The storage medium 22 stores a plurality of software modules and a plurality of firmware modules, wherein each software module or firmware module is composed of program codes. After the multimedia processing device 12 is turned on, the processor 23 reads and loads these software modules and/or firmware modules from the storage medium 22 to execute corresponding operations.
在本范例实施例中，储存媒体22至少储存有设备配置模块221、设备驱动模块222、应用程序储存模块223、应用程序执行模块224及播放模块225。In this exemplary embodiment, the storage medium 22 at least stores a device configuration module 221 , a device driver module 222 , an application storage module 223 , an application execution module 224 and a playback module 225 .
设备配置模块221用以提供设备清单。此设备清单用以记录外部设备的设备信息。在本范例实施例中，外部设备的设备信息包括外部设备的连线信息及/或装置信息。例如，外部设备的连线信息包括外部设备的网络地址(例如，IP地址)、硬件地址(例如，MAC地址)及/或连线金钥等与建立无线连线有关的信息。例如，一旦外部设备201～203的其中之一曾经与多媒体处理装置12建立过无线连线，则设备清单上就会记录有与此无线连线有关的信息。尔后，若多媒体处理装置12欲与此设备清单上记载的外部设备201～203的其中之一连线时，多媒体处理装置12可以快速地根据对应的连线信息来建立所需的无线连线，而不需要重新分派连线金钥等等。藉此，可加快建立连线的速度。外部设备的装置信息包括装置名称、编号及/或硬件识别码等与识别硬件有关的信息。此外，针对特定类型的外部设备，所述连线信息还可以包括载波频率及/或账号密码等发送信号或执行身分验证所需的信息。多媒体处理装置12可以根据外部设备的设备信息来找到并且使用这些外部设备。在一范例实施例中，外部设备的设备信息还可以包括任意有用的信息，而不限定于上述。The device configuration module 221 is used to provide a device list. This device list is used to record the device information of external devices. In this exemplary embodiment, the device information of the external device includes connection information and/or device information of the external device. For example, the connection information of the external device includes the network address (eg, IP address), hardware address (eg, MAC address) and/or connection key of the external device and other information related to establishing a wireless connection. For example, once one of the external devices 201-203 has established a wireless connection with the multimedia processing device 12, information related to the wireless connection will be recorded in the device list. Afterwards, if the multimedia processing device 12 intends to connect with one of the external devices 201-203 recorded in the equipment list, the multimedia processing device 12 can quickly establish the required wireless connection according to the corresponding connection information, There is no need to redistribute connection keys and so on. In this way, the speed of establishing a connection can be accelerated. The device information of the external device includes information related to identifying hardware such as device name, serial number and/or hardware identification code. In addition, for a specific type of external device, the connection information may also include carrier frequency and/or account password and other information required for sending signals or performing identity verification. The multimedia processing device 12 can find and use these external devices according to the device information of the external devices. In an exemplary embodiment, the device information of the external device may also include any useful information, and is not limited to the above.
以下将外部设备203作为范例进行说明，其余外部设备201与202可以此类推。In the following, the external device 203 is taken as an example for illustration, and the rest of the external devices 201 and 202 can be deduced by analogy.
设备驱动模块222用以接收外部设备203(亦称为第一外部设备)即时产生的多媒体信号(亦称为第一多媒体信号)，并且根据第一多媒体信号产生本地数据。其中，第一多媒体信号是对应于外部设备203所即时撷取到的影像(亦称为第一影像)及/或声音(亦称为第一声音)。例如，若外部设备203透过摄像头2031及/或收音器2032即时撷取到影像及/或声音，外部设备203会即时将此影像及/或声音转换为对应的多媒体信号，并且透过有线或无线的方式将此多媒体信号传送至多媒体处理装置12。设备驱动模块222会透过通信接口21接收此多媒体信号，并且透过解调变、去杂讯、取样及/或信号放大等操作来产生对应于此多媒体信号的本地数据。例如，若透过无线的方式来传输多媒体信号，则此多媒体信号的传输格式可以是符合实时传输协议(Real-timeTransportProtocol,RTP)的规范。然而，任意的传输协议都可以被采用，本发明不加以限制。The device driver module 222 is configured to receive a multimedia signal (also called a first multimedia signal) generated by the external device 203 (also called a first external device) in real time, and generate local data according to the first multimedia signal. Wherein, the first multimedia signal is corresponding to the image (also referred to as the first image) and/or sound (also referred to as the first sound) captured by the external device 203 in real time. For example, if the external device 203 captures the image and/or sound in real time through the camera 2031 and/or the radio 2032, the external device 203 will immediately convert the image and/or sound into a corresponding multimedia signal, and transmit The multimedia signal is transmitted to the multimedia processing device 12 in a wireless manner. The device driver module 222 receives the multimedia signal through the communication interface 21, and generates local data corresponding to the multimedia signal through operations such as demodulation, noise removal, sampling and/or signal amplification. For example, if the multimedia signal is transmitted wirelessly, the transmission format of the multimedia signal may conform to the specification of Real-time Transport Protocol (RTP). However, any transmission protocol can be used, and the present invention is not limited thereto.
应用程序储存模块223用以储存至少一通信应用程序。此至少一通信应用程序可分别用来与远端装置(例如，图1中的远端装置15)进行远端通信。例如，此至少一通信应用程序可包括Skype、微信、QQ或者任何透过网络与远端用户进行音/视频通信的网络通信应用程序。The application storage module 223 is used for storing at least one communication application. The at least one communication application program can be respectively used for remote communication with a remote device (eg, the remote device 15 in FIG. 1 ). For example, the at least one communication application program may include Skype, WeChat, QQ or any network communication application program for performing audio/video communication with remote users through the network.
应用程序执行模块224用以根据设备驱动模块222产生的本地数据执行此至少一通信应用程序的其中之一(亦称为第一通信应用程序)。例如，应用程序执行模块224可执行第一通信应用程序以发送本地数据至远端装置15及/或从远端装置15接收至少一远端数据。例如，本地数据与远端数据皆是透过互联网14进行传输，如图1所示。The application executing module 224 is used for executing one of the at least one communication application (also referred to as the first communication application) according to the local data generated by the device driver module 222 . For example, the application execution module 224 can execute the first communication application to send local data to the remote device 15 and/or receive at least one remote data from the remote device 15 . For example, both local data and remote data are transmitted through the Internet 14, as shown in FIG. 1 .
播放模块225用以在第一通信应用程序被执行时，提供第一通信应用程序的操作介面(亦称为第一操作介面)至显示装置11进行显示。每一个通信应用程序可以具有相同或不同的操作介面。根据所接收到的远端数据，播放模块225可以根据此远端数据中的视频数据在第一操作介面上显示相对应的一或多个远端影像。若远端数据中包括音频数据，则播放模块225还可以透过显示装置11或任意的声音输出装置(例如，外接式音响或耳机)来播放相对应的远端声音。远端装置15需安装有对应于第一通信应用程序的另一通信应用程序(亦称为第二通信应用程序)。第一通信应用程序与第二通信应用程序必须是相互匹配(match)的，但第一通信应用程序与第二通信应用程序可以相同也可以不同。远端装置15可在其萤幕上显示第二通信应用程序的操作介面(亦称为第二操作介面)。在接收到多媒体处理装置12发送的本地数据以后，远端装置15可以根据此本地数据中的视频数据在第二操作介面上显示多媒体处理装置12的一或多个本地影像。若本地数据中包括音频数据，则远端装置15也可以透过任意的声音输出装置来播放相对应的本地声音。藉此，透过多媒体通信系统10，本地端的用户可以在显示装置11的萤幕上观看远端影像或者同时听到远端声音，而远端的用户则可以在远端装置15的萤幕上观看本地影像或者同时听到本地声音。The playing module 225 is used for providing the operation interface (also referred to as the first operation interface) of the first communication application program to the display device 11 for display when the first communication application program is executed. Each communication application program can have the same or different operation interface. According to the received remote data, the playing module 225 can display one or more corresponding remote images on the first operation interface according to the video data in the remote data. If the remote data includes audio data, the playing module 225 can also play the corresponding remote sound through the display device 11 or any audio output device (eg, external stereo or earphone). The remote device 15 needs to be installed with another communication application (also called a second communication application) corresponding to the first communication application. The first communication application and the second communication application must match each other, but the first communication application and the second communication application may be the same or different. The remote device 15 can display the operation interface of the second communication application program (also referred to as the second operation interface) on its screen. After receiving the local data sent by the multimedia processing device 12, the remote device 15 can display one or more local images of the multimedia processing device 12 on the second operation interface according to the video data in the local data. If the local data includes audio data, the remote device 15 can also play the corresponding local sound through any audio output device. In this way, through the multimedia communication system 10, the local user can watch the remote image on the screen of the display device 11 or hear the remote sound at the same time, while the remote user can watch the local video on the screen of the remote device 15. video or hear local sound at the same time.
在一范例实施例中，每一个外部设备201～203或外部设备201～203中的一部分会安装有对应于设备驱动模块222的一配套服务模块，以搭配多媒体处理装置12使用。例如，在一范例实施例中，配套服务模块可反应于设备驱动模块222的控制指令来控制相对应的外部设备201～203。此外，在一范例实施例中，配套服务模块也可以负责信号的格式转换、与多媒体处理装置12之间连线的建立、或者外部设备中软/固件的更新等操作。In an exemplary embodiment, each of the external devices 201 - 203 or a part of the external devices 201 - 203 is installed with a supporting service module corresponding to the device driver module 222 for use with the multimedia processing device 12 . For example, in an exemplary embodiment, the supporting service module can control the corresponding external devices 201 - 203 in response to the control command of the device driver module 222 . In addition, in an exemplary embodiment, the supporting service module may also be responsible for signal format conversion, establishing a connection with the multimedia processing device 12, or updating software/firmware in external devices.
图3是根据本发明的一范例实施例所绘示的外部设备与多媒体处理装置之间的通信的示意图。在此同样是以外部设备203作为范例，而外部设备201与202可以此类推。FIG. 3 is a schematic diagram illustrating communication between an external device and a multimedia processing device according to an exemplary embodiment of the present invention. Here too, the external device 203 is taken as an example, and the external devices 201 and 202 can be deduced by analogy.
请参照图3，外部设备203安装有配套服务模块31。配套服务模块31是软件或固件模块，并且可被外部设备203的处理器(未绘示)或微处理器(未绘示)运行。在本范例实施例中，配套服务模块31用以将摄像头2031即时撷取到的影像及/或收音器2032即时撷取到的声音转换为第一多媒体信号，并透过外部设备203的通信接口(未绘示)将此第一多媒体信号传输至多媒体处理装置12。特别是，在一范例实施例中，多媒体处理装置12的设备驱动模块222可发送控制指令(亦称为第一控制指令)至外部设备203，其中此第一控制指令用以指示外部设备203开始或停止传送第一多媒体信号。例如，在接收到第一控制指令之后，若此第一控制指令是指示开始传送第一多媒体信号，则配套服务模块31会启动摄像头2031及收音器2032，将摄像头2031即时撷取到的影像及/或收音器2032即时撷取到的声音转换为第一多媒体信号，并且开始传送第一多媒体信号至多媒体处理装置12。若此第一控制指令是指示停止或暂停传送第一多媒体信号，则配套服务模块31会关闭摄像头2031及收音器2032，并且停止传送第一多媒体信号。此外，第一控制指令也可以包含不同的指示策略，例如，指示启动摄像头2031但不启动收音器2032、指示不启动摄像头2031但启动收音器2032、指示经过一预设时间(亦称为第一预设时间)后自动启动摄像头2031及/或收音器2032、或者经过另一预设时间(亦称为第二预设时间)后自动关闭摄像头2031及/或收音器2032等等，且不限于此。设备驱动模块222可以是根据本地用户的操作或者定时自动发送此第一控制指令。Referring to FIG. 3 , the external device 203 is installed with a supporting service module 31 . The supporting service module 31 is a software or firmware module, and can be executed by a processor (not shown) or a microprocessor (not shown) of the external device 203 . In this exemplary embodiment, the ancillary service module 31 is used to convert the image captured by the camera 2031 and/or the sound captured by the radio 2032 into a first multimedia signal, and through the external device 203 The communication interface (not shown) transmits the first multimedia signal to the multimedia processing device 12 . In particular, in an exemplary embodiment, the device driver module 222 of the multimedia processing device 12 can send a control command (also referred to as a first control command) to the external device 203, wherein the first control command is used to instruct the external device 203 to start Or stop transmitting the first multimedia signal. For example, after receiving the first control command, if the first control command indicates to start transmitting the first multimedia signal, then the supporting service module 31 will activate the camera 2031 and the radio 2032, and capture the information captured by the camera 2031 in real time. The video and/or sound captured by the audio receiver 2032 is converted into the first multimedia signal in real time, and starts to transmit the first multimedia signal to the multimedia processing device 12 . If the first control command indicates to stop or suspend the transmission of the first multimedia signal, the supporting service module 31 will turn off the camera 2031 and the microphone 2032, and stop transmitting the first multimedia signal. In addition, the first control command may also include different instruction strategies, for example, instructing to activate the camera 2031 but not to activate the radio 2032, to instruct not to activate the camera 2031 but to activate the radio 2032, to instruct to pass a preset time (also referred to as the first automatically start the camera 2031 and/or the radio 2032 after the preset time), or automatically turn off the camera 2031 and/or the radio 2032 after another preset time (also referred to as the second preset time), and are not limited to this. The device driver module 222 may automatically send the first control instruction according to a local user's operation or timing.
在一范例实施例中，设备驱动模块222可以根据由两个或两个以上的外部设备传送的多媒体信号来产生本地数据。以外部设备201(亦称为第二外部设备)与203为例，在一范例实施例中，设备驱动模块222可接收外部设备203即时产生的第一多媒体信号与外部设备201即时产生的多媒体信号(亦称为第二多媒体信号)，并且根据第一多媒体信号与第二多媒体信号产生本地数据。此时，所产生的本地数据是对应至第一多媒体信号与第二多媒体信号。其中，第一多媒体信号对应于第一外部设备所即时撷取到的第一影像及/或第一声音，并且第二多媒体信号对应于第二外部设备所即时撷取到的影像(亦称为第二影像)及/或声音(亦称为第二声音)。若第二外部设备具有摄像头(亦称为第二摄像头)及/或收音器(亦称为第二收音器)，则第二多媒体信号是转换第二摄像头即时撷取到的第二影像及/或第二收音器即时撷取到的第二声音而获得。然而，在此范例中，由于外部设备201不具有收音器，因此第二多媒体信号仅对应于外部设备201所即时撷取到的影像。In an exemplary embodiment, the device driver module 222 may generate local data according to multimedia signals transmitted by two or more external devices. Taking the external device 201 (also referred to as the second external device) and 203 as an example, in an exemplary embodiment, the device driver module 222 can receive the first multimedia signal generated by the external device 203 and the first multimedia signal generated by the external device 201 immediately. A multimedia signal (also referred to as a second multimedia signal), and local data is generated according to the first multimedia signal and the second multimedia signal. At this time, the generated local data is corresponding to the first multimedia signal and the second multimedia signal. Wherein, the first multimedia signal corresponds to the first image and/or the first sound captured by the first external device in real time, and the second multimedia signal corresponds to the image captured by the second external device in real time (also known as the second image) and/or sound (also known as the second sound). If the second external device has a camera (also referred to as a second camera) and/or a receiver (also referred to as a second receiver), the second multimedia signal is to convert the second image captured by the second camera in real time And/or the second sound captured by the second receiver in real time. However, in this example, since the external device 201 does not have a receiver, the second multimedia signal only corresponds to the image captured by the external device 201 in real time.
若本地数据是对应于来自不同的外部设备的两个或两个以上的多媒体信号，则根据此本地数据，第一通信应用程序的第一操作介面及/或第二通信应用程序的第二操作介面上可显示有两个或两个以上的本地影像。可供显示的本地影像的数量与来自不同的外部设备的多媒体信号的数量一致。例如，第一多媒体信号是由外部设备203即时产生且发送的，且第二多媒体信号是由外部设备201即时产生且发送的，则远端装置15可以选择在其萤幕上同时显示对应于第一多媒体信号的本地影像与对应于第二多媒体信号的本地影像，或者仅显示对应于第一多媒体信号或第二多媒体信号的本地影像。此播放方式同样适用于多媒体处理装置12，并且类似地，对应于不同多媒体信号的多个本地声音也可以被选择同时或者择一播放。此外，若远端装置15的数量是多个及/或远端数据是对应至多个远端多媒体信号，则多个远端影像及/或远端声音也可以被选择在第一操作介面上同时或择一播放。If the local data corresponds to two or more multimedia signals from different external devices, then according to the local data, the first operation interface of the first communication application and/or the second operation of the second communication application Two or more local images can be displayed on the interface. The number of local images available for display corresponds to the number of multimedia signals from different external devices. For example, if the first multimedia signal is generated and transmitted by the external device 203 in real time, and the second multimedia signal is generated and transmitted by the external device 201 in real time, the remote device 15 can choose to simultaneously display the The local image corresponding to the first multimedia signal and the local image corresponding to the second multimedia signal, or only the local image corresponding to the first multimedia signal or the second multimedia signal is displayed. This playing method is also applicable to the multimedia processing device 12, and similarly, multiple local sounds corresponding to different multimedia signals can also be selected to be played simultaneously or alternatively. In addition, if the number of remote devices 15 is multiple and/or the remote data is corresponding to multiple remote multimedia signals, then multiple remote images and/or remote sounds can also be selected on the first operation interface at the same time Or choose one to play.
在一范例实施例中，配置在外部设备中的配套服务模块也可以用来发送用来决定第一操作介面的显示模式的控制指令(亦称为第二控制指令)或用来决定第二操作介面的显示模式的控制指令(亦称为第三控制指令)至多媒体处理装置12。例如，在图3的另一范例实施例中，根据用户的操作，外部设备203的配套服务模块31可发送第二控制指令至多媒体处理装置12。多媒体处理装置12的设备驱动模块222可接收此第二控制指令，并且应用程序执行模块224会根据此第二控制指令决定本地数据所对应的至少一本地影像及/或至少一远端影像在本地端的第一操作介面上的显示模式。例如，此第二控制指令可以用以决定一或多个本地影像及/或一或多个远端影像在第一操作介面上的显示位置及/或显示尺寸。此外，在另一范例实施例中，此第二控制指令也可以用以决定要在第一操作介面上显示哪一个本地影像及/或哪一个远端影像，或者决定第一操作介面的任何显示参数。In an exemplary embodiment, the supporting service module configured in the external device can also be used to send a control command (also called a second control command) used to determine the display mode of the first operation interface or to determine the second operation The control command of the display mode of the interface (also referred to as the third control command) is sent to the multimedia processing device 12 . For example, in another exemplary embodiment shown in FIG. 3 , according to the user's operation, the supporting service module 31 of the external device 203 can send the second control command to the multimedia processing device 12 . The device driver module 222 of the multimedia processing device 12 can receive the second control instruction, and the application program execution module 224 will determine at least one local image and/or at least one remote image corresponding to the local data in the local The display mode on the first operation interface of the terminal. For example, the second control command can be used to determine the display position and/or display size of one or more local images and/or one or more remote images on the first operation interface. In addition, in another exemplary embodiment, the second control command can also be used to determine which local image and/or which remote image to display on the first operation interface, or determine any display on the first operation interface parameter.
图4与图5是根据本发明的一范例实施例所绘示的第一操作介面的示意图。FIG. 4 and FIG. 5 are schematic diagrams of a first operation interface according to an exemplary embodiment of the present invention.
请参照图4与图5，假设显示装置11上的第一操作介面401显示有本地影像41、本地影像42、远端影像43及远端影像44，并且本地影像41、本地影像42、远端影像43及远端影像44的显示位置与显示尺寸都是平均配置(如图4所示)。在设备驱动模块222接收到第二控制指令后，应用程序执行模块224会根据第二控制指令的指示来调整第一操作介面401的显示模式。例如，根据第二控制指令，本地影像41与本地影像42被缩小及/或往第一操作介面401的一侧边或其角落移动，而远端影像43与远端影像44则被放大及/或往第一操作介面401的中央移动或延伸(如图5所示)。此外，在另一例中，若第二控制指令是指示不显示部分或全部的本地影像或者不显示部分或全部的远端影像，则在第一操作介面401上对应的本地影像41、本地影像42、远端影像43及远端影像44的至少其中之一会被隐藏。或者，在一范例实施例中，本地影像41、本地影像42、远端影像43及远端影像44的部份或全部也可以是重叠显示或者是三维(3D)环绕显示等，并且根据第二控制指令，应用程序执行模块224会将本地影像41、本地影像42、远端影像43及远端影像44的其中之一或部分移动到第一操作介面401的最上层或中间位置。任意的影像排列与布局都可以被套用至第一操作介面401上。本地端的用户可透过第二控制指令来对第一操作介面401的显示模式进行调整(例如，放大、缩小、隐藏或移动某个影像等等)。此外，第二控制指令也可以包括对于多媒体处理装置12播放的声音的输出模式进行调整(例如，提高/降低某个声音的音量、或者将某个声音消音等等)。Please refer to FIG. 4 and FIG. 5, assuming that the first operation interface 401 on the display device 11 displays a local image 41, a local image 42, a remote image 43, and a remote image 44, and the local image 41, the local image 42, the remote image The display positions and display sizes of the image 43 and the remote image 44 are averagely configured (as shown in FIG. 4 ). After the device driver module 222 receives the second control instruction, the application execution module 224 adjusts the display mode of the first operation interface 401 according to the instruction of the second control instruction. For example, according to the second control command, the local image 41 and the local image 42 are zoomed out and/or moved to one side or a corner of the first operation interface 401, while the remote image 43 and the remote image 44 are enlarged and/or Or move or extend toward the center of the first operation interface 401 (as shown in FIG. 5 ). In addition, in another example, if the second control command indicates not to display part or all of the local image or not to display part or all of the remote image, the corresponding local image 41 and local image 42 on the first operation interface 401 At least one of , the far-end image 43 and the far-end image 44 will be hidden. Or, in an exemplary embodiment, part or all of the local image 41, the local image 42, the remote image 43, and the remote image 44 may also be displayed in overlapping or three-dimensional (3D) surround display, etc., and according to the second According to the control instruction, the application execution module 224 will move one or part of the local image 41 , the local image 42 , the remote image 43 and the remote image 44 to the uppermost layer or the middle position of the first operation interface 401 . Arbitrary image arrangement and layout can be applied to the first operation interface 401 . The local user can adjust the display mode of the first operation interface 401 (for example, zoom in, zoom out, hide or move a certain image, etc.) through the second control command. In addition, the second control instruction may also include adjusting the output mode of the sound played by the multimedia processing device 12 (for example, increasing/decreasing the volume of a certain sound, or muting a certain sound, etc.).
在图3的另一范例实施例中，根据用户的操作，外部设备203的配套服务模块31可发送第三控制指令至多媒体处理装置12。多媒体处理装置12的设备驱动模块222可接收此第三控制指令，并且应用程序执行模块224会根据此第三控制指令决定本地数据所对应的至少一本地影像在远端装置15的第二操作介面上的显示模式。In another exemplary embodiment of FIG. 3 , according to the user's operation, the supporting service module 31 of the external device 203 can send a third control command to the multimedia processing device 12 . The device driver module 222 of the multimedia processing device 12 can receive the third control command, and the application execution module 224 will determine the second operation interface of at least one local image corresponding to the local data on the remote device 15 according to the third control command. on the display mode.
图6与图7是根据本发明的一范例实施例所绘示的第二操作介面的示意图。FIG. 6 and FIG. 7 are schematic diagrams of a second operation interface according to an exemplary embodiment of the present invention.
请参照图6与图7，假设远端装置15上的第二操作介面601显示有本地影像61、本地影像62、远端影像63及远端影像64，并且本地影像61、本地影像62、远端影像63及远端影像64的显示位置与显示尺寸都是平均配置(如图6所示)。在设备驱动模块222接收到第三控制指令后，应用程序执行模块224会根据第三控制指令的指示而在欲传送至远端装置15的本地数据中嵌入一个调整指令，以透过此调整指令来调整第二操作介面601的显示模式。例如，根据此调整指令，远端影像63与远端影像64被缩小及/或往第二操作介面601的一侧边或其角落移动，而本地影像61与本地影像62则被放大及/或往第二操作介面601的中央移动或延伸(如图7所示)。此外，在另一例中，若第三控制指令是指示不显示部分或全部的本地影像或者不显示部分或全部的远端影像，则在第二操作介面601上对应的本地影像61、本地影像62、远端影像63及远端影像64的至少其中之一会被隐藏。类似于第一操作介面，任意的影像排列与布局都可以被套用至第二操作介面601上。本地端的用户可透过第三控制指令来对第二操作介面601的显示模式进行调整(例如，放大、缩小、隐藏或移动某个影像等等)。此外，第三控制指令也可以包括对于远端装置15播放的声音的输出模式进行调整(例如，提高/降低某个声音的音量、或者将某个声音消音等等)。虽然上述范例实施例是以内嵌调整指令的方式来调整远端装置15上的第二操作介面601的显示模式及/或声音输出模式，然而，在另一范例实施例中，也可以是透过直接修改欲传送至远端装置15的影像/声音数据的方式来调整远端装置15上的第二操作介面601的显示模式及/或声音输出模式。Please refer to FIG. 6 and FIG. 7, assuming that the second operation interface 601 on the remote device 15 displays a local image 61, a local image 62, a remote image 63, and a remote image 64, and the local image 61, the local image 62, the remote The display positions and display sizes of the end image 63 and the far end image 64 are all configured on average (as shown in FIG. 6 ). After the device driver module 222 receives the third control instruction, the application program execution module 224 will embed an adjustment instruction in the local data to be transmitted to the remote device 15 according to the instruction of the third control instruction, so as to pass the adjustment instruction to adjust the display mode of the second operation interface 601 . For example, according to the adjustment command, the remote image 63 and the remote image 64 are zoomed out and/or moved to one side or a corner of the second operation interface 601, while the local image 61 and the local image 62 are enlarged and/or Move or extend toward the center of the second operation interface 601 (as shown in FIG. 7 ). In addition, in another example, if the third control command indicates not to display part or all of the local image or not to display part or all of the remote image, then the corresponding local image 61 and local image 62 on the second operation interface 601 At least one of , the far-end image 63 and the far-end image 64 will be hidden. Similar to the first operation interface, any arrangement and layout of images can be applied to the second operation interface 601 . The local user can adjust the display mode of the second operation interface 601 (for example, zoom in, zoom out, hide or move a certain image, etc.) through the third control command. In addition, the third control instruction may also include adjusting the output mode of the sound played by the remote device 15 (for example, increasing/decreasing the volume of a certain sound, or muting a certain sound, etc.). Although the above exemplary embodiment adjusts the display mode and/or sound output mode of the second operation interface 601 on the remote device 15 in the form of an embedded adjustment command, however, in another exemplary embodiment, it may also be through The display mode and/or the audio output mode of the second operation interface 601 on the remote device 15 are adjusted by directly modifying the image/audio data to be transmitted to the remote device 15 .
值得一提的是，上述第二控制指令与第三控制指令可以是由当前发送多媒体信号的外部设备或者其他的外部设备来发送。例如，在一范例实施例中，只有当前正在发送多媒体信号至多媒体处理装置12的外部设备拥有发送上述第二控制指令与第三控制指令的权限。在另一范例实施例中，只有属于主控(master)装置的外部设备拥有发送上述第二控制指令与第三控制指令的权限，而此属于主控装置的外部设备不一定正在发送多媒体信号。或者，属于主控装置的外部设备也可能没有影像及/或声音的撷取功能。例如，属于主控装置的外部设备可以是遥控器或行动装置等等。It is worth mentioning that the above-mentioned second control instruction and third control instruction may be sent by the external device currently sending the multimedia signal or other external devices. For example, in an exemplary embodiment, only the external device currently sending the multimedia signal to the multimedia processing device 12 has the right to send the above-mentioned second control command and third control command. In another exemplary embodiment, only the external device belonging to the master device has the right to send the second control command and the third control command, and the external device belonging to the master device may not be sending multimedia signals. Alternatively, the external device belonging to the main control device may not have the image and/or sound capture function. For example, the external device belonging to the main control device may be a remote control or a mobile device and so on.
在一范例实施例中，若本地端的用户想要以某一个外部设备(例如，第一外部设备)作为多媒体信号的输入，则设备驱动模块222会先查询此第一外部设备的设备信息是否已被记载于设备配置模块221的设备清单中。若此第一外部设备的设备信息已被记载于此设备清单中，则设备驱动模块222会根据第一外部设备的设备信息在本地网络中搜寻此第一外部设备。在找到此第一外部设备后，设备驱动模块222会直接利用此第一外部设备的设备信息来与第一外部设备建立无线连线，并且在建立无线连线之后，接收来自第一外部设备的多媒体信号。若此第一外部设备的设备信息没有被记载于此设备清单中，则设备驱动模块222会先在本地网络中搜寻可能存在的外部设备，并且在找到此第一外部设备后，执行分派连线金钥与建立无线连线等步骤。在无线连线被建立后，设备配置模块221会将此第一外部设备的设备信息记录至设备清单中。类似地，若某一个外部设备(例如，第一外部设备)欲被加入至多媒体通信系统10中，则同样可透过上述操作来将对应的设备信息新增至设备清单中。或者，用户也可以透过手动输入的方式来将外部设备的设备信息新增至设备清单中。在本范例实施例中，上述本地网络是指一个本地局域网络或一个本地虚拟网络。在另一范例实施例中，若一个外部设备是在一或多个本地无线适配器(wirelessadaptor)的无线信号(例如，WiFi)涵盖范围内，则此外部设备可视为是属于本地网络。In an exemplary embodiment, if the user at the local end wants to use a certain external device (for example, a first external device) as an input of a multimedia signal, the device driver module 222 will first inquire whether the device information of the first external device has been It is recorded in the device list of the device configuration module 221 . If the device information of the first external device has been recorded in the device list, the device driver module 222 searches for the first external device in the local network according to the device information of the first external device. After finding the first external device, the device driver module 222 will directly use the device information of the first external device to establish a wireless connection with the first external device, and after establishing the wireless connection, receive a message from the first external device multimedia signal. If the device information of the first external device is not recorded in the device list, the device driver module 222 will first search for possible external devices in the local network, and after finding the first external device, execute the dispatch connection key and establish a wireless connection and other steps. After the wireless connection is established, the device configuration module 221 will record the device information of the first external device into the device list. Similarly, if a certain external device (for example, the first external device) is to be added to the multimedia communication system 10, the corresponding device information can also be added to the device list through the above operations. Alternatively, the user may also add the device information of the external device to the device list by manually inputting. In this exemplary embodiment, the aforementioned local network refers to a local local area network or a local virtual network. In another exemplary embodiment, if an external device is within the coverage range of one or more local wireless adapters (eg, WiFi), the external device may be considered to belong to the local network.
此外，本发明并不限制多媒体处理装置所执行的远端通信是音频通信、视频通信、或是结合音频与视频的通信。例如，在一范例实施例中，多媒体处理装置12所执行的远端通信仅包含音频通信。在一范例实施例中，多媒体处理装置12所执行的远端通信仅包含视频通信。在一范例实施例中，多媒体处理装置12所执行的远端通信则同时包含音频与视频的通信。In addition, the present invention does not limit the remote communication performed by the multimedia processing device to be audio communication, video communication, or a combination of audio and video communication. For example, in an exemplary embodiment, the remote communication performed by the multimedia processing device 12 only includes audio communication. In an exemplary embodiment, the remote communication performed by the multimedia processing device 12 only includes video communication. In an exemplary embodiment, the remote communication performed by the multimedia processing device 12 includes both audio and video communication.
图8是根据本发明的一范例实施例所绘示多媒体通信系统的使用情境示意图。FIG. 8 is a schematic diagram of a usage scenario of a multimedia communication system according to an exemplary embodiment of the present invention.
请参照图8，在家里的客厅中，外部设备1306是用来撷取用户A的影像，并且将对应于用户A的影像的多媒体信号发送至多媒体处理装置12；外部设备1303是用来撷取用户A的声音，并且将对应于用户A的声音的多媒体信号发送至多媒体处理装置12；外部设备1301是用来撷取用户B的影像与声音，并且将对应于用户B的影像与声音的多媒体信号发送至多媒体处理装置12。显示装置11会显示通信应用程序的操作介面801，此通信应用程序例如是Skype等网络音/视频通信应用程序。操作介面801上显示有本地影像81、82及远端影像83。本地影像81对应于外部设备1306，本地影像82对应于外部设备1301。此外，本地声音会透过多媒体处理装置12传送给远端的用户C。藉此，用户A与B可以透过图8中的多媒体通信系统与远端影像83中的用户C进行远端通信。此外，本发明的多媒体通信系统并不限于图8的范例实施例的使用情境，而还可以例如是应用于老人/幼儿居家照护、多人远端会议等等。在远端通信中，多媒体通信系统中部份的外部设备还可以用来输入文字、预先下载的图片、音乐或影片等多媒体档案至多媒体处理装置12，以增添乐趣与使用上的多元性。Please refer to FIG. 8 , in the living room at home, the external device 1306 is used to capture the image of user A, and sends the multimedia signal corresponding to the image of user A to the multimedia processing device 12; the external device 1303 is used to capture The voice of user A, and the multimedia signal corresponding to the voice of user A is sent to the multimedia processing device 12; The signal is sent to the multimedia processing device 12 . The display device 11 displays an operation interface 801 of a communication application program, such as an Internet audio/video communication application program such as Skype. Local images 81 , 82 and remote images 83 are displayed on the operation interface 801 . The local image 81 corresponds to the external device 1306 , and the local image 82 corresponds to the external device 1301 . In addition, the local audio will be transmitted to the remote user C through the multimedia processing device 12 . In this way, users A and B can perform remote communication with user C in the remote image 83 through the multimedia communication system in FIG. 8 . In addition, the multimedia communication system of the present invention is not limited to the usage scenarios of the exemplary embodiment shown in FIG. 8 , but can also be applied, for example, to home care for the elderly/children, multi-person teleconferencing, and the like. In remote communication, some external devices in the multimedia communication system can also be used to input multimedia files such as text, pre-downloaded pictures, music or videos to the multimedia processing device 12 to increase fun and use diversity.
值得一提的是，在一范例实施例中，图2中的设备配置模块221、设备驱动模块222、应用程序储存模块223、应用程序执行模块224及播放模块225分别是一个软件模块或固件模块。设备配置模块221、设备驱动模块222、应用程序储存模块223、应用程序执行模块224及播放模块225可以是储存在储存媒体22中，或者是直接烧录在处理器23中。在另一范例实施例中，设备配置模块221、设备驱动模块222、应用程序储存模块223、应用程序执行模块224及播放模块225也可以分别是以硬件电路来实作，而可提供相对应的功能。应用程序执行模块224是属于应用层(usermode)，而设备驱动模块222是属于驱动层(kernelmode)。It is worth mentioning that, in an exemplary embodiment, the device configuration module 221, the device driver module 222, the application program storage module 223, the application program execution module 224 and the playback module 225 in FIG. 2 are respectively a software module or a firmware module . The device configuration module 221 , the device driver module 222 , the application program storage module 223 , the application program execution module 224 and the playback module 225 may be stored in the storage medium 22 or directly burned in the processor 23 . In another exemplary embodiment, the device configuration module 221, the device driver module 222, the application program storage module 223, the application program execution module 224, and the playback module 225 can also be implemented by hardware circuits respectively, and corresponding Features. The application execution module 224 belongs to the application layer (usermode), and the device driver module 222 belongs to the driver layer (kernelmode).
图9是根据本发明的一范例实施例所绘示的多媒体通信方法的示意图。此多媒体通信方法适用于上述多媒体处理装置。FIG. 9 is a schematic diagram of a multimedia communication method according to an exemplary embodiment of the present invention. The multimedia communication method is suitable for the above-mentioned multimedia processing device.
请参照图9，在步骤S901中，提供设备清单，其用以记录至少一外部设备的设备信息。在步骤S902中，接收所述外部设备中的第一外部设备即时产生的第一多媒体信号，并且用以根据第一多媒体信号产生本地数据。在步骤S903中，根据本地数据执行第一通信应用程序。在步骤S904中，提供第一通信应用程序的第一操作介面至显示装置进行显示。Referring to FIG. 9, in step S901, a device list is provided, which is used to record device information of at least one external device. In step S902, a first multimedia signal generated immediately by a first external device among the external devices is received, and used to generate local data according to the first multimedia signal. In step S903, the first communication application program is executed according to the local data. In step S904, the first operation interface of the first communication application is provided to the display device for display.
然而，图9中各步骤已详细说明如上，在此便不再赘述。值得注意的是，图9中各步骤可以实作为多个程序码或是电路，本发明并不在此限。此外，图9的方法可以搭配以上实施例使用，也可以单独使用，本发明并不在此限。However, each step in FIG. 9 has been described in detail above, and will not be repeated here. It should be noted that each step in FIG. 9 can be implemented as a plurality of program codes or circuits, and the present invention is not limited thereto. In addition, the method in FIG. 9 can be used in conjunction with the above embodiments, or can be used alone, and the present invention is not limited thereto.
综上所述，根据本发明的一范例实施例的多媒体处理装置与多媒体通信系统，即使多媒体处理装置本身不具有摄像头或收音器，透过外部设备即时撷取的影像或声音，多媒体处理装置即可进行远端通信。相对于总是设置在电视机旁的多媒体处理装置，外部设备可以分散设置在家中的各个房间、角落或者集中设置，以采集不同用户、不同位置或者不同角度的影像或声音，从而提升使用乐趣与便利性。In summary, according to a multimedia processing device and a multimedia communication system according to an exemplary embodiment of the present invention, even if the multimedia processing device itself does not have a camera or a receiver, the multimedia processing device can instantly capture the image or sound through an external device. Remote communication is possible. Compared with the multimedia processing device that is always installed next to the TV, the external devices can be scattered and installed in various rooms, corners or centrally installed in the home to collect images or sounds from different users, different positions or different angles, thereby improving the fun of use and convenience.
虽然本发明已以实施例揭露如上，然其并非用以限定本发明，任何本领域技术人员，在不脱离本发明的精神和范围内，当可作些许的更动与润饰，故本发明的保护范围当视后附的权利要求所界定者为准。Although the present invention has been disclosed above with the embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the present invention The scope of protection shall prevail as defined by the appended claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410414372.9ACN105451089A (en) | 2014-08-21 | 2014-08-21 | Multimedia processing device and multimedia communication system |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410414372.9ACN105451089A (en) | 2014-08-21 | 2014-08-21 | Multimedia processing device and multimedia communication system |
| Publication Number | Publication Date |
|---|---|
| CN105451089Atrue CN105451089A (en) | 2016-03-30 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410414372.9APendingCN105451089A (en) | 2014-08-21 | 2014-08-21 | Multimedia processing device and multimedia communication system |
| Country | Link |
|---|---|
| CN (1) | CN105451089A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107783685A (en)* | 2016-08-24 | 2018-03-09 | 英业达科技有限公司 | Tool sense of touch experience multimedia immediate interactive system and its method are provided |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002030117A1 (en)* | 2000-09-29 | 2002-04-11 | Digeo, Inc. | Systems and methods for video and audio capture and communication |
| US20090125955A1 (en)* | 2007-11-08 | 2009-05-14 | At&T Bls Intellectual Property, Inc | Methods, computer program products, and virtual servers for a virtual collaborative environment |
| CN102726055A (en)* | 2010-01-25 | 2012-10-10 | Lg电子株式会社 | Video communication method and digital television using the same |
| CN102736565A (en)* | 2011-04-02 | 2012-10-17 | 成都齐峰科技有限公司 | Communication method of automatic control equipment based on upper and lower computer structures |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2002030117A1 (en)* | 2000-09-29 | 2002-04-11 | Digeo, Inc. | Systems and methods for video and audio capture and communication |
| US20090125955A1 (en)* | 2007-11-08 | 2009-05-14 | At&T Bls Intellectual Property, Inc | Methods, computer program products, and virtual servers for a virtual collaborative environment |
| CN102726055A (en)* | 2010-01-25 | 2012-10-10 | Lg电子株式会社 | Video communication method and digital television using the same |
| CN102736565A (en)* | 2011-04-02 | 2012-10-17 | 成都齐峰科技有限公司 | Communication method of automatic control equipment based on upper and lower computer structures |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107783685A (en)* | 2016-08-24 | 2018-03-09 | 英业达科技有限公司 | Tool sense of touch experience multimedia immediate interactive system and its method are provided |
| Publication | Publication Date | Title |
|---|---|---|
| EP3195606B1 (en) | Direct streaming for wireless display | |
| JP6626440B2 (en) | Method and apparatus for playing multimedia files | |
| KR102284721B1 (en) | Method and apparatus for displaying application data in wireless communication system | |
| TW201840176A (en) | System and method for wireless screen projection | |
| CN105144143A (en) | Pre-caching of audio content | |
| CN104519397A (en) | Audio and video screen-projection playing method, set-top box and terminal device | |
| US9357215B2 (en) | Audio output distribution | |
| JP2016535351A (en) | Video information sharing method, apparatus, program, and recording medium | |
| JP6385429B2 (en) | Method and apparatus for reproducing stream media data | |
| JP2007306570A (en) | Accessing data resources that use a pause point | |
| KR102063463B1 (en) | Multimedia information reproduction method and system, standardization server, live broadcasting terminal | |
| CN103873798A (en) | Sound playing method and device for intelligent television | |
| KR102397886B1 (en) | Electronic device, user terminal apparatus, and control method thereof | |
| JP2017501598A5 (en) | ||
| US20140140674A1 (en) | Wireless transmission of media to an audio/visual output device | |
| CN106095132B (en) | Method and device for setting key function of playing equipment | |
| CN204215585U (en) | Children-story machine | |
| KR20160132049A (en) | Method and device for providing contents in communication system | |
| TWI578795B (en) | Multimedia device and video communication method | |
| CN104683854A (en) | A multimedia playback control method and device | |
| TW201421287A (en) | Devices, methods and electronic equipments for playback controlling | |
| CN105451089A (en) | Multimedia processing device and multimedia communication system | |
| CN105307007A (en) | Program sharing method, apparatus and system | |
| CN103888814A (en) | Hdmi signal processing system and method | |
| US20130315417A1 (en) | Bluethooth-to-rf tranceiver |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | Application publication date:20160330 |