US20190239056A1 - Communication apparatus control method and storage medium - Google Patents

Abstract

A communication apparatus selects to transmit a first signal indicating that the communication apparatus can execute a first function of transmitting data on which output processing is performed by an output unit to an external apparatus, a second signal indicating that the communication apparatus can execute a second function of receiving data on which output processing is performed by an external apparatus and performing output processing based on the received data, or a third signal indicating that the communication apparatus can execute both the first function and the second function, based on a function of a first external communication apparatus that is connecting to the communication apparatus, and connects to a second external communication apparatus that has responded to one of the selected and transmitted signals.

Description

CROSS-REFERENCE TO RELATED APPLICATION
• This application is a Continuation of U.S. application Ser. No. 15/414,038, filed Jan. 24, 2017, which claims priority from Japanese Patent Application No. 2016-016374, filed Jan. 29, 2016, which are hereby incorporated by reference herein in their entireties.
BACKGROUNDField
• Aspects of the present disclosure generally relate to an apparatus that transmits and receives data on which output processing is to be performed.
Description of the Related Art
• In recent years, a mirroring technology for sharing display screen data wirelessly has been standardized as Wi-Fi® Display (Miracast®). Mirroring is a technique to share the content of a display screen by transmitting display screen data that is being displayed by a transmitting apparatus to a receiving apparatus via a network and allowing the receiving apparatus to output the same display screen as that of the transmitting apparatus. In Wi-Fi® Display, a source device, which has the function of transmitting display screen data, a sink device, which has the function of receiving display screen data, and a dual-role device, which has both of those functions, are defined as various roles.
• A method for determining whether each audio/video apparatus serves as a source device or a sink device has been proposed in Japanese Patent Application Laid-Open No. 2014-509821 (Japanese translation of a PCT patent application).
• In Wi-Fi® Display, the dual-role device notifies an external communication apparatus that the dual-role device has both the function serving as a source device (source function) and the function serving as a sink device (sink function). However, even a dual-role device can use only one of the source function and the sink function to communicate with an external communication apparatus that is newly targeted for connection.
• For example, there can be considered a case where the number of devices to which the dual-role device when serving as a source device is allowed to connect is limited to one. In such a situation, when the dual-role device when serving as a source device has already been connecting to one sink device, the dual-role device is not able to connect to a new sink device. However, if the dual-role device notifies the new sink device that the dual-role device has both the function serving as a source device and the function serving as a sink device, the dual-role device can perform connection processing with the new sink device in spite of the fact that the dual-role device is unable to communicate with the new sink device.
SUMMARY
• Aspects of embodiments are generally directed to enabling an apparatus including both the function of transmitting data to an external apparatus and the function of performing output processing based on received data to perform a notification adapted to a situation.
• According to an aspect of embodiments, a communication apparatus includes an output unit configured to perform output processing based on data, a first transmission unit configured to transmit a first signal indicating that the communication apparatus can execute a first function of transmitting data on which output processing is performed by the output unit to an external apparatus, a second transmission unit configured to transmit a second signal indicating that the communication apparatus can execute a second function of receiving data on which output processing is performed by an external apparatus and performing output processing based on the received data, a third transmission unit configured to transmit a third signal indicating that the communication apparatus can execute both the first function and the second function, a determination unit configured to determine in which of the first function and the second function a first external communication apparatus connecting to the communication apparatus is operating, a selection unit configured to select whether to transmit the first signal, the second signal, or the third signal based on a result of determination by the determination unit, and a connection unit configured to connect to a second external communication apparatus that has responded to one of the first, second, or third signals selected by the selection unit and transmitted.
• Further features will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
• FIG. 1 a network configuration diagram of a communication system.
• FIG. 2 is a hardware configuration diagram of a communication apparatus.
• FIG. 3 is a flowchart illustrating processing performed when the communication apparatus performs mirroring processing of a monitor screen.
• FIG. 4 is a flowchart illustrating processing performed when the communication apparatus switches its roles.
• FIG. 5 is a flowchart illustrating processing performed when the communication apparatus detects an external communication apparatus.
• FIG. 6 is a flowchart illustrating processing performed when the communication apparatus connects to an external communication apparatus.
• FIG. 7 is a sequence chart illustrating processing performed when the communication apparatus connects to an external communication apparatus.
• FIG. 8 is a sequence chart illustrating processing performed when the communication apparatus connects to an external communication apparatus.
DESCRIPTION OF THE EMBODIMENTS
• FIG. 1 illustrates a network configuration of a communication system according to an exemplary embodiment. In awireless network110, a communication apparatus101 performs wireless communications withexternal communication apparatuses102 and103. Here, the communication apparatus101 operates in conformity with the Miracast® standard. In the Miracast® standard, a Source function, a Sink function, and a Dual-Role function are prescribed.
• The Source function is a function of transmitting, to an external apparatus, data which is output from an output unit (a display or a speaker) included in the communication apparatus101 and allowing an output unit included in the external apparatus to perform output processing that is based on the data. An apparatus having the Source function is referred to as a “source device”. The Sink function is a function of receiving data which is output from an output unit included in an external apparatus and allowing an output unit included in the communication apparatus101 to perform output processing that is based on the received data. An apparatus having the Sink function is referred to as a “sink device”. In Wi-Fi® Display, the source device and the sink device are paired to perform data communication.
• The Dual-Role function is a function of being capable of executing both the Source function and the Sink function. An apparatus having the Dual-Role function is referred to as a “dual-role device”. In particular, an apparatus capable of executing both the Source function and the Sink function in a concurrent manner is referred to as a “concurrent dual-role device”. The communication apparatus101 as cited herein is a concurrent dual-role device. Each of theexternal communication apparatuses102 and103 is a source device or a sink device.
• Examples of the source device include an image input apparatus, such as a tablet, a smartphone, a personal computer (PC), a mobile phone, a camera, and a video camera, but are not limited to those. Examples of the sink device include an image output apparatus, such as a tablet, a smartphone, a PC, a mobile phone, a television set, a set-top box, a head-mounted display, a projector, a display, or a car navigation apparatus, but are not limited to those.
• Moreover, examples of the dual-role device include an image input apparatus, such as an imaging apparatus (for example, a camera or a video camera) and a scanner, and an image output apparatus, such as a projector, a television set, and a display. Moreover, the dual-role device can be a storage device, such as a hard disk device and a memory device, or an information processing apparatus, such as a PC, a smartphone, a tablet, or a car navigation apparatus, and is not limited to those.
• While, in the following description, the communication apparatus101 as cited herein is compliant with the IEEE 802.11 series, the configuration of the present exemplary embodiment is also applicable to a communication apparatus compliant with another wireless communication system, such as Bluetooth®, Ultra Wide Band (UWB), ZigBee, and MBOA (Multiband PFDM Alliance). Examples of UWB include wireless universal serial bus (USB), wireless 1394, and WINET. The configuration of the present exemplary embodiment is also applicable to a communication apparatus compliant with a wired communication system, such as a wired local area network (LAN). Additionally, the communication apparatus101 and theexternal communication apparatus102 or103 can not only directly communicate with each other but also communicate with each other via a relay device (not illustrated) (for example, an access point).
• FIG. 2 illustrates a hardware configuration of the communication apparatus101. Astorage unit201, which is configured with a memory, such as a read-only memory (ROM) or a random access memory (RAM), stores programs used to perform various operations described below and various pieces of information, such as communication parameters for wireless communication. Besides the memory such as a ROM or a RAM, thestorage unit201 can be configured with a storage medium, such as a flexible disk, a hard disk, an optical disk, a magneto optical disk, a CD-ROM, a CD-R, a magnetic tape, a non-volatile memory card, and a Digital Versatile Disc (DVD). Thestorage unit201 can include, for example, a plurality of memories.
• Acontrol unit202, which is configured with a processor, such as a central processing unit (CPU) or a micro processing unit (MPU), controls the entirety of the communication apparatus101 by executing programs stored in thestorage unit201. Thecontrol unit202 can be configured to control the entirety of the communication apparatus101 by causing an operating system (OS) and a program stored in thestorage unit201 to cooperate with each other. Moreover, thecontrol unit202 can include a plurality of processors, such as a multi-core processor, and can be configured to control the entirety of the communication apparatus101 using the plurality of processors. Additionally, thecontrol unit202 controls afunction unit203 to perform predetermined processing, such as image capturing or image projection.
• Thefunction unit203 is hardware by which the communication apparatus101 performs predetermined processing. For example, in a case where the communication apparatus101 is a camera, thefunction unit203 is an imaging unit and thus performs image capturing processing. Moreover, for example, in a case where the communication apparatus101 is a mobile phone, thefunction unit203 is a Long-Term Evolution (LTE) communication unit and thus performs LTE communication. Data to be processed by thefunction unit203 can be data stored in thestorage unit201, or can be data received by communicating with an external communication apparatus via acommunication unit206, which is described below.
• Aninput unit204 receives various operations performed by the user. Anoutput unit205, which is, for example, a display unit or a speaker, performs output processing that is based on data stored in thestorage unit201 or data received from an external apparatus. More specifically, theoutput unit205 performs at least one of, for example, displaying on a display screen, audio output by a speaker, and vibration output. Both theinput unit204 and theoutput unit205 can be implemented as a single module like a touch panel.
• Thecommunication unit206 performs control of wireless communication compliant with the IEEE 802.11 series and control of Internet Protocol (IP) control. Moreover, thecommunication unit206 controls anantenna207 to transmit and receive a wireless signal for wireless communication. The communication apparatus101 communicates data on which output processing is performed by theoutput unit205 with theexternal communication apparatus102 or103 via thecommunication unit206. For example, the communication apparatus101 transmits display screen data, which is displayed on a display screen serving as theoutput unit205, to theexternal communication apparatus102 or103. Here, a communication compliant with Wi-Fi® Display is used for the transmission of the display screen data. Wi-Fi® Display is not limiting, but another communication method, such as Intel Wireless Display (WiDi), can be used.
• In the following description, an example is described in which the communication apparatus101 transmits or receives display screen data to or from the external communication apparatus102. However, not only this, but the communication apparatus101 can transmit or receive audio data, which is output to theoutput unit205, to or from the external communication apparatus102.
• FIG. 3 is a flowchart illustrating the flow of processing implemented by thecontrol unit202 reading a program stored in thestorage unit201 and executing the program when the communication apparatus101 communicates display screen data with the external communication apparatus102 in conformity with Wi-Fi® Display. At least a part of the flowchart illustrated inFIG. 3 can be implemented by hardware. In a case where hardware is used for such implementation, for example, a predetermined compiler can be used to automatically produce a dedicated circuit on a Field Programmable Gate Array (FPGA) from a program for implementing each step. Moreover, a gate array circuit can be formed as with an FPGA for implementation as hardware. Additionally, an application specific integrated circuit (ASIC) can be used for implementation as hardware.
• The flowchart illustrated inFIG. 3 is started when the function of Wi-Fi® Display is turned on by the user. The flowchart illustrated inFIG. 3 can be started in the following cases. For example, the cases include a case where a predetermined time has been reached, a case where it is determined by, for example, a global positioning system (GPS) that the communication apparatus101 is present within a predetermined range, a case where a predetermined network has been detected, and the entire communication apparatus101 has been powered on.
• First, in step S301, thecontrol unit202 sets the role of the communication apparatus101 to one of Source, Sink, Dual-Role, and Search Inhibition. Here, the term “role” refers to which of a source device, a sink device, and a dual-role device the communication apparatus101 operates as in a case where the communication apparatus101 connects to a new external communication apparatus, to search for the new external communication apparatus targeted for connection. In a case where the role is set to Search Inhibition, search processing described below is not performed.
• For example, in the following description, if the role of the communication apparatus101 is set to Source, the communication apparatus101 operates as a source device and searches for an external communication apparatus to be newly connected to the communication apparatus101. This does not hinder the communication apparatus101 from operating as a sink device in relation to an external communication apparatus that is being connected to the communication apparatus101.
• Processing for setting the role in this step is performed without any user operation on theinput unit204. Details of the processing for setting the role are described below with reference toFIG. 4.
• After the role is set, then in step S302, thecontrol unit202 determines whether the set role is one of Source, Sink, and Dual-Role. If the role is none of Source, Sink, and Dual-Role, in other words, if the role is set to Search Inhibition (NO in step S302), the processing proceeds to step S307 while omitting search processing and other processing performed in steps S303 to S306. On the other hand, if the role is one of Source, Sink, and Dual-Role (YES in step S302), then in step S303, thecontrol unit202 searches for an external communication apparatus based on the role set in step S301. Search for an external communication apparatus is performed by transmitting and receiving wireless signals, such as a beacon, a probe request, and a probe response, based on the Wi-Fi® Display specifications. Details of the search processing are described below with reference toFIG. 5.
• Then, as a result of the search processing, in step S304, thecontrol unit202 determines whether an external communication apparatus that is not yet connected to the communication apparatus101 has been detected. Here, in a case where both the role of the communication apparatus101 set in step S301 and the role of the detected external communication apparatus are Source or Sink and thus coincide with each other, the communication apparatus101 and the detected external communication apparatus are cannot transmit and receive display screen data to and from each other. Accordingly, in a case where both the role of the communication apparatus101 and the role of the detected external communication apparatus are Source or Sink and thus coincide with each other, thecontrol unit202 determines that the external communication apparatus is not the detected one. In a case where both the role of the communication apparatus101 and the role of the detected external communication apparatus are Dual-Role and thus coincide with each other, then, when both the roles are set to respective appropriate ones, the communication apparatus101 and the external communication apparatus can transmit and receive display screen data to and from each other. Accordingly, in a case where both the role of the communication apparatus101 and the role of the detected external communication apparatus are Dual-Role and thus coincide with each other, thecontrol unit202 determines that the external communication apparatus is the detected one.
• In a case where it is determined by the above determination step that a plurality of external communication apparatus has been detected, one apparatus is selected and then subjected to connection processing. This selection can be performed based on an instruction from the user or can be automatically performed based on the number of times of connection or the timing of the last connection. In a case where the selection is performed based on an instruction from the user, theoutput unit205 notifies the user of information about the detected external communication apparatus. Here, theoutput unit205 is configured not to notify the user of information about an external communication apparatus the role of which is Source or Sink and coincides with the role of the communication apparatus101 among the detected external communication apparatuses. This enables improving the convenience for the user to select an apparatus to be connected to the communication apparatus101.
• If any external communication apparatus that is not yet connected to the communication apparatus101 has not been detected (NO in step S304), the processing proceeds to step S307. On the other hand, if an external communication apparatus that is not yet connected to the communication apparatus101 has been detected (YES in step S304), then in step S305, thecontrol unit202 performs wireless connection processing with respect to the detected external communication apparatus.
• In the wireless connection processing in step S305, the role of the communication apparatus101 of operating as a source device or operating as a sink device is determined. Details of the wireless connection processing are described below with reference toFIG. 5. Then, in step S306, thecontrol unit202 communicates display screen data with the connected external communication apparatus and starts mirroring processing. The term “mirroring” refers to performing the same display on a display screen of the communication apparatus101 and on a display screen of the connected external communication apparatus. In a case where the communication apparatus101 operates as a source device, the communication apparatus101 transmits display screen data, and the external communication apparatus receives the display screen data and displays the received display screen data on the display screen of the external communication apparatus. On the other hand, in a case where the communication apparatus101 operates as a sink device, the external communication apparatus transmits display screen data, and the communication apparatus101 receives the display screen data and displays the received display screen data on the display screen of the communication apparatus101.
• Then, in step S307, thecontrol unit202 determines whether to end the mirroring processing. Here, thecontrol unit202 performs the determination based on whether theinput unit204 has received a mirroring end instruction from the user. The mirroring end instruction is issued by selecting one or some apparatuses from among the external communication apparatuses which are performing mirroring processing with the communication apparatus101 and specifying the selected apparatuses as targets for ending the mirroring processing. Instead of this instruction or in addition to this instruction, an instruction to end the mirroring processing itself can be issued. In this case, step S309, which is described below, can be omitted.
• If thecontrol unit202 determines not to end mirroring processing (NO in step S307), the communication apparatus101 continues mirroring processing and the processing returns to step S301 in preparation for wireless connection processing with another external communication apparatus. On the other hand, if thecontrol unit202 determines to end mirroring processing (YES in step S307), then in step S308, the communication apparatus101 disconnects communication with the selected external communication apparatus, thus ending the mirroring processing. In a case where an instruction to end the mirroring processing itself is issued, the communication apparatus101 disconnects communication with all of the external communication apparatuses which are performing mirroring processing, thus ending the mirroring processing itself.
• After that, in step S309, thecontrol unit202 determines whether the mirroring processing performed by the communication apparatus101 has been entirely ended. Instead of performing this determination, thecontrol unit202 can determine whether an instruction to end the mirroring processing itself performed by the communication apparatus101 has been issued. Such an instruction can be issued at the time in step S307 or can be issued at the time in step S309.
• If the mirroring processing performed by the communication apparatus101 has been entirely ended (YES in step S309), the processing illustrated inFIG. 3 ends. If the mirroring processing is continued (NO in step S309), the processing returns to step S301.
• Next, the above-mentioned step S301, i.e., the processing for setting the role, is described with reference toFIG. 4. First, in step S401, thecontrol unit202 sets the role of the communication apparatus101 as a dual-role device. Then, in step S402, thecontrol unit202 determines whether the external communication apparatus which is connecting to the communication apparatus101 is operating as a source device or is operating as a sink device. In other words, thecontrol unit202 determines the role of the external communication apparatus which is connecting to the communication apparatus101. Here, in a case where a plurality of external communication apparatuses is connecting to the communication apparatus101, thecontrol unit202 performs the determination with respect to each external communication apparatus.
• Then, in step S403, thecontrol unit202 determines, based on a result of the determination in step S402, whether the number of apparatuses operating as a source device among the external communication apparatus which are connecting to the communication apparatus101 has reached the maximum number of connections or the number of apparatuses operating as a sink device has reached the maximum number of connections. Since the maximum numbers of connections indicate threshold values for the respective functions, the maximum numbers of connections can be respective different values. If the number of apparatuses has reached neither of the maximum numbers of connections (NO in step S403), the processing illustrated inFIG. 4 ends. Thus, the communication apparatus101 is set as a dual-role device.
• On the other hand, if the number of apparatuses has reached at least one of the maximum numbers of connections (YES in step S403), then in step S404, thecontrol unit202 determines whether the number of apparatuses operating as a source device among the external communication apparatus which are connecting to the communication apparatus101 has reached the maximum number of connections. If it is determined that the number of apparatuses operating as a source device has not reached the maximum number of connections (NO in step S404), i.e., if it is determined that the number of apparatuses operating as a sink device has reached the maximum number of connections, then in step S405, thecontrol unit202 switches the role of the communication apparatus101 from Dual-Role to Sink. Thus, the communication apparatus101 is set as a sink device. With this, since the communication apparatus101 does not perform search while operating as a source device, the communication apparatus101 does not any more connect to an external communication apparatus which operates as a sink device. Accordingly, the possibility that the communication apparatus101 would perform wireless connection processing with sink devices beyond the maximum number of connections can be reduced.
• On the other hand, if it is determined that the number of apparatuses operating as a source device has reached the maximum number of connections (YES in step S404), then in step S406, thecontrol unit202 determines whether the number of apparatuses operating as a sink device among the external communication apparatus which are connecting to the communication apparatus101 has reached the maximum number of connections. If it is determined that the number of apparatuses operating as a sink device has not reached the maximum number of connections (NO in step S406), i.e., if it is determined that only the number of apparatuses operating as a source device has reached the maximum number of connections, then in step S407, thecontrol unit202 switches the role of the communication apparatus101 from Dual-Role to Source. Thus, the communication apparatus101 is set as a source device. With this, since the communication apparatus101 does not perform search while operating as a sink device, the communication apparatus101 does not any more connect to an external communication apparatus which operates as a source device. Accordingly, the possibility that the communication apparatus101 would perform wireless connection processing with source devices beyond the maximum number of connections can be reduced.
• On the other hand, if it is determined that the number of apparatuses operating as a sink device has reached the maximum number of connections (YES in step S406), i.e., if it is determined that each of the number of apparatuses operating as a sink device and the number of apparatuses operating as a source device has reached the maximum number of connections, then in step S408, thecontrol unit202 sets the communication apparatus101 to Search Inhibition. In this case, the communication apparatus101 does not perform search processing. Moreover, theoutput unit205 can display information indicating that both source devices and sink devices have reached the maximum number of connections, thus notifying the user that the communication apparatus101 can no longer connect to an external communication apparatus.
• In this way, automatically setting the role of the communication apparatus101 enables performing search processing with the appropriate role without requiring a user operation.
• Next, the search processing in step S303 is described in detail with reference to the flowchart ofFIG. 5. First, in step S501, thecontrol unit202 determines whether an instruction for searching for an external communication apparatus has been received from the user. This instruction is an instruction to cause the communication apparatus101, which has been only waiting for being searched for by an external apparatus conforming to Wi-Fi® Display, to transmit a signal so as to actively perform searches.
• In a case where, in step S301, the role of the communication apparatus101 is set to Source or Dual-Role, step S501 can be omitted so that the processing can automatically proceed to step S502. In this instance, in a case where, in step S301, the role of the communication apparatus101 is set to Sink, step S501 can be omitted so that the processing can automatically proceed to step S504.
• If it is determined that the search instruction has been received (YES in step S501), then in step S502, thecontrol unit202 performs search processing for an external communication apparatus. In a case where the communication apparatus101 searches for an external communication apparatus, the communication apparatus101 transmits a probe request compliant with the IEEE 802.11 series while changing wireless LAN channels based on the Wi-Fi Display specifications. Then, the communication apparatus101 receives a probe response from an external communication apparatus which has responded to the probe request, thus detecting an external communication apparatus compliant with the IEEE 802.11 series.
• Upon detecting an external communication apparatus, thecontrol unit202 sets information about the role set in the above-mentioned step S301 (one of Source, Sink, and Dual-Role) to the item “device-type” of a Wi-Fi® Display Information Element (WFD IE) in a wireless signal compliant with Wi-Fi® Display.
• Then, the communication apparatus101 transmits a wireless signal including the WFD IE in which the role information is set to the device-type. Information about a connecting condition of the communication apparatus101, such as the maximum number of connections of source devices and the maximum number of connections of sink devices, can be set in the WFD IE. An external communication apparatus can determine the allowance or denial of communication and to control a connection method based on the information about the connecting state. For example, in a case where the maximum number of connections of sink devices is one, since multi-channel audio data cannot be received by a plurality of speakers (sink devices), an external communication apparatus which operates as a sink device can be prevented from connecting to the communication apparatus101.
• Then, in step S503, thecontrol unit202 acquires information about the role (role information) of an external communication apparatus. Here, thecontrol unit202 acquires the role information by referring to the device-type in the WFD IE included in a wireless signal, such as a probe response, received from an external communication apparatus. The role information contains information indicating whether the external communication apparatus is a sink device or a dual-role device.
• In addition to this processing, the communication apparatus101 can perform service discovery compliant with Wi-Fi® Display. More specifically, in a case where the communication apparatus101 operates as a sink device, the communication apparatus101 functions as a service advertiser. The service advertiser performs broadcasting of information about a function which the communication apparatus101 can supply. Then, the service advertiser waits for a connection request transmitted from the other-party apparatus. On the other hand, in a case where the communication apparatus101 operates as a source device, the communication apparatus101 functions as a service seeker. The service seeker searches for a service advertiser that sends information about a service which the communication apparatus101 intends to use, and performs unicast transmission of a connection request containing function information. In a case where the communication apparatus101 is a dual-role device, the communication apparatus101 functions as both a service seeker and a service advertiser. In other words, the communication apparatus101 performs not only broadcasting but also unicast transmission of function information about the communication apparatus101.
• A search for an external communication apparatus can be performed not only by the above-mentioned method but also by performing a communication in a communication method different from the IEEE 802.11 series, such as Near Field Communication (NFC) or Bluetooth®.
• On the other hand, if, in step S501, it is determined that a search instruction for an external communication apparatus has not been received from the user (NO in step S501), then in step S504, thecontrol unit202 determines whether a search signal has been received from an external communication apparatus. Here, the search signal is a probe request from an external communication apparatus. However, not only this, but the search signal can be a beacon signal which an external communication apparatus transmits.
• If, in step S504, it is determined that no search signal from an external communication apparatus has been received (NO in step S504), the processing returns to step S501, in which thecontrol unit202 waits for a search instruction from the user again. On the other hand, if it is determined that a search signal from an external communication apparatus has been received (YES in step S504), then in step S505, thecontrol unit202 acquires information about the role of the external communication apparatus. The information about the role (role information) of the external communication apparatus can be acquired by referring to the device-type in the WFD IE contained in a wireless signal, such as a probe request received from the external communication apparatus or a service discovery request prescribed by the Wi-Fi® Display standard. One of Source, Sink, and Dual-Role is set in the role information.
• Then, in step S506, thecontrol unit202 transmits a response to the external communication apparatus. The response is a wireless signal, such as a probe response to a probe request received from the external communication apparatus or a service discovery response to a service discovery request received from the external communication apparatus. As in the above-mentioned step S502, the connecting state of the communication apparatus101, such as the maximum number of connections of source devices or the maximum number of connections of sink devices which are currently connectable, can be set in a predetermined field in the WFD IE contained in the response. Moreover, the communication apparatus101 does not transmit a response to an external communication apparatus the role of which is Source or Sink and coincides with that of the communication apparatus101.
• In this way, the search processing can be appropriately performed according to the role of the communication apparatus101 set in step S301.
• Next, wireless connection processing is described with reference toFIG. 6. In a case where the role of an external communication apparatus is Source or Sink and coincides with the role of the communication apparatus101, since it is determined that the external communication apparatus is not the detected one, in the following description, such an external communication apparatus is assumed not to serve as a connection partner.
• First, in step S601, thecontrol unit202 determines whether the role of the external communication apparatus serving as a connection partner acquired in step S503 or S505 (hereinafter referred to as an “other-party apparatus”) is Source. If the role of the other-party apparatus is Source (YES in step S601), thecontrol unit202 advances the processing to step S602 so as to set the role of the communication apparatus101 to Sink and cause the communication apparatus101 to connect to the other-party apparatus.
• In step S602, to set the role of the communication apparatus101 to Sink and cause the communication apparatus101 to connect to the other-party apparatus, thecontrol unit202 changes the role information contained in a wireless signal to be transmitted to Sink and performs connection setup. The device-type in the WFD IE is used for setting of the role information as mentioned above. Moreover, the connection setup is performed based on the Wi-Fi® Display specifications.
• Then, in step S603, thecontrol unit202 sets the role of the communication apparatus101 to Sink and performs capability exchange signaling and negotiation with the other-party apparatus. In the Wi-Fi® Display specifications, the use of the Real Time Streaming Protocol (RTSP) is prescribed for capability exchange signaling and negotiation, and predetermined messages including RTSP M1 to RTSP M4 are exchanged with the other-party apparatus. The RTSP is a protocol used to control streaming, and the Transmission Control Protocol (TCP) is typically used as a lower layer transport protocol. In the case of functioning as Sink, the communication apparatus101 starts processing with reception of an RTSP M1 request transmitted from the other-party apparatus.
• Lastly, in step S604, thecontrol unit202 establish a session while setting the role of the communication apparatus101 to Sink, and starts processing for receiving and playing back display screen data. In the Wi-Fi® Display specifications, predetermined messages including RTSP M5 to RTSP M7 are exchanged with the other-party apparatus to establish a session and start playback. In the case of functioning as Sink, the communication apparatus101 starts processing with reception of an RTSP M5 request transmitted from the other-party apparatus.
• On the other hand, if, in step S601, it is determined that the role of the other-party apparatus is not Source (NO in step S601), i.e., if the role of the other-party apparatus is Sink or Dual-Role, then in step S605, thecontrol unit202 determines whether the role of the communication apparatus101 is Sink.
• If, in step S605, it is determined that the role of the other-party apparatus is Sink (YES in step S605), thecontrol unit202 advances the processing to step S606 so as to set the role of the communication apparatus101 to Source and cause the communication apparatus101 to connect to the other-party apparatus. In step S606, to set the role of the communication apparatus101 to Source and cause the communication apparatus101 to connect to the other-party apparatus, thecontrol unit202 changes the role information contained in a wireless signal to be transmitted to Source and performs connection setup. Here, the type of a wireless signal used for connection setup is also similar to that described in Step S602, and is, therefore, omitted from the description.
• Then, in step S607, thecontrol unit202 sets the role of the communication apparatus101 to Source and performs capability exchange signaling and negotiation with the other-party apparatus. In the capability exchange signaling and negotiation, as in step S603 described above, messages including RTSP M1 to RTSP M4 are exchanged with the other-party apparatus, and, in the case of functioning as Source, the communication apparatus101 starts processing with transmission of an RTSP M1 request to the other-party apparatus.
• Lastly, in step S608, thecontrol unit202 establish a session while setting the role of the communication apparatus101 to Source, and starts processing for transmitting and playing back display screen data. In the establishment of a session and the start of playback, as in step S604 described above, messages including RTSP M5 to RTSP M7 are exchanged with the other-party apparatus, and, in the case of functioning as Source, the communication apparatus101 starts processing with transmission of an RTSP M5 request to the other-party apparatus.
• Next, a case where, in step S605, it is determined that the role of the other-party apparatus is not Sink (NO in step S605) is described. In this case, both the role of the communication apparatus101 and the role of the other-party apparatus are Dual-Role. In such a case, then in step S609, thecontrol unit202 displays a role selection screen on theoutput unit205 to allow the user to select the role of the communication apparatus101 via theinput unit204. The role selection screen is configured to display two roles of screen transmission (Source) and screen reception (Sink) and not to display a role of Dual-Role. This enables the user to optionally select one of roles of Source and Sink.
• In a case where a user for the other-party apparatus has specified the role thereof, the ole selection screen can be ended. In this case, if the other-party apparatus has been specified as Source, the communication apparatus101 serves as Sink. If the other-party apparatus has been specified as Sink, the communication apparatus101 serves as Source. In this way, the roles of the communication apparatus101 and the other-party apparatus can be determined only by a role selection operation on one of the two apparatuses.
• After, in step S609, the user has selected the role of the communication apparatus101, then in step S610, thecontrol unit202 determines what is the selected role. If, in step S610, it is determined that the selected role is Sink, thecontrol unit202 advances the processing to step S602 so as to set the role of the communication apparatus101 to Sink and cause the communication apparatus101 to connect to the other-party apparatus. Details of the connection processing performed here are as described above, and are, therefore, omitted from the description. On the other hand, if, in step S610, it is determined that the selected role is Source, thecontrol unit202 advances the processing to step S606 so as to set the role of the communication apparatus101 to Source and cause the communication apparatus101 to connect to the other-party apparatus. Details of the connection processing performed here are as described above, and are, therefore, omitted from the description.
• In this way, according to the connection processing illustrated in the flowchart ofFIG. 6, even in a case where the communication apparatus101 has a concurrent dual-role function, the role of the communication apparatus101 is determined without the user performing a role switching operation on theinput unit204 or with the user performing a simple operation, thus enabling the communication apparatus101 to connect to the other-party apparatus.
• Next, connection processing performed in the entire system, which includes the communication apparatus101 and theexternal communication apparatuses102 and103, according to the present exemplary embodiment is described with reference toFIG. 7 andFIG. 8.
• FIG. 7 is a sequence chart in a case where the communication apparatus101 connects to the external communication apparatus102 serving as a source device and theexternal communication apparatus103 serving as a sink device in a concurrent manner.
• Here, each apparatus executes a sequence compliant with Wi-Fi® Display. First, the communication apparatus101 performs device discovery (701 to704 and717 to720), and then performs connection setup (705 to713 and721 to725). Then, the communication apparatus101 performs capability exchange signaling and negotiation (714 and726) to establish a session. After that, the communication apparatus101 starts playback (715 and727), so that video streaming (716 and728) is performed. In the option specifications of Wi-Fi® Display, while, for example, a step of discovering a service before the connection setup (705 to713 and721 to725) is prepared, in the present exemplary embodiment, for ease of explanation, such a step is not used. Moreover, since, as mentioned above, the communication apparatus101 can concurrently assume the role of Source and the role of Sink, each of the number of connectable other-party source devices and the number of connectable other-party sink devices is necessarily at least one. In the present exemplary embodiment, for ease of explanation, as the capability of the communication apparatus101, each of the maximum number of connectable other-party source devices and the maximum number of connectable other-party sink devices is deemed to be one.
• First, the communication apparatus101 and the external communication apparatus102 perform steps for device discovery (701 to704). Here, in the external communication apparatus102, a user thereof issues an instruction to start a search for another apparatus (701). When the instruction to start a search is issued, the external communication apparatus102 transmits a probe request (702) and receives a probe response (703) with respect to the communication apparatus101. Even when the instruction to start a search is issued in the communication apparatus101, the communication apparatus101 similarly transmits a probe request and receives a probe response. Wireless signals to be transmitted and to be received are prescribed in the Wi-Fi® Peer-to-Peer specifications, and, for example, a beacon signal can also be used. Moreover, since the external communication apparatus102 has a source function, Source is set as role information in the probe request (702) transmitted from the external communication apparatus102.
• On the other hand, since the communication apparatus101 has a dual-role function, Dual-Role is set as role information in the probe response (703) transmitted from the communication apparatus101. The external communication apparatus102 detects the communication apparatus101 by receiving the probe response (703) transmitted from the communication apparatus101, and notifies the user of the external communication apparatus102 of a result of device discovery (704).
• In steps for connection setup of the communication apparatus101 and the external communication apparatus102 (705 to713), first, the user of the external communication apparatus102 selects the communication apparatus101 from a list of discovered devices (705). After that, the external communication apparatus102 and the communication apparatus101 transmit and receive predetermined wireless signals (706 to713) to perform connection setup. Wireless signals to be transmitted and to be received are also prescribed in the Wi-Fi® Peer-to-Peer specifications, and the wireless signal described in the above-mentioned step S602 can also be used besides thesignals706 to713. Moreover, although the communication apparatus101 has a dual-role function, since the communication apparatus101 becomes aware that the external communication apparatus102 has a source function from the role information contained in the received probe request (702), the communication apparatus101 functions as Sink. Accordingly, Sink instead of Dual-Role is set as the role information in the wireless signals (707,709, and713) transmitted from the communication apparatus101. On the other hand, Source is set as the role information in the wireless signals (706,708, and712) transmitted from the external communication apparatus102.
• Next, a step for capability exchange signaling and negotiation (714) and a step for session establishment and playback start (715) are performed between the communication apparatus101 and the external communication apparatus102. These steps are as described above in the above-mentioned steps S603 and S604, respectively. In other words, the communication apparatus101 and the external communication apparatus102 transmit and receive predetermined RTSP messages prescribed in the Wi-Fi® Display specifications, and then, video streaming (716) is started from the external communication apparatus102 to the communication apparatus101.
• Next, a step for device discovery (717 to720) is performed between the communication apparatus101 and theexternal communication apparatus103. More specifically, when an instruction for search start is issued in the communication apparatus101 (717), the communication apparatus101 transmits a probe request (718) to theexternal communication apparatus103 and receives a probe response (719) from theexternal communication apparatus103. Although the communication apparatus101 has a concurrent dual-role function, since the communication apparatus101 is unable to operate as a sink device because of connecting to the external communication apparatus102 in advance, Source is set as the role information in the probe request (718) transmitted from the communication apparatus101. On the other hand, since theexternal communication apparatus103 has a sink function, Sink is set as the role information in the probe response (719) transmitted from theexternal communication apparatus103. The communication apparatus101 detects theexternal communication apparatus103 by receiving the probe response (719) transmitted from theexternal communication apparatus103, and notifies the user of a result of device discovery (720).
• In steps for connection setup of the communication apparatus101 and the external communication apparatus103 (721 to725), the user of the communication apparatus101 is allowed to select theexternal communication apparatus103 from a list of detected devices (721). After the selection is performed, the communication apparatus101 and theexternal communication apparatus103 transmit and receive predetermined wireless signals (722 to725) to perform connection setup. Although the communication apparatus101 has a dual-role function, since the communication apparatus101 becomes aware that theexternal communication apparatus103 has a sink function from the role information contained in the received probe request (719), the communication apparatus101 functions as Source. Accordingly, Source instead of Dual-Role is set as the role information in the wireless signals (722 and724) transmitted from the communication apparatus101. On the other hand, Sink is set as the role information in the wireless signals (723 and725) transmitted from theexternal communication apparatus103.
• A step for capability exchange signaling and negotiation (726) and a step for session establishment and playback start (727) between the communication apparatus101 and theexternal communication apparatus103 are as described above in the above-mentioned steps S607 and S608, respectively. In other words, the communication apparatus101 and theexternal communication apparatus103 transmit and receive predetermined RTSP messages prescribed in the Wi-Fi® Display specifications, and then, video streaming (728) is started from the communication apparatus101 to theexternal communication apparatus103.
• In a case where, as mentioned above, each of the maximum number of connectable other-party source devices and the maximum number of connectable other-party sink devices as the capability of the communication apparatus101 is one, the communication apparatus101 is in a state of having reached the maximum number of connections for both a source device and a sink device. Therefore, the communication apparatus101 inhibits subsequent discovery of other-party apparatuses and subsequent notification of a role to other-party apparatuses (729).
• While, inFIG. 7, the role of theexternal communication apparatus103 is illustrated as Sink, the above description is also applicable to a case where the role is Dual-Role. More specifically, except that the role set in a wireless signal to be transmitted from theexternal communication apparatus103 during device discovery (for example, the probe response (719)) is changed to Dual-Role, the other wireless signals, messages, and data to be transmitted and received between the communication apparatus101 and theexternal communication apparatus103 are the same as those described above.
• Next,FIG. 8 is a sequence chart in a case where the communication apparatus101 connects to the external communication apparatus102 and theexternal communication apparatus103 each serving as a source device in a concurrent manner.
• The connection sequence between the communication apparatus101 and the external communication apparatus102 (801 to816) is similar to the connection sequence between the communication apparatus101 and the external communication apparatus102 (701 to716) illustrated inFIG. 7, and is, therefore, omitted from the description.
• Unlike the sequence illustrated inFIG. 7, in a step for device discovery between the communication apparatus101 and theexternal communication apparatus103, when an instruction to start a search is issued in the external communication apparatus103 (817), theexternal communication apparatus103 transmits a probe request (818) and the communication apparatus101 receives the probe request (818). Since theexternal communication apparatus103 has a source function, Source is set as the role information in the probe request (818) transmitted from theexternal communication apparatus103.
• On the other hand, although the communication apparatus101 has a concurrent dual-role function, since the communication apparatus101 is unable to operate as a sink device because of connecting to the external communication apparatus102 in advance, the communication apparatus101 does not respond to the probe request (818) transmitted from the external communication apparatus103 (819). In this way, since theexternal communication apparatus103 receives no probe response from the communication apparatus101, theexternal communication apparatus103 cannot detect the communication apparatus101 (820). Accordingly, information about the communication apparatus101 is not included in a notification of a result of device discovery performed by theexternal communication apparatus103, so that theexternal communication apparatus103 cannot proceed to a step for connection setup with the communication apparatus101.
• While, in the above description, each of the maximum number of connectable other-party source devices and the maximum number of connectable other-party sink devices as the capability of the communication apparatus101 is one as mentioned above, in a case where it is two or more, the communication apparatus101 can continue to function as a dual-role device.
• As described above, as a result of control processing for switching communication modes of a communication apparatus according to the present exemplary embodiment, a communication mode is determined according to a connecting state of the communication apparatus and the role of an external communication apparatus. In a case where the role of an other-party apparatus is Dual-Role, the user can select the role. Accordingly, in a case where a dual-role device concurrently assumes both of the roles of a source device and a sink device, the role of the communication apparatus is determined automatically or by a simple operation before discovery of a device, so that user convenience can be enhanced.
• While the exemplary embodiment has been described in detail above, additional embodiments can be embodied as, for example, a system, an apparatus, a method, a program, or a recording medium (storage medium). More specifically, embodiments can be applied to a system configured with a plurality of devices, e.g., a host computer, an interface device, an imaging apparatus, or a web application, or can be applied to an apparatus configured with a single device.
• Embodiments can also be implemented by performing processing for supplying a program implementing one or more of the functions of the above-described exemplary embodiment to a system or apparatus via a network or a storage medium and causing one or more processors included in the system or apparatus to read and execute the program. Moreover, embodiments can also be implemented by a circuit that implements one or more of the functions (for example, an application specific integrated circuit (ASIC)).
Other Embodiments
• Embodiment(s) can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random access memory (RAM), a read-only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™, a flash memory device, a memory card, and the like.
• According to an exemplary embodiment of the present invention, an apparatus including both the function of transmitting data to an external apparatus and the function of performing output processing based on received data is enabled to perform a notification adapted to a situation.
• While exemplary embodiments have been described, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims (20)

What is claimed is:

1. A communication apparatus, comprising:

an output unit configured to perform output processing based on data;

a first transmission unit configured to transmit a first signal indicating that the communication apparatus is able to execute a first function that is a function of transmitting, to an external apparatus, the data for which the output processing is being performed by the output unit;

a second transmission unit configured to transmit a second signal indicating that the communication apparatus is able to execute a second function that is a function of receiving data for which output processing is being performed by the external apparatus and performing output processing based on the received data;

a selection unit configured to select, as a signal to be transmitted by the communication apparatus, one of a plurality of types of signal that includes at least the first signal and the second signal, wherein the selection is based on information regarding a function of first another communication apparatus that is currently connected to the communication apparatus; and

a connection unit configured to establish a connection to second another communication apparatus that responds to the transmitted signal selected by the selection unit.

2. The communication apparatus according toclaim 1,

wherein the output unit outputs an image to a display.

3. The communication apparatus according toclaim 1,

wherein the output unit outputs audio to speakers.

4. The communication apparatus according toclaim 1,

wherein the connection unit transmits a connection request and performs wireless connection processing in a case where the selection unit selects to transmit the first signal, and

wherein the connection unit waits for a connection request and performs wireless connection processing in a case where the selection unit selects to transmit the second signal.

5. The communication apparatus according toclaim 1,

wherein the first function is a Source function defined by Wi-Fi Miracast®, and

wherein the second function is a Sink function defined by Wi-Fi Miracast®.

6. The communication apparatus according toclaim 1, further comprising:

an acquisition unit configured to acquire information indicating in which of the first function or the second function the first another communication apparatus operates;

wherein, based on the information acquired by the acquisition unit, the selection by the selection unit is made.

7. The communication apparatus according toclaim 6,

wherein the acquisition unit acquires the information indicating in which of the first function and the second function the first external communication apparatus operates, via a beacon, a probe request, a probe response, a service discovery request, or a service discovery response transmitted from the first another communication apparatus.

8. The communication apparatus according toclaim 6,

wherein each of the first transmission unit and the second transmission unit performs transmission via a first communication unit, and

wherein the acquisition unit acquires, via a second communication unit different from the first communication unit, the information indicating in which of the first function and the second function the first another communication apparatus operates.

9. The communication apparatus according toclaim 8,

wherein the first communication unit performs wireless communication compliant with IEEE 802.11 series, and

wherein the second communication unit performs wireless communication compliant with Near Field Communication or Bluetooth®.

10. The communication apparatus according toclaim 1, further comprising:

a third transmission unit configured to transmit a third signal indicating that the communication apparatus is able to execute a third function for execution of both of the first function and the second function;

wherein, based on the information regarding the function of the first another communication apparatus, the selection unit makes the selection from among the first signal, the second signal, and the third signal.

11. The communication apparatus according toclaim 10,

wherein the third function is a Dual-Role function defined by Wi-Fi Miracast®.

12. The communication apparatus according toclaim 10,

wherein the selection unit selects to transmit the third signal in a case where a number of apparatuses that execute the first function, from among a plurality of other communication apparatuses to which the communication apparatus is wirelessly connected, is less than a first threshold value, and the selection unit selects to transmit the second signal in a case where the number of apparatuses that execute the first function, from among the plurality of other communication apparatuses to which the communication apparatus is wirelessly connected, is not less than the first threshold value and where, in addition, a number of apparatuses that execute the second function, from among the plurality of other communication apparatuses to which the communication apparatus is wirelessly connected, is less than a second threshold value, and

wherein the selection unit selects to transmit the first signal in a case where the number of apparatuses that execute the first function, from among the plurality of other communication apparatuses to which the communication apparatus is wirelessly connected, is less than the first threshold value and where, in addition, the number of apparatuses that execute the second function, from among the plurality of other communication apparatuses to which the communication apparatus is wirelessly connected, is not less than the second threshold value.

13. The communication apparatus according toclaim 12,

wherein the selection unit selects to transmit none of the first signal, the second signal, and the third signal in a case where the number of apparatuses that execute the first function, from among the plurality of other communication apparatuses to which the communication apparatus is wirelessly connected, is not less than the first threshold value and where, in addition, the number of apparatuses that execute the second function, from among the plurality of other communication apparatuses to which the communication apparatus is wirelessly connected, is not less than the second threshold value.

14. The communication apparatus according toclaim 10, further comprising:

a decision unit configured to decide which of the first function and the second function the communication apparatus executes based on which of the first function and the second function the second another communication apparatus is able to execute.

15. The communication apparatus according toclaim 14,

wherein the decision unit decides to execute the second function in a case where the second another communication apparatus is able to execute the first function, and

wherein the decision unit decides to execute the first function in a case where the second another communication apparatus is able to execute the second function.

16. The communication apparatus according toclaim 10,

wherein the third transmission unit transmits the third signal by broadcast and by unicast.

17. The communication apparatus according toclaim 1,

wherein the first transmission unit transmits the first signal by broadcast, and

wherein the second transmission unit transmits the second signal by unicast.

18. The communication apparatus according toclaim 1, further comprising:

a notification unit configured to notify a user of information about the second another communication apparatus.

19. A control method for a communication apparatus, comprising:

causing an output unit to perform output processing based on data;

selecting, as a signal to be transmitted by the communication apparatus, one of a plurality of types of signal that includes at least a first signal and a second signal, wherein the selection is based on information regarding a function of first another communication apparatus that is currently connected to the communication apparatus, wherein the first signal indicates that the communication apparatus is able to execute a first function that is a function of transmitting, to an external apparatus, the data for which the output processing is being performed, and wherein the second function is a function of receiving data for which output processing is being performed by the external apparatus and performing output processing based on the received data;

transmitting the selected signal;

establishing a connection to second another communication apparatus that responds to the transmitted selected signal.

20. A non-transitory computer-readable storage medium storing a program for causing a communication apparatus to execute a communication method, the communication method comprising:

causing an output unit to perform output processing based on data;

selecting, as a signal to be transmitted by the communication apparatus, one of a plurality of types of signal that includes at least a first signal and a second signal, wherein the selection is based on information regarding a function of first another communication apparatus that is currently connected to the communication apparatus, wherein the first signal indicates that the communication apparatus is able to execute a first function that is a function of transmitting, to an external apparatus, the data for which the output processing is being performed, and wherein the second function is a function of receiving data for which output processing is being performed by the external apparatus and performing output processing based on the received data;

transmitting the selected signal;

establishing a connection to second another communication apparatus that responds to the transmitted selected signal.

Images