CONFERENCE APPARATUS AND METHOD
BACKGROUND
Meetings involving a group of participants can use conference equipment which provides a unit on each participant’s desk and allows participants to speak, to hear others and to participate in voting. The conference equipment may be installed in a conference venue on a permanent basis or on a temporary basis. Examples of venues where this equipment is installed include conference venues, debating chambers of government buildings (e.g. councils, parliaments), commercial offices (e.g. meeting rooms, boardrooms) and educational establishments.
FIGURE 1 shows an example of conference equipment at a venue. Audio conferencing equipment typically comprises a Conference Control Unit (CCU) 40 and a plurality of delegate units (DU) 10. A delegate unit DU 10 is typically a small desktop unit with a high- quality microphone 11 and a loudspeaker 12. The delegate units DU 10 are connected to the CCU 40 by a wired link or a wireless link. During a conference, a participant wishing to speak can activate the microphone of their DU 10 by pressing a button. Alternatively, a participant may request to speak by pressing a button on their DU and, subsequently, the organiser or Chairperson may activate the microphone at the DU of the participant. This causes audio to be output from that DU 10 to the CCU 40. Other DUs may be controlled so as to mute their microphones. The CCU 40 may mix audio from a single, or multiple, DUs and output the mixed audio to loudspeakers at the DUs so that the speaking participant can be heard by other participants. DUs may support other functions, such as voting.
Video equipment may also be provided at the venue. The video equipment is typically separate to the audio conferencing equipment. One or more cameras 20 are connected to a camera and video control unit 35. An operator can select a video input from one of the cameras for output to a display 30. The operator can also manually control the cameras to provide a required view, such as of the participants currently speaking.
The audio conferencing equipment at a venue is typically supplied by a single manufacturer and is an expensive investment. Currently, the installed conference equipment at a conference venue is mainly used in isolation. That is, a conference takes place between the participants within the venue, but does not allow participants at the venue to participate in a conference with other participants outside the venue, or participants at another conference venue. Manufacturers have, in general, developed proprietary technology which is intended to tie a customer to their conference equipment.
The delegate units at a venue are equipped with a high-quality microphone which is superior to the kind of microphone fitted to general-purpose portable devices. While the delegate units provide high-quality audio, the functionality of delegate units may be limited in other respects.
There are known technologies for conferencing between multiple geographically distributed parties. For example, audio and video conferencing is possible between remote users via a conferencing service hosted on an Internet-based server. FIGURE 2 shows an example of an internet-based conferencing service. Each terminal 60 participating in the conference may be a personal computer (PC), tablet, smartphone or other computing device running an application 62 of the conferencing provider. Each terminal 60 communicates, via a network 64, with a server 66 supporting the conferencing service. These systems are not intended to interoperate with the type of multi-user installed conferencing systems shown in FIGURE 1. Also, they do not support some of the functions of multi-user installed conferencing systems, such as allowing a user to request to speak and allowing a conference Chairperson to control a list of users who have made a request to speak.
It is an aim of the present invention to address at least one disadvantage associated with the prior art.
SUMMARY OF THE INVENTION
There is provided a method of configuring conference equipment for a first user at a venue, wherein the venue comprises a first delegate unit having a microphone and a control apparatus in communication with the first delegate unit and wherein there is a portable device for allowing the first user to participate in a conference, the method comprising: determining that the first user wants to use the first delegate unit to participate in the conference; updating a configuration of the conference to form an association between the first delegate unit and the portable device; and wherein the association selects the first delegate unit as a source of audio for the first user.
The method may be performed by the control apparatus at the venue. Optionally, the association selects the first delegate unit as a destination of conference audio for the first user.
Optionally, the association enables the portable device to control at least one function of the first delegate unit, the method comprising the control apparatus: receiving control data from the portable device for the at least one function; and performing the at least one function.
Optionally, the at least one function of the first delegate unit comprises: request-to-speak; activate the microphone of the first delegate unit; deactivate the microphone of the first delegate unit; make a voting selection; select an audio channel.
Optionally, the association enables the portable device to provide an enhanced version of at least one function of the first delegate unit, the method comprising the control apparatus: sending control data to the portable device for the at least one function and/or receiving control data from the portable device for the at least one function; and performing the at least one function.
Optionally, the association enables the portable device to provide at least one function which is not provided on the first delegate unit, the method comprising the control apparatus: sending control data to the portable device for the at least one function and/or receiving control data from the portable device for the at least one function; and performing the at least one function.
Optionally, sending control data comprises sending control data to: cause the portable device to display a virtual control button for a function; cause the portable device to display a label for a virtual control button for a function.
Optionally, the association selects an in-venue camera, or in-venue cameras, as a source of video for the first user. Optionally, the method comprising determining that the first user wants to use the first delegate unit in the venue by receiving a request to form an association from the portable device.
Optionally, the request comprises an identifier of the first delegate unit.
Optionally, the method comprises determining that the first user wants to use the first delegate unit by receiving a request to form an association from the first delegate unit.
Optionally, the request comprises one or more of: an identifier of the first delegate unit; an identifier of the portable device; an identifier of the first user.
Optionally, the method comprises: causing a notification to be sent to the portable device of an attempt to form an association between the first delegate unit and the portable device; receiving a response from the portable device indicating approval or disapproval of the association; and if the response indicates approval of the association, forming the association between the first delegate unit and the portable device.
Optionally, the step of determining that the first user wants to use the first delegate unit occurs while the portable device is already participating in an ongoing conference wherein, before the association, the portable device is a source of audio for the first user and the portable device is a destination of conference audio.
There is provided a control unit for configuring conference equipment for a first user at a venue, wherein the control apparatus is configured to communicate with a first delegate unit having a microphone, and wherein there is a portable device for allowing the first user to participate in a conference, the control unit configured to perform the method as described or claimed.
There is provided a conference system comprising: a first delegate unit having a microphone; a control apparatus configured to communicate with the first delegate unit; and a portable device for participating in a conference, wherein the control apparatus is configured to perform the method as described or claimed.
There is provided a method of configuring conference equipment for a first user at a venue, wherein the venue comprises a first delegate unit having a microphone and a control apparatus in communication with the first delegate unit, wherein the first user has a portable device for participating in a conference, the method comprising, at the portable device: requesting an updated configuration of the conference to form an association between the first delegate unit and the portable device, wherein the association indicates that the first delegate unit and the portable device are associated with the first user and causes the control apparatus to select the first delegate unit as a source of audio for the first user.
Optionally, the method comprises, after forming the association, receiving and/or sending control data to control or perform at least one function of the first delegate unit.
Optionally, the at least function of the first delegate unit comprises: request-to-speak; activate the microphone of the first delegate unit; deactivate the microphone of the first delegate unit; make a voting selection; select an audio channel.
Optionally, the method comprises, after forming the association, receiving and/or sending control data to control or perform at least one function which is not provided on the first delegate unit.
Optionally, the at least one function which is not provided on the first delegate unit comprises: make a voting selection; select an audio channel; a messaging function; access to electronic documents; editing of electronic documents.
Optionally, the request comprises an identifier of the first delegate unit, and the method comprises acquiring the identifier of the first delegate unit by at least one of: requesting user input of the identifier of the first delegate unit; causing a camera on the portable device to acquire an image of the identifier of the first delegate unit; causing a near field communication interface on the portable device to acquire the identifier of the first delegate unit by communication with the first delegate unit.
There is provided a method of configuring conference equipment for a first user at a venue, wherein the venue comprises a first delegate unit having a microphone and a control apparatus in communication with the first delegate unit and wherein there is a portable device for allowing the first user to participate in a conference, the method comprising, at the first delegate unit: acquiring an identifier of the portable device, or an identifier of the first user by near field communication; sending the identifier of the portable device, or the identifier of the first user, to the control apparatus, wherein the identifier is used to update a configuration of the conference to form an association between the first delegate unit and the portable device, wherein the association indicates that the first delegate unit and the portable device are associated with the first user.
Optionally, acquiring an identifier of the portable device is performed by near field communication.
There is provided a delegate unit configured to perform the method as described or claimed.
There is provided a computer program comprising instructions which, when the program is executed by a processor of a portable device, cause the processor to perform the method as described or claimed.
An advantage of at least one example or embodiment is that a user who attends the venue with a portable device (e.g. a tablet or computer that the user would normally use to remotely join a meeting, such as when working at home or in an office) can participate in a meeting at the venue with the same audio (and video) quality as other participants. This provides a more uniform meeting experience to participants. The first delegate unit has a directional microphone which provides a better audio quality. Using the directional microphone on the first delegate unit can also help to avoid audio problems, such as audio feedback, when portable devices with less directional microphones are used in a meeting venue. The portable device is configured to participate in a conference via a communication path to the control apparatus. The communication path can connect to a remote access system or a remote access server. The communication path can use a wide area network. The portable device uses a different communication path to the first delegate unit, such as a cellular wireless network or a wireless LAN of the venue.
An advantage of at least one example or embodiment is that a participant with a portable device can use the portable device to control one or more of the functions of the DU. For example, the participant can request-to-speak (RTS), turn the DU microphone on/off, select a voting option. Other functions are possible.
Another advantage of forming the association is that the participant can use the portable device to perform one or more functions which are not available on the DU, or to perform one or more enhanced functions. This contrasts with a conventional multi-user installed conference system where a participant uses a delegate unit of an audio conference system for audio and uses a personal computing device for document access, with no integration between the audio conference system and the personal computing device.
An advantage of at least one example or embodiment is that a participant with a portable device can participate in a meeting and can continue to use features of their portable device which may not be available with in-venue DUs. For example, the portable device may allow access to a digital agenda, document management system etc. Where a venue has legacy DUs, this can allow a venue to provide additional features to participants without the expense of replacing or upgrading the legacy DUs. It is expensive to upgrade DUs at a venue, and even upgraded DUs may provide inferior functionality compared to a user’s portable device. Another advantage is that the participant can continue to use a device they are familiar with, rather than trying to interact with an unfamiliar user interface of an in-venue DU.
Where a modified DU is provided, the participant can benefit from one or more functions which supports their portable device in the venue, such as a charging outlet.
An advantage of at least one example or embodiment is that a participant with a portable device can participate in a meeting and use their portable device to control microphone functions of the DU (e.g. request to speak) using their portable device, in the same manner as when they use their portable device as a remote attendee. This provides a more consistent user experience. The term “conference control unit” (CCU) relates to a unit which is found in audio conferencing systems. The CCU is connectable to a plurality of delegate units (DU). The connection between a CCU and a DU may be a wired or a wireless link. The maximum number of DUs served by a CCU varies between vendors and may range, for example, from 8 or 12, to a larger number such as 150 or 245. The CCU is configured to send audio to the DUs and to receive audio from the DUs. The CCU is configured to send control data/signals to the DUs and to receive control data/signals from the DUs. The CCU may provide power to the DUs. DUs may alternatively be called microphone units (MU) or contribution units. Some vendors use a different term to describe a unit which performs the function of a conference control unit, such as “central control unit (CCU)” or “audio processor and powering switch”.
Embodiments of the invention may be understood with reference to the appended claims.
Within the scope of this application it is envisaged that the various aspects, embodiments, examples and alternatives, and in particular the individual features thereof, set out in the preceding paragraphs, in the claims and/or in the following description and drawings, may be taken independently or in any combination. For example features described in connection with one embodiment are applicable to all embodiments, unless such features are incompatible.
For the avoidance of doubt, it is to be understood that features described with respect to one aspect of the invention may be included within any other aspect of the invention, alone or in appropriate combination with one or more other features.
BRIEF DESCRIPTION OF THE DRAWINGS
One or more embodiments of the invention will now be described, by way of example only, with reference to the accompanying figures in which:
FIGURE 1 shows conventional conference equipment at a venue;
FIGURE 2 shows conference equipment which supports an audio and video conference via a network-based server;
FIGURE 3 shows a conference system which supports remote attendee devices; FIGURE 4 shows a conference system which supports a user with a portable device in a venue;
FIGURE 5 shows a conference system which supports a user with a portable device in a venue;
FIGURES 6A-6D show some ways of forming an association between a delegate unit and a portable device; FIGURE 7 shows a method of operating a conference system;
FIGURES 8A-8C show examples of providing functions at a delegate unit and a portable device;
FIGURE 9 shows a method of operating a conference system;
FIGURE 10 shows the conference system in more detail;
FIGURE 11 shows a data structure for use in the conference system of FIGURE 6 or FIGURE 7;
FIGURE 12 schematically shows a delegate unit for use in a conference system;
FIGURE 13 shows the delegate unit;
FIGURE 14 shows a delegate unit which can be operated in two modes;
FIGURE 15 shows a conference system communicating with remote attendee devices;
FIGURE 16 shows processing apparatus for implementing the control apparatus or the delegate unit;
FIGURE 17 shows a method of operation of a control apparatus;
FIGURE 18 shows a method of operation of a portable device;
FIGURE 19 shows a method of operation of a delegate unit.
DETAILED DESCRIPTION
FIGURE 3 shows an example of a system with conference equipment at a first venue (VENUE A) 100. A meeting may only involve participants who are physically present in the first venue, or a meeting may involve participants who are physically present in the venue and at least one remote attendee (i.e. a participant who is not physically present in the venue.) In this disclosure, the term “meeting” includes a conference or an event.
The system at VENUE A comprises audio conferencing equipment comprising a conference control unit (CCU) 140 connected to a plurality of delegate units (DU) 110. Each DU has a microphone 111. Typically, the microphone is a high-quality microphone with a directional pick-up pattern. Each DU 110 may also have one or more of: a loudspeaker 112, an audio output socket for connecting to a headset, or some other form of audio output for providing audio to the participant. The connection between the DUs 110 and the CCU 140 may be wired or wireless. A delegate unit 110 may be called a microphone unit (MU), a discussion unit, a contribution unit or a conference unit. Another name for a conference control unit CCU is a central control unit or an audio processor and powering switch. The audio conferencing equipment may be permanently installed in the venue, such as DUs which are mounted on desks in a fixed manner. Alternatively, the audio conferencing equipment may be temporarily installed in the venue, such as portable DUs placed on desks, and the audio conferencing equipment can be moved from one location to another. The audio conferencing equipment may be equipment which is intended to be used in a standalone manner within VENUE A, i.e. equipment which is not intended to be used in conjunction with equipment external to the venue. The DUs 110 may be battery powered or powered via the CCU 140.
The system at VENUE A comprises video equipment comprising a plurality of video sources, such as cameras 120. The video equipment comprises one or more displays 130. The cameras 120 may be controllable in terms of direction (pan and tilt) and field of view (zoom). This type of control is called pan, tilt and zoom (PTZ). During a conference, one of the cameras 120 can be controlled to steer, in terms of pan and tilt, to point at a speaking participant. Zoom can be controlled to suitably frame the speaking participant, or multiple participants. A video output of the speaking participant from the camera 120 can be output to display 130. The display 130, or other digital signage, can be used to display other information related to the conference, such as name of the speaking participant, presentation materials (e.g. slides), voting instructions, voting results etc. An audio output may also be provided to an in-venue audio system 135 and/or to other parties wishing to listen to the conference, such as a translator.
The system at VENUE A comprises a control unit, called a Director 150. The Director 150 is connected to the CCU 140. In this example, the cameras 120 and displays 130 are also connected to the Director 150. The connection between the Director 150 and the CCU 140 can carry audio signals (e.g. in a digital format or in analogue format) and control/data signals. Examples of control data/signals are: control data/signals for turning a DU microphone on/off; control data/signals for requesting to speak; control data/signals indicating a voting selection made at a DU; control data for display at a DU.
The system of FIGURE 3 supports remote attendees to a meeting. Remote attendees are participants who are not physically present in VENUE A. A remote attendee may join the meeting by using a portable device 320 in their home or office, or while travelling. A remote attendee device RA(A1-AN) connects to the meeting via a Remote Attendee System (RAS) and a wide area network (e.g. Internet) 300. The number of remote attendee devices can be any number between 1 and N. The remote attendee devices may be a personal computer (PC), tablet, smartphone or other computing device running an application 305 which can communicate with the RAS. The application 305 is capable of communicating audio data with the RAS via a data network, i.e. audio is carried in packetised form over a data network. A suitable protocol for carrying audio (and video) data is Voice over Internet Protocol (VoIP). Other protocols can be used. Audio is captured by a microphone 321 on the remote attendee device 320, or by an external microphone which is connected to the remote attendee device 320. Audio is output by a loudspeaker 322 on the remote attendee device 320, or an external loudspeaker, headset or earpiece which is connected to the remote attendee device 320. Video can be captured by a camera 323 (e.g. a webcam) which is integrated with the portable device 320, or which is connected to the portable device 320. The application 305 can display video of the meeting. The communication path between the Director 150, RAS 304 and the remote attendee device 320 may also support control data. The application 305 can also display virtual control buttons which provide the same, or similar, functionality as participants in the venues 100, 200. For example, the virtual control buttons can support request-to-speak, voting etc. This allows a remote attendee who has an Internet connection to participate in the conference in the same manner as a participant who is physically present in one of the venues. The remote attendee device 320 has a user interface 324, such as a touchscreen or a display and a trackpad or a mouse for user input.
The system comprises an admin server 306. The admin server 306 hosts a document management system (DMS) 307. The DMS 307 may interface to third party DMS systems (not shown) and import documents to the DMS 307. The DMS provides document management services for meetings/conferences, such as documents which are discussed during meetings/conferences.
A meeting or conference typically has an agenda of items to be discussed. The DMS 307 can store agenda data (e.g. in an agenda folder) comprising agenda meeting items. An Agenda application communicates with the Director 150. Each agenda meeting item may include information in respect of:
- the name of the person that is leading the agenda item;
- a list of documents in the DMS associated with that agenda item;
- an amount of time allotted to the agenda item;
- information regarding a vote in respect of that agenda item e.g. a statement defining the vote such as a motion.
The remote attendee can use their portable device 320 to access the meeting agenda and associated documents, such as by communicating with the admin server 306 (directly, or via the RAS 304), or by communicating with the RAS 304. The RAS 304 can access the meeting agenda and associated documents on the admin server 306, or on a further database which is accessible to the RAS 304.
System with a conventional DU FIGURE 4 shows a scenario in which a participant attends a meeting in the venue 100 with the portable device 320. The portable device 320 can participate in the meeting by communicating with the RAS 304, in a similar manner as if the participant were a remote attendee outside the venue (FIGURE 3). The portable device 320 may use a communication network of the venue (e.g. VENUE A's Wi-Fi network 170 and gateway 172) to access the Internet 300 and RAS 304, or the portable device 320 may use a cellular wireless network 380 to access the Internet 300 and RAS 304.
When the participant attends a meeting in the venue 100 with their portable device 320, an association or “pairing” 180 can be formed between: (i) one of the DUs 110 in the venue; and (ii) the portable device 320. The association indicates that the DU 110 and the portable device 320 are associated with the same user. In this example, the association 180 is formed between DU(AN) and device 320. One advantage of forming the association is to allow the participant to make use of the better audio capabilities of the DU 110 in the venue. The DU 110 in the venue usually has a higher quality microphone 111 than the microphone 321 fitted to the portable device 320. The microphone 111 in the DU 110 will more clearly capture audio of the participant in the venue and provide a better meeting experience for other users. After forming the association 180, the in-venue video camera(s) 120 may be used to capture video of the participant instead of a camera 323 on the portable device 320. The in-venue cameras will provide a higher quality video feed than the camera 323 fitted to, or normally used with, the portable device 320. The association 180 can be stored as part of the configuration data 152 used by the Director 150.
Forming the association 180 may allow the participant to control one or more of the functions of the DU 110 using the portable device 320. For example, the participant can request-to-speak (RTS), turn the DU microphone on/off, select a voting option. Forming the association 180 may allow the participant to control or perform one or more functions which are not available on the DU 110, or may allow the participant to control or perform one or more enhanced functions. For example, the DU may have a plurality of buttons for selecting voting options, but the DU may lack any capability to display labels indicating what the voting buttons correspond to. The portable device 320 can display voting buttons, and descriptive labels corresponding to the current vote.
Another example of enhanced functionality is allowing a portable device to support functionality required for a meeting chairperson (“Chair”). A chairperson has additional functions compared to other participants. In a meeting where participants request to speak, there is a list of participants who have requested to speak. This list is called an RTS list. The Chairperson has functions associated with controlling or managing the RTS list. For example, the functions can comprise: advancing to the next person in the RTS list; deleting an entry in the RTS list; moving entries up/down the RTS list. The Chairperson can also speak during a conference, independently of the RTS list. The Chairperson functionality can be provided on a portable device 320. By associating a particular portable device 320 with a DU 110, that person is able to perform the role of Chairperson and has the functionality to control Chairperson functions by using their portable device.
Another example of enhanced functionality is allowing a portable device 320 to support chat functionality. This is text-based messaging between participants (e.g. between a participant and the Chairperson). For example, a participant may use the chat function to message the Chairperson with details of a technical difficulty with the audio equipment.
The participant can continue to use their portable device 320 to access the RAS 304 in the same manner as described above for FIGURE 3. The participant can use their portable device 320 to access RAS 304 to access the meeting agenda and associated documents.
Another example of enhanced functionality is supporting multiple audio channels, such as multiple language channels. The user interface on the portable device can allow a participant to select from a plurality of language channels. The selected audio channel may be delivered to the DU 110, where the audio conferencing equipment is capable of distributing a selected audio channel to a particular DU. Alternatively, the selected audio channel may be delivered to the portable device 320 and output via the speaker 322 or audio output of the portable device 320.
In FIGURE 4, DU(AN) 110 is a conventional DU. That is, DU(AN) is a DU which has not been modified to allow an association 180 to be made. The association 180 between DU(AN) and device 320 is a logical association, which involves the control unit 150. The association 180 causes the control unit 150 to select the source of the audio (and video) for the participant using device 320. Some possible ways of forming the association 180 are described below. The association between DU(AN) 110 and device 320 does not require an electrical connection or wireless communication between the DU(AN) and device 320.
System with a modified DU
In FIGURE 5, the system at VENUE A comprises a modified DU 510. DU 510 is provided with one or more additional features compared to a conventional DU 110. DU 510 may comprise functionality to support the forming of an association 180 between the DU 510 and device 320. For example, DU 510 may comprise a near-field communication (NFC) module to support near-field communication with device 320, or some other NFC device. DU 510 may provide a power supply outlet for the device 320, such as a Universal Serial Bus (USB) interface. DU 510 may comprise physical features for interacting with the device 320, such as a supporting ledge or shelf for supporting a device 320 in an inclined position. In this example the modified DU 510 directly communicates with the control unit 150 via a LAN 160, and does not communicate with a CCU 140. The control unit 150 may host a virtual CCU which provides the functionality which is the same as, or similar to, CCU 140. Alternatively, the modified DU 510 may communicate with a CCU 140 which can support the additional functionality of the modified DU 510.
FIGURES 6A-6D show some possible ways for forming an association between a DU 110 (or a modified DU 510) and a portable device 320. In FIGURE 6A, DU 110, 510 has a Quick Response (QR) code 114, a bar code or some other form of machine-readable indicia. The indicia may be in the form of a label attached to the DU, printing applied directly to the DU, or another form. A QR code is a two-dimensional barcode which represents a digital code. The digital code identifies the DU 110, 510. The portable device 320 has a camera 326. A code capture module 332 is configured to use the camera 326 to capture an image of the QR code (or other indicia) 114 and extract the digital code represented by the QR code 114. The portable device 320 is configured to send the digital code to the RAS 304. This digital code can then be used to associate the portable device 320 with the DU 110, 510 identified by the digital code.
In FIGURE 6B, DU 110, 510 has human-readable indicia, such as a string of numbers (e.g. “12345”), a string of letters (e.g. “ABCDE”), or a string of numbers and letters (e.g. “XYZ123”). The code identifies the DU 110, 510. The indicia may be in the form of a label attached to the DU, printing applied directly to the DU, hand-written marking, or another form. A code entry module 334 is configured to allow a user to enter the code 116. The portable device 320 is configured to send the code to the RAS 304. This code can then be used to associate the portable device 320 with the DU identified by the code. In a further alternative, the camera 326 and code capture module 332 of FIGURE 6A can acquire an image of the string displayed on the DU, and convert that to a digital code by optical character recognition or other technique.
In FIGURE 6C, the DU 110, 510 has an NFC (RFID) tag 516. For example, the NFC tag 516 can be in the form of a label which is affixed to the DU. The NFC tag 516 stores a digital code which identifies the DU 110, 510. The portable device 320 has an NFC reader 330. The portable device 320 is configured to use the NFC reader 330 to interrogate the NFC tag 516 and receive the digital code stored on the NFC tag 516. This digital code can then be used to associate the portable device 320 with the DU 110, 510. An NFC tag is usually a passive device which does not contain a power supply. The NFC tag uses the interrogating radiation from the reader to power the NFC tag and send a reply. In an alternative, the DU 510 has an NFC (RFID) module. The NFC module stores a digital code which identifies the DU 510. An NFC module is an active device which is powered by the host, i.e. by the DU 510.
FIGURE 6D is similar to FIGURE 6C, but the position of the NFC reader and NFC tag (or NFC module) have been swapped. The portable device 320 has an NFC (RFID) tag 336. NFC (RFID) tag 336 is the same, or similar, to the NFC tag 516. It stores a digital code which identifies the portable device 320. The DU 510 has an NFC (RFID) reader 530. The DU 510 is configured to use the NFC reader 530 to interrogate the NFC tag 336 and receive the digital code stored on the NFC tag 336. This digital code can then be used to associate the portable device 320 with the DU 510. In an alternative, the portable device 320 has an NFC (RFID) module. The NFC module stores a digital code which identifies the portable device 320. An NFC module is an active device which is powered by the host, i.e. by the portable device 320.
FIGURES 6A-6D are some examples of forming an association. Other ways are possible.
FIGURE 7 shows an example of operation of the system of FIGURE 4 or FIGURE 5. Initially, a user attends VENUE A with their portable device 320 and selects a DU that they would like to use during the meeting. For example, some venues may allocate one or more “hot desking” positions, each equipped with a DU. The participant then begins a process to form an association between their portable device 320 and the selected DU. As shown in FIGURE 6A and FIGURE 6B, the participant may use their portable device 320 to acquire an image of a QR code on the DU, or the participant may manually enter a code displayed on the DU. At 402, an association request is sent from the portable device 320 to the RAS 304. The association request includes the digital code which identifies the DU. At 404, the association request is forwarded to the Director 150.
The Director 150 uses the code, received at 404, to associate the DU with the portable device 320. The Director knows which DU the participant wishes to use. The Director updates a configuration for that DU and portable device 320. For example, the Director updates the configuration to select the DU as a source of audio for the first user, instead of the portable device. The updated configuration selects the DU as a destination of conference audio for the first user, instead of the portable device. The Director can also update the configuration to select in-venue cameras 120 as a video source of the first user, instead of the portable device. At 408, 410 the Director confirms the association with the portable device 320.
During a meeting, audio is received 412 from the microphone on the DU. Also, audio (i.e. an audio mix of speakers participating in the meeting) is sent to the DU, for output to the participant. Video is received 416 from the camera in the venue. Video is sent 418 to the in-venue display(s).
During a meeting, control data may be received from one, or both, of: (i) the DU 110, 510; and (ii) the portable device 320. The participant may interact with the user interface on the DU to perform functions such as request-to-speak, turn their microphone on/off, or vote. This is shown at 424. The participant may interact with the user interface 324 on the portable device 320 to control a function of the DU 110, 510, such as request-to-speak, turn their microphone on/off, or vote. Control data to/from the portable device 320 is sent 420, 422 via the RAS 304. The Director 150 can send control data to the portable device 320 to provide an enhanced version of a function of the DU, or to provide a function which is not supported by the DU.
The association between a portable device 320 and a DU 110, 510 can be formed before the start of a meeting. It is also possible to form an association between a portable device 320 and a DU 110, 510 while the portable device is already participating in an ongoing conference. Before forming the association, the portable device 320 is a source of audio for the user and the portable device 320 is a destination of conference audio. After forming the association, the DU 110, 510 is a source of audio for the user and the DU 110, 510 is a destination of conference audio. Before forming the association, a camera on the portable device 320 is a source of video for the user. After forming the association, a camera within the venue can be a source of video for the user.
FIGURES 8A-8C show some examples of the functions provided by the portable device 320. In FIGURE 8A the portable device 320 provides the same function as the DU 110, 510. In this example, the DU has an RTS button. The user interface of the portable device 320 also displays a button (i.e. a virtual button on a display or touchscreen of the portable device 320) for RTS. The participant can either press the RTS button on the DU, or they can press the virtual button RTS on the user interface 324. When the participant presses the virtual button RTS on the user interface 324, control data is sent to the Director 150. In FIGURE 8B the portable device 320 provides an enhanced version of the same function of the DU. In this example, the DU 110, 510 has buttons for voting. The voting buttons are labelled “A”, “B” and “C”. The Director 150 sends control data to the portable device 320 which causes the user interface 324 of the portable device 320 to display buttons for the voting options and labels which describe each of the voting options, e.g. Option A = “To maintain the current budget”; Option B = “To increase the current budget”; Option C = “To reduce the current budget”. The participant can either press the buttons A, B or C on the DU, or they can press the virtual buttons A, B or C on the user interface 324. When the participant presses one of the virtual buttons A, B or C on the user interface 324, control data is sent to the Director.
In FIGURE 8C the portable device 320 provides a function which is not provided on the DU. In this example, the DU 110, 510 is a normal delegate DU which does not support any Chairperson functions. The Director 150 sends control data to the portable device 320 which causes the user interface 324 of the portable device 320 to display data and virtual buttons for the Chairperson function. For example, the user interface displays the RTS list (i.e. participants who have requested to speak) and displays virtual buttons for functions such as: advancing to the next person in the RTS list; deleting an entry in the RTS list; moving entries up/down the RTS list.
In addition, the participant may interact with the user interface on the portable device 320 to perform other functions, such as accessing documents for the meeting.
FIGURE 9 shows an example of operation of the system of FIGURE 5 where the modified DU 510 includes an NFC reader. There are several possible ways in which this type of system can operate. In one example, the process begins by near field communication between the DU 510 and an NFC device. Initially, a user attends VENUE A with their portable device 320 and selects a DU that they would like to use during the meeting. The participant then begins a process to form an association between their portable device 320 and the selected DU. As shown in FIGURE 6C and FIGURE 6D, the DU 510 has an NFC reader 530. The NFC reader 530 can interrogate 422 an NFC device. In one example, the NFC device is an NFC tag attached to the portable device 320, or an NFC module in the portable device 320. In another example, the NFC device is an NFC tag belonging to the participant, such as a staff badge which comprises an NFC tag. The DU receives a digital code identifying the portable device 320 (or the participant). At 424, an association request is sent from the DU to the Director 150. The association request includes the digital code which identifies the portable device (or the participant). The association request also identifies the DU. Optionally, at 426, the Director 150 may notify the RAS of the association request for that portable device 320. The notification sent at 426 may enquire if the conference application 305 on RA(A1) is currently in use, e.g. whether the participant has logged on to the RAS. The response 428 can indicate if the participant is logged in. The notification 426 can include a code which the DU received from the NFC device at 422. The RAS can use that code to look-up the participant. The response 428 can return other data, such as the name e.g. “Jane Smith” of the participant corresponding to that code. The exchange 426, 428 can serve as a security feature.
The method may proceed directly to block 436. Alternatively, the method may comprise additional steps which communication with the portable device RA(A1). For example, the RAS may notify 430 the portable device RA(A1) that an attempt has been made to associate that device with a DU. The application 305 on RA(A1) may ask the participant to confirm that they wish to associate their device with a DU, and may identify the DU. This can prevent unintended association between RA(A1) and the DU, such as when a user places RA(A1) on a desk next to the DU. Also, this can prevent unintended association between RA(A1) and the DU in a situation where the staff badge belonging to the owner of RA(A1) has been mislaid or stolen.
At 436, the Director uses the code, received at 424, to associate the DU with the portable device 320. The Director updates a configuration for that DU and portable device 320. For example, the Director updates the configuration to receive audio of the participant of the portable device 320 from the DU, instead of from the portable device. The Director can also update the configuration to receive video of the participant from an in-venue camera, instead of from the portable device. At 438 the Director confirms the association to the DU. At 440, 442 the confirmation of the association is sent to the portable device 320 via the RAS 304. During a meeting, operation of the system is the same as shown for FIGURE 7.
FIGURE 10 shows an example overview of signals and data sent between equipment at venue 100. A conventional DU 110 typically communicates with a CCU 140 using a proprietary communications protocol. The communications link may be wired or wireless, such as Wi-Fi. Each DU 110 is able to transmit an audio signal (in analogue or digital format) via the communications link when the microphone associated with the DU is active. The DU 110 can also receive an audio signal from the CCU 140 and output the audio through one or more loudspeakers 112. The DU 110 can transmit a control signal/data in the form of a microphone Request-to-Speak (RTS) indication each time a microphone RTS button is activated. The DU 110 can also transmit MIC ON and MIC OFF indications (e.g. in the form of digital control data) to inform the CCU 140 of the status of the microphone associated with the DU. Other possible control signals are control signals to support voting functions. During a meeting, a participant may have an opportunity to vote on a matter. A DU may present the participant with voting selections, such as “Yes”, “No” or “Abstain”. A DU may receive a control signal indicating when a vote occurs (and voting options) and the DU may output a voting selection, indicating the voting selection of the participant, such as Yes/No/Abstain.
The CCU 140 is configured to output an audio signal/audio data and control data to the Director 150. The audio signal may be a mix of audio signals from one or more active microphones. The audio signal may comprise two or more individual channels. For example, systems employing Dante™ audio networking, up to eight individual audio channels may be output by the CCU 140 in a digital, frame or packet-based format.
The Director has an interface configured to communicate with the CCU 140. Interface 152 will be called an audio interface or a CCU audio interface. In general, audio interface 152 can receive audio (in analogue or digital form) from the CCU 140 and can send audio (in analogue or digital form) to the CCU 140.
Various control data is sent from the CCU and received by the CCU 140. The control data output by the CCU 140 can indicate whether a DU is connected to the CCU 140. The control data output by the CCU 140 can provide information in respect of a microphone of a DU, such as one or more of: an indication of when an RTS button of a DU is pressed; confirmation of a microphone on/off at a DU. The Director 150 has an interface 151 configured to communicate with the CCU 140. The audio and control signals between the CCU 140 and Director 150 may be carried in frame or packet-based form over a local area network, such as in payloads of Ethernet frames.
The Director 150 can receive video from a range of video sources, such as cameras. Camera 120 has an interface 122 to connect to a network. Video and control signals between the camera 120 and Director 150 may be carried in frame or packet-based form over a local area network, such as in payloads of Ethernet frames. The camera 120 can have an IP address and the interface can have an IP (TCP/IP) layer. The Director 150 has a video source interface 153 for receiving video data from the camera 120 and for communicating control data to the camera, such as commands to control pan, tilt and zoom (PTZ) operations of the camera. The interface with the camera may also carry power, or a separate power supply may be provided for the camera. An example of an interface which carries data and power is Power over Ethernet (PoE), with the video data and control data carried in the payloads of Ethernet frames. Other video sources with a network interface (e.g. IP) can be connected in the same manner as shown. A video source may connect directly to the Director 150 instead of, or in addition to, any video equipment connected to a LAN. A direct connection may use a High Definition Multimedia Interface (HDMI), or another kind of video or media interface.
The Director 150 comprises a video output interface 155 for communicating with at least one display 130 or digital signage device. The Director 150 may comprise additional audio interfaces 156, 157. Audio interface 156 is configured to receive audio from another audio source, such as a microphone (other than a DU 110), a microphone associated with camera 120, audio accompanying video received from a video player or another media source (local or networked). Audio interface 157 is configured to output audio to an audio system 135 or other audio device requiring a feed from a meeting. For example, a meeting requiring a translation service requires an audio output to allow a translator to perform translation in real time. It is also advantageous to provide an accompanying video output to the translator so that the translator can see the lips of the person speaking.
The Director 150 has an external interface 158 for communicating with the RAS and external servers. The external interface 158 can also be used to communicate with one or more other Directors. Communication with other Directors may be via a local area network (e.g. where Directors are located in the same building) or via a wide area network such as the Internet (e.g. where Directors are located in different buildings).
FIGURE 11 shows an example of a data structure 152 which can be used by the Director 150 to store configuration data about a meeting. In this simple example there are three participants at VENUE A and a remote attendee. The Director 150, 250 has an overview of all participants/seats in a meeting and can allow all of the participants to participate in a unified meeting environment. The data structure 152 contains an identifier 352 of a seat number in the overall meeting across all participants. The data structure 152 contains an identifier 354 of where the participant is physically located. Identifier 354 maps the seat number to a physical location of the seat. In this example, seat 1 corresponds to DU(A1) at VENUE A, seat 2 corresponds to DU(A2) at VENUE A, seat 3 corresponds to DU(A3) at VENUE A and seat 4 corresponds to a remote attendee, hosted by the RAS 304. The mapping 354 indicates which interface the Director should use to communicate with the participant (seat). The data structure 152 contains an identifier 356 of an association. As described above, an association can be formed between a DU in the venue and a portable device. In this example, DU(A3) in the venue is associated with RA(A1). This means that DU(A3) and RA(A1) are both associated with the same participant. The data structure 152 contains an identifier 357 of a status of the seat. In this example, the current statuses are: MIC ON; MIC OFF; RTS. Other statuses are possible. The data structure 152 contains an identifier 358 of a video source which corresponds to the seat. The video source can be a camera, an image file or some other source. The data structure 152 can also store video presets 359. A video preset can be associated with a set of instructions for controlling a camera, such as PZT values. This causes a camera to frame a shot for the seat. The data structure 152 can also store one or more other types of data for each seat. The Director 150 can update the data structure 152 when: control data is received from a local CCU or DU; control data is received from RAS 304. The Director may periodically exchange status data with other entities to ensure the locally held data in data structure 152 is up-to-date.
The association field 356 in the data structure 152 indicates an association between a DU and a portable device. In this example, DU(A3) is associated with RA(A1). When the Director 150 receives control data for RA(A1), it will use that control data to control operation of DU(A3). For example, if the Director receives control data from the RAS indicating that RA(A1) has made a RTS, the Director adds DU(A3) to a RTS queue.
FIGURE 12 shows an example of a modified DU 510. The DU 510 may be in the form of a unit for desktop and/or wall mounting. The DU 510 has a wired LAN communications interface 526 for communicating with the Director 150, such as an Ethernet interface or a Power over Ethernet (PoE) interface. A PoE interface has data and power. The DU 510 has a wireless LAN communications interface 528 for communicating with the Director 150, such as a Wi-Fi interface. The DU 510 may use the wired communications interface 526 or the wireless communications interface 528 for communicating with the Director 150. As described above, the communications interface is used to carry audio to and from the Director, and control data.
The DU 510 has a microphone 511. The microphone 511 can have a directional pick-up pattern which helps to exclude unwanted background sources of noise. The DU 510 has a loudspeaker 512, and may also have an audio output socket for connecting a headset, such as a 3.5 mm jack socket. Although not shown, the DU 510 may also comprise audio processing modules to perform one or more of: analogue-to-digital conversion of an audio signal output by the microphone 511; digital-to-analogue conversion of a digital signal output by the processor 520. The DU 510 may also comprise one or more of: an audio amplifier for the audio output 512; a headphone amplifier for the audio output socket 512; a microphone pre-amplifier for an input audio line from the microphone 511. The DU 510 has a user interface 524. This can be in the form of physical buttons, a touchscreen display or some other user input device.
The DU 510 has a Universal Serial Bus (USB) interface 522 with one or more ports 523. This may be used to communicate with an attached device or may only be used to provide a power supply to a portable device 320.
Optionally, the DU 510 has a battery 517 which may power the DU. If the DU 510 is connected to a PoE interface, or a mains power supply, the battery may not be required.
Optionally, the DU 510 has a NFC module 530. This can communicate with an NFC tag or an NFC module on an NFC-enabled portable device.
Optionally, the DU 510 has a Personal Area Network (PAN) wireless communications interface 518, such as a Bluetooth™ interface. The PAN interface 518 may be used to communicate audio to a host device, as described below.
A processor 520 is connected to the functional modules of the DU 510 and controls operation of the DU 510. The processor 520 is configured to output control data to the Director based on inputs via the user interface, such as a request-to-speak indication. The processor 520 is configured to control operation of the DU in response to control data received from the Director, such as turning the microphone 511 on/off. The processor 520 comprises one or more processor which may be any type of processor for executing instructions to control the operation of the device. Processor-executable instructions 504 may be provided using any data storage device or computer-readable media, such as memory 503. The processor-executable instructions 504 comprise instructions for implementing the functionality of the described methods. The memory 503 is of any suitable type such as non-volatile memory, a magnetic or optical storage device. Memory 503, or an additional memory, stores data used by the processor 520.
FIGURE 13 shows an example of a Delegate Unit (DU) 510. The DU comprises a housing 540 with a microphone 511. A control button or key 524A is provided on the housing 540. The control button 524A may function as a switch to allow the participant to turn on the microphone 511 before speaking. Alternatively, the control button 524A may function as a request-to-speak button. The participant may press the control button 524A to indicate that they wish to speak. The DU may also comprise an indicator 524B which can be illuminated when the microphone is turned on (active). The DU may comprise one or more loudspeakers 512 to provide the participant with audio. The audio may be the current speaking participant, a mix of the current speaking participants, or other audio, such as audio accompanying a video presentation. The DU may comprise one or more further buttons or keys 524C for other purposes during the conference, such as voting (e.g. “YES”, “NO”). The DU may comprise a display 524D. The display 524D can be used to display operating settings or information related to the conference. The display 524D may be a display which only displays information to a participant, or it may be a touch screen display which allows a participant to make selections. One or more of the buttons, such as buttons 524C may be implemented as virtual buttons on the touch screen. For example, at a time of a vote, the display can display two virtual buttons for “YES” and “NO”.
DU with two operating modes: in-venue mode and remote access mode
FIGURE 14 shows a modified DU 510 which is configured to operate in two modes:
(i) a first (in-venue) mode. In this mode, the DU 510 communicates with a control unit (Director 150) in the venue 100 via a wired communications interface (e.g. Ethernet, PoE) 526 or a wireless communications interface (e.g. Wi-Fi) 528. The microphone 511 and audio output 512 on the DU 510 are used, and audio is communicated to the Director 150 via the wired or wireless LAN communications interface 526, 528.
(ii) a second (remote) mode. In this mode, the DU 510 communicates with a portable device 320. The DU 510 functions as a peripheral or an accessory of the portable device 320. The DU 510 provides higher quality audio functions compared to the portable device 320. The application 305 selects the microphone 511 on the DU 510 as an audio source and mutes the microphone 321 on the portable device 320. The application 305 selects the speaker 512 on the DU 510 as an audio destination and mutes the speaker 322 on the portable device 320. Similar to the in-venue operation, a user may either use controls on the user interface 524 of DU 510, or controls on user interface 324 to perform functions such as request-to-speak, vote etc.
In the second (remote) mode, the DU 510 uses a different communication interface compared to the first mode. For example, the DU 510 can use a PAN wireless communication interface (e.g. Bluetooth™) to communicate with the portable device 320. Another possible interface is a USB interface, such as one of the USB ports 523. The portable device 320 can use a wired or a wireless connection to the home/office LAN network and gateway to access the Internet and communicate with the RAS 304.
The DU 510 is capable of operating in both of the modes. A DU 510 may only be used in one of the modes during an operating lifetime (e.g. the DU is always used in a venue in the first mode, or always used outside a venue in the second mode). Alternatively, a DU 510 may be used in both modes. For example, a user may be allocated a personal DU 510, and may use the DU 510 when they are working remotely, and also carry the same DU 510 with them and use within a meeting venue when they attend a meeting in the meeting venue.
A user may also use the DU 510 as a peripheral or an accessory of the portable device 320 when participating in other types of network-based conferencing services which do not involve the RAS 304. The DU 510 operates in the same manner as the second mode. The DU 510 provides higher quality audio functions compared to the portable device 320. The application 305 selects the microphone 511 on the DU 510 as an audio source and mutes the microphone 321 on the portable device 320. The application 305 selects the speaker 512 on the DU 510 as an audio destination and mutes the speaker 322 on the portable device 320.
There are various ways of controlling the operating mode of the DU 510. In one example, the DU 510 can be manually controlled by a control on the DU 510, such as a selector switch with a first position (Mode 1) and a second position (Mode 2). In another example, the DU 510 can default to one of the operating modes and a user can control the DU to select the other mode. For example, the DU 510 can default to the in-venue mode and a user can operate a control on the DU to cause the DU to enter the second (remote) mode. This may cause the DU 510 to pair with the portable device 320.
FIGURE 15 shows the system for supporting remote attendee devices in more detail. The Director 150 at VENUE A communicates with RAS 304. RAS 304 communicates with remote attendee devices RA(A1), RA(A2). RAS 304 comprises Remote Attendee CCU 312 and a Media Server 313. The Remote Attendee CCU 312 manages connectivity and status using control data. The Media Server 313 supports the forwarding of media content, such as audio, video and data (e.g. documents associated with a meeting).
The Director hosts a software module 311 which provides an interface to the RAS and the remote attendee devices RA(A1), RA(A2) connected to the RAS. The software module 311 can be a library stub. The software module 311 appears to the Director as an interface to another CCU and connected DUs, which allows a unified functionality at the core of the Director. The RAS and remote attendee devices RA(A1-AN) can be viewed as a remote attendee CCU with a plurality of connected DUs. The CCU (RAS) 311 provides an interface between the Director and the RAS. It offers the same functionality to the Director as a hardware CCU 140, but calls upon the RAS 304 to provide status and audio/video functionality. The Director 150 provides the seamless management of local and remote attendees. The RAS 304 runs as an Internet service which accepts connections from both the CCU (RAS) 311 and Remote Attendee Client applications 305. It maintains the activation state of each attendee, handles authorisation of attendees to a meeting, provides the audio and video streams for remote attendees, and ensures that all attendees are provided the same content, regardless of location.
The Remote Attendee Client application 305 runs on the remote attendee’s device 320, and connects to the RAS 304. The client application 305 presents audio and video data from the meeting, sends voice and video data into the meeting, and provides convenient access to the same documents and facilities that regular event attendees enjoy. An example user interface 314 of the application is shown. The user interface 314 comprises controls, such as a virtual request to speak (RTS) button 315. An indicator 316 indicates status of the microphone (on or off). A pane 317 displays video. Typically, this will be the same video as is currently being displayed in the VENUE A. Metadata 318 associated with the speaker is displayed, such as speaker name. A pane 319 provides access to documents associated with the meeting, such as the agenda and any documents discussed on the agenda.
When an event is marked as having remote attendees, a Remote Attendee CCU 312 is prepared in the RAS 304. Remote attendees can then be added to the Remote Attendee CCU 312, allowing the proper control of who may and may not be present (remotely) in an event. Each meeting will have a unique Remote Attendee CCU identifier associated with it, and once the Client has successfully authorised themselves to the RAS, a list of appropriate identifiers will be provided by the server.
The Director 150 connects to the Remote Attendee CCU 312 and integrates the remote attendees into the meeting, to form a single list. When the meeting is running, it is the job of the CCU (RAS) 311 to communicate with the RAS 304 to ensure that updates to the state of the meeting (e.g. change of active speaker, or the start of a vote) are made available to Remote Attendee Client applications 305, and any actions or notifications sent by a Remote Attendee Client application 305 are handled appropriately.
The Remote Attendee Client application 305 will negotiate a connection to an existing remote attendee CCU 312 and, if successful, will appear as a connected DU on that device. The RAS 304 will send meeting audio and video to the Remote Attendee Client application 305, and will notify the Remote Attendee Client application 305 about any changes to the state of the meeting. The Director 150 and the RAS 304 can manage the status of remote attendees to a meeting, such as by an asynchronous communication channel. The Director 150 and the RAS 304 can query, respond and update the status of a Remote Attendee.
FIGURE 16 shows an example of a processing apparatus 800 which may be used to implement the Director 150. Processing apparatus 800 comprises one or more processor 801 which may be any type of processor for executing instructions to control the operation of the device. The processor 801 is connected to other components of the apparatus via one or more buses 802. Processor-executable instructions 804 may be provided using any data storage device or computer-readable media, such as memory 803. The processor-executable instructions 804 comprise instructions for implementing the functionality of the described methods. The memory 803 is of any suitable type such as non-volatile memory, a magnetic or optical storage device. Memory 805, or memory 803, stores data used by the processor.
The processing apparatus 800 comprises an I/O interface 807 which allows the processing apparatus 800 to connect to a display and an input device (e.g. keyboard, mouse or pointer device). The I/O interface 807 can comprise a USB interface. A user interface 812 can be provided on a display connected to the I/O interface 807, or on another computing device which communicates with the processing apparatus 800 via the network interface 808 or the wireless network interface 809.
The processing apparatus 800 comprises various network interfaces 808-810. Network interface 808 connects to a wired network, such as a local area network and/or a gateway/router. Wireless network interface 809 connects to a wireless network, such as audio and/or video equipment within the venue, or other wireless equipment. The network interfaces 808, 809 can communicate audio, control and video data to equipment.
FIGURE 17 shows a method for configuring conference equipment for a first user at a venue. The method can be performed by the Director 150. At block 602 the method determines that the first user wants to use the first delegate unit to participate in the conference. This can be achieved in several ways. At block 604 the method determines that the first user wants to use the first delegate unit in the venue by receiving a request to form an association from the portable device. At block 606 the method determines that the first user wants to use the first delegate unit in the venue by receiving a request to form an association from the first DU. At block 608 the method updates a configuration of the conference to form an association between the first delegate unit and the portable device. The association selects the first delegate unit as a source of audio for the first user. The association selects the first delegate unit as a destination of conference audio for the first user. The association can select the first delegate unit as a destination of conference audio for the first user. The association can select the in-venue camera(s) as a video source for the first user.
At block 610, the association enables the portable device to control at least one function of the first delegate unit via the portable device. The control apparatus receives control data from the portable device for the at least one function and performs the at least one function.
At block 612, the association enables the portable device to control at least one function via the portable device. This is a function which is not supported by the first DU. The control apparatus receives control data from the portable device for the at least one function and performs the at least one function.
FIGURE 18 shows a method for configuring conference equipment for a first user at a venue. The method can be performed by the portable device 320. At block 652 the method requests an updated configuration of the conference to form an association between the first delegate unit and the portable device. The association indicates that the first delegate unit and the portable device are associated with the first user and causes the control apparatus to select the first delegate unit as a source of audio for the first user.
At block 654, the method sends control data to perform or control at least one function of the first delegate unit.
FIGURE 19 shows a method for operating a delegate unit. This corresponds to the DU shown in FIGURE 14. The method can be performed by the DU 510. At block 662 the method selectively operates the DU in a first mode and a second mode. At block 664 the DU operates in the first (in-venue) mode. The DU is configured to send and receive audio data via the LAN communication interface and to communicate with a conference control apparatus. At block 666 the DU operates in the second (remote access) mode. The DU is configured to send and receive audio data via a different communication interface (e.g. the PAN communication interface) and to communicate with a device hosting a remote access application. The system described above has a single venue, VENUE A. It is also possible to form a conference which includes one or more additional venues, with communication of audio, video and control data between the venues.
In the system described above, the Director 150 at VENUE A has functionality for forming an association between a delegate unit 110 and a portable device 320 at VENUE A. More generally, each venue can have a Director with functionality for forming an association between a delegate unit 110 and a portable device 320 at that venue. One advantage of providing this functionality at each venue is that the local Director can continue to support a meeting between participants at the local venue in the event of a network failure.
In another system, at least part of the functionality of the Director (or multiple Directors) can be implemented by a Virtual Director V-DIR hosted by a server. For example, the V- DIR can have functionality for forming an association between a delegate unit 110 and a portable device 320 at VENUE A. The V-DIR receives information about a user wanting to use a delegate unit to participate in the conference. The V-DIR can have functionality for forming an association between a delegate unit 110 and a portable device 320 at a second venue, VENUE B. This arrangement has an advantage that functionality provided at the server V-DIR can be shared between multiple venues. Each venue can still have a control apparatus (Director) with reduced functionality compared to the Director 150 of FIGURE 4. The V-DIR may perform one or more of: audio coding and/or transcoding; video coding and/or transcoding; maintaining a RTS list for participants at the venues; Chairperson functionality for the venues; configuration of a conference.
Other aspects of the disclosure are described in the numbered clauses below:
1. A delegate unit for participating in a conference comprising: a microphone and/or a microphone socket for connecting a microphone; a loudspeaker and/or an audio output; a user interface; a first communication interface which is a local area networking (LAN) communication interface; a second communication interface; and a controller, wherein the controller is configured to selectively operate the delegate unit in: a first, in-venue, mode in which the delegate unit is configured to send and receive audio data via the LAN communication interface and to communicate with a conference control apparatus; and a second, remote access, mode in which the delegate unit is configured to send and receive audio data via the second communication interface and to communicate with a device hosting an application for participating in a conference.
2. A delegate unit according to clause 1 wherein the user interface is configured to allow user selection of the first mode and/or the second mode.
3. A delegate unit according to clause 1 or 2 wherein the second communication interface is one of: a PAN communication interface; a USB interface.
4. A delegate unit according to clause 3 wherein the second communication interface is a PAN communication interface and the controller is configured to, in the second mode, pair with the device using the PAN communication interface.
5. A delegate unit according to any one of the preceding clauses wherein, in the second mode, the controller is configured to: cause the delegate unit to capture audio via the microphone or the microphone socket and send audio data from the second communication interface; cause the delegate unit to receive audio via the second communication interface and output audio via the loudspeaker and/or the audio output.
6. A delegate unit according to any one of the preceding clauses wherein the controller is configured to send control data indicative of one or more of: a request-to-speak; an indication to activate (turn on) the microphone of the delegate unit; an indication that the microphone of the delegate unit has been activated (turned on); an indication to deactivate (turn off) the microphone of the delegate unit; an indication that the microphone of the delegate unit has been deactivated (turned off); a voting selection; select an audio channel.
7. A delegate unit according to any one of the preceding clauses wherein the local area networking (LAN) communication interface comprises at least one of: a wired LAN communication interface and a wireless LAN communication interface. 8. A delegate unit according to clause 7 wherein the local area networking (LAN) communication interface comprises both of: a wired LAN communication interface and a wireless LAN communication interface.
9. A method of operating a delegate unit for participating in a conference, the delegate unit comprising a first communication interface which is a local area networking (LAN) communication interface, a second communication interface, a microphone and/or a microphone socket for connecting a microphone, a loudspeaker and/or an audio output and a controller, the method comprising selectively operating the delegate unit in: a first, in-venue, mode in which the delegate unit is configured to send and receive audio data via the first communication interface and to communicate with a conference control apparatus; and a second, remote access, mode in which the delegate unit is configured to send and receive audio data via the second communication interface and to communicate with a device hosting a remote access application.
10. A method according to clause 9 comprising receiving a user selection of the first mode and/or the second mode.
11. A method according to clause 9 or 10 wherein the second communication interface is one of: a PAN communication interface; a USB interface.
12. A method according to clause 11 wherein the second communication interface is a PAN communication interface and the method comprises, in the second mode, pairing with the device using the PAN communication interface.
13. A method according to any one of clauses 9 to 12 comprising, in the second mode: causing the delegate unit to capture audio via the microphone or the microphone socket and send audio data from the second communication interface; causing the delegate unit to receive audio via the second communication interface and output audio via the loudspeaker and/or the audio output.
14. A method according to any one of clauses 9 to 13 comprising sending control data indicative of one or more of: a request-to-speak; an indication to activate (turn on) the microphone of the delegate unit; an indication that the microphone of the delegate unit has been activated (turned on); an indication to deactivate (turn off) the microphone of the delegate unit; an indication that the microphone of the delegate unit has been deactivated (turned off); a voting selection; select an audio channel.
15. A computer program comprising instructions which, when the program is executed by a processor of a delegate unit, cause the processor to perform the method of any one of clauses 9 to 14.
An advantage of some examples or embodiments according to the numbered clauses and as described herein is providing a higher audio quality to a user who participates in a conference outside of a meeting venue, such as when working at home or in an office. The microphone of the delegate unit can be a directional microphone which provides a higher quality compared to a microphone fitted to a portable device. This helps to provide a more uniform audio quality for users who are located in the meeting venue and users who are located outside the meeting venue.
An advantage of some examples or embodiments according to the numbered clauses and as described herein is that the same delegate unit can be used in a meeting venue and also in a remote access environment (e.g. at home or in an office). This provides a more consistent meeting experience for users, as they can use a delegate unit with the same controls in a meeting venue and in a remote access (home/office) environment. It also allows more flexible deployment, or re-deployment, of delegate units. For example, when an organisation experiences an increase in a number of users working remotely, the delegate units from a meeting venue can be re-deployed for remote access, thereby saving a need to purchase new equipment. It also allows users to continue using a delegate unit that they are familiar with. It is possible to allocate a personal delegate unit to a user. The delegate unit can be used when they are working remotely (e.g. at home or in an office), and also used within a meeting venue when they attend a meeting in the meeting venue.
Throughout the description and claims of this specification, the words “comprise” and “contain” and variations of the words, for example “comprising” and “comprises”, means “including but not limited to”, and is not intended to (and does not) exclude other moieties, additives, components, integers or steps. Throughout the description and claims of this specification, the singular encompasses the plural unless the context otherwise requires. In particular, where the indefinite article is used, the specification is to be understood as contemplating plurality as well as singularity, unless the context requires otherwise.