RELATED APPLICATIONThis application claims priority to U.S. Provisional Application Ser. No. 62/274,095 filed Dec. 31, 2015.
FIELD OF THE INVENTIONThe present disclosure relates generally to peripheral management and more particularly to peripheral context control with a host device.
BACKGROUNDTraditional televisions (TV) and set-top box (STB) consumer devices have static remote controls used for navigation purposes. In the TV domain, conventional remote controls have a set of mechanical keys which are mapped to a set of functionality. Remote control units have increased in compatibility to operate various devices, such as, a main display of the TV, projectors, sound systems, gaming systems, media players, STBs, etc. but involve a high degree of user input to match the active device or interface screen with the available operations for user control. Traditionally, the user discovers the proper configuration through trial and error.
Some remote controls have displays and can change between a set of keys or options but do not provide clarity on what set of keys or options can be used for different usage cases. For example, a remote controls may have 20 set of keys available for a STB offering live broadcast TV, menu access, video on-demand, games, etc., but as the STB changes screens or menus, the display of the remote controls remains static with control option irrelevant to the updated screens or menus in use on the STB.
Additionally, when software on STBs is updated to include new features, menus, or operations, the options available to users on the remote controls are restricted to previously mapped functionality. For example, when a feature to “play the next episode” is added to a menu or screen, the traditional remote controls is restricted to previously mapped arrow navigation that can involve several user interactions to perform. Traditional remote controls do not support updatable options for display by the remote controls and fail to provide a positive user experience.
BRIEF DESCRIPTION OF THE DRAWINGSThe present disclosure is illustrated by way of examples, and not by way of limitation, and may be more fully understood with references to the following detailed description when considered in connection with the FIGs., in which:
FIG. 1 illustrates a block diagram of an example system in accordance with one or more implementations of the present disclosure;
FIG. 2 illustrates an example of a host media device in accordance with one or more implementations of the present disclosure;
FIG. 3 illustrates an example peripheral control device in accordance with one or more implementations of the present disclosure;
FIG. 4 is a flow diagram of an example context management method in accordance with one or more implementations of the present disclosure;
FIGS. 5A-B illustrates example interfaces of a peripheral control device in accordance with one or more implementations of the present disclosure;
FIG. 6 is a flow diagram of an example context management method in accordance with one or more implementations of the present disclosure;
FIG. 7 illustrates an example context management sequence in accordance with one or more implementations of the present disclosure;
FIG. 8 illustrates a block diagram of one implementation of a computing device.
DETAILED DESCRIPTIONThe present disclosure relates to techniques for coordinating control functions between a host media device and a peripheral control device (PCD). The host media device (e.g., a set-top-box (STB), Television (TV), etc.) can connect to several different media services (e.g., a broadcast media service, a streaming media service, an on-demand media service, etc.). A context may refer to an application or graphical user interface currently running on a host media device that is presented on a main display (e.g., TV, monitor, projector, etc.).
Different types of media services may have a different group of control functions (e.g., new channel, play, pause, new episode, etc.) to control items of content displayed by the host media device. Additionally, media services are increasingly offering users additional custom options to interact with the media service. As the variety of media services grows, the number and combination of control functions are difficult to manage using traditional remote controls. For example, a traditional remote control device stays configured with control functions corresponding to a live broadcast media service when a host TV changes to running a streaming service. Moreover, as on-screen menus and graphical user interfaces become more complicated, users navigation is becoming increasingly more laborious and complicated. Accordingly, peripheral devices with increased context control and management allow the user to maintain control of the host device switching between multiple media services across various contexts and sub-contexts.
The techniques described here relate to switching context controls on a peripheral control device to enable users to efficiently access and control a variety of media service. As used herein, the term media services may at least include traditional media services, as well as, local media types (e.g., video files, music files, and digital images). In an example aspect of the present disclosure, software on the peripheral control device allows reception and storage of sets of control functions associated with media applications of the host media device. The host media device can identify different contexts active on the main display and transmit a context identifier to indicate to the peripheral control device to load one or more sets of control.
In an example aspect of the present disclosure, a method is provided to present a set of control functions via an interface of a PCD. A control function is a command associated with one or more media contexts. The method includes decoding a payload from the host media device with an encoded context identifier. The context identifier indicates a primary media context active on the host media device that allows the PCD to determine one or more control functions corresponding to the context identifier. The set of control functions on the interface of the PCD change to include the one or more control functions to command the primary media context. For example, when the media service displaying on a TV changes from a live broadcast to a streaming media service, the control functions displayed on the PCD change to include playback options as well as application specific shortcuts that allow for efficient control of the media service.
In an example aspect of the present disclosure, the host media device can communicate using encoded payloads that allows the PCD to receive additional control information to present control functions relevant to the media service running on the host media device. For example, the PCD can receive a network logo that matches the channel being displayed by the host media device. In an implementation, encoded payloads can be transmitted using a standard report protocol, as discussed herein.
FIG. 1 illustrates a block diagram of anexample system100 in accordance with one or more implementations of the present disclosure.System100 may be configured to enable aperipheral control device150 to switch control contexts in accordance with the techniques described herein. In the example illustrated inFIG. 1,system100 includes one or more communications networks104-105, ahost media device110, amain display115, one ormore media services130A-130N, and aperipheral control device150.System100 may include software modules operating on one or more devices. Software modules may be stored in a memory and executed a processor. Devices (e.g., thehost media device110, the peripheral control device150) may include one or more processors and a plurality of internal and/or external memory devices. Examples of memory devices include file servers, file transfer protocol (FTP) servers, network attached storage (NAS) devices, local disk drives, or any other type of device or storage medium capable of storing data. Storage media may include optical discs, including, e.g., Blu-ray discs, DVDs, and CD-ROMs, flash memory, or any other suitable digital storage media.
System100 represents an example of a system that may be configured to allow thehost media device110 to accessmultiple media services130A-130N for presentation of media content to a user, for example, via thedisplay115. In the example illustrated inFIG. 1, thehost media device110 may include any device configured to transmit data to and/or receive data fromcommunication network104. For example, thehost media device110 may be equipped for wired and/or wireless communications and may include set-top boxes, digital video recorders, televisions, desktop, laptop, or tablet computers, gaming consoles, mobile devices, including, for example, “smart” phones, cellular telephones, and personal gaming devices.
Communications networks104-105 may comprise any combination of wireless and/or wired communication media. Communications networks104-105 may include coaxial cables, fiber optic cables, twisted pair cables, or any other equipment that may be useful to facilitate communications between various devices and sites.Communications network104 can represent a wide area network that allows the host media device to connect to one ormore media services130A-130N.
Media services130A-130N may provide content to thehost media device110 using communications network104 (e.g., broadcast, Internet protocol, etc.). For example,television service130A may include a public over-the-air television broadcast, a cable television service, satellite television service, etc. that is configured to provide television services to analog and/or digital televisions and set-top boxes. In some examples, themedia services130A-130N may be referred to as atelevision service130A, astreaming media service130B, aninteractive media service130C, an on-demand media service130D, acomputing media service130F, orother media service130N. For example, a user of one of thehost media devices110 may access the Internet and multimedia content provided by amedia service130A-130N through a cable modem connected to a coaxial network maintained by a cable television provider.
Thehost media device110 may also be configured to accessmedia services130A-130N independent of acommunications network104. For example, thehost media device110 can directly access a library of multimedia (e.g., music, movies, and TV shows) stored inlocal media service130H, amedia player130G, acomputer media service130F, orother media device130N. Further, in some examples,media services130A-130N may refer to applications that, upon execution, enable a user to access digital content through execution of the application.
In addition to being configured to receive digital media content fromcommunications network104, thehost media device110 is configured to communicate withperipheral control device150 either directly or throughcommunications network105.Communications network105 can represent a local area network or local wireless communication means. using a standardized communication protocol, such as for example, Universal Serial Bus protocol (USB), Bluetooth, ZigBee or a proprietary communications protocol, such as, for example, a proprietary infrared communications protocol.
Theperipheral control device150 is a device configured to communicate with thehost media device110 and includes a user interface (e.g., a touch screen, microphone, etc.) in communication with a device with digital media presentation capabilities (e.g., host media device110). Theperipheral control device150 may be an associated companion device, including, for example, remote controllers, human interface devices, tablet computers, etc. In an example,peripheral control device150 may execute applications in conjunction with thehost media device110. As described in reference toFIGS. 3-6,peripheral control device150 may be configured to provide user interfaces that enable users to provide input. For example, upon selection through a user interface of theperipheral control device150, an item of content may be presented on adisplay115 of thehost media device110.
Theperipheral control device150 includes an interface (e.g., a touchscreen) that changes the control commands presented to the user based on the media service or type of media running (i.e., rendering, displaying, etc.) on thehost media device110. When thehost media device110 changes themedia service130A-130N being displayed ondisplay115, theperipheral control device150 can update the interface to include control options that correspond to relevant control commands of themedia service130A-130N. For example, if thehost media device110 switches from atelevision media service130A to an on-demand media service130D, theperipheral control device150 can adapt the commands present on the interface to replace channel navigation command options with on-demand menu navigation command options.
Peripheral control device150 may be equipped for wired and/or wireless communications. In the example illustrated inFIG. 1,peripheral control device150 may be configured to communicate directly with the host media device110 (e.g., using a short range or near field communication protocols), communicate with thehost media device110 via a local area network105 (e.g., through a Wi-Fi router), and/or communicate with a wide area network (e.g., a cellular network)104. Further, in some examples,peripheral control device150 may act as a client device for thehost media device110. For example,peripheral control device150 may be configured to act as a Universal Plug and Play (UPnP) client or a multicast Domain Name System (mDNS) client. In one example,peripheral control device150 may be registered with thehost media device110 using its media access control (MAC) address or a unique device identifier and/or a user's subscriber identifier.
In an implementation, wireless communication between thehost media device110 andperipheral control device150 vianetwork105 uses Bluetooth Low Energy to provide reduced power consumption and cost. Human Interface Devices (HID) (e.g., peripheral control device150) implement wireless transmission of data according to the Bluetooth Low Energy protocol. The Bluetooth Low Energy wireless protocol is compatible with Human-Interface-Devices (HIDs) using the Bluetooth Generic Attribute profile (GATT). A Generic ATTribute Profile is associated with an Attribute Protocol (ATT) that establishes common operations and a framework for the data transported and stored by the Attribute Protocol. The HID over GATT profile defines the procedures and features to be used by Bluetooth Low Energy HID Devices using GATT and Bluetooth HID Hosts using GATT.
Once a connection is established between thehost media device110 and theperipheral control device150, the HID over GATT profile specifies formats for data transfers referred to as reports. In some cases, reports can be in arbitrary formats and parsed by devices while other reports are specified to of a predefined length and format. A feature report can be sent by either device to establish a connection. An input report can refer to a predefined report format sent by theperipheral control device150 and received by thehost media device110. An output report can refer to a predefined report format sent by thehost media device110 toperipheral control device150.
As described in reference toFIG. 2-4, the HID over GATT profile can be used to transmit HID reports that can be encoded with a context identifier to indicate to the peripheral control device to load one or more sets of control. As described in reference toFIG. 4-7, in some implementation, thehost media device110 can use HID reports to transfer images to theperipheral control device150. As described in reference toFIG. 4-7, in some implementation,peripheral control device150 can use HID reports to wirelessly transfer voice commands to hostmedia device110.
In an implementation of the present disclosure, a HID over GATT (HoG) profile is used for transfer of image. As per the HID specification, the host media device can receive data via the input report format, send data via the output report format, and communicate features via a feature report format. Two of the three supported report types (the input reports and the output report) can be used to transfer data. In an implementation of the present disclosure the output report is used to transfers data associated with control functions to be presented by thePCD150. Output reports can be sent in bulk and in short messages.
According to an exemplary aspect, image data can be encoded in the supported format of thehost media device110 and decoded by a decoder of thePCD150. Encoded data can be sent as part of a set of packets, which are received (e.g., directly or indirectly) by thePCD150. Theperipheral control device150 can store the encoded data to assemble the image data. The encoded data can be decoded to get the actual image transferred. Since the image data is transmitted as notifications, there transfer can be completed independent of handshaking that indicate a start and stop. The packets are tailored with header and trailer information to indicate a start and stop of the image data. For example, channel logos are transferred over Bluetooth Low Energy from thehost media device110 to thePCD150. The method can also be implemented using HID specification with ZigBee communication.
FIG. 2 illustrates an example of ahost media device200 in accordance with one or more implementations of the present disclosure.Host media device200 is an example of a computing device (e.g.,host media device110 ofFIG. 1) that may be configured to transmit data to and receive data from a communications network, connect to multiple media services, allow a user to access multimedia content, and execute one or more applications.Host media device200 may include or be part of a stationary computing device (e.g., a desktop computer, a television, a set-top box, a gaming console, a dedicated multimedia streaming device, a digital video recorder, etc.), a portable computing device (e.g., a mobile phone, a laptop, a personal data assistant (PDA), a tablet device, a portable gaming device, etc.) or another type of computing device. In an example, thehost media device200 can include, but not limited to, one or more communication interface(s)205, central processing unit(s)210,memory212, and a display processor(s)215 for presenting media content via a main display.
Central processing unit (CPU)210 may be configured to implement functionality and/or process instructions for execution in thehost media device200.CPU210 may be capable of retrieving and processing instructions, code, and/or data structures for implementing one or more of the techniques described herein. Instructions may be stored on a computer readable medium, such asmemory212.CPU210 may include multi-core central processing units.
TheCPU210, the communication interface(s)205,memory212 and,display processor215 may be interconnected (physically, communicatively, and/or operatively) for inter-component communications and may be implemented as any of a variety of suitable circuitry, such as one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), discrete logic, software, hardware, firmware or any combinations thereof. Functions ofhost media device200 may be realized using any combination of hardware, firmware and/or software implementations. In some examples, functionality ofhost media device200 may be implemented using one or more so-called systems on a chip (SOC). Thehost media device200 may be configured to enable communications between components and comprises structures that enable data to be transferred from one peer device to another peer device or to a storage medium. For example,host media device200 may include a chipset supporting Accelerated Graphics Port (AGP) based protocols, Peripheral Component Interconnect (PCI) bus based protocols, such as, for example, the PCI Express™ (PCIe) bus specification, which is maintained by the Peripheral Component Interconnect Special Interest Group, or any other form of structure that may be used to interconnect peer devices.
The communication interface(s)205 may be configured to enablehost media device200 to send and receive data via networks as well as direct communications means for transfer of data with local devices. For example, communication interface(s)205 may be configured to send and receive digital content originating from one or more media services, such as, a broadcast, a multicast, a unicast, an over-the-top content source, a personal video recorder (PVR), and a peer-to-peer content source, etc. Data sent or received may include data from a media service associated digital content, such as, for example, music, videos, images, webpages, messages, voice communications, and applications.
Communication interface(s)205 may include a network interface card, such as an Ethernet card, an optical transceiver, a radio frequency transceiver, or any other type of device configured to send and receive information. The communication interface(s)205 may be configured to communicate with a with a peripheral control device (e.g.,peripheral control device150 ofFIG. 1) and operate according to one or more communication protocols such as, for example, a Global System Mobile Communications (GSM) standard, a code division multiple access (CDMA) standard, a 3rd Generation Partnership Project (3GPP) standard, an Internet Protocol (IP) standard, a Wireless Application Protocol (WAP) standard, Bluetooth, ZigBee, and/or an IEEE standard, such as, one or more of the 802.11 standards, as well as various combinations thereof. Data sent or received may include encoded packets with control commands for operation of one or more media services.
Communication interface(s)205 may be configured to perform physical signaling, addressing, and channel access control according to the physical and network layers to extract audio packets, video packets, and data packets from a data stream, or similar fragments and utilize a network, such as, for example,network104. For example, communication interface(s)205 may be configured to extract video packets, audio packets, and data packets according to one or more streaming protocols including internet protocol (IP), transport control protocol (TCP), real time streaming protocol (RTSP), user datagram protocol (UDP), real time protocol (RTP), MPEG transport streaming protocols, IPTV protocols, and the so-called HTTP Live Stream (HLS) Protocol.
Data associated with digital content can refer to, for example, music, videos, images, webpages, messages, voice communications, and applications that may be stored in a computer readable medium, such as, for example,memory212. Data stored in a memory device may be retrieved and processed by theCPU210 along with audio decoders, audio processors, video decoders, graphics processing units, and the display processor232.
Display processor215 may be configured to retrieve and process data for display. For example,display processor215 may be coupled to a main display (e.g, display115 ofFIG. 1) using a standardized communication protocol (e.g., High-Definition Multimedia Interface (HDMI), Digital Visual Interface (DVI), DisplayPort, component video, composite video, and/or Video Graphics Array (VGA)). The display (e.g., display115) may by any means to present digital content, such as a liquid crystal display (LCD), a plasma display, an organic light emitting diode (OLED) display, a standard definition television, a high definition television, an ultra-resolution display, an integrated display of a portable computing device (e.g., a mobile phone, a laptop, a personal data assistant (PDA), or a tablet device), or another type of display device capable of presenting video data to a user.
Memory212 may be described as a non-transitory or tangible computer-readable storage medium. In some examples,memory212 may provide temporary and/or long-term storage and be represent volatile and/or non-volatile memory. Examples of volatile memories include random access memories (RAM), dynamic random access memories (DRAM), and static random access memories (SRAM). Examples of non-volatile memories include magnetic hard discs, optical discs, floppy discs, flash memories, or forms of electrically programmable memories (EPROM) or electrically erasable and programmable (EEPROM) memories.Memory212 may include an internal hard disk or solid state drive, a random access memory module, an embedded MultiMediaCard (eMMC) memory device, and/or one or more caches (e.g., CPU caches and/or GPU caches).
Memory212 may be configured to store information that may be used byhost media device200 during operation.Memory212 may be used to store program instructions for execution byCPU210 and may be used by software orapplications220 running onhost media device200 to temporarily store information during program execution. For example,memory212 may store instructions associated withoperating system222, drivers, encoder/decoders applications224, acontext handler230, acommand handler235, and media application(s)240.
Applications220 may include applications implemented within or executed byhost media device200 and may be implemented or contained within, operable by, executed by, and/or be operatively/communicatively coupled to components ofhost media device200.Applications220 may include and be executed by operatingsystem222.Operating system222 may be configured to facilitate the interaction of applications (e.g., encoder/decoders applications224,context handler230,command handler235, media application(s)240, etc.) withCPU210, and other hardware components ofhost media device200.Operating system222 can include a HID driver and driver management software to support the Bluetooth Low Energy protocol. Components ofoperating system220 and components acting in conjunction withoperating system222 may be referred to as middleware. Further, in some examples,application220 may include an application programming interface (API). The techniques described herein may be utilized by devices configured to operate using any and all combinations of software architectures.Operating system222 may be an operating system designed to be installed on laptops, desktops, smartphones, tablets, set-top boxes, digital video recorders, televisions and/or gaming devices. In one example,operating system222 may include one or more of operating systems or middleware components developed by OpenTV®, Windows® operating systems, Linux operation systems, Mac OS®, Android® operating systems, and any and all combinations thereof.
Applications220 may cause one or more graphical user interfaces to be presented that enable a user to provide data (i.e., commands) for use by amedia application240.Applications220 for enabling a user to access a digital media service may be highly integrated with an application oroperating system222 of thehost device200. For example, a set-top box supported by a cable television provider may enable a user to access items of content from a television service, an on demand media service maintained by the cable television service provider, and/or a third party media streaming service. Each distinct graphical user interface enabling a user to select items of content to access may be referred to as a context.
Media application(s)240 may be provided to thehost media device200 and enable the presentation of different graphical user interfaces associated with items of content (i.e. different contexts). Each media application(s)240 and/or distinct graphical user interface may have different control commands that enable a user to select items of content or control operations and features provided by the media application(s)240. For example, amedia application240 of on-demand content can include a command that allows a user to skip recorded commercials.
Context handler230 andcommand handler235 may operate in conjunction with an application running on a peripheral control device, as described in reference toFIGS. 3-4.Command handler235 can register application specific commands, shortcuts, virtual button icons, etc. frommedia applications240 to create command profiles associated withmedia applications240 that can be stored in a memory (e.g., memory212). A command profile can include mapped control functions associated with a context of amedia application240. Thecommand handler235 can associate application specific icons with the mapped control functions for display by the peripheral control device. Thecommand handler235 can transmit command profiles as control options to be stored by the peripheral control device. As discussed in reference toFIGS. 3-5, the peripheral control device can receive control options as mapped control functions to virtual buttons for display by the peripheral control device. In some implementations, thecommand handler235 can track and manage the command profiles stored by the peripheral control device. In some implementations, the peripheral control device can notify or request thecommand handler235 to provide control options associated with a command profile. For example, the peripheral control device may only store a subset of available control functions and thecommand handler235 can provide control functions not available in storage of the peripheral control device.
Thecontext handler230 can identify themedia application240 currently running on thehost media device200. For example,context handler230 identifies when thehost media device200 changes between amedia application240 associated with a media service for broadcast television, gaming application, a streaming media service, etc. In some implementations, the context handler also identifies a sub-context for a particular aspect of themedia application240 running on the host media device. A sub-context may refer to a specific graphical user interface (e.g., a navigation menu, item of content, commercial, etc.) of themedia application240 that is associated with one or more specific control functions. In an implementation, thecontext handler230 assigns one or more context identifiers to amedia application240 and associates the relevant command profiles. Application specific icons and mapped control functions may be based on a context and/or a sub-context. In response to determining the active context of themedia application240 for a context identifier, thecontext handler230 can notify the peripheral control device, via an encoded payload, to coordinate display of command options on the peripheral control device. As described in reference toFIGS. 3-5, commands for controlling various media services can be associated with a context identifier that is communicated to a peripheral control device. The peripheral control device can load control functions that are relevant to a selected media service or content being displayed via thehost media device200 based on the context identifier.
Encoder/Decoder224 can be used with the one ormore communication interfaces205 to communicate with the peripheral control device using one or more wireless protocols. In an implementation, communication interface is configured for Bluetooth® Low Energy communication with the peripheral control device. Encoder/Decoder224 is used to communicate data to and from thecontext handler230, thecommand handler235, or themedia applications240 with the peripheral control device utilizing one or more efficient protocols.
Encoder/Decoder224 can send data transported over the Attribute Protocol and can accept Attribute Protocol requests, commands, and confirmations from a GATT client such as the peripheral control device. Attributes are generally formatted as services and characteristics. Services may include a collection of characteristics that include a value and a number of descriptors describing the characteristic value. The GATT Profile can describe a structure in which profile data is exchanged. A structure may describe basic elements (e.g., services and characteristics) used in a profile. A top level of the hierarchy is a profile. A profile may include one or more services necessary to fulfill a use case. For example, a service may include characteristics or references to other services. In some implementations, characteristic include a value and may contain optional information about the value. The service and characteristic and the components of the characteristic (e.g., value and descriptors) may include the profile data. The GATT profile makes use of characteristic descriptors and associated values that can be understood by compatible HID devices.
Thehost media device200 can receive, viacommunication interface205, and decode, via Encoder/Decoder224, input reports of the HID over GATT protocol sent by a peripheral control device. Thehost media device200 can also use Encoder/Decoder224 to generate and encode output reports for transmission to the peripheral control device viacommunication interface205. In some implementations, the Encoder/Decoder224 sends indication and notifications (e.g., asynchronously) to the peripheral control device when specified events occur. For example,context handler230 can detect a context of the main display changed, determine a context identifier associated with the new context, and Encoder/Decoder224 send an encoded payload encoded with the context identifier to the peripheral control device.
Image data and audio data can be encoded with header and trailer information. Encoded data is transferred to peripheral device via HID output reports. The peripheral control device decodes the header and stores or buffering the data until trailer information is received. The peripheral control device decodes the data based on the encoding done. The encoding and decoding of transferred data can be done in parallel. In an implementation a channel logo can be transferred from the host media device to the peripheral control device. The peripheral control device may include an interactive display of the received images that allows a user to command the host media device.
In some implementations, thehost media device200 can transmit or receive additional data encoded as an HID report. Encoder/Decoder224 can include functionality to transform the additional data into a format for transfer as an HID report. For example, thehost media device200 can include acommand handler235 for processing voice commands. For example, the Encoder/Decoder224 can decode an input report and parse header and trailer information to extract voice data from an input report for processing by thecommand handler235. In another example, the Encoder/Decoder224 can encode image data into a compressed format and append header and trailer information to transmit the image data as a HID output report to a peripheral control device. As discussed in reference toFIGS. 4-7, thehost media device200 can use the HID reports to transfer and receive payloads encoded with addition data, such as voice commands or image data.
In an implementation, as described in reference toFIG. 4-6, the Encoder/Decoder224 can encode a payload with an image encoded in a Bluetooth® Low Energy protocol. The payload can cause the peripheral control device to present the image as a control function associated with a context that matches a media service being rendered by a display associated with thehost media device200. In an implementation, the payload can include audio data encoded in a Bluetooth® Low Energy, where the audio data is used by the peripheral control device as a control function associated with a context that matches a media service being rendered by a display associated with thehost media device200.
FIG. 3 illustrates an exampleperipheral control device300 in accordance with one or more implementations of the present disclosure.Peripheral control device300 is an example of a computing device (e.g.,peripheral control device150 ofFIG. 1) that may be configured to transmit control commands and receive data from a host media device (e.g.,host media device110 ofFIG. 1,host media device200 ofFIG. 23).Peripheral control device300 allow a user to access multiple sets of control functions associated with multimedia content presented on a display associated with the host media device.
Peripheral control device300 can be resource constrained devices that can connect to a more powerful (e.g., more resources, bandwidth, etc.) host media device and execute one or more applications. In an example, theperipheral control device300 can include, but not limited to, one or more communication interface(s)305, central processing unit(s)310,memory312, user interface(s)315 for presenting control functions to a user.
Central processing unit (CPU)310 may be configured to implement functionality and/or process instructions for execution in theperipheral control device300.CPU310 may be capable of retrieving and processing instructions, code, and/or data structures for implementing one or more of the techniques described herein. Instructions may be stored on a computer readable medium, such asmemory312.CPU310 may include multi-core central processing units.
Communication interface(s)305 may include a network interface card, such as an Ethernet card, an optical transceiver, a radio frequency transceiver, or any other type of device configured to send and receive information. The communication interface(s)305 may be configured to communicate with a with the host media device and operate according to one or more communication protocols such as, for example, a Global System Mobile Communications (GSM) standard, a code division multiple access (CDMA) standard, a 3rd Generation Partnership Project (3GPP) standard, an Internet Protocol (IP) standard, a Wireless Application Protocol (WAP) standard, Bluetooth, ZigBee, and/or an IEEE standard, such as, one or more of the 802.11 standards, as well as various combinations thereof. Data sent or received may include encoded packets with control commands for operation of one or more media services.
Memory312 may be a non-transitory or tangible computer-readable storage medium. In some examples,memory312 may provide temporary and/or long-term storage and be represent volatile and/or non-volatile memory.Memory312 may include an internal hard disk or solid state drive, a random access memory module, an embedded MultiMediaCard (eMMC) memory device, and/or one or more caches (e.g., CPU caches and/or GPU caches).
Memory312 may be configured to store information that may be used byperipheral control device300 during operation.Memory312 may be used to store program instructions for execution byCPU310 and may be used by software orapplications320 running on theperipheral control device300 to temporarily store information during program execution. For example,memory312 may store instructions associated withoperating system322, Encoder/Decoders applications324, acontext control330 application.
Applications320 can be used collecting and transmitting user input to the host media device to cause control of digital content executed by thehost media device200.Applications320 may include applications implemented within or executed byperipheral control device300 and may be implemented or contained within, operable by, executed by, and/or be operatively/communicatively coupled to components ofperipheral control device300. In an example,applications320 may causeperipheral control device300 to receive and decode updated control functions, present control options to a user that are relevant to an active media application on a main display, collect user input, encode the user input or selected control functions for transmission to the host media device. Theapplications320 include a HID driver and driver management software to process wireless communication thehost media device200.
Applications320 may include and be executed by operatingsystem322.Operating system322 may be configured to facilitate the interaction of applications (e.g., Encoder/Decoders applications324, context control330) withCPU310, and other hardware components ofperipheral control device300. Components ofoperating system322 and components acting in conjunction withoperating system322 may be resource constrained.
Acontext control330 application running on theperipheral control device300 may be configured to receive data (e.g., a context identifier) from thehost media device200 and receive a context identifier used to load a set of control functions that match a context and/or a sub-context of thehost media device200.Context control330 may cause one ormore user interfaces315 to present a set of control functions that match the context of the host media device to allow for efficient control of one or more media services.
User interface(s)315 may include devices configured to receive input from a user during operation ofperipheral control device300. For example, user interface(s)315 may include buttons and switches, motion sensors (e.g., accelerometers), touch-sensitive sensors, a track pad, a mouse, a keyboard, a microphone, a video camera, or any other type of device configured to receive user input.
In some examples, anperipheral control device300 including user interfaces(s)315 may be operatively coupled tohost media device200 using a standardized communication protocol, such as for example, Universal Serial Bus protocol (USB), Bluetooth Low Energy, ZigBee or a proprietary communications protocol, such as, for example, a proprietary infrared communications protocol. User interface(s)315 may include a display configured to display the graphical users interfaces as described in reference toFIG. 5. For example, in the case wherehost media device200 includes a television, theperipheral control device300 in communication with a television may include a user interface including a touch-sensitive display presenting a graphical user interface. For example, a user may provide commands to hostmedia device200 by activating portions of a touch-sensitive display.
In an example implementation,context control application330 can loads control functions (e.g., virtual keys, image icons, etc.) applicable or related tomedia application240 of thehost media device200 that is active on thedisplay115. Theuser interface315 of theperipheral control device300 can present the user with textual information and channel information relevant to information active on thedisplay115 of thehost media device200. For example, thedisplay115 of thehost media device200 may have a Live TV application screen in TV has a contextual control functions, such as allowing user to select subtitle, volume control, settings such as video, audio language, subtitle language selection, etc.
Theuser interface315 of theperipheral control device300 can present a set of control functions (i.e., virtual keys) applicable for the screen or context the screen is currently functioning. For example, theuser interface315 of theperipheral control device300 can present a set of keys for controlling a streaming application that corresponds to a streaming application executed by the STB and displayed on the main screen. When a search functionality of the application is presented on the main screen, theuser interface315 of theperipheral control device300 can present a set of virtual keys that correspond to the search functionality or present a set of search results. Keys may be easily extended so without any additional cost to a new hardware remote control change. New features and direct key mapping may be displayed and controlled by application.
Encoder/Decoder324 can be used with the one ormore communication interfaces305 to communicate with the host media device using one or more wireless protocols. In an implementation, communication interface is configured for Bluetooth® Low Energy (BLE) communication with the host media device. Encoder/Decoder324 is used to communicate data associated with thecontext application330 or other applications. The Generic Attribute Profile can be used to associate with an Attribute Protocol that establishes common operations and a framework for the data transported and stored by the Attribute Protocol. Encoder/Decoder324 can send data transported over the Attribute Protocol and can accept Attribute Protocol requests, commands, and confirmations from a GATT server such as the host media device.
HID over GATT follows a defined protocol to maintain the universal compatibility. HID Specification defines three types of allowed data transfer where information is shared in units called reports. The input report format is used to transfer data from thePCD300 to the host media device. The output report format is used to transfer data from the host media device to thePCD300. In the feature report information travels from either host media device or PCD.
In some implementations, theperipheral control device300 can transmit or receive additional data encoded as an HID report. Encoder/Decoder324 can include functionality to transform the additional data into a format for transfer with as an HID report. Theperipheral control device300 can include auser interface315 with a microphone for collecting voice commands. Encoder/Decoder324 can encode the voice command into a compressed format and append header and trailer information to transmit the voice command as a HID input report.
In an implementation, the input report can be used for transfer voice samples from thePCD300 to the host media device. For example, the voice samples can capture voice based commands—channel up, channel down etc. In another example, the method can be used for voice based search—movies by Dany Boyle etc. Input report packet size can be configured to a maximum size (e.g., 20 bytes) and include Bluetooth specific header data. Input voice samples can be encoded into adaptive differential pulse-code modulation (ADPCM). Adaptive differential pulse-code modulation is a variant of differential pulse-code modulation (DPCM) that varies the size of the quantization step, to allow further reduction of the required bandwidth for a given signal-to-noise ratio. Pulse-code modulation (PCM) is a method used to digitally represent sampled analog signals. In a PCM stream, the amplitude of the analog signal can be sampled regularly at uniform intervals, and each sample can be quantized to the nearest value within a range of digital steps.
In an implementation, a voice capture can be started by thePCD300 using PCM samples that are collected. PCM samples can be encoded324 to ADPCM samples. ADPCM can be used to reduce audio data from 16 bits to 4 bits. The compressed voice samples can be encoded324 and transferred to thehost media device200 via HID input reports.
Thehost media device200 can receive and buffer all the samples until voice capture is stopped. Thedecoder224 of thehost media device200 decodes ADPCM to PCM samples for processing by the command handler. At thehost media device200, the input report starts with a notification and subsequent reports include an identifier fixed for the voice data collected. Once the collection of the voice samples is complete, the data processed to the decoder for the ADPCM format is decoded to PCM audio data for processing by the command handler of thehost media device200.
In another example,peripheral control device300 can receive an output report encoded with image data. The Encoder/Decoder324 can decode the output report and parse header and trailer information to extract the image data for use by theperipheral control device300. As discussed in reference toFIGS. 4-7, theperipheral control device300 can use the HID reports to transfer and receive payloads encoded with addition data, such as voice commands or image data.
FIG. 4 is a flow diagram of an examplecontext management method400 in accordance with one or more implementations of the present disclosure. In an example implementation, a method can be performed by processing logic that can comprise hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions run on a processing device), or a combination thereof. In an implementation, the method is performed by a context control application (e.g.,context control330 ofFIG. 3) executed by a processing device of a PCD (e.g.,CPU310 ofFIG. 3). The PCD can be in communication with a host media device and an associated display (e.g., projector, TV, etc.). The processing device can support multiple contexts that coordinate one or more sets of control options available via the PCD with the activities or context of the host media device.
Atblock410, the processing device presents a set of control functions via an interface of a peripheral control device. The control function includes a command associated with one or more media contexts of a host media device. In some implementations, the processing device includes a touchscreen interface and presents a set of virtual buttons, images, or icons representing the control functions.
The control functions present on the interface of the PCD may become inoperable with a primary media context active on the host media device. A media context can be associated with a media service such as a search service, television media service, streaming media service, on-demand media service, local media service, etc. The primary media context is the media service presented on a main display by the host media device.
The set of control functions presented on an interface of the PCD are commonly not associated with the primary media context active on the main display by the host media device causing user confusion. For example, when the main display by the host media device is activated after a period of inactivity, the interface of the PCD may have been knocked around or inadvertently changed, and thus the control functions present on the interface of the PCD do not correspond to the control options relevant to the primary media context. In some cases, there are multiple means to change the primary media context active on the main display and the control options on the interface of the PCD becomes out of date. For example, the host media device may experience a power failure and reset to a different context, a user may use a physical interface on the host media device to change the primary context, or the host media device may pre-programmed or scheduled to change the primary media context active on the main display to name a few.
Atblock420, the processing device decodes a payload from the host media device with an encoded context identifier. The context identifier indicates the primary media context active on the host media device. In an implementation, the host media device can send the payload with context identifier in response to a request by the processing device to change the context of the primary media context active on the host media device. The request by the processing device can include the context identifier and the host media device can load a primary media context associated with the context identifier on a main display of the host media device. The host media device can send the payload with the context identifier in response to successfully launching primary media context as a confirmation that the original request by the processing device is complete.
In some implementations, the processing device receives the payload with a context identifier based on a timed interval to maintain context coordination between the host media device and PCD. For example, a payload can be delivered every 30 seconds or more frequently based on a frequency of interaction between the processing device and host media device.
In some implementations, the host media device sends the payload with context identifier as part of an error response. For example, the host media device may send a payload with a context identifier in response to receiving a first control function associated with a first context identifier and determine that the first control function is not associated with the primary media context active on the host media device. In this example, the processing device receives the payload in response to sending a previous command that does no do not match the context of active on the host media device.
In an implementation, the processing device communicates with the host media device via protocol, such as Bluetooth Low Energy or ZigBee and the context identifier is received as an encoded value in an HID reports. The processing device decoding the payload to determine the context identifier can include, for example, parsing header and trailer information.
Atblock430, the processing device determines one or more control functions corresponding to the context identifier. In an implementation, processing device can include an index indicating the control functions associated with a context identifier. For example, the PCD can have a stored index of control functions with associated context identifiers. In an implementation, processing device can request an index indicating the control functions associated with a context identifier. For example, the processing device can request an index from the host media device or a media application associated with context identifier.
The processing can search memory based on the control identifier and the index to access locally stored control functions available in memory of the PCD. The processing device can load the determined control function from the memory and present the control function via the interface. For example, the processing device can determine the context identifier is associated with a set of playback control functions and present a set of playback icons on the interface. In an implementation, processing device can determine one or more control functions associated with the context identifier are unavailable in memory of the PCD and access remotely stored control functions. For example, the processing device can access a cloud service to download the one or more control functions associated with the context identifier.
Atblock440, the processing device changes the set of control functions on the interface of the PCD to include the one or more control functions that can command the primary media context. For example, the processing device can update the touchscreen interface to add or remove virtual buttons, images, or icons. The processing device in communication with the host media device actively updates the interface of the PCD to present the user with control options that are relevant to the context of the host media device.
FIGS. 5A-B illustrates example interfaces500 of a peripheral control device in accordance with one or more implementations of the present disclosure.User interface500 can be a display of a programmable peripheral control device500 (e.g.,peripheral control device300 ofFIG. 3). The functionality ofuser interface500 may be implemented using different types of interfaces. In some examples,user interface500 may include a microphone and/or motion sensors and may be configured to receive voice and motion input. For example, in the case where auser interface500 includes a touchscreen, gesture recognition, and/or voice recognition, virtual buttons may be presented on the touchscreen and functions achieved by activation of buttons onuser interface500 may be achieved through any and all combinations of virtual button activation, motion gestures, and/or voice commands. As illustrated inFIG. 5A,user interface500 of theperipheral control device500 can includes touchscreen displays.
Touchscreen user interface500 may include any display device configured to display graphics and receive a user touch input. For example, touchscreen display interfaces500 may include an LCD display, an OLED display, or any other type of display device capable of presenting visual data to a user, and a capacitive touch sensor device, a resistive touch sensor device, or any other type of device capable of receiving user touch events. Thetouchscreen interface500 can be configured to receive user touch events directly or indirectly (e.g., using a stylus).Touchscreen user interface500 may be configured to display icons representing items of content.Touchscreen user interface500 can receive various user touch inputs, such as, a signal tap, a double-tap, a press of a specified duration (e.g., a long press), a multi-point touch input (e.g., a pinch gesture), and complex touch gestures (e.g., drag and drop gesture, character writing gestures, and swiping gestures). Further, in some examples,touchscreen user interface500 may be pressure sensitive and cause different types of activations to occur based on the amount of pressure a user applies to touchscreen user interface500 (i.e., how “hard” a user presses).
Touchscreen user interface500 may be configured to enable a user to perform multiple types of activations with respect to regions502-505 oftouchscreen user interface500, where aregion502 may present one or more graphics (e.g., an icon) to activate a control function.User interface500 may include designated regions502-505 that can be used to group sets of control options.
In the example illustrated inFIG. 5A,touchscreen user interface500 displays virtual buttons and a graphical user interface within respective regions502-505. Virtual buttons may replicate push-buttons, including, for example, one or more of the buttons for a control operation. A user may activate a virtual button by activating a corresponding area ontouchscreen user interface500. In some instances virtual buttons may be referred to as soft keys. In some implementations,user interface500 may include a regions502-503 presenting short-cut icon configured to facilitate functionality with respect to a particular application, media service, graphical user interface, or particular item of digital content currently running on a host media device.
A context control application running on the peripheral control device may be configured to receive data (e.g., a context identifier) from the host media device and determine one or more sets of control functions to present on thedisplay500. The context identifier may be associated with a set of control functions for controlling an application currently running on the host media device. In an implementation, theperipheral control device500 can present a first set of control functions (e.g., play back controls) in afirst region503 of the display. A sub-context identifier may be associated with an additional set of control functions for controlling a particular aspect of an application running on a host media device. Application specific icons and control functions may be based on a context and/or a sub-context. In an implementation, theperipheral control device500 can present a second set of control functions (e.g., short-cuts) in anotherregion505 of the display.
In the examples illustrated inFIG. 5B, different groups of control functions can be displayed as relevant short-cuts, text, icon or combination in one of the regions502-505 and includes application specific control options mapped to control functions of a media application. The peripheral control device includes context control software to match the set of control functions displayed500 to a context of the media application running on the host media device. In an implementation, theuser interface500 displays control functions as short-cut icons to provide the user with increased flexibility efficiency to control the host media device.
In the examples illustrated inFIG. 5B, contextspecific control options510,520,530,550,560 can include virtual buttons as icons that are associated with control functions relevant to an active media service on the host media device. For example, in response to the peripheral control device receiving a context identifier associated with a traditional television service, a numerictelevision context group510 may present virtual buttons inregion503 that replicate a numeric keypad511, anenter button512, a previouschannel button buttons513, and volume control buttons515.
In some examples region502-505 may change to match a different context used to perform other functions associated with a different media service. Devices with digital media playback capabilities, including, for example, televisions, set top boxes, and mobile devices, may be configured to provide users thereof with graphical user interfaces that enable the selection of content. Context specific control options may be customized for a specific application or include general options that can be mapped for specific applications. For example a computer contextspecific control option540 may include icons to cause the host media device to launch a particular computer application on the main display, such as weather application, task list, sports scores, etc.
Context specific control options can be represented by icons associated with television network logos that, upon activation (e.g., a tap activation, a click activation, etc.), may cause a tuner of the host media device to tune to the particular television channel (or cause the host media device to access a particular media stream). In the case where application specific options are associated with television channels, television channels may correspond to recently viewed channels and/or a set of channels determined by information included in a user's profile. Further, in one example, television channels represented by icons associated with context specific control options may mirror channels displayed on a graphical user interface.
For example, a main display (e.g., display115 ofFIG. 1) may include channels AMC, FOX, NBC, CBS, BBC, Showtime, and HBO of thehost media device110 as part of a graphical user interface. In this case, application specific icons may include icons representing AMC, FOX, NBC, CBS, BBC, Showtime, and HBO. In a similar manner, when a graphical user interface associated with an on demand content application is presented on a display, specific icons may represent icons corresponding items of content. For example, context specific options may represent the movies when thedisplay115 presents a movie. In this manner,user interface503 is configured to dynamically present icons which may be activated by a user and receive user input, including multi-level activations.
Based on received user inputs provided to a peripheral control device, the host media device may cause changes to occur with respect to an item of content and/or graphical user interfaces presented on the main display and/or theuser interface500 of the peripheral control device. In some examples, contextspecific control options510,520,530,550,560 may be presented to a user in response to a user selection. For example, a user can selected a control function to activate a particular media stream (e.g., menu534) and the peripheral control device can display a sub-context group of specific control options (e.g., streaming menu options560) in anotherregion505 independent of the host media device.
In otherexamples user interface500 may display motion based graphics, animations, video, and the like and may enable complex user interactions (e.g., so-called second screen applications). For example,user interfaces500 may enable a user to play a game (e.g., a trivia game or a video game) or keyboard displayed in regions502-505. Further,user interface500 may display information associated with an item of content rendered on a display associated with a computing device (e.g., a plot synopsis of a movie). For example, a user selection of aninfo button533 can cause supplemental information to appear in anotherregion504.
Theuser interface500 may also present control functions as a graphics, icons, or text representing an item of content. In an example, graphical user interface can includes a voice activated searching graphical user interface. For example, upon a user saying the name of an actress andgraphical user interface500 may display a list of movies associated with the actress.
In an implementation, the interface includes a microphone, and the PCD receives voice data via the interface, compresses the voice data into an Adaptive Differential Pulse Code Modulation format; and transmits the compressed voice data to the host media device to command the primary media context.
In an example media context, theregion503 might present playback controls520 configured to enable a user to control the playback of and/or record multimedia content. For example, theregion503 matching a playback context may enable a user to control the playback of a video originating from a media service provider site, an on demand engine, and/or a personal video recorder (PVR). Theregion502 matching a playback context may include reverse playback button521, normal playback button522, forward playback button523, stopplayback button524,pause playback button525, andrecord button526. Reverse playback button521 may enable to a user to navigate to a previous point in a multimedia sequence.
Upon activation, normal playback button522 may cause the host media device to present normal playback of an item of multimedia content to begin or resume on the main display. Forward playback button523 may enable a user to navigate to a future point in a multimedia sequence.Record button526 may enable a user to cause an item of multimedia content to be stored to a storage device. In one example,record button526 may enable a user to record content to a storage device.
Other context specific control options, e.g.530, may include default control options or be associated with multiple media services. For example, anavigational region504 may be configured to presentnavigation control options530 with virtual navigational buttons as a default set of control functions, such asarrow buttons531,select button532,information button533,menu button534, guide button535,back button536, and exit button537.Navigational arrow buttons531 may be configured to move the position of a cursor associated with a graphical user interface and/or change the selection of an item included in a graphical user interface.Select button532 may enable a user to further select an icon. In one example, consecutive activations ofselect button532 may cause respective levels of selection to occur.Information button533 may be configured to cause additional information associated with an item of content of to be displayed. For example, when an icon representing an item of content is initially selected, activation ofinformation button533 may cause information associated with the content (e.g., cast and crew information) to be displayed.Menu button534, guide button535,back button536, and exit button537 may be configured to enable a user to cause different graphical user interfaces to be presented. Upon activation,menu button534 may cause a graphical user interface including a high level menu to be displayed. In one example, a high level menu may include a menu that enables a user to change settings associated with the operation of a computing device. In one example, a high-level menu may include a menu that enables a user to select a user profile (e.g., a log-in graphical user interface). Upon activation, guide button535 may be configured to provide a graphical user interface that enables a user to select content. In one example, upon activation of guide button535, a graphical user interface including a grid guide may be presented to a user.Back button536 may be configured to enable a user to return to a previous graphical user interface. Exit button537 may be configured to enable a user to return to a full screen viewing mode. For example, when a graphical user interface is displayed, upon activation of exit button537, the graphical user interface may “disappear” and a full screen content viewing mode may be presented to a user.
FIG. 6 is a flow diagram of an examplecontext management method600 in accordance with one or more implementations of the present disclosure. In an example implementation, a method can be performed by processing logic that can comprise hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions run on a processing device), or a combination thereof. In an implementation, the method is performed by at least a context handler application (e.g.,command handler235,context handler230, and/or Encoder/Decoder224, ofFIG. 2) executed by a processing device of a host media device (e.g.,CPU210 ofFIG. 2). The host media device can be associated with a main display (e.g., projector, TV, etc.) and in communication with a peripheral control device. The processing device can support multiple contexts that coordinate one or more sets of control options available via the PCD with the activities or context of the host media device.
Atblock610, the processing device determines one or more commands for controlling an active media context of the host media device. The host media device can support several media services such as a search service, television media service, streaming media service, on-demand media service, local media service, etc. that outputs a media context of the media service onto the main display. For example, the media context can be a specific be an item of content, a menu, or other graphical interface of the media service. The active media context is the media context being presented on a main display by the host media device. The host media device can handle multiple commands for switching between media services or contexts of media services. Each media service can have application specific commands as well as context specific commands to allow for user interaction.
Atblock620, the processing device encodes a payload with a context identifier corresponding to the one or more commands. The context identifier is used by the PCD to identify control functions that corresponds to the one or more commands that for controlling the active media context.
Atblock630, the processing device transmits the encoded payload to the PCD. In an implementation, the processing device communicates with the PCD via a protocol, such as Bluetooth Low Energy or ZigBee and the context identifier is encoded as an HID reports. The processing device encodes the payload, for example, by packing the control identifier with header and trailer information according to the protocol.
Atblock640, the processing device determines whether the PCD includes one or more control functions associated with the context identifier. Atblock650, the processing device causes the PCD to present one or more control functions corresponding to the one or more determined commands of the active media context. For example, if the processing device loads a media service that allows the user to enter alphanumeric input, the processing device determines the PCD includes a virtual keyboard for entering alphanumeric input and can instruct the PCD to associate the alphanumeric input with the context identifier.
If the PCD does not have the control functions stored locally, the processing device can send the PCD a new set of control functions for use with the active media context. In an implementation, the processing device can send a payload that includes an image encoded in as a HID output report. The PCD can present the image as a control functions corresponding to the one or more determined commands of the active media context. For example, if the processing device loads an active media service with recently added channels, the processing device can send the PCD a set of images associated with the added channel logos and a set of instruction to transmit the channel identifier to the processing device. Then the PCD can display the images as short-cuts for display by the PCD to the user. In response to receiving the channel identifier from the PCD, the processing device can tune the main display to the channel.
FIG. 7 illustrates an examplecontext management sequence700 in accordance with one or more implementations of the present disclosure. In an implementation, the peripheral control device may communicate over IP (Ethernet/Wifi/ZigBee) or by using Bluetooth Low Energy. A user may boot up a host media device, e.g., a STB, and the host media device then discovers the peripheral control device and pairs with the remote control unit. Steps720-730 illustrate a Bluetooth discovery and paring sequence between the host media device with theperipheral device controller712. For example, at720, the host media device performs a DiscoverDevices function using the host encoder706 (e.g., Bluetooth) andPCD Bluetooth Service710 to getDeviceDiscovery( ).
Thehost media device702 can provide services for a scan client role with a scan parameters profile. For example, a PCD can have one or more instances of HID Services, one or more instances of a battery service, a device information service, scan parameters service, etc. The PCD may include single or multiple instances of other services. In this example, thehost media device702 has upper layers of the Bluetooth software running on its native processor and is connected to a Bluetooth radio module via a transport bus such as USB. The PCD in this example has its firmware encoded with the radio firmware, running on the same CPU, for the lowest possible cost implementation. Other implementations on the HID side are possible and equally valid.
TheBluetooth Service710 returns a list of discovered device at724. Thehost media device702 can select peripheral control device name from the device list and send a request to bond the devices at726 via thehost encoder706 that include a protocol driver for communicating with the PCD (e.g., Bluetooth, Zigbee, othe HID protocol) to PairBtDevice(deviceName) at728. ThePCD Bluetooth Service710 authorizing the request will return a message to the host media device to confirm a PairingSuccess( ) at730.
Thehost media device702 can executehost context handler708 and the PCD can executePCD context controller712 to facilitate the context management that coordinate possible control commands of anactive media service704 on thehost media device702 with control options presented to the user by the PCD. That is, thecontext management sequence700 is to indicate to the PCD the control options that are relevant to themedia service704 that is active on the host media device so that the PCD can present the relevant control options to the user.
In an example scenario, thehost media device702 can boot-up or initialize at732 and activate amedia service704, for example, load aLiveTV734 service. Since the active context of thehost media device702 or the presented control options on the PCD may have changed since the last time the two device were used together, the context management software can change the control options presented by the PCD to be relevant to themedia application702. For example, themedia service704 may load to the last state TuneChannel(lastViewedChannel) at736. Thehost context controller708 can determine the active context vie receiving sendContextinfo(liveTVinfo) at738.
At740, thehost context handler708 can determine the commands associated with the active context of themedia service704 by processing context information. To ensure reliable and low cost coordination with the PCD, the HID over GATT protocol can be used to encode a Payload with the context information (LiveTVinfo) at742. The middleware encodes contextual packets and sends it to the Bluetooth driver over an extended Bluetooth protocol. The PCD can receive a message from the driver and unpacks the details in the PCD application. The PCD application can decode the payload and load the application context keys and information related to the context. For example, thehost encoder706 on thehost media device702 can encode the context information into an HID output and send thecontext information744 to theBluetooth service710 of the PCD. TheBluetooth service710 can receive the encodedmessage data746 and decode the message back intocontext data748 that can be send to thePCD context controller712. ThePCD context controller712 determines the control options associated with the decoded packets at750 and displays the relevant control options to the user at752.
FIG. 8 illustrates a block diagram of one implementation of acomputing device800 within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed. In alternative implementations, the machine may be connected (e.g., networked) to other machines in a Local Area Network (LAN), an intranet, an extranet, or the Internet. The machine may operate in the capacity of a server or a client machine in a client-server network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine may be a personal computer (PC), a tablet computer, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a web appliance, a server, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while only a single machine is illustrated, the term “machine” shall also be taken to include any collection of machines (e.g., computers) that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
Theexample computing device800 includes aprocessing device802, a main memory804 (e.g., read-only memory (ROM), flash memory, dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM) or Rambus DRAM (RDRAM), etc.), a static memory806 (e.g., flash memory, static random access memory (SRAM), etc.), and a secondary memory (e.g., a data storage device818), which communicate with each other via a bus830.
Processing device802 represents one or more general-purpose processors such as a microprocessor, central processing unit, or the like. More particularly, theprocessing device802 may be a complex instruction set computing (CISC) microprocessor, reduced instruction set computing (RISC) microprocessor, very long instruction word (VLIW) microprocessor, processor implementing other instruction sets, or processors implementing a combination of instruction sets.Processing device802 may also be one or more special-purpose processing devices such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), network processor, or the like.Processing device802 is configured to execute the processing logic (instructions822) for performing the operations and steps discussed herein.
Thecomputing device800 may further include anetwork interface device808. Thecomputing device800 also may include a video display unit810 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)), an alphanumeric input device812 (e.g., a keyboard), a cursor control device814 (e.g., a mouse), and a signal generation device816 (e.g., a speaker).
Thedata storage device818 may include a machine-readable storage medium (or more specifically a non-transitory computer-readable storage medium)828 on which is stored one or more sets ofinstructions822 embodying any one or more of the methodologies or functions described herein. Theinstructions822 may also reside, completely or at least partially, within themain memory804 and/or within theprocessing device802 during execution thereof by thecomputer system800, themain memory804 and theprocessing device802 also constituting computer-readable storage media.
The computer-readable storage medium828 may also be used to store a context control service engine890 (as described with reference toFIGS. 1-7), and/or a software library containing methods that call an contextcontrol service engine890. While the computer-readable storage medium828 is shown in an example implementation to be a single medium, the term “computer-readable storage medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term “computer-readable storage medium” shall also be taken to include any medium other than a carrier wave that is capable of storing or encoding a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies described herein. The term “computer-readable storage medium” shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media.
In an implementation, the modules, components and other features described herein (for example context control service engine in relation toFIGS. 3-7) can be implemented as discrete hardware components or integrated in the functionality of hardware components such as ASICS, FPGAs, DSPs or similar devices as part of a peripheral control device (e.g.,peripheral control device150 ofFIG. 1). In addition, the modules can be implemented as firmware or functional circuitry within hardware devices. Further, the modules can be implemented in any combination of hardware devices and software components, or only in software.
Some portions of the detailed description have been presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of steps leading to a desired result. The steps are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.
It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise, as apparent from the following discussion, it is appreciated that throughout the description, discussions utilizing terms such as “receiving”, “presenting”, “changing”, “downloading”, “determining”, “encoding”, “decoding”, “causing”, “receiving,” “identifying,” “transmitting” or the like, refer to the actions and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
Implementations of the present disclosure also relate to an apparatus for performing the operations herein. This apparatus may be specially constructed for the discussed purposes, or it may comprise a general purpose computer system selectively programmed by a computer program stored in the computer system. Such a computer program may be stored in a computer readable storage medium, such as, but not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, and magnetic-optical disks, read-only memories (ROMs), random access memories (RAMs), EPROMs, EEPROMs, magnetic disk storage media, optical storage media, flash memory devices, other type of machine-accessible storage media, or any type of media suitable for storing electronic instructions, each coupled to a computer system bus.
It is to be understood that the above description is intended to be illustrative, and not restrictive. Many other implementations will be apparent to those of skill in the art upon reading and understanding the above description. Although the present disclosure has been described with reference to specific example implementations, it will be recognized that the disclosure is not limited to the implementations described, but can be practiced with modification and alteration within the spirit and scope of the appended claims. Accordingly, the specification and drawings are to be regarded in an illustrative sense rather than a restrictive sense. The scope of the disclosure should, therefore, be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.