FIELD OF THE INVENTION- The present invention relates generally to computer-based methods and apparatuses, including computer program products, for input queued content switching using a playlist. 
BACKGROUND- Historically, video data is transmitted in the radio frequency (RF) spectrum to a television or set-top box (STB). For example, a Cable Head-End might use quadrature amplitude modulation (QAM) to transmit digital video to its subscribers by modulating the video onto an RF signal that is up-converted and transmitted in the analog RF spectrum. The modulated video is formatted using MPEG-2 Transport Streams (MPEG-2 TS), and each home's television or STB tunes to a particular RF channel to view a program. On-demand content might also be modulated onto a QAM, and the STB tunes to a particular channel to view a program that was requested. In this type of network, the live broadcast content and the on-demand content is combined at the RF plant using an RF combiner. Different QAM devices are also generally used for video and data over cable service interface specification (DOCSIS) data, and similarly combined at the RF plant (i.e., DOCSIS uses QAM channels that are not used for video broadcast). 
- Newer internet protocol television (IPTV) deployments wrap the video in a transport layer (e.g., real-time transport protocol (RTP), transmission control protocol (TCP), user datagram protocol (UDP)) and then transmit the content using either a multicast or unicast across an IP data network (e.g., DOCSIS, very high bitrate digital subscriber line (VDSL), gigabit passive optical network (GPON), Ethernet, etc.). The use of IP multicast is common for live broadcast channels viewed by many, since it is similar in concept to broadcast television. However, in this usage of multicast, only the IPTV subscribers that request to join a particular multicast session will actually receive the transmission. IP unicast, on the other hand, is used for on-demand content, with a unique IP address used per subscriber. Unicast enables per-subscriber customization of live content, such as when performing targeted advertising. 
- FIG. 1 shows avideo delivery network100 with different video delivery systems108a-z, each connecting to clients112a-zthrough adistribution network110. Clients112a-zare able to access each video delivery system108a-zthrough thisnetwork100, as well as content available from theIP core network106. 
- Content is ingested by each video delivery system108a-z, typically from anIP network106. For example, IP multicast may be used for broadcast television retrieved from abroadcast television encoder102, while IP unicast is used for on-demand content retrieved from a content origin server104. Content may be ingested and delivered using different protocols. For example, File Transfer Protocol (FTP), TCP and Hypertext Transfer Protocol (HTTP) may be used for content ingest, while RTP, UDP, TCP, and HTTP may be used for delivery. TCP and HTTP are beneficial for delivery across IP data networks, since they are reliable and support bursting of data (e.g., progressive download to a STB or personal computer (PC)). 
- Clients112a-z(e.g., STB, PC) interact (e.g., using Real Time Streaming Protocol (RTSP), HTTP, etc.) with a video delivery system108a-zby making content requests. A signaling session is set up between the client112a-zand the video delivery system108a-z, and requests for content are made by the client112a-z. This includes, for example, picking titles and channel changing for live content, as well as pause, rewind, fast forward, play, etc., for stored content. Once a video delivery system108a-zhas established a signaling session with a client112a-z, some video delivery systems108a-zwill provide a proxy function to maintain the session when the requested content is available elsewhere in the network (i.e., a local cache “miss”). In this case, the system108a-zmakes the content appear as though it had originated locally, even though coming from another device in the network. Implementing the proxy function may also require a gateway between different protocol sessions (e.g., fetching content using HTTP and delivering content using UDP). In some cases, a redirect is performed, creating a new session with another system108a-zcontaining the desired content. 
- For stored content delivery, a video delivery system (e.g.,108z) may use a playlist to access the stored content. For example, this might be used for playing a sequence of chapters in a movie. A playlist is any ordered list of content or references to content that can be accessed and played over a given time period. A playlist may be a list of songs, videos, multimedia, or other content. Playlists have long been used for music, e.g., dating back to radio broadcasting and, more recently, for multimedia content that can be played on a PC. Typically, a playlist is constructed with multiple references to one or more pieces of content, starting at the beginning and continuing until the end is reached. Playlists have many formats and are used in many different applications, including computerized media players, e.g., Windows Media Player from Microsoft Corporation of Redmond, Wash., or Adobe Flash Player from Adobe Corporation of San Jose, Calif., among others. Typically, a playlist is executed by retrieving the media data (from local storage, network storage, etc.) and running a program that actually plays the media. Often, the stored media is in a compressed format (e.g., MPEG-2, Advanced Video Coding (AVC), MPEG-1 Audio Layer 3 (MP3), VC-1, etc) and the program that plays the content decodes the media before presenting it. 
- At times, subscribers may want to switch between different types of content (e.g., from a live broadcast to on-demand programming). Content switching is generally performed between different systems, resulting in new sessions being created at each content switch. This generally includes switching between live and stored content, such as between broadcast television and timeshift TV, as well as to proxy content that is fetched from elsewhere in the network. A video delivery system (e.g.,108a) connected to a client (e.g.,112a) via a signaling session may be capable of supporting live television broadcast delivery as well as stored content delivery (e.g., Video On-Demand (VoD), Timeshift TV, Network Personal Video Recorder (nPVR)). However, it is more often that different video delivery systems108a-zwill be used for different applications, such as one forlive content delivery108a(e.g., fast channel change) and another for storedcontent delivery108z. Having different systems108a-zfor each type of content delivery requires creating a new session between the client112a-zand each video delivery system108a-zat each content switch. For example, a subscriber atclient112amay be watching live television and then select a time-shifted version of the same program. If the live content is provided by one system (e.g.,108a) and the stored timeshift TV content is provided by another system (e.g.,108z), then a new signaling session is needed between theclient112aand thetimeshift system108z. This process may take several seconds to complete, since one session is taken down and another is created, and typically involves another application on another system that then directs where the content session requests should be made. 
- Content switching may also include fetching proxy content that is stored elsewhere in thenetwork100. In a system108a-zthat is capable of single session proxy, where the proxy content being delivered is consistent with any locally served content, access requests to the proxy content may be included in a playlist. The proxy content may be available in the same protocol as what is being delivered, or the content may be available in a different protocol. If the content is available in the same protocol, a Network Address Translation (NAT)-like function (UDP in and UDP out) may be performed. If the content is available in a different protocol, a more sophisticated gateway function may be needed to convert between protocols (e.g., HTTP to UDP). Typically, the video delivery system108a-zwill conduct this conversion by ingesting the proxy content, storing it locally, and then delivering it to a client112a-zas stored content. Depending on the caching effectiveness of the system108a-z, this may require significant ingest and storage bandwidth. 
- Playlists may be used to control content switching between different content sources, even when the sources have different access latency. For example, a switch between a live broadcast television program, stored content, and proxy content stored elsewhere in the network may be done, although each switch may complete at a different time. This is due to each content type potentially having a different access delay. A seamless content switch requires each content type be available at a precise time so there are no gaps in the resulting output stream and no overlap of content. 
- Another example of content switching occurs in the context of advertisement (ad) splicing in live broadcast streams. Ad splicing is a common function supported by a video delivery system108a-z. Spliced advertisements may be stored on the video delivery system108a-zperforming the splice or on an ad server (not shown). When a splice is to be performed, a splice point is often indicated in the live video stream. The system108a-zperforming the splice has a fixed window of time to fetch the ad and perform the splice (e.g., four-second countdown that is signaled in live broadcast feed). If the ad is available in time, then a switch is made between the live stream and the ad stream being read from storage. If the ad cannot be fetched quickly enough, then the splice is aborted and the live broadcast continues unchanged, since there is typically a default ad already in the spot. This is possible since the splicer generally has access to both input streams simultaneously, and can choose in real-time which to deliver as its output. 
- An input queued system may have many queues with content available for writing to an output buffer. A priority or fairness algorithm can be used to determine which input queue to read from as there is space available in an output buffer. Generally, content that is part of the same flow and read from different input queues requires some means to reorder the content before delivery, increasing complexity and the amount of bandwidth required at the output buffer. When input queues are used for content switching, controlling the order in which the input queues are accessed is essential to composing an output stream in the output buffer, and further reducing the output buffer bandwidth and complexity. By insuring that there are no gaps or overlap in input queue access, the output buffer input bandwidth may be matched to its output bandwidth and be written in first-in first-out (“FIFO”) order. 
- Controlling the precise time for input queue selection, when performing content switching, requires a mechanism to synchronize the input queue access with the actual content. For example, a seamless content switch may require two pieces of content be spliced back to back in an MPEG-2 TS compliant manner. This would be needed to avoid display artifacts that might occur from a partially constructed output stream. The input queue selection may be done based on time if the system is precise enough, e.g., switch at 12 o'clock, based on a content data length if this is known before hand, e.g., switch after 1,000 bytes, and by examining the content stream if a command can be issued at the appropriate time, e.g., look for the next video out-point and then switch. These approaches each have issues, since it is not always known when a content switch must occur, for example, when performing an ad splice. 
- Content switching in a system with variable latency may require a means to handle cases where the content cannot be accessed at the needed time. A system using a playlist and issuing multiple commands in the playlist in parallel has an expectation that the commands will be fulfilled in time. If a command in the playlist cannot be completed because the content is unavailable, then an error may be signaled and an interruption in content delivery may occur. For example, a playlist is constructed ahead of time in the splicing countdown window of a live stream so an advertisement can be pre-fetched and then inserted when the splicing point is reached. Since the playlist is generated ahead of knowing whether the content read will succeed or not, any content switch to content that is unavailable causes reading of the live stream to stop, and no content to be sent to a client. In the case of an advertisement being unavailable for delivery, this may result in one or more freeze frames, as well as display and audio artifacts that are undesirable, until the system recovers. This may take several seconds, especially if the playlist is aborted and a new playlist must be created for new content. 
- A scalable system must support many content streams in parallel. Each stream may have different attributes and different access patterns. Keeping each stream's content requests separate from others is essential to scale and uniform content delivery (i.e., no gaps, skipped play, etc). 
SUMMARY OF THE INVENTION- The techniques described herein include methods and apparatuses for input queued content switching using a playlist. The techniques combine live and stored content delivery, along with proxy content delivery from another source, and support content switching between different content types in a single client session. The transition between content can also be made seamless with respect to MPEG TS compliance. 
- In one aspect, there is a computerized method. The method includes generating, by a first computing device, a retrieval sequence using a plurality of content requests, the content requests being based on content location information. The method includes requesting a first portion of content to be queued at a first content source and a second portion of content to be queued at a second content source using the retrieval sequence. The method includes generating, at the first computing device, a content stream of the first portion of content and the second portion of content. The generating a content stream includes selecting the first portion of content from a queue associated with the first content source using the retrieval sequence. The generating a content stream includes transferring the first portion of content from the queue associated with the first content source to an output buffer. The generating a content stream includes terminating transfer of the first portion of content from the queue associated with the first content source to the output buffer, and initiating transfer of the second portion of content from a queue associated with the second content source to the output buffer, by selecting the second portion of content from the queue associated with the second content source using the retrieval sequence. The method includes transmitting the portion of content in the output buffer to a client device. 
- In another aspect, there is a computer program product. The computer program product is tangibly embodied in a machine-readable storage device. The computer program product includes instructions being operable to cause a data processing apparatus to generate, by a first computing device, a retrieval sequence using a plurality of content requests, the content requests being based on content location information. The computer program product includes instructions being operable to cause a data programming apparatus to request a first portion of content to be queued at a first content source and a second portion of content to be queued at a second content source using the retrieval sequence. The computer program product includes instructions being operable to cause a data programming apparatus to generate, at the first computing device, a content stream of the first portion of content and the second portion of content. The generating a content stream includes selecting the first portion of content from a queue associated with the first content source using the retrieval sequence. The generating a content stream includes transferring the first portion of content from the queue associated with the first content source to an output buffer. The generating a content stream includes terminating transfer of the first portion of content from the queue associated with the first content source to the output buffer, and initiating transfer of the second portion of content from a queue associated with the second content source to the output buffer, by selecting the second portion of content from the queue associated with the second content source using the retrieval sequence. The computer program product includes instructions being operable to cause a data programming apparatus to transmit the portion of content in the output buffer to a client device. 
- In another aspect, there is a system for input queued content switching. The system includes a content request processor configured to generate, by a first computing device, a retrieval sequence using a plurality of content requests, the content requests being based on content location information. The content request processor is configured to request a first portion of content to be queued at a first content source and a second portion of content to be queued at a second content source using the retrieval sequence. The system includes a content retrieval processor configured to generate, at the first computing device, a content stream of the first portion of content and the second portion of content. The generating a content stream includes selecting the first portion of content from a queue associated with the first content source using the retrieval sequence. The generating a content stream includes transferring the first portion of content from the queue associated with the first content source to an output buffer. The generating a content stream includes terminating transfer of the first portion of content from the queue associated with the first content source to the output buffer, and initiating transfer of the second portion of content from a queue associated with the second content source to the output buffer, by selecting the second portion of content from the queue associated with the second content source using the retrieval sequence. The content retrieval processor is configured to transmit the portion of content in the output buffer to a client device. 
- In another aspect, there is a system for input queued content switching. The system includes means for generating, by a first computing device, a retrieval sequence using a plurality of content requests, the content requests being based on content location information. The system includes means for requesting a first portion of content to be queued at a first content source and a second portion of content to be queued at a second content source using the retrieval sequence. The system includes means for generating, at the first computing device, a content stream of the first portion of content and the second portion of content. The generating a content stream includes selecting the first portion of content from a queue associated with the first content source using the retrieval sequence. The generating a content stream includes transferring the first portion of content from the queue associated with the first content source to an output buffer. The generating a content stream includes terminating transfer of the first portion of content from the queue associated with the first content source to the output buffer, and initiating transfer of the second portion of content from a queue associated with the second content source to the output buffer, by selecting the second portion of content from the queue associated with the second content source using the retrieval sequence. The system includes means for transmitting the portion of content in the output buffer to a client device. 
- In some examples, any of the aspects can include one or more of the following features. The generating a retrieval sequence includes generating a plurality of retrieval entries based on each content request and inserting the retrieval entries into the retrieval sequence. The generating a retrieval sequence can further include determining a content access delay for each retrieval entry and determining a content request time based on the content access delay. The content request time can be based on a content type, a content length, a content source, a temporal value, or any combination thereof. 
- In other examples, the requesting first and second portions of content includes sending a first content retrieval request to the first content source and a second content retrieval request to a second content source. The first content source and the second content source can be of type transient buffer, persistent storage, network-based, or any combination thereof. 
- In some examples, the selecting the second portion of content includes selecting a substitute portion of content from a queue associated with a third content source based on the retrieval sequence wherein the second portion of content is unavailable in the queue associated with the second content source. The first content source and the third content source can be the same. 
- In other examples, the content requests are based on session control information. The content requests can be based on a request from a client device. The transferred portion of content can be processed to determine the existence of an indicator. Control information can be inserted into the output buffer based on the indicator. 
- In some examples, the content location information includes a primary content source, a proxy content source, or any combination thereof. The output buffer can be a first-in first-out buffer. The output buffer can include content delivery processing. 
- In other examples, the first content source, the second content source, and the first computing device are connected by a switch fabric. The retrieval sequence can be a data structure. 
- Any of the examples described herein can include one or more of the following advantages. The techniques, including methods, apparatuses, and computer program products, provide for live and stored content delivery in a single system, as well as proxy from another source, and therefore can support content switching between different content types in a single client session. The original signaling session can be retained even when switching between different content types. The transition between applications can also be made seamless with respect to MPEG TS compliance. The techniques employ an input queued system and a playlist to control the manner in which content is accessed. The playlist determines which content to access in sequence, the location of the content, the amount of content to read, and the input queue in which to store the content. Any difference in access latency between content types is hidden by issuing read commands far enough in advance of needing the content so that the input queue contains some or all of the requested content. Any access overlap between different content types is hidden since input queues may be written concurrently. 
- The techniques take advantage of the attributes of a playlist to control precisely the sequence of input queues that are accessed when performing content switching, as well as controlling the time at which a switch between input queues is made to compose an output stream in an output buffer. The precise timing of access eliminates any potential of content overlap, thereby reducing the bandwidth requirement of the output buffer and any complexity that might be associated with receiving content that is out of order. The size of the output buffer is also reduced, since the content is read slightly in advance of delivery, and no extra storage is needed for overlapped content accesses. The techniques use a separate playlist and output buffer for each delivered content stream. Each playlist may be executed at different times, according to the availability of content and when there is room available in the output buffer. This can avoid any head of line blocking. 
- The techniques utilize a playlist to access proxy content. By issuing the commands sufficiently in advance of needing the content, the techniques allow for storing the proxy to an input queue, so that the input queue selection can be performed similar to locally accessed content, and allow sending the proxy directly to a delivery output buffer without requiring the proxy content be stored first. This removes any storage bandwidth considerations from limiting the amount of proxy content that can be delivered by the system. 
BRIEF DESCRIPTION OF THE DRAWINGS- The foregoing and other objects, features and advantages of the present invention, as well as the invention itself, will be more fully understood from the following description of various embodiments, when read together with the accompanying drawings. 
- FIG. 1 is a depiction of a video delivery network, as illustrated in the prior art. 
- FIG. 2 is a block diagram of an exemplary system for video delivery. 
- FIG. 3 is a block diagram of an exemplary system for video delivery that includes proxy content delivery. 
- FIG. 4 is a block diagram of an exemplary system for video delivery that includes content ingest processing for proxy content delivery. 
- FIG. 5 is a block diagram of an exemplary system for video delivery that includes the components connected through a switch fabric. 
- FIG. 6 is a block diagram of an exemplary system and method for input queued content switching using a playlist. 
- FIG. 7 is a flowchart of an exemplary method for input queued content switching using a playlist. 
- FIG. 8A is a diagram of an exemplary content request format. 
- FIG. 8B is a diagram of an exemplary content retrieval request format. 
- FIG. 9 is a diagram of an exemplary retrieval sequence format. 
- FIG. 10 is a diagram of an exemplary output stream generated by a playlist. 
- FIG. 11 is a diagram of an exemplary playlist format including in-band commands. 
- FIG. 12 is a diagram of an exemplary output stream generated by a playlist including in-band commands. 
- FIG. 13 is a diagram of an exemplary conditional composite playlist where the requested content is ready. 
- FIG. 14 is a diagram of an exemplary conditional composite playlist where the requested content is not ready 
DETAILED DESCRIPTION- In general overview, the described techniques include methods and apparatuses that are for input queued content switching using a playlist. The techniques are related to switching between live and stored content in order to create a content stream for delivery to a client device. The techniques achieve efficient transition between multiple content types by utilizing input queued functionality and a playlist to control the manner in which content is accessed. The playlist determines which content to access in sequence, the location of the content, the amount of content to read, and the input queue in which to store the content. Once the content is queued, these techniques make retrieval, buffering and delivery of the content more efficient by selecting portions of content according to the playlist sequence, thereby reducing the bandwidth requirements of the delivery module and output buffer. 
- FIG. 2 is a block diagram of an exemplaryvideo delivery system200. Thevideo delivery system200 is capable of content switching between live and stored content. Thesystem200 includes an ingestmodule204, a broadcast buffer module206 (e.g., DRAM), a storage module208 (e.g., Flash memory), and adelivery module210. The functions of therespective modules204,206,208, and210 may be integrated together or be kept separate. The ingestmodule204 receives network packets202 (for example, video streams such as MPTS, SPTS, or other content formats) over a communications network, processes the content as necessary, and then stores the content in thebroadcast buffer module206 or in thestorage module208. Live video may be written to thebroadcast buffer module206 for near instant access, such as for fast channel change (e.g., using a memory), as well as to storage (e.g., timeshift TV). Thedelivery module210 reads the content from thebroadcast buffer module206 or thestorage module208, and transmits the read content to clients230 (e.g., STB, PC, etc) across a communications network. Thedelivery module210 also provides a signaling interface (e.g., signalinglinks220aand220b) between thevideo delivery system200 andclients230 in order forclients230 to request access to content from thevideo delivery system200. Thevideo delivery system200 supports constant bit-rate (CBR) and variable bit-rate (VBR) ingest and delivery, as well as multi-protocol ingest and delivery (e.g., RTP, UDP, TCP, HTTP, etc.). 
- FIG. 3 is a block diagram of avideo delivery system300 that includes proxy content delivery. In addition to supporting content delivery from thebroadcast buffer module206 and thestorage module208, thevideo delivery system300 also supports proxy content delivery to aclient device230. Thevideo delivery system300 can fetch theproxy content302 from another content source on the network by using signaling304 to communicate with the content source. Typically, thevideo delivery system300 fetchescontent302 from a proxy content source when a local cache miss occurs (e.g., if the requested content is unavailable in thebroadcast buffer module206 or the storage module208). The proxy content delivery can occur in a single session. When thevideo delivery system300 retrieves theproxy content302, thesystem300 provides the content302 to thedelivery module210 for transmission to aclient device230 without first needing that content to be stored in, for example, thebroadcast buffer module206 or thestorage module208. Thedelivery module210 and the network proxy device (not shown) supplying the proxy content provide anysignaling304 that is necessary to retrieve thecontent302. This makes the full delivery bandwidth available for proxy, and any scheduling ofproxy content302 may further be performed by thedelivery module210. 
- FIG. 4 is a block diagram of anexemplary system400 for video delivery that includes content ingest processing for proxy content delivery. In some cases, it may be necessary to receiveproxy content402 at the ingestmodule204, process theproxy content402, and then make theproxy content402 available to thedelivery module210 for transmission to aclient device230, again without storing the content. The ingestmodule204 creates a signaling session404 (e.g., HTTP, TCP, etc.) between thevideo delivery system400 and the proxy system providing thecontent402. The ingestmodule204 receives the proxy network packets (e.g., over Ethernet) and processes them as needed, and then makes the content402 available to thedelivery module210 for transmission to aclient device230. Thedelivery module210 continues to manage the signaling interface between thevideo delivery system400 and theclient device230, such that theclient device230 is unaware that thecontent402 was sourced from an entity other than thevideo delivery system400. 
- FIG. 5 is a block diagram of anexemplary system500 for video delivery that includes thecomponents204,206,208, and210 connected through aswitch fabric502. In order to provide connectivity between each of the functions involved in the process of ingesting, storing, proxy, and delivery of content on a large scale, the ingestmodule204, thebroadcast buffer module206, thestorage module208, and the proxy content source are all connected to thedelivery module210 and to each other via aswitch fabric502. Theswitch fabric502 can be lossless. Theswitch fabric502 provides a connection between (n) outputs and (m) inputs simultaneously (where n can be less than, equal to, or greater than m) in a non-blocking fashion, meaning that for each output a connection to an input can be made without interference from other outputs or inputs. Theswitch fabric502 may be comprised from a single switch supporting bidirectional connectivity, a separate switch for each connection direction, as well as separate switch types, e.g., one for switching content and another for switching network packets. Multiple other configurations are also possible (e.g., dual star, full mesh, crossbar, etc). 
- Theswitch fabric502 provides connectivity between each of therespective modules204,206,208, and210, for example, to ingest content at the ingestmodule204 from aproxy device interface504. In one embodiment, the ingestmodule204 may contain a direct connection (not shown) to aproxy device interface504 to conserve switch fabric bandwidth, or receive its content from aproxy device interface504 that is attached to theswitch fabric502. Thedelivery module210 may also provide a direct connection (not shown) to aproxy device interface504 to reduce the bandwidth requirement of theswitch fabric502. In doing so, content can be read from thestorage module208, thebroadcast buffer module206, and theproxy device interface504 by thedelivery module210 and then be sent directly to a network, typically one facing a client device230 (although this is not necessary), without needing to traverse the switch fabric502 a second time. Each of the respective modules may itself be comprised from multiple components or devices, such as having several proxy device interfaces504,storage modules208, broadcast buffers206, and ingestdevices210. 
- FIG. 6 is a block diagram of anexemplary system600 for input queued content switching using a playlist. Thesystem600 includes an ingestmodule204, abroadcast buffer module206, astorage module208, and aproxy device interface504, all connected via aswitch fabric502 to adelivery module210. Thedelivery module210 is connected to anetwork interface620 to communicate withclient devices230. Each of themodules204,206,208 and504 include a controller (e.g., Ingest Controller, Storage Controller, Broadcast Buffer Controller, Proxy Interface Controller) to receive content requests from thedelivery module210, a content storage medium (e.g., Ingest Content, Flash, Memory, Proxy Data) for storing content, and a queue interface for making content available to thedelivery module210. Each of the respective queue interfaces can include one or more input queues to hold content. Thedelivery module210 includes asession control module602, aplaylist creation module604, a contentlocation information module606, aplaylist control module608, and anoutput buffer614. Theoutput buffer614 communicates with anetwork interface620 to transmit content toclient devices230. Thedelivery module210 also includes a content observation link616 between theplaylist control module608 and theoutput buffer614. 
- FIG. 7 is a flowchart of an exemplary method for input queued content switching using a playlist.FIG. 7 is described using thesystem600 ofFIG. 6. Theplaylist creation module604 in thedelivery module210 generates (702) a retrieval sequence (also referred to as a playlist) using one or more requests received from aclient device230. The retrieval sequence can be a data structure. The requests are received using a signaling session that is set up between theclient device230 and thedelivery module210 via thesession control module602. In generating the retrieval sequence, theplaylist creation module604 uses content requests based oncontent location information606. Theplaylist creation module604 generates a plurality of retrieval entries based on each content request. The retrieval entries are inserted into the retrieval sequence. Theplaylist control module608 then requests (704) a first portion of content by sending a content request using the retrieval sequence to a first content source (e.g., ingest204, broadcastbuffer206,storage208, or proxy). Theplaylist control module608 can also request (704) a second portion of content by sending a content request using the retrieval sequence to a second content source (e.g., the storage module208). 
- Once theplaylist control module608 has sent content requests to the content sources, the respective content source retrieves the content associated with the content request, typically from content storage (e.g., Flash, Memory, etc.) at the content source, and stores the content in an associated input queue. For example, when a content request is received by thebroadcast buffer controller610aat thebroadcast buffer module206, the requested content is retrieved from thebroadcast buffer memory610band stored in aninput queue610cassociated with thebroadcast buffer module206. A content source can have one or more associated input queues, as represented by Q(0) through Q(m) inFIG. 6. 
- Using the retrieval sequence, theplaylist control module608 then selects (706) the first portion of content from the associated input queue, and transfers (708) the first portion of content to anoutput buffer614 via theswitch fabric502. In some embodiments, a queue scheduler (not shown) may be implemented at thedelivery module210, in addition to the selection provided by theplaylist control module608, in order to control how often an input queue is serviced, e.g., to avoid overfilling the output buffer. Theplaylist control module608 can also observe the content thesystem600 transfers from the input queues (e.g.,610c,612c) to theoutput buffer614 usingfeedback communication path616. Theplaylist control module608 can use information—for example an indicator or a flag—existing in the content to insert control information into theoutput buffer614, as described in greater detail below. The control information can be used by theplaylist control module608 to control when content requests are issued and when content retrieval requests should be made (e.g., at playlist request boundaries a different input queue selection may be made). Generally, theplaylist control module608 controls the transfer of the selected portion of content to the “tail” of theoutput buffer614, while thenetwork interface module620 reads content from the “head” of theoutput buffer614 for transmittal to aclient device230. In some examples, thedelivery module210 may employ an output scheduler (not shown) to control how often data is read from theoutput buffer614 and sent to aclient device230. This may be done at a constant rate, a variable rate, etc. An example of using a rate might occur when transmitting content using a CBR video stream to a STB. Thedelivery module210 can then transmit (714) the content from theoutput buffer614 to aclient device230. 
- Theplaylist control module608 utilizes the retrieval sequence to control the order in which content requests are sent to the content sources and the order in which selections and transfers of content are made from associated input queues. In some examples, theplaylist control module608 can generate one retrieval sequence for each content stream thedelivery module210 generates. The retrieval sequence may contain one or more retrieval entries, and a content access delay may be determined for each retrieval entry. The content access delay can be based on the access latency associated with retrieving content from the various content sources. For example, a storage module206 (e.g., Flash memory) may have a longer access latency than abroadcast buffer module204. Based on the content access delay, theplaylist control module608 can determine a content request time for each retrieval entry in the retrieval sequence. In addition to the latency of the content source, the content request time can be based on considerations such as, among others, the length or size of the requested content or the type of the requested content. As a result, a content request may be made to thestorage module206 before a content request is made to thebroadcast buffer module204 even though theplaylist control module608 may select and transfer the requested content from thebroadcast buffer module204 before selecting and transferring the requested content from thestorage module206. This allows content to be available in an input queue at the time the content is needed for selection and transfer by theplaylist control module608. Also, the content request time can apply to content retrieval requests, resulting in theplaylist control module608 transferring content from the input queues of the respective content sources to theoutput buffer614 in a FIFO manner. 
- While delivering the content, thedelivery module210 switches from retrieving content from the first content source to retrieving content from the second content source (e.g., to insert a localized advertisement). Using the retrieval sequence, theplaylist control module608 can terminate (710) the transfer of the first portion of content and initiate (712) transfer of the second portion of content by selecting the second portion of content from an input queue associated with the second content source. For example, theplaylist control module608 can initiate transfer of content (e.g., a live broadcast) from aninput queue610cassociated with thebroadcast buffer module206. Theplaylist control module608 uses the retrieval sequence to determine that a switch is to be made to select and transfer content (e.g., an advertisement) from thestorage module208 in place of content from thebroadcast buffer module206. Theplaylist control module608 stops the transfer of thebroadcast buffer206 content, selects content from aninput queue612cat thestorage module208, and begins the transfer of content from theinput queue612cto theoutput buffer614. In some examples, when theplaylist control module208 finishes the transfer of the second portion of content, themodule208 can again select content from thefirst content source206 and initiate transfer of the selected content to theoutput buffer614. 
- FIG. 8A is a diagram of an exemplarycontent request format800. The format includes the content location802 (e.g., the location of the content that is to be queued), the content length804 (e.g., how much content to queue), and theinput queue806 into which the content is queued. Theformat800 also includes playlist control flow information, specifically ajump length808 and atest control field810. Anon-zero jump length808 indicates that the next (n) playlist commands in the list should be jumped over if the current content request is executed as part of the retrieval sequence. A zerojump length808 means no requests are jumped over and the next request in sequence is executed. Thetest control field810 may contain one or more bits that affect the control flow. For example, if a particular condition is true then the command may be executed or ignored. This enables conditional execution of playlist commands, as described in greater detail below, which provides an ability to provide different control paths based on tested conditions. 
- FIG. 8B is a diagram of an exemplary contentretrieval request format850. Theformat850 includes aninput queue identifier806, which identifies the input queue (e.g., Q(0)612c) from which the content will be selected as well as playlist control flow information, such as thejump length808 and a conditional control test field—in this example, a skip-on-empty (SoE)control bit812 is shown. Anon-zero jump length808 indicates that the next (n) playlist commands in the list should be jumped. TheSoE bit812 in this example might indicate that this command should be skipped if an input queue is empty at a predetermined time that such identified queue needs to be accessed, as described in greater detail below. Other control bits (not shown) may also be used to conditionally alter the sequence of the playlist as well. 
- FIG. 9 is a diagram of an exemplaryretrieval sequence format900. The retrieval sequence can include a plurality of retrieval entries, including both content requests902a-band content retrieval requests904a-b. Each retrieval sequence may be a different size and contain a different number of retrieval entries for both content requests902a-band content retrieval requests904a-b. For example, many content requests902a-bmay be made to the same content source where only a single input queue is used. The content retrieval requests904a-bassociated with a single content device may be identified sequentially when inserted into the retrieval sequence or the content retrieval requests for all content devices (e.g.,204,206,208,504) may be identified sequentially when inserted into the retrieval sequence. Theplaylist control module602 uses the content retrieval requests904a-bto determine from which input queue to select content, with the selection order determined by the retrieval sequence. In some examples, content requests902a-band content retrieval requests904a-bare decoupled from each other in the retrieval sequence, although each is executed sequentially. The content requests902a-bmay be taken from the retrieval sequence and sent as quickly as possible to the respective content devices, or the content requests902a-bmay be sent out at a rate that is determined by the respective content devices' ability to receive requests. Generally, theplaylist control module608 takes content retrieval requests904a-bfrom the retrieval sequence at a different time that the corresponding content requests902a-b, although this is not necessary. For example, theplaylist control module608 may take a content request (e.g.,902a) from the retrieval sequence and send the content request to a content source before the corresponding content retrieval request (e.g.,904a) is taken from the retrieval sequence. This allows theplaylist control module608 to account for different content access delays and other content processing delays. 
- FIG. 10 is a diagram of anexemplary output stream1000 generated by a retrieval sequence. The diagram shows how theplaylist control module608 selects content from one or more input queues and then transfers that content in sequence to theoutput buffer614. For example, when theplaylist control module608 observes each end of content1004a-bvia the contentobservation communication path616 as the content is transferred to theoutput buffer614, theplaylist control module608 issues a new content retrieval request to select content from a different input queue, the input queue potentially located on a different content source. It is noted that in some examples, theplaylist control module608 does not wait until the end of content to request the next content, but instead makes the request slightly before the end of the content. This advantageously accounts for delays for processing and transmission (e.g., across the switch fabric502) so that there are no gaps between two portions of content (e.g., between content (0) and content(1)). Theplaylist control module608 determines the order and amount of content placed in theoutput buffer614 by the retrieval sequence. In some examples, theplaylist control module608 can request portions of content from different content locations on the same content source, and the portions of content can share the same input queue. As a result, theplaylist control module608 does not need to switch between input queues to select content because each content request indicates what content to read and how much. In other examples, different portions of content from the same content source can be queued to different input queues of that content source so that the content can be selected by selecting the different input queues when necessary. 
- In addition to using a retrieval sequence to control both the order in which content requests are sent and the timing of content retrieval requests, the retrieval sequence may also be used to insert in-band commands into the content stream. Theplaylist control module608 may insert in-band commands, for example, to signal a downstream device that some action needs to be taken, such as inserting some number of MPEG-2 TS Null packets as indicated by the command. Similar to how content selection is performed, an in-band command may be inserted at content selection boundaries based on some indicator in the content (e.g., flags or markers).FIG. 11 is a diagram of an exemplaryretrieval sequence format1100 including in-band commands (CMD)1102a-b. For example, each time theplaylist control module608 observes a particular indicator in the selected content via thecontent observation link616, theplaylist control module608 may take an in-band command1102a-bfrom the retrieval sequence and insert the command1102a-bsequentially into theoutput buffer614. The commands1102a-bcan be inserted independently of the content requests and content retrieval requests that theplaylist control module608 also uses. 
- FIG. 12 is a diagram of anexemplary output stream1200 generated by a retrieval sequence including in-band commands. The diagram shows how theplaylist control module608 selects a portion of content1206 from an input queue, transfers thatcontent1206 in sequence to theoutput buffer614, and inserts an in-band commands1208 between the portions ofcontent1206 and1210. For example, when theplaylist control module608 observes each end of content1204a-bvia thecontent observation path616 as thecontent1206 is transferred to theoutput buffer614, theplaylist control module608 inserts an in-band command1208 into theoutput buffer614 before switching to select content1210 from a different input queue. Theplaylist control module608 determines the order and amount of content and in-band commands placed in theoutput buffer614 by the retrieval sequence. 
- Once theplaylist control module608 transfers content and in-band commands to theoutput buffer614, theoutput buffer614 processes the content for delivery to aclient device230. The processing can include transmitting the content across a communications network to aclient device230. The processing can also include execution of the inserted in-band commands, for example, to instruct a downstream device to further process the content stream before that content reaches theclient device230. 
- Generally, content switching between different devices of varying access latency can open the possibility that content may not always be available in time for theplaylist control module608 to select and transfer the content to theoutput buffer614. For example, switching from a live broadcast stream in a fast memory device (e.g., a broadcast buffer204) to content stored in a slower access technology (e.g., a storage module206) may lead to such a problem, especially if the content request cannot be made far enough in advance of needing the content. One embodiment of this problem is ad splicing applications where the advertisement may be stored on a separate storage system (e.g., an ad server) and there is the possibility that the ad content may not be available quickly enough to successfully complete a splicing operation. This is partly due to the notification that a splice point is coming is usually embedded in the live broadcast stream (e.g., using SCTE 35 Cue Messages), and there is a countdown (e.g., 4 seconds) to the actual splicing point. Thevideo delivery system200 needs to detect the splicing message in the stream, determine which ad to place in the spot, retrieve the ad from storage (e.g., storage module208), and then perform the splicing operation within the countdown time. 
- Normally, an ad splicer would have both the advertisement from storage (e.g., storage module208) and the live broadcast feed (e.g., from a broadcast buffer206) available at inputs from which the ad splicer could select content. In the case of an advertisement not being available quickly enough, the splicer would simply continue to select the live content feed without inserting the stored content. However, thevideo delivery system200 performs ad splicing on delivery by using a playlist to access the live content and the advertisement in sequence. The use of a playlist in this example can avoid needing both the live and stored sources of content in parallel at delivery, possibly doubling its input bandwidth requirement. Also, the use of a playlist in this example can reduce the output buffering requirements of the delivery module210 (e.g., by not having to store twice the content streams being delivered to client devices230). 
- In some examples, thevideo delivery system200 uses a composite playlist containing multiple playlist sequences that are selected conditionally based on a test. For example, theplaylist creation module604 generates a composite playlist that contains a first and second playlist. In the case of a missed ad, the input queue (e.g.,input queue612c) that would have contained the ad content might be empty, signaling that the first playlist should be skipped and a second playlist used instead. In some examples, the second playlist contains a conditional switch back to the live content and theplaylist control module608 selects a substitute input queue (e.g.,input queue610c) with the live content so that the subscriber watching at aclient device230 sees an uninterrupted video stream. Theplaylist control module608 may also send a content request to a content source before the time of the conditional switch, or at the time of the conditional switch, depending on the access latency of the content device. In the case of switching back to a live stream in a fast memory (e.g., broadcast buffer206), theplaylist control module608 can send the content request at the time of the condition test. If the latency is large, theplaylist control module608 may need to send a content request far enough in advance of the condition test so that the substitute content is preloaded in an input queue (e.g.,612c), thereby allowing the conditional switch to be made at theplaylist control module608 by selecting the preloaded input queue (e.g.,612c). 
- Theplaylist control module608 can make a conditional switch between two input queues based on the fullness of a queue—for example, whether the queue is empty or contains content. If theplaylist control module608 determines that a second portion of content is unavailable in the input queue associated with the second content source, then theplaylist control module608 would not select content based on the first playlist and instead select content based on the second playlist. Thevideo delivery system200 can return to selecting content from the input queue containing the first portion of content, which remains at the last position of a previous selection, or thesystem200 can select content from another input queue containing a third portion of content (e.g., a preloaded input queue) that has been made available for splicing, so that something is placed in the spot. In some examples, the conditional control flow of the content requests and the content retrieval requests may be independent of one another or coupled together. They may also be decoupled in time, such that different tests are made at different times and the control paths indicated are taken at those times. A conditional control path may be implemented on one or more playlist components, including commands that are inserted into the content stream. 
- FIG. 13 is a diagram of an exemplary conditionalcomposite playlist1300 where the requested second portion of content is available in the input queue associated with the second content source. In this example, both content requests and content retrieval requests respond to similar test conditions, such as determining whether an input queue is empty when accessed. When the requested second portion of content is available, for example, the conditional test may return a false value. In this example, the second portion of content is available, so theplaylist control module608 requests and selects content using a first playlist comprisingcontent requests1302a,1302b,1302c,1302d,1302eandcontent retrieval requests1304a,1304b,1304c,1304d, and1304e, and skips a second conditional playlist comprisingcontent requests1302f,1302g,1302handcontent retrieval requests1304f,1304g, and1304h. For example, theplaylist control module608 sendscontent requests1302aand1302bin sequence. TheJump Length808 incontent request1302bhas a value of 3, causing theplaylist control module608 to jump over the second conditional playlist since thecontent requests1302f,1302g, and1302handcontent retrieval requests1304f,1304g, and1304hcorresponding to the second playlist are the next three entries in the sequence. Theplaylist control module608 would then sendcontent request1302c,1302d, and1302e. As a result, theplaylist control module608 would select content based oncontent retrieval requests1304a,1304b,1304c,1304d, and1304ein sequence, skippingcontent retrieval requests1304f,1304g, and1304h. Likewise,content retrieval request1304aand1304bare processed by the playlist control module. Because of the skip in the content requests, the correspondingcontent retrieval requests1304f,1304g, and1304hare skipped. 
- FIG. 14 is a diagram of an exemplary conditionalcomposite playlist1400 where the requested second portion of content is not available in the input queue associated with the second content source. When the requested second portion of content is not available, for example, the conditional test may return a true value. Since the second portion of content is not available in this example, theplaylist control module608 requests and selects content using a second conditional playlist comprisingcontent requests1402f,1402g,1402handcontent retrieval requests1404f,1404g, and1404h, and skips several entries in the first playlist including1402b,1402c, and1402d, andcontent retrieval requests1404b,1404c, and1404d. In this example, the skip on empty (SoE) bitfield812 is set incontent request1402bandcontent retrieval request1404b, causing theplaylist control module608 to test the fullness of the input queue associated with thoseretrieval entries1402band1404b. When theplaylist control module608 accesses the input queue and determines that the queue does not contain the requested portion of content, theplaylist control module608 skips theretrieval entries1402band1404b. Theplaylist control module608 then moves to thenext entry1402fin sequence since the jump length is ignored in the entries that are not executed. In this example, thecontent request1402handcontent retrieval request1404hcontain a jump length of 2, causing theplaylist control module608 to jump overadditional entries1402c,1402d,1404c, and1404d. Specifically, theplaylist control module608 sendscontent requests1402a,1402f,1402g,1402h, and1402ein sequence, while themodule608 skipscontent requests1402b,1402c, and1402d. Accordingly, themodule608 selects content based oncontent retrieval requests1404a,1404f,1404g,1404h, and1404ein sequence, while themodule608 skipscontent retrieval requests1404b,1404c, and1404d. 
- The above-described systems and methods can be implemented in digital electronic circuitry, in computer hardware, firmware, and/or software. The implementation can be as a computer program product (i.e., a computer program tangibly embodied in a computer-readable storage device). The implementation can, for example, be in a machine-readable storage device for execution by, or to control the operation of, data processing apparatus. The implementation can, for example, be a programmable processor, a computer, and/or multiple computers. 
- A computer program can be written in any form of programming language, including compiled and/or interpreted languages, and the computer program can be deployed in any form, including as a stand-alone program or as a subroutine, element, and/or other unit suitable for use in a computing environment. A computer program can be deployed to be executed on one computer or on multiple computers at one site. 
- Method steps can be performed by one or more programmable processors executing a computer program to perform functions of the invention by operating on input data and generating output. Method steps can also be performed by and an apparatus can be implemented as special purpose circuitry. The circuitry can, for example, be a FPGA (field programmable gate array), an ASIC (application-specific integrated circuit), or the like. Modules refer to portions of the hardware (e.g., the processor, processor and memory, the special circuitry and the like), including the software elements (e.g., computer program), that implements that functionality. 
- Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor receives instructions and data from a read-only memory or a random access memory or both. The essential elements of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. Generally, a computer can include, can be operatively coupled to receive data from and/or transfer data to one or more computer readable storage devices for storing data (e.g., magnetic, magneto-optical disks, or optical disks). 
- Data transmission and instructions can also occur over a communications network. Information carriers suitable for embodying computer program instructions and data include computer readable storage mediums, for example all forms of non-volatile memory, including by way of example semiconductor memory devices. The computer readable storage mediums can, for example, be EPROM, EEPROM, flash memory devices, magnetic disks, internal hard disks, removable disks, magneto-optical disks, CD-ROM, and/or DVD-ROM disks. The processor and the memory can be supplemented by and/or incorporated in special purpose logic circuitry. 
- To provide for interaction with a user, the above described techniques can be implemented on a computer having a display device or a transmitting device. The display device can be, for example, a cathode ray tube (CRT) and/or a liquid crystal display (LCD) monitor. The interaction with a user can be, for example, a display of information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer (e.g., interact with a user interface element). Other kinds of devices can be used to provide for interaction with a user. Other devices can be, for example, feedback provided to the user in any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback). Input from the user can be, for example, received in any form, including acoustic, speech, and/or tactile input. 
- The computing device can include, for example, a computer, a computer with a browser device, a telephone, an IP phone, a mobile device (e.g., cellular phone, personal digital assistant (PDA) device, laptop computer, electronic mail device), a server, a rack with one or more processing cards, special purpose circuitry, and/or other communication devices. The browser device includes, for example, a computer (e.g., desktop computer, laptop computer) with a World Wide Web browser (e.g., Microsoft® Internet Explorer® available from Microsoft® Corporation, Mozilla® Firefox available from Mozilla® Corporation). The mobile computing device includes, for example, a Blackberry®. 
- The web servers can be, for example, a computer with a server module (e.g., Microsoft® Internet Information Services available from Microsoft® Corporation, Apache Web Server available from Apache Software Foundation, Apache Tomcat Web Server available from Apache Software Foundation). 
- The databases can be, for example, a computer with a server module (e.g., Microsoft® SQL Server 2008 available from Microsoft® Corporation and/or Oracle® Database 11g available from Oracle® Corporation). 
- The above described techniques can be implemented in a distributed computing system that includes a back-end component. The back-end component can, for example, be a data server, a middleware component, and/or an application server. The above described techniques can be implemented in a distributing computing system that includes a front-end component. The front-end component can, for example, be a client computer having a graphical user interface, a Web browser through which a user can interact with an example implementation, and/or other graphical user interfaces for a transmitting device. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). 
- The system can include clients and servers. A client and a server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. 
- The above described communications networks can be implemented in a packet-based network, a circuit-based network, and/or a combination of a packet-based network and a circuit-based network. Packet-based networks can include, for example, the Internet, a carrier internet protocol (IP) network (e.g., local area network (LAN), wide area network (WAN), campus area network (CAN), metropolitan area network (MAN), home area network (HAN)), a private IP network, an IP private branch exchange (IPBX), a wireless network (e.g., radio access network (RAN), 802.11 network, 802.16 network, general packet radio service (GPRS) network, HiperLAN), and/or other packet-based networks. Circuit-based networks can include, for example, the public switched telephone network (PSTN), a private branch exchange (PBX), a wireless network (e.g., RAN, Bluetooth, code-division multiple access (CDMA) network, time division multiple access (TDMA) network, global system for mobile communications (GSM) network), and/or other circuit-based networks. 
- Comprise, include, and/or plural forms of each are open ended and include the listed parts and can include additional parts that are not listed. And/or is open ended and includes one or more of the listed parts and combinations of the listed parts. 
- One skilled in the art will realize the invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The foregoing embodiments are therefore to be considered in all respects illustrative rather than limiting of the invention described herein. Scope of the invention is thus indicated by the appended claims, rather than by the foregoing description, and all changes that come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.