US20220405270A1 - Systems and methods for dynamic media asset modification - Google Patents

Abstract

The present disclosure provides systems and methods for transforming media assets using data retrieved from external sources. A system can identify a request to update one or more media assets maintained in a database of a media asset system. The system can retrieve, from a remote data system identified in the request, data corresponding to object metadata of each media asset of the one or more media assets. The system can generate, for each media asset of the one or more media assets, an updated media asset to include the data retrieved from the remote data system. The system can modify the object metadata of each of the one or more media assets based on the data. The system can update, responsive to the request, the database with each updated media asset. The updated media assets can be transmitted to client devices for display in information resources.

Description

BACKGROUND
• In a computer networked environment such as the internet, media asset publishers provide media assets for display on end-user computing devices. These media assets can be displayed on a web page associated with a respective publisher. Modifying large catalogs of content to conform to a target context is particularly challenging.
SUMMARY
• Traditional content publishing systems provide content to client devices in various presentation or serving contexts, for example, in response to requests. Often, the requested content is displayed as part of a webpage, email, or another type of information resource. In many circumstances, content publishers display requested content on information resources hosted on a publisher platform. The requested content can be one of many media assets that are stored as part of a media catalog. Traditionally, the presentation of a media asset in an information resource is performed without any modification of the media asset beyond basic formatting (e.g., minor scaling, etc.). However, many publishers prefer to modify content to conform to a context provided by the information resource on which the media assets will be presented. But, because the catalogs of content are so large, this task is often impracticable to perform for many publishers.
• The systems and methods of this technical solution solve these and other issues by providing techniques for combining data from multiple sources to transform content for presentation on an information resource. The system can monitor the catalog of media assets maintained in a media asset catalog at media source. Upon detecting a change to the media assets, the systems and methods described herein can retrieve existing media assets from a catalog hosted by a source, which may not support content transformation directly, and transform the content using data retrieved from external sources. Transforming the content can be performed by overlaying the data retrieved from the external content source and modifying the content to conform to the target serving context of the information resource.
• At least one aspect of the present disclosure is directed to a method. The method can be performed, for example, by one or more processors coupled to memory. The method can include identifying a request to update one or more media assets maintained in a database of a media asset system. The method can include retrieving, from a remote data system identified in the request, data corresponding to object metadata of each media asset of the one or more media assets. The method can include generating, for each media asset of the one or more media assets, an updated media asset to include the data retrieved from the remote data system. The method can include modifying the object metadata of each of the one or more media assets based on the data. The method can include updating, responsive to the request, the database with each updated media asset.
• In some implementations, generating the updated media asset for each media asset of the one or more media assets can include generating overlay content including at least a portion of the data. In some implementations, generating the updated media asset for each media asset of the one or more media assets can include combining the overlay content and the media asset to generate the updated media asset. In some implementations, at least one media asset of the one or more media assets is an image. In some implementations, combining the overlay content and the at least one media asset can include overlaying the image of the at least one media asset with the overlay content to generate the updated media asset.
• In some implementations, updating the database can include formatting the object metadata of the one or more media assets to conform to formatting requirements of the media asset system. In some implementations, the method can include retrieving, from the database of the media asset system, the one or more media assets and the object metadata of each of the one or more media assets. In some implementations, retrieving the one or more media assets maintained in the database of the media asset system can include retrieving a media catalog from the database maintained by the media asset system. In some implementations, retrieving the one or more media assets maintained in the database of the media asset system can include extracting, from the media catalog, the one or more media assets and the object metadata of each media asset of the one or more media assets.
• In some implementations, identifying the request to update the one or more media assets can include detecting an update to the database of the media asset system. In some implementations, updating the database with each updated media asset is responsive to detecting the update. In some implementations, identifying the request to update the one or more media assets can include receiving, from the remote data system, an indication that the data has changed. In some implementations, updating the database with each updated media asset is responsive to receiving the indication that the data has changed. In some implementations, the object metadata of each media asset of the one or more media assets can include a description of the media asset. In some implementations, modifying the object metadata can include modifying the description to include at least a portion of the data. In some implementations, the method can include generating the one or more media assets and the object metadata of each of the one or more media assets by scraping the database of the media asset system or a web page provided by a remote computing device.
• At least one other aspect of the present disclosure is directed to a system. The system can include one or more processors coupled to memory. The system can identify a request to update one or more media assets maintained in a database of a media asset system. The system can retrieve, from a remote data system identified in the request, data corresponding to object metadata of each media asset of the one or more media assets. The system can generate, for each media asset of the one or more media assets, an updated media asset to include the data retrieved from the remote data system. The system can modify the object metadata of each of the one or more media assets based on the data. The system can update, responsive to the request, the database with each updated media asset.
• In some implementations, the system can generate the updated media asset for each media asset of the one or more media assets by performing operations comprising generating overlay content including at least a portion of the data. In some implementations, the system can generate the updated media asset for each media asset of the one or more media assets by performing operations comprising combining the overlay content and the media asset to generate the updated media asset. In some implementations, at least one media asset of the one or more media assets is an image. In implementations, the system can combine the overlay content and the at least one media asset by overlaying the image of the at least one media asset with the overlay content to generate the updated media asset.
• In some implementations, the system can update the database further by performing operations comprising formatting the object metadata of the one or more media assets to conform to formatting requirements of the media asset system. In some implementations, the system can retrieve, from the database of the media asset system, the one or more media assets and the object metadata of each of the one or more media assets. In some implementations, the system can retrieve the one or more media assets maintained in the database of the media asset system by performing operations comprising retrieving a media catalog from the database maintained by the media asset system. In some implementations, the system can retrieve the one or more media assets maintained in the database of the media asset system by performing operations comprising extracting, from the media catalog, the one or more media assets and the object metadata of each media asset of the one or more media assets.
• In some implementations, the system can identify the request to update the one or more media assets by performing operations comprising detecting an update to the database of the media asset system. In some implementations, the system can update the database with each updated media asset responsive to detecting the update. In some implementations, the system can identify the request to update the one or more media assets by performing operations comprising receiving, from the remote data system, an indication that the data has changed. In some implementations, the system can update the database with each updated media asset responsive to receiving the indication that the data has changed. In some implementations, the object metadata of each media asset of the one or more media assets comprises a description of the media asset. In some implementations, the system can modify the object metadata by modifying the description to include at least a portion of the data. In some implementations, the system can generate the one or more media assets and the object metadata of each of the one or more media assets by scraping the database of the media asset system or a web page provided by a remote computing device.
• These and other aspects and implementations are discussed in detail below. The foregoing information and the following detailed description include illustrative examples of various aspects and implementations and provide an overview or framework for understanding the nature and character of the claimed aspects and implementations. The drawings provide illustration and a further understanding of the various aspects and implementations and are incorporated in and constitute a part of this specification. Aspects can be combined, and it will be readily appreciated that features described in the context of one aspect of the invention can be combined with other aspects. Aspects can be implemented in any convenient form. For example, aspects can be implemented by appropriate computer programs, which may be carried on appropriate carrier media (computer readable media), which may be tangible carrier media (e.g., disks) or intangible carrier media (e.g., communications signals). Aspects may also be implemented using suitable apparatus, which may take the form of programmable computers running computer programs arranged to implement the aspect. As used in the specification and in the claims, the singular form of ‘a,’ ‘an,’ and ‘the’ include plural referents unless the context clearly dictates otherwise.
BRIEF DESCRIPTION OF THE DRAWINGS
• The accompanying drawings are not intended to be drawn to scale. Like reference numbers and designations in the various drawings indicate like elements. For purposes of clarity, not every component may be labeled in every drawing. In the drawings:
• FIG.1A is a block diagram depicting an embodiment of a network environment comprising a client device in communication with a server device;
• FIG.1B is a block diagram depicting a cloud computing environment comprising a client device in communication with cloud service providers;
• FIGS.1C and1D are block diagrams depicting embodiments of computing devices useful in connection with the methods and systems described herein;
• FIG.2 is a block diagram of an example system for transforming content using data retrieved from external sources, in accordance with one or more implementations;
• FIG.3 depicts an image of an example modified media asset displayed in association with corresponding metadata, in accordance with one or more implementations; and
• FIG.4 illustrates an example flow diagram of a method of transforming content using data retrieved from external sources, in accordance with one or more implementations.
DETAILED DESCRIPTION
• Below are detailed descriptions of various concepts related to, and implementations of, techniques, approaches, methods, apparatuses, and systems for transforming content using data retrieved from external sources. The various concepts introduced above and discussed in greater detail below may be implemented in any of numerous ways, as the described concepts are not limited to any particular manner of implementation. Examples of specific implementations and applications are provided primarily for illustrative purposes.
• For purposes of reading the description of the various implementations below, the following descriptions of the sections of the Specification and their respective contents may be helpful:
• Section A describes a network environment and computing environment which may be useful for practicing embodiments described herein; and
• Section B describes systems and methods for transforming content using data retrieved from external sources.
A. Computing and Network Environment
• Prior to discussing specific implements of the various aspects of this technical solution, it may be helpful to describe aspects of the operating environment as well as associated system components (e.g., hardware elements) in connection with the methods and systems described herein. Referring toFIG.1A, an embodiment of a network environment is depicted. In brief overview, the network environment includes one or more clients102a-102n(also generally referred to as local machine(s)102, client(s)102, client node(s)102, client machine(s)102, client computer(s)102, client device(s)102, endpoint(s)102, or endpoint node(s)102) in communication with one or more agents103a-103nand one or more servers106a-106n(also generally referred to as server(s)106, node(s)106, or remote machine(s)106) via one ormore networks104. In some embodiments, a client102 has the capacity to function as both a client node seeking access to resources provided by a server and as a server providing access to hosted resources for other clients102a-102n.
• AlthoughFIG.1A shows anetwork104 between the clients102 and the servers106, the clients102 and the servers106 may be on thesame network104. In some embodiments, there aremultiple networks104 between the clients102 and the servers106. In one of these embodiments, anetwork104′ (not shown) may be a private network and anetwork104 may be a public network. In another of these embodiments, anetwork104 may be a private network and anetwork104′ a public network. In still another of these embodiments,networks104 and104′ may both be private networks.
• Thenetwork104 may be connected via wired or wireless links. Wired links may include Digital Subscriber Line (DSL), coaxial cable lines, or optical fiber lines. The wireless links may include BLUETOOTH, Wi-Fi, and Worldwide Interoperability for Microwave Access (WiMAX), an infrared channel or satellite band. The wireless links may also include any cellular network standards used to communicate among mobile devices, including standards that qualify as 1G, 2G, 3G, or 4G. The network standards may qualify as one or more generation of mobile telecommunication standards by fulfilling a specification or standards such as the specifications maintained by International Telecommunication Union. The 3G standards, for example, may correspond to the International Mobile Telecommunications-2000 (IMT-2000) specification, and the 4G standards may correspond to the International Mobile Telecommunications Advanced (IMT-Advanced) specification. Examples of cellular network standards include AMPS, GSM, GPRS, UMTS, LTE, LTE Advanced, Mobile WiMAX, and WiMAX-Advanced. Cellular network standards may use various channel access methods, e.g., FDMA, TDMA, CDMA, or SDMA. In some embodiments, different types of data may be transmitted via different links and standards. In other embodiments, the same types of data may be transmitted via different links and standards.
• Thenetwork104 may be any type and/or form of network. The geographical scope of thenetwork104 may vary widely, and thenetwork104 can be a body area network (BAN), a personal area network (PAN), a local-area network (LAN), e.g., Intranet, a metropolitan area network (MAN), a wide area network (WAN), or the Internet. The topology of thenetwork104 may be of any form and may include, e.g., any of the following: point-to-point, bus, star, ring, mesh, or tree. Thenetwork104 may be an overlay network which is virtual and sits on top of one or more layers ofother networks104′. Thenetwork104 may be of any such network topology as known to those ordinarily skilled in the art capable of supporting the operations described herein. Thenetwork104 may utilize different techniques and layers or stacks of protocols, including, e.g., the Ethernet protocol, the internet protocol suite (TCP/IP), the ATM (Asynchronous Transfer Mode) technique, the SONET (Synchronous Optical Networking) protocol, or the SDH (Synchronous Digital Hierarchy) protocol. The TCP/IP internet protocol suite may include application layer, transport layer, internet layer (including, e.g., IPv6), or the link layer. Thenetwork104 may be a type of a broadcast network, a telecommunications network, a data communication network, or a computer network.
• In some embodiments, the system may include multiple, logically-grouped servers106. In one of these embodiments, the logical group of servers may be referred to as a server farm38 (not shown) or a machine farm38. In another of these embodiments, the servers106 may be geographically dispersed. In other embodiments, a machine farm38 may be administered as a single entity. In still other embodiments, the machine farm38 includes a plurality of machine farms38. The servers106 within each machine farm38 can be heterogeneous—one or more of the servers106 or machines106 can operate according to one type of operating system platform (e.g., WINDOWS NT, manufactured by Microsoft Corp. of Redmond, Wash.), while one or more of the other servers106 can operate on according to another type of operating system platform (e.g., Unix, Linux, or Mac OS X).
• In one embodiment, servers106 in the machine farm38 may be stored in high-density rack systems, along with associated storage systems, and located in an enterprise data center. In this embodiment, consolidating the servers106 in this way may improve system manageability, data security, the physical security of the system, and system performance by locating servers106 and high performance storage systems on localized high performance networks. Centralizing the servers106 and storage systems and coupling them with advanced system management tools allows more efficient use of server resources.
• The servers106 of each machine farm38 do not need to be physically proximate to another server106 in the same machine farm38. Thus, the group of servers106 logically grouped as a machine farm38 may be interconnected using a wide-area network (WAN) connection or a metropolitan-area network (MAN) connection. For example, a machine farm38 may include servers106 physically located in different continents or different regions of a continent, country, state, city, campus, or room. Data transmission speeds between servers106 in the machine farm38 can be increased if the servers106 are connected using a local-area network (LAN) connection or some form of direct connection. Additionally, a heterogeneous machine farm38 may include one or more servers106 operating according to a type of operating system, while one or more other servers106 execute one or more types of hypervisors rather than operating systems. In these embodiments, hypervisors may be used to emulate virtual hardware, partition physical hardware, virtualize physical hardware, and execute virtual machines that provide access to computing environments, allowing multiple operating systems to run concurrently on a host computer. Native hypervisors may run directly on the host computer. Hypervisors may include VMware ESX/ESXi, manufactured by VMWare, Inc., of Palo Alto, Calif.; the Xen hypervisor, an open source product whose development is overseen by Citrix Systems, Inc.; the HYPER-V hypervisors provided by Microsoft or others. Hosted hypervisors may run within an operating system on a second software level. Examples of hosted hypervisors may include VMware Workstation and VIRTUALBOX.
• Management of the machine farm38 may be de-centralized. For example, one or more servers106 may comprise components, subsystems and modules to support one or more management services for the machine farm38. In one of these embodiments, one or more servers106 provide functionality for management of dynamic data, including techniques for handling failover, data replication, and increasing the robustness of the machine farm38. Each server106 may communicate with a persistent store and, in some embodiments, with a dynamic store.
• Server106 may be a file server, application server, web server, proxy server, appliance, network appliance, gateway, gateway server, virtualization server, deployment server, SSL VPN server, or firewall. In one embodiment, the server106 may be referred to as a remote machine or a node. In another embodiment, a plurality of nodes may be in the path between any two communicating servers.
• Referring toFIG.1B, a cloud computing environment is depicted. A cloud computing environment may provide client102 with one or more resources provided by a network environment. The cloud computing environment may include one or more clients102a-102n,in communication with respective agents103a-103nand with thecloud108 over one ormore networks104. Clients102 may include, e.g., thick clients, thin clients, and zero clients. A thick client may provide at least some functionality even when disconnected from thecloud108 or servers106. A thin client or a zero client may depend on the connection to thecloud108 or server106 to provide functionality. A zero client may depend on thecloud108 orother networks104 or servers106 to retrieve operating system data for the client device. Thecloud108 may include back end platforms, e.g., servers106, storage, server farms, or data centers.
• Thecloud108 may be public, private, or hybrid. Public clouds may include public servers106 that are maintained by third parties to the clients102 or the owners of the clients. The servers106 may be located off-site in remote geographical locations as disclosed above or otherwise. Public clouds may be connected to the servers106 over a public network. Private clouds may include private servers106 that are physically maintained by clients102 or owners of clients. Private clouds may be connected to the servers106 over aprivate network104.Hybrid clouds108 may include both the private andpublic networks104 and servers106.
• Thecloud108 may also include a cloud-based delivery, e.g., Software as a Service (SaaS)110, Platform as a Service (PaaS)112, and Infrastructure as a Service (IaaS)114. IaaS may refer to a user renting the use of infrastructure resources that are needed during a specified time period. IaaS providers may offer storage, networking, servers, or virtualization resources from large pools, allowing the users to quickly scale up by accessing more resources as needed. Examples of IaaS include AMAZON WEB SERVICES provided by Amazon.com, Inc., of Seattle, Washington; RACKSPACE CLOUD provided by Rackspace US, Inc., of San Antonio, Tex.; Google Compute Engine provided by Google Inc. of Mountain View, Calif.; or RIGHTSCALE provided by RightScale, Inc., of Santa Barbara, California. PaaS providers may offer functionality provided by IaaS, including, e.g., storage, networking, servers, or virtualization, as well as additional resources such as, e.g., the operating system, middleware, or runtime resources. Examples of PaaS include WINDOWS AZURE provided by Microsoft Corporation of Redmond, Wash.; Google App Engine provided by Google Inc.; and HEROKU provided by Heroku, Inc., of San Francisco, Calif. SaaS providers may offer the resources that PaaS provides, including storage, networking, servers, virtualization, operating system, middleware, or runtime resources. In some embodiments, SaaS providers may offer additional resources including, e.g., data and application resources. Examples of SaaS include GOOGLE APPS provided by Google Inc.; SALESFORCE provided by Salesforce.com Inc. of San Francisco, California; or OFFICE 365 provided by Microsoft Corporation. Examples of SaaS may also include data storage providers, e.g., DROPBOX provided by Dropbox, Inc., of San Francisco, California; Microsoft SKYDRIVE provided by Microsoft Corporation; Google Drive provided by Google Inc.; or Apple ICLOUD provided by Apple Inc. of Cupertino, Calif.
• Clients102 may access IaaS resources with one or more IaaS standards, including, e.g., Amazon Elastic Compute Cloud (EC2), Open Cloud Computing Interface (OCCI), Cloud Infrastructure Management Interface (CIMI), or OpenStack standards. Some IaaS standards may allow clients access to resources over HTTP, and may use Representational State Transfer (REST) protocol or Simple Object Access Protocol (SOAP). Clients102 may access PaaS resources with different PaaS interfaces. Some PaaS interfaces use HTTP packages, standard Java APIs, JavaMail API, Java Data Objects (JDO), Java Persistence API (JPA), Python APIs, web integration APIs for different programming languages including, e.g., Rack for Ruby, WSGI for Python, or PSGI for Perl, or other APIs that may be built on REST, HTTP, XML, or other protocols. Clients102 may access SaaS resources through the use of web-based user interfaces, provided by a web browser (e.g., GOOGLE CHROME, Microsoft INTERNET EXPLORER, or Mozilla Firefox provided by Mozilla Foundation of Mountain View, Calif.). Clients102 may also access SaaS resources through smartphone or tablet applications, including, e.g., Salesforce Sales Cloud, or Google Drive app. Clients102 may also access SaaS resources through the client operating system, including, e.g., Windows file system for DROPBOX.
• In some embodiments, access to IaaS, PaaS, or SaaS resources may be authenticated. For example, a server or authentication server may authenticate a user via security certificates, HTTPS, or API keys. API keys may include various encryption standards such as, e.g., Advanced Encryption Standard (AES). Data resources may be sent over Transport Layer Security (TLS) or Secure Sockets Layer (SSL).
• The client102 and server106 may be deployed as and/or executed on any type and form of computing device, e.g., a computer, network device, or appliance capable of communicating on any type and form of network and performing the operations described herein.FIGS.1C and1D depict block diagrams of acomputing device100 useful for practicing an embodiment of the client102 or a server106. As shown inFIGS.1C and1D, eachcomputing device100 includes acentral processing unit121, and amain memory unit122. As shown inFIG.1C, acomputing device100 may include astorage device128, aninstallation device116, anetwork interface118, an I/O controller123, display devices124a-124n,akeyboard126 and apointing device127, e.g., a mouse. Thestorage device128 may include, without limitation, an operating system, software, andmedia processing platform120, which can implement any of the features of themedia processing system205 described herein below in conjunction withFIG.2. As shown inFIG.1D, eachcomputing device100 may also include additional optional elements, e.g., amemory port132, abridge170, one or more input/output devices130a-130n(generally referred to using reference numeral130), and acache memory140 in communication with thecentral processing unit121.
• Thecentral processing unit121 is any logic circuitry that responds to and processes instructions fetched from themain memory unit122. In many embodiments, thecentral processing unit121 is provided by a microprocessor unit, e.g., those manufactured by Intel Corporation of Mountain View, Calif.; those manufactured by Motorola Corporation of Schaumburg, Ill.; the ARM processor and TEGRA system on a chip (SoC) manufactured by Nvidia of Santa Clara, California; the POWER7 processor manufactured by International Business Machines of White Plains, N.Y.; or those manufactured by Advanced Micro Devices of Sunnyvale, Calif. Thecomputing device100 may be based on any of these processors, or any other processor capable of operating as described herein. Thecentral processing unit121 may utilize instruction level parallelism, thread level parallelism, different levels of cache, and multi-core processors. A multi-core processor may include two or more processing units on a single computing component. Examples of a multi-core processors include the AMD PHENOM IIX2, INTEL CORE i5, INTEL CORE i7, and INTEL CORE i9.
• Main memory unit122 may include one or more memory chips capable of storing data and allowing any storage location to be directly accessed by themicroprocessor121.Main memory unit122 may be volatile and faster thanstorage128 memory.Main memory units122 may be Dynamic random access memory (DRAM) or any variants, including static random access memory (SRAM), Burst SRAM or SynchBurst SRAM (BSRAM), Fast Page Mode DRAM (FPM DRAM), Enhanced DRAM (EDRAM), Extended Data Output RAM (EDO RAM), Extended Data Output DRAM (EDO DRAM), Burst Extended Data Output DRAM (BEDO DRAM), Single Data Rate Synchronous DRAM (SDR SDRAM), Double Data Rate SDRAM (DDR SDRAM), Direct Rambus DRAM (DRDRAM), or Extreme Data Rate DRAM (XDR DRAM). In some embodiments, themain memory122 or thestorage128 may be non-volatile, e.g., non-volatile read access memory (NVRAM), flash memory non-volatile static RAM (nvSRAM), Ferroelectric RAM (FeRAM), Magnetoresistive RAM (MRAM), Phase-change memory (PRAM), conductive-bridging RAM (CBRAM), Silicon-Oxide-Nitride-Oxide-Silicon (SONOS), Resistive RAM (RRAM), Racetrack, Nano-RAM (NRAM), or Millipede memory. Themain memory122 may be based on any of the above described memory chips, or any other available memory chips capable of operating as described herein. In the embodiment shown inFIG.1C, theprocessor121 communicates withmain memory122 via a system bus (described in more detail below).FIG.1D depicts an embodiment of acomputing device100 in which the processor communicates directly withmain memory122 via amemory port132. For example, inFIG.1D themain memory122 may be DRDRAM.
• FIG.1D depicts an embodiment in which themain processor121 communicates directly withcache memory140 via a secondary bus, sometimes referred to as a backside bus. In other embodiments, themain processor121 communicates withcache memory140 using thesystem bus150.Cache memory140 typically has a faster response time thanmain memory122 and is typically provided by SRAM, BSRAM, or EDRAM. In the embodiment shown inFIG.1D, theprocessor121 communicates with various I/O devices130 via alocal system bus150. Various buses may be used to connect thecentral processing unit121 to any of the I/O devices130, including a PCI bus, a PCI-X bus, or a PCI-Express bus, or a NuBus. For embodiments in which the I/O device is a video display124, theprocessor121 may use an Advanced Graphics Port (AGP) to communicate with the display124 or the I/O controller123 for the display124.FIG.1D depicts an embodiment of acomputer100 in which themain processor121 communicates directly with I/O device130borother processors121′ via HYPERTRANSPORT, RAPIDIO, or INFINIBAND communications technology.FIG.1D also depicts an embodiment in which local busses and direct communication are mixed; theprocessor121 communicates with I/O device130ausing a local interconnect bus while communicating with I/O device130b directly.
• A wide variety of I/O devices130a-130nmay be present in thecomputing device100. Input devices may include keyboards, mice, trackpads, trackballs, touchpads, touch mice, multi-touch touchpads and touch mice, microphones, multi-array microphones, drawing tablets, cameras, single-lens reflex camera (SLR), digital SLR (DSLR), CMOS sensors, accelerometers, infrared optical sensors, pressure sensors, magnetometer sensors, angular rate sensors, depth sensors, proximity sensors, ambient light sensors, gyroscopic sensors, or other sensors. Output devices may include video displays, graphical displays, speakers, headphones, inkjet printers, laser printers, and 3D printers.
• Devices130a-130nmay include a combination of multiple input or output devices, including, e.g., Microsoft KINECT, Nintendo Wiimote for the WII, Nintendo WII U GAMEPAD, or Apple IPHONE. Some devices130a-130nallow gesture recognition inputs through combining some of the inputs and outputs. Some devices130a-130nprovides for facial recognition which may be utilized as an input for different purposes including authentication and other commands. Some devices130a-130nprovides for voice recognition and inputs, including, e.g., Microsoft KINECT, SIRI for IPHONE by Apple, Google Now or Google Voice Search.
• Additional devices130a-130nhave both input and output capabilities, including, e.g., haptic feedback devices, touchscreen displays, or multi-touch displays. Touchscreen, multi-touch displays, touchpads, touch mice, or other touch sensing devices may use different technologies to sense touch, including, e.g., capacitive, surface capacitive, projected capacitive touch (PCT), in-cell capacitive, resistive, infrared, waveguide, dispersive signal touch (DST), in-cell optical, surface acoustic wave (SAW), bending wave touch (BWT), or force-based sensing technologies. Some multi-touch devices may allow two or more contact points with the surface, allowing advanced functionality including, e.g., pinch, spread, rotate, scroll, or other gestures. Some touchscreen devices, including, e.g., Microsoft PIXELSENSE or Multi-Touch Collaboration Wall, may have larger surfaces, such as on a table-top or on a wall, and may also interact with other electronic devices. Some I/O devices130a-130n, display devices124a-124n,or group of devices may be augmented reality devices. The I/O devices may be controlled by an I/O controller123 as shown inFIG.1C. The I/O controller may control one or more I/O devices, such as, e.g., akeyboard126 and apointing device127, e.g., a mouse or optical pen. Furthermore, an I/O device may also provide storage and/or aninstallation medium116 for thecomputing device100. In still other embodiments, thecomputing device100 may provide USB connections (not shown) to receive handheld USB storage devices. In further embodiments, an I/O device130 may be a bridge between thesystem bus150 and an external communication bus, e.g., a USB bus, a SCSI bus, a FireWire bus, an Ethernet bus, a Gigabit Ethernet bus, a Fibre Channel bus, or a Thunderbolt bus.
• In some embodiments, display devices124a-124nmay be connected to I/O controller123. Display devices may include, e.g., liquid crystal displays (LCD), thin film transistor LCD (TFT-LCD), blue phase LCD, electronic papers (e-ink) displays, flexible displays, light emitting diode displays (LED), digital light processing (DLP) displays, liquid crystal on silicon (LCOS) displays, organic light-emitting diode (OLED) displays, active-matrix organic light-emitting diode (AMOLED) displays, liquid crystal laser displays, time-multiplexed optical shutter (TMOS) displays, or 3D displays. Examples of 3D displays may use, e.g., stereoscopy, polarization filters, active shutters, or autostereoscopic techniques. Display devices124a-124nmay also include a head-mounted display (HMD). In some embodiments, display devices124a-124nor the corresponding I/O controllers123 may be controlled through or have hardware support for OPENGL or DIRECTX API or other graphics libraries.
• In some embodiments, thecomputing device100 may include or connect to multiple display devices124a-124n, which each may be of the same or different type and/or form. As such, any of the I/O devices130a-130nand/or the I/O controller123 may include any type and/or form of suitable hardware, software, or combination of hardware and software to support, enable, or provide for the connection and use of multiple display devices124a-124nby thecomputing device100. For example, thecomputing device100 may include any type and/or form of video adapter, video card, driver, and/or library to interface, communicate, connect, or otherwise use the display devices124a-124n.In one embodiment, a video adapter may include multiple connectors to interface to multiple display devices124a-124n.In other embodiments, thecomputing device100 may include multiple video adapters, with each video adapter connected to one or more of the display devices124a-124n.In some embodiments, any portion of the operating system of thecomputing device100 may be configured for using multiple displays124a-124n.In other embodiments, one or more of the display devices124a-124nmay be provided by one or more other computing devices100aor100bconnected to thecomputing device100, via thenetwork104. In some embodiments software may be designed and constructed to use another computer's display device as asecond display device124afor thecomputing device100. For example, in one embodiment, an Apple iPad may connect to acomputing device100 and use the display of thedevice100 as an additional display screen that may be used as an extended desktop. One ordinarily skilled in the art will recognize and appreciate the various ways and embodiments that acomputing device100 may be configured to have multiple display devices124a-124n.
• Referring again toFIG.1C, thecomputing device100 may comprise a storage device128 (e.g., one or more hard disk drives or redundant arrays of independent disks) for storing an operating system or other related software, and for storing application software programs such as any program related to themedia processing platform120. Examples ofstorage device128 include, e.g., hard disk drive (HDD); optical drive including CD drive, DVD drive, or BLU-RAY drive; solid-state drive (SSD); USB flash drive; or any other device suitable for storing data. Some storage devices may include multiple volatile and non-volatile memories, including, e.g., solid state hybrid drives that combine hard disks with solid state cache. Somestorage devices128 may be non-volatile, mutable, or read-only. Somestorage devices128 may be internal and connect to thecomputing device100 via abus150. Somestorage devices128 may be external and connect to thecomputing device100 via an I/O device130 that provides an external bus. Somestorage devices128 may connect to thecomputing device100 via thenetwork interface118 over anetwork104, including, e.g., the Remote Disk for MACBOOK AIR by Apple. Someclient devices100 may not require anon-volatile storage device128 and may be thin clients or zero clients102. Somestorage devices128 may also be used as aninstallation device116, and may be suitable for installing software and programs. Additionally, the operating system and the software can be run from a bootable medium, for example, a bootable CD, e.g., KNOPPIX, a bootable CD for GNU/Linux that is available as a GNU/Linux distribution from knoppix.net.
• Client device100 may also install software or application from an application distribution platform. Examples of application distribution platforms include the App Store for iOS provided by Apple, Inc.; the Mac App Store provided by Apple, Inc.; GOOGLE PLAY for Android OS provided by Google Inc.; Chrome Webstore for CHROME OS provided by Google Inc.; and Amazon Appstore for Android OS and KINDLE FIRE provided by Amazon.com, Inc. An application distribution platform may facilitate installation of software on a client device102. An application distribution platform may include a repository of applications on a server106 or acloud108, which the clients102a-102nmay access over anetwork104. An application distribution platform may include application developed and provided by various developers. A user of a client device102 may select, purchase, and/or download an application via the application distribution platform.
• Furthermore, thecomputing device100 may include anetwork interface118 to interface to thenetwork104 through a variety of connections including, but not limited to, standard telephone lines LAN or WAN links (e.g., 802.11, T1, T3, Gigabit Ethernet, Infiniband), broadband connections (e.g., ISDN, Frame Relay, ATM, Gigabit Ethernet, Ethernet-over-SONET, ADSL, VDSL, BPON, GPON, fiber optical including FiOS), wireless connections, or some combination of any or all of the above. Connections can be established using a variety of communication protocols (e.g., TCP/IP, Ethernet, ARCNET, SONET, SDH, Fiber Distributed Data Interface (FDDI), IEEE 802.11a/b/g/n/ac CDMA, GSM, WiMax and direct asynchronous connections). In one embodiment, thecomputing device100 communicates withother computing devices100′ via any type and/or form of gateway or tunneling protocol, e.g., Secure Socket Layer (SSL) or Transport Layer Security (TLS), or the Citrix Gateway Protocol manufactured by Citrix Systems, Inc. of Ft. Lauderdale, Fla. Thenetwork interface118 may comprise a built-in network adapter, network interface card, PCMCIA network card, EXPRESSCARD network card, card bus network adapter, wireless network adapter, USB network adapter, modem, or any other device suitable for interfacing thecomputing device100 to any type of network capable of communication and performing the operations described herein.
• Acomputing device100 of the sort depicted inFIGS.1C and1D may operate under the control of an operating system, which controls scheduling of tasks and access to system resources. Thecomputing device100 can be running any operating system such as any of the versions of the MICROSOFT WINDOWS operating systems, the different releases of the Unix and Linux operating systems, any version of the MAC OS for Macintosh computers, any embedded operating system, any real-time operating system, any open source operating system, any proprietary operating system, any operating systems for mobile computing devices, or any other operating system capable of running on the computing device and performing the operations described herein. Typical operating systems include, but are not limited to, WINDOWS 2000, WINDOWS Server 2012, WINDOWS CE, WINDOWS Phone, WINDOWS XP, WINDOWS VISTA, and WINDOWS 7, WINDOWS RT, and WINDOWS 8 all of which are manufactured by Microsoft Corporation of Redmond, Wash.; MAC OS and iOS, manufactured by Apple, Inc. of Cupertino, Calif.; Linux, a freely-available operating system, e.g., Linux Mint distribution (“distro”) or Ubuntu, distributed by Canonical Ltd. of London, United Kingdom; Unix or other Unix-like derivative operating systems; and Android, designed by Google, of Mountain View, Calif., among others. Some operating systems, including, e.g., the CHROME OS by Google, may be used on zero clients or thin clients, including, e.g., CHROMEBOOKS.
• Thecomputer system100 can be any workstation, telephone, desktop computer, laptop or notebook computer, netbook, ULTRABOOK, tablet, server, handheld computer, mobile telephone, smartphone or other portable telecommunications device, media playing device, a gaming system, mobile computing device, or any other type and/or form of computing, telecommunications, or media device that is capable of communication. Thecomputer system100 has sufficient processor power and memory capacity to perform the operations described herein. In some embodiments, thecomputing device100 may have different processors, operating systems, and input devices consistent with the device. The Samsung GALAXY smartphones, e.g., operate under the control of Android operating system developed by Google, Inc. GALAXY smartphones receive input via a touch interface.
• In some embodiments, thecomputing device100 is a digital audio player such as the Apple IPOD, IPOD Touch, and IPOD NANO lines of devices, manufactured by Apple Computer of Cupertino, Calif. Some digital audio players may have other functionality, including, e.g., a gaming system or any functionality made available by an application from a digital application distribution platform. For example, the IPOD Touch may access the Apple App Store. In some embodiments, thecomputing device100 is a portable media player or digital audio player supporting file formats including, but not limited to, MP3, WAV, M4A/AAC, WMA Protected AAC, AIFF, Audible audiobook, Apple Lossless audio file formats and .mov, .m4v, and .mp4 MPEG-4 (H.264/MPEG-4 AVC) video file formats.
• In some embodiments, thecomputing device100 is a tablet, e.g., the IPAD line of devices by Apple; GALAXY TAB family of devices by Samsung; or KINDLE FIRE, by Amazon.com, Inc., of Seattle, Wash. In other embodiments, thecomputing device100 is an eBook reader, e.g., the KINDLE family of devices by Amazon.com, or NOOK family of devices by Barnes & Noble, Inc., of New York City, New York.
• In some embodiments, the communications device102 includes a combination of devices, e.g., a smartphone combined with a digital audio player or portable media player. For example, one of these embodiments is a smartphone, e.g., the IPHONE family of smartphones manufactured by Apple, Inc.; the Samsung GALAXY family of smartphones manufactured by Samsung, Inc.; or the Motorola DROID family of smartphones. In yet another embodiment, the communications device102 is a laptop or desktop computer equipped with a web browser and a microphone and speaker system, e.g., a telephony headset. In these embodiments, the communications devices102 are web-enabled and can receive and initiate phone calls. In some embodiments, a laptop or desktop computer is also equipped with a webcam or other video capture device that enables video chat and video call.
• In some embodiments, the status of one or more machines102,106 in thenetwork104 is monitored, generally as part of network management. In one of these embodiments, the status of a machine may include an identification of load information (e.g., the number of processes on the machine, CPU and memory utilization), of port information (e.g., the number of available communication ports and the port addresses), or of session status (e.g., the duration and type of processes, and whether a process is active or idle). In another of these embodiments, this information may be identified by a plurality of metrics, and the plurality of metrics can be applied at least in part towards decisions in load distribution, network traffic management, and network failure recovery as well as any aspects of operations of the present solution described herein. Aspects of the operating environments and components described above will become apparent in the context of the systems and methods disclosed herein.
• B. Transforming Content Using Data Retrieved from External Sources
• Publishers, such as the provider of a website of email service, present content from a content source as a part of information resources provided to client devices. Information resources can include, for example, web pages, articles, email messages, or other types of electronic transmissions that can include media assets. Although publishers can provide some selection criteria that control which media assets are presented on the information resources the publishers provide, the publishers often do not have the resources or ability to directly modify media assets using automatic processes.
• In many cases, a publisher may maintain a catalog of media assets using a media asset server, which is periodically updated when a publisher, or another content source, modifies the catalog. Although some publishers may use rudimentary automatic formatting techniques (e.g., basic scaling, etc.), publishers typically cannot modify content automatically for every item of content in the content catalog to conform to targets serving contexts. For example, it is challenging for publishers to automatically modify and format catalogs of media assets for particular network bandwidth requirements. In addition, if a publisher's serving context indicates that additional information should be provided in connection with a particular media asset, an additional request must be made by the publisher's information resource each time the particular media asset is served. Making such requests can exhaust network bandwidth and network computing resources when the requests occur across large numbers of client devices.
• The systems and methods of this technical solution solve these and other issues by providing techniques for accessing, transforming, and updating catalogs of media assets in accordance with various serving contexts. In doing so, the systems and methods described herein can generate transformed media assets that include additional information from external sources for target serving contexts. Because each media asset is transformed to include the additional information, a client device is no longer required to make a separate request for the additional information at the external source, which greatly reduces the utilization of network computing resources. In addition, the systems and methods described herein can transform catalogs of media assets in accordance with various bandwidth requirements, further reducing the overall network resource utilization when providing the media assets to many client devices.
• The systems and methods described herein can retrieve a catalog of media assets from a media asset server that is associated with a content publisher. The catalog can be generated, for example, as an extensible markup language (XML) or comma-separated values (CSV) file that includes information about each media asset in the catalog. In some implementations, the catalog can be formatted as a spreadsheet, or generated via a web scraping process to gather the appropriate media asset information. The systems and methods described herein can execute application programming interface (API) calls to the media asset server to retrieve the catalog for modification.
• Then, using additional API calls to a remote computing device or remote database, the systems and methods described herein can retrieve additional metadata or other information associated with each media asset identified in the catalog data. The API calls can be used, for example, to perform a key-value lookup procedure at the database or remote computing device. Any type of data related to the media asset can be retrieved, including a description of the media asset, a title of the media asset, payment information associated with the media asset (e.g., payment installment information, interest rate information, price information, etc.), category information related to the media asset, user-specific information that corresponds to the media asset (e.g., information from one or more user profiles used to access the respective publisher, etc.), or any other media asset data or metadata. In some implementations, the data can include predetermined text strings used in target serving contexts that are related to the publisher or the media asset.
• The data retrieved using the API calls can be combined with the media assets in the catalog to generate transformed media assets. Any aspect of the media asset can be transformed or modified in accordance with the retrieved data and one or more formatting rules, including, for example, text, images, audio, or video, among others. In addition, metadata associated with the media asset, such as descriptive data, can be modified in addition to the media content, including titles, descriptions, tags, labels, or categories, among others. Visual portions of the media assets can be transformed by the systems and methods described herein, for example, by generating overlays containing portions of the retrieved additional data. These overlays can be combined with the original media asset to generate an updated media asset including both the overlay and the original media asset.
• This process can be repeated for each media asset in the catalog, or each media asset that is requested to be updated (e.g., by a publisher device, etc.) The transformed set of media items can then be formatted into the required formats of the content server from which the media assets were retrieved. For example, the systems and methods described herein can update the transformed catalog of media assets to be in an XML or CSV format. The systems and methods can synchronize updates to the transformed media content, such that an update by the a publisher or another computing device to the media asset catalog, or an update by the remote computing system to the additional data, can trigger the systems and methods described herein to update the transformed media assets using the new data.
• The catalog of media content can be generated using various different processes. For example, in some implementations, the catalog of media assets can be provided by a media asset server as a file or series of files. In some implementations, the catalog of media assets can be generated using one or more API calls to the media asset server. The one or more API calls are used to perform the function of reading or writing to the media asset server attributes, and formatting those attributes into the catalog of media assets required by the publisher. In some implementations, the catalog of media assets can be retrieved directly from an external data platform, for example, if the external media platform has a connection (e.g., an API call or other access procedure, etc.) to the media asset server.
• Thus, the systems and methods described herein can automatically detect changes to, and transform, catalogs of media assets for presentation by publisher devices. The techniques described herein can allow the media assets to be transformed to include additional data for target serving contexts, which removes the requirement for additional requests to be transmitted by client devices, thereby improving overall network performance. Accordingly, the systems and methods described herein provide a technical improvement to content publishing systems by quantity of network requests when providing media assets to many client devices. An example system that implements these and other techniques is described in connection withFIG.2.
• Referring now toFIG.2, illustrated is a block diagram of anexample system200 for transforming content using data retrieved from external sources, in accordance with one or more implementations. Thesystem200 can include at least onemedia processing system205, at least onenetwork210, one ormore client devices220A-220N (sometimes generally referred to as client device(s)220), at least onemedia asset server260, at least oneremote computing system280, and at least oneexternal asset source285. Themedia processing system205 can include at least oneprocessing circuit206, which can include at least oneprocessor207, at least onerequest identifier230, at least onedata retriever235, a least onemedia asset generator240, at least one object metadata modifier245, and at least onedatabase updater250. The media asset server can include at least onedatabase215, which can maintain acatalog265 storing one or more media asset(s)270 and one or more transformed asset(s)275. In some implementations, thedatabase215 can be external to themedia asset server260, for example, as a part of a cloud computing system or an external computing device in communication with the devices (e.g., themedia processing system205, the client devices220, themedia asset server260, etc.) of thesystem200 via thenetwork210.
• Each of the components (e.g., themedia processing system205, thenetwork210, the client devices220, themedia asset server260, theremote computing system280, theexternal asset source285, therequest identifier230, thedata retriever235, a least onemedia asset generator240, the object metadata modifier245, thedatabase updater250, thedatabase215, etc.) of thesystem200 can be implemented using the hardware components or a combination of software with the hardware components of a computing system, such as thecomputing system100 detailed herein in conjunction withFIGS.1A-1D, or any other computing system described herein. Each of the components of themedia processing system205 can perform any of the functionalities detailed herein.
• Themedia processing system205 can include at least oneprocessor207 and a memory, (e.g., a processing circuit206). The memory can store processor-executable instructions that, when executed by processor, cause the processor to perform one or more of the operations described herein. Theprocessor207 may include a microprocessor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), etc., or combinations thereof. The memory may include, but is not limited to, electronic, optical, magnetic, or any other storage or transmission device capable of providing the processor with program instructions. The memory may further include a floppy disk, CD-ROM, DVD, magnetic disk, memory chip, ASIC, FPGA, read-only memory (ROM), random-access memory (RAM), electrically erasable programmable ROM (EEPROM), erasable programmable ROM (EPROM), flash memory, optical media, or any other suitable memory from which the processor can read instructions. The instructions may include code from any suitable computer programming language. Themedia processing system205 can include one or more computing devices or servers that can perform various functions as described herein. Themedia processing system205 can include any or all of the components and perform any or all of the functions of thecomputer system100 described herein in conjunction withFIGS.1A-1D.
• Thenetwork210 can include computer networks such as the Internet, local, wide, metro or other area networks, intranets, satellite networks, other computer networks such as voice or data mobile phone communication networks, or any combinations thereof. Themedia processing system205 of thesystem200 can communicate via thenetwork210, for example, with one or more client devices220, themedia asset server260, theremote computing system280, or theexternal asset source285. Thenetwork210 may be any form of computer network that can relay information between themedia processing system205, the one or more client devices220, themedia asset server260, theremote computing system280, theexternal asset source285, and one or more information sources, such as web servers or external databases, amongst others. In some implementations, thenetwork210 may include the Internet and/or other types of data networks, such as a local area network (LAN), a wide area network (WAN), a cellular network, a satellite network, or other types of data networks. Thenetwork210 may also include any number of computing devices (e.g., computers, servers, routers, network switches, etc.) that are configured to receive and/or transmit data within thenetwork210. Thenetwork210 may further include any number of hardwired and/or wireless connections. Any or all of the computing devices described herein (e.g., themedia processing system205, the one or more client devices220, themedia asset server260, theremote computing system280, theexternal asset source285, etc.) may communicate wirelessly (e.g., via Wi-Fi, cellular, radio, etc.) with a transceiver that is hardwired (e.g., via a fiber optic cable, a CATS cable, etc.) to other computing devices in thenetwork210. Any or all of the computing devices described herein (e.g., themedia processing system205, the one or more client devices220, themedia asset server260, theremote computing system280, theexternal asset source285, etc.) may also communicate wirelessly with the computing devices of thenetwork210 via a proxy device (e.g., a router, network switch, or gateway). In some implementations, thenetwork210 can be similar to or can include thenetwork104 or thecloud108 described herein above in conjunction withFIGS.1A and1B.
• Each of the client devices220 can include at least one processor and a memory, e.g., a processing circuit. The memory can store processor-executable instructions that, when executed by processor, cause the processor to perform one or more of the operations described herein. The processor can include a microprocessor, an ASIC, an FPGA, etc., or combinations thereof. The memory can include, but is not limited to, electronic, optical, magnetic, or any other storage or transmission device capable of providing the processor with program instructions. The memory can further include a floppy disk, CD-ROM, DVD, magnetic disk, memory chip, ASIC, FPGA, ROM, RAM, EEPROM, EPROM, flash memory, optical media, or any other suitable memory from which the processor can read instructions. The instructions can include code from any suitable computer programming language. The client devices220 can include one or more computing devices or servers that can perform various functions as described herein. The one or more client devices220 can include any or all of the components and perform any or all of the functions of thecomputer system100 described herein in conjunction withFIGS.1A-1D. The client devices220 can be, or can be similar to, the client devices102 described herein above in conjunction withFIGS.1A-1D.
• Each client device220 can include, but is not limited to, a television device, a mobile device, smart phone, personal computer, a laptop, a gaming device, a kiosk, or any other type of computing device. Each client device220 can be implemented using hardware or a combination of software and hardware. Each client device220 can include a display device that can provide visual information, such as information presented as a result of executing instructions stored in the memory of the client device220. The display device can include an liquid-crystal display (LCD) device, an organic light-emitting diode (OLED) display, a light-emitting diode (LED) display, a bi-stable display (e.g., e-ink, etc.), amongst others. The display device can present one or more user interfaces on various regions of the display in accordance with the implementations described herein. In some implementations, the display device can include interactive elements, such as a capacitive or resistive touch sensors. Thus, the display device can be an interactive display (e.g., a touchscreen, a display, etc.), and can include one or more input/output (I/O) devices or interfaces. Each client device220 can further include or be in communication with (e.g., via a communications bus coupled to the processors of the client devices220, etc.) one or more input devices, such as a mouse, a keyboard, or digital key pad, among others.
• The display can be used to present one or more applications as described herein, such as web browsers or native applications. The display can include a border region (e.g., side border, top border, bottom border). The inputs received via the input/output devices (e.g., touchscreen, mouse, keyboard, etc.) can be detected by one or more event listeners, and indicate interactions with one or more user interface elements presented on the display device of the client devices220. The interactions can result in interaction data, which can be stored and transmitted by the processing circuitry of the client device220 to other computing devices, such as those in communication with the client devices220. The interaction data can include, for example, interaction coordinates, an interaction type (e.g., click, swipe, scroll, tap, etc.), and an indication of an actionable object with which the interaction occurred. Thus, each client device220 can enable a user to interact with and/or select one or more actionable objects presented as part of graphical user interfaces to carry out various functionalities as described herein.
• The client devices220 can each execute one or more client applications, which can include a web browser or native application that presents information resources, which can be presented by one or more publisher computing devices (not pictured). As described herein, the information resources may cause a client device220 to transmit a request to the media asset server to present one or more of themedia assets270 or the transformedassets275 stored in thecatalog265. The one or more client applications can cause the display device of one or more client devices220 to present a user interface that includes the information resource, and one or more of themedia assets270 or transformedassets275 requested by the client device220 (e.g., based on a script included in the information resource, etc.). The application can be a web application or web page (e.g., provided by a publisher device via thenetwork210, etc.), a native application, an operating system resource, or some other form of executable instructions. In some implementations, the client application can include a local application (e.g., local to a client device220), hosted application, Software as a Service (SaaS) application, virtual application, mobile application, and other forms of content. In some implementations, the web page displayed on the client device can be presented as part of a web page that presents one ormore media assets270, such as a media provider website or website for an electronic store. In some implementations, the web page can cause (e.g., via one or more scripts, markup language, or computer-readable instructions, etc.) the client device220 to generate a user interface that displays one or more of themedia assets270 or the transformedmedia assets275. In some implementations, the user interface can include one or more actionable objects that correspond to links, buttons, or other user-selectable objects that allow the user to navigate the website, web application, or native application. In some implementations, the application can be an email application, and themedia assets270 or the transformedassets275 can be displayed in one or more emails received from a publisher device.
• Each of the client devices220 can be computing devices configured to communicate via thenetwork210 to access the information resources, such as web pages via a web browser, emails via an email client, or application resources via a native application executing on a client device220. When accessing the information resources, the client device220 can execute instructions (e.g., embedded in the native applications, or a script in theinformation resources280, etc.) that cause the client devices to display content, which can include text, images, video, audio, or other types ofmedia assets270. As described herein, the client device220 can transmit one or more requests for media assets to themedia asset server260, and can receive one or more responses that include the requested content. A request for amedia asset270 can include, for example, a request for an identifiedmedia asset270 and information about the client device220 (e.g., device information, user profile information, a user identifier, etc.).
• Themedia asset server260 can include at least one processor and a memory, e.g., a processing circuit. The memory can store processor-executable instructions that, when executed by processor, cause the processor to perform one or more of the operations described herein. The processor can include a microprocessor, an ASIC, an FPGA, etc., or combinations thereof. The memory can include, but is not limited to, electronic, optical, magnetic, or any other storage or transmission device capable of providing the processor with program instructions. The memory can further include a floppy disk, CD-ROM, DVD, magnetic disk, memory chip, ASIC, FPGA, ROM, RAM, EEPROM, EPROM, flash memory, optical media, or any other suitable memory from which the processor can read instructions. The instructions can include code from any suitable computer programming language. Themedia asset server260 can include one or more computing devices or servers that can perform various functions as described herein. In some implementations, themedia asset server260 can be a cloud computing resource, such as thecloud108 described in connection withFIG.1B. Themedia asset server260 can include any or all of the components and perform any or all of the functions of thecomputer system100 described herein in conjunction withFIGS.1A-1D.
• Themedia asset server260 can be a server, or group of distributed computing devices, which includes adatabase215 that stores acatalog265 ofmedia assets270 and transformedmedia assets275. Themedia asset server260 can transmit one ormore media assets270, or transformedmedia assets275, in response to request received from computing devices via thenetwork210. In some implementations, the requests for content can identify the requestedmedia asset270 or the requested transformedmedia asset275. In some implementations, in response to receiving a request, themedia asset server260 can select amedia asset270 or a transformedmedia asset275 based on the content of the request. For example, themedia asset server260 can select amedia asset270 if the request indicates a request for one of themedia assets270. In another example, if the request indicates a request for one of the transformedassets275, themedia asset server260 can select a transformedasset275 in response to the request.
• In some implementations, themedia asset server260 can select amedia asset270 or a transformedasset275 based on a similarity between themedia asset270 or the transformedasset275 and a client device profile of a client device220 that transmitted the request. In some implementations, themedia asset server260 can select amedia asset270 or a transformedasset275 based on a target serving context (e.g., client device220 information, information resource content displayed at the requesting client device220, client device profile information, etc.). In some implementations, the request for amedia asset270 or a transformedasset275 can be transmitted by a publisher device (not pictured). In response, themedia asset server260 can transmit themedia asset270 or the transformedasset275 to the publisher device via thenetwork210. Thepublisher device260 can then incorporate (e.g., include, merge, combine, etc.) themedia asset270 or the transformedasset275 into one or more information resources of the publisher device, such as a webpage or an email, which can be transmitted to one or more client devices220. In some implementations, the publisher device can monitor information resources associated with a transformedasset275 that were previously accessed by a client device220, and transmit an email including the transformed content275 (e.g., provided by the media asset server260), to the client device220.
• Themedia asset server260 can include thedatabase215. Thedatabase215 can be a computer-readable memory that can store or maintain one or more catalog(s)265. Thedatabase215 can maintain one or more data structures, which may contain, index, or otherwise store information, such as the catalog(s)265, themedia assets270, and the transformedassets275. Thedatabase215 can be accessed using one or more memory addresses, index values, or identifiers of any item, structure, or region maintained in thedatabase215. Thedatabase215 can be accessed by the components of themedia processing system205, or any other computing device described herein, such as the client devices220 or a publisher device, via thenetwork210. In some implementations, thedatabase215 can be internal to themedia asset server260. In some implementations, thedatabase215 can exist external to themedia asset server260, and may be accessed by themedia asset server260 via thenetwork210. In some implementations, both themedia asset server260 and thedatabase215 can be distributed across many different computer systems or storage elements, and may be accessed via thenetwork210 or a suitable computer bus interface. In some implementations, thedatabase215 can be similar to or include thestorage128 described herein above in conjunction withFIG.1C. In some implementations, thedatabase215 can be a distributed storage medium in a cloud computing system, such as thecloud108 detailed herein in connection withFIG.1B.
• Thedatabase215 can store one or more catalog(s)265 in one or more data structures, which can be associated with a respective publisher device. The catalog(s)265 can be, for example, in an XML or a CSV format, and can include lists of identifiers ofmedia assets270 and transformedassets275. For example, acatalog265 can storemedia assets270 and transformedassets275 that that are associated with a respective publisher device. When a client device accesses information resources of the publisher device, the client device220 can transmit requests to themedia asset server260 for amedia asset270 or the transformedassets275 from acatalog265 that corresponds to the respective publisher device. Thecatalog265 can store one ormore media assets270, for example, in one or more data structures. One or more of themedia assets270 or one or more of the transformedmedia assets275 can be transmitted to one or more client devices220 in response to requests, as described herein. In some implementations, themedia assets270 or the transformedmedia assets275 can be transmitted to a publisher device, which can include themedia assets270 or the transformedmedia assets275 in one or more email messages that can be transmitted to a client device220. In some implementations, each of themedia assets270 can be stored in association with an identifier of eachrespective media asset270. Themedia assets270 can be any form of electronic media, including text, images, video, audio, or instructions to display images, video, or text in an information resource (e.g., a web page, an application resource, an email, a short-message service (SMS) message, etc.). Themedia assets270 can be stored in association with one or more tags, topics, product identifiers, or category identifiers that indicate the type of information provided by themedia asset270.
• The one or more catalog(s)265 can store one or more transformedassets275. The transformedassets275 can be generated by themedia processing system205 as described in detail herein, and can be indexed in one or more files, such as XML files or CSV files. The transformedassets275 can each correspond to arespective media asset270. A transformedasset275 can be acorresponding media asset270 that is modified to include additional information, such as information retrieved from aremote computing system280 or anexternal asset source285. The transformedassets275 can be, for example, a flattened version of acorresponding media asset270 with an overlay of additional content generated based on information retrieved from theremote computing system280 or theexternal asset source285. In some implementations, when a request is received for amedia asset270, themedia asset server260 can transmit the transformedasset275 that corresponds to the requestedmedia asset270 based on the contents of the request (e.g., a user profile identifier, etc.). In some implementations, the request can indicate that the transformed version of amedia asset270 is desired, and in response themedia asset server260 can select and transmit the corresponding transformedasset275 to the requesting computing device.
• Theremote computing device280 can include at least one processor and a memory, e.g., a processing circuit. The memory can store processor-executable instructions that, when executed by processor, cause the processor to perform one or more of the operations described herein. The processor can include a microprocessor, an ASIC, an FPGA, etc., or combinations thereof. The memory can include, but is not limited to, electronic, optical, magnetic, or any other storage or transmission device capable of providing the processor with program instructions. The memory can further include a floppy disk, CD-ROM, DVD, magnetic disk, memory chip, ASIC, FPGA, ROM, RAM, EEPROM, EPROM, flash memory, optical media, or any other suitable memory from which the processor can read instructions. The instructions can include code from any suitable computer programming language. Theremote computing device280 can include one or more computing devices or servers that can perform various functions as described herein. In some implementations, theremote computing device280 can be a cloud computing resource, such as thecloud108 described in connection withFIG.1B. Theremote computing device280 can include any or all of the components and perform any or all of the functions of thecomputer system100 described herein in conjunction withFIGS.1A-1D.
• Theremote computing system280 can be a server, or group of distributed computing devices, which can provide additional information to themedia processing system205 in response to one or more requests. The additional information can be used, for example, to generate one or more transformedassets275 that can be stored in thecatalog265. The additional information can include, for example, any type of data related to amedia asset270, including a description of the media asset, a title of the media asset, payment information associated with the media asset (e.g., payment installment information, interest rate information, price information, etc.), category information related to the media asset, user-specific information that corresponds to the media asset (e.g., information from one or more user profiles used to access the respective publisher, etc.), or any other media asset data or metadata. A request for additional information can include an identifier of a particular media asset. In some implementations, the request can indicate a type of additional information, or selection criteria for the additional information, that the remote computing system can use to select additional information to provide in response to the request. For example, the request for additional information can indicate a corresponding client device identifier or user profile identifier, which can be used to select additional information that is associated with both the user profile identifier and the media asset(s)270 identified in the request. In some implementations, the request can indicate a category or topic, and theremote computing system260 can select additional information associated with both the category or topic and the identified media asset(s)270. The additional information can be transmitted to themedia processing system205 to generate one or more transformedassets275.
• Theexternal asset source285 can include at least one processor and a memory, e.g., a processing circuit. The memory can store processor-executable instructions that, when executed by processor, cause the processor to perform one or more of the operations described herein. The processor can include a microprocessor, an ASIC, an FPGA, etc., or combinations thereof. The memory can include, but is not limited to, electronic, optical, magnetic, or any other storage or transmission device capable of providing the processor with program instructions. The memory can further include a floppy disk, CD-ROM, DVD, magnetic disk, memory chip, ASIC, FPGA, ROM, RAM, EEPROM, EPROM, flash memory, optical media, or any other suitable memory from which the processor can read instructions. The instructions can include code from any suitable computer programming language. Theexternal asset source285 can include one or more computing devices or servers that can perform various functions as described herein. In some implementations, theexternal asset source285 can be a cloud computing resource, such as thecloud108 described in connection withFIG.1B. Theexternal asset source285 can include any or all of the components and perform any or all of the functions of thecomputer system100 described herein in conjunction withFIGS.1A-1D.
• Theexternal asset source285 can be a server, or group of distributed computing devices, different from themedia asset server260, which provides themedia assets270. For example, in some implementations, themedia processing server205 can generate one ormore catalogs265 usingmedia assets270 retrieved (e.g., using one or more scraping procedures, etc.) from theexternal asset source285. Theexternal asset source285 may storemedia assets270 in a format that is different from the format used to store thecatalog265 at themedia asset server260. In some implementations, themedia processing system205 can store themedia assets270 in acatalog265 generated by themedia processing system205. In addition, theexternal asset source285 can include additional information aboutmedia assets270 hosted by theexternal asset source285, including metadata or other information related tomedia assets270 as described herein.
• Referring now to the operations of themedia processing system205, therequest identifier230 can identify a request to update one ormore media assets270 maintained in adatabase215 of themedia asset server260. For example, the request can be a request transmitted by a publisher device (not pictured) that provides one or more information resources that include themedia assets270 to one or more client devices220. In some implementations, the request can be a request to update themedia assets270 at themedia asset server270 on a periodic basis. For example, the request can indicate one ormore catalogs265 ofmedia assets270, or one or morespecific media assets270, or one or more regions of memory at the media asset server260 (e.g., a folder or directory, etc.), to update or modify with additional data. In some implementations, the request can be a request to update one or more of themedia assets270 periodically or on a predetermined schedule. In some implementations, the request can be a request to update themedia assets270 as thecatalog265 is updated (e.g., by another computing device via thenetwork210, etc.).
• In such implementations, therequest identifier230 can detect an update to thedatabase215 or thecatalog265 of themedia asset server260 by using one or more API calls. For example, when themedia asset server260 detects an update to thedatabase215 or one ormore catalogs265, themedia asset server260 can transmit a message indicating which portions of thedatabase215 or thecatalogs265 were updated (e.g., a list of identifiers of updated media assets270) using a corresponding API of themedia processing system205. In some implementations, therequest identifier230 can periodically (e.g., hourly, daily, any other period of time, etc.), query themedia asset server260, using an API call corresponding to themedia asset server260, with a request for information regarding whether thedatabase215 or aspecific catalog265 has been updated. If there has been an update, therequest identifier230 can transmit a request for any added or changedmedia assets270 for use in the processes described herein. In some implementations, therequest identifier230 can query theremote computing system280 using an API call corresponding to theremote computing system280 to request whether the additional data corresponding to any of themedia assets270 have been updated. In response, therequest identifier230 can receive an indication that one or more portions of the additional data associated with any of themedia assets270 has changed. Upon receiving the indication, therequest identifier230 can retrieve the updated additional data from theremote computing system280, and retrieve thecorresponding media assets270 from themedia asset server260 to generate the transformedassets275 as described herein.
• Thedata retriever235 can retrieve, from thedatabase215 of themedia asset server260, the one or more media assets270 (e.g., which are identified asmedia assets270 to be modified in the request) and object metadata associated with each of themedia assets270. The object metadata of amedia asset270 can be any sort of information related to themedia asset270, including descriptive information, title information, presentation information, payment information, product information, information that describes objects depicted in or described in amedia asset270, or any other information relating to amedia asset270. The object metadata can be, for example, included in thecatalog265 maintained in thedatabase215 by themedia asset server260. In some implementations, thedata retriever235 can retrieve a portion of, or all of, thecatalog265 corresponding to a publisher identified in the request. Then, thedata retriever235 can extract the object metadata from thecatalog265, which in some implementations can include a list of identifiers of themedia assets270 to be updated.
• Using the identifiers of themedia assets270, thedata retriever235 can retrieve themedia assets270 from themedia asset server260 by transmitting one or more requests for themedia assets270 to themedia server260 via thenetwork210. In response, themedia asset server260 can transmit the requestedmedia assets270 to thedata retriever235, which can store each media asset in one or more data structures in the memory of themedia processing system205 in association with the object metadata corresponding to each media asset. In some implementations, thedata retriever235 can retrieve one or more of themedia assets270, the object metadata, or the additional information from theexternal asset source285. In some implementations, to reduce overall memory consumption, themedia processing system205 can process themedia assets270 in bursts (e.g., retrieve a subset of themedia assets270, process the media assets into transformedassets275, and write the transformedassets275 to thecatalog265, retrieve a next subset ofmedia assets270, and so on). In some implementations, the object metadata can include information that is displayed on an information resource in connection with a media asset (e.g., a description or corresponding block of text displayed in association with themedia asset270, etc.).
• In some implementations, thedata retriever235 can generate the one ormore media assets270 and the object metadata of each of the one ormore media assets270 by scraping thedatabase215 of themedia asset server260 or a web page provided by a remote computing device. For example, in some cases, acatalog265 including identifiers of themedia assets270 may not exist. Therefore, in order to retrieve each of themedia assets270 and the object metadata relating to the media assets, thedata retriever235 can scrape, or iterate through each file hosted by themedia server260 or theexternal asset source285, to identify and retrieve themedia assets270. In some implementations, theexternal asset source285 can host one or more websites or webpages (e.g., HTML documents, scripts, etc.). Thedata retriever235 can scrape the website or webpages of the external asset source by parsing any media files, HTML documents, or scripts hosted or maintained by theexternal asset source285. When scraping the said files, thedata retriever235 can identify one ormore media assets270 that have attributes that match those of themedia assets270 identified in the request (e.g., part of a subdomain or region of memory, by filename, by date, or by another filtering criteria, etc.). Likewise, thedata retriever235 can scrape theexternal asset source285 or thedatabase215 to identify object metadata associated with eachmedia asset270.
• Thedata retriever235 can retrieve, from theremote computing system280, additional data corresponding to the object metadata of eachmedia asset270 to be updated by themedia processing system205. Thedata retriever235 can provide the object metadata of each media asset to theremote computing system280, such that theremote computing system280 can use the object metadata to retrieve additional data that is specific to therespective media asset270. In some implementations, theremote computing system280 can be identified in the request to update the one or more media assets. In some implementations, thedata retriever235 can retrieve the additional data from theremote computing system280 in response to determining that the additional data for one ormore media assets270 has been updated. In some implementations, the additional data for eachmedia asset270 can be retrieved based on specified criteria. For example, in some implementations, thedata retriever235 can retrieve sets of additional data for each media asset, where each item of data in a set of additional data corresponds to a category, topic, or media asset selection criteria.
• For example, a set of additional data may be retrieved for modification of amedia asset270 for a target group of client devices220, and may include information relating to specified attributes (e.g., specified in the request identified by the request identifier230) of one or more client devices220. Each set of retrieved data can be stored in association with the specified criteria used to retrieve the additional data. As described herein, the additional data is used by themedia processing system205 to modify one ormore media assets270 to generate one or more corresponding transformedassets275. The additional data for amedia asset270 can include, for example, any type of data related to amedia asset270, including a description of the media asset, a title of the media asset, payment information associated with the media asset (e.g., payment installment information, interest rate information, price information, etc.), category information related to the media asset, user-specific information that corresponds to the media asset (e.g., information from one or more user profiles used to access the respective publisher, etc.), or any other media asset data or metadata. In some implementations, the additional data can include information about theremote computing system280 from which the additional data was retrieved. For example, in some implementations, to access or display the additional information, theremote computing system280, or other rules or regulations, may require predetermined text or additional information be displayed in connection with amedia asset270 modified to include the additional data (e.g., a transformed asset275).
• Once the additional data has been retrieved for eachmedia asset270, themedia asset generator240 can generate, for each retrievedmedia asset270, a transformed asset275 (e.g., an updated media asset270), to include the additional data associated with themedia asset270. Generating a transformedasset275 using amedia asset270 can include modifying amedia asset270 to include the additional data retrieved for thatmedia asset270 by overlaying the additional data onto themedia asset270. For example, if themedia asset270 is an image, video, or other type of media asset that can be rendered, themedia asset generator240 can generate overlay content including at least a portion of the additional data, which can be combined with themedia asset270 to generate the transformedasset275. Generating the overlay content can include selecting a theme (e.g., one or more graphical elements, graphic colors, etc.) for the overlay content.
• In some implementations, the theme, or type of overlay content, can be specified in the request to modify the one ormore media assets270. In some implementations, themedia asset generator240 can select a default overlay format (e.g., colors, position, etc.). Likewise, in some implementations, themedia asset generator240 parse one or more colors of themedia assets270 to identify an overlay format (e.g., colors, shape, location in themedia asset270, etc.). In some implementations, the overlay format or colors may be specified by theremote computing system280 from which the additional data was retrieved. The overlay content can be, for example, an overlay template that is generated to conform to the size and shape of thecorresponding media asset270. The overlay content template can be populated with portions of the additional data for themedia asset270, and themedia asset270 can be modified such that the overlay content is overlaid on top of themedia asset270. If themedia asset270 is an image, the overlay content can be placed over themedia content270 as a top layer, and the combined image can be flattened to generate the transformedcontent275 for thatmedia asset270. Similar processes can be performed formedia assets270 that include video content. For example, themedia asset generator270 can select one or more frames of themedia asset270 to overlay with the overlay content. The video can then be flattened to generate to the transformedcontent275. An example modifiedmedia asset270 that is an image is depicted inFIG.3.
• Referring briefly now toFIG.3, depicted is ascreenshot image300 of an example transformedasset275 displayed in association with corresponding object metadata, in accordance with one or more implementations. As shown, the transformedasset275 is amedia asset270 combined withoverlay content310A and310B. Theoverlay content310B is a small banner that is predetermined height and having a width that matches the width of themedia asset270. Theoverlay content310B is a bordered circle, which is partially transparent, that includes a second portion of the additional data. In this example, the additional data is payment information relating to a wall-mounted entertainment center product. The media asset is a picture of the product, and the object metadata includes attributes of the product displayed adjacent to the image (e.g., the title, price, product type, website link, description, group identifier, etc.). In addition, the size of the image (700 px by 700 px) is displayed.
• Referring back now toFIG.2 and the operations of themedia processing system205, themedia asset generator240 can modify other types of content, in addition to images and video, to generate corresponding transformedassets275. For example, themedia asset generator240 can modify or otherwise alter audio content to include additional information. Modifying audio content can include, for example, splicing in audio segments that correspond to the additional data retrieved for thecorresponding media asset270. The audio segments can be spliced into, or otherwise incorporated with the audio content of media asset at predetermined intervals, or at intervals specified in the object metadata associated with themedia asset270. If multiple sets of additional data are retrieved for amedia asset270, themedia asset generator240 can generate a transformedasset275 as described herein for each item of additional data in the set of additional data retrieved for themedia asset270. Each of the transformedassets275 generated for amedia asset270 can be stored in association with themedia asset270 from which the transformedassets275 were generated.
• The object metadata modifier245 can modify the object metadata of each of the one ormore media assets270 based on the additional data retrieved for the one or more media assets from theremote computing system280. As described herein, the object metadata for amedia asset270 can include, for example, descriptive information, title information, presentation information, payment information, product information, information that describes objects depicted in or identified by amedia asset270, or any other information relating to amedia asset270. In some implementations, the object metadata for amedia asset270 can include one or more tags (e.g., category information, other targeting information) that are used by a content provider system (not pictured) to select themedia asset270 for presentation on a client device220. To reflect the changes made to themedia asset270 when the transformedasset275 is generated for themedia asset270, the object metadata modifier245 can modify the object metadata for the corresponding transformedasset275 to include at least a portion of the additional data.
• The portions of the additional data to be included in the object metadata can be specified by information in thecatalog265 of themedia asset270, information retrieved from theremote computing system280, or information specified by the publisher device (not pictured) that made the request to update thecatalog265 or themedia assets270. In some implementations, the object metadata modifier245 can modify the object metadata by modifying a description of the transformedasset275 to include at least a portion of the additional data, such as a predetermined text string specified by theremote computing system280. In some implementations, the object metadata modifier245 can modify the object metadata for each transformedasset275 generated for amedia asset270. The object metadata can be modified to identify that the transformedasset275 with which it is associated is a modified form of aparticular media asset270.
• Once the transformedassets275 are generated and the object metadata has been modified for each transformedasset275, thedatabase updater250 can update thedatabase215 with each transformedasset275. To do so, thedatabase updater250 can formatting the object metadata of the transformedassets275 to conform to formatting requirements of themedia asset server260. For example, once the transformedassets275 and the corresponding object metadata are generated or modified, thedatabase updater250 can format the transformedassets275 and the object metadata into the format of thecatalog265. This can include, for example, generating appropriate XML data or CSV data in accordance with the requirements of themedia asset server260. In some implementations, thedatabase updater250 can format the transformedassets275 and the object metadata using a formatting API that corresponds to themedia asset server260 or to thecatalog265 format. Once the transformedassets275 and the object metadata have been formatted, thedatabase updater250 can update thedatabase215 and/or thecatalog265 by transmitting the formatted transformedassets275 and the modified object metadata for each transformedasset275 to themedia asset server260. For example, thedatabase updater250 can utilize an API corresponding to thedatabase215 or themedia asset server260 to push the transformedassets275 and the object metadata to themedia asset server260. In some implementations, thedatabase updater250 can update thedatabase215 or thecatalog265 in response to the request to update themedia assets270. In some implementations, thedatabase updater265 can transmit the transformed formatted transformedassets275 and the object metadata to a different asset server (not pictured).
• Once the media asset server is updated, the transformedassets275 and any associated object metadata can be transmitted to the client devices220 in accordance with one or more requests, as described herein. For example, various publishers may select and serve one or more transformedassets275 to corresponding client devices220, for example, when the client devices220 are associated with content selection information that corresponds to (e.g., is similar to, or identifies, etc.) the modified object metadata of the one or more transformedasset275. In some cases, publishers can select one or more transformedassets275 for provision to client devices220 such that the one or more transformedassets275 and any appropriate object metadata are displayed in one or more information resources, which can include webpages or emails transmitted to the client devices220.
• Referring now toFIG.4, depicted is an illustrative flow diagram of amethod400 of transforming content using data retrieved from external sources. Themethod400 can be executed, performed, or otherwise carried out by themedia processing system205, thecomputer system100 described herein in conjunction withFIGS.1A-1D, or any other computing devices described herein. In brief overview of themethod400, the media processing system (e.g., themedia processing system205, etc.) can identify a request to update media assets (e.g., themedia assets270, etc.) (STEP402), retrieve data corresponding to a media asset (STEP404), generate an updated media asset (e.g., a transformed asset275) (STEP406), modify object metadata of the media asset (STEP408), determine whether the counter register k is equal to the number of media assets n (STEP410), increment the counter register k (STEP412), and update a database (e.g., thedatabase215, etc.) with the updated media assets (STEP414).
• In further detail of themethod400, the media processing system can identify a request to update media assets (e.g., themedia assets270, etc.) (STEP402). For example, the request can be a request transmitted by a publisher device that provides one or more information resources that include the media assets to one or more client devices (e.g., the client devices220, etc.). In some implementations, the request can be a request to update the media assets at a media asset server (e.g., themedia asset server260, etc.) on a periodic basis. For example, the request can indicate one or more catalogs (e.g., the catalog(s)265, etc.) of media assets, or one or more specific media assets, or one or more regions of memory at the media asset server (e.g., a folder or directory, etc.), to update or modify with additional data. In some implementations, the request can be a request to update one or more of the media assets periodically or on a predetermined schedule. In some implementations, the request can be a request to update the media assets as the catalog is updated (e.g., by another computing device via thenetwork210, etc.).
• In such implementations, the media processing system can detect an update to the database or the catalog of the media asset server by using one or more API calls. For example, when the media asset server detects an update to the database or one or more catalogs, the media asset server can transmit a message indicating which portions of the database or the catalogs were updated (e.g., a list of identifiers of updated media assets) using a corresponding API of the media processing system. In some implementations, the media processing system can periodically (e.g., hourly, daily, any other period of time, etc.) query the media asset server, using an API call corresponding to the media asset server, with a request for information regarding whether the database or a specific catalog has been updated. If there has been an update, the media processing system can transmit a request for any added or changed media assets for use in the processes described herein. In some implementations, the media processing system can query a remote computing system (e.g., theremote computing system280, etc.) using an API call corresponding to the remote computing system to request whether the additional data corresponding to any of the media assets have been updated. In response, the media processing system can receive an indication that one or more portions of the additional data associated with any of the media assets has changed. Upon receiving the indication, the media processing system can retrieve the updated additional data from the remote computing system, and retrieve the corresponding media assets from the media asset server to generate the transformed assets as described herein.
• The media processing system can retrieve additional data corresponding to a media asset (STEP404). In addition, the media processing system can retrieve, from the database of the media asset server, the one or more media assets (e.g., which are identified as media assets to be modified in the request) and object metadata associated with each of the media assets. The object metadata of a media asset can be any sort of information related to the media asset, including descriptive information, title information, presentation information, payment information, product information, information that describes objects depicted in or described in a media asset, or any other information relating to a media asset. The object metadata can be, for example, included in the catalog maintained in the database by the media asset server. In some implementations, the media processing system can retrieve a portion of, or all of, the catalog corresponding to a publisher identified in the request. Then, the media processing system can extract the object metadata from the catalog, which in some implementations can include a list of identifiers of the media assets to be updated.
• Using the identifiers of the media assets, the media processing system can retrieve the media assets from the media asset server by transmitting one or more requests for the media assets to the media server via a network (e.g., thenetwork210, etc.). In response, the media asset server can transmit the requested media assets to the media processing system, which can store each media asset in one or more data structures in the memory of the media processing system in association with the object metadata corresponding to each media asset. In some implementations, the media processing system can retrieve one or more of the media assets, the object metadata, or the additional information from an external asset source (e.g., theexternal asset source285, etc.). In some implementations, to reduce overall memory consumption, the media processing system can process the media assets in bursts (e.g., retrieve a subset of the media assets, process the media assets into transformed assets, and write the transformed assets to the catalog, retrieve a next subset of media assets, and so on). In some implementations, the object metadata can include information that is displayed on an information resource in connection with a media asset (e.g., a description or corresponding block of text displayed in association with the media asset, etc.).
• In some implementations, the media processing system can generate the one or more media assets and the object metadata of each of the one or more media assets by scraping the database of the media asset server or a web page provided by a remote computing device. For example, in some cases, a catalog including identifiers of the media assets may not exist. Therefore, in order to retrieve each of the media assets and the object metadata relating to the media assets, the media processing system can scrape, or iterate through each file hosted by the media server or the external asset source, to identify and retrieve the media assets. In some implementations, the external asset source can host one or more websites or webpages (e.g., HTML documents, scripts, etc.). The media processing system can scrape the website or webpages of the external asset source by parsing any media files, HTML documents, or scripts hosted or maintained by the external asset source. When scraping the said files, the media processing system can identify one or more media assets that have attributes that match those of the media assets identified in the request (e.g., part of a subdomain or region of memory, by filename, by date, or by another filtering criteria, etc.). Likewise, the media processing system can scrape the external asset source or the database to identify object metadata associated with each media asset.
• The media processing system can retrieve, from the remote computing system, additional data corresponding to the object metadata of each media asset to be updated by the media processing system. The media processing system can provide the object metadata of each media asset to the remote computing system, such that the remote computing system can use the object metadata to retrieve additional data that is specific to the respective media asset. In some implementations, the remote computing system can be identified in the request to update the one or more media assets. In some implementations, the media processing system can retrieve the additional data from the remote computing system in response to determining that the additional data for one or more media assets has been updated. In some implementations, the additional data for each media asset can be retrieved based on specified criteria. For example, in some implementations, the media processing system can retrieve sets of additional data for each media asset, where each item of data in a set of additional data corresponds to a category, topic, or media asset selection criteria.
• For example, a set of additional data may be retrieved for modification of a media asset for a target group of client devices, and may include information relating to specified attributes (e.g., specified in the request identified by the media processing system) of one or more client devices. Each set of retrieved data can be stored in association with the specified criteria used to retrieve the additional data. As described herein, the additional data is used by the media processing system to modify one or more media assets to generate one or more corresponding transformed assets. The additional data for a media asset can include, for example, any type of data related to a media asset, including a description of the media asset, a title of the media asset, payment information associated with the media asset (e.g., payment installment information, interest rate information, price information, etc.), category information related to the media asset, user-specific information that corresponds to the media asset (e.g., information from one or more user profiles used to access the respective publisher, etc.), or any other media asset data or metadata. In some implementations, the additional data can include information about the remote computing system from which the additional data was retrieved. For example, in some implementations, to access or display the additional information, the remote computing system, or other rules or regulations, may require predetermined text or additional information be displayed in connection with a media asset modified to include the additional data (e.g., a transformed asset).
• The media processing system can generate an updated media asset (e.g., a transformed asset) (STEP406). Generating a transformed asset using a media asset can include modifying a media asset to include the additional data retrieved for that media asset by overlaying the additional data onto the media asset. For example, if the media asset is an image, video, or other type of media asset that can be rendered, the media processing system can generate overlay content including at least a portion of the additional data, which can be combined with the media asset to generate the transformed asset. Generating the overlay content can include selecting a theme (e.g., one or more graphical elements, graphic colors, etc.) for the overlay content.
• In some implementations, the theme, or type of overlay content, can be specified in the request to modify the one or more media assets. In some implementations, the media processing system can select a default overlay format (e.g., colors, position, etc.). Likewise, in some implementations, the media processing system parse one or more colors of the media assets to identify an overlay format (e.g., colors, shape, location in the media asset, etc.). In some implementations, the overlay format or colors may be specified by theremote computing system280 from which the additional data was retrieved. The overlay content can be, for example, an overlay template that is generated to conform to the size and shape of the corresponding media asset. The overlay content template can be populated with portions of the additional data for the media asset, and the media asset can be modified such that the overlay content is overlaid on top of the media asset. If the media asset is an image, the overlay content can be placed over the media content as a top layer, and the combined image can be flattened to generate the transformed content for that media asset. Similar processes can be performed for media assets that include video content. For example, the media processing system can select one or more frames of the media asset to overlay with the overlay content. The video can then be flattened to generate to the transformed content.
• The media processing system can modify other types of content, in addition to images and video, to generate corresponding transformed assets. For example, the media processing system can modify or otherwise alter audio content to include additional information. Modifying audio content can include, for example, splicing in audio segments that correspond to the additional data retrieved for the corresponding media asset. The audio segments can be spliced into, or otherwise incorporated with the audio content of media asset at predetermined intervals, or at intervals specified in the object metadata associated with the media asset. If multiple sets of additional data are retrieved for a media asset, the media processing system can generate a transformed asset as described herein for each item of additional data in the set of additional data retrieved for the media asset. Each of the transformed assets generated for a media asset can be stored in association with the media asset from which the transformed assets were generated.
• The media processing system can modify object metadata of the media asset (STEP408). The media processing system can modify the object metadata of each of the one or more media assets based on the additional data retrieved for the one or more media assets from the remote computing system. As described herein, the object metadata for a media asset can include, for example, descriptive information, title information, presentation information, payment information, product information, information that describes objects depicted in or identified by a media asset, or any other information relating to a media asset. In some implementations, the object metadata for a media asset can include one or more tags (e.g., category information, other targeting information) that are used by a content provider system (not pictured) to select the media asset for presentation on a client device. To reflect the changes made to the media asset when the transformed asset is generated for the media asset, the media processing system can modify the object metadata for the corresponding transformed asset to include at least a portion of the additional data.
• The portions of the additional data to be included in the object metadata can be specified by information in the catalog of the media asset, information retrieved from the remote computing system, or information specified by the publisher device (not pictured) that made the request to update the catalog or the media assets. In some implementations, the media processing system can modify the object metadata by modifying a description of the transformed asset to include at least a portion of the additional data, such as a predetermined text string specified by the remote computing system. In some implementations, the media processing system can modify the object metadata for each transformed asset generated for a media asset. The object metadata can be modified to identify that the transformed asset with which it is associated is a modified form of a particular media asset.
• The media processing system can determine whether the counter register k is equal to the number of media assets n (STEP410). To determine whether each media asset has been used to generate at least one corresponding transformed asset, the media processing system can compare the counter register k, which is used to track the number of processed media assets, to the total number of media assets to be processed n. If the counter register k is not equal to (e.g., less than) the total number of media assets to be processed n, the media processing system can execute (STEP412). If the counter register k is equal to (e.g., equal to or greater than) the total number of media assets to be processed n, the media processing system can execute (STEP414).
• The media processing system can increment the counter register k (STEP412). To track the total number of media assets that have been processed into transformed assets, the media processing system can add one to the counter register k to indicate the number of media assets that have been processed has increased by one. After incrementing the value of the counter register k, the media processing system can execute (STEP404).
• The media processing system can update a database with the updated media assets (STEP414). To do so, the media processing system can formatting the object metadata of the transformed assets to conform to formatting requirements of the media asset server. For example, once the transformed assets and the corresponding object metadata are generated or modified, the media processing system can format the transformed assets and the object metadata into the format of the catalog. This can include, for example, generating appropriate XML, data or CSV data in accordance with the requirements of the media asset server. In some implementations, the media processing system can format the transformed assets and the object metadata using a formatting API that corresponds to the media asset server or to the catalog format. Once the transformed assets and the object metadata have been formatted, the media processing system can update the database and/or the catalog by transmitting the formatted transformed assets and the modified object metadata for each transformed asset to the media asset server. For example, the media processing system can utilize an API corresponding to the database or the media asset server to push the transformed assets and the object metadata to the media asset server. In some implementations, the media processing system can update the database or the catalog in response to the request to update themedia assets270.
• Once the media asset server is updated, the transformed assets and any associated object metadata can be transmitted to the client devices in accordance with one or more requests, as described herein. For example, various publishers may select and serve one or more transformed assets to corresponding client devices, for example, when the client devices are associated with content selection information that corresponds to (e.g., is similar to, or identifies, etc.) the modified object metadata of the one or more transformed asset. In some cases, publishers can select one or more transformed assets for provision to client devices such that the one or more transformed assets and any appropriate object metadata are displayed in one or more information resources, which can include webpages or emails transmitted to the client devices.
• Implementations of the subject matter and the operations described in this specification can be implemented in digital electronic circuitry, or in computer software embodied on a tangible medium, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Implementations of the subject matter described in this specification can be implemented as one or more computer programs, e.g., one or more components of computer program instructions, encoded on computer storage medium for execution by, or to control the operation of, data processing apparatus. The program instructions can be encoded on an artificially-generated propagated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal that is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus. A computer storage medium can be, or be included in, a computer-readable storage device, a computer-readable storage substrate, a random or serial access memory array or device, or a combination of one or more of them. Moreover, while a computer storage medium is not a propagated signal, a computer storage medium can include a source or destination of computer program instructions encoded in an artificially-generated propagated signal. The computer storage medium can also be, or be included in, one or more separate physical components or media (e.g., multiple CDs, disks, or other storage devices).
• The operations described in this specification can be implemented as operations performed by a data processing apparatus on data stored on one or more computer-readable storage devices or received from other sources.
• The terms “data processing apparatus,” “data processing system,” “client device,” “computing platform,” “computing device,” or “device” encompasses all kinds of apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, a system on a chip, or multiple ones, or combinations, of the foregoing. The apparatus can include special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit). The apparatus can also include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of them. The apparatus and execution environment can realize various different computing model infrastructures, such as web services, distributed computing and grid computing infrastructures.
• A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, declarative or procedural languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, object, or other unit suitable for use in a computing environment. A computer program may, but need not, correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub-programs, or portions of code). A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
• The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform actions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatuses can also be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit).
• Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. The elements of a computer include a processor for performing actions in accordance with instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks. However, a computer need not have such devices. Moreover, a computer can be embedded in another device, e.g., a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a Global Positioning System (GPS) receiver, or a portable storage device (e.g., a universal serial bus (USB) flash drive), for example. Devices suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
• To provide for interaction with a user, implementations of the subject matter described in this specification can be implemented on a computer having a display device, e.g., a CRT (cathode ray tube), plasma, or LCD (liquid crystal display) monitor, for displaying information to the user and a keyboard and a pointing device, e.g., a mouse or a trackball, by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can include any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback; and input from the user can be received in any form, including acoustic, speech, or tactile input. In addition, a computer can interact with a user by sending documents to and receiving documents from a device that is used by the user; for example, by sending web pages to a web browser on a user's client device in response to requests received from the web browser.
• Implementations of the subject matter described in this specification can be implemented in a computing system that includes a back-end component, e.g., as a data server, or that includes a middleware component, e.g., an application server, or that includes a front-end component, e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the subject matter described in this specification, or any combination of one or more such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication, e.g., a communication network. Examples of communication networks include a local area network (“LAN”) and a wide area network (“WAN”), an inter-network (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks).
• The computing system such as themedia processing system205 can include clients and servers. For example, themedia processing system205 can include one or more servers in one or more data centers or server farms. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. In some implementations, a server transmits data (e.g., an HTML page) to a client device (e.g., for purposes of displaying data to and receiving input from a user interacting with the client device). Data generated at the client device (e.g., a result of an interaction, computation, or any other event or computation) can be received from the client device at the server, and vice-versa.
• While this specification contains many specific implementation details, these should not be construed as limitations on the scope of any inventions or of what may be claimed, but rather as descriptions of features specific to particular implementations of the systems and methods described herein. Certain features that are described in this specification in the context of separate implementations can also be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single implementation can also be implemented in multiple implementations separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
• Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results.
• In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of various system components in the implementations described above should not be understood as requiring such separation in all implementations, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products. For example, themedia processing system205 could be a single module, a logic device having one or more processing modules, one or more servers, or part of a search engine.
• Having now described some illustrative implementations and implementations, it is apparent that the foregoing is illustrative and not limiting, having been presented by way of example. In particular, although many of the examples presented herein involve specific combinations of method acts or system elements, those acts and those elements may be combined in other ways to accomplish the same objectives. Acts, elements, and features discussed only in connection with one implementation are not intended to be excluded from a similar role in other implementations or implementations.
• The phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” “having,” “containing,” “involving,” “characterized by,” “characterized in that,” and variations thereof herein is meant to encompass the items listed thereafter, equivalents thereof, and additional items, as well as alternate implementations consisting of the items listed thereafter exclusively. In one implementation, the systems and methods described herein consist of one, each combination of more than one, or all of the described elements, acts, or components.
• Any references to implementations or elements or acts of the systems and methods herein referred to in the singular may also embrace implementations including a plurality of these elements, and any references in plural to any implementation or element or act herein may also embrace implementations including only a single element. References in the singular or plural form are not intended to limit the presently disclosed systems or methods, their components, acts, or elements to single or plural configurations. References to any act or element being based on any information, act or element may include implementations where the act or element is based at least in part on any information, act, or element.
• Any implementation disclosed herein may be combined with any other implementation, and references to “an implementation,” “some implementations,” “an alternate implementation,” “various implementation,” “one implementation” or the like are not necessarily mutually exclusive and are intended to indicate that a particular feature, structure, or characteristic described in connection with the implementation may be included in at least one implementation. Such terms as used herein are not necessarily all referring to the same implementation. Any implementation may be combined with any other implementation, inclusively or exclusively, in any manner consistent with the aspects and implementations disclosed herein.
• References to “or” may be construed as inclusive so that any terms described using “or” may indicate any of a single, more than one, and all of the described terms.
• Where technical features in the drawings, detailed description, or any claim are followed by reference signs, the reference signs have been included for the sole purpose of increasing the intelligibility of the drawings, detailed description, and claims. Accordingly, neither the reference signs nor their absence have any limiting effect on the scope of any claim elements.
• The systems and methods described herein may be embodied in other specific forms without departing from the characteristics thereof. Although the examples provided may be useful for transforming content using data retrieved from external sources, the systems and methods described herein may be applied to other environments. The foregoing implementations are illustrative rather than limiting of the described systems and methods. The scope of the systems and methods described herein may thus be indicated by the appended claims, rather than the foregoing description, and changes that come within the meaning and range of equivalency of the claims are embraced therein.

Claims (21)

1-20. (canceled)

21. A method, comprising:

receiving, by one or more processors coupled to a memory storing a database of a media asset system from a remote computing device, a request for media assets of the database updated since a prior request;

retrieving, by the one or more processors, data corresponding to object metadata of each media asset updated since the prior request, the retrieved data provided to the remote computing device;

receiving, by the one or more processors from the remote computing device, a further updated media asset for each media asset updated since the prior request, the further updated media asset comprising modified object metadata; and

updating, by the one or more processors, the database with the further updated media asset for each media asset updated since the prior request.

22. The method ofclaim 21, wherein the further updated media asset comprises overlay content including at least a portion of the data corresponding to the object metadata of the media asset.

23. The method ofclaim 22, wherein the media asset is an image; and

wherein the overlay content is overlaid by the remote computing device on the image of the media asset to generate the further updated media asset.

24. The method ofclaim 21, wherein updating the database further comprises reformatting, by the one or more processors, the modified object metadata of each further updated media asset.

25. The method ofclaim 21, wherein the database of the media asset system comprises a media catalog.

26. The method ofclaim 25, further comprising extracting, by the one or more processors, from the media catalog, each media asset updated since the prior request and the corresponding object metadata.

27. The method ofclaim 21, further comprising detecting, by the one or more processors, an update to the database of the media asset system; and

transmitting a notification, by the one or more processors to the remote computing device, of the detected update.

28. The method ofclaim 21, wherein the object metadata of each media asset comprises a description of the media asset, and wherein the modified object metadata comprises a modified description.

29. The method ofclaim 21, further comprising generating, by the one or more processors, the media assets and the object metadata of each media asset by scraping, by the one or more processors, a web page provided by a second remote computing device.

30. A system, comprising:

one or more processors coupled to memory storing a database of a media asset system, the one or more processors configured to:

receive, from a remote computing device, a request for media assets of the database updated since a prior request,

retrieve data corresponding to object metadata of each media asset updated since the prior request, the retrieved data provided to the remote computing device,

receive, from the remote computing device, a further updated media asset for each media asset updated since the prior request, the further updated media asset comprising modified object metadata, and

update the database with the further updated media asset for each media asset updated since the prior request.

31. The system ofclaim 30, wherein the further updated media asset comprises overlay content including at least a portion of the data corresponding to the object metadata of the media asset.

32. The system ofclaim 31, wherein the media asset is an image; and

wherein the overlay content is overlaid by the remote computing device on the image of the media asset to generate the further updated media asset.

33. The system ofclaim 30, wherein the one or more processors are further configured to reformat the modified object metadata of each further updated media asset for storage in the database of the media asset system.

34. The system ofclaim 30, wherein the database of the media asset system comprises a media catalog.

35. The system ofclaim 34, wherein the one or more processors are further configured to extract, from the media catalog, each media asset updated since the prior request and the corresponding object metadata.

36. The system ofclaim 30, wherein the one or more processors are further configured to:

detect an update to the database of the media asset system; and

transmit a notification, to the remote computing device, of the detected update.

37. The system ofclaim 30, wherein the object metadata of each media asset comprises a description of the media asset, and wherein the modified object metadata comprises a modified description.

38. The system ofclaim 30, wherein the one or more processors are further configured to generate the media assets and the object metadata of each media asset by scraping a web page provided by a second remote computing device.

39. A non-transitory computer readable medium comprising instructions that, when executed by one or more processors of a computing device, cause the computing device to:

identify a request to update one or more media assets maintained in a database of a media asset system;

retrieve, from a remote data system identified in the request, data corresponding to object metadata of each media asset of the one or more media assets;

generate, for each media asset of the one or more media assets, an updated media asset to include the data retrieved from the remote data system;

modify the object metadata of each of the one or more media assets based on the data;

and update, responsive to the request, the database with each updated media asset.

40. The computer readable medium ofclaim 39, wherein execution of the instructions further cause the one or more processors to generate the updated media asset for each media asset of the one or more media assets by performing operations comprising:

generating overlay content including at least a portion of the data; and

combining the overlay content and the media asset to generate the updated media asset.

Images