US20020013852A1 - System for providing content, management, and interactivity for thin client devices - Google Patents

Abstract

A system is provided for delivering Internet and digital content to a variety of thin client devices. A web portal for accessing and selecting content is used in conjunction with graphical user interfaces on a personal computer for setting up and controlling the content channels. The user interfaces, scheduling, and communication management are controlled by a system control software application running on a local server with an Internet connection. A high speed local area network provides for streaming content from the Internet or local server to thin client devices. A digital audio playback device is connected to the local server via the local area network connection and decodes streamed audio files, and converts them into analog audio signals for input into a conventional stereo. Digital content is streamed automatically from the local server to another Internet playback device, based on end user content preferences and schedule selections.

Description

• This application claims the benefit of U.S. Provisional Application No. 60/199,638, filed Apr. 25, 2000, entitled System for Presenting Data and Content from the Internet on Client Devices; and No. 60/268,434, filed Feb. 12, 2001, entitled System for Delivering Content to Client Devices.[0001]
FIELD OF THE INVENTION
• A system is disclosed for providing user specified channels for moving content from the Internet and local storage device to one or more networked devices for access by end users. More specifically, content and data is delivered to a variety of devices via a caching gateway device and a local area network. Software residing on a PC or PC in combination with a storage gateway device provides content distribution, management, and interaction functions.[0002]
DEFINITIONS
• Web, world wide web, and Internet are used here interchangeably, and are defined as the sum total of all connected computers on the planet, the connection being via standardized digital communications protocols, such as TCP-IP and HTTP and the like, including wirelessly linked devices that may use other protocols.[0003]
• Broadband connection is defined as a communications network in which the frequency bandwidth can be divided and shared by multiple simultaneous signals. A broadband connection to the Internet typically provides minimum upstream and downstream data-rates of approximately 200K or more bits per second. There are many different types of broadband connections including DSL, cable modems, and fixed and mobile wireless connections.[0004]
• A DOCSIS (Data Over Cable System Interface Specification) modem is an industry standard type of cable modem that is used to provide broadband access to the Internet over a coaxial cable physical layer that is also used for the delivery of cable TV signals (CATV). DOCSIS modems are well known in the telecommunications industry and will not be described here in detail.[0005]
• A DSL (Digital Subscriber Line) modem is also an industry standard type of modem that is used to provide broadband access to the Internet, but over conventional copper phone lines (local loops). DSL modems are well known in the telecommunications industry and will not be described here in further detail.[0006]
• The term gateway, used interchangeably with broadband gateway, is defined as an integral modem and router, and may include hub functionality. The modem function is used to change voltage fluctuations on an input carrier line (a DSL line input or a cable TV input) into digital data. Modems (modulator/demodulator) are a well-known technology in the telecommunications market and will not be addressed in detail here. Routers are devices that connect one distinct network to another by passing only certain IP addresses that are targeted for specific networks. Hubs allow one network signal input to be split and thus sent to many devices. Routers and hubs are well known technologies in the network and telecommunications industry so they will not be described here in detail.[0007]
• Gateway storage peripheral is defined as an add-on storage device with processing power, an operating system, and a software application that manages the downloading and storage of data. An example scenario for the use of a gateway storage peripheral is a system where a user has a DOCSIS modem and would like to add an always-on storage capability. The gateway storage peripheral is connected to the DOCSIS modem via a USB port or an Ethernet port in the DOCSIS modem. USB disks are well known in the computer storage peripheral industry, and are available for purchase. A gateway storage peripheral in combination with a DOCSIS modem or any type of broadband modem is considered a storage gateway system. A PC that is always left on and connected to an always-on gateway with a DSL or broadband cable connection is considered a storage gateway system.[0008]
• The term “message” is defined as information that is sent digitally from one computing device to another for various purposes. The term “content” is used to mean the information contained in digital files or streams that is meaningful, relevant, and desired, by end-users. For example, content is entertainment or news, that is, information that was for the most part created by entities other than the end-user, or for example, audio files in MP3 format. “Data” is used to mean information created by end-users such as digital schedule contents, responses from devices sent back through the system, or digital messages and email. “Content” and “data” are sometimes used interchangeably.[0009]
• Local Area Network (LAN) is defined as a network structure that includes two or more devices that can communicate with other devices utilizing a shared communication infrastructure, including wired network technologies, such as Ethernet, or wireless network technologies such as 802.11b or HomeRF technology. Wireless LAN technology such as 802.11b and HomeRF are based on the unlicensed 2.4 Ghz ISM (Industrial, Scientific, and Medical) frequency band and are well known the telecommunications and LAN industries. These networking technologies utilize Transmission Control Protocol/Internet Protocols (hereafter TCP/IP) protocols. Since these protocols and these technologies are well known, they will not be addressed here in detail. A LAN typically constitutes a group of interconnected devices that share a common geographic location and are typically grouped together as a subnet. A local network for example would be a home network where several computers and other smart devices, such as the Internet clock (described below), would be digitally connected for the purpose of transferring content and data, controlling each other, sharing programming, or presenting data and content to an end user.[0010]
• Codec (Compression/Decompression algorithm) is a software application that is used to decode (uncompress) encoded (compressed) media files or streams. Most content is stored and sent in a compressed format so that the content files are smaller and thus take up less storage space and use less bandwidth when being transferred via the Internet. The content is then decoded at the playback device. For example, MP3 audio files are encoded and must be decoded by a microprocessor running the codec in order for the audio content to be presented to the user in an analog format. Codecs for both video and audio are a well-known field of digital media technology and will not described here in detail.[0011]
• HTTP is Hyper-text transfer protocol, the protocol used by Web browsers and Web servers to transfer files, such as text and graphic files. Data-rate is defined as the data throughput of a telecommunications system or technology, and is measured in a quantity of bits per second, such as millions of bits per second (Mbps).[0012]
BACKGROUND AND DESCRIPTION OF PRIOR ART
• The rapid buildup of telecommunications infrastructure combined with substantial investment in Internet-based businesses and technology has brought Internet connectivity to a large segment of the population. Recent market statistics show that a majority of households in the U.S. own at least one personal computer (PC), and a significant number of these PCs are connected to the Internet. Many households include two or more PCs, as well as various PC productivity peripherals such as printers, scanners, and the like. Decreases in the cost of PC components such as microprocessors, hard disk drives, memory, and displays, have driven the commoditization of PCs. Although the majority of household PCs are connected to the Internet by dialup modem connections, broadband connectivity is being rapidly adopted, and is decreasing in price as a variety of technologies are introduced and compete in the marketplace. A large majority of households in the U.S. and Europe is viable for at least one or more type of broadband connection, such as cable, DSL, optical networks, fixed wireless, or two-way satellite transmission.[0013]
• A market for home networking technology has emerged, driven by the need to share an Internet connection between two or more PCs, and to connect all the PCs to productivity peripherals. There has been innovation in LAN technology based on end-user desire for simplicity and ease of installation. Installing Ethernet cable is impractical for a majority of end-users, therefore a number of no-new-wires technologies have been introduced. The Home Phoneline Networking Association (HPNA) promotes networking products that turn existing phone wiring in the home into an Ethernet physical layer. Adapters are required that allow each device to plug into any RJ-11 phone jack in the home. The adapter modifies the signal from devices so that it can be carried by the home phone lines. Existing HPNA products provide data-rates equivalent to 10base-T Ethernet, approximately 10 Mbps. Networking technology that uses the AC power wiring in the home to carry data signals has also appeared, notably from Intellon Corporation, of Ocala, Florida. Similar to HPNA devices, adapters are required to convert data signals from devices into voltage fluctuations carried on to and off of the AC wires, allowing any AC outlet to become a network interface. Although both HPNA and power line networking products are convenient to use because they require no new wires, the advantage of AC power line products over HPNA is that AC power outlets are more ubiquitous than RJ-11 phone jacks.[0014]
• Wireless radio-frequency (RF) LAN technology has also been introduced into the home networking market. Theoretically, wireless technology is the most convenient for the end user to install. There are currently two prevalent standards for wireless networking, 802.11b and HomeRF. Both of these systems utilize the unlicensed 2.4 Ghz ISM band as the carrier frequency for the transmission of data. Both of these technologies have effective ranges of approximately 150 feet in a typical household setting. 802.11b is a direct sequence spread spectrum technology, and is provided by a variety of telecommunication OEMs such as Lucent Corporation of Murray Hill, New Jersey. HomeRF is a frequency-hopping spread spectrum technology and is also provided by a variety of telecommunications OEMs such as Proxim, Inc., of Sunnyvale, Calif. Adapters that are RF transceivers are required for each device to communicate on the network. In addition to utilizing TCP/IP protocols, each of 802.11b and HomeRF include additional encryption and security protocol layers so that the user's devices have controlled access to data being sent through the LAN.[0015]
• Due to market competition and the effect of Moore's Law, home networking technology is greatly increasing in performance and availability, while decreasing in price. For example, the current data-rate roadmap shows HomeRF increasing from 10 Mbps to 20 Mbps, utilizing the 5 Ghz band. The 802.11 technology roadmap shows the introduction of 802.11a at 54 Mbps, also utilizing the 5 Ghz band. It is important to note that LAN data-rates are increasing much faster than wide-area data-rates, such as the data-rates provided by “last mile” technologies including DSL, DOCSIS. Wireless wide area data-rates are also improving slowly. Current digital cellular technology provides less than 64 Kbps data-rates, with most systems providing throughput in the 20 Kbps range.[0016]
• While networked PCs with Internet connectivity provide greater convenience for productivity applications, there are other trends that are influencing end user's content experiencing habits. For example, Personal Video Recorders (hereafter PVRs), such as the technology provided by Tivo, of Santa Clara, Calif., are increasing in popularity. These devices are an improvement on VCR “time-shifting” functionality, allowing users to record, pause, and start live broadcast media, almost in real time. These devices digitize terrestrially broadcast television content and store the files on a hard disk drive, providing much faster random access, fast-forwarding, and rewinding. A graphical user interface is provided that allows users to make content preference selections. A PVR supports the trend toward user controlled “anytime” access to digital content.[0017]
• The MP3 digital audio format is an audio encoding technology that allows consumers to further compress digital audio files such as those found on Compact Disks, to much smaller sizes with very little decrease in sound quality. The MP3 format is the audio layer of MPEG-2 digital audio and video compression and transmission standard. For example, the MP3 format allows for compression of audio content to approximately 1 million bytes per minute of audio, at near Compact Disk quality. This capability, combined with a decrease in the cost of flash memory, a type of non-volatile silicon-based mass memory, has made it possible to develop affordable, portable digital audio playback devices. These are devices that are significantly smaller than portable CD players because they contain no moving parts, only flash memory and a microprocessor for decoding MP3 compressed audio content.[0018]
• PC-based MP3 software players have been created that provide a convenient graphical user interface and software decoding of MP3 files. The most popular player is the Winamp player, is provided by American Online/Time Warner. Winamp allows users to play MP3 files on their PC, using an existing sound card with external speakers. However, to listen to MP3 s the user must interface with the PC, using a mouse and keyboard, and must be nearby the PC sound output equipment.[0019]
• The smaller size of MP3 encoded audio files has also enabled these files to be shared by users across the Internet, since the transfer of these files takes an acceptable amount of time. Internet-based digital music access and distribution service businesses have appeared, such as MP3.com and Napster.com, that provide various means for users to gain access to digital audio files.[0020]
• In addition to music, many other types of audio content are now available in digital format, such as spoken-word content, news, commentary, and educational content. Audible.com is an Internet-based repository of digital spoken-word content. Digital files containing audio recordings of books being read aloud are available for download directly from their website.[0021]
• Graphic content such as video and still images are also increasingly available. Digital still and video cameras allow the capture and rapid transfer of images. The Ceiva Picture Frame, provided by Ceiva Logic, of Los Angeles, Calif., is a product that allows users to share digital images across the Internet. The Ceiva Picture Frame is comprised of a frame housing similar to a conventional picture frame, but with a large LCD in place of a photograph. The device includes a microprocessor, memory, and modem. The device must be plugged into a phone line, and it functions by automatically dialing-up to a server where new digital images are stored. Based on user instructions made through a setup function on a website, a group of photos are sent to, and stored on, and displayed by the device. The Ceiva Picture Frame is a costly item due to the fact that it includes a large LCD, and also because it must include enough memory to store the digital images. However, the Ceiva Picture Frame is an example of digital content delivered beyond the PC.[0022]
• Internet access is also available through the use of wireless phones with Internet browsing capability and Personal Digital Assistants (hereafter PDAs) with wide-area wireless connections, such as the Palm VII, provided by Palm Computing of Santa Clara, Calif., or a Palm V with an OmniSky wireless modem, provided by OmniSky Corporation of San Francisco, Calif. The Palm VII uses the paging network, which provides among the lowest bandwidth connection available at approximately 2.4 Kbps. The OmniSky product uses the cellular wireless infrastructure which provides a maximum of 19.2 Kbps. Many wireless cellular phones now provide “wireless web” limited browsing capability. The slow data-rates provided by these products, as well as limited display area and awkward methods of user interaction, have resulted in slow adoption rates, and signals that users increasingly demand rich media experiences that can only be supported by broadband data-rates. Additionally, use of these products supports the trend of access to Internet content beyond the PC.[0023]
• AvantGo, Inc. of San Mateo Calif. provides software that channels content from the Internet to a Palm Pilot handheld device through a PC with an Internet connection. The Palm Pilot must be docked in its cradle for the transfer to take place. The personal computer is used mainly as a communication link, as none of the content is stored on the computer, it passes through the PC and is stored on the Palm Pilot. The user removes the Palm Pilot from the cradle and then accesses the information from the last download on the Pilot. The AvantGo system does not provide for rich media experiences as the Palm Pilot is limited in its processing power and Palm Pilot does not leverage the processing power of the personal computer. Although the Palm Pilot with the AvantGo service is not a real-time Internet device, it does further support the trend of access to Internet content beyond the PC.[0024]
• Cable, as well as satellite TV services are efficient in providing video content to a wide variety of users. However, most existing cable and satellite systems provide video delivery services on a broadcast model, that is, customers must choose from a set number of audio/video programs that are simultaneously broadcast, with the schedule determined by the broadcast networks. With the overlaying of data services over existing cable lines, there is the opportunity to provide a video-on-demand service whereby customers could order video programming of their choice at any time. However, a simple calculation will show that pure video-on-demand cannot be supported by the bandwidth available on the existing networks, due to the high data-rates required to transport high-quality video and audio in real-time.[0025]
• The convergence of the digitization of content, combined with the proliferation and decreasing cost of networking and data processing components, is providing the opportunity to deliver rich content via the Internet, to a variety of inexpensive devices beyond the personal computer. What is required is a system that provides an economically optimal architecture and management system for allowing users to set up preferences for content of varying types, including rich content, and other services, to be automatically delivered to inexpensive client devices.[0026]
SUMMARY OF THE INVENTION
• The present invention exemplifies the new and unobvious art of a system for delivering content, data, and application services to a variety of thin client devices. Briefly and generally, the system is used to provide a means for end users to program preference-based content for delivery at various client devices, and then to automatically or under the control of the user, send the content to client devices for presentation to the end user. Content from the Internet or otherwise digital content is accessed and cached locally in a server in the home or enterprise, so that wide area network bandwidth is optimized. The cached content is sent to thin client devices via a LAN communication link that is much faster than the wide area link, resulting in rich media experiences for the end user. The system also provides for inexpensive thin client devices, because the long term mass storage of content and data, and the processing of GUI instruction occurs at the local PC and/or storage gateway. The system for delivering content and services to thin client devices disclosed herein provides for a low total cost of delivering content beyond the PC, while insuring a high quality experience for the user in terms of audio and video quality, and simple interaction.[0027]
• Objects and Advantages[0028]
• Further objects and advantages of the present invention are as follows:[0029]
• (a) to provide a system where content delivery devices can be lower in cost due to the fact that mass storage, large displays, and the majority of device setup is offloaded to the PC or PC and caching gateway.[0030]
• (b) to provide high-bandwidth content delivery with a very low overall system cost.[0031]
• (c) to provide a system that optimizes the usage of broadband bandwidth, due to the fact that content can be sent to the local caching device during times when bandwidth is least expensive, such as in the middle of the night or during midday.[0032]
• (d) to provide a simple system for sending Internet content to client devices beyond the PC.[0033]
• (e) to provide a system that provides economically efficient content delivery by utilizing un-used processing power and storage capacity in a user's PCs.[0034]
• (f) to provide a means for configuring content and operational preferences for a thin client device that receives Internet content, by using the convenient and optimized interface available at a PC.[0035]
• (g) to provide a device with valuable real-time interactivity with a simple, low-cost human interface.[0036]
• (h) to provide a convenient drag-and-drop graphical user interface that allows users to make content selections using a web page and a local application.[0037]
• (i) to provide a system whereby content that is specifically preferred by an end user is automatically retrieved and stored on a local storage device for delivery at a pre-scheduled time or regularly scheduled interval.[0038]
• (j) to provide a system that allows single button activation interactivity by the end user.[0039]
• (k) to provide a system that allows users to gain access to information related to content they experience on thin client devices while engaged in other activities that make browsing at the very moment of experiencing the content impractical or inconvenient.[0040]
LIST OF DRAWING FIGURES
• FIG. 1. shows a block diagram of the system at the highest level.[0041]
• FIG. 2. shows a block diagram of the system control application.[0042]
• FIG. 3. shows an example console GUI on the PC desktop.[0043]
• FIG. 4. shows the web-based content guide GUI window and the audio device content editor GUI on a PC display desktop window.[0044]
• FIG. 5. shows the web-based content guide GUI window and the audio device content editor GUI after a content object has been dragged and placed.[0045]
• FIG. 6. shows the web-based content guide GUI window and the audio device content editor GUI with a dialog box launched.[0046]
• FIG. 7. shows the web-based content guide GUI window and the audio device content editor GUI with the “new playlist” text box open.[0047]
• FIG. 8. shows the web-based content guide GUI window and the Internet clock content editor GUI.[0048]
• FIG. 9. shows the web-based content guide GUI window and the Internet clock content GUI after a content module has been dragged and placed.[0049]
• FIG. 10. shows the web-based content guide GUI window and the Internet clock content GUI after a content module has been expanded from “Monday” to “Friday”.[0050]
• FIG. 11. shows the web-based content guide GUI window and the Internet clock content GUI and the softkey assignment pop-up menu.[0051]
• FIG. 12. is an isometric view of the audio playback device.[0052]
• FIG. 13. is an isometric view of the Internet clock.[0053]
• FIG. 14. shows a tag aggregation web page.[0054]
• FIG. 15. shows a PC desktop with the console and the audio device controller.[0055]
• FIG. 16. shows a PC desktop with the console and the Internet clock controller.[0056]
• FIG. 17. shows a functional block diagram of a storage gateway.[0057]
• FIG. 18. shows a digital image editor GUI.[0058]
• FIG. 19. shows a block diagram of the audio playback device/stereo system.[0059]
• FIG. 20. shows the audio playback device with the remote control removed.[0060]
• FIG. 21. is a block diagram of the tag response sequence.[0061]
• FIG. 22. shows a PC desktop with a content preference selection web page.[0062]
• FIG. 23. shows a system block diagram including a storage gateway peripheral.[0063]
• FIG. 24. is a home PC storage server setup flowchart.[0064]
• FIG. 25. is a flowchart showing the process of programming client device content on a website.[0065]
• FIG. 26. is a home PC storage server operation sequence.[0066]
• FIG. 27. is an image of a webpage for selecting the client device to program.[0067]
• FIG. 28. is an image of webpage which is a first setup page for an Internet clock.[0068]
• FIG. 29. is an image of a webpage for programming the content for an Internet clock.[0069]
• FIG. 30. is an image of a webpage showing the results of a users selection of content for an Internet clock.[0070]
DESCRIPTION OF PREFERRED EMBODIMENT
• First a description of the various components of the system is provided, then a description of the three functional modes. It should be noted that the functionality of the software and hardware pertinent to the invention disclosed in this document is described at several levels including at the interface level (what the end user sees and experiences) and at the action level (software and hardware interactions involving digital messages, content, and data). It is assumed that software engineers of reasonable ability would be able to program the functions described here using common programming languages and tools such as C, C++and Java programming languages, and Microsoft Foundation Classes (MFC), and other tools and development systems for other operating system such as VxWorks and Linux. Details of the software architecture are given when it is deemed to aid in the complete disclosure of the system.[0071]
• The system disclosed herein provides a communication connection and a content and data management system comprised of software and hardware on three different computing platforms: (1) the[0072]Internet8, (2) alocal PC34 orPC34 and astorage gateway38, and (3) thelocal client devices78a, b, c,andd. FIG. 1 shows a schematic of the invention disclosed here.PC34 is a conventional computer including a microprocessor, system memory,hard disk drive30, display, keyboard, and mouse, and runs the Windows operating system, provide by Microsoft of Redmond, Oreg.PC34 also includes a Universal Serial Bus (hereafter USB) port for connecting peripheral devices.PC34 is connected to content anddata10 onInternet8 via a wide area networkbroadband communication link14 that provides data delivery rates ranging from 500 kbps to 3,000 kbps.Broadband communication link14 is well known in the telecommunications and computer industry, thus the connection technology will not be described in greater detail. In the preferred embodiment,broadband connection14 is maintained byDOCSIS storage gateway38. FIG. 17 shows a block diagram of the functional hardware and software components ofstorage gateway38.Hard disk drive30 is combined with a conventional DOCSIS cable modem and aHomeRF LAN transceiver50. These subsystems are controlled by a computer comprised of a microprocessor280, and the SDRAM284 running an operating system, such as VxWorks provided by WindRiver Systems of Alameda, Calif. Thecore module42 software application described below, runs on and functionally connectsstorage gateway38 to the other system components.
• Referring again to FIG. 1, in the preferred embodiment, the high-[0073]speed LAN connection70 betweenPC34,storage gateway38, and devices78, is a HomeRF wireless network. The communications protocol betweenPC34 andInternet8 is HTTP and TCP/IP. TheGUI module46 software aspect ofsystem control application18 exists onPC34. In the preferred embodiment,core module38 aspect ofsystem control application18 exists and is run on bothstorage gateway38 and onPC34. The communication message structure between client devices78 andPC34 andstorage gateway38 are XML formattedmessages74 sent over HTTP. Web Content Guide Referring again to FIG. 1, content anddata10 onInternet8 is expressed on web pages as an organization of text and graphical information, some of which is configured as interactive hyperlinks, all of which are formatted using HTML for presentation to end user'sPCs34 via HTTP communication protocols. A contentselection web page22 is shown in FIG. 4 through FIG. 11. The graphical interactive representation of the portal to the end user is as a series of hyper-linked web pages and hyper-linked text and images. The physical manifestation of the portal is that of software and data stored on servers located at various and disparate physical locations, but connected byInternet8.
• [0074]Content10 onInternet8 is arranged for delivery tolocal client devices78a, b, c,anddby a system that allows for graphical icons, referred to in this disclosure as content objects20, that exist on contentselection web page22, to be dragged and dropped onto content editors on aPC34. Drag anddroppable content object20 is a graphical representation of a file system path that points to a digital content file stored locally onhard disk drive30 onPC34 or onstorage gateway38, or on a server onInternet8, or is the graphical designation of a URL or IP address and port number of an digital content stream originating on a server onInternet8. The purpose of the portal is to simplify and facilitate the discovery and selection ofcontent10 fromInternet8 for later use on client devices78.
• Content[0075]selection web page22 capability may include, but is not limited to the following functionality:
• 1) Presentation and organization of content and or links to content according to file type (e.g. MP3, MPEG, and the like), and or according to genre (e.g. music or video).[0076]
• 2) Further sub classification of content within file types or genres. For example a “music” category may be further divided into additional classifications such as “classical”, “jazz”, “pop”, “internet radio” and the like.[0077]
• 3) Additional information that is relevant to content links. For example, a song link may be displayed with information about the artist and or reviews and links to further information such as lyrics, artist concert schedule, and the like.[0078]
• 4) A means for searching for particular content on the web portal and or its affiliate links.[0079]
• 5) A means for retaining user preference information for the purpose of customizing the web portal content according to the users preferences.[0080]
• [0081]Content10 fromInternet8 that may be used in the system disclosed here may be selected from a wide range of contentselection web pages22, that may be formatted differently, and may be available from many different content creators and content aggregators. Content creators include for example the music labels, such as EMI or BMG, both of New York, N.Y., that is, firms whose business it is to create or commission to create, and own content. Content aggregators are firms whose business it is to collect certain types of content, such as digital music, for the purpose of enabling ease of selection by end users and distribution. Examples of content aggregators are MP3.com, or Listen.com.
• The capability for determining and aggregating the content objects[0082]20 presented to a specific user on contentselection web pages22 are derived from content preferences selections provided by the user. For example, referring now to FIG. 22 a content preferenceselection web page24 is shown with contentselection check boxes42 beside content selection labels46 that describe a variety of content choices. The user uses the mouse to click on the boxes next to desired content types, as shown in FIG. 22. Thereafter upon returning to contentselection web page22, onlycontent objects20 that relate to the selected content types are displayed to the user. Functionally, content selection labels46 are graphical representations of HTML links to actual content files, such as digital audio or digital video files. These links are organized and stored in a content link database126 on content link database server130. The actual content files to which content selection labels46 refer are stored at the content creator's or content aggregator's servers.
• System Control Application[0083]
• Referring now to FIG. 1 and[0084]2, asystem control application18 is comprised of two sub-applications, thecore module42 and the Graphical User Interface (hereafter GUI)module46. In the preferred embodiment,core module42 is implemented as a multi-threaded Java application with instances running on bothPC34 andstorage gateway38. A Windows version of a Java Virtual Machine (JVM) resides and runs onPC34 and interpretscore module42 instructions for the Windows operating system. Likewise, a VxWorks version of JVM interpretscore module42 instructions to VxWorks.GUI module46 is implemented as a Win32 application and resides and runs onPC34.System control application18 serves the function of managing the connection betweencontent10 and various servers onInternet8, andPC34 andstorage gateway38, and also manages the flow of information betweenPC34 andstorage gateway38, and client devices78.
• [0085]Core module42 andGUI module46 access and modify the systemcontrol application database96 using methods called over HTTP and expressed with XML grammar. Systemcontrol application database96 is a set of files that contain system parameters and data. For example, a track (song name) shown in audiodevice content editor24 is referenced as a file name and a path designation a particularhard disk drive30 on either ofPC34 orstorage gateway38, in a listing in systemcontrol application database96. Actions that are taken, such as playing this file, are triggered byXML messages74 sent from client devices78 viaLAN70 or fromGUI module46 to core modules(s)42 over HTTP.
• The GUI module consists of segments of the software application that run the GUI, including, but not limited to, the following functions:[0086]
• 1. Displaying GUI elements on a computer display for view by the end user.[0087]
• 2. Acknowledging user responses made via mouse and keyboard, or other pointing and interaction devices.[0088]
• 3. Allowing for manipulation of the GUI elements such as:[0089]
• a. drag and drop[0090]28 of content objects20
• b. GUI button activations[0091]
• c. text entry.[0092]
• d. pull down menu and menu selections.[0093]
• 4. Communication between[0094]GUI module46 andcore module42. The selections and control manipulations made by the end user are communicated tocore module42 where they can be acted upon.
• 5. Launching of specific device content and control editors from a[0095]system console16, as shown initially in FIG. 3, described below.
• [0096]Core module42 consists of the portion of thesystem control application18 that acts on content anddata10 fromInternet8 and also processes commands contained in messages sent from client devices78, providing, but not limited to, the following functions:
• 1. Communication links:[0097]
• a. Accessing[0098]content10 onInternet8 at a prescribed location as determined by user inputs into the GUI content editors such as audiodevice content editor24 and Internetclock content editor40.
• b. Accessing and communicating with[0099]GUI module46.
• c. Accessing and communicating with client devices[0100]78.
• 2. Managing the caching (local storage) of[0101]content10 fromInternet8 or otherwise digital content files.
• 3. Streaming of[0102]content10 fromInternet8 to client devices78 connected toPC34 andstorage gateway38 viaLAN70.
• a. Managing and routing streaming[0103]digital content10 fromInternet8 to client devices78.
• b. Managing and routing streams of cached[0104]digital content10 files onstorage gateway38 orPC34 to the client devices78.
• 4. Scheduling—time-based automation of the accessing, caching, and streaming of[0105]content10 fromInternet8 at times prescribed by the user or at times derived by direction given by the user through the GUI content editors such as audiodevice content editor24 and Internetclock content editor40. The scheduling function accesses time and date inputs associated with actions stored in systemcontrol application database96 by GUI module. The scheduling function periodically compares these time and date entries with the current state of PC's34 or storage gateway's38 internal timer. When there is a match, the action is taken.
• 5. Managing user responses at client devices[0106]78—messages are sent from client devices78 tocore module42, based on button activations at client devices78.
• 6. Network Address Translation (NAT) and routing—certain client devices[0107]78 must be connected to theInternet8 in real time.Core module42 acts to connect messages and streams from client devices78 toInternet8, and fromInternet8 to the client devices78.
• 7. Client device[0108]78 Application/Software Delivery—Client device78 application code can be stored atPC34 orstorage gateway38 and delivered to client devices78 on an as-needed basis. For example, if the network device isaudio playback device86 that must be able to decode a variety of different encoded audio streams, then a specific CODEC (sent as a BLOB—binary large object) can be delivered toaudio playback device86 viaLAN70 and installed into memory212 immediately before a content stream requiring that specific CODEC. Many different types of applications can be delivered just-in-time to client devices78. The advantage of this feature is that is requires for exampleaudio playback device86 to have smaller quantities of non-volatile (flash) memory216 and smaller quantities of volatile (SDRAM) memory212. Reprogramming or modifying the firmware220 at client devices78 is also made easier since the software is accessible atPC34 orstorage gateway38.
• 8. Transcoding—Certain types of content will be received at[0109]PC34 orstorage gateway38, decoded, re-encoded using a different CODEC atPC34, and then streamed to client devices78.
• 9. Auto-discovery—Client devices[0110]78 connected toPC34 viaLAN70 will automatically appear as a specific clientdevice control bar26 onconsole16 located onPC34desktop12. One or more client device control bars26 constituteconsole16, shown in FIG. 3 through FIG. 11.
• 10. Message Transactions—text or other content or data from the[0111]Internet8 can be transferred and presented ondisplay170 and display132 client devices78.
• 11. Tag servicing—when a[0112]tag button128 ortag button188 is pressed on one of client devices78, time, data, and information pertaining to currently playing content is aggregated into a message and sent to tag storage and processing server138. Tag processing services included incore module42 acquire information that is included in the message. Tagging is described in greater detail later in this document. Tag servicing includes a function wherecore module42 periodically accesses a specific location onInternet8 to acquire and store an accurate time and date.
• 12. Synchronization—Data, such as user data and related information, such as an accurate time and date, must be synchronized across the three platforms (web, device, and local server).[0113]Core module42 time and date data is thus synchronized with an external (absolute) standard.
• 13. Mirroring—Users can specify that content selections they make using the device content editors are to be mirrored at various other devices. For example, a user may have[0114]audio playback device86 and a car caching and playback device. The user can specify that they want content10 fromInternet8 that is cached onstorage gateway38 in the home to be mirrored exactly in the car-based caching device. The end user can thereby access all of the exactsame content10 in the same playlist structure in both the home and in the automobile.
• [0115]System control application18 and systemcontrol application database96 are designed to function with a number of instances ofcore module42 andGUI module46 running concurrently onmultiple PCs34 and orstorage gateways38, all connected by thesame LAN70. It is anticipated that users will own and operatemultiple PCs34 in a single home for example, withdifferent content10 cached on eachPC34. However, for the purpose of simplicity in describing the basic functionality of the system, the preferred embodiment will focus will be on a singular GUI module located and executed on a PC.
• Client Devices[0116]
• Client devices[0117]78 can take many physical forms but the common attribute is that it client devices78 are nodes onLAN70, receiving digital content anddata10, and instructions, fromcore module42 subsystem of thesystem control application18, and sending backXML message74 control instructions and data from interaction or data that originates at client devices78. In the preferred embodiment client devices78 includewebpad92,audio playback device86,Internet clock82, digital picture frame100, and automotive storage device142. Generally, client devices depend onLAN70 connectivity to provide the majority of their functionality. Client devices78 range widely in the amount of integral memory capability. For purposes of clarity, the preferred embodiment shows in detail how content is set up, organized, and scheduled for delivery to two media player devices:audio playback device86 that is connected to astereo receiver114, and Internet connectedclock82. However, it should be clearly understood that the system is designed to function with a wide variety of networked client devices78 andaudio playback device86 andInternet clock82 are described as examples of how the system functions.
• FIG. 12 shows an isometric view of the[0118]audio playback device86. The purpose ofaudio playback device86 is to functionally connect digital audio content from a remote digital audio source to an already existing conventional stereo system.Audio playback device86 receives a stream of encoded audio content fromPC34 orstorage gateway38, real-time decodes it in real-time, and converts the uncompressed digital information into analog electrical signals.Audio playback device86 includes a plastic injection-moldedmain housing168 that contains a printed-circuit board (PCB)218. PCB218 electrically connects the components of a computer, comprised of a microprocessor208 with dynamic memory (SDRAM)212 and programmable (flash) memory216. Microprocessor208 in combination with dynamic memory212 executes instructions from its operating system and programming, referred to as the firmware220 stored in programmable memory216.Audio playback device86 also includes a wireless network interface sub-system228 for communicating withPC34 andstorage gateway38, an infra-red (IR) control sub-system146 for processing IR commands from the IRremote control90, and adisplay170 sub-system for presenting text and graphical information to the user.Audio playback device86 also includes a digital-to-analog converter (DAC)224 for converting the uncompressed digital information into analog signals that are presented at the standard left and right RCA connectors,240 and244.Audio playback device86 firmware220 also includes a CODEC for decoding the audio file that is streamed to it fromPC34 orstorage gateway38. In this embodiment,remote control90 can be attached toaudio playback device86front bezel164, as shown in FIG. 12. FIG. 20 showsremote control90 removed from the front bezel. FIG. 19 is a block diagram showing howleft analog output240 andright analog output244 included in audiocontent playback device86 are connected respectively to theleft line input248 andright line input252 on existingstereo receiver114.Stereo receiver114 functions in the conventional way, pre-amplifying and amplifying the audio signals and delivering them to the left speaker272 and the right speaker276. As shown in FIG. 19,audio playback device86 also includes a terrestrial broadcast tuner subsystem236 for tuning local AM and FM broadcast radio.
• [0119]Audio playback device86remote control90 includes button controls for the following functions:Power button196—for powering the device on and off; Source/User button204—for selecting the user (owner of playlists and corresponding tracks) or for selectingstorage gateway38,PCs34, or terrestrial broadcast, from whichcontent10 fromInternet8 or other terrestrial content will be delivered;Playlist forward button176 and playlist backbutton172—for advancing through and selecting playlists;Track forward button184 and trackbackward button180—for advancing through and selecting tracks for playback; Play/Pause button192—for starting and pausing (stopping at point in the middle of a playback of an audio file);Stop button200—for stopping playback of audio content;Tag button188—for triggering the transmission of information about a currently playing track (file,Internet8 stream, or terrestrial broadcast) back through the system for delivery to the end user on a website or for delivery to the content creator or content originator; User-definedbutton206—This button may be associated with a variety of functions as selected by the user using the audio playback device setup GUI.
• The text descriptors associated with the playlists and associated tracks are sent to[0120]audio playback device86 when requests are made by button activations. For example, if the user activatesforward playlist button176, the text string for the next playlist after the one that is currently being played is sent toaudio playback device86 viaLAN70, is processed, and the text is displayed ondisplay170. Likewise if forward-track button184 is activated, the text string that is the name of the next sequential file from the current playlist stored in systemcontrol application database96 located onstorage gateway38 orPC34, is sent bycore module38 toaudio playback device86, where the text string is displayed ondisplay170. Ifplay button192 is then activated, the currently playing track is halted and the track that is being displayed is sent, decoded, and played through the stereo system. The functional interface to the user ofaudio playback device86 is similar to that found on a typical CD changer, where the CD represents the playlist, and the tracks on the CD represent the tracks in the playlist.
• FIG. 13 shows an isometric view of[0121]Internet clock82.Internet clock82, is similarly comprised of a plastic injection-moldedmain housing122 with a microprocessor156, dynamic memory140, non-volatile memory144,TFT display132, and operating system and firmware146 programming.Display132 onInternet clock82 in the preferred embodiment is a large TFT graphics LCD, capable of showing images with 8-bit color. The control buttons or dials onInternet clock82 include the following:
• 1. The[0122]Softkey buttons124a, b, c, d,ande, along-side display132 that are labeled by graphics ondisplay132. Softkey buttons124a-ecan be used as presets to allow the user to jump to content presentations that are associated with each button by a GUI pull-down menu52 on Internetclock content editor40, as shown in FIG. 11.
• 2. Volume dial[0123]
• 3. Snooze button[0124]120 (on/off)
• 4. Source select (terrestrial radio,[0125]Internet8 content)
• 5. The[0126]Tag Button128—for triggering the transmission of information about a currently playing track (file,Internet8 stream, or terrestrial broadcast) back through the system for presentation to the end user on tagaggregation web page56, or for delivery to the content creator or content originator.
• [0127]Internet clock82 includes microprocessor156 and memory140 sufficient to receive and decode a full-motion video stream.Internet clock82 also contains an integral sound system consisting of an amplifier andspeakers136. ThereforeInternet clock82 is capable of presenting audio, video, and interactive multimedia. The digital electronics and packaging technology for such a devices is well known in the consumer electronics industry, so it will not be described in greater detail.
• Preferred Embodiment—Use of the System[0128]
• There are three functional modes: (1) setup, (2) real-time user controlled content/data delivery, and (3) automatic content/data delivery.[0129]
• The setup functions provide the user with the ability to organize and manage content that is to be sent to a device.[0130]Content10 may be stored or generated onInternet8, or may exist on a local storage device, such on the PC's34hard disk drive30, or onstorage gateway38. This content is organized and managed with the use of device content editors that are an aspect ofGUI module46 ofsystem control application18.
• A content editor is a part of[0131]GUI module46 and is used for managing and manipulatingcontent10 that will be sent to networked client device78. The preferred embodiment will describe audiodevice content editor24, used to program andcontrol content10 foraudio playback device86; and Internetclock content editor40, used to program and control content forInternet clock82. Content editors are launched fromconsole16. This action is explained later in this disclosure.
• Audio[0132]device content editor24 provides the user with the ability to group audio files (tracks) into user-defined playlists, which are text association that contains a list of and paths to audio files or the URLs or IP addresses of audio streams, and are stored in systemcontrol application database96. For example, a user may create a playlist called “Classical Music” that contains ten Beethoven symphonies. A common type of audio file format is the MP3 (MPEG layer3) format. Certain tracks such as MP3 music files are stored onhard disk drive30 onPC34, while other tracks such as streamedInternet8 radio, are stored as URLS or IP addresses. Streamed media can be in a variety of formats. A popular format is in the Windows Media format, created by Microsoft Corporation of Redmond, Oreg. The audiodevice content editor24 capability includes, but is not limited to, the following functionality:
• 1. Display playlists[0133]
• 2. Display tracks in a playlist[0134]
• 3. Create a new playlist[0135]
• 4. Delete a playlist and its associated tracks[0136]
• 5. Add a track to a playlist[0137]
• 6. Reorder playlists (accomplished by dragging and dropping the playlists in the GUI window frame)[0138]
• 7. Delete a track from a playlist (highlight the track, activate the “delete” button)[0139]
• 8. Reorder tracks in a playlist (this is accomplished by dragging and dropping the tracks in the playlist editor).[0140]
• The interaction between audio[0141]device content editor24 and the other elements of the system will be discussed later.
• The function of Internet[0142]clock content editor40 is to managecontent10 that is associated with a scheduled routine, such as a wakeup routine. Internetclock content editor40 allows the user to associatecontent10 such as audio or video files (stored on the user'shard disk drive30 or streamed over Internet8) with an associated time and date. A set of content selections for the one-week period shown on Internet clock content editor in FIG. 8 is called a wake-up routine. For example, referring now to FIG. 9, the user can associate a pointer to a news stream from theInternet8, shown as “MSNBC” in the figure, to be triggered at 8 am on Monday through Friday. This association is created by dragging and dropping28content object20 from contentselection web page22, to Internetclock content editor40. At the prescribed time, the scheduler function incore module42 initiates the serving of content designated bycontent object20, toInternet clock82, where it is played or presented to the user to wake them up, or for other purposes where automatic triggering is required.
• The Internet[0143]clock content editor40 capability includes, but is not limited to the following functionality:
• 1. Display calendar (time, days, weeks, months, dates, and the like)[0144]
• 2. Select and associate content with a time and date[0145]
• 3. Add additional content to a pre-existing routine[0146]
• 4. Delete a content object from a routine[0147]
• 5. Play audio files from an audio playlist (a playlist made using the audio device content editor)[0148]
• 6. Schedule the display of graphics files, such as a series of digital pictures on[0149]Internet clock82 when it is not executing a scheduled wake-up routine.
• 7. Associate a content type or content module with one of the softkey buttons[0150]124 located besidedisplay132.
• 8. Synchronize with a user's personal (digital) information manager (PIM), such as a Palm Pilot made by Palm, Inc. of Santa Clara, Calif., or the Cassiopeia, made by Casio Inc., of N.J.[0151]
• Both audio[0152]device content editor24 and Internetclock content editor40 are launched manually by the user by clicking on the associated clientdevice control bar26 onconsole16. FIG. 3 showsPC desktop12 withconsole16 showing three client device control bars26 (the PC's speakers here are not considered a client device although audio can be channeled to them). For example, considering FIG. 3 as the initial state of launched and runningsystem control application18, using the mouse the user would position the pointer onPC desktop12 on clientdevice control bar26 that is associated withaudio playback device86 and activate the left mouse button. Audiodevice content editor24 launchs and the result is shown in FIG. 4, with audiodevice content editor24 displayed onPC desktop12.
• [0153]PC desktop12 in FIG. 4 also shows contentselection web page22. Contentselection web page22 can be launched in a number of ways. One method for launching contentselection web page22 is to activate theContent Guide button30 located on the bottom ofconsole16 by using the mouse to place the pointer on top ofContent Guide button30, and pressing and releasing the left mouse button. Another launching method is to have contentselection web page22 “bookmarked” (Netscapte Navigator) in a browser, or added to a “favorites” list in a browser (Microsoft Internet Explorer). This type ofInternet8 browsing shortcut to a specific web page is well known in the computer industry.
• The spherical icons on content[0154]selection web page22 arecontent objects20 that are dragged and dropped onto the audiodevice content editor24tracks window34. Using the mouse to control the pointer onPC desktop12, the user moves the pointer on top ofcontent object20, depresses the left mouse button, and moves the pointer-content object20 bundle totracks window34 of audio device content editor24 (while continuing to depress the left mouse button). When the user releases the left mouse button, a text description ofcontent object20 appears intracks window34 of audiodevice content editor24. FIG. 5 shows thatcontent object20 “Top40 Radio” has been dragged from contentselection web page22 to audiodevice content editor24tracks window34, with drag anddrop path28 depicted. The user would perform this drag and drop operation on content objects20 for which playback ataudio playback device86 is desired. For example, the “Top40 Radio”content object20 represents the URL of anInternet8 radio stream. As shown in FIG. 6, the user can also add audio files to the playlists using a conventional Windows dialog box that allows the user to navigate to a specific subdirectory onPC34. This type ofPC34 file access is a well known function ofPCs34. Audiodevice content editor24 also provides the capability for the user to create playlists. This is accomplished by using theNew List button37, shown as part of audiodevice content editor24 in FIG. 4 through FIG. 7. FIG. 7 shows that a playlist creationtext entry box36 is launched when the user activatesNew List button37.
• On the software action level, when a user creates or modifies a playlist by adding tracks such as described above using audio[0155]device content editor24,GUI module46 modifies systemcontrol application database96, a file that contains the text names of playlists, the file names and paths of local content files, and URLs of streams, that the user has selected as tracks. A copy of systemcontrol application database96 is stored on both the PC's hard disk drive and on the storage gateway's hard disk drive. In the preferred embodiment, a portion of the files that are set up by the user as tracks in playlists that are accessed ataudio playback device86 are stored onstorage gateway38. In this scenario, the user can still access tracks stored onstorage gateway38 ataudio playback device86 ifPC34 has been shutdown. The system may also function with the some or all of the files that constitute the tracks listed in audiodevice content editor24 stored on thePC34. It is obvious thatPC34 must be booted and functioning for the user to access any files stored onPC34. The action of accessing those files ataudio playback device86 is discussed below.
• FIG. 8 shows an initial state for using the Internet[0156]clock content editor40. Internetclock content editor40 is formatted as a calendar (with a time domain format), sinceInternet clock82 will have varying content depending on the time of day or night. Internetclock content editor40 is also launched fromconsole16 in the same way that audiodevice content editor24 is launched. FIG. 9 shows Internetclock content editor40 aftercontent object20 has been dragged onto the editor window in the “Monday” slot. FIG. 10 shows that the user has draggedcontent object20, expanding it across the weekly calendar slots, stopping on the “Friday” slot. Oncecontent object20 is dragged and placed onto Internetclock content editor40,content object20 is referred to as anexpandable content bar48. Expandable content bars48 are dragged across the day sections of Internetclock content editor40 by using the mouse to position the pointer on the right side of expandable content bars48, depressing the left mouse button, dragging across Internet clock content editor40 (expandable content bar48 will graphically elongate) while keeping the mouse button depressed. The mouse button can be released whenexpandable content bar48 is dragged to the last day on whichcontent10 referred to byexpandable content bar48 is to be played. Again referring to FIG. 10, the result of this programming activity is that every day of the week between Monday and Friday,core module42 will automatically sendprescribed content10 toInternet clock82 at the time indicated on left hand side of Internetclock content editor40, or at the time that the user has set as the wake-up time atInternet clock82. Settings atInternet clock82 take precedence over Internetclock content editor40 settings.
• In setup mode,[0157]GUI module46 receives commands from the user via the GUI that is drawn onPC desktop12. The user's actions and decisions are recorded by device content editors such as Internetclock content editor40 and audiodevice content editor24 which compriseGUI module46, are encoded as digitally described messages, and are then communicated to and stored in systemcontrol application database96 bycore module42. In the preferred embodiment, wherecore module42 exists as a JAVA software program onstorage gateway38,content10, the playlists, and names of tracks and stream addresses, are stored onhard disk drive30 atstorage gateway38.PC34 also contains a copy of systemcontrol application database96.
• Preferred Embodiment—Real-time Mode[0158]
• In real-time mode, the user can activate and control the delivery of[0159]content10 that has been set-up in audiodevice content editor24, either ataudio playback device86, or atPC34. In the preferred embodiment whereaudio playback device86 is connected tostereo receiver114, the user can access the playlist information on an interface ataudio playback device86. FIG. 12 shows thatremote control90 is used to access the source, playlist, and track (content object20) ataudio playback device86.Display170 included onaudio playback device86 displays text information according to the manipulations of the controls by the user. For example, when the user presses forwardplaylist button176 onremote control90, an IR stream is transmitted fromremote control90 and is received byIR subsystem104 onaudio playback device86. This message is decoded by microprocessor208 inaudio playback device86 as a forward select button selection, and anXML message74 is sent fromaudio playback device86 tocore module42 requesting that a string of text that represents the next playlist title be sent via high-speed LAN70 toaudio playback device86.Core module42 receivesXML message74 and sends the text string representing the next playlist toaudio playback device86, via high-speed LAN70. Microprocessor208 processes thisXML message74 and displays the text string onaudio playback device86display170.
• When[0160]play button192 is pressed, againIR subsystem104 triggers XML formattedmessage74 to be sent tocore module42 stating thatplay button192 was activated.Core module42 determines the present file or stream listing onaudio playback device86display170, and initiates a stream of that file orInternet8 stream toaudio playback device86.
• The other method for controlling client devices is to use a device controller GUI on[0161]PC34. Device controllers are launched fromconsole16 by right clicking on clientdevice control bar26 onconsole16 associated with the specific device that is to be controlled. FIG. 15 shows the audioplayback device controller60 and FIG. 16 shows the Internetclock device controller88. The function of a device controller is to remotely control networked client devices78, and to also allow for the setting of certain preferences and features for client devices78. Thus continuing with our previously mentioned examples, audioplayback device controller60 is used to directly controlaudio playback device86, such as to instructaudio playback device86 to play, stop or pause on a particular track. SimilarlyInternet Clock controller88 is used to directly controlInternet Clock82 such as to turn Internet clock on or off, or set the date or time, as shown in FIG. 16.
• The following is a list of controls and features for audio playback device controller[0162]60: a play/pause button80 (holding down play button causes the player to fast forward, playing brief samples of the audio file at muted volume); astop button76; a track backwardbutton72; atrack forward button84; abalance slider94.
• The following is a list of controls for features on Internet clock controller[0163]88: ramp display back light during wakeup routine (slowly increase the light of the display during the wakeup routine); ramp audio volume during wakeup routine (slowly increase the volume of the device during the wakeup routine; length of dwell time for snooze button (the length of time thatInternet clock82 is dormant aftersnooze button120 is activated; deactivate snooze button120 (no snoozing); length of time for sleep mode (the length oftime Internet clock82 will playcontent10 when activated at night while the user is falling asleep). The function controls now shown in FIG. 16 are available on an additional menu accessed by activating “more”button112.
• Preferred Embodiment—Automatic Mode, Playback[0164]
• In automatic mode,[0165]content10 that the user has selected for playback in the content editor is sent automatically to the playback device, based on some prescribed time setting that was pre-set by the user. A scheduling function incore module42 compares time inputs listed in systemcontrol application database96 with the current state ofPC34 system timer. When a match occurs between a time input in systemcontrol application database96 and the current state ofPC34 system timer,core module42 initiates the delivery ofcontent10 to client device78. In the case wherecontent10 is a stream from a URL onInternet8, a connection is created bycore module42 between the streaming URL viabroadband communication link14, throughstorage gateway38, and viaLAN70 to client device78.
• Preferred Embodiment—Automatic Mode, Caching[0166]
• Certain content objects[0167]20 designate a location for file-basedcontent10 that changes on a regular basis. In this case, a specific file is acontent object20 instance that is cached onlocal PC34 orstorage gateway38 and streamed to client device78. For example,content10 forInternet clock82 may include a digital audio file with news located on a server onInternet8 that may be updated every four hours. Ifcontent object20 instance is a file designation that is not local, the scheduling function incore module42 will periodically check the file at its location onInternet8 to see if the file has changed. It will do this by comparing the locally cached file's creation date and title, and other file information, with the file located onInternet8. If the file's creation date and/or title has changed, the new file will be downloaded and stored onPC34 orstorage gateway38, so that the latest file can be sent to client device78 at the prescribed time. This is part of the scheduling function listed incore module42 functions in FIG. 2.
• [0168]Storage gateway38 is an “always-on” device. Therefore the scheduling function running oncore module42 onstorage gateway38 can be set to automatically access and acquirecontent10 onInternet8 at times when wide area network bandwidth is less expensive, such as overnight or during midday.Core module42 onstorage gateway38 call also limit data-rates at certain times to further optimize wide area network bandwidth usage. For example,core module42 can be limited to download data-rate speeds of 200 Kbps during the hours of 4 pm to 10 pm, and allowed to download at the maximum broadband rate any other time. This download optimization setting can be set by users, who may want access to bandwidth while they are home in the evening, or it may be set by network operators. These data-rate control settings and times may be set using a network bandwidth optimization control GUI, accessible by user atPC34 or by network operators remotely. The data-rate control settings and times are stored in systemcontrol application database96.
• Preferred Embodiment—System-wide Functions—Tag Interactivity[0169]
• Because[0170]LAN70 technology is a two-way interconnection technology, responses from client devices78 can be sent back through the system and processed and presented to the user and other interested entities at bothPC34 and on the web. FIG. 12 showstag button188 onaudio playback device86. FIG. 13 showstag button128 onInternet clock82. During the playing ofcontent10, activation oftag button128 by the user results in a transmission ofXML message74 back throughLAN70 informingcore module42 that thetag button128 was activated.Core module42 then compiles and transmitstag XML message74 to tag storage and processing server138. This process is described in FIG. 21. The information incore module42tag XML message74 may include but is not limited to: metadata or meta-tags included in the file or stream (characters or images); the file name ifcontent10 is a file; the URL or IP address of the stream ifcontent10 is a stream; time; date; and user identifier.
• The transmission of[0171]tag XML message74 can have different results. FIG. 14 shows that the information in the message formatted as a readable text message and presented to a user on a personal tagaggregation web page56. In this scenario, the user has signed up with an account and receives a password for entry into protected tagaggregation web page56.
• The tagging function requires that[0172]core module42 always have access to accurate time and date information. FIG. 2 shows thatcore module42 has a function that accesses a server onInternet8 where accurate time and date data is available, and these quantities are stored locally bycore module42 in systemcontrol application database96 and is updated relative to the internal time and date timer located internal toPC34 orstorage gateway38 that stores and runscore module42 aspect ofsystem control application18.
• Alternative Embodiments[0173]
• An alternative embodiment of this system includes the TV as an output device for using[0174]GUI module46 aspect ofsystem control application18. In this embodiment,system control application18 resides on a set-top box that includes the components and functionality ofstorage gateway38. Set-top boxes are available that include a DOCSIS cable modem as well as a CATV tuner,hard disk drive30, and microprocessor280. In this system, the TV can be used as the output device on which the device control GUIs are visually presented, and a set top box remote control with a cursor pointing function is the input device. The GUI images look and function virtually identically to those shown in FIG. 3 through FIG. 11. Most set-top boxes already contain the circuitry and firmware to draw images on a TV screen (NTSC format), soGUI module46 would be minimally modified to support the number of pixels on conventional TV screens.
• Alternative Embodiment—Storage Gateway Peripheral[0175]
• A storage gateway peripheral[0176]134 is defined as a computer with a integralhard disk drive30 and processing capability, and an integral wireless LAN transceiver58 to provideLAN70 connectivity, that is added to an existinggateway150 device for the purpose of addingcontent10 mass storage and serving capability. FIG. 23 shows a networktopology including PC34, aconventional gateway150 that is a DOCSIS cable modem. Storage gateway peripheral134 is connected togateway150 via a wired LAN connection, in this case Ethernet, that is included in allgateways150. Storage gateway peripheral134 is always-on, and includes power management features such as the ability to power downhard disk drive30.Core module42 is stored and runs on storage gateway peripheral134, thus all of the services and functions provided by a system using astorage gateway38 are provided with the use of a storage gateway peripheral134.
• Alternative Embodiment—GUI Content Editors on Storage Gateway or Gateway Storage Peripheral[0177]
• The content editors can be programmed and executed across the network as Java applications stored on[0178]storage gateways38 or on a storage gateway peripheral134 device. The advantage of this is that any computer with a display and input peripherals such as a keyboard and a mouse, and that has a Java Virtual Machine (JVM), would be a viable client device content programming, set-up, and control workstation. This embodiment could also be implemented so that it was entirely browser-based. A user could access the device content editors within a browser window, with the application running as a Java applet.
• Alternative Embodiment—Digital Image Player and Sequence Editor[0179]
• Another device that can exist as a client device in this platform is digital picture frame[0180]100. One implementation of digital picture frame functionality is to set upInternet clock82 to present a timed sequence of digital images onLCD132 whenInternet clock82 is not being used for presentation ofother content10.Internet clock82 can be set up to present digital images either automatically or under direct control of the user.
• The user could attach a digital image to one of the softkey buttons located on[0181]Internet clock82. A separate GUI, thedigital image editor96 would be accessed via the left-mouse-click onInternet clock82 clientdevice control bar26 located onconsole16. Launching this editor is similar to launching audiodevice content editor24, described previously. FIG. 18 shows an example ofdigital image editor96. There is a frame into which the user can drag-and-drop image files, or the user can navigate to image files via a conventional dialog box, and add these image files to the frame. The frame would then show a small image of the actual file. The user can drag-and-drop these images to reorder them.
• Alternatively, dedicated digital picture frame[0182]100 can be used to display digital images. Referring again to FIG. 18,digital image editor96 is a GUI that is used to create a digital image playlist for such a device.Digital image editor96 is launched by left-clicking on the “digital image player” clientdevice control bar26 onconsole16.
• Alternative Embodiment—Digital Video Caching[0183]
• The system for providing content distribution, management, and interactivity for thin client devices can also be used to access, store, and serve digital video, such as movies, TV shows, and other video content. User's make selections on a web site as disclosed herein. Digital video files, such as DVD movies are then downloaded and stored on user's[0184]PC34,storage gateway38, or storage gateway peripheral134. The digital video files would then be sent to a client device78 that is a TV, or any other client device that can decode and present digital video. For example, a PDA with awireless LAN70 capability and the ability to decode MPEG-2 video would be a viable terminal client device78. The advantage of this system, as opposed to streaming digital video directly from a cable headend or DSL ISP is that is makes better use of network bandwidth. Digital video files are very large, potentially several giga-bytes (billions of bytes). The downloading of these large files can be spread out over a longer period of time than would be required if the digital video files are streamed and viewed in real-time. The digital video files can always be downloading during periods of inactivity on wide areabroadband communications connection14. Additionally, the download data-rates can be controlled based on the time of day. For example,core module42 includes a data-rate control function described in this disclosure. The allowable data-rate can be reduced for peak times of wide area network usage, and can be increased during off-peak times.
• Alternative Embodiment—Automated PC-only[0185]
• The system for providing content and other information services to thin client devices can be implemented with just[0186]PC34.System control application18 resides onhard disk drive30 onPC34 and provides all of the functions and features including those provided bycore module42 andGUI module46. Systemcontrol application database96 also resides onPC34, as well as all cachedcontent10. In this embodiment,LAN70 is established by the use of a HomeRF wireless LAN access point54. The wireless LAN access point54 is a self-contained device that communicates withPC34 via the USB port. Wireless LAN access point54 includes an RF network interface transceiver58, and a microprocessor116 and firmware for managing the transfer of data betweenhost PC34, and anantenna112. There is also an antenna integrated into a plastic housing. Wireless LAN access point54 gets its power from the USB connection. In this embodiment, the wireless LAN access point54 could also be incorporated into an internal add-on bus card, such as a card that would attach to the PCI bus. Such peripheral bus cards are well known in the field of PC design. In the case of a bus card, there would be an external antenna.
• The automated services function of[0187]core module42, wherebycontent10 is automatically accessed, downloaded and cached onPC34, and wherebycontent10 is automatically streamed to client devices78, is facilitated ifPC34 is always on, or ifPC34 can be automatically turned on (booted).PC34 includes a Basic Input Output System (hereafter BIOS) for controlling the basic functions of the system. The BIOS may also be used to automate the booting ofPC34. In the implementation wherebyPC34 boots automatically,system control application18 includes software that can modify the BIOS software ofPC34 so that automatic pre-scheduled activation ofPC34 is enabled. Subsequent control ofPC34 to connect to theInternet10 and perform operations, is also provided by the scheduling function incore module42. The BIOS consists of a set of instructions and data that the microprocessor uses as part of its initial sequence of operation. These instructions are stored in a BIOS flash memory chip, which is a nonvolatile type of memory chip, so that the instructions and data are retained when power to the computer is turned off. BIOS software and design, as well as reprogrammable flash memory technology, is well known in the PC industry and will not be described in detail here. The date and time that the computer uses for various purposes is a function that is controlled by the BIOS chip and interface. Typically, a PC motherboard includes a timer and date function that is backed up by a battery on the motherboard. The purpose of this system is so that when the computer is turned on, the operating system has access to accurate time and date information. Since the time and date (timer) function is always operating on a computer motherboard, and this system is connected to the BIOS, most BIOS systems include an automated wakeup function. This is a function that operates internal to the BIOS chip and can be activated or de-activated. If the automatic wake-up function is turned on and a specific time and date is entered and stored in the BIOS memory, a software function operating in the BIOS continually compares the current date and time with a designated wake-up time and function that is stored in memory. When the two times and dates match, a power-on command is given andPC34 power-up sequence begins. The BIOS modification software automatically modifies the BIOS from the OS level, so that the user doesn't have to access the BIOS during the early phase ofPC34 boot.
• Another function that is performed by the BIOS modification software is to modify the internal settings of[0188]PC34 that control the power saving modes and control parameters which include parameters such as when the PC display is turned off, and when drives are spun down whilePC34 is operating. The BIOS modification software allows for the “always-on” operation ofPC34. In this case, the PC can be put into a low-power mode with monitor off and with the drive not spinning. Control of various power saving modes is also provided for users at the operating system level. The Advanced Configuration and Power Interface, created by Intel of Santa Clara, Calif. is a set of functions that provide control ofPC34 power usage, allowing the computer to be put into various suspend states, as well as spinning down drives and other functions. Power control functions incore module42 modify ACPI settings, providing for quiet, low power operation ofPC34.
• The function of this embodiment will now be described.[0189]PC34 exists in the user's home, or other location where there is a desire for the ability to playInternet8 content ordata10, including multimedia content, on one or more standalone devices apart fromPC34. There is a setup activity for the system, requiring several one-time actions by the user. Then there is an actual use scenario. Referring now to FIG. 5, first, the setup activity will be described.
• [0190]PC34 is booted (started up) and a connection toInternet8 is made. This is achieved by using the dial-up networking function that is standard on any machine with the Windows operating system. This connection could also be an always-on DSL, ISDN, or cable modem connection. Once a connection is made toInternet8, browser software is started and the user would navigate to a specific information appliance setup website associated with the system and the devices. This website would have a particular URL that would be supplied in the instruction materials that come with wireless LAN access point54 or client device78. Using the browser, or other interface to the website server, the user would navigate to a setup page at the website that asks for a serial number of client device78 that the user is planning to use. The user would then connect the USB cable on wireless LAN access point54 to the USB port onPC34. The user would then enter this serial number, which is included in the documentation that is included with the end-user device. The online application has a database of these serial numbers that are associated with each individual manufactured client device78 (including both wireless LAN access point54 and client device78) that are distributed into the market. Once a match is made between the serial number that the user entered at the website, and a serial number that is included in the online database, an online application automatically begins downloading and installingsystem control application18 to user'sPC34. This software is installed on user'sPC34 and provides the following functions.
• A scheduling function determines when[0191]PC34 automatically connects to the Internet. IfPC34 is running in a power saving mode, such as with the display turned off and with the drives not spinning, the scheduling function will initially act to take thePC34 out of power saving mode, and then to automatically connect to the Internet using the Dialup Action. Many users will already havePC34 set up to dial up to an Internet service provider (ISP). In this case, the dialup networking function that already exists will be used. If the user does not have this installed onPC34, an application is included that will install the correct dialup information, so that a connection is made to the correct ISP and server.
• At 12 am,[0192]PC34 automatically boots and dials up the ISP. AnInternet8 connection is established.PC34 automatically connects to the web server associated with client device78. Here the user's account is referenced as well as the identifying serial number of user's client device78. A volume ofcontent10 that the user specified to be automatically delivered toInternet clock82 is downloaded to user'sPC34, where it is stored on thePC34hard disk drive30. After the content has completely downloaded,PC34 terminates the connection to the ISP, and shuts down. This occurs at 1:30 am. At thispoint PC34 may also be kept on, as selected by the user during the configuration of the system.
• At 5:30 am, the PC again automatically boots. The wireless communication system establishes a connection to[0193]Internet clock82. At 6:00 am, the specified wake up time of the user,PC34 initiates the transfer of content toInternet clock82. This content is presented to the user as sound and images, waking up the user.
• Alternative Embodiment—Web-based System Control Application[0194]
• In an alternative embodiment there is a website that is accessed for the purpose of downloading and setting up the[0195]system control application18 onPC34, and for controlling the content that is sent to client devices78, and for controlling the features of client devices78. This website is accessible from any computer that is connected to theInternet8 and includes a browser. The website also contains a database for storing the content preferences of the user or owner of client devices78. These content preferences include pointers to the locations of the content entities, such as audio files, video files, or text files, onInternet8 that the user had specified to be played on client device78. The website could also include a server-based version ofsystem control application18 that would retrieve and store content and data according to user preferences on the web.
• Alternative Embodiment—Webpad Client Device[0196]
• In this embodiment, client device[0197]78 is a portable computing device referred to as awebpad92, able to be carried around the house or within range ofLAN70.Webpad92 includes a set of rechargeable batteries and a battery recharging system. There is also a dock into which thewebpad92 is placed during times when it is not used. When it is docked, there are electrical contacts in the dock that make contact with the electrical contacts onwebpad92 and the batteries are recharged.Webpad92 also has stored in its non-volatile memory an identifying serial number, which is used to identifywebpad92 on the wireless network, and is also used to coordinate the content that is specified by the user to be sent to and cached at thelocal PC34, and ultimately sent wirelessly towebpad92. For example, users can access cached content onPC34 orstorage gateway38 such as digital, searchable Yellow Pages or White Pages, and other reference databases. Additionally, webpad92 can access theInternet8 viaPC34 orstorage gateway38, utilizingPC34 orstorage gateway38 as a router.
• Furthermore, webpad[0198]92 can be used to control other client devices78. For example, awebpad92 version of audio device content editor and audio device controller GUI allow the user to access playlists and tracks, and controlaudio playback device86 in real time while away fromPC34.XML messages74 are sent fromwebpad92 toPC34 orstorage gateway38, processed bycore module42, and appropriate XML messages are sent toaudio playback device86.
• Alternative Embodiments[0199]
• [0200]LAN70 could be implemented with a number of different of wireless systems such as 802.11b, 802.11a, or Bluetooth. The wireless communication system could be a 900 Mhz system used on many cordless phones. The system could be implemented with a phone line network system where the house wiring is used as the network physical layer for communication betweenPC34 and client devices78. The system could be implemented using an AC power line networking technology that uses the AC wiring in the home as the network physical layer. It should be noted also, that the system will work with any type of connection to the internet, including other broadband technologies such as DSL or fixed wireless, or a dialup modem connection.
• A phone that includes a microprocessor, memory, and network interface is also a client device. The[0201]content10 that would be transferred to it would be the digital address books, such as those that are a part of PDA databases and desktop organizer software, such as Palm Desktop or Microsoft Outlook. The phone numbers from these personal information managers, and other relevant phone numbers could be downloaded from the web and cached at the PC, and subsequently transferred to the phone database, so that dialing can be made much easier.

Claims (20)

I claim:

1. A system for channeling content to computer devices, comprising in combination,

a connection to the Internet,

a local server with a mass storage device,

a web site for providing access to content selections,

a means for associating a content selection for streaming with a client device,

a local area network connecting the local server to a client device, and

a client device for receiving and decoding content selections.

2. The system ofclaim 1 where the client device is a digital audio decoder.

3. The system ofclaim 1 where the means for associating a content selection for streaming with a client device is a drag and droppable content object.

4. The system ofclaim 1 where the mass storage device is a personal computer.

5. The system ofclaim 1 where the mass storage device is a storage gateway.

6. The system ofclaim 1 where the mass storage device is a storage gateway peripheral.

7. The system ofclaim 1 where the local area network is a wireless network.

8. The system ofclaim 1 where the client device is a webpad.

9. A method for delivering digital content from to client computer devices including:

a. Associating a content selection with a client device.

b. Activating the streaming of the content selection to the client device, via a local storage device.

10. The method ofclaim 9 where the association between a content selection and a client device is a drag and drop interface between and web page and a content editor on a PC.

11. The method ofclaim 9 where the client device is a digital audio decoder.

12. The method ofclaim 9 where the activation of the streaming of the content selection is performed at the client device.

13. The method ofclaim 9 where the local storage device is a storage gateway.

14. The method ofclaim 9 where the local storage device is a storage gateway peripheral.

15. A system for channeling content to client devices, comprising in combination,

a local computing and mass storage device comprising a hard disk drive, a

microprocessor, and a local area network connection,

a broadband connection for connecting the local computing device to the Internet,

Content objects located on a web page on the Internet,

a means for associating content objects located on the Internet with content object editors on the local computing device whereby content represented by content objects is downloaded and stored on the local computing device, and,

a means for streaming content stored on the local computing device to client devices.

16. The system ofclaim 15 where the local computing device is a storage gateway.

17. The system ofclaim 15 where the local computing device is a storage gateway peripheral.

18. The system ofclaim 15 where the means for associating content objects on the Internet with content object editors on the local computing device is a drag and drop interface.

19. The system ofclaim 15 where the client device is a audio playback device.

20. The system ofclaim 15 where the client device is a webpad.

Images