US20060212908A1 - Video distribution system - Google Patents

Abstract

The invention relates to video distribution systems and, more particularly, to a system that blanket transmits video/audio content such as movies (for example, via satellite downlink transmission) to each customer's computer-based recording, storage and playback system. Customers preselect from a list of available movies or other content in advance using an interactive screen selector, and pay for only the video/audio content that is actually viewed.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
• This application is divisional of Ser. No. 09/645,087, filed Aug. 24, 2000, which is a continuation in part of Ser. No. 09/385,671, filed Aug. 27, 1999; Ser. No. 09/436,281, filed Nov. 8, 1999; Ser. No. 09/476,078, filed Dec. 30, 1999; Ser. No. 09/502,069, filed Feb. 10, 2000 and Ser. No. 09/553,524, filed Apr. 20, 2000.
FIELD OF THE INVENTION
• The invention relates to video distribution systems and, more particularly, to a system that blanket transmits video/audio content such as movies (for example, via satellite downlink transmission) to each customer's computer-based recording, storage and playback system. Customers preselect from a list of available movies or other content in advance using an interactive screen selector, and pay for only the video/audio content that is actually viewed.
DESCRIPTION OF THE PRIOR ART
• Widespread home television viewing began in approximately 1950 with broadcast networks transmitting shows on specific, prepublished schedules. This model remained the primary model for television viewing for over thirty years.
• Cable, and later direct broadcast satellite, increased the number of channels. But viewers were still subject to programming schedules.
• Video cassette recorders offered the prospect of shifting viewing times, provided the end user was one of the thirty percent or less of VCR owners who learned to program their VCR's. Even among those who learned to program their VCR, time shifting via VCR remains subject to properly setting up the timer, assuring the power is in the correct state, assuring that a correct tape is in the VCR, that the tape is not full, that the tape is properly rewound, etc. Thus, for the majority of TV viewers, even at the turn of the century, the TV viewing model has scarcely changed from the mode of 1950.
• Video rental stores have provided a sort of “video on demand” subject, of course, to the high cost of video cassette purchases by the rental stores, as well as the high capital outlay for real estate (land and building) and the cost of labor at the stores. Even when a title becomes available through video release, the viewer's ability to watch the show at his chosen time is subject to availability of the video at the store, round-trip transportation to the store and the inevitable problems with late returns, damaged videos, lost videos, etc.
• True video-on-demand has been envisioned whereby massive video servers would be positioned in every geographic location to transfer high speed video data streams to the houses of individual viewers at any time a viewer wished to access a particular movie or other content. However, this type of video demand system, after years and billions of dollars of investment, has proven to be too complex and expensive and, therefore, has not been implemented. A compromise on the video-on-demand concept has been proposed by Replay Networks, Inc. (USA) whereby viewers create their own “replay channels” containing content categorized by, for example, show titles, actor, movie type, etc., with such programming being recorded on hard disks at a local facility and later available for on-demand access by individual viewers. Another type of on-demand video distribution system is described in U.S. Pat. No. 5,832,287, whereby video-on-demand and network programming is provided from master file and network program databases through multiple community systems, each of which may serve up to approximately one hundred homes.
• Both the Replay Networks, Inc. and the '287 systems have severe limitations in terms of storage capability and customer options.
• An interactive viewing system that automatically records selected programs is disclosed in U.S. Pat. No. 5,805,763. However, the '763 system simply provides another mechanism for recording television programs. This system attempts to simplify the VCR recording function, but because of its complex nature and limited benefits it has not been implemented.
• There is an acute need in the video distribution industry for a system that will provide each individual viewer with ready access to thousands of movies titles, as well as educational programming, network programming, audio programming and the like, in a convenient low-cost manner that fully satisfies user demand, while enhancing the economic incentives of content providers to create and distribute an ever expanding offering of movies and other video/audio content.
SUMMARY OF THE INVENTION
• The present invention provides a video distribution system that is beneficial to all involved parties, namely consumers, content providers and data transmission providers. In preferred embodiments, consumers are able to preselect movies for viewing from as many as one to eight thousand movies or more that are transmitted daily and as many as ten to sixty thousand movies or more transmitted monthly. Customers of the video distribution system utilize a menu driven, graphical user interface with simplified controls that provide movie selection by title, type, category (e.g., comedy new releases from major studios). In preferred embodiments, video/audio content is blanket transmitted via direct broadcast satellite (DBS) in an encoded, compressed form for playback at VHS resolution (or other desired resolution). The transmission is directly to each customer's receiving dish or antenna which is linked to the customer's user station where selected movies are stored on DVD RAM discs or CD's in a multiple disc platter, or on a hard drive having a storage capacity of, for example, 20 gigabytes or more. The movies may then be played immediately or at any time desired by the consumer, with the consumer paying for only those movies that are viewed. Preferably, the movies are encoded to prevent conversion and duplication for play on existing DVD, CD or other systems. The encoding technology also prevents playback on user stations of the video distribution system in homes that are not current on payments for previous purchases. In certain embodiments, the encoding system includes a novel time-based encoding technology, and movies may be watermarked so that copies are traceable to the customer site.
• The video distribution system of the present invention offers numerous advantages to consumers. For example, consumers have access to new movie releases at those times dictated by market conditions to be most favorable by the content providers and the distributors, often before the movies would be available at video rental stores. Consumers will pay for a movie only after it has been viewed, not when recorded. Thus, consumers are free to record categories or classes of movies (e.g., new releases) and later make a decision as to which movies to actually view—paying only for those that are viewed. In certain embodiments, consumers have access to movies that are automatically recorded, such as popular new release movies and movies that are being promoted by the content provider and/or system operator. Consumers may view the videos at any time without restraints related to broadcasting schedules and with no need to visit a video rental store for selection of the movie or returning the movie. There are no late fees. New movie releases will never be “sold out” as they frequently are in existing video rental stores. Another advantage to consumers is the ultimate lower cost occasioned by the system's elimination of the real estate and labor costs associated with existing video rental stores. Because literally thousands of movies are available on a daily/weekly/monthly basis, the video distribution system of the invention provides a much greater selection than any existing video rental store. The invention also provides full access to content for those who live in geographically remote and/or sparsely populated areas that may presently have little or no access to video rental stores. The invention also allows access to videos for families with young children, elderly persons and handicapped persons where theater viewing and round trips to video rental stores are inconvenient, prohibitive or expensive. Each user station utilizes high capacity storage such as DVD platters or hard drives for its read/write functions in addition to an operating system that provides greatly simplified on-screen programming. The present invention also provides the ability to update movie pricing at any time, for example on a daily, weekly or monthly basis, so that consumers can choose to view movies at times when content providers offer pricing specials or incentives. When a movie is recorded on a disc, it can be labeled and stored for future play or, depending upon the storage medium, recorded over (similar to a blank VCR tape). As new movies are recorded and shelved, new or previously used videos can be inserted into the platter for future recording. Video quality is improved over existing video rentals where, in most cases, available tapes have been degraded by previous play.
• Content providers (e.g., major studio producers) recognize a very significant benefit in that they receive income every time a movie is played, thereby creating significant residual value for their investments. Importantly, new release movies are always available (i.e., not “sold out”) during initial peak demand when pricing power is the highest. The mentioned residual value translates into increased income for the content providers because a significant portion of existing content is available for sale every day—since thousands of movies are transmitted on a daily/weekly/monthly basis. The invention also allows content providers to change pricing at any time, e.g., daily/weekly/monthly, to optimize price vs. consumer demand. In this regard, content providers are allowed to meet consumer demand for a significant portion of the existing content inventory value every day. This provides an extremely high benefit by effectively allowing the market to clear (i.e., real demand matches supply), something that the current video distribution model (TV, movie channels, pay-per-view and video rental) do not provide. Additionally, content providers may download preview material that is specific to user profiles.
• According to the invention, content providers are confident that they can distribute their movies with extremely high security through the use of appropriate encoding technology. Preferably, the encoding includes time-based encoding technology, with new code keys for every distributed movie transmitted via phone/modem with billing queries every month. Time-based coding, in combination with a single standard proprietary operating system, allows the video distribution system operator to achieve the level of security demanded by content providers. Watermarks coded to each site may be placed in any playback signal to assure that movie copies, even those made by recording at the input to the TV or monitor can be traced to a specific site or purchase.
• Transmission providers (DBS satellite system providers, in preferred embodiments) realize the advantage of a significantly increased income base for supporting their services and the utilization of lower cost, off-peak time for transmission of a significant portion of the movies, as well as opportunities to market other products and services to specific customer profiles.
• In one aspect, the video distribution system of the present invention includes a data transmission system blanket transmitting a plurality of encoded movies to customer households. A user station is provided at each customer household, the user station including means permitting the customer household to preselect desired transmitted movies for recording. A receiver and associated recording device at each customer household is provided for recording movies. The recorder may be an internal or external hard drive, DVD or CD recording device or other appropriate device. A playback device permits each customer to play back those recorded movies that the customer desires to view. The video distribution system also includes a central controller system having a database for storing therein an address corresponding to each customer household, a communications link between each customer household and the central controller system to verify to the controller unit that a recorded movie has been played back for viewing and a billing system linked to the central controller system to bill customer households for only those recorded movies that are played back for viewing.
• In another aspect, the invention may be defined as a method of distributing movies to customer households comprising the steps of blanket transmitting a plurality of movies to customer households, permitting each customer household to preselect and record desired movies, permitting each customer household to playback for viewing any recorded movie, communicating movie playback information from each customer household to a central controller, and billing customer households for only those recorded movies that are played back for viewing.
• Other embodiments allow downloading and storage of marketing material, information, transmission schedules, or even several movies that are currently in high demand.
BRIEF DESCRIPTION OF THE DRAWINGS
• Some of the features of the invention having been stated, other features will appear as the description proceeds, when taken in connection with the accompanying drawings, in which—
• FIG. 1 is a schematic representation of a video distribution system of the present invention utilizing satellite downlink data transmission.
• FIG. 2 illustrates further details of a user station shown inFIG. 1.
• FIG. 2A is a view of the user station ofFIG. 2 showing several optional features.
• FIG. 3 shows a hand held infrared remote control for use in association with the user station.
• FIG. 4 is a block diagram showing components of a representative user station of the invention.
• FIGS. 5, 6, and7 show several screens that appear on the display when a customer reviews available movies, preselects movies for viewing and performs other associated functions using the interactive program guide.
• FIG. 8 illustrates a Level I time-based coding format that provides enhanced security for the transmitted programming.
• FIG. 9 is a block diagram showing functions of the central controller system.
• FIG. 10 is a block diagram of one simplified embodiment of a business model for commercializing the video distribution system of the invention.
• FIG. 11 is schematic representation of another satellite-based video distribution system that utilizes a relatively large hard drive as the primary data storage medium.
• FIG. 12 shows the operational sequence for use of the video distribution system ofFIG. 11.
• FIG. 13 shows a screen containing one example of a simple graphical user interface used by a customer to enter customer movie preference information by movie type.
• FIG. 14 shows a screen containing another example of a graphical user interface for entering more complex, multilevel customer preference information.
• FIG. 15 is a block diagram showing how customer preference information entered by customers and general population clustered preference data compiled and analyzed by the system operator are used to create customized preference-based downloading choices at the customer user stations.
• FIG. 16 is a flow sheet showing the procedure for promotion-based streaming of movies, for example where a movie distribution company decides to push a selected movie as a promotion.
• FIG. 17 is a schematic representation of an embodiment of the invention wherein the video portion of a movie is highly compressed prior to being blanket transmitted at low resolution. The video is enhanced by an upconverter at the customer's user station (set top box), thereby permitting transmission and storage of the video as a smaller file while still permitting the customer to enjoy a picture with the desired resolution, for example, VHS resolution.
• FIG. 18 is a schematic representation of another embodiment of the invention wherein a hardware implementation of artificial neural networks is used to sample the video portion of a movie frame by frame to create a library of neural patterns. The library of patterns for the movie is blanket transmitted along with very low resolution, highly compressed encoded video, with the transmitted video file undergoing pattern recognition image enhancement at the set top box and, optionally, up-conversion as well.
• FIG. 19 is a schematic representation of an embodiment that is similar to that ofFIG. 18 except that the set top box contains in memory a universal library of neural patterns for image enhancement of the transmitted video so that a complete, unique pattern library for each transmitted movie does not have to be transmitted along with the movie.
• FIG. 20 is a schematic representation of another embodiment similar to that ofFIG. 18 with the additional feature that the video portion of the movie is transmitted with a uniform pattern of added noise that is used as copy protection encryption. The noise is removed by the processor in the set top box, as the processor is also enhancing the image.
• FIG. 21 is a representation of how neural patterns can be grouped in the library by frame type.
• FIG. 22 is a representation showing how, as a video file is being scanned, the specific frame types ofFIG. 21 are noted and stored in the pattern library.
DETAILED DESCRIPTION OF THE INVENTION
• While the present invention will be described more fully hereinafter with reference to the accompanying drawings, in which aspects of the preferred manner of practicing the present invention are shown, it is to be understood at the outset of the description which follows that persons of skill in the appropriate arts may modify the invention herein described while still achieving the favorable results of this invention. Accordingly, the description which follows is to be understood as being a broad, teaching disclosure directed to persons of skill in the appropriate arts, and not as limiting upon the present invention.
• The Overall Video Distribution System, Generally
• Referring toFIG. 1, there is shown a simple schematic of one embodiment of avideo distribution system10 of the invention.System10 utilizes direct broadcast satellite (DBS) transmission viasatellite20 as the means for blanket transmitting encoded programming data, either in real time or in time compressed format (discussed below). The program data is received at each customer household by a receiving antenna ordish24.Dish24 is linked to adedicated user station28 by asatellite receiver link30.User station28 is an interactive device permitting customers to preselect desired transmitted movies, record the preselected movies and play back the recorded movies on a video display device (e.g., television32) anytime the customer wishes to view them.Station28 communicates at appropriate times with acentral controller system36 via a phone/modem connection38 (land, Internet or cellular).Central controller system36 stores a discrete address (e.g., telephone number, credit card number or billing address) for each customer household and receives information viaconnection38 to verify that a preselected, recorded movie has been played back for viewing.Central controller system36 utilizes the movie playback information to bill customer households and also to credit the accounts of content providers. The satellite link (or alternatively the central controller system36) periodically communicates with each customer household to provide information on available movies and when they will be transmitted, along with pricing information for the playback of specific movies or categories of movies. In preferred embodiments, the satellite link and phone/modem connection38 transmit time-based code keys for the transmitted movies that form part of the security system for the video distribution system.
• FIG. 2 illustrates the front panel of one embodiment ofuser station28.Station28 includes a port for thesatellite receiver link30, a phone/modem connection38, a remoteinfrared sensor44 and a DVD RAM platter46 (e.g., a 10-disc platter) which is utilized as the write/read mechanism for recording and playback of movies or other content.User station28 also includes a user interface comprising a power on/offswitch50, a fivekey program selector54, a “Programs Recorded” key62 and a platter out/inkey66, all of which preferably are duplicated on an infrared handheld remote70 (FIG. 3). A more detailed discussion of the use ofuser station28 to review movie availability, to preselect, record and playback movies will be set forth below in the description of the viewer interface and interactive program guide.
• The Satellite(s) According to preferred embodiments of the present invention, data transmission is achieved utilizing geostationary satellites operating in the KU band that are downlinked to conventional receiving antennae or dishes located at the customer households, which are in turn linked to TV Receive Only (TVRO) units connected the customer user stations.
• Following the recent acquisition of PrimeStar's assets by Hughes, there are now two digital broadcast satellite providers in the United States, Hughes (DSS) and EchoStar (DISH Network). EchoStar's DISH network launched an additional satellite in September 1999 (its fifth satellite) that, in combination with its previous satellites, provides continuous transmission of greater than five hundred channels to substantially the entire continental United States. EchoStar now has satellites located in the 119, 110, 61.5 and 148 positions within the Clark Belt.
• With the above satellite orientations, EchoStar's new “DISH 500” system utilizes an elliptical twenty inch antenna or dish containing two LMBS heads that can receive information from two different satellites simultaneously. As mentioned above, this system permits greater than five hundred channels to be directly broadcast to each customer household.
• Currently preferred embodiments of the present invention utilize the EchoStar system, most preferably the DISH 500 system, for programming data transmission at either real time or time-compressed transmission rates, discussed below. In alternative embodiments, the invention may be implemented utilizing the Hughes (DSS) system, or a combination of both the Hughes and EchoStar systems (resulting in a relatively smaller portion of each system's total capacity being devoted to the invention's video distribution).
• Data Transmission Parameters
• EchoStar's DISH 500 system has 480×704 resolution, providing a very high band width of approximately 4 megabits/sec for each channel, for a total transmission capacity of approximately 2000 megabits/sec for five hundred channels.
• As mentioned above, in accordance with certain preferred embodiments of the invention the video content (e.g., movies) may be broadcast at standard VHS resolution (240×352) which translates into a requirement of approximately 1.3 megabits/sec per channel with MPEG II compression. Thus, the full (greater than 2000 megabits/sec) capability of the DISH 500 system translates into the capability to broadcast approximately 1,530 movies simultaneously in real time (i.e., not time compressed). At 110 minutes per movie, the full twenty-four hour capacity is approximately 20,000 movies per day, far greater than total requirements for the video distribution system of the invention.
• Thus, according to this aspect of the invention, a portion of the total transmission capability of the DISH 500 system may be utilized to blanket transmit thousands of movies for preselection and recording by customers. In this regard, and as discussed in more detail in the Examples below, new release movies (e.g., the 100 most popular new release movies from major studios) may be transmitted several times per day with concentration before and during prime evening viewing periods, with a second tier of popular movies transmitted less often, but still at least daily, and third and fourth tiers of movies transmitted weekly/monthly—all in accordance with content listings and transmission schedules available to customers through their periodically updated electronic program guide.
• It will be appreciated that instead of using more typical 120 watt DBS transponders, implementation of the present invention may be carried out with higher power transponders (e.g., 240 watt transponders) to increase the effective transponder capacity (e.g., from 23 megabits/sec to 30 megabits/sec) by reducing much of the capacity allotted for forward error correction and system management inherent in lower power transponders. Also, along with the use of higher power transponders, the invention may be carried out with quanternary (QPSK) polarization to double the effective bit transfer rate for each transponder over that which may be obtained by using current orthogonal polarization—with a sacrifice in bit error rate that is acceptable for those applications of the invention where lower video and audio resolution is not an important consideration to the customer. Thus, the use of high power transponders (e.g., 240 watts or higher) in conjunction with higher level polarization (e.g., quanternary) permits video distribution systems of the invention to be implemented utilizing less of the DBS system's total transmission capacity, permits the transmission of a greater number of movies or other content, permits more frequent transmission of high demand (e.g., Tier 1) movies and permits greater time compression of movies, or a combination of the above, all to the benefit of consumers.
• User Station Details
• FIG. 4 is a block diagram showing components of arepresentative user station28 of the invention. The primary controller forstation28 is a central processing unit (CPU)80 that includes a microprocessor, a non-volatile high speed memory device containing the unit's proprietary operating system, a graphics generator, and additional peripheral devices such as a clock that are common in CPU devices.
• Encoded programming data via satellite downlink throughantenna24 is transmitted to adecoder82.Decoder82 looks for headers indicating movies or other content that have been preselected for recording. The programming data includes video/audio content data, content availability/scheduling data and content pricing data. Decoded preselected movie data is transmitted viaCPU80 to a high speed memory buffer84 (with or without high capacity storage capability) and then written to aDVD RAM disc86 that is associated with theDVD RAM platter46. In certain embodiments, the highspeed memory buffer84 may utilize a magnetic drive, a magneto-optical drive, an optical drive, or other suitable drive.Buffer84 may utilize DRAM, flash memory, SRAM or other suitable memory such as digital tape.
• As will be appreciated by those skilled in the art, in alternative embodiments the transmitted data may bypassCPU80.
• An internal orexternal modem87 connects to a phone line that provides communication to thecentral controller system36.
• The content availability/scheduling data, content pricing data and time-based security codes B (discussed below) are transmitted at periodic intervals (e.g., every ten minutes, every hour or every day, as deemed most desirable by the video distribution system operator) and are routed fromCPU82 to RAM88 where the information is stored and available.
• Viewed-content information used for billing purposes, content preselection information entered by the user and time-based security key codes C (discussed below) are stored and available inSRAM90.
• CPU80 directly receives manual and infrared remote operation input data. Thevideo display device32 receives input from the DVD RAM platter for playback of movies and receives graphics data fromCPU80 for display of the interactive program guide.
• It is understood that important aspects of this invention may be provided by different electronics configurations such as a central server to support, and in certain cases to replace, functions carried out by the RAM, SRAM and DVD RAM shown inFIG. 4. In addition, SRAM or a suitable high speed memory drive could be used to fulfill the function provided by the RAM (shown inFIG. 4). Other embodiments may include an additional disc drive in support of the system data storage and retrieval functions.
• Viewer Interface/Interactive Program Guide
• The viewer interface and interactive program guide will now be described in connection with how they permit a customer to review available movies, preselect movies for recording, playback movies for viewing and perform other associated functions.
• Referring toFIG. 5, there is shown arepresentative screen100 that is displayed on thevideo display device32 when a user initiates use of the system via on/offkey50. By utilizing the four (up/down, left/right) keys of theprogram selector54 and by clicking on “Programs Recorded”, the user may choose to first determine the status of the multiple (e.g., ten) disc positions in the DVD RAM platter, i.e., what movies are currently recorded and stored in the DVD RAM platter at which disc positions, which disc positions contain blank discs and which disc positions have no discs.FIG. 6 shows arepresentative screen110 indicating the status of each disc position. Once this information is displayed, the user may elect to playback a movie that is already on the platter, remove disc(s) for storage, etc.
• After, or instead of, using the “Programs Recorded” function, the user may use the “Available Movies” function to scroll down through a listing of movies in the interactive program guide that, as shown, may be based on various categories of available movies. For example, the first category of movies is new releases, which may be subdivided into, for example, comedy, action, drama, documentary, etc. After a particular category of movies is chosen (e.g., new releases/comedy) another screen110 (FIG. 7) is displayed showing the titles (in this case twenty titles) in this category. In order to preselect a title for recording, the cursor is moved to the chosen title and the middle key ofprogram selector54 is pressed twice, the first press showing the current playback price and changing the background color of the display (indicating “selection mode”) and the second press completing the selection.
• It will be appreciated that the interactive program guide may include links to a short summary of a movie being considered, critical review(s) of the movie or a brief “clip” or preview of the movie. This information may be stored in internal memory, obtained through a link to the website of the video distribution system operator or obtained by direct Internet access to the websites of film producers, movie rating services, etc. (SeeFIG. 2A.) Other suitable means for providing movie information may also be employed.
• Program Security Utilizing Encoding Technology
• As mentioned above, in certain embodiments of the invention programming security is best achieved by time-basedcoding, in combination with the utilization of security codes that are interlaced into the video frames.
• The proprietary operating system utilizes standard interlaced encoding data that, as known in the art, prevents movies recorded by a customer at a user station from being played on other nonconforming playback devices (for example, standard DVD playback devices). In addition, recognizing the possibility of pirates utilizing data conversion technology to defeat this security technique so that bootleg copies could be run on other systems, and recognizing the prospect of recorded movies being played on user stations that are not current on payment or are otherwise unauthorized, the invention incorporates a time-based code key to assure that playback of recorded content can only occur on currently authorized user stations.
• FIG. 8 describes one preferred Level I time-based coding format wherein a first code key A comprises a 32-bit monthly code at the beginning of each transmitted movie. With one such code key provided for each month over an extended period of time, say 100 years, there is a total of 12×100=1200 32-bit code keys A per movie.
• A second code key B comprises a 32-bit code for each month chosen by the video distribution system operator at the beginning of each month. Code keys B for all available movies are blanket transmitted to customer households each month by the data transmission means, preferably, satellite.
• A third code key C comprises another 32-bit code for each available movie. Code keys C are delivered to each customer household by phone/modem on a monthly basis, preferably at the time of monthly billing queries from thecentral controller system36 to the household. The third code keys C are provided only when the customer household is current in payments and otherwise is in good standing.
• The time-based coding ofFIG. 8 assures that a movie will playback at a specific user station only when all three code keys A (transmitted with the movie), B (chosen and blanket transmitted monthly) and C (delivered monthly by phone modem) are present, with the user station software simply verifying that C is the correct value when a predetermined mathematical function is applied to A and B.
• Level II security coding comprises a 128-bit code interlaced through every third frame of the movie. This code, in conjunction with the decoding software of the unit's proprietary operating system, is used to assure that recorded movies can be played only on stations provided to consumers by the video distribution system operator. (The players incorporated into the proprietary user stations of the video distribution system simply read and ignore Level II code.)
• Thus, recorded movies may not be played back on standard DVD players. However, even if a determined pirate were to defeat the Level II code to produce a disc playable on a standard DVD player, a pirated copy would be useful only until the end of the month, due to Level I time-based coding protection, discussed above.
• Optional Level III coding may be utilized to relate Level I and Level II coding in a specific location in each movie over multiple frames where the Level II code is a more complex (e.g., 1024K) program requiring completion from the time-based coding of Level I.
• In addition to the security means discussed above, preferably eachuser station28 must be in an enabled state. In this regard, an enabling command from central controller system36 (via phone/modem) may be sent monthly to each customer household that is in good standing.
• To deter production of copies of movies recorded at the box connections to the TV, a digital watermark identifying the purchasing customer may be placed in the movie signal. The watermark would be unnoticable to a viewer but would allow copies of the movie to be traced to the original purchase site.
• As an alternative to monthly billing queries by thecentral controller system36 to each customer household, monthly provision of code keys C and monthly provision of an enabling command to customer households in good standing, as described above, these functions may be carried out each time a movie is played back for viewing via a two-way communication betweencentral controller system36 and the customer household. To this end, when a customer initiates playback of a movie through the interactive controls, the playback information (the identity of the movie and the identity of the customer household) is communicated tocentral controller system36 by phone/modem, at which timecentral controller system36 verifies good standing status for the customer household and sends back a single code key C for the specific movie and an enabling code for the user station. Utilization of this form of communication between a user station andcentral controller system36 at the time of every playback offers the advantage of the video distribution system operator not having to send thousands of key codes C (for all available movies) on a monthly basis to each customer household (where the key codes C must be stored in memory) and the further advantage of assuring good standing of the customer household's account prior to each movie playback. A further advantage is that customers' accounts may be billed more currently, at the time of each playback instead of monthly.
• Central Controller System
• Referring toFIG. 9, thecentral controller system36 will now be discussed in more detail. As discussed above, in one preferred embodimentcentral controller system36 provides the following functions:
• • 1. Stores a discrete address for each customer household.
  • 2. Transmits monthly billing query to each customer household to determine which preselected, recorded movies were viewed.
  • 3. Sends monthly transmission of time-based security codes “C” and an enabling command to each customer household that is current in its payments and otherwise is in good standing.
  • 4. Credits accounts of content providers for the use of their content through linkage to a financial network.
  • 5. Debits accounts of customers for movies viewed.
    Alternative Data Transmission Technologies
• Referring toFIG. 2A, several alternative data transmission technologies may be utilized in place of or in addition to direct broadcast satellite (DBS) which is discussed above.
• A first option is data transmission by optical fiber employing suitable technology, preferably an optical fiber technology providing high transmission rates, for example OC3. A single OC3 optical cable transmits data at approximately 128 megabits/sec so that, at VHS resolution, it can transmit approximately sixty movies simultaneously at real speed, or transmit one movie every two minutes at a time-compressed speed.
• Other options include cable/modem transmission, Internet connection, other suitable phone connections, or the use of higher or lower frequencies than KU if licensed for satellite-based content transmission, or a combination of any of the transmission means discussed herein.
• It will be appreciated that video/audio content transmitted by any of the above means, whether transmitted at real time or at a time-compressed speed, may run in series for simultaneous recording on multiple stations at a consumer household.
• Business Models
• The present invention provides significant flexibility with respect to the business model to be used to commercialize the invention. In one simplified embodiment, shown in block diagram form inFIG. 10, the video distribution system operator interfaces with three parties, the data transmission provider, the content providers, and consumers. The content providers provide content to the data transmission provider which, in turn, blanket transmits the content to the consumers, preferably by direct broadcast satellite. The satellite transmission also includes content availability/scheduling data and content pricing data, updated periodically. The content providers also provide copyright license and pricing requirements to the video distribution system operator. Both the data transmission provider and the content providers receive payments directly from the video distribution system operator. Lastly, the video distribution system operator periodically receives viewed-content information for billing, while also sending enabling commands to the consumers.
• Other business models may utilize time-based security coding as discussed above. Also, the Internet may be used to provide centrally posted content availability information and permit preselection of movies for recording at the customer's household.
EXAMPLE I
• The video distribution system of the present invention is implemented using the business model ofFIG. 10, the DISH 500 DBS system, and the other hardware and software systems described above and illustrated in the drawing figures.
• The video/audio content provided by the video distribution system is transmitted in real time (i.e., not time-compressed—average movie 110 minutes). The movies are blanket broadcast utilizing approximately 49% of the total capacity of the DISH 500 system, with transmission times heavily weighted forTier 2, 3 and 4 movies to off-peak broadcast hours (e.g., 1:00 am-8:00 am).
• Movie “Hierarchy”
• • Tier 1: The current 100 new release movies from major studios.
  • Tier 2: The 6000 movies that are at the second level of consumer demand after theTier 1 new release movies.
  • Tier 3: The 8000 movies at the third level of consumer demand.
  • Tier 4: 60,000 additional movies.
    Transmission Schedule
  • Tier 1: Each new release movie is transmitted every day on the hour from 4:30 pm to 8:30 pm, and at several other times daily.
  • Tier 2: EachTier 2 movie is transmitted once per day.
  • Tier 3: EachTier 3 movie is transmitted once per week.
  • Tier 4: EachTier 4 movie is transmitted once per month.
• A consumer who wishes to plan ahead can easily record all new releases in the “comedy” category, for example, and have them available for viewing at his pleasure, with payment obligations arising only for those movies he actually views, when he views them. The same consumer or another consumer wishing to view a new release on the evening at which the viewing decision is made, simply preselects the movie for recording any time during the day so that it will be available during the evening viewing hours. An Internet phone/modem connection (not shown) may be provided so that consumers may access their user stations from remote locations (e.g., from their business offices) to preselect movies for viewing that evening.
• The term “movies” as used in connection with the Examples, and as used at other times herein, encompasses more than the term traditionally implies. The term “movies” may encompass not only motion pictures and similar content, but also certain content that appears in the lower tiers, especiallyTier 4, such as classic sporting events (e.g., all Super Bowls) and popular TV series (e.g., all episodes of Star Trek or Sienfeld or J Love Lucy). In this regard, a customer who wishes to do so may record all episodes of I Love Lucy (transmitted monthly in Tier 4) on a multiple disc platter, store the discs andplayback5 selected episodes any time he desires, paying only when he views an episode or episodes.
EXAMPLE II
• The video distribution system of Example II is implemented with the same tiers of movies as Example I with the difference being that theTier 1 movies are transmitted in compressed time format to a high speed memory buffer contained in the user station which, in turn, writes to the DVD RAM disc at its maximum write speed. This compressed time transmission (e.g., 8 to 10 minutes per movie) permits consumers to have movies, particularlyTier 1 movies, available on short notice, often in a time less than or on the order of that time required for a round trip to a video rental store. To further facilitate this enhanced availability of movies on short notice, according toExample II Tier 1 new release movies are transmitted every 30 minutes from 5:30 pm to 8:30 pm, and at several other times daily.
EXAMPLE III
• Same as Example II except that all movies are transmitted in compressed time format.
EXAMPLE IV
• The video distribution system of this Example IV is implemented with the same tiers of movies as Examples I-III. According to Example IV, the recording and playback device ofuser station28 comprises a magneto-optical disc recording and playback device that has the capacity to write to a magneto-optical disc at write speeds on the order of 12 megabits/sec or greater, a write speed that is approximately 8 to 10 times the data stream speed for conventional VHS resolution video/audio transmission and playback (with conventional MPEG II compression). Utilizing an approximately 12 megabit/sec write speed, and a corresponding data transmission speed via DBS or other suitable transmission means, a movie may be transmitted in time-compressed format and recorded at 8 to 10 times real time, so that a 110 minute movie may be transmitted and recorded in approximately 11 to 14 minutes or less.
• In order to provide ready consumer access to new-release movies, each of the 100Tier 1 movies is broadcast from 6:00 p.m. to 9:00 p.m., at 15 minute intervals. Thus, during these prime time hours, a consumer may select anyTier 1 movie and have it available for viewing within 15 to 30 minutes. (With faster transmission and write speeds theTier 1 movie availability time period may be reduced accordingly.) As with Example II, theTier 1 movies are also transmitted at several other times daily, for example, hourly.
• According to Example IV,Tier 2, 3 and 4 movies are also transmitted and written to discs in compressed time, for example, at approximately 12 megabits/sec or greater.
EXAMPLE V
• The distribution systems described in Examples I-IV have the capability to transmit audio in compact disc (CD) quality or another form to a suitable storage medium such as read/write CD's, write only CD's, DVD RAM, magneto-optical disc, digital tape or a central server. In this Example V, the consumer may choose any music selection from up to as many as 80,000 or more titles in a tiered transmission structure similar to Examples I-IV and use less than 10% of the existing DBS transmission capacity.
• With music distribution under this Example V, the system allows the user to listen to the recording (e.g., CD) several times for free before the consumer is required to permanently select the CD. Once permanently selected, the CD receives a permanent enabling code and the consumer pays a one time fee—similar to the current one-time fee structure which is standard in the existing music distribution business model. The player then plays the CD through TV speakers or provides an audio output to an optional external audio system (FIG. 2A). This music distribution model eliminates a significant portion of the labor, real estate and transportation costs inherent in the current distribution models for music, much as the novel movie distribution model described herein eliminates costs in the distribution of movies as compared to current models. The music distribution model of this Example V may utilize DBS or the alternative data transmission means described above, either 5 alone or in combination.
EXAMPLE VI
• The distribution system of Example IV is augmented with CD quality music transmission capability where 10,000 titles per day are transmitted at a time-compressed speed of, for example, 12 megabits/sec or greater. The music transmission of this Example VI may be carried out by utilizing additional DBS capacity, by reducing the number ofTier 2 movies transmitted daily, by reducing movie transmission in other tiers, or by a combination of the above. As described above in connection with Example V, the customer may listen to the recording several times for free after the encoded transmission is stored (with or without the use of memory buffer84), before the purchase selection. Once the purchase selection is made, the recording preferably is written to a conventional CD so that it may be played back on conventional home or auto playback devices. To this end, theuser station28 may include positions for holding and writing to conventional CD's—in addition to the ability to write to another medium such as DVD RAM or magneto-optical discs used for storage of movies. In the alternative, once the recording is selected, it may be routed to the external audio system (FIG.2A) which has its own CD read/write or write only device that will permanently write the selected recording to a CD that can be held in a single, stack or platter system.
• One Alternative User Station Configuration
• FIG. 11 illustrates an alternative user station configuration that is substantially similar touser station28 ofFIGS. 1, 2,2A and4, with a primary difference being the use of a large disk drive as the primary memory component. The encoded video content is scheduled and transmitted to the direct broadcast satellite up-link facility200 by the system operator throughsystem controller36. In addition, periodic digital program/pricing information is transmitted to the up-link facility, for example, every ten minutes. The digital video content and program/pricing information, once received by the appropriate satellite, are then transmitted down broadly (i.e. “blanket transmitted”) to geographic coverage areas where the user stations can receive the downlink transmissions via the home user'ssatellite dish24. Data is then transmitted to downloadmodule220 contained inuser station228 where it is stored digitally instorage module230, preferably in a large disk drive having a storage capacity of 20 gigabytes, or more. The use of a disk drive of suitable size permits the storage of up to six to twenty or more movies at one time instorage module230. Thus, a video distribution system may be operated with customers storing and playing back movies solely by using the hard drive ofstorage module230. Additionally, for those customers desiring to build a library of movies,user station228 may include an optional recording/playback device that records movies onto, for example, a DVD RAM, and plays back these movies through the user station at any desired time, with customers paying only when they view the movies. While it is preferred that the movies in such a library remain fully encoded and encrypted for playback only on a user station in the system operator's network,user station228 may include a CPU or CODEC capable of real-time decryption and decompression as the movie is recorded to a storage medium such as a DVD, so that such movies may be played on a standard DVD player. The decryption/decompression process preferably processes digital watermarks in these recorded movies so that a unique customer or transaction number is hidden in the movie, thereby allowing a copy of the movie to be traced to its source. Suitable watermarking technologies are available to those skilled in the art.
• The transmission of movies in compressed time format has been discussed above. This mode is particularly appropriate when larger hard drives are installed in the customer's user station. A typical VHS movie requires about 10 gigabits of storage (about 1.3 gigabytes), and an HD movie requires about 12 gigabytes of storage. Thus a 20 gigabyte hard drive could hold a dozen VHS movies or one HD movie. Typical receivers can receive a maximum of 27 megabits per second per transponder and current units can only receive one transponder at a time allowing downloading a typical 110 minute VHS movie in about eight minutes or an HD movie in about 55 minutes. Other receivers may contain multiple tuners allowing simultaneous downloading of several movies, or a movie and a CD, or several CD's while watching a live baseball game.
• The sequence of operation for a customer of the system usinguser station228 is summarized inFIG. 12, which is large self-explanatory. The illustrated modes of operation, following account set up, are identified as:
• 1. Selection
• 2. Ordering
• 3. Downloading
• 4. Viewing
• 5. Billing
• 6. Optional “Library” Copy Delivery.
• “On-Demand” Movies
• As discussed above,storage module230 ofuser station228 includes a storage medium (e.g., a hard drive) that stores each movie that the customer selects until such time as the customer either deletes the recording from memory, or the recording is written over when the storage medium's capacity is reached (e.g., on a “first in, first out” basis). When the user station is provided with astorage module230 having a substantial data storage capacity, it is possible for many movies to be immediately available to the customer for viewing. For example, auser station28 in the form of a DBS (or cable) system “set top box” may have a disk drive with a storage capacity on the order of 20 Gigabytes or more, with most of the storage devoted to the movie storage function ofstorage module230. This storage medium permits the storage of approximately six to twenty, or more, compressed movies at all times in each customer's user station. The customer, therefore, at all times has immediate on-demand access to the movies in his storage module for viewing or permanent recording on his recorder (e.g., DVD writer). Movies on the hard drive preferably are stored in encrypted format to prevent loss.
• Thus, one advantage of a large storage capacity atstorage module230 is that a customer may maintain a significant number of movies in storage for a considerable period of time before having to make a decision on whether to view (and pay for) a particular movie. However, this large storage capacity opens up other possibilities, as well. For example, according to one manner of carrying out the invention, the system operator may automatically (i.e., without requiring customer preselection) download certain very popular movies (usually very popular new releases) to every customer storage module on a periodic basis, such as one featured movie every day. At one automatically downloaded movie per day to each customer, a fifteen storage capacity and a “first in, first out” write-over protocol would permit each automatically downloaded movie to remain instorage module230 and available for on-demand viewing for approximately two weeks, with the exact time depending upon how many customer-selected movies are downloaded during that period. Thus, over any two week period, the system operator may automatically make available (at one automatic download per day) 14 popular movies for all customers, without the customers having to preselect anything. Of course, the preselection option for all catalog movies remains available at all times. It will be appreciated that the automatic downloading of movies to all customer user stations can be readily achieved by the system operator simply communicating (e.g., daily) to all user stations the ID header information for that day's automatically downloaded movie or movies. The user station downloads movies to the intermediate storage instorage module230 just as if the recording had been preselected by the customer. The graphical user interface alerts the customer that the recordings are available by a cue such as “YOU'VE GOT FLICKS”.
• Using Customer Preference Information
• In a more customer-specific manner of carrying out the invention, different sets of movies are automatically downloaded at customer user stations according to the movie preferences of the customer. For example, each customer may use the graphical user interface (seeFIG. 13) to select those movie types (e.g., romantic comedy, documentary, action) they most prefer. The system operator uses this information to tailor the automatic downloads to that customer's user station accordingly. In a simple application, the system operator may create, for example, five to ten standard customer profiles so that each customer receives automatic downloads for the one of those profiles which he most closely matches. The objective is for thestorage module230 to have available for on-demand viewing a large percentage of the movies that any particular customer may be interested in at any given time—or at least have those movies available to the customer over a period of time as new entries into storage overwrite older entries, recognizing that at all times the customer is free to order any movie from the catalog.
• As described above, the system operator may create, for example, five to ten customer profiles and assign each customer to one of these profiles according to movie preference information entered by the customer. Thereafter, the customer receives (e.g., daily) the automatically downloaded movies for his particular profile category. However, in other embodiments of the invention, customer preference information may also be used in a more sophisticated fashion to tailor the profiles to the individual tastes of a customer or the tastes of the customer household family members. To this end, the customer may use the graphical user interface (FIG. 14) to enter movie preferences at a desired level of detail. As shown inFIG. 14, a first level of detail is the selection of one or several types of movies (similar to the selection made in connection withFIG. 13). In addition, the customer may go to a second step where each selected type of movie may be further subdivided by, for example, favorite movie star(s)7 top ten movies this month, etc. Other means for subdividing interest areas under a particular type of movie may be used (e.g., World War II,). However the expression of movie preferences is made, this information may be used alone, or in conjunction with other information, to permit the customer's user station to download to memory (e.g., fifteen movie capacity) an ongoing, rolling selection of movies that will most likely match the preferences of the customer.
• Referring toFIG. 15, there is shown a block diagram that illustrates in schematic form the generation and use of customer preference information.FIG. 11 shows portions ofuser station228, namely, thedownload module220 with receiver and thestorage module230 for movie storage. The optional recorder for permanently recording “library” movies (e.g., DVD burner) is also shown. As schematically shown betweenuser station228 andstorage module230,apparatus310 serves to read the ID headers on all of the broadcast movies and select for downloading tomodule230 only those that are indicated as being desirable to the customer by the processed movie preference information.
• FIG. 15 also shows portions ofcentral controller36 that store and analyze customer preference information and customer order information, and generate from that information the individualized “customer catalog” that determines which movies will be automatically downloaded at that customer's user station. To this end,controller36 includes an individual customer preferenceinformation storage module320, a general populationcluster preference database330 and a customercatalog generator module340. Each customer's preference information is entered in the manner described above via the graphical user interface and is communicated tomodule220 by phone/modem. In addition, the preference information of the entire customer population (or some subset thereof), as well as order data, is stored inmodule330. Information frommodules320 and330 is analyzed to create an individual “customer catalog” for each customer viamodule340. The individual customer catalog data is communicated to the user station in each customer household and serves to assure that those movies that best fit the preference customer profile are the ones that are downloaded tostorage module230. While a first-in, first-out protocol may be used for overwriting onto the hard drive ofmodule230, the customer catalog information may serve to establish a different protocol that will overwrite the less likely to be purchased movies ahead of those recordings which, by analysis atmodule340, show more promise of being viewed by the customer. Certain new release movies in high demand within the customer's primary areas of interest may be designated to remain in storage for a minimum period of time, say one week, regardless of the “traffic” throughstorage module230.
• Along with movies, there is blanket transmission of catalogs and other advertising or customer interest information. The storage and display of this information may be based on customer profiles. For example, an advertisement for a new movie that is expected to appeal to young adults, Julia Robert fans, and customers living in a particular geographic area would have this information contained in its header, and the receiver would recognize if any of its users are in any of these categories and will appropriately store or not store this advertisement on the hard drive, and may determine to display or not display this ad on the user's TV catalog. Similarly, advertisements for other related merchandise, like “Star Wars” paraphernalia, might also be displayed. Text describing individual movie stars or related events might also be stored with the catalog.
• Promotion-Based Streaming
• FIG. 16 shows the use of promotion-based streaming to download movies at customer user stations. A content provider (e.g., movie distribution company) may decide to push a selected movie as a promotion. The system operator packages the advertisements and movie and then broadcasts them for automatic downloading by all customers or by a selected group of customers based on the broad profile information developed by the operator (FIG. 15). The promotional movie is advertised to the customers through an advertisement that appears at the top of screens generated by the system, or by a flashing message such as, “YOU'VE GOT NEW FLICKS”. Promotional movies are stored instorage module230 until they are overwritten or deleted. As with the other means of providing movies for viewing, once the customer views the movie, the billing is consolidated in the customer's monthly statement. Promotional-based streaming may be accomplished typically in a relatively short period of time using appropriate bandwidth (e.g., one quarter transponder).
• In applications of the invention where both movies and music are made available to customers, promotions may include movie soundtracks for movies that are being broadcast by DBS or cable. In this situation, prior to broadcast of the movie, the soundtrack is broadcast and automatically downloaded to all user stations. When the movie is broadcast, viewers of the movie are informed that the soundtrack for the very movie they are viewing is on their hard drive and available for immediate on-demand purchase. Purchases may be made during the movie by appropriate means; for example, a translucent icon may appear on the screen and purchase made by simply clicking on the icon. Or, the purchase can simply be made at the conclusion of the movie where, preferably, viewers are reminded that the soundtrack is available on their hard drive for on-demand purchase.
• Alternative Embodiments: Transmission and Storage of Highly Compressed Video Files
• As mentioned above, utilizing current technology, transmission of the video portion of a movie at standard VHS quality forMPEG 2 compression requires approximately 2.4 megabits/sec of bandwidth. A 100-minute movie stored at this compression requires a file size on the order of 1.3 to 1.8 gigabytes, typically about 1.6 gigabytes, which can be stored on various media discussed above, but which is too large for a onesided compact disc (approximately 600 megabytes storage capacity) or a two-sided CD (approximately 1200 megabytes storage capacity). Preserving desirable (e.g., VHS quality) video playback for the consumer, while reducing these bandwidth and data storage requirements, is desirable, particularly if the movie file can be stored on a two-sided CD or, even more preferably, on a single-sided CD. (Preferably, current audio encoding/decoding technologies, such as those from MPEG, Microsoft, Liquid Audio or Dolby, can continue to be used for the audio portion of the movie.)
• Several embodiments of video encoding, compression and processing that achieve the above goals will now be described with reference toFIGS. 16-22.
• Video Encoding Utilizing Existing Codecs and an Upconverter (FIG. 17)
• IBM Corporation (France) has developed a digital video upconverter IC that performs real time upconversion of an incoming video stream and outputs a video pixel stream at up to 3 times the input rate, for the purpose of providing a high definition (HD) or near HD signal to an HD digital TV from a relatively low resolution input. As its primary advantage, this IBM upconverter permits broadcasters to provide HDTV-like services without using the precious bandwidth that would otherwise be required. The IBM upconverter uses a combination of functions to increase the number of lines, remove interlacing, enhance pixelization through spatial and temporal interpolation and increase the frame rate enabling users with high resolution television sets to view high definition video with low resolution input. The IBM upconverter IC is described at http://www.fr.ibm.com/france/cdlav/video.htm, incorporated herein by reference. Other suitable upconverters may be used.
• According to the present invention, upconversion technology is used in a new way for image enhancement of a low resolution, blanket transmitted video input stream (e.g., at 0.8 megabits/sec) so that it can be displayed at an apparently higher resolution (e.g., VHS) at the customer's television. Referring toFIG. 17, the video portion of a movie is highly compressed using, for example,MPEG 2,MPEG 4 or DivX encoding to the lowest possible resolution that can be upconverted at the set top box to permit VHS quality viewing. In certain embodiments, this might be accomplished by shrinking a normal VHS picture from full-screen to quarter-screen size and then compressing the screen comprising a quarter-screen image with the rest of the screen black. The highly compressed, low resolution video is blanket transmitted to the consumer's set top box where conventional decoding hardware (MPEG 2,MPEG 4, DivX) decodes the signal and an upconverter, preferably one employing three-dimensional spatial/temporal interpolation such as the IBM upconverter IC referred to above, increases the pixelization rate to a point where the quarter-screen video may be viewed by the consumer as a full-screen image. The compressed movie (video and audio) may be stored via a local hard drive for local temporary storage. It may also be stored via a CDR on a single-sided or double-sided CD prior to decoding and upconversion provided, as is in preferred embodiments, the total broadcast data will fit on a CD.
• It will be appreciated that the above described techniques ofFIG. 17 not only permit blanket transmission of the movie file using less bandwidth and the ability to store an entire movie on a CD, but also protects the transmitted content by degrading it before transmission and then using specialized processing at the set top box—a type of processing that is poorly handled on a PC and requires a specialized chip.
• Video Encoding Utilizing Zero Instruction Set Computer (ZISC) Pattern Recognition on a Video-By-Video Basis (FIG. 18)
• Another development by IBM Corporation (France) is a zero instruction set computer (ZISC) that utilizes an hardware implementation of artificial neural networks for noise reduction and image enhancement of a gray scale digital still image. By way of summary, the ZISC chip set (e.g., IBM ZISCO36) can recreate images from pattern recognition learning. The ZISC chip set can be taught the difference between” original and a degraded image (degraded from high compression or additive noise) by processing samples of each (the higher number of samples, the better the processing ability and resulting images) and then recreate the original image from an extremely poor quality or degraded image. A discussion of the ZISC technology can be found in “Noise Reduction and Image Enhancement Using a Hardware Implementation of Artificial Neural Networks”, published in VI-DYNN'98-Virtual Intelligence-Dynamic Neural Networks-Stockholm, Sweden, Jun. 22-26, 1998, and in U.S. Pat. Nos. 5,621,863; 5,701,397; 5,710,869; 5,717,832; 5,740,326 and 5,943,670, the contents of which are incorporated herein by reference.
• In accordance with the invention, and with reference toFIG. 18, a highly compressed version of the video (e.g., the video portion of a DVD movie) is created atencoder502 with a compression method such asMPEG 2,MPEG 4 or DivX at the lowest resolution possible that will result in VHS quality output at the consumer's set top box (STB). This highly compressed, low resolution video is stored indatabase504, along with audio that is encoded using standard encoding/decoding technology as identified above. In certain embodiments of the invention, a 100 to 120 minute movie may be compressed in this manner to a file on the order of 500 to 600 megabytes or less, a file that can be stored on a single-sided CD, or alternatively, to about 1100 megabytes for storage on a two-sided CD.
• In parallel, utilizing the zero instruction set computer's pattern recognition capabilities, the video portion of the DVD movie is sampled frame by frame at510. Each sample takes the form of a recognizable pattern that may be, for example, an 8 pixel by 8 pixel pattern that can be stored in 64 bytes. The number of samples per frame is at or near the number to effectively recreate the frame at VHS quality, for example, sampling about 1000 to 2000 samples per frame. As each frame is sampled, optimal patterns are stored. Optimal patterns are those permitting maximal enhancement of the video images that will be degraded by resolution reduction or additive noise prior to transmission. A typical movie has less than 300,000 frames to sample. The resulting database will be substantially less than 600,000,000 samples because so many of the samples can be reused. All of the resulting samples are stored as a digital neural archive (DNA) pattern library. Preferably, the patterns undergo comparison and consolidation at512 and frame type categorization (described below) at514.
• Once the frame patterns have been created and stored in the DNA library, the library of patterns is packaged up at504 with the highly compressed version of the video, and with the encoded audio. For transmission, the entire contents ofdatabase504 is sent. The DNA library of patterns for the movie can be sent and buffered first, followed by the highly compressed video content. Once the patterns are received at the customer's set top box, they are cached in memory for image enhancement to the video. The video content can be streamed in or stored for later playing. When the video is played, it is first decoded using a standard video decoding method (MPEG 2,MPEG 4, DivX) and then sent to the ZISC processor for enhancement with the pattern database. Thereafter, optionally, but preferably, the resulting images are sent directly to an upconverter to increase the pixelization rate, as described above in connection withFIG. 17.
• It will be appreciated that for archiving and storage, the system only needs to store the patterns, along with the highly compressed video file (and the encoded audio). In certain preferred embodiments of the invention, the entire movie, video and audio, and DNA library can be stored on a single-sided CD. Thus, in accordance with this aspect of the invention, the set top box may include a hard drive or other suitable memory device for local temporary storage, as well as a CD recordable device (CDR) for recording movies onto one-sided (or, less preferably, two-sided) CD's for long-term movie storage and archiving.
• Video Encoding Utilizing ZISC Pattern Recognition for any Video Source (FIG. 19)
• Once a substantial number of videos have been successfully learned through pattern recognition methods described above, eventually there will be enough patterns in the DNA library that the library may be used to enhance virtually any type of video. Once this is accomplished, the DNA library becomes a database that no longer needs to be attached to the video file, but can be stored on remote devices (for example, on disc or ROM) for movie enhancement purposes. Thus, as shown inFIG. 19, the customer's set top box can include a stored universal DNA library so that the transmitted movies need not be accompanied by their own pattern library information. In this regard, the universal library may include libraries for various video types, for example, broadcast sports, old black-and-white movies, animation movies, or other broad color palette video types.
• Referring toFIG. 21, it will be appreciated that patterns can be grouped in the DNA pattern library by frame type. Grouping in this manner enables the library to be further categorized and to reduced access speed to the library by the ZISC processor.
• Referring toFIG. 22, it will also be appreciated that as a video file is being scanned, the specific frame types may be noted and stored in the DNA pattern library. The library pattern groups are grouped by the most likely patterns to be used for a given frame type in the video. The goal is to reduce the number of patterns and to group them to the point that they can be stored and read as needed from the ZISC processor.
• Thus, the ZISC-enabled compression technology described above relies on a DNA library of small image types (for example, 8 by 8 pixels) to decode. The library is valuable because:
• • 1. It provides extra security, especially if the library is communicated separate from the media and stored in the set top box.
  • 2. It may allow a higher level of compression of the media so the compressed video with or without its respective library information can be stored on a single CD.
  • 3. It may provide extra security by requiring a hardware chip whose functions cannot be run quickly on a PC type processor.
    Video Encryption Utilizing ZISC Noise Reduction (FIG. 20)
• The embodiment ofFIG. 18 can be further enhanced by adding noise to the transmitted video as a type of copy protection, with the noise being capable of removal by the ZISC processor. This noise is added based upon the premise that, at some point, the quality of the transmitted video content is so poor that it is not worth duplicating or copying the digital source. In preferred embodiments (FIG. 20), a uniform pattern of noise is added to each frame of the movie. To enable the best enhancement by the ZISC processor at the set top box, preferably care is taken to restrict the character and the location of the noise to specific areas of the video frames so that noise reduction and removal by the ZISC processor is 5 optimized. (Obviously, noise will not be used to distort the transmitted DNA library.) Coordination between noise distribution and initial pattern recognition points assure that the associated category pixels of the degraded video are not changed by added noise. Another benefit to adding the noise in the form of uniform noise from frame to frame is the additional compression ratios that can be achieved due to identical pixels throughout the entire video.
• Ensuring Flawless Movie Recordings Using Checksums and Multiple Downloads
• Satellite receivers do not have perfect reception due to the tradeoff between electrical power and bandwidth of the satellite. Weather conditions, motion of atmosphere layers or obstructions between the dish and the satellite may interrupt the signal. A momentary loss of bits will cause a video image to freeze for a frame or two, while longer interruptions will cause reception to blank. Whereas a short loss in video is a couple of frozen frames, data loss in audio may leave a glaring blank. Therefore, a satellite system for transmission of movies and/or music preferably should include a method to detect and fix data losses at the receiver.
• Patching data “potholes” requires a method for sensing potholes and another for placing “asphalt” to fill them. Typically, digital data is sent in packets of bits (perhaps one thousand bits at a time with each packet containing 1/40 second of music). Loss of bits within a packet can be detected by error codes or merely a “checksum” at the end of the packet which indicates the sum of all the sent bits. Each packet may have an identifying number so that loss of an entire packet is noticed. This is all conventional Internet technology.
• Repairing data loss might be accomplished by replacing an occasional packet by the receiver asking for a copy of the packet via an Internet or modem phone connection. However, the frequency of data loss and amount of contiguous data might be lost (for instance, during a rainstorm), requires a wider bandwidth, like the satellite, to provide the material to repair 5 data loss.
• Therefore, in certain embodiments, the present invention provides the capability in the system to detect bit losses and receive a second copy of the selection and use all or part of that copy to patch the missing or corrupted bits or packets in the original download. This would require storing a requested download on the storage medium (e.g., hard drive), checking for missing data, informing the customer that the download was imperfect, then receiving and storing all or part of a second (or rarely a third) transmission, and then selecting good packets of bits to make up the final copy.
• In practice, a customer selects a movie or music selection via the TV-remote interface and the TV screen notes a download, say, 45 minutes later. As soon as the download is completed, the customer is informed of the quality of the download (A, B, C, D) and informed of the time of the next transmission of the material. The customer has the option of viewing the less-than-per feet movie, or even burn a CD if they wish. Or the customer can wait for a better version.
• While the present invention has been described in connection with certain illustrated embodiments, it will be appreciated that modifications may be made without departing from the true spirit and scope of the invention. For example, the term “video display device” has been used herein in its broadest sense to refer to any suitable video imaging system, such as a television, computer monitor, plasma screen,LED 5 display, liquid crystal display, 3D imaging system, or the like, understanding that an appropriate audio capability is provided. Also, while a DVD RAM platter system has been described as one preferred recording and playback device, both at real time and time-compressed transmission speeds and write speeds to the discs, other systems may be used, alone or in combination, such as magneto-optical disc, digital tape, VHS tape, a central or auxiliary server (optical, magnetic or magneto-optical). The discrete storage media of any one of these alternative devices may be arranged in a platter or stack or other suitable format to provide the user access to multiple stored audio/video content stored thereon. These and other modifications are deemed to be within the true spirit and scope of the invention.

Claims (32)

1. A method of distributing digital data content to a customer, the method comprising:

degrading the resolution of digital data content in order to not permit proper display of the digital data content;

transmitting a plurality of the digital data content to the customer;

automatically selecting desired digital data content from the plurality of digital data content for storage according to a predetermined criteria;

permitting the customer to display any of the selected digital data content from storage;

upconverting the selected digital data content immediately prior to display to permit display; and

transmitting digital data content displaying information from the customer to a remote location to verify that a selected digital data content has been displayed.

2. The method ofclaim 1, wherein the upcpnverting comprises upconverting to increase a pixelization rate of the preselected digital data content.

3. The method ofclaim 2, wherein the upconverting is performed by three-dimensional spatial/temporal interpolation that performs real time de-interlacing and frame rate upconversion of the preselected digital data content.

4. A system for distributing digital data content to a customer, the system comprising:

degrading means for degrading a plurality of digital data content in order to not permit proper display of the digital data content;

first transmission means for transmitting the degraded plurality of the digital data content to the customer;

receiver means for receiving the plurality of degraded digital data content and automatically selecting desired digital data content from the plurality of digital data content according to a predetermined criteria;

a memory for storage of the selected degraded digital data content;

enhancement means for enhancing the selected digital data content in the memory immediately prior to display in order to permit display;

a playback device for permitting the customer to display any of the enhanced selected digital data content from the memory; and

second transmission means for transmitting digital data content displaying information from the customer to a remote location to verify that a selected digital data content has been displayed.

5. The system ofclaim 4, wherein the enhancement means comprises an upconverter that utilizes three-dimensional spatial/temporal interpolation to perform real time de-interlacing and frame rate upconversion.

6. The system ofclaim 4 wherein the enhancement means comprises a hardware implementation of artificial neural networks.

7. The system ofclaim 6, wherein the hardware implementation comprises a zero instruction set computer.

8. The system ofclaim 4, further comprising:

an encoder for compressing the digital data content prior to transmission to the customer; and

a decoder for decompressing the digital data content prior to displaying by the customer.

9. The system ofclaim 4, further comprising a billing system for billing the customer for only the digital data content that is stored and displayed.

10. The system ofclaim 4, wherein the digital data content is video image data and the playback device is a monitor for displaying of the video image data by viewing.

11. The system ofclaim 4, wherein the digital data content is audio data and the playback device is at least one speaker for displaying of the audio data by audio reproduction.

12. The system ofclaim 4, wherein the predetermined criteria is randomly on a periodic basis.

13. The system ofclaim 4, wherein the predetermined criteria is based on the popularity of the digital data content.

14. The system ofclaim 4, wherein the predetermined criteria is based on the preferences of the customer.

15. The system ofclaim 14, wherein the preferences of the customer are manually entered by the customer.

16. The system ofclaim 14, further comprising:

means for inserting classification information in a header of at least some of the plurality of digital data content prior to transmission; and

a processor for comparing the classification information to preference information of the customer and automatically selecting digital data content from the plurality of digital data content having a predetermined degree of similarity between the classification information and the preference information.

17. A user station for displaying digital data content, the user station comprising:

a receiver for receiving a transmission of a plurality of digital data content, the digital data content being degraded in order to not permit proper display of the content;

a memory;

a means for automatically selecting from the plurality of digital data content for storage in the memory;

selection means for informing the user of the digital data content automatically selected and for selecting from the automatically selected digital data content for display; and

enhancement means for enhancing the selected digital data content in the memory immediately prior to display in order to permit proper display of the digital data content.

18. The user station ofclaim 17, wherein the enhancement means comprises an upconverter that utilizes three-dimensional spatial/temporal interpolation to perform real time de-interlacing and frame rate upconversion.

19. The user station ofclaim 17, wherein the enhancement means comprises a hardware implementation of artificial neural networks.

20. A user station for displaying digital data content, the user station comprising:

a receiver for receiving a transmission of a plurality of digital data content, the digital data content being degraded from an acceptable displaying degree; a memory;

selection means for informing the user of the plurality of digital data content received, for selecting from the plurality of digital data content for storage in the memory, and for selecting from the digital data content stored in memory for display; and

enhancement means for enhancing the preselected digital data content in the memory prior to display in order to permit display, wherein the enhancement means comprises a hardware implementation of artificial neural networks and wherein the hardware implementation comprises a zero instruction set computer.

21. The user station ofclaim 17, further comprising a display for displaying the digital data content stored in the memory.

22. The user station ofclaim 17, wherein the digital data content is video image data and the display is a monitor.

23. The user station ofclaim 17, wherein the digital data content is audio data and the display is at least one speaker.

24. The user station ofclaim 17, further comprising a transmission means for transmitting billing information to a remote location for billing the customer for only the digital data content that is stored and displayed.

25. The user station ofclaim 17, wherein the receiver is selected from a group consisting of a satellite receiver, cable receiver, internet receiver, and telephone receiver.

26. The user station ofclaim 17, wherein the memory is a peripheral device selected from a group consisting of a hard drive, a compact disc, an optical drive, a magnetic drive, a magneto-optical drive, and a DVD Ram.

27. The user station ofclaim 17, wherein the plurality of digital data content is compressed, the user station further comprising a decoder for decompressing the digital data content prior to displaying by the customer.

28. The user station ofclaim 17, further comprising means for detecting data errors in the stored digital data content.

29. The user station ofclaim 17, wherein the predetermined criteria is randomly determined on a periodic basis.

30. The user station ofclaim 17, wherein the predetermined criteria is based on the popularity of the digital data content.

31. The user station ofclaim 17, wherein the predetermined criteria is based on the preferences of the customer.

32. The user station ofclaim 31, wherein the preferences of the customer are manually entered by the customer.

Images