CROSS-REFERENCES TO RELATED INVENTIONSThe present application is a continuation application of and claims priority to commonly assigned U.S. patent application Ser. No. 10/446,375 (now U.S. Pat. No. 7,391,528), titled “Apparatus and method for high-throughput and flexible digital printing”, filed May 23, 2003, the disclosures of which is incorporated herein by reference.
FIELD OF THE INVENTIONThis invention relates to the field of digital printing, and more specifically to an apparatus, architecture and method for efficient printing image prints using digital image data.
BACKGROUND OF THE INVENTIONFor many years, photographs were produced in an analog process based on silver-halide chemistry. An image was captured by exposing a photo-sensitive film to a scene by an optical system in a camera. The photo-sensitive material coated on the film includes silver halide emulsions. The silver halide emulsions can capture photons and record a latent image corresponding to the captured image. The exposed photo-sensitive film was chemically developed to convert the latent image into a dye image on the film. A photo-sensitive paper was in turn exposed to the dye image on the film. A photographic print is finally obtained after the exposed paper is processed. As with other systems, photography can benefit from digital techniques applied to various aspects of the process. Image data, captured by a digital camera or digitized from a reflective print or a film by a scanner, can be transmitted anywhere in the world almost instantaneously and then stored on mass storage devices. Multiple copies can be easily made and stored at different locations. The image data can be manipulated using image-processing software.
As well known in the photographic industry, it is desirable for the photographic prints to have the look and feel of the conventional silver halide based photographic prints, even if the images are captured in a digital process. To fulfill this need, the digital images can be digitally exposed on a photographic paper and subsequently developed, bleach/fixed, and washed in the conventional photographic chemical processes. Such produced photographic prints have equal image quality and the same look and feel as the conventional photographs for viewing and sharing.
The process for generating photographic prints includes a number of different steps. Image data are often compressed in the digital cameras. To generate a print of such compressed images, one must uncompress the data and perform image processing on the uncompressed image data. The image processing operations can include tone or color adjustment, neutral balance, and image enhancement. Additional image design and text information may also be added to the digital image. The image data is then converted into an image exposure pattern to expose a photosensitive material coated on a substrate to form a latent image. The latent image is converted to form a dye image when the photosensitive material is processed. Information may be printed on the back of the prints. The prints are cut and packaged before shipping. Any of these processes can become a bottleneck that limits the overall speed of the system.
Thus, there is a need for a method and apparatus that can efficiently reproduce photographic prints in response to input digital images.
SUMMARY OF THE INVENTIONOne aspect of the present invention provides a digital printing system for producing prints in response to input digital images, comprising:
a) a digital printer for producing prints;
b) a plurality of computer processors, including
- i) one or more image-rendering units for rendering the input digital images to generate rendered digital images, wherein the image rendering is independent of specific characteristics of the digital printer; and
- ii) one or more image processors for processing the rendered digital images in accordance with one or more specific characteristics of the digital printer, such processed images being subsequently used by the digital printer to produce the prints, wherein the plurality of computer processors can be dynamically assigned to be the image-rendering unit or the image processor.
Another aspect of the present invention provides a method for a digital printing system for producing prints in response to input digital images, comprising:
a) a plurality of digital printers that are distributed at two or more locations;
b) a plurality of computer processors, including
- i) one or more image-rendering units for rendering the input digital images to generate rendered digital images, wherein the image rendering is independent of specific characteristics of the digital printer; and
- ii) one or more image processors for processing the rendered digital images in accordance with one or more specific characteristics of the digital printer, such processed images being subsequently used by the digital printer to produce the prints, wherein the plurality of computer processors can be dynamically assigned to be the image-rendering unit or the image processor.
An advantage of the present invention is that it provides a high-throughput digital printing system that can fully utilize the maximum intrinsic speeds of the digital printers within the digital printing system. The digital images are rendered independent of the printer devices and processed specific to the printer devices so that the digital images are prepared to be in the ready-to-print states prior to the printing operations.
Other advantages of the present invention include the following. The architecture of the rendering system is compatible with low-cost off-the-shelf computers, resulting in high price/performance computing. It is flexible, robust, and scalable to any printing throughputs and printer types. Furthermore, the present invention provides a flexible digital printing system that is suitable for the centralized and distributed printing. The distributions of the image rendering system can be tailored to the distributions of the digital printers, the data transmission rates, and the schedules of the various operations related to digital printing. The system throughput is optimized by the flexibility of dynamic assignments of image rendering, image processing, the printing jobs to distributed computer processors and digital printers.
Still another advantage of the present invention is that it provides an efficient digital printing system that includes a image rendering system that can dynamically adjust processing resources in response to the number of digital images assigned to be rendered independent of the printer devices and the number of digital images assigned to be processed specific to the printer devices.
BRIEF DESCRIPTION OF THE DRAWINGSFIG. 1ashows a block diagram in accordance to one embodiment of the printing system of the present invention.
FIG. 1bis a block diagram showing details of therendering system120 ofFIG. 1a.
FIG. 2 is a block diagram in accordance to another embodiment of the printing system of the present invention.
FIG. 3 is a block diagram in accordance to yet another embodiment of the printing system of the present invention.
DESCRIPTION OF PREFERRED EMBODIMENTSIn the following detailed description of the preferred embodiments, reference is made to the accompanying drawings that form a part hereof, and in which are shown by way of illustration specific embodiments in which the invention may be practiced. It is understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention.
FIG. 1ashows an embodiment of the present invention. Thedigital printing system100 includes animage archive111 where the digital images are stored in the long-term base. The digital images can be captured by digital cameras by customers and sent to a photo service provider, such as Shutterfly, Inc, based at Redwood City, Calif., or a retail location. The digital images can also be digitized from photographic films after the images are captured on the film and the films are chemically processed. The customer can submit orders for producing image-based products using the digital images. In the present invention, image-based products include photographic prints, greeting cards, greeting cards, photo books and albums, poster images, framed photo prints, photo calendars, photo books, photo T-shirt, photo coffee mugs, CDs or DVDs containing recorded images, mouse pads, key-chains, or any other type of photo gift or photo novelty items. An order of image-based product may include a combination of different image-based products, for example, 4 copies of a 4″×6″ prints based on one digital image, a personalized photo calendar based on 13 digital images (for the cover and the 12 months), and a photo birthday card base on another digital image. The order information submitted by the customers is stored in anorder database112. In addition, the rendering or processing status, the product types, the shipping methods and priorities of the print jobs are also stored at theorder database112.
Thedigital printing system100 further includes ascheduler115, animage rendering system120, one or more digital printers such as one or moredigital minilab printers141, one or more digital roll-to-rollphotographic printers142, and one or moredigital presses143, andline controllers131,132,133 respectively in connection with each digital printer (141,142,143). Theimage rendering system120 includes one or moreimage rendering units121, animage cache122, and one ormore image processors123. Thedigital printing system100 can also include other types of digital printers such as thermal dye sublimation printers and electrographic (or laser) printers. Typically, it is desirable for a line controller to be located close to its associated digital printing equipment so it is easier for the operator to monitor the status of the printing jobs on the line controller. The various printing equipment and their associated line controllers can be distributed at one central location (i.e. at a central lab), or at one or more remote locations relative to theimage archive111, theorder database112, or thescheduler115.
In the present invention, the term “photographic printer” refers to a printer that receives digital images and produces dye images on a photosensitive material such as photographic paper. An example of the photographic printers is thedigital minilab printer141 described above. Examples of thedigital minilab printers141 compatible with the present invention include Fuji Frontier Digital Minilab printers, Noritsu's digital minilab printers, Kodak's Digital Lab System (DLS), Agfa D-Lab Minilab printers, and so on. Another type of photographic printers is the digital roll-to-roll photographic printers as exemplified by Gretag FastPrint printer, Kodak's I-Lab Central Lab printer, and Agfa's d-print.20 digital high-speed printer. These photographic printers typically include an exposure unit, one or more chemical processing unit, one or more back printing units, and one or more cutting and packaging units. The digital roll-to-roll photographic printers normally receive large rolls of unexposed photographic paper in light-sealed magazines. The paper rolls are cut at the cutting and packaging units after exposure, chemical processing, and backprinting. Details about the digital roll-to-roll photographic printers are disclosed in the commonly assigned and above referenced U.S. patent application Ser. No. 09/871,022, filed on May 31, 2000, titled “Apparatus, Architecture, and Method for High Speed Printing”, the disclosure of which is incorporated herein by reference.
Digital presses are typically based on 4-color (Y,M,C,K) offset printing engines. In contrast to the photographic printers that develop dye images on pre-sensitized photograph media, the digital presses print images by transferring toners or inks on to substrates. Examples of the digital presses include HP Indigo 3000 digital printing press, Xerox's DocuColor printers, and NexPress 2100.
The information about orders by the customers is stored in theorder database112. Thescheduler115 retrieves the order information from the order database113, and organizes the orders into printing jobs. The priorities of the printing jobs may depend on a number of factors as defined by a predetermined set of rules, such as, the time when the job order was received, the shipping method, and any special timelines when the products are to be used (e.g. holiday presents or greeting cards before the holidays). Each order may contain a plurality of printing jobs. For example, the order cited above may include three printing jobs: one having 4 4″×6″ prints, another job having a personalized photo calendar, and a third job including a photo birthday card. Thescheduler115 then sends information about the printing jobs and their sequence to theimage rendering system120.
A detailed block diagram of theimage rendering system120 is shown inFIG. 1b. In one embodiment of the present invention, theimage rendering system120 includes a plurality of computer devices connected in a computer network such as a local area network (LAN) or the Internet. Theimage rendering system120 includes a rendercontroller124, and animage cache122, a plurality ofcomputer processors126A,125B, . . .126H,126I,126J,1 . . . and126X that can be dynamically and automatically assigned to be theimage rendering units121 or theimage processors123. As described below, the rendercontroller124, theimage cache122 and the computer processors126 can be distributed flexibly on the network for maximizing efficiency. In some embodiments, various devices in theimage rendering system120 uses a simple XML/URL based API (extended markup language/universal resource locator), and file based (NFS) and URL-based output. The architecture of therendering system120 can be built using low-cost off-the-shelf computers resulting in high price/performance computing. It is flexible, robust, and scalable to any printing throughputs and printer types of thedigital printing system100.
An advantage of thedigital printing system100 in the present invention is that it maximizes the overall throughput of thedigital printing system100. A key benefit of digital image printing is to allow images to be customized in many ways that cannot be easily achieved by the traditional photography. The digital image printing can be customized according to the image properties, the properties of the image capture devices, the image content, the specific users, the specific image-based products in the orders, and specific printing equipment used to produce the products. The increased demand for image customization has greatly increased the load on image rendering and image processing before the printing of the digital images. The image rendering and image processing operations are often the bottleneck to thedigital printing system100 if they are conducted in synchronization with the printing operations. The image-rendering system120 allows image rendering and image processing to be performed prior to the printing operation so that ready-to-print image data is prepared before the printers begin the printing operations. The throughput of each digital printer can therefore be fully utilized.
The processing of digital images includes printer-independent image rendering and printer-dependent image processing respectively handled by theimage rendering units121 or theimage processors123. The printer-independent image rendering includes image decompression, tone calibration, color correction, white balance, sharpening, image enhancement, image cropping, compositing image borders and/or image effects, and image re-sampling. The printer-independent rendering may also produce the images for the header prints for the printing jobs. The printer-dependent image processing includes color or tone calibrations of the printers, color mapping, image formatting, and optionally formatting print jobs for the printers, etc.
The image-rendering operations are printer independent and can be conducted before the printing jobs are assigned to specific printers. In accordance to the present invention, the image rendering operations begin at theimage rendering units121 once the printing job information is received from thescheduler115. The rendered images are stored in theimage cache122. The status of the rendered images and printed jobs are updated at theorder database112. The image processing operations on the other hand are printer dependent, which are conducted after a printer has been assigned to print the printing jobs associated with the digital images.
The rendercontroller124 manages theimage rendering system120 to maximize its image rendering/processing efficiencies. Therendering controller122 regularly records the requests for image rendering and image processing and determines the appropriate resources for each type of operations. For example, more computer processors (126A-H) will be automatically assigned to be the image-renderingunits121 than to be theimage processors123 if the number of scheduled image-rendering jobs is higher than the number of requested image-processing jobs. On the other hand, more computer processors (126I-X) are automatically assigned to be theimage processors123 than assigned to be the image-renderingunits121 if the number of requested image-processing jobs is higher than the number of scheduled image-rendering jobs.
Upon receiving the printing job information from thescheduler115, the image rendering units121 (i.e. thecomputer processors126A,126B . . .126H that are assigned to be the image rendering unit121) fetch from theimage archive111 the digital images to be used in the printing jobs. The printer-independent image rendering is conducted. The rendered digital images are locally stored in theimage cache122 to minimize the delay in retrieving the images for the subsequent image processing. The status and the information of the rendered printing jobs are updated and stored at theorder database112. The information includes product types, shipping method, and priorities, etc.
Each of the line controllers131-133 manages the printing jobs for the respectivedigital minilab printer141, the digital roll-to-rollphotographic printer142, anddigital press143. When a printer is first turned on, its associated line controller (131,132, or133) sends an inquiry to theorder database112 for the status and the information of the rendered printing jobs stored in the image cache, including the information about orders of the product types that the printer is ready to print. In accordance to another embodiment of the present invention, the inquiries about the status and the information of the rendered printing jobs stored in the image cache can also be made by the line controllers to theschedule115.
After the information of the rendered print jobs of the correct product types is received by the line controller, the line controller (131,132 or133) sends a request to the image rendering system120 (the render controller124). The request to theimage rendering system120 specifies the product type that the printer is ready to print. For example, a digital minilab printer can at each time print one or two of the print formats such as 4″×6″, 5″×7″, 8″×10″ and so on. A digital press may be able to print greeting cards, calendars, and so on.
The digital printers are typically calibrated at least once a day. The calibration data (typically in the form of LUT's, ICC profiles, etc) are sent from the line controllers to be stored in theimage cache122 in the image rendersystem120. Other printer specific information such as printing resolution, orientation, the number of colors (RGB vs. YMCK) is also stored in theimage cache122.
After receiving the printing requests from the line controllers131-133, the image rendercontroller124 searches the rendered images stored in theimage cache122 for appropriate product types as requested by the line controller. The rendered digital images of the product types that match the requested product type are sequenced in accordance to the priorities of the jobs/orders. A batch of these matched print jobs and the printer specific properties (e.g. calibration data) will be sent to theimage processors123 for the printer-dependent image processing. The image processing of the rendered images are conducted on theimage processor1261,126J-126X. The processed and ready-to-print digital images are automatically sent to the line controller that made the request, or sent directly to the associated digital printing equipment. The line controller stores a batch of printing jobs each containing one or more ready-to-print images specific to the printer. The printing operation is ready to begin. As the images are printed, the list of ready-to-print images may become shorter. The line controller (131-133) can send a new request to image render system when the number of ready-to-print images reaches a minimum threshold.
The devices in the rendersystem120 can be distributed in different configurations.FIG. 2 illustrates another embodiment of the render system in accordance to the present invention. The printing equipment251-253 are remotely located relative theimage archive211, theorder database212, and thescheduler215. The printer-independent image rendering operations are conducted on the image-rendering unit221 and stored on theimage cache222 after the printing jobs are prepared by the scheduler. The image processors231-233 are distributed with each group of line controllers241-243 and digital printing equipment251-253. The printer-dependent image processing operations occur on the image processors next to the digital printing equipment251-253.
While the general sequence of the various pre-print operations are similar to those described above in relation toFIGS. 1aand1b, the printing architecture inFIG. 2 is particularly optimal for the data transfer rate considerations. The processed digital images output of the image processor231-233 are often in the raw image format and very large in image sizes (e.g. more than 6 MB for a 4″×6″ print at 300 dpi printing resolution). These processed digital images may thus require considerable time for data transfer over the computer network, especially for transfers to remote locations where the digital printing equipment (251-253) are distributed. In contrast, the rendered digital images can be compressed (e.g. in JPEG format) and can be relatively small in image size (e.g. 0.5 MB per image). The architecture shown inFIG. 2 keeps the data transfer among remote locations to small image sizes. The data transfer of large image files sizes between the image processors231-233 and the line controller241-243 are conducted in a high-speed Location Area network (LAN) such as a GigaBit Ethernet and optical fiber connection. The high local data transfer rates ensures that the data transfer keeps up with the printing rate of the printing equipment and that the data transfer does not become a bottleneck to theoverall printing system200.
The architecture inFIG. 2 is also compatible with data transfer over memory media between the central location (where the image rendering units are location) and the printer locations (where the digital printing equipment are located). Rather than storing onimage cache222, the rendered digital images can be stored on CD or DVDs and carried by an operator to the printer locations. The rendered images stored on the memory media will be processed and printed at the printer location. The communication to the order database is optional. This mode of operation can be beneficial when a network connection or a file transfer protocol is not established between the central location and the distributed locations like the situation between the photo service provider and a short-term printer partner.
FIG. 3 shows another embodiment of the image render system in accordance with the present invention. Theprinting system300 includes a combination of centrally locatedprinting equipment351,352 and associatedline controllers341,342, and distributedprinting equipment353 andline controller343. Theimage rendering systems320 and325 can be tailored to suit the needs of both the centrally located and distributed printing equipment. The image rendersystem320 includes centrally locatedimage rendering unit321 andimage processors331,332. Theimage rendering system325 is completely remotely distributed next to theremote printing equipment353. In one aspect, the architecture shown inFIG. 3 is a hybrid of the structures shown inFIG. 1aandFIG. 2. The sequence of pre-print operations is also approximately the combination of the operations described in relations toFIG. 1a,FIG. 1b, andFIG. 2.
It is understood that the above description is intended to be illustrative, and not restrictive. Many other embodiments will be apparent to those of skill in the art upon reviewing the above description. The scope of the invention should, therefore, be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.