PRIORITY CLAIM AND INCORPORATION BY REFERENCEThis application claims the benefit of U.S. Prov. Pat. App. No. 62/360,424 filed Jul. 10, 2016. This application incorporates by reference, in their entireties and for all purposes, U.S. Prov. Pat. App. No. 62/360,424 and international patent application number WO2005/086526 A1.
BACKGROUND OF THE INVENTIONField of the InventionThe present invention relates to a new and useful machine. In particular, the display case includes a transparent video screen for viewing display case contents.
Discussion of the Related ArtDisplay cases are well known in various environments including the shops and stores of merchants and along the refrigerated/freezer product aisles of grocery stores and markets. Typical of such display cases are viewing ports or windows that enable observation of items within the case.
SUMMARY OF THE INVENTIONEmbodiments of the present invention provide a display case with a transparent video screen through which items within the case may be viewed.
In an embodiment, a display case system is for viewing a product through a transparent liquid crystal display (LCD) screen, the display case comprising: a housing arranged around a product display space; the screen and a housing opening arranged to provide a view through the screen into the product display space; a plurality of light emitting diode (LED) arrays within the housing for backlighting the screen; a power supply for selectively distributing electric power to one or more of the arrays; a local controller electrically coupled with the power supply and a sensor; and, the sensor for triggering operation of the screen when a patron approaching the display case is recognized by the sensor.
In an embodiment, the display case further comprising: a multimedia patron immersion function; tasks implementing the function include patron assessment, scene creation, scene delivery, and a response to patron feedback; patron assessment including recognition of visual characteristics of patron via a video camera; scene creation that results in video and audio content that is personalized based on patron assessment; delivery of the personalized scene directed to a space occupied by the patron; and, recognition of patron feedback and delivery of a response directed to a space occupied by the patron.
In an embodiment, the display case wherein: patron assessment includes an assessment of patron gender, age, and ethnicity assessments; scene creation utilizes content derived from video camera images of the patron; scene delivery includes video presented in a first plane via the LCD screen and video presented in a second plane that intersects the first plane; scene delivery includes audio presented via a sound field focused on the patron; patron feedback is via patron gestures received by the video camera and interpreted by the local controller; and, delivery of a response to the feedback includes actual or virtual manipulation of a product within the display case.
In an embodiment, the display case wherein patron assessment further includes an assessment of patron reaction, mood, and head tracking or wherein the video presented in the second plane is video projected on a surface adjacent to the patron.
In an embodiment, a donation receptacle for receiving donations and for viewing received donations through a transparent liquid crystal display (LCD) screen, the receptacle comprising: a housing arranged around a donation display space; the screen and a housing opening arranged to provide a view through the screen into the donation display space; a plurality of light emitting diode (LED) arrays within the housing for backlighting the screen; a power supply for selectively distributing electric power to one or more of the arrays; a local control including a media player electrically coupled with the power supply and a proximity sensor; and, the proximity sensor for triggering operation of the screen.
In an embodiment, the donation receptacle wherein the LCD screen is touch sensitive for one or more of charity selection, payment, and collection of donor information used to report donor activity via a social media website.
In an embodiment, the donation receptacle wherein the screen and speakers deliver a multimedia message to an approaching patron that triggers the proximity sensor.
In an embodiment, the donation receptacle wherein the screen and speakers deliver a multimedia message to a patron following insertion of a donation in the receptacle.
BRIEF DESCRIPTION OF THE DRAWINGSThe present invention is described with reference to the accompanying figures. These figures, incorporated herein and forming part of the specification, illustrate some embodiments of the invention and, together with the description, further serve to explain its principles enabling a person skilled in the relevant art to make and use the invention.
FIG. 1 shows a block diagram of a display case of the present invention.
FIGS. 2A-C show features of a transparent LCD panel of the display case ofFIG. 1.
FIGS. 3A-F show mechanical features of the display case ofFIG. 1.
FIGS. 4A-D show electrical and electronic features of the display case ofFIG. 1.
FIGS. 5A-G show operational features of the display case ofFIG. 1.
FIGS. 6A-B show a display case in the form of a donation kiosk.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTSThe disclosure provided in the following pages describes examples of some embodiments of the invention. The designs, figures and description are non-limiting examples of the embodiments they disclose. For example, other embodiments of the disclosed device and/or method may or may not include the features described herein. Moreover, disclosed advantages and benefits may apply to only certain embodiments of the invention and should not be used to limit the disclosed invention.
As used herein, the terms “coupled” and “attached” include direct and indirect connections. Moreover, where first and second devices are coupled or attached, intervening devices including active devices may be located therebetween.
FIG. 1 shows adisplay case system100. A typicaldisplay case system102 includes a transparentLCD panel assembly104,LED lighting108, one ormore sensors112, acabinet assembly106, andelectronics110. Some embodiments of the display case system include one or more of a man-machine interface (“MMI”)116, a refrigeration/freezer unit120, communications devices (“Comms”)114,ventilation devices118, andother devices122.
FIGS. 2A-B show transparentLCD panel assemblies200A-B.
InFIG. 2A, a first transparentLCD panel assembly210 is included. Here, the panel assembly may be referred to as an active or protected active assembly.
This first transparentLCD panel assembly210 includes a front glass such as atempered glass212 and behind the front glass anLCD cell assembly213 including an LCDcell carrier glass214 and anLCD cell216. In various embodiments the transparent LCD cell includes LCD crystals interposed between first and second glass plates. And, in various embodiments, the LCD cell includes a vertical filter, a horizontal filter, and a color filter. For example, a vertical filter may be adjacent to the first glass plate and horizontal and color filters may be adjacent to the second glass plate.
InFIG. 2B, a secondLCD panel assembly220 includes aforward assembly210 and arearward assembly221. Theforward assembly210 may be referred to as an active or protected active assembly.
This second transparent LCD panel assembly includes a front glass such as atempered glass212 and behind the front glass anLCD cell assembly213 including an LCDcell carrier glass214 and anLCD cell216. In various embodiments the transparent LCD cell includes LCD crystals interposed between first and second glass plates. And, in various embodiments, the LCD cell includes a vertical filter, a horizontal filter, and a color filter. For example, a vertical filter may be adjacent to the first glass plate and horizontal and color filters may be adjacent to the second glass plate.
Therearward assembly221 may be referred to as a pair glass or thermal insulating assembly. Therearward assembly221 includes aforward glass222 and arearward glass224 spaced apart byspacers226 such that agap223 is formed therebetween. The gap space may be evacuated and/or filled with a gas such as a low thermal conductivity gas, for example filled with nitrogen.
In some embodiments, therearward assembly221 includes means for prevention and/or elimination of glass fogging. For example, i) any of thepair glass222,224 or ii) a frame in which a pair glass is mounted may be heated as by an electrically resistive heater trace (e.g., conductive paint) on the glass or using heater wire such as nichrome wire embedded in the door frame.
FIG. 2C shows a schematic representation of anLCD cell200C. Here, anLCD cell230 includes apixel array240. As seen in the figure, pixels may be regularly arranged as in a grid like arrangement withrows 1, 2, 3, 4, 5 . . . and columns a, b, c, d, e . . . .
In use, all of the pixels of an LCD panel are typically operated to produce respective brightnesses and colors, for example through the use of filtered subpixels and related operating voltages, that reproduce an image sent to theLCD cell230. In the present invention, some embodiments use an atypical pixel operating scheme wherein some pixels such as pixels in a regular pattern of pixels are operated for continuous transparency while the remaining pixels are operated to reproduce the desired image.
For example, the pattern may be an “every other” type pattern such that pixels a1, a3, a5 . . . ; b2, b4 . . . ; c1, c3, c5 . . . ; d2, d4 . . . ; e1, e3, e5 . . . ; are operated for continuous transparency. Operating sets of pixels in patterns or regular patterns for continuous transparency may enhance the viewability of images presented on a transparent LCD panel and may enhance the transparency of the LCD panel and thus the view of product(s) within.
The schematicsFIGS. 3A-Fshow cabinet assemblies300A-F.
InFIG. 3A acabinet assembly302 may include one ormore components300A. The cabinet assembly includes a housing and a means of accessing a housing interior. For example, a housing assembly may include a housing such as anouter housing306 and adoor308. Embodiments may also include aninner housing304 and/or astand310. Where inner and outer housings are included, a space between the housings may be created and used for channeling ventilation air, for wireways, for enabling relative motion of the housings, and/or for thermal or mechanical isolation between the housings.
InFIG. 3B, a schematic top view or cross-sectional top view of a display case is shown300B. The display case includes ahousing323 and adoor324,326 that is hinged328 to the housing. As shown, the door may be pivoted from aclosed position324 to an open or partiallyopen position326. In some embodiments, thehousing323 includes an outer housing such as anouter shell320, and inner housing such as aninner shell322 and aspace321 therebetween. Where the inner housing defines a refrigerated/freezer space, the space between the housings may be used for, inter alia, a thermal insulation space.
In various embodiments, thedoor324 includes a transparentLCD panel assembly327 which provides a viewing port into adisplay space325 enclosed at least in part by theinner housing322. Where the display space is refrigerated, the LCD panel assembly may be similar to that ofFIG. 2B. Where the display space is not refrigerated, the LCD panel assembly may be similar to that ofFIG. 2A. As can be appreciated from the above, operation of the transparent LCD panel may mask display case contents to a variable extent such that contents are totally recognizable through the LCD panel, only partially recognizable through the LCD panel, or not recognizable through the LCD panel.
In some embodiments, the display case has a transparent wall such as atransparent back wall337 that provides for viewing therethrough. Here, apocket330 between thewall337 andinner housing322 may be used to receive via a display case top or side slot a insertable graphic338 for display via the transparent back wall. In an embodiment, prior to insertion of the graphic the transparent back wall and the transparent LCD panel face each other such that a view or an unobstructed view is provided through the display case.Graphic display lighting336 may be provided by any suitable means, for example by one or by an array of LED's located between the graphic and the inner housing.
InFIG. 3C, a schematic top view or cross-sectional top view of another display case is shown300C. The display case includes ahousing343, atransparent LCD panel344 inserted in a front face orwall347 of the case, and adoor346 inserted in a back face orwall348 of the case. The door is hinged349 or otherwise mounted to the case to allow access to thedisplay interior345.
In some embodiments, thehousing343 includes an outer housing such as anouter shell340, and inner housing such as aninner shell342 and aspace341 therebetween. Where the inner housing defines a refrigerated/freezer space, the space between the housings may be used for, inter alia, a thermal insulation sp ace.
The transparentLCD panel assembly344 provides a viewing port into thedisplay space345 enclosed at least in part by theinner housing342. Where the display space is refrigerated, the LCD panel assembly may be similar to that ofFIG. 2B. Where the display space is not refrigerated, the LCD panel assembly may be similar to that ofFIG. 2A. As can be appreciated from the above, operation of the transparent LCD panel may mask display case contents to a variable extent such that contents are totally recognizable through the LCD panel, only partially recognizable through the LCD panel, or not recognizable through the LCD panel.
InFIG. 3D, a transparent LCD panel and a frame of the LCD panel are shown300D. The transparentLCD panel frame365 holds theLCD panel354 that provides a view into an interior of a display case (not shown). LED lights for illuminating the LCD panel are mounted on the frame and/or on the LCD panel near the edges of the LCD panel. In some embodiments the frame is a door frame. In some embodiments the LCD panel andframe369 is a part of or substantially all of a display case front. The LED lights may be arranged as arrays, for example as linear arrays, along LCD panel edges. In an embodiment, LED lights are to eitherside361,363 of the LCD panel. LED lights may also be located above362 and/or below364 the LCD panel.
The LED lighting361-364 may be selectively operated individually or as a group. For example, the LED lighting may be turned off when the transparent LCD screen is not in use. For example, the LED lighting may be turned off when a door in which a lighted LCD screen is located is opened.
InFIG. 3E, a transparent LCD panel and an LCD panel surround are shown300E. Thetransparent LCD panel378 is for providing a view into an interior of a display case (not shown). LED lights such as arrays of LED lights are for illuminating the LCD panel. The LED lights may be arranged as arrays, for example as linear arrays, along LCD panel edges. In an embodiment, LED lights are to eitherside371,373 of the LCD panel. These LED lights may be mounted to either of adisplay housing375 or theLCD panel surround376. LED lights may also be located above372 and/or below374 the LCD panel. These LED lights may be mounted to either of the display housing or to the LCD panel surround. In some embodiments, multiple rows of led lighting are provided, for example multiple rows of LED lighting located above372 the LCD panel as in aceiling379 of the display space. Illumination provided by the LED lighting within the display case may be in the range of 1000 to 10000 lumens.
The LED lighting371-374 may be selectively operated individually or as a group. For example, the LED lighting may be turned off when the transparent LCD screen is not in use. For example, the LED lighting may be turned off when a door in which a lighted LCD screen is located is opened.
InFIG. 3F, another display case is shown300F. As seen, a hinged395door assembly390 with a door handle and/or latch397 provides access to adisplay space3101 within anouter housing380. The latch may be electrically operated, as by a solenoid or motor, for either of local or remote latching and de-latching. A door state or position sensor such as a magnetic or reed switch may be located with the door latch or with another part of the door and/or housing assembly.
Thedoor assembly390 includes atransparent LCD panel388 within aframe396 such that thedisplay space3101 is visible through the LCD panel. Lighting for the LCD panel is provided by lighting mounted to thedoor assembly390 and/or a housing such as theouter housing380 and/or aninner housing359. Door assembly mounted lighting may be provided along opposingvertical edges391,393 of the LCD panel and along opposinghorizontal edges392,394 of the LCD panel. Housing mounted lighting may be provided in addition to and or in lieu of door assembly mounted lighting. For example, housing mounted lighting above theLCD panel3103 may be provided in lieu of upper door assembly mountedlighting392. For example, housing mountedlighting3105 below theLCD panel388 may be provided in lieu of lower door assembly mountedlighting394.
Various sensors may be used in connection with operating and monitoring of thedisplay case300F. In particular, sensors may be mounted to or within either of theouter housing380 and theinner housing395. An audio transducer such as a speaker or an ultrasonic device may be mounted above381 or below399 thedoor assembly390. A proximity sensor may be mounted above382 or below385 thedoor assembly390. A video camera and/or infrared camera or sensor may be mounted above383 or below386 the door assembly. A video projector may be mounted above384 or below387 the door assembly. Notably, any of the proximity sensor, video camera, infrared camera, and infrared sensor may be adapted for use as a proximity sensor.
The schematics ofFIGS. 4A-D show display case electrical devices anddevice interconnections400A-D.
InFIG. 4A, adisplay case402 includes asystem box404 with electrical interconnections to display case devices. In some embodiments, there are electrical interconnections between the system box and devices such as remote communications devices that are external to the display case (as shown).
Thesystem box404 includes an electronics power supply and distribution unit (EPSD)410 and may include any of alocal controller412, a local communications unit (LCU)416, and a local man-machine interface414. In some embodiments the local controller is or includes a media player.
TheEPSD410 receives power from amains connection424 and provides power to theLED lighting108. In various embodiments, the EPSD receives control signals from the local controller while both the EPSD and thelocal controller412 receive signals from one ormore sensors112 such as the proximity sensors mentioned above.
Embodiments include atransparent LCD panel104.Local controller412memory411 such as semiconductor or magnetic memory may provide stored video content viewable on thetransparent LCD panel104. The LCD panel may be a touch sensitive device such that communications between the LCD panel and the local controller are bi-directional.
Communications with thelocal controller412 may be via the local man-machine interface414 including any of a monitor, keyboard, keypad, mouse, and the like. For example, thelocal controller412 may be a microprocessor based computing device such as a personal computer or computer server running, for example, a Windows®, Android®, Java® or Unix® based operating system, the mentioned peripherals being coupled to the computing device.
Communications with thelocal controller412 may be via the local communications unit (LCU)416. In various embodiments the LCU provides two way communications with a remote communications unit (RCU)420. The LCU/RCU pair may utilize any communications media and protocol suited to the application including wired media, wireless media, any 802.x IEEE wireless communications standard, and custom protocols. In an embodiment, the LCU includes a wireless 802.x WiFi device and the RCU provides a gateway such as an Internet connected gateway with 802.x WiFi connections for communicating with the LCU.
Remote control of thedisplay case402 may be via aremote controller422 that is in communication with theRCU420. The remote controller may be a hardwired or wireless device and data exchanged between the remote controller and the RCU may be transported over the Internet or not.
As mentioned in connection withFIG. 1 above, a display case may include aventilation system118 and/or a refrigeration/freezer system120. Ventilation system devices such as fans may be powered by the mains connection424 (as shown) or by the EPSD as when variable speed fans utilizing temperature feedback control are used. Refrigeration/freezer devices such as fans and compressors may be powered by mains connection424 (as shown) or by the EPSD as when variable speed fans or compressor utilizing temperature feedback control are used.
InFIG. 4B, sensors that may be used in connection with display case operations are shown400B. As seen, special purpose proximity sensors includeproximity430,magnetic switch432, andcontact sensors434. Visual sensors includevideo438,HD video440,web442 cameras, andinfrared cameras443. Audio sensors includemicrophones440. Other sensors may be included such as atemperature sensor436 for monitoring temperature(s) within the display case.
Non-contact sensors designed specifically for detecting proximity ormotion430 may be used. For example, an infrared, microwave, or ultrasonic camera or sensor may be used to indicate whether a person has come within a range or sector such as within a predetermined range or sector of the display case. These devices may also be used to indicate a person's direction of travel such that a person approaching the display case can be distinguished from a person that is not approaching the display case.
Contact sensors designed specifically for detecting proximity ormotion434 may be used. For example, a pressure sensor, e.g., a pressure plate sensor such as a pressure actuated switch may be used to indicate whether a person is in a particular location relative to the display case. For example, a pressure sensor, e.g., a pressure actuated switch, may be used to indicate whether an item such as a displayed item available for removal and/or purchase remains in its original position.
Sensors that determine motion and/or position are not limited to the specialty sensors mentioned above. For example, audio from amicrophone sensor444 may be used to indicate a person's presence near a display case. For example, analysis and/or comparison of one or more video camera frames can be used to detect motion, position, direction of motion. Position may be detected when a person's position in a frame is analyzed. Motion and/or direction of motion may be detected when a person's change in position in multiple frames is analyzed. Suitable cameras include any of thevideo camera438,HD video camera440, andweb camera442.
Magnetic sensors such asmagnetic switches432 may be used to detect a position of one part relative to another such as the position of a display case door (e.g.,390) relative to a housing (e.g.,380). Temperature sensors such as a thermocouple, solid state temperature sensor, resistance temperature device (RTD), or thermistor may be used to monitor temperature such as a ventilation air temperature, a system box internal temperature, a display space temperature, or a refrigerated/freezer space temperature.
Turning again to use of cameras such asvideo camera338 andHD video camera440, images of a person near the display case may be used to assess personal characteristics to the extent allowed by law in the jurisdiction where the display case is operated. Images may be used to assess one or more of location, age, gender, race, ethnicity, demographic, behavior, emotion, mood, head turning and similar observation based characteristics of the person. In addition facial imaging may be used to determine either if the person matches a data file available for matching or if the person matches an available data file that enables identification of the person by name or other unique/quasi-unique indicia.
In some embodiments, a camera such as thevideo camera438 orHD video camera440 may be used to identify items the person holds or wears for the purpose of suggesting a complementary item available from the display case or another known location. For example, when aproximity sensor430 identifies a nearby patron, a video camera image of the person may identify a bottle of wine held by the person and thelocal controller412 may match the wine with a complementary cheese available from the display case that is subsequently displayed on the LCD panel. Such feedback based suggestions or suggestions for purchase may also be made for complementary apparel and/or accessories.
InFIG. 4C, input/output devices that may be used in connection with display case operations are shown. Imaging and/or video input devices include a video camera such as aHD video camera454, aweb camera455, aninfrared camera463, ascanner460, and agesture video camera458 such as a video camera interoperating with gesture software, e.g. Intel RealSense™ software. Video output devices include a transparent LCD panel for display of video451 (see e.g. LCD panel104) and avideo projector457 such as an LED video projector.
Audio input devices include amicrophone456.Audio output devices461 include one or more of speaker(s), speaker array(s), horn(s), horn array(s), ultrasonic devices e.g., Audio Spotlight® by Holosonics, and other suitable devices known to skilled artisans. As will be recognized, speaker array(s), horn array(s), and ultrasonic devices may be used to provide directional or highly directional sound, for example sound directed to a particular person in a particular location.
Tactile input devices include a keyboard orkeypad453 and a touch sensitive transparent LCD panel for presenting and sensing touch sensitive selections (see e.g. LCD panel104). Scanner input devices include QR, barcode, magnetic strip, and EMV credit card scanners.
In addition, various control input devices may be included in certain display cases. For example, a control interface presented via transparentLCD panel video451 with selections via transparentLCD panel touch452 may be used to manipulate an object within a display case. Control output devices such asenvironment control devices459 may include any of a turntable for rotating an object within the display case, articulated/robotic manipulators for moving an object within the display case, and product dispensers, for example where dispensable products are on display. In some embodiments, points of sale devices (POS)462 common in retail and vending industries are included.
FIG. 4D shows various display case communications means400D. In some embodiments, selected communications means are applicable to one or both of theLCU416 andRCU420.Wireless480 communications include WiFi, cell service data, and LTE hotspot communications.Wired482 communication media includes wiring such as copper wiring and free space or fiber guided optical communication such as fiber optic communications.
Other communications means may link thelocal controller412 and/or theLCU416 to patron held devices such as cell phones, beacons, radio ID tags, and the like. For example, a nearfield transceiver communications link484 may be provided using an NFC signal and/or cell phone push notifications. For example a Beacon (i.e., cell phone app based or specialized active radio beacon adapted to tracking people) transceiver communications link486 may be provided for customer tracking.
FIGS. 5A-G show selecteddisplay case operations500A-G.
FIG. 5A illustrates a first multimedia immersion facility via afirst flowchart500A. Implemented at least in part in a controller such as thelocal controller412, the flowchart describes a patron interaction process that runs when triggered by the patron's presence near the display case.
In a first awaittrigger step510, the process awaits the presence of a patron as indicated by a sensor. When the sensor indicates the presence of a patron, anassessment step520 follows.
Assessment of a patron instep520 includes one or more of assessing a patron's gender, age, ethnicity, reaction, mood, head movement, facial features, clothing, accessories, and possessions. When the patron assessment step is completed, aconstruct scene step530 follows.
Construction of a scene instep530 includes one or more of selecting a video scene for display on theLCD panel104, selecting a video scene forprojection457 on a surface other than a display case surface, selecting an audio recording for playback via the amplifier andspeakers461, and selecting a movement of an object within the display case via amanipulator459. When the scene construction step is completed, a deliverscene step540 follows.
Delivery of a scene instep540 includes an orchestrated delivery of the LCD panel display, the projected display, the audio recording, and the object manipulation. When the scene delivery step is completed, the process may return541 to the awaittrigger step510.
FIG. 5B illustrates a second patron multimedia immersion facility using asecond flowchart500B. Implemented at least in part in a controller such as thelocal controller412, the flowchart describes a patron interaction with process that runs when triggered by the presence of a patron near the display case.
In a first awaittrigger step510, the process awaits the presence of a patron as indicated by a sensor. When the sensor indicates the presence of a patron, anassessment step520 follows.
Assessment of a patron instep520 includes one or more of assessing a patron's gender, age, ethnicity, reaction, mood, head movement, facial features, clothing, accessories, and possessions. When the assessment step is completed, a firstscene query step522 follows.
In the firstscene query step522, a determination is made as to whether a first scene has yet to be constructed530 and delivered540. IfYes523, theconstruct scene step530 follows.
Construction of a scene instep530 includes one or more of selecting a video scene for display on thetransparent LCD panel104, selecting a video scene forprojection457 on a surface other than a display case surface, selecting an audio recording for playback via the amplifier andspeakers461, and selecting a movement of an object within the display case via amanipulator459. When the scene construction step is completed, a deliverscene step540 follows.
Delivery of a scene instep540 includes an orchestrated delivery of two or more of the LCD panel display, the projected display, the audio recording, and the object manipulation. When the scene delivery step is completed, afeedback query step542 follows.
Thefeedback query step542 awaits, for example for a predetermined time, patron action(s) such as responses to the delivered scene and/or questions. To the extent there is such a patron action, the process returns544 to theassessment step520 wherein the patron action is assessed to determine an appropriate response and/or appropriate content responsive to the patron action. To the extent no patron action is recognized as eliciting a response, the process returns543 to the awaittrigger step510.
Whereassessment520 followsfeedback542, the next step is the first scene query. The answer to the first scene query is No524 where, as here, a first scene was earlier constructed530 and delivered540. When the first scene query is answered, a newscene query step526 follows.
In the newscene query step526, a determination is made as to whether or not a new scene should be used in a response to the patron action. If answered No527, the response tofeedback step529 follows and a response, other than constructing and delivering a new scene, may be made. If answeredYes528, the next step is theconstruct scene step530. Notably, where a response tofeedback529 is made, the process may return531 to thefeedback query542.
Construction of a scene instep530 is executed here for a second or subsequent time. Here, the scene constructed is at least in part responsive to the patron action. Scene construction includes one or more of selecting a video scene for display on theLCD panel104, selecting a video scene forprojection457 on a surface other than a display case surface, selecting an audio recording for playback via the amplifier andspeakers461, and selecting a movement of an object within the display case via amanipulator459. When the scene construction step is completed, a deliverscene step540 follows.
Delivery of a scene instep540 includes an orchestrated delivery of two or more of the LCD panel display, the projected display, the audio recording, and the object manipulation. When the scene delivery step is completed, afeedback query step542 follows.
The number of times that patron feedback is responded to may be limited. For example, responses may be limited as x responses per time span, y responses per patron, or z responses per product as in z responses per product per hour for example.
FIG. 5C shows a device application table500C. The table includes sensor devices, processor devices, and multimedia devices. Sensors include a proximity sensor (e.g.,430), a door switch (e.g.,432), a pressure plate switch (e.g.,434), a web camera (e.g.,442), a video camera (e.g.,440), aninfrared camera443 and a microphone (e.g.,444). Sensors may be used for activities including trigger (e.g.510), assessment (e.g.,520), construct scene (e.g.,530), deliver scene (e.g.,540), and respond to feedback (e.g.,529,544). Processing devices include alocal controller412 and/or aremote controller422. Multimedia devices include a transparent LCD panel (e.g.,451), a video projector (e.g.,457), an audio output device (e.g.,461) and an environment control device(s) (e.g.,459).
Trigger devices may include any one or more of a specialized proximity sensor, door switch, pressure plate, web camera, video camera, and microphone. As explained above, any of these devices might be used alone or in combination to detect, with or without use of a local or remote controller, the presence of a patron near a display case and/or in a particular location.
Assessment devices may include any one or more the web camera, video camera, and microphone. As explained above, any of these devices might be used alone or in combination to detect, for example with use of a local or remote controller, information about a patron that is observable (e.g. color of hair) or that might be gleaned from observations (e.g., estimated age).
Scene construction devices may include any one or more of the web camera, video camera, microphone, local controller and remote controller. As explained above, any of these devices might be used alone or in combination to create a scene that is personalized to a patron or not.
Scene delivery devices may include any two or more of the transparent LCD panel, video projector, audio output devices, and environment controls such as merchandise manipulators. As explained above, any of these devices might be used alone or in combination to interact with a patron. And, as explained above, combinations of these device may be used to immerse a patron in a specially created and/or personalized multimedia scene.
FIG. 5D shows an active interactions table500D. Devices listed in the table may be used by a patron to interact with the display case or with display case scenes. Devices include a touch sensitive transparent LCD panel (e.g.,452), a keyboard or keypad (e.g.,453), an audio input device such as a microphone (e.g.,456), imaging devices such as a HD video camera (e.g.454) and/or an infrared camera (e.g.,463), environmental controls (e.g.,459), point of sale devices (e.g.,464) and a local man machine interface (e.g.414).
LCD panel touch interactions include selection and messaging. Selection includes any of selection from among objects, characters, symbols, graphics, pictures and the like displayed by theLCD panel video451. For example, controls for manipulating and/or dispensing display case contents may be implemented using the LCD panel touch capabilities. Messaging includes any of messaging via use of a virtual keyboard, virtual keypad, or messaging via any of the mentioned selections.
Keyboard/keypad interactions include selection and messaging with a physical keyboard or keypad. Selection includes any of selection from among objects, characters, symbols, graphics, pictures and the like displayed on the keyboard/keypad. Messaging includes any of messaging via use of the keyboard/keypad.
Microphone interactions are voice interactions. These interactions may or may not involve voice recognition. For example, merely making a sound may provide the interaction. Or, voiced messages, instructions, commands, and/or requests may be converted into words for use by thelocal controller411.
Video camera interactions include the use of gestures. For example, thelocal controller411 may compare a patron's gestures observed by avideo camera454 with a library of gestures stored in a local controller memory to determine what message, instruction, command, and/or request the gesture(s) represents.
Environment control interactions include manipulation of a product within the display case. These controls may be exercised by any of the LCD panel touch, keyboard/keypad, microphone, video camera, and local man machine interface. As discussed above, environment controls may be associated with, among other things, a turntable to turn an item within the display case, an articulated manipulator to move a product within the display case, and a actuator to dispense product from a product container within the display case.
Point of sale interactions include payment transactions available using known point of sale devices for making a payment. For example, credit card payments whether via magnetic reader or chip reader for EMV capable cards. For example, digital wallet payments such as Apple Pay payments via cell phone app. For example Pay Pal payments via LCD panel touch andlocal controller411.
Local man machine interface (MMI) interactions include any one or more of the interactions mentioned above.
FIG. 5E shows a passive interactions table500E. Devices listed in the table may be used without human intervention. Devices include a video camera such as an HD video camera (e.g.,454) and/or an infrared camera (e.g.,463), a proximity or motion sensor (e.g.,430), a contact or pressure plate sensor (e.g.,434), and a door sensor such as a magnetic switch (e.g.,432).
Video camera passive interactions include facial recognition, demeanor recognition, proximity sensing, and position sensing. Facial recognition and demeanor recognition may be carried out in any of thelocal controller411,remote controller422 or web accessible server computer.
Proximity or motion sensor passive interactions include proximity sensing, position sensing, and direction of travel sensing. To the extent sensing requires multiple sensor readings, thelocal controller411 may carry out required tabulations and/or comparisons.
Door switch passive interactions including indicating one or more door positions. For example, a door switch located on a door jamb may be used to signal shutting down the LCD lights within a display case when the door is opened.
The schematic ofFIG. 5F shows a display case such as a display case operating in apatron attraction mode500F.Display case590 operation in the patron attraction mode may occur when display case sensors indicate no patron is nearby. As shown, display case components include ahousing562, acase front564, amovable door566 mounted in the case front, and atransparent LCD panel568 mounted in the movable door.
For sensing proximity or motion of a patron, either of avideo camera572 or aproximity sensor574 may be used. For presenting a scene, any of thetransparent LCD panel568, avideo projector570, andaudio transducers576 such as directional sound transducers may be used.
While operating in the attraction mode, thedisplay case590 may deliver a scene constructed from stock video and audio stored in alocal controller412memory411. Or, the scene may include image(s) of a patron known to be not nearby (e.g., within 3 meters), but in the area (e.g., within 50 meters).
The schematic ofFIG. 5G shows a display case operating in aninteraction mode500G. Thedisplay case590 is in the interaction mode because display case sensors indicate apatron588 is nearby. As seen, the patron is located in aninteraction zone586 such that a display case scene can be delivered to immerse the patron in a multimedia experience. The multiple media includevideo content567 displayed on thetransparent LCD panel568 and product(s)569 within the display case viewable through the transparent LCD panel. The multiple media may includevideo content580 displayed on a surface adjacent to thepatron588 via avideo projector570, for example video content displayed on thefloor581 between the patron and the display case. The multiple media may includeaudio content584 emitted from anaudio transducer576 that directs sound to preferentially ensonify a zone or field immediately around the patron.
Scene video content may include one or more of stock video, live video such as live video available via the Intenet, and live or recorded video of thepatron588 as observed by thevideo camera572. For example, a scene may mix product video with lifestyle video selected based on patron assessment. For example, a scene may place a patron in a virtualized context such as wearing a displayed product.
In an embodiment, video of the patron captured by a premises video camera such as thecase video camera572 is used to construct content for a scene showing the patron using/enjoying aproduct569 displayed within thecase590. In various embodiments, patron assessment is used to select video content that is appropriate for any of the age, sex, ethnic group, or known shopping pattern of the patron. And, in various embodiments, patron assessment is used to suggest products that are appropriate for any of the age, sex, ethnic group, or known shopping pattern of the patron.
Scene video may be coordinated such that from the patron'sview582, the transparent LCDpanel video image567 and theprojector video image581 merge to create an actual multidimensional video display that immerses the patron. For example, transparentLCD panel video576 displayed in the y-z plane may be coordinated withprojector video580 displayed in a x-z plane.
FIG. 6A shows a display case adapted for use as adonation kiosk600A. The kiosk provides for receiving donations and for viewing received donations through a transparent LCD panel. In various embodiments of thekiosk600A, any suitable display case features mentioned above may be employed in connection with making and/or using the donation kiosk. Selected embodiments are described below.
As shown, akiosk housing602 is arranged around adonation display space620 that receives donations via a housing opening such as a housing opening such as ahousing top opening603. Atransparent LCD panel606 and thedonation display space620 are arranged to provide a view through the panel into the donation display space. Not shown is an optional door in a sidewall of the housing for accessing the interior of thehousing602.
Backlighting for thetransparent LCD panel606 is provided by lights within thehousing602. These lights may include one or more of verticalLED lighting arrays608,609 along each of the vertical panel edges and horizontalLED lighting arrays610,611 along each of the horizontal panel edges.
FIG. 6B shows an electrical device schematic600B. The kiosk may house one or more of the electrical devices shown. A power distribution unit (“PDU”)650 is for selectively distributing electric power to one or more of the LED lighting arrays608-611 and amedia player654 for supplying video content to thetransparent LCD panel606. Some embodiments include alocal controller658 for carrying out any of the functions mentioned in connection withlocal controllers412 above.
Where alocal controller658 is provided, communications such as wireless orInternet communications660 may be implemented. Where triggering of scenes and/or patron interactions are provided, any of a proximity sensor662,video camera664, or donation sensor such as a housing opening photocell666 may be used to sense a triggering event such as a patron's presence and/or a donation being made.
Thekiosk601 may utilize a transparent LCD panel that is touch sensitive for one or more of charity selection, payment, and collection of donor information used to report donor activity via a social media website. Yet other means of making financial donations include any of the payment means mentioned in connection with the display cases above.
A patron's donation may be recognized in various ways. For example, a scene such as an audiovisual scene may be triggered by a donation. For example, patron information and/or images may be acquired via the LCDpanel touch screen606 and/or avideo camera664 and the information may be used to construct content to be posted to a charity, social media, or another web site of the patron's choosing.
The present invention has been disclosed in the form of exemplary embodiments. However, it should not be limited to these embodiments. Rather, the present invention should be limited only by the claims which follow where the terms of the claims are given the meaning a person of ordinary skill in the art would find them to have.