US20160110751A1 - Method, computer program product, and system for providing a sensor-based environment - Google Patents

Abstract

Method, computer program product, and system of providing rewards to a person based on item interactions during a transaction in an environment, where the person is associated with a personal profile. The method includes generating, based on information in the personal profile, one or more tasks for the person to complete during the transaction, each task including at least one item interaction. The method further includes presenting, using an output device within the environment, the one or more tasks to the person, analyzing image information acquired by one or more visual sensors within the environment to evaluate the person's performance of the one or more tasks, and awarding, based on the evaluation, an amount of rewards to the person.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
• This application claims benefit of United States provisional patent application Ser. No. 62/064,323, filed Oct. 15, 2014, entitled “Integrated Shopping Environment,” which is herein incorporated by reference.
BACKGROUND
• The present disclosure relates to a sensor-based environment, and more specifically, to techniques for identification of items selected by a person in the environment using visual identification and using personal profile information associated with the person.
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
• FIG. 1 illustrates an exemplary environment including a plurality of items, according to one embodiment.
• FIG. 2 illustrates an exemplary system of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment.
• FIG. 3 is a block diagram illustrating operation of a system of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment.
• FIG. 4 illustrates amethod400 of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment.
• FIG. 5 illustrates amethod500 of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment.
• FIG. 6 illustrates amethod600 of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment.
• FIG. 7 illustrates amethod700 of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment.
• FIG. 8 illustrates amethod800 of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment.
• To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures. It is contemplated that elements disclosed in one embodiment may be beneficially utilized on other embodiments without specific recitation. The illustrations referred to here should not be understood as being drawn to scale unless specifically noted. Also, the drawings are often simplified and details or components omitted for clarity of presentation and explanation. The drawings and discussion serve to explain principles discussed below, where like designations denote like elements.
DETAILED DESCRIPTION
• Aspects of the current disclosure relate to an integrated environment capable of providing a personalized, automated, and adaptive experience for a person within the environment. A number of different sensor devices may be employed within the environment, and networked with various computing devices such as point-of-sale (POS) terminals, digital signage, servers, and mobile or handheld computing devices to provide a seamless integration of mobile technologies and e-commerce into traditional experiences.
• Using a system having one or more visual sensors within the environment, a retailer or other provider may compile and process environmental data related to a person's transaction within the environment. The environmental data may be used to identify interactions of the person with various items in the environment, which may include selecting items for presentation during a subsequent checkout transaction. The identification of the interactions and items may be based on an analysis of static imagery—such as an image of contents of the person's shopping cart at a particular time—and/or dynamic imagery (e.g., using a continuous video feed). The identification may occur at different times and places during the transaction within the environment, such as while the person browses items, while scanning items during a checkout transaction, and so forth.
• A rewards program may be administered within an environment, incentivizing certain tasks performed by persons such as customers. Rewards programs may be implemented in various forms, such as games or other tasks for the person to perform during the transaction, which are incentivized as appropriate. Generally, the benefits provided through rewards programs may keep customers more engaged during their transactions, and therefore more likely to return for subsequent transactions. Performing the rewards tasks may benefit the individual customers—offering monetary discounts or other incentives—but may also benefit the environment administrators (e.g., retailers) and/or item manufacturers due to the increased visibility of items and possibility of increased sales. In some cases, the rewards tasks may further benefit the environment administrators through customers' willing participation in otherwise menial tasks, which may allow for a better distribution of employees to provide service to customers. All in all, rewards programs may provide a better experience for customers, individually as well as in the aggregate.
• However, not all tasks are equally appealing or interesting to all customers. In various embodiments, personal profile information that is compiled for an individual person may be used to adapt the tasks to the personal interests of the person. The personal profile information may include an item history, preferences, as well as other information. By using the personal profile information to make the tasks more relevant and interesting to the person, the chances of willing participation by the person in the rewards program are increased.
• While generally discussed within the context of a shopping environment, such as a retail store or commercial environment, it is contemplated that the techniques disclosed herein may be applied to other environments (some non-limiting examples include libraries, museums, classrooms, hospitals, etc.) to provide a similar experience for persons included therein.
• FIG. 1 illustrates an exemplary environment including a plurality of items, according to one embodiment. Theenvironment100 includes a plurality ofsensor modules105 disposed in theceiling110 of the environment. Thesensor modules105 may each include one or more types of sensors, such as video sensors (e.g., cameras), audio sensors (e.g., microphones), and so forth.Sensor modules105 may also include actuating devices for providing a desired position and/or orientation of the included sensor(s). Generally, the sensor modules or individual sensors may be disposed at any suitable location within theenvironment100. Some non-limiting examples of alternative locations include below, within, or above afloor115 of the environment, within other structural components of theenvironment100 such as ashelving unit120 or walls, and so forth. In some embodiments, sensors may be disposed on, within, or near item display areas such as theshelving unit120. The sensors may be oriented toward expected locations of personal interactions with items in order to acquire better data about the person's interactions, such as determining the person's field of view relative to certain items, updating a virtual cart or transaction record for the person's transaction in the environment, and so forth.
• Environment100 also includes a number of computer-based terminals (or kiosks)125. Generally,terminals125 may be configured for performing customer checkout and/or other functions, such as providing information to a customer or employee. Eachterminal125 may each include a discrete computing device or portions of a computing system, and may include various I/O devices, such as visual displays, audio speakers, cameras, microphones, etc. for interacting with various persons such as customers and/or employees. In some embodiments, aperson130 in the environment may have a mobile computing device, such as asmartphone135, that communicatively couples with theterminal125 for completing a checkout transaction. For example, the person'ssmartphone135 may include payment information, identification information, etc. that facilitate completion of the checkout transaction. In one embodiment, the mobile computing device may execute a store application that connects with the computing system of the environment (e.g., to store servers or other computing devices through the Internet). In one embodiment, the mobile computing device may be directly connected withkiosk125 through wireless networks established within the environment (e.g., over Wi-Fi or Bluetooth). In one embodiment, the mobile computing device may couple with thekiosk125 when brought within range, e.g., using Bluetooth or near-field communication (NFC).
• Environment100 also includes one ormore shelving units120 havingshelves140 that supportvarious store items145. Though not shown,multiple shelving units120 may be disposed in a particular arrangement in theenvironment100, with the space between adjacent shelving units forming aisles through which customers and employees may travel. For example, customers may navigate the aisles and/or approach theshelving units120 to viewitems145 included therein, to handle the items, to select the items, etc. In another example, employees may navigate the aisles and/or approach theshelving units120 to view stock levels of theitems145, to determine out-of-place items, etc. In some embodiments,shelving units120 may include visual sensors or other sensor devices or I/O devices. The sensors or devices may couple with the person'ssmartphone135 and/or other networked computing devices (includingterminals125 and/or servers) that are associated with theenvironment100. For example, thefront portions150 ofshelves140 may include video sensors oriented outward from the shelving unit120 (i.e., toward the aisle) to acquire image information for a person's interactions withitems145 on theshelving unit120, with the image information provided to back-end servers for storage and/or analysis. In some cases, some or all of the image information may also be accessible by a person's mobile computing device. In some embodiments, portions of the shelving unit120 (such as thefront portions150 of shelves140) may include indicator lights or other visual display devices or audio output devices that are able to communicate with a person.
• During an exemplary transaction in the environment, theperson130 may have a shopping receptacle in which the person places items after they are selected for purchase. Examples of shopping receptacles include shopping carts, baskets, or other containers that may be carried or otherwise transported by the person during the transaction. Upon completion of the transaction—for example, the person has selected all of the desired items—the person may approach one of theterminals125 or a designated checkout area to perform a checkout transaction.
• In some cases, the checkout transaction may have “touchless” aspects or may be entirely touchless. For example, visual sensors included in the environment and/or within the approached terminal125 may acquire image information that is usable to identify the person, items included within the shopping receptacle, etc. and that streamlines or otherwise facilitates the checkout transaction. As will be discussed further herein, logic may be applied to enhance the analysis of the image information using personal profile information associated with the person conducting the transaction. Application of the personal profile information may result in item identification processes having greater accuracy and/or confidence levels, as well as being performed more quickly. The improved accuracy and speed may help the person to spend a shorter time completing their checkout transaction, which can improve their overall transaction experience. Reducing time for checkout transactions also increases the collective throughput at the checkout area. In some cases, a person may be able to complete a checkout transaction simply as part of departing the environment, without requiring the person to stop at a checkout terminal or in the checkout area. In some cases, the person's time in the checkout area may be significantly reduced, such as only a momentary pause at a checkout terminal.
• FIG. 2 illustrates an exemplary system of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment. Thesystem200 includes a number of components that are disposed within theenvironment100. The system may also include components that are outside the environment—for example, aserver265 may be located remotely or proximately disposed to the environment (such as within a back room in the same building that is not accessible by customers).
• Components within the environment include one ormore sensors205 of various types, such asvisual sensors210,audio sensors215, andweight sensors220. Thesensors205 may also includeother sensors225 capable of providing meaningful information about personal interactions within the environment, e.g., location sensors. Thesensors205 may be discrete sensor devices deployed throughout theenvironment100 in fixed and/or movable locations.Sensors205 may be statically included in walls, floors, ceilings, displays, or other non-sensor devices, or may be included in shopping receptacles capable of being transported through the environment. For example,weight sensors220 may be disposed in fixed locations within the environment, such as within the floor or within a surface of a checkout terminal, and may also include load cells or other sensors disposed in a basket portion of a shopping receptacle. In one embodiment,sensors205 may include adjustable-position sensor devices, such as motorized cameras (i.e., an example of visual sensors210) attached to a rail, wire, or frame. In one embodiment,sensors205 may be included on one or more unmanned vehicles configured to travel through some or all of theenvironment100, such as unmanned ground vehicles (UGVs) or unmanned aerial vehicles (UAVs or “drones”).Sensors205 may also include sensor devices that are included in computing devices associated with theenvironment100, such aspersonal devices230,employee devices235, andterminals240. In some cases, the computing devices (or the component sensor devices) may be implemented as body-worn or carried devices.
• Personal devices230 andemployee devices235 may each include passive or actively-powered devices capable of communicating with at least one of the networked devices ofsystem200. One example of a passive device (which may be worn or carried) is a NFC tag. Active devices may include mobile computing devices, such as smartphones or tablets, or wearable devices such as a Google Glass™ interactive eyepiece (Glass is a trademark of Google Inc.). Thepersonal devices230 generally denotes ownership or possession of the devices by customers within theenvironment100, while theemployee devices235 denotes ownership or possession by the retailer or other administrator of theenvironment100. In some cases,employee devices235 may be carried by employees and used in the course of their employment.Personal devices230 andemployee devices235 may execute applications or other program code that generally enables various functions and features accessible usingserver265 and/or other networked computing devices. In some embodiments, sensor devices that are included with thepersonal devices230 oremployee devices235 may be included in thesensors205.
• System200 includes a plurality ofterminals240 within theenvironment100.Terminals240 generally include any structure that is capable of receiving input from and/or producing output to people (e.g., customers, employees) within theenvironment100. Theterminals240 may include computing systems, portions of computing systems, or devices controllable by computing systems. In one example, a terminal240 may include a computing device that is communicatively coupled with a visual display and audio speaker(s), as well as being communicatively coupled with one or more input devices. In another example, a terminal240 may include a visual display and associated driver hardware, but a computing device coupled to the terminal and providing data for display is disposed separately from the terminal. In some embodiments,terminals240 may be implemented as standalone devices, such as a kiosk disposed on the store floor or monolithic device disposed on a shelf or platform. In some embodiments,terminals240 may be integrated partially or wholly with other components of theenvironment100, such as input or output devices included with shelving or other structural components in the environment (e.g., components used for product display or storage). In some embodiments,terminals240 may be modular and may be easily attachable and detachable to elements of theenvironment100, such as the structural components.
• Generally,terminals240 may be distributed throughout theenvironment100 and may enhance various phases of the person's transactions within the environment. For example,terminals240 may include digital signage (i.e., included as an example of other terminals255) disposed throughout the environment, such as included in or near aisles, endcaps, displays, and/or shelving in the environment. A person during a transaction may view and/or interact with the digital signage as he or she moves throughout the environment. The digital signage may be included in a static display or may be movable, such as including digital signage within a shopping receptacle.Terminals240 may also include one or more types of terminals usable for completing checkout transactions, such as employee-mannedPOS terminals245 and self-checkout terminals250. In some cases, theterminals240 that provide checkout functionality may be disposed within a designated checkout area within theenvironment100.
• In some embodiments,terminals240 may provide an integrated functionality. For example,terminals240 may function in a first mode as digital signage, and when engaged by a person (i.e., receiving input from the person), the terminals function in a second mode as a self-checkout terminal or other type of terminal.
• Server265 generally includes processor(s), memory, and communications capabilities and may perform various computing tasks to support the operation of theenvironment100.Server265 may communicate using various wired and/or wireless communications methods withterminals240,sensors205, and with other networked devices such aspersonal devices230 andemployee devices235.Server265 generally executes computer program code in which input data is received from networked devices, the input data is processed and/or stored by the servers, and output data is provided to networked devices for operation of theenvironment100.
• Network260 may include one or more networks of various types, including a local area or local access network (LAN), a general wide area network (WAN), and/or a public network (e.g., the Internet). In one embodiment, various networked computing devices of thesystem200 are interconnected using a LAN, and one or more computing devices (e.g.,server265, personal devices230) include connections to the Internet.
• FIG. 3 is a block diagram illustrating operation of a system of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment. Specifically, thearrangement300 illustrates operation of thesystem200.Arrangement300 includes a number ofprocessors305,memory310, and input/output315, which are interconnected using one ormore connections320. In one embodiment, thearrangement300 may be implemented as a singular computing device andconnection320 may represent a common bus. In other embodiments,arrangement300 is distributed and includes a plurality of discrete computing devices that are connected through wired or wireless networking. Theprocessors305 may include any processing element suitable for performing functions described herein, and may include single or multiple core processors, as well as combinations thereof.Processors305 may be included in a single computing device, or may represent an aggregation of processing elements included across a number of networked devices such as thepersonal devices230,terminals240, etc. discussed above.
• Input/output (I/O)315 includes one ormore output devices370 and one ormore sensors205.Output devices370 include one or more devices for presenting information to customers and generally includeaudio output devices371 and/orvisual output devices372. Theaudio output devices371 may include conventional audio speakers having any suitable form factor (e.g., standalone, integrated in a stereo, headphones, etc.), as well as devices using alternative methods of producing sound perceptible by a person such as a customer or employee, such as bone conduction transducers in a worn device.Visual output devices372 may include visual displays and various visual indicators such as light emitting diodes (LEDs). In some embodiments, theterminals240,personal devices230, andemployee devices235 ofFIG. 2 may include theoutput devices370, such as visual devices372 (e.g., visual displays, indicators) and/or audio devices371 (e.g., speakers) for communicating with persons during their transactions.Other output devices373 may provide information to customers through tactile feedback (e.g., haptic devices) or using other sensory stimuli.Sensors305 may includevisual sensors210 which may be carried or wornsensors374, and distributedsensors376 that are disposed throughout the environment. In one embodiment, the distributedsensors376 are disposed in a static arrangement in the environment. In one embodiment, at least some of the distributedsensors376 are movable. For example, the distributedsensors376 may be included on movable product displays or structures, and/or unmanned vehicles (e.g., aerial or ground-based vehicles).Other sensors378 may also be included that are suitable for collecting information about a person and his/her interactions within the environment. Examples ofother sensors378 include without limitation infrared (IR) sensors, thermal sensors, weight sensors, capacitive sensors, magnetic sensors, sonar sensors, radar sensors, lidar sensors, and so forth.
• I/O315 may also includeinput devices368 suitable for receiving input from persons, such as cameras, keyboards or keypads, touchscreens, buttons, inertial sensors, etc. I/O315 may further include wired or wireless connections to an external network (e.g., network260) using I/O adapter circuitry.
• Thevisual sensors210 may be used to captureimage information346 including the person and/or the environment, which may include views from various perspectives (e.g., a customer-worn visual sensor, static or movable visual sensors at various locations in the environment). Theimage information346 may be stored inmemory310, and may be individually or collectively processed byprocessors305 to determine information about persons within the environment and their respective interactions with items in the environment.
• Memory310 may include a variety of computer-readable media selected for their size, relative performance, or other capabilities: volatile and/or non-volatile media, removable and/or non-removable media, etc.Memory310 may include cache, random access memory (RAM), storage, etc. Storage included as part ofmemory310 may typically provide a non-volatile memory for the networked computing devices (e.g., server265), and may include one or more different storage elements such as Flash memory, a hard disk drive, a solid state drive, an optical storage device, and/or a magnetic storage device.Memory310 may be included in a single computing device or may represent an aggregation of memory included in networked devices.Memory310 may include a plurality of modules for performing various functions described herein. The modules generally include program code that is executable by one or more of theprocessors305. As shown, modules include animage analysis module348, arewards module350, and aninventory management module358. The modules may also interact to perform certain functions. For example, rewardsmodule350 may make calls to theimage analysis module348 to evaluate using image information346 a person's performance of a presented task. The person of ordinary skill will recognize that the modules provided here are merely non-exclusive examples; different functions and/or groupings of functions may be included as desired to suitably operate the environment.
• Memory310 includes a plurality ofpersonal profiles322 corresponding to the different persons. In some cases, thepersonal profiles322 may be associated with a loyalty program administered in the environment. During operation of thesystem200, thepersonal profiles322 may be associated with a current transaction for a person after identifying the person using the person's portable computing device (e.g., a login using a mobile computing app), a visual scan of the person's loyalty card or the person's face or other identifying features, etc. In one embodiment, thepersonal profiles322 and at least some of theimage information346 may be stored on theserver265 or on a separate database.
• Thepersonal profiles322 include a number of different types of information that may be useful to augment visual identification of items. Anitem interaction history324 may reflect the person's interactions with various items in the environment, which may have occurred during previous transactions and/or earlier during the current transaction. Theitem interaction history324 may be adaptively updated as image information is acquired and the person's identified interactions are added into thevirtual transaction record349. Some non-limiting examples of item interactions includeviewing items325, handlingitems326, and purchasingitems327. The item interactions may be directly observed and/or deduced usingvisual sensors210 in the environment. In one example of direct observation, a person wears a forward-looking visual sensor that generally represents their field of view (i.e., including viewed items) at a given time. In one example of a deduced observation, a gaze-tracking camera tracks the eye movement of the person, but its information alone may be unable to discern what items the person is viewing. However, using image information to determine the person's position within the environment and the relative orientation of their head, and perhaps referenced with item location information, the system may be able to determine what items are being viewed by the person and add this information into theviewing items325 portion of theitem interaction history324.
• Personal profiles322 also includepersonal preferences328 reflecting preferences that are explicitly specified by the person (explicit preferences329), or that may be deduced by the system based on other information included in the personal profile322 (deduced preferences330), such as the person'sitem interaction history324. The person may specify preferences using a personal computing device (e.g., through a mobile computing device app) or through terminals or other computing devices accessible in the environment.Personal preferences328 may reflect preferences of one item in relation to another (e.g., apples tend to be purchased at the same time as oranges), one grouping of items in relation to another (e.g., junk food preferred over vegetables), transaction preferences, and so forth. In one example, a person may prefer to purchase their fresh produce during a certain transaction that occurs with some regularity, say every couple of weeks. Therefore, when a first item is selected that is positively identified as a fresh vegetable, it is likely that a significant number of other items in the same transaction will also be fruits and/or vegetables. This information may be used to help identify items detected by the image analysis.
• Personal profiles322 may also includehealth information332 for the person. For example, a person could specify that they have certain allergies or othermedical conditions333. For example, a person may have allergic reactions to certain items such as nuts, shellfish, eggs, etc. The other medical conditions, while perhaps not as serious as an allergic reaction, may still cause discomfort to the person. For example, oils in mango skin may cause dermatitis for persons who are sensitive to poison ivy. Items that are related to the allergies andother conditions333 are generally less likely to be selected by the person during a transaction. In some embodiments, the allergies andother conditions333 may be used to remove certain possible items from consideration while performing item identification, as it would be highly unlikely that the person would be selecting an item to which they are allergic.Health information332 may also include one ormore nutrition goals334 andfitness goals335 for the person.
• For example,nutrition goals334 may include a set of values representing various nutrients (calories, vitamins, minerals, etc.), which may be provided as daily recommendations or perhaps indicated as part of a specific diet plan for the person. Thenutrition goals334 may interact with or may partially overlap with the fitness goals335 (e.g., caloric content related to weight loss).
• Personal profiles322 may also includeprospective item information336 that suggests that a person may select a particular type of item during the transaction. Theprospective item information336 may be indicated by the person or deduced. For example, the person may enter a shopping list orwish list337 using a mobile computing device app, and the items listed therein are very likely to be selected by the person during the transaction. In another example, arecipe338 is entered by the person in the mobile computing device app (e.g., the person wishes to purchase the component ingredients to prepare the recipe). Alternatively, recipes may be accessed by thesystem200 responsive to a number of items previous identified during the transaction. For example, say a person selects containers of peanut butter and of jelly during a particular transaction. The system may search for recipes that include both of those ingredients—one of which is a peanut butter and jelly sandwich. Based on the information in thisrecipe338, it is more likely that the person will also select bread during the transaction. Accordingly, a visually detected item with physical attributes roughly corresponding to a loaf of bread (e.g., having an approximate size and shape as the loaf) may be more easily identified as the loaf of bread, without the need for full image processing.
• Memory310 includes avirtual transaction record349 reflecting the person's item interactions, which may be determined using acquiredimage information346. In some embodiments, thevirtual transaction record349 is included in thepersonal profile322; in some embodiments, the two may be separately maintained inmemory310. The person's interactions with different items may be identified using image information, and those interactions stored in thevirtual transaction record349. When items are identified as being selected by the person, the selected items may be added to item lists (e.g., a virtual cart) within thevirtual transaction record349. The item lists are then used as part of completing the checkout transaction. In some cases, as thevirtual transaction record349 is updated, corresponding portions of theitem interaction history324 are also updated.
• Image information346 is generally acquired using thevisual sensors210. Theimage information346 may be maintained in any form suitable for performing image analysis—one or more still images, video, and so forth. In some cases, theimage information346 does not include labeling (such as a universal product code (UPC) or quick response (QR) code) or other encoded information that is sufficient to uniquely identify the item. In some cases, theimage information346 includes some encoded information, but not enough to positively identify the corresponding item (e.g., the barcode is partially obscured). In some embodiments, partial encoded identification information may be used to narrow a set of possible items for item identification.
• Image analysis module348 is configured to receiveimage information346 as inputs, and to perform analysis according to any suitable techniques. Generally, theimage analysis module348 may perform edge detection or comparable techniques to define areas within theimage information346 that correspond to different items. Theimage analysis module348 may further compare theimage information346 withreference image information343 to attempt to identify the detected items. In some cases,reference image information343 may be intentionally simplified, such as acquiring the reference image information under controlled conditions, including only a singular item within the reference image information, and so forth.
• Theimage analysis module348 may further be able to detect predefined gestures or other behaviors by a person relative to particular items. In some embodiments, an item interaction represents a determined behavior of the person relative to an identified item. Some non-limiting examples of item interactions includeviewing items325, handlingitems326, and purchasingitems327. In some embodiments, theimage analysis module348 is configured to output item interactions to thevirtual transaction record349 and/or to therewards module350. In some embodiments, the identified items and behaviors are output to thevirtual transaction record349, where the item interactions are determined (i.e., association of items with behaviors). Thevirtual transaction record349 may then provide the determined item interactions to therewards module350.
• The item interactions (including identified items and behaviors) from theimage analysis module348 may be provided as inputs to therewards module350.Rewards module350 is generally configured to administer the rewards component of thesystem200, which incentivizes a person for performing certain tasks within the environment. The incentives may be provided to the person in any suitable form, such as money, points, discounts, coupons, promotions, giveaways, etc. In some cases, a rewards component of an environment may be completely responsive, with the incentives determined based on actions the person has already taken within the environment. In various embodiments described herein, the rewards component may include proactive aspects, providing specific tasks for the person to perform during their transaction within the environment. While a person's participation in the provided rewards tasks is not guaranteed, determining suitable tasks and appropriate incentives for the tasks increases the chance that the person will participate. Therewards module350 includes a number offunctional sub-modules351, which includetask generation352,evaluation354, andaward356. Therewards module350 may further include one or morepredefined games353 that provide a context or cohesive theme for the individually generated tasks. The addition of context, such as animated characters, a story or narrative, or other audiovisual elements, may increase a level of interest or engagement for the person, further encouraging the person's participation in the rewards tasks.
• The task generation sub-module352 determines one or more tasks for the person to perform within the environment during their transaction. Each task may include one or more specific item interactions for the person to perform. Generally, the task generation sub-module352 may use information associated with the person, such as thepersonal profile322 and thevirtual transaction record349, to generate tasks that are tailored to the person's interests or that are otherwise intended to influence the person's actions during the transaction.
• The task generation sub-module352 may also useitem information342 to determine the one or more tasks to be performed.Item information342 includeslocation information344, which may be used to select appropriate items to be included in the tasks. For example, based on the person's location in the environment, remaining items on his or hershopping list337, etc., the task generation sub-module352 may select items that are relatively close (e.g., within several feet, along the same aisle, etc.) to the location or to anticipated locations of the person. In this way, the tasks may be perceived as less inconvenient for the person. Generally, less inconvenience in the tasks may correlate to greater participation of persons in the rewards tasks.
• In additional to personal information and item information, the tasks generated by the task generation sub-module352 may also reflect other competing considerations, such as inventory information, incentive information, and initiatives. For example, aninventory management module358 may operate to track inventory levels for the various items on display in the environment, as well as additional item inventory (say, located in nearby store rooms, warehouses, etc.) for restocking the environment, and ordering information to timely acquire additional items. Theinventory management module358 may includeitem expiration information359 that may be used for item restocking, rotation, replacement, etc. as necessary. For example, theitem expiration information359 may be used to generate prompts for employees to locate and sort out expired or near expiring items from the rest of the items on display.
• One ormore incentives360 may be available for promoting various items.Incentives360 may have any suitable form, such as discounts, offers, rebates, etc. for the associated items. Incentives may originate from different sources, such as from theitem manufacturer361 and from the environment362 (e.g., store-specific). In some cases, incentives may be available from different sources corresponding to the same item. To resolve any incompatibility between the different incentives, the incentives may be prioritized according to the source, the amount, etc. For example, incentives provided at the environment level may override any conflicting incentives from the item manufacturer. In another example, the “better” (i.e., greater amount) of the incentives may be given priority regardless of source.
• One ormore initiatives364 may be used to promote various features associated with the environment. In one embodiment, awebsite initiative365 may encourage a person to access a website related to the environment using their personal computing device. An example operation of awebsite initiative365 is discussed below with respect toFIG. 7. Theinitiatives364 may include one or moreother features366 that promote any desired aspects (virtual or physical) associated with the environment. For one example initiative, a corresponding task may require that the person access item information using a mobile computing app associated with the environment. In another example initiative, corresponding tasks may direct shoppers to visit a newly-remodeled section of the environment.
• The generated tasks may be presented to the person using asuitable output device370 located within the environment. For example, the tasks may be transmitted to a personal computing device that belongs to the person, or to a computer-based terminal disposed within the environment and suitably close to the person's location or along the person's anticipated route within the environment. The generated tasks may be presented to the person in a direct or an indirect manner. A direct presentation of the task could ask the person to interact with the specific item—for example, locate item x. However, an indirect presentation of the task may use descriptive information about the particular item, requiring the person to consider the descriptive information or to search a plurality of different items to find the particular item. For example, a task may require a person to locate an item havingparticular nutrition information345. In some cases, the descriptive information may be in the form of a riddle or puzzle to be solved by the person prior to completion of the task. In some cases, using an indirect approach may increase the person's engagement with the rewards tasks and increase their overall willingness to participate.
• In addition to associated items and behaviors, the generated tasks may also specify one or more criteria for task completion or for rewards scoring. Criteria may include a time element (e.g., perform this task within three minutes) and/or specific aspects of task execution (e.g., locate the item and capture an image of the associated labeling, barcode, etc.).
• Theevaluation sub-module354 receives as input one or more of the generated tasks, as well as performance information based on acquiredimage information346, and scores the performance of the tasks based on the performance information. In some embodiments, theevaluation sub-module354 associates item and behavior information received from theimage analysis module348 to determine the item interaction. In other embodiments, theimage analysis module348 or thevirtual transaction record349 provides the determined item interaction to theevaluation sub-module354. The determined item interaction is compared with the generated tasks to determine whether a particular task was completed, as well as whether it was performed according to prescribed criteria. Theevaluation sub-module354 may use any suitable algorithm(s) for scoring performance of the tasks.
• Theaward sub-module356 receives scoring information from theevaluation sub-module354 assessing the person's performance of the task. The scoring information may be provided in any suitable fashion—an overall score of the task performance, component scores related to the prescribed performance criteria, and so forth. Theaward sub-module356 receives the scoring information and determines a corresponding amount of awards to reward to the person's account. The particular task and the performance score may be combined in a predefined relationship to determine the amount of rewards, for example, according to any suitable equation. In some cases, the tasks may be given different weights depending on their relative importance, which may be determined using inventory information (e.g., a need to quickly sell the associated item), incentive information, initiative information, and so forth.
• The award sub-module356 may associate the determined amount of rewards with the person using thepersonal profile322 and/or thevirtual transaction record349. The rewards may be applied by the person during the current transaction, or may accumulate for application during a later transaction. In some cases, the rewards may be tied to promotions outside the transaction and/or environment, such as a mailed rebate or an electronic promotion to an event.
• FIG. 4 illustrates amethod400 of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment. Themethod400 may generally be used in conjunction with thearrangement300 described above.
• Method400 begins atblock405, where one or more tasks are generated for the person to complete during the transaction. The tasks are generated based on information included in the personal profile associated with the person, such as an item interaction history, personal preference information, health information, and prospective item information. Each task may relate to one or more item interactions, which associate items in the environment with certain predetermined behaviors.
• Atblock415, the one or more tasks are presented to the person using an output device within the environment. In some embodiments, the presentation may be provided to a personal computing device associated with the person (such as a smartphone or tablet). In some embodiments, the presentation may be provided to a computing device disposed within the environment, such as a terminal in the proximity of the person or along an anticipated path of the person through the environment.
• Atblock425, acquired image information is analyzed to evaluate the person's performance of the one or more presented tasks. The image information is acquired using one or more visual sensors disposed within the environment. In one or more embodiments, the analysis may be further based on input provided by other sensor devices or by the person through a user interface. In some embodiments, the evaluation may be binary—that is, does the image information (as represented in the determined item interaction) indicate that the person completed the task? In other embodiments, the evaluation may be based on one or more criteria—for example, performing the task correctly, performing the task within a prescribed window of time, within a predetermined time limit, and so forth.
• Atblock435, an amount of rewards is awarded to the person based on the evaluation. In some embodiments, the rewards are associated with the person's personal profile and/or the virtual transaction record (associated with the person's current transaction). The rewards may be redeemed during the current transaction or during a later transaction, consistent with the overall rewards system and the person's preferences (e.g., accumulating rewards for a later transaction).
• FIG. 5 illustrates amethod500 of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment. Themethod500 represents one possible implementation of themethod400, and may generally be used in conjunction with thearrangement300 described above. In one embodiment, themethod500 represents an item-matching game available within the environment.
• Atblock505, at least one item is selected for a prospective task. In some embodiments, selection of the item is based onlocation information510, such asperson location information512 and/oritem location information344. Theperson location information512 may be provided directly or determined through image analysis ofimage information346. Selecting an item closer to the person's location may cause the associated task to be perceived as less inconvenient by the person. In some embodiments, selection of the item may also be based onpersonal profile322 information, such as the person'spreferences328 orprospective item information336. For example, the system may more frequently select items with which the person has interacted or has a relative preference. In some embodiments, theprospective item information336 may be used to suggest alternative items (e.g., a different brand of an item included on a shopping list, or a suitable substitute item) to the person.
• Atblock515, descriptive information for the item is selected. In some cases, the descriptive information may include merely identification information (i.e., a unique name, size, etc.) for the item. In some cases, however, descriptive information may include attributes or other qualities of the item, such as nutrition information, without providing unique identification information. In some embodiments, the amount of descriptive information included with a task is adaptive, based on the person's preferences and/or other task generation considerations such as incentives, inventory, initiatives, and so forth.Blocks505 and515 may be repeated as desired—e.g., as part of determining a plurality of tasks for the person to perform.
• Atblock525, a task including the selected descriptive information is presented to the person. In some embodiments, a single task is presented atblock525. In other embodiments, more than one task is presented (e.g., a checklist). The presented task may be selected from a plurality of determined tasks for the person. In some embodiments, the task is presented to the person using a personal computing device. In some embodiments, the task is presented using a computing device disposed within the environment, such as a terminal located near the person's location.
• Atblock535, acquired image information is analyzed to determine one or more item interactions performed by the person. Atblock540, the item interactions are evaluated to determine whether any match the task. If at least one match is determined (“YES”) the method proceeds to block545, where performance of the task is evaluated according to one or more criteria. However, if no matches are determined (“NO”), the method returns to block535 to continue analysis of image information.
• Atblock555, the rewards for the person are updated based on the evaluation of task performance. The rewards may be maintained as part of the personal profile and/or a virtual transaction record for the current transaction. The grouping ofblocks535,540,545, and555 may be generally referred to as asubroutine565.
• Atblock560, the method determines whether all generated tasks have been completed. If complete (“YES”), the method ends. However, if not complete (“NO”), the method returns to one ofblock525 and535, depending generally on whether multiple tasks were presented to the person. If multiple tasks were presented at once to the person (e.g., as a checklist), the method may return to block535 to continue analysis of image information. However, if only a single task was presented to the person at the first instance, a next task is presented to the user when the method returns to block525.
• FIG. 6 illustrates amethod600 of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment. Themethod600 represents one possible implementation of themethod400, and may generally be used in conjunction with thearrangement300 described above. In one embodiment, themethod600 represents an expired items game available within the environment.
• Method600 begins atblock605, where the system determines that one or more expiring items have either reached their expiration date or are nearing their expiration date. The determination may be based on information available throughinventory management module358, such as theitem expiration information359. A retailer or other provider (e.g., an item manufacturer) may generally wish to remove expiring items from display as customers or shoppers may perceive
• Atblock615, a task involving at least one of the expiring items ofblock605 is presented to the person during a transaction. The task (i.e., the selected item and/or associated behavior) may be selected for the person based onpersonal profile322 information, such aspreferences328 and/orprospective item information336. For example, given two different types of expiring items, one type of which the person does not prefer (i.e., a negative preference), the system may tend to select the other type to present as part of the task. The task may further be based onlocation information510 to reduce any inconvenience for the person who is to perform the task.
• Generally, the task may include locating an expiring item and/or sorting the expiring item from other non-expiring items. In some cases, the task may be associated with a discount on purchasing the expiring item. By incentivizing customers or shoppers to locate the expiring items, the retailer or environment administrator may not need to send an employee to perform the same task.
• Atblock625,subroutine565 is performed. As discussed above, thesubroutine565 generally includes analyzing image information, determining a match with the presented task, evaluating performance of the task, and updating rewards based on the evaluation. At anoptional block630, the system determines whether the presented task item had been sorted from other items, but not selected by the person. For example, the person may have located the expiring item consistent with the presented task, but did not remove the item as he or she did not intend to purchase the item. In this case, the retailer or environment administrator may not wish to leave the expiring item in place, but may remove the item to avoid selection by other shoppers. Accordingly, if the item was sorted but not selected (“YES”), atblock635 the system may notify an employee to collect the sorted item.
• In an alternative embodiment, the presented task may prescribe a placement of the expiring (but not yet expired) item, to improve the likelihood that the expiring item is selected prior to its expiration date. For example, an expiring item located near the bottom of a stack of items may be located by the person and placed near the top of the stack, so that the item is more visible and may be more likely to be selected by other shoppers.
• FIG. 7 illustrates amethod700 of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment. Themethod700 represents one possible implementation of themethod400, and may generally be used in conjunction with thearrangement300 described above. In one embodiment, themethod700 represents an online services game available within the environment.
• Method begins atblock705, where a task is presented involving one or more initiatives and one or more items. Theinitiatives364 may specify one or more physical or virtual features associated with the environment, such as website features, mobile app features, etc.
• The associated item for the task may be selected based onpersonal profile322 information, such asprospective item information336 andother information340. In some cases, the associated item for the task may be selected from prospective items included in theprospective item information336. For example, say the initiative relates to using a mobile computing app to research an item or view a comparison of items. One associated task may be acquiring image information of an item using a mobile computing device; the app then loads the information related to the item for viewing by the person (i.e., the feature highlighted in the initiative). Here, the system may select an item for the task based on items that the person has included in a shopping list but has not yet selected for purchase (e.g., by removing from display and placing in a shopping receptacle). This information may be reflected in thevirtual transaction record349. Another example of a task is accessing a web page associated with an item that is already selected or expected to be selected by the person (say, based onprospective item information336, purchase history, etc.). The task may require that the person transmit a link to the page (or other content from the page) to a computing device associated with the environment (such as server265).
• By selecting items for a task in which the person may already be interested, and by integrating the task into an action that the person is expected to perform (e.g., selecting an item on a shopping list), the level of participation in initiatives and other rewards tasks may generally be increased.
• Theother information340 may includeinitiatives participation710 information, which reflects the person's participation in various initiatives. For example, the system may determine not to present a task relating to an initiative which the person has previously participated in. In one embodiment, theinitiatives participation710 may be as simple as single data bits indicating whether the person has participated or not. Of course, the initiatives participation may include more in-depth information about the nature of the participation, items involved, etc.
• Atblock715,subroutine565 is performed. As discussed above, thesubroutine565 generally includes analyzing image information, determining a match with the presented task, evaluating performance of the task, and updating rewards based on the evaluation. Of note, the acquired image information may be acquired as part of the person's performance of the task—such as capturing an image of the item included in the presented task—or perhaps reflected in image information that includes the person manipulating the computing device to perform the task.
• FIG. 8 illustrates amethod800 of providing rewards to a person based on item interactions during a transaction in an environment, according to one embodiment. Themethod800 represents one possible implementation of themethod400, and may generally be used in conjunction with thearrangement300 described above. In one embodiment, themethod800 represents a profile matching game available within the environment.
• Method800 begins atblock805, where an entry is determined from ashopping list337 of a person'spersonal profile322. In an alternative embodiment, other prospective item information associated with thepersonal profile322 may be substituted for the shopping list. In some embodiments, the shopping list entry may correspond directly to an item in the environment—for example, exactly matching an item brand, name, size, etc. In other embodiments, the shopping list may describe one or more items generically without including the unique identification information—for example, an entry including “soda” instead of a more specific intended item, such as a six-pack of 12-ounce cans of Coca-Cola®. Alternatively, an item may be specifically included in the shopping list entry, but is out of stock in the environment.
• Atblock815, the system determines a categorical grouping corresponding to the entry. For example, for an entry of “lettuce,” some possible categorical groupings include^“green vegetables,” “leafy greens,” “vegetables,” etc. The most pertinent categorical grouping may be determined using profile information and/or the virtual transaction record—for example, the selection of other vegetables (e.g., carrots, celery, cucumbers, tomatoes) during the transaction may indicate that the person is purchasing items to assemble a salad. As a number of different vegetables have been selected in this example, an appropriate grouping for the lettuce entry may be narrower than merely “vegetables” or “green vegetables” categories. Assume for the purposes of this example that the system determines “leafy greens” to be the best categorical grouping. The example leafy greens category may encompass a plurality of different items—different varieties of lettuce, spinach, kale, collards, Swiss chard, cabbage, Brussels sprouts, etc. Each of the plurality of items may have different qualities or characteristics, such as nutrition information, which may be comparatively ranked relative to one or more criteria.
• Atblock825, a task involving the grouping is presented to the person. The task may be presented relative to the one or more criteria, which may be explicitly included or deduced from thepersonal profile322. The criteria may be based onhealth information332, such asnutrition goals334 and/orfitness goals335. The task may further be based on inventory and/or incentive information, such as a need to sell certain items.
• Continuing the earlier example, say one of the person'snutrition goals334 is increasing daily potassium intake. Each of the plurality of items in the “leafy greens” category may have a differing amount of potassium content. Thus, the items may be given a relative ranking according to their potassium content—e.g., spinach as having the most potassium, Swiss chard second-most, kale third-most, and so forth. Of course, a combination of multiple criteria may be used to rank the categorical items; the criteria may be weighted as part of determining scoring for each of the items.
• Presenting the task to the person may include directing the person to find the item within the categorical grouping that best matches one or more criteria. In the example, the task may prompt the person to locate the leafy green vegetable having the highest potassium content.
• Atblock835,subroutine565 is performed. As discussed above, thesubroutine565 generally includes analyzing image information, determining a match with the presented task, evaluating performance of the task, and updating rewards based on the evaluation. In this case, evaluating the person's performance is based on which item the person selects from the categorical grouping. For example, the person might receive a largest score for selecting the spinach, and lesser scores for selecting one of the other types of leafy greens. In some embodiments, the system may present the “best” choice to the person after the person's item selection has been made, in order to improve their understanding and item selection abilities.
• Atblock840, the system determines whether additional entries remain on the shopping list. If so (“YES”), the method returns to block805. Accordingly, the profile matching game may be implemented as an incremental game, adapting the task and/or scoring based on the person's selection of the previous item. Based on the item selected from a first grouping, the system assess how the selected item affects nutrition goals, fitness goals, etc. included in the personal profile, and may adapt the next task accordingly. For example, if the person selects the leafy greens item corresponding to the highest potassium content, evaluation of subsequent shopping list entries may lessen the relative importance of the items' potassium content (e.g., adjusting relative weighting) in favor of other criteria. The system may further suggest one or more items (not included on the shopping list) based on the person's selections, whether to complement the selected items or to compensate for deficiencies of the selected items.
• The descriptions of the various embodiments of the present disclosure have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
• In the preceding, reference is made to embodiments presented in this disclosure. However, the scope of the present disclosure is not limited to specific described embodiments. Instead, any combination of the following features and elements, whether related to different embodiments or not, is contemplated to implement and practice contemplated embodiments. Furthermore, although embodiments disclosed herein may achieve advantages over other possible solutions or over the prior art, whether or not a particular advantage is achieved by a given embodiment is not limiting of the scope of the present disclosure. Thus, the following aspects, features, embodiments and advantages are merely illustrative and are not considered elements or limitations of the appended claims except where explicitly recited in a claim(s). Likewise, reference to “the invention” shall not be construed as a generalization of any inventive subject matter disclosed herein and shall not be considered to be an element or limitation of the appended claims except where explicitly recited in a claim(s).
• Aspects of the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module,” or “system.”
• The present disclosure may be a system, a method, and/or a computer program product. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present disclosure.
• The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
• Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
• Computer readable program instructions for carrying out operations of the present disclosure may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present disclosure.
• Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.
• These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
• The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
• The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.
• Embodiments of the disclosure may be provided to end users through a cloud computing infrastructure. Cloud computing generally refers to the provision of scalable computing resources as a service over a network. More formally, cloud computing may be defined as a computing capability that provides an abstraction between the computing resource and its underlying technical architecture (e.g., servers, storage, networks), enabling convenient, on-demand network access to a shared pool of configurable computing resources that can be rapidly provisioned and released with minimal management effort or service provider interaction. Thus, cloud computing allows a user to access virtual computing resources (e.g., storage, data, applications, and even complete virtualized computing systems) in “the cloud,” without regard for the underlying physical systems (or locations of those systems) used to provide the computing resources.
• Typically, cloud computing resources are provided to a user on a pay-per-use basis, where users are charged only for the computing resources actually used (e.g., an amount of storage space consumed by a user or a number of virtualized systems instantiated by the user). A user can access any of the resources that reside in the cloud at any time, and from anywhere across the Internet. In context of the present disclosure, a user may access applications (e.g., a retail store app for a mobile computing device) or related data (e.g., compiled shopping data) available in the cloud. Doing so allows a user to access this information from any computing system attached to a network connected to the cloud (e.g., the Internet).
• While the foregoing is directed to embodiments of the present disclosure, other and further embodiments of the disclosure may be devised without departing from the basic scope thereof, and the scope thereof is determined by the claims that follow.

Claims (20)

What is claimed is:

1. A computer-implemented method of providing rewards to a person based on item interactions during a transaction in an environment, the person associated with a personal profile, the method comprising:

generating, based on information in the personal profile, one or more tasks for the person to complete during the transaction, each task including at least one item interaction;

presenting, using an output device within the environment, the one or more tasks to the person;

analyzing image information acquired by one or more visual sensors within the environment to evaluate the person's performance of the one or more tasks; and

awarding, based on the evaluation, an amount of rewards to the person.

2. The method ofclaim 1, wherein the amount of rewards are applied to one of the personal profile and a virtual transaction record reflecting the person's item interactions during the transaction.

3. The method ofclaim 1, wherein the information in the personal profile includes one or more of an item interaction history, item preferences, health information, prospective item information for the transaction, and participation information for one or more initiatives.

4. The method ofclaim 1, wherein generating the one or more tasks is further based on one or more of item incentive information, initiative information, and item inventory information.

5. The method ofclaim 4, wherein the item inventory information indicates a first item nearing a corresponding expiration date, and wherein at least one task includes the person locating the first item.

6. The method ofclaim 1, wherein the one or more tasks includes locating a selected item, wherein presenting the one or more tasks includes providing descriptive information about the item without explicitly identifying the item.

7. The method ofclaim 1, wherein generating the one or more tasks includes:

determining an entry of a shopping list included in the personal profile; and

determining a categorical grouping that corresponds to the entry and that includes a plurality of items,

wherein the one or more tasks are presented with respect to the determined grouping, and wherein evaluating the performance of the one or more tasks is based on which of the plurality of items is involved in the corresponding item interaction.

8. A computer program product of providing rewards to a person based on item interactions during a transaction in an environment, the person associated with a personal profile, the computer program product comprising:

a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation that includes:

generating, based on information in the personal profile, one or more tasks for the person to complete during the transaction, each task including at least one item interaction;

presenting, using an output device within the environment, the one or more tasks to the person;

analyzing image information acquired by one or more visual sensors within the environment to evaluate the person's performance of the one or more tasks; and

awarding, based on the evaluation, an amount of rewards to the person.

9. The computer program product ofclaim 8, wherein the amount of rewards are applied to one of the personal profile and a virtual transaction record reflecting the person's item interactions during the transaction.

10. The computer program product ofclaim 8, wherein the information in the personal profile includes one or more of an item interaction history, item preferences, health information, prospective item information for the transaction, and participation information for one or more initiatives.

11. The computer program product ofclaim 8, wherein generating the one or more tasks is further based on one or more of item incentive information, initiative information, and item inventory information.

12. The computer program product ofclaim 11, wherein the item inventory information indicates a first item nearing a corresponding expiration date, and wherein at least one task includes the person locating the first item.

13. The computer program product ofclaim 8, wherein the one or more tasks includes locating a selected item, wherein presenting the one or more tasks includes providing descriptive information about the item without explicitly identifying the item.

14. The computer program product ofclaim 8, wherein generating the one or more tasks includes:

determining an entry of a shopping list included in the personal profile; and

determining a categorical grouping that corresponds to the entry and that includes a plurality of items,

wherein the one or more tasks are presented with respect to the determined grouping, and wherein evaluating the performance of the one or more tasks is based on which of the plurality of items is involved in the corresponding item interaction.

15. A system of providing rewards to a person based on item interactions during a transaction in an environment, the person associated with a personal profile, the method comprising:

one or more computer processors;

at least a first visual sensor disposed within the environment and communicatively coupled with the one or more computer processors; and

a memory containing program code which, when executed by the one or more computer processors, performs an operation that includes:

generating, based on information in the personal profile, one or more tasks for the person to complete during the transaction, each task including at least one item interaction;

presenting, using an output device within the environment, the one or more tasks to the person;

analyzing image information acquired by one or more visual sensors within the environment to evaluate the person's performance of the one or more tasks; and

awarding, based on the evaluation, an amount of rewards to the person.

16. The system ofclaim 15, wherein the amount of rewards are applied to one of the personal profile and a virtual transaction record reflecting the person's item interactions during the transaction.

17. The system ofclaim 15, wherein the information in the personal profile includes one or more of an item interaction history, item preferences, health information, prospective item information for the transaction, and participation information for one or more initiatives.

18. The system ofclaim 15, wherein generating the one or more tasks is further based on one or more of item incentive information, initiative information, and item inventory information.

19. The system ofclaim 18, wherein the item inventory information indicates a first item nearing a corresponding expiration date, and wherein at least one task includes the person locating the first item.

20. The system ofclaim 15, wherein generating the one or more tasks includes:

determining an entry of a shopping list included in the personal profile; and

determining a categorical grouping that corresponds to the entry and that includes a plurality of items,

wherein the one or more tasks are presented with respect to the determined grouping, and wherein evaluating the performance of the one or more tasks is based on which of the plurality of items is involved in the corresponding item interaction.

Images