US20180188905A1 - Generating messaging streams with animated objects - Google Patents

Abstract

A method for generating a messaging stream where one or more messages are exchanged between a first user and a second user comprises generating a messaging stream where one or more messages are exchanged between a first user and a second user. The method further includes receiving a selection of an animated object from the first user for the messaging stream. The method further includes providing the animated object in the messaging stream. The method further includes receiving a first action from the first user related to the animated object. The method further includes modifying a display of the animated object based on the first action. The method further includes receiving a second action from the second user related to the animated object. The method further includes modifying the display of the animated object based on the second action.

Description

BACKGROUND
• Current messaging applications allow for non-interactive, one-directional objects in the form of stickers, emojis, photos, GIFs, and sounds. However, these one-directional objects may be considered fleeting because they are limited in applicability. For example, a first user may send an emoji to a second user, who finds the emoji to be funny, but then forgets about the emoji entirely.
• The background description provided herein is for the purpose of generally presenting the context of the disclosure. Work of the presently named inventors, to the extent it is described in this background section, as well as aspects of the description that may not otherwise qualify as prior art at the time of filing, are neither expressly nor impliedly admitted as prior art against the present disclosure.
SUMMARY
• Implementations generally relate to a computer-implemented method to generate a messaging stream where one or more messages are exchanged between a first user and a second user. The method may include generating a messaging stream where one or more messages are exchanged between a first user and a second user. The method further includes receiving a selection of an animated object from the first user for the messaging stream. The method further includes providing the animated object in the messaging stream. The method further includes receiving a first action from the first user related to the animated object. The method further includes modifying a display of the animated object based on the first action. The method further includes receiving a second action from the second user related to the animated object. The method further includes modifying the display of the animated object based on the second action.
• In some implementations, receiving the first action from the first user includes detecting a change in airflow near a microphone associated with a user device. In some implementations, receiving the first action from the first user includes detecting movement of a finger on a touch screen or detection of movement of a pointing device. In some implementations, receiving the first action from the first user includes detecting movement of a user device based on information received from a sensor associated with the user device. In some implementations, receiving the first action from the first user includes receiving a message from the first user and determining a context from the messaging stream and modifying a display of the animated object based on the first action includes modifying the display of the animated object based on the context from the messaging stream. In some implementations, the first action is pulling the animated object in a first direction and the second action is pulling the animated object in a second direction. In some implementations, the method further comprises displaying the one or more messages within the messaging stream while the animated object remains fixed in a portion of the messaging stream. In some implementations, the first user is a chat bot and the animated object is related to the one or more messages exchanged between the first user and the second user. In some implementations, the display of the animated object is modified based on at least one of a word in the one or more messages, voice content, and a context of the messaging stream. In some implementations, the method further comprises identifying a set of objects to provide as options to the first user based on a type of user device on which the messaging stream is displayed, wherein the animated object is part of the set of objects.
• In some implementations, the method includes generating a messaging stream where one or more messages are exchanged between a first user and a second user. The method further includes receiving a selection of an animated object from the first user for the messaging stream. The method further includes causing a version of the animated object to be displayed based on a type of user device on which the animated object is displayed. The method further includes receiving an action from the second user related to the animated object. The method further includes in response to receiving the action, modifying the display of the animated object.
• In some implementations, the selection is a first selection and the animated object is a first animated object and the method further comprises providing the second user with a set of animated objects based on their relationship to the first object, receiving a second selection of a second animated object from the set of animated objects, and in response to the receiving the second selection, providing the second object in the messaging stream. In some implementations, the version of the animated object to be displayed based on the type of user device on which the animated object is displayed includes a complicated version for a desktop computer, a simpler version for a mobile device, and a more simple version for a smart watch. In some implementations, the selection is a first selection, the animated object is a first animated object, the action from the second user includes a second selection of a second animated object from the second user for the messaging stream, and modifying the display of the first animated object includes the first animated object interacting with the second animated object.
• In some implementations, the method may include means for generating a messaging stream where one or more messages are exchanged between a first user and a second user. The method further includes means for receiving a selection of an animated object from the first user for the messaging stream. The method further includes means for providing the animated object in the messaging stream. The method further includes means for receiving a first action from the first user related to the animated object. The method further includes means for modifying a display of the animated object based on the first action. The method further includes means for receiving a second action from the second user related to the animated object. The method further includes means for modifying the display of the animated object based on the second action.
• The various implementations described below provide messaging streams that include interactive animated objects. The animated objects described below may include multimedia features, such as features that can be displayed on a display screen, projected in a virtual reality environment, played back as audio, played back via haptic feedback, or a combination of such modalities. In various implementations, based on user consent, the animated objects react to user input, messages exchanged in the messaging stream, messaging context, and a combination of such factors. Interactive animated objects may provide several advantages. For example, such animated objects may enhance the user experience of using a messaging application that implements the messaging stream, e.g., by enabling users to express themselves in interactive ways, rather than being restricted to sending text, images, or stock items such as animated GIF, stickers, and emoji. Further, in implementations that provide animated objects in messaging streams that include multiple users, the animated objects may be acted upon concurrently, or sequentially, by multiple users. Such interactivity may provide geographically separated users an experience of collaboratively modifying an object. A further benefit is that behaviors of the objects may be customizable by users.
• The implementations provided herein efficiently provide interactive animated objects in a messaging stream. For example, the animated objects may be preprogrammed for certain behaviors, e.g., may be configured to respond to various user actions, messaging context, etc. by being modified or displayed in accordance with the user actions or context. In this manner, a technical advantage is that a large or even infinite number of behaviors of animated objects may be provided by a combination of preprogrammed behaviors, without the need to explicitly specify each behavior. This can permit complex animated objects to be stored and displayed with limited computational resources. Animated objects may be downloaded or accessed on demand, e.g., only upon insertion of the animated object in the messaging stream, which reduces storage space required to store the objects. Different versions of an animated object may be provided, as described below, for different user devices. Therefore, devices with limited storage space, network access capacity, and processing power, can still render a suitable version of an animated object. Thus, implementations described below provide animated objects in messaging streams for different types of user devices, without the need for device-specific reconfiguration.
BRIEF DESCRIPTION OF THE DRAWINGS
• The disclosure is illustrated by way of example, and not by way of limitation in the figures of the accompanying drawings in which like reference numerals are used to refer to similar elements.
• FIG. 1 illustrates a block diagram of an example system that generates a messaging stream with an animated object according to some implementations.
• FIG. 2 illustrates a block diagram of an example computing device that generates the messaging stream with the animated object according to some implementations.
• FIG. 3A illustrates an example user interface of a messaging stream that includes an animated cookie according to some implementations.
• FIG. 3B illustrates an example user interface of a messaging stream that includes the animated cookie with eyes that follow a pointing device controlled by a first user according to some implementations.
• FIG. 3C illustrates an example user interface of a messaging stream that includes the animated cookie that is viewable by multiple users according to some implementations.
• FIG. 3D illustrates an example user interface of a messaging stream that includes the animated cookie with eyes that follow a cursor controlled by a second user according to some implementations.
• FIG. 3E illustrates an example user interface of a messaging stream that includes the animated cookie that reacts to being moved according to some implementations.
• FIG. 3F illustrates an example user interface of a messaging stream that includes the animated cookie that reacts to being placed according to some implementations.
• FIG. 3G illustrates an example user interface of a messaging stream that includes the animated cookie with eyes that move to view text displayed within the messaging stream according to some implementations.
• FIG. 3H illustrates an example user interface of a messaging stream that includes the animated cookie that stays in a fixed location within the messaging stream according to some implementations.
• FIG. 3I illustrates an example user interface of a messaging stream that includes an animated cookie that reacts to a word in a message according to some implementations.
• FIG. 3J illustrates an example user interface of a messaging stream that includes the animated cookie that continues to react to the word in the message according to some implementations.
• FIG. 4A illustrates an example user interface of a messaging stream that includes an animated bear according to some implementations.
• FIG. 4B illustrates an example user interface of the messaging stream that includes the animated bear after a user performed a user action according to some implementations.
• FIG. 5A illustrates an example user interface of a messaging stream that includes animated bubbles according to some implementations.
• FIG. 5B illustrates the example user interface of the messaging stream that includes the animated bubbles after two users performed user actions according to some implementations.
• FIG. 6 illustrates an example user interface of a messaging stream that includes an animated money transfer object according to some implementations.
• FIG. 7A illustrates an example user interface of an animated takeout box according to some implementations.
• FIG. 7B illustrates the example user interface of the animated takeout box after a user performed a user action according to some implementations.
• FIG. 8A illustrates an example user interface of a messaging stream that includes an animated airplane according to some implementations.
• FIG. 8B illustrates an example user interface of the messaging stream that includes an animated couple that is displayed responsive to a user action related to the animated airplane according to some implementations.
• FIG. 9 illustrates a flowchart of an example method to generate a messaging stream that includes an animated object.
DETAILED DESCRIPTION
• In some implementations, a messaging application generates a messaging stream where messages are exchanged between a first user and a second user. The messaging application may receive a selection of an animated object from the first user for the messaging stream. For example, the first user may select an animated bubble to add to the messaging stream. The messaging application may add the animated object to the messaging stream. For example, the first user and the second user may view the animated bubble in the messaging stream.
• The messaging application may receive a first action from the first user related to the animated object. For example, the first user may blow into a user device and the user device detects a change in airflow near the microphone. The messaging application may modify a display of the animated object based on the first action. For example, the messaging application may show the bubble as moving upwards based on the user blowing into the user device. The messaging application may receive a second action from the second user related to the animated object. For example, the messaging application may receive indications based on the second user pulling the bubble with a finger on the user device. The messaging application may modify the display of the animated object based on the second action. For example, the messaging application may show the bubble as stretching in the direction corresponding to the movement of the finger and then popping.
Example System
• FIG. 1 illustrates a block diagram of anexample system100 that generates a messaging stream that includes an animated object. The illustratedsystem100 includes amessaging server101,user devices115a,115n, asecond server120, and anetwork105.Users125a,125nmay be associated withrespective user devices115a,115n. In some implementations, thesystem100 may include other servers or devices not shown inFIG. 1. InFIG. 1 and the remaining figures, a letter after a reference number, e.g., “115a,” represents a reference to the element having that particular reference number. A reference number in the text without a following letter, e.g., “115,” represents a general reference to implementations of the element bearing that reference number.
• Themessaging server101 may include a processor, a memory, and network communication capabilities. In some implementations, themessaging server101 is a hardware server. Themessaging server101 is communicatively coupled to thenetwork105 viasignal line102.Signal line102 may be a wired connection, such as Ethernet, coaxial cable, fiber-optic cable, etc., or a wireless connection, such as Wi-Fi®, Bluetooth®, or other wireless technology. In some implementations, themessaging server101 sends and receives data to and from one or more of theuser devices115a,115nand thesecond server120 via thenetwork105. Themessaging server101 may include amessaging application103aand adatabase199.
• Themessaging application103amay be code and routines operable to generate a messaging stream that includes an animated object. In some implementations, themessaging application103amay be implemented using hardware including a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC). In some implementations, themessaging application103amay be implemented using a combination of hardware and software.
• Thedatabase199 may store animated objects, messaging streams, etc. For example, thedatabase199 may store the messages between a first user and a second user. Thedatabase199 may also store social network data associated with users125, user preferences for the users125, etc.
• The user device115 may be a computing device that includes a memory and a hardware processor. For example, the user device may include a desktop computer, a mobile device, a tablet computer, a mobile telephone, a wearable device, a head-mounted display, a mobile email device, a portable game player, a portable music player, a reader device, or another electronic device capable of accessing anetwork105.
• In the illustrated implementation, user device115ais coupled to thenetwork105 viasignal line108 anduser device115nis coupled to thenetwork105 viasignal line110.Signal lines108 and110 may be a wired connection, such as Ethernet, coaxial cable, fiber-optic cable, etc., or a wireless connection, such as Wi-Fi®, Bluetooth®, or other wireless technology.User devices115a,115nare accessed byusers125a,125n, respectively. Theuser devices115a,115ninFIG. 1 are used by way of example. WhileFIG. 1 illustrates two user devices,115aand115n, the disclosure applies to a system architecture having one or more user devices115.
• In some implementations, the user device115 can be a user device that is included in a wearable device worn by the user125. For example, the user device115 is included as part of a clip (e.g., a wristband), part of jewelry, or part of a pair of glasses. In another example, the user device115 can be a smart watch. The user125 may view an animated object from themessaging application103 on a display of the device worn by the user125. For example, the user125 may view the animated object on a display of a smart watch or a smart wristband.
• In some implementations,messaging application103bmay be stored on a user device115a. Themessaging application103 may include a thin-client messaging application103bstored on the user device115aand amessaging application103athat is stored on themessaging server101. For example, themessaging application103bstored on the user device115amay display a messaging stream that includes an animated object. The user device115amay identify a user action from a first user, such as shaking the user device115ato make snow fall over an animated object of a snowman. The user device115amay transmit information about the messaging stream and the user action to themessaging application103astored on themessaging server101, which provides the information to a second user that accesses themessaging application103afrom a desktop computer.
• Thesecond server120 may include a processor, a memory, and network communication capabilities. Thesecond server120 may access thenetwork105 viasignal line109. Thesecond server120 may receive information from themessaging application103 about the messaging stream and provide information to themessaging application103. For example, thesecond server120 may be associated with a bank and thesecond server120 may communicate with themessaging application103 to pay a bill using the bank information. A user125 may instruct themessaging application103 to authorize thesecond server120 to pay a bill by clicking on an animated object of a bag of money. Once the transaction is complete, thesecond server120 may send themessaging application103 a notification that the transaction is complete. Themessaging application103 may modify the animated object to show the money moving from the money bag to the bank associated with thesecond server120. In another example, thesecond server120 may include a bot that performs functions for a user125, such as ordering food, scheduling an appointment, making a reservation, booking a flight, etc. In yet another example, thesecond server120 may include a separate application that provides information to themessaging application103, such as a calendar application that sends, upon user consent, information about the user's meetings.
• In the illustrated implementation, the entities of thesystem100 are communicatively coupled via anetwork105. Thenetwork105 may be a conventional type, wired or wireless, and may have numerous different configurations including a star configuration, token ring configuration or other configurations. Furthermore, thenetwork105 may include a local area network (LAN), a wide area network (WAN) (e.g., the Internet), and/or other interconnected data paths across which multiple devices may communicate. In some implementations, thenetwork105 may be a peer-to-peer network. Thenetwork105 may also be coupled to or include portions of a telecommunications network for sending data in a variety of different communication protocols. In some implementations, thenetwork105 includes Bluetooth® communication networks, WiFi®, or a cellular communications network for sending and receiving data including via short messaging service (SMS), multimedia messaging service (MMS), hypertext transfer protocol (HTTP), direct data connection, email, etc. AlthoughFIG. 1 illustrates onenetwork105 coupled to the user devices115 and themessaging server101, in practice one ormore networks105 may be coupled to these entities.
• In situations in which the systems and methods discussed herein may collect or use personal information about users (e.g., user data, information about a user's social network, user's location, user's biometric information, user's activities and demographic information, the messaging server stores and analyzes videos), users are provided with opportunities to control whether information is collected, whether the personal information is stored, whether the personal information is used, whether the videos are analyzed, and how the information about the user is collected, stored, and used. That is, the systems and methods discussed herein collect, store, and/or use user personal information only upon receiving explicit authorization from the relevant users to do so. For example, a user is provided with control over whether programs or features collect user information about that particular user or other users relevant to the program or feature. Each user for which personal information is to be collected is presented with one or more options to allow control over the information collection relevant to that user, to provide permission or authorization as to whether the information is collected and as to which portions of the information are to be collected. For example, users can be provided with one or more such control options over a communication network. In addition, certain data may be treated in one or more ways before it is stored or used so that personally identifiable information is removed. As one example, a user's identity information may be treated, e.g., anonymized, so that no personally identifiable information can be determined from a video. As another example, a user's geographic location may be generalized to a larger region so that the user's particular location cannot be determined.
Example Computing Device
• FIG. 2 illustrates a block diagram of anexample computing device200 that generates composite images. Thecomputing device200 may be amessaging server101 or a user device115. Thecomputing device200 may include aprocessor235, amemory237, acommunication unit239, adisplay241, aspeaker243, asensor245, and astorage device247. Additional components may be present or some of the previous components may be omitted depending on the type ofcomputing device200. For example, if thecomputing device200 is themessaging server101, thecomputing device200 may not include thedisplay241, thespeaker243, or thesensor245. Amessaging application103 may be stored in thememory237. In implementations where thecomputing device200 is a wearable device, thecomputing device200 may not includestorage device247. In some implementations, thecomputing device200 may include other components not listed here, such as a battery, etc. The components of thecomputing device200 may be communicatively coupled by abus220.
• Theprocessor235 includes an arithmetic logic unit, a microprocessor, a general purpose controller or some other processor array to perform computations and provide instructions to a display device.Processor235 processes data and may include various computing architectures including a complex instruction set computer (CISC) architecture, a reduced instruction set computer (RISC) architecture, or an architecture implementing a combination of instruction sets. AlthoughFIG. 2 includes asingle processor235,multiple processors235 may be included. Other processors, operating systems, sensors, displays and physical configurations may be part of thecomputing device200. Theprocessor235 is coupled to thebus220 for communication with the other components viasignal line222.
• Thememory237 stores instructions that may be executed by theprocessor235 and/or data. The instructions may include code for performing the techniques described herein. Thememory237 may be a dynamic random access memory (DRAM) device, a static RAM, or some other memory device. In some implementations, thememory237 also includes a non-volatile memory, such as a (SRAM) device or flash memory, or similar permanent storage device and media including a hard disk drive, a compact disc read only memory (CD-ROM) device, a DVD-ROM device, a DVD-RAM device, a DVD-RW device, a flash memory device, or some other mass storage device for storing information on a more permanent basis. Thememory237 includes code and routines operable to execute themessaging application103, which is described in greater detail below. Thememory237 is coupled to thebus220 for communication with the other components viasignal line224.
• Thecommunication unit239 transmits and receives data to and from at least one of the user device115 and themessaging server101 depending upon where themessaging application103 may be stored. In some implementations, thecommunication unit239 includes a port for direct physical connection to thenetwork105 or to another communication channel. For example, thecommunication unit239 includes a universal serial bus (USB), secure digital (SD), category 5 cable (CAT-5) or similar port for wired communication with the user device115 or themessaging server101, depending on where themessaging application103 may be stored. In some implementations, thecommunication unit239 includes a wireless transceiver for exchanging data with the user device115,messaging server101, or other communication channels using one or more wireless communication methods, including IEEE 802.11, IEEE 802.16, Bluetooth® or another suitable wireless communication method. Thecommunication unit239 is coupled to thebus220 for communication with the other components viasignal line226.
• In some implementations, thecommunication unit239 includes a cellular communications transceiver for sending and receiving data over a cellular communications network including via short messaging service (SMS), multimedia messaging service (MMS), hypertext transfer protocol (HTTP), direct data connection, e-mail or another suitable type of electronic communication. In some implementations, thecommunication unit239 includes a wired port and a wireless transceiver. Thecommunication unit239 also provides other conventional connections to thenetwork105 for distribution of files and/or media objects using standard network protocols including, but not limited to, user datagram protocol (UDP), TCP/IP, HTTP, HTTP secure (HTTPS), simple mail transfer protocol (SMTP), SPDY, quick UDP internet connections (QUIC), etc.
• Thedisplay241 may include hardware operable to display graphical data received from themessaging application103. For example, thedisplay241 may render graphics to display an overlay and a resulting composite image. Thedisplay241 is coupled to thebus220 for communication with the other components viasignal line228.
• Thespeaker243 may include hardware operable to emit noises. For example, in response to a user performing an action, theaction module206 may instruct thespeaker243 to emit a sound. The speaker is coupled to thebuss220 for communication with the other components viasignal line230.
• Thesensor245 may include hardware operable to detect changes to the user device115. For example, thesensor245 may include motion sensors that measure movement of thecomputing device200. For example, thesensor245 may include an accelerometer and a gyroscope that detect acceleration forces and rotational forces along the x, y, and z-axes. Thesensor245 may also include position sensors that measure the physical position of the user device115, such as orientation sensors and magnetometers. Thesensor245 may also include hardware that detects sounds and/or pressure changes, such as a microphone that detects changes in airflow when a user blows on thecomputing device200. Thesensor245 is coupled to thebus220 for communication and with the other components viasignal line232. Thesensor245 may detect contact on a touch screen of thecomputing device200. For example, thesensor245 may detect a user's finger touching the touch screen and movement of the user's finger.
• Thestorage device247 may be a non-transitory computer-readable storage medium that stores data that provides the functionality described herein. In implementations where thecomputing device200 is themessaging server101, thestorage device247 may include thedatabase199 inFIG. 1. Thestorage device247 may be a DRAM device, a SRAM device, flash memory or some other memory device. In some implementations, thestorage device247 also includes a non-volatile memory or similar permanent storage device and media including a hard disk drive, a CD-ROM device, a DVD-ROM device, a DVD-RAM device, a DVD-RW device, a flash memory device, or some other mass storage device for storing information on a permanent basis. Thestorage device247 is coupled to thebus220 for communication with the other components viasignal line234.
• Themessaging application103 may include amessaging module202, an animation module204, anaction module206, and auser interface module208.
• Themessaging module202 generates a messaging stream. In some implementations, themessaging module202 includes a set of instructions executable by theprocessor235 to generate the messaging stream. In some implementations, themessaging module202 is stored in thememory237 of thecomputing device200 and can be accessible and executable by theprocessor235.
• In some implementations, themessaging module202 generates a messaging stream that includes data sent to and from users and chat bots, for example, by sending data to a user device115, amessaging server101, and/or asecond server120. The messaging stream may include one or more messages where the messages have certain characteristics, such as a sender; a recipient; and message content including text, an animated object, images, video, and message metadata. The message metadata may include a timestamp, an originating device identifier, an expiration time, a retention time, various formats and effects applied, etc. In some implementations, the messaging stream includes a displayed messaging stream that includes messages displayed in chronological order within a user interface with various formats and effects applied.
• The messaging stream may be used as part of different messaging platforms, such as part of an instant messaging application, a short-message service (SMS), an email application, an enhanced-message service (EMS), a multimedia-message service (MMS), push messaging (e.g., HDML, WAP push, etc.), application-to-application messaging, etc. The messages may be available for a limited amount of time, archived for an indeterminate time, etc. The messages may be encrypted. In some implementations, themessaging module202 generates messages that are independent of the animated objects and inaccessible to the animated objects. In some implementations, the messages are available to the animated objects and are used to modify the display of the animated objects, for example, when an animated object appears to react to content in a message.
• In some implementations, themessaging module202 instructs theuser interface module208 to generate a user interface that includes the messaging stream. The user interface may include fields for entering text, videos, images, emojis, etc. Themessaging module202 receives messages between users and instructs theuser interface module208 to display the messages in the messaging stream. For example, user125aenters text via the user interface that says “Hey Carl!” Themessaging module202 on the user device115atransmits the message touser125nand the message is displayed on theuser device115n. In some implementations, the message is transmitted from the user device115ato themessaging server101, which transmits the message to theuser device115n.
• The animation module204 generates animated objects. In some implementations, the animation module204 includes a set of instructions executable by theprocessor235 to generate the animated object. In some implementations, the animation module204 is stored in thememory237 of thecomputing device200 and can be accessible and executable by theprocessor235.
• In some implementations, the animation module204 generates a group of animated objects. The animated objects may include cartoons; caricatures of people (famous people, avatars, generic people, etc.), animals (e.g., a bear), inanimate objects (e.g., a cookie); abstract moving objects (e.g., a swirling pattern with eyes and a mouth); etc.
• The animation module204 may instruct theuser interface module208 to provide the group of animated in a user interface. The animation module204 may organize the group of animated objects according to type and instruct theuser interface module208 to display an organized group of animated objects from which the user may select an animated object.
• In some implementations, the animation module204 may instruct theuser interface module208 to display options for customizing an animated object. For example, the user interface may include options for selecting a color or a size of an animated object. In some implementations, the options for customizing the animated object may be specific to the type of animated object. For example, the user interface may include an option to select an eye color for animated objects that have eyes. In some implementations, the user interface may include options for limiting the amount of information and/or actions available to the animated object. For example, the user interface may include options for disabling certain behaviors, such as nodding or producing a sound. In another example, the user interface may include options for disabling certain types of actions based on privacy concerns, such as disabling context-based animations that react based on words in the messages, while retaining animations that are in response to explicit user input, such as a user shaking thecomputing device200.
• In some implementations, the animation module204 may instruct theuser interface module208 to provide a group of animated objects that are different depending on the type ofcomputing device200 being used to select an animated object. For example, where thecomputing device200 is a smart watch, the group may include a subset of the animated objects that may be appropriate for the display on the smart watch. In some implementations, the group of animated objects may include different versions that are used for different devices. An animated object may include a complicated version for a desktop computer, a simpler version for a mobile device, and a more simple version for a smart watch. For example, an animated object on the desktop may include a cartoon of a man with a background scene, the animated object on the mobile device may include the cartoon of the man, and the animated object on the smart watch may include a cartoon of the man's face.
• In some implementations, the animation module204 may instruct acomputing device200 to provide different attributes of the animated object based on the type ofcomputing device200. For example, for a single animated object, the animation module204 may instruct acomputing device200 that corresponds to a smart watch to provide vibrations and/or a sound, acomputing device200 that corresponds to a mobile device to provide a visual display, and acomputing device200 that corresponds to virtual reality goggles to provide a three-dimensional rendition of the user interface. The three-dimensional rendition may including placing the animated object at different depths in the user interface.
• The animation module204 receives a selection of an animated object from a user. The animation module204 generates the animated object and instructions theuser interface module208 to display the animated object in the messaging stream. Theuser interface module208 may display the animated object in different parts of the messaging stream. For example, theuser interface module208 may display the animated object at the top of the user interface, at the bottom of the user interface or in the middle of the user interface. In another example, theuser interface module208 may display the one or more messages within the messaging stream while the animated object remains fixed in a portion of the messaging stream. In yet another example, theuser interface module208 may display the animated object according to a time that the first user selected the animated object so that the animated object is located after content that was provided before the animated object was selected and before content that is provided after the animated object was selected. In yet another example, theuser interface module208 may display the animated object in random locations. Theuser interface module208 may also change the location of the animated object based on actions performed by a user, as described in greater detail below.
• Theuser interface module208 displays the animated object within the user interface for each person that is viewing the same messaging stream. For example, the messaging stream may be viewed by a single user that is making notes for himself, the messaging stream may be viewed by a first user and a second user, or the messaging stream may be viewed by a group of users. In some implementations, theuser interface module208 places the animated object in different locations based on characteristics associated with different users. For example, a first user may provide user input that the first user prefers to see the animated object at the bottom right-hand part of the screen. In another example, the animated object may be located in the center of the messaging stream for users from a group that interact with the animated object and at the top left of the messaging stream for users that have not interacted with the animated object. In some implementations, the animated object is displayed differently depending on the position of the animated object in the messaging stream and/or the time the animated object has been displayed and/or how long since a user action associated with the animated object occurred.
• In some implementations, the animated object may look different to multiple users that are viewing the same messaging stream based on metadata associated with each of the users. The metadata may include a time of day associated with a user device, a location associated with a user device, a time zone associated with a user device, user preferences associated with a user, etc. The animation module204 may obtain information from thesensor245 to determine information from the metadata. For example, the animation module204 may determine the user's location, if the user has contented to such a determination by the animation module204, based on asensor245 that provides global positioning system (GPS) information. The animation module204 may modify an animated object based on the metadata. For example, where the animated object is an animation of a person, the person may wear shorts if the user is located in an area with warm weather, a jacket if the user is located in an area with cold weather, etc. The animation module204 may display the animation of the person with different clothing or different behavior based on the time of day of the user. For example, the animation module204 may display the animation of the person in pajamas and the animation may fall asleep if the time of day of the user is at night. In some implementations, upon consent of the user, the animation module204 may modify the animated object based on user data. For example, the animation module204 may instruct theuser interface module208 to display the animated object with an alarm that goes off when the user has configured an alarm on thecomputing device200, the animated object may display a countdown associated with a timer that the user configured on thecomputing device200, the animated object may display an upcoming calendar event based on a calendar entry based on information associated with thesecond server120, etc.
• In some implementations, the animation module204 instructs theuser interface module208 to provide the second user with set of animated objects based on their relationships to the first animated object. For example, where the first animated object conveys a message, such as “I'll be home soon,” the set of animated objects may include responses to the message. Theuser interface module208 may replace a first animated object with the second animated object or the second animated object may be displayed in the same messaging stream as the first animated object. In some implementations, the first animated object and the second animated object interact with each other.
• Theaction module206 modifies the animated object based on a user action. In some implementations, theaction module206 includes a set of instructions executable by theprocessor235 to modify the animated object. For example, theaction module206 may program the animated object (e.g., the animated object may include stored code or a prerecorded animation) to react to the user action. In some implementations, theaction module206 is stored in thememory237 of thecomputing device200 and can be accessible and executable by theprocessor235.
• Theaction module206 receives a first action from a first user related to the animated object. Theaction module206 determines a type of action that occurred and instructs theuser interface module208 to modify a display of the animated object based on the action. For example, when the first user taps on an animated object, theaction module206 instructs theuser interface module208 to display hearts coming off of the animated object. In some implementations, the users that view the same messaging stream will see the hearts coming off of the animated object. Theaction module206 receives a second action from a second user related to the animated object. For example, the second user makes a swiping motion, which theaction module206 detects. Theaction module206 instructs theuser interface module208 to modify the display based on the second action. Continuing with the example above, theaction module206 instructs theuser interface module208 to display the animated objects as grabbing the hearts with the animated object's mouth.FIGS. 3A-3J below provide an example of different user actions that cause theaction module206 to determine an action and theuser interface module208 to modify a display of the animated object based on the action.
• The actions may include taps, swipes, making noise, changing pressure, moving a pointing device (e.g., a mouse moving an arrow), moving thecomputing device200, capturing an image, providing a message with a context, providing a message with a word in the message, providing voice content, selecting options provided by the user interface, selecting another animated object, etc.
• Turning toFIG. 3A, anexample user interface300 is illustrated of a messaging stream that includes an animated cookie according to some implementations. In this example, the messaging stream may include alist301 of the users that are participating in the messaging stream. A first user may be associated with a first user icon302 in the messaging stream. The first user may select ananimated cookie303 as the animated object and theuser interface module208 may display theanimated cookie303 within aword bubble304.
• FIG. 3B illustrates anexample user interface310 of a messaging stream that includes theanimated cookie303 with eyes that follow acursor311 controlled by a pointing device that is controlled by a first user according to some implementations. In this example, theuser interface module208 illustrates thecursor311 with a circle; however, other variations are possible, such as an arrow, a rectangle, etc. Theaction module206 determines that a pointing device is moved above the location of theanimated cookie303 in the user interface. This is illustrated inFIG. 3B with thecursor311 above theanimated cookie303. Theaction module206 instructs theuser interface module208 to modify a display of theanimated cookie303. For example, theanimated cookie303 is updated to show animated eyes that move and track the movement of thecursor311 as thecursor311 moves above theanimated cookie303.
• Theanimated cookie303 may follow the location of thecursor311 with the same speed of movement as thecursor311. For example, if thecursor311 moves up and down quickly, theanimated cookie303 may include eyes that are animated to look up and down as quickly as thecursor311. In some implementations, moving the cursor311 a particular speed could cause the animated object to react. In this example, moving thecursor311 around theanimated cookie303 several times may cause theanimated cookie303 to look dizzy, for example, by depicting stars floating around theanimated cookie303.
• FIG. 3C illustrates anexample user interface320 of a messaging stream that includes theanimated cookie303 that is viewable by multiple users according to some implementations. In this example, the second user is associated with asecond user icon321 in the messaging stream. Theanimated cookie303 remains in the same location because theanimated cookie303 is part of theword bubble304.
• FIG. 3D illustrates anexample user interface330 of a messaging stream that includes theanimated cookie303 with eyes that follow a pointing device331 controlled by the second user according to some implementations. In this example, theaction module206 determines a location of thecursor311 and theuser interface module208 modifies the display of theanimated cookie303 to look above and to the left of where thecursor311 is located.
• The second user moves thecursor311 to theanimated cookie303 in order to move the animated cookie. In this example, theuser interface module208 also includes informative text below thesecond icon321 to inform the users that the second user is moving theanimated cookie303.
• FIG. 3E illustrates anexample user interface340 of a messaging stream that includes theanimated cookie303 that reacts to being moved according to some implementations. In this example, as the second user moves theanimated cookie303, theuser interface module208 modifies the display of theanimated cookie303 to look as though thecursor311 is tickling theanimated cookie303 by modifying theanimated cookie303 to have scrunched up eyes and a pursed smiling mouth. Because the second user moved theanimated cookie303 outside of the word bubble associated with the first user, theuser interface module208 creates athird icon341 associated with the first user that indicates that the first user created the animated cookie by calling theanimated cookie303 an active sticker. The second user may move theanimated cookie303 anywhere within the messaging stream. In some implementations, the animated cookie stays fixed wherever a user places it.
• FIG. 3F illustrates anexample user interface350 of a messaging stream that includes ananimated cookie303 that reacts to being placed according to some implementations. Theuser interface module208 illustrates theanimated cookie303 as continuing to laugh as if he was tickled by the pointing device. Theuser interface module208 also modifies the text below thesecond icon321 to inform the other users that the second user placed theanimated cookie303.
• FIG. 3G illustrates anexample user interface360 of a messaging stream that includes ananimated cookie303 with eyes that move to view text displayed within the messaging stream according to some implementations. Theaction module206 determines that the first user entered text within the messaging stream. Theuser interface module208 modifies theanimated cookie303 to move the eye to look downward as if theanimated cookie303 is reading the text. In some implementations, theanimated cookie303 may not access the content of the text, but instead merely reacts to the appearance of text. In some implementations, upon user consent, theanimated cookie303 has access to the text. This feature may be disabled, for example, if the user declines permission for theaction module206 to detect that the user entered text or received a message.
• FIG. 3H illustrates anexample user interface370 of a messaging stream that includes ananimated cookie303 that stays in a fixed location within the messaging stream according to some implementations. As more messages are added within the messaging stream, the messages scroll upward. Since theanimated cookie303 is placed in a fixed position, it stays within the center of the messaging stream.
• FIG. 3I illustrates anexample user interface380 of a messaging stream that includes ananimated cookie303 that reacts to a word in themessage381, if the users participating in the messaging stream provide consent to access the messages exchanged in the messaging stream, according to some implementations. In this example, the first user provides a message that states “Oh! I have to go . . . chat later.” Based upon user consent to access the message, theaction module206 determines that the words “I have to go . . . chat later” indicate that the first user is about to end the chat. Theaction module206 may determine a reaction for theanimated cookie303 based on themessage381 by using machine learning, comparing words in the message to lists of words associated with different contexts, etc. For example, such a determination may be made by a comparison of one or more of the words with words known to be associated with ending a chat, e.g., based upon prior training data, based upon clustering previous messages, etc. Theuser interface module208 modifies the display of theanimated cookie303 to start to fall asleep (e.g., by illustrating droopy eyes) based on the first user's message.
• FIG. 3J illustrates anexample user interface390 of a messaging stream that includes theanimated cookie303 that continues to react to the word within the message according to some implementations. Theaction module206 determines, when consent is provided by the second user for access to messages in the messaging stream, that the second user is also about to leave the messaging stream based on the words associated with the second user stating “Ok!Bye.” Based on theaction module206 determining a meaning of the words, theuser interface module208 modifies the display of theanimated cookie303 to fall asleep (e.g., by displaying theanimated cookie303 saying “ZZZ”).
• In some implementations, the action from the user includes the user blowing on acomputing device200. For example, the user could blow on a mobile device or blow while wearing a headset. Thesensor245 may include a microphone that detects a change in airflow and transmits information about the change in airflow to theaction module206. Theaction module206 may determine a degree of the change in airflow and theaction module206 instructs theuser interface module208 to move the animated object based on the degree of the change in airflow. For example, the animated object may be a box of tissues and blowing on thecomputing device200 causes the tissues to move out of the box of tissues. If the user blows slightly on thecomputing device200, it causes a few of the tissues from the box of tissues to come out of the box. If the user blows hard on thecomputing device200, it causes several of the tissues from the box of tissues to come out of the box. In another example, the animated object is a character, such as a cartoon fox, and blowing on thecomputing device200 causes the fox to hang on to the side of the messaging stream window and hold on. In yet another example, the animated object is a bubble and blowing on thecomputing device200 makes the bubble increase in size corresponding to the extent of the first user blowing on thecomputing device200.
• In some implementations, the action from the user includes moving thecomputing device200. Theaction module206 may receive information from a sensor245 (e.g., an accelerometer or a gyroscope) and determine a degree of the movement. Theaction module206 may instruct theuser interface module208 to illustrate the animated object with additional changes. For example, the user shaking the user's smart watch or other mobile device causes theaction module206 to instruct theuser interface module208 to illustrate items moving, such as snow falling from the sky, nuts and bolts coming loose, a character's hair becoming disarrayed, the character shaking a fist at a user, etc. In another example, when the user moves thecomputing device200 to the user's ear, theaction module206 may receive information from thesensor245 indicating that the user moved thecomputing device200 to the user's ear and instruct thespeaker243 to emit a noise. In some examples, the animated object emits a different noise depending on how thecomputing device200 is moved, such as a yip if the user moves thecomputing device200 to the user's left ear and a bark if the user moves thecomputing device200 to the user's right ear.
• Turning toFIG. 4A, anexample user interface400 of a messaging stream is illustrated that includes ananimated bear405 according to some implementations. A first user may select ananimated bear405 and place theanimated bear405 in the center of the messaging stream below the messages. Upon user consent, theaction module206 may identify that Steve provided a message stating “There might be bears at that picnic spot.” Theaction module206 may instruct theuser interface module208 to modify the display of the bear by animating the animated bear's405 eyes to move back and forth to give the appearance that theanimated bear405 is reading the text.
• FIG. 4B illustrates anexample user interface425 of the messaging stream that includes theanimated bear430 after a user performed a user action according to some implementations. For example, the second user may turn the user device115 upside down. Theaction module206 receives information from asensor245 and determines that the degree of the movement of the user device115 is 180 degrees. Theaction module206 instructs theuser interface module208 to modify the display to show theanimated bear430 as upside down.
• In another example, theaction module206, upon user consent, may identify that Karen responded to Steve with “We'll fight them off!” Theaction module206 determines that fight is an instruction associated with theanimated bear430 and instructs theuser interface module206 to modify the display of theanimated bear430 to show theanimated bear430 initially fighting and then falling upside down.
• In some implementations, the action from the user includes movement within the messaging stream. The movement may be the user touching a touch screen of a mobile device or movement of a pointing device, such as a mouse. The animated object may be a character with eyes (e.g., a smiley face). Theaction module206 may receive information about the movement from the sensor245 (e.g. a touch screen), and determine the direction of the movement. Theaction module206 instructs theuser interface module208 to move the eyes of the animated object to correspond to the direction of the movement from the first user. In another example, the movement may stretch the animated object.
• Turning toFIG. 5A, anexample user interface500 of a messaging stream that includes animated bubbles is illustrated according to some implementations. The first user uses a pointing device associated with acomputing device200 to pull afirst arrow502 in a first direction. The second user uses a pointing device associated with anothercomputing device200 to pull asecond arrow503 in a second direction. Both thefirst arrow502 and thesecond arrow503 are pulling thebubble501 in a different direction. Theaction module206 identifies the first action and the second action as pulling thebubble501 in a tug of war by pulling in opposite directions.
• FIG. 5B illustrates theexample user interface525 of the messaging stream that includes the animated bubbles after two users performed user actions according to some implementations. Theaction module206 determines how much each of the users pulls the bubble with thefirst arrow502 and thesecond arrow503. In some implementations, theaction module206 applies animation rules to determine a winner of the tug of war by determining whether the first user or the second user first pulled the bubble a threshold number of pixels in the user interface. Other ways to determine a winner are possible, such as determining which user stretched the bubble a threshold pixel distance outside of a boundary.
• In some implementations, when participant users in the messaging stream consent to such use of messages, theaction module206 identifies a word in a message or a context of the messaging stream. Theaction module206 may compare words in a message to a list of words associated with different meanings, such as different emotions (e.g., happy, sad, angry, etc.), different states (e.g., about to end the chat), etc. Theaction module206 may use machine learning to predict a meaning associated with a user based on the message where the machine learning may be based on all messages available to theaction module206 or, subject to user content, the messages associated with a particular user. The context of the messaging stream may be based on user patterns, a time of day, a location of thecomputing device200, etc. and is determined only upon specific user consent to access such data. For example, where a user typically ends a messaging stream at the end of a workday. As a result, theaction module206 may instruct theuser interface module208 to modify a display of the animated object based on the context.
• In some implementations, theaction module206 may, responsive to user content, identify voice content from the user. Theaction module206 may convert the speech to text and identify an indent of the voice content. For example, theaction module206 may identify the user providing verbal instructions for an abstract animated object that includes “Jump around.” Based on the verbal content, theaction module206 instructs the user interface to modify the display of the abstract animated object to show it moving up and down.
• In some implementations, a first user may be a chat bot (e.g., an automated chat program) that provides services to a user. The animated object may be related to one or more messages exchanges between the chat bot and the user. For example, the user may instruct the chat bot to make a reservation, a purchase, etc. by entering a message. Theaction module206 may, upon user consent, instruct theuser interface module208 to modify the animated object based on the message. For example, if the user instructs the chat bot to make a reservation, the animated object includes a graphic associated with making a reservation.
• Turning toFIG. 6, anexample user interface600 of a messaging stream is illustrated that includes an animatedmoney transfer object601 according to some implementations. In this example, user Sara consents to the use of a chat bot to perform actions for her by instructing the Bankbot to pay off a credit card statement. The user provides amessage602 that states: “@Bankbot Pay off my credit card statement.” The Bankbot responds with amessage603 that states: “Confirmed. Payment posted.” Upon user consent for theaction module206 to access the user's message, theaction module206 determines that the user instructed the chat bot to transfer money from the user's account to a credit card company. Theaction module206 instructs theuser interface module208 to display an animatedmoney transfer object601 that shows money moving from a money bag to a credit card.
• In some implementations, various examples described above may be combined. For example, a messaging stream may include multiple users and a chat bot. Theaction module206 may detect a movement of a user on thecomputing device200 and instruct theuser interface module208 to modify a display of the animated object based on messages related to the chat bot and the movement of the user.
• Turning toFIG. 7A, anexample user interface700 of an animated takeout box is illustrated according to some implementations. In this example, Kira andSam exchange messages701 about ordering delivery food from Tasty Thai. The users also consent to the chatbot accessing their messages to help the users. A food ordering chatbot places the order and informs the users that the food will arrive in 40 minutes. The first user selects a takeout boxanimated object702, which theuser interface module208 displays in the messaging stream. The second user touches the takeout boxanimated object702 with afinger703. Theaction module206 detects movement of the second user'sfinger703 touching the animated object.
• FIG. 7B illustrates theexample user interface725 of the animated takeout box after a user performed a user action according to some implementations. Based on the second user touching the takeout boxanimated object702 inFIG. 7A, theaction module206 determines the type of action that occurred and instructs theuser interface module208 to modify the takeout box animated object to display an opened takeout boxanimated object726.
• In some implementations, the action may include a second user selecting a second animated object. The second animated object may be from a subset of animated objects based on its relationship to a first animated object. The second animated object may be selected from a group of all animated objects. In some implementations, theuser interface module208 modifies a display by showing the first animated object interacting with the second animated object. For example, the first animated object may be a fox with boxing gloves and the second animated object may be a kangaroo with boxing globes. Theuser interface module208 may display the two animated objects fighting with each other. In some implementations, the first user may control the first animated object and the second user may control the second animated object such that the first and second user engage in a boxing match using the two animated objects.
• In some implementations where multiple animated objects are displayed in the messaging stream, the animated objects react differently depending on how they were added to the messaging stream. Two animated objects may react differently depending on their proximity to each other and a length of time, such that animated objects that are close to each other react to each other more than animated objects that are far away from each other. For example, when two animated people are next to each other they look at each other and touch each other. When the two animated people are at opposite sides of the messaging stream, they wave every two minutes but otherwise do not interact.
• Theuser interface module208 generates a user interface. In some implementations, theuser interface module208 includes a set of instructions executable by theprocessor235 to generate the user interface. In some implementations, theuser interface module208 is stored in thememory237 of thecomputing device200 and can be accessible and executable by theprocessor235.
• In some implementations, theuser interface module208 receives instructions from the animation module204 to generate a user interface that includes a messaging stream. The user interface may include a group of animated objects for a first user to choose from. Theuser interface module208 may receive a selection from the first user of one of the animated objects. Theuser interface module208 displays the animated object in the messaging stream.
• Theuser interface module208 receives instructions from theaction module206 to modifying a display of the animated object based on a first action from the first user. For example, theuser interface module208 receives instructions to modify an animated object of marbles to show them rolling around the messaging stream based on movement of a computing device associated with the first user. Theuser interface module208 receives instructions from theaction module206 to modify the display of the animated object based on a second action from a second user. For example, theuser interface module208 receives instructions to show the marbles bouncing in the messaging stream based on the second user touching acomputing device200 associated with the second user to simulate the marbles bouncing within the messaging stream.
• In some implementations, theuser interface module208 provides a user interface that includes interactive features to change the appearance of the animated object. For example, theuser interface module208 provides a user interface that provides a scratchpad for drawing. The scratchpad may include a toolkit with various tools for drawing such as a pencil, a paintbrush, color options, etc. In another example, theuser interface module208 provides a user interface that includes an interactive keyboard for producing music, beeps, tones, etc. When a user touches a key on the keyboard, theaction module206 detect the touch and instructs thespeaker243 to emit a beep, tone, etc. In yet another example, theuser interface module208 provides a user interface that includes interactive graphics, such as charts, timelines, etc. where the user has options for changing the appearance of the interactive graphics.
• FIG. 8A illustrates anexample user interface800 of a messaging stream that includes an animated airplane according to some implementations. In this example, a first user selects an animated object of anairplane801, which represents a message to the second user that the first user is about to get on an airplane. The first user swipes across a screen of the smartwatch to cause theuser interface module208 to modify the display of theairplane801 to show theairplane801 moving across the screen. The animation module204 provides the second user with a set of animated objects based on their relationship to theairplane801. For example, the set of animated objects could be a hand waving, a thumbs up, and two people kissing. The second user selects the animated object of two people kissing.
• FIG. 8B illustrates anexample user interface825 of the messaging stream that includes ananimated couple826 that is displayed responsive to a user action related to the animated airplane according to some implementations. In this example, the user action is the second user selecting the animated object of the two people kissing.
Example Method
• FIG. 9 illustrates a flowchart of anexample method900 to generate a messaging stream that includes an animated object. Themethod900 is performed by amessaging application103 stored on acomputing device200, such as a user device115, amessaging server101, or in part a user device115 and in part amessaging server101.
• At block902, a messaging stream is generated where one or more messages are exchanged between a first user and a second user. For example, the first user and the second user send messages to each other using an instant messaging platform, via text, via SMS, etc. At block904, a selection is received of an animated object from the first user for the messaging stream. For example, the first user selects the animated object from a group of animated objects that are displayed for the first user's device. For example, the animated object is an animated version of a flamingo. The user may customize the animated object by choosing a color for the animated object, a style of eyes for the animated object, etc. Atblock906, the animated object is provided in the messaging stream. For example, theuser interface module208 displays the animated object in a default location, such as the center of the user interface.
• At block908, a first action is received from the first user related to the animated object. For example, theaction module206 detects the first user blowing into asensor245, such as a microphone, of thecomputing device200. Atblock910, a display of the animated object is modified based on the first action. For example, based on the first user blowing into thecomputing device200, theuser interface module208 modifies the display of the animated object to show the flamingo blowing around in the wind with his feathers flying.
• At block912, a second action is received from the second user related to the animated object. For example, the second user shakes the second user'scomputing device200. Atblock914, the display of the animated object is modified based on the second action. For example, the display is modified to show the flamingo bouncing up and down with movement corresponding to the shaking of the second user'scomputing device200.
• In the above description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the specification. It will be apparent, however, to one skilled in the art that the disclosure can be practiced without these specific details. In some instances, structures and devices are shown in block diagram form in order to avoid obscuring the description. For example, the implementations can be described above primarily with reference to user interfaces and particular hardware. However, the implementations can apply to any type of computing device that can receive data and commands, and any peripheral devices providing services.
• Reference in the specification to “some implementations” or “some instances” means that a particular feature, structure, or characteristic described in connection with the implementations or instances can be included in at least one implementation of the description. The appearances of the phrase “in some implementations” in various places in the specification are not necessarily all referring to the same implementations.
• Some portions of the detailed descriptions above are presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of steps leading to a desired result. The steps are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic data capable of being stored, transferred, combined, compared, and otherwise manipulated. It has proven convenient at times, principally for reasons of common usage, to refer to these data as bits, values, elements, symbols, characters, terms, numbers, or the like.
• It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the following discussion, it is appreciated that throughout the description, discussions utilizing terms including “processing” or “computing” or “calculating” or “determining” or “displaying” or the like, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission, or display devices.
• The implementations of the specification can also relate to a processor for performing one or more steps of the methods described above. The processor may be a special-purpose processor selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a non-transitory computer-readable storage medium, including, but not limited to, any type of disk including optical disks, ROMs, CD-ROMs, magnetic disks, RAMs, EPROMs, EEPROMs, magnetic or optical cards, flash memories including USB keys with non-volatile memory, or any type of media suitable for storing electronic instructions, each coupled to a computer system bus.
• The specification can take the form of some entirely hardware implementations, some entirely software implementations or some implementations containing both hardware and software elements. In some implementations, the specification is implemented in software, which includes, but is not limited to, firmware, resident software, microcode, etc.
• Furthermore, the description can take the form of a computer program product accessible from a computer-usable or computer-readable medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer-readable medium can be any apparatus that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
• A data processing system suitable for storing or executing program code will include at least one processor coupled directly or indirectly to memory elements through a system bus. The memory elements can include local memory employed during actual execution of the program code, bulk storage, and cache memories which provide temporary storage of at least some program code in order to reduce the number of times code must be retrieved from bulk storage during execution.
• In situations in which the systems discussed above collect or use personal information, the systems provide users with an opportunity to control whether programs or features collect user information (e.g., information about a user's social network, social actions or activities, profession, a user's preferences, or a user's current location), or control whether and/or how to receive content from the server that may be more relevant to the user. In addition, certain data may be treated in one or more ways before it is stored or used, so that personally identifiable information is removed. For example, a user's identity may be treated so that no personally identifiable information can be determined for the user, or a user's geographic location may be generalized where location information is obtained (such as to a city, ZIP code, or state level), so that a particular location of a user cannot be determined. Thus, the user may have control over how information is collected about the user and used by the server.

Claims (20)

What is claimed is:

1. A computer-implemented method comprising:

generating a messaging stream where one or more messages are exchanged between a first user and a second user;

receiving a selection of an animated object from the first user for the messaging stream;

providing the animated object in the messaging stream;

receiving a first action from the first user related to the animated object;

modifying a display of the animated object based on the first action;

receiving a second action from the second user related to the animated object; and

modifying the display of the animated object based on the second action.

2. The method ofclaim 1, wherein receiving the first action from the first user includes detecting a change in airflow near a microphone associated with a user device.

3. The method ofclaim 1, wherein receiving the first action from the first user includes detecting movement of a finger on a touch screen or detection of movement of a pointing device.

4. The method ofclaim 1, wherein receiving the first action from the first user includes detecting movement of a user device based on information received from a sensor associated with the user device.

5. The method ofclaim 1, wherein:

receiving the first action from the first user includes receiving a message from the first user and determining a context from the messaging stream; and

modifying the display of the animated object based on the first action includes modifying the display of the animated object based on the context from the messaging stream.

6. The method ofclaim 1, wherein the first action is pulling the animated object in a first direction and the second action is pulling the animated object in a second direction.

7. The method ofclaim 1, further comprising:

displaying the one or more messages within the messaging stream while the animated object remains fixed in a portion of the messaging stream.

8. The method ofclaim 1, wherein the first user is a chat bot and the animated object is related to the one or more messages exchanged between the first user and the second user.

9. The method ofclaim 1, wherein the display of the animated object is modified based on at least one of a word in the one or more messages, voice content, and a context of the messaging stream.

10. The method ofclaim 1, further comprising:

identifying a set of objects to provide as options to the first user based on a type of user device on which the messaging stream is displayed, wherein the animated object is part of the set of objects.

11. A non-transitory computer readable medium with instructions stored thereon that, when executed by one or more computers, cause the one or more computers to perform operations, the operations comprising:

generating a messaging stream where one or more messages are exchanged between a first user and a second user;

receiving a selection of an animated object from the first user for the messaging stream;

causing a version of the animated object to be displayed based on a type of user device on which the animated object is displayed;

receiving an action from the second user related to the animated object; and

in response to receiving the action, modifying the display of the animated object.

12. The computer storage medium ofclaim 11, wherein the selection is a first selection and the animated object is a first animated object and further comprising:

providing the second user with a set of animated objects based on their relationship to the first object;

receiving a second selection of a second animated object from the set of animated objects; and

in response to the receiving the second selection, providing the second object in the messaging stream.

13. The computer storage medium ofclaim 11, wherein the version of the animated object to be displayed based on the type of user device on which the animated object is displayed includes a complicated version for a desktop computer, a simpler version for a mobile device, and a more simple version for a smart watch.

14. The computer storage medium ofclaim 11, wherein receiving the action from the second user includes detecting a change in airflow near a microphone associated with a user device.

15. The computer storage medium ofclaim 11, wherein:

the selection is a first selection;

the animated object is a first animated object;

the action from the second user includes a second selection of a second animated object from the second user for the messaging stream; and

modifying the display of the first animated object includes the first animated object interacting with the second animated object.

16. A system comprising:

one or more processors; and

a memory that stores instructions executed by the one or more processors, the instructions comprising:

generating a messaging stream where one or more messages are exchanged between a first user and a second user;

receiving a selection of an animated object from the first user for the messaging stream;

providing the animated object in the messaging stream;

receiving a first action from the first user related to the animated object;

modifying a display of the animated object based on the first action;

receiving a second action from the second user related to the animated object; and

modifying the display of the animated object based on the second action.

17. The system ofclaim 16, wherein receiving the first action from the first user includes detecting a change in airflow near a microphone associated with a user device.

18. The system ofclaim 16, wherein receiving the first action from the first user includes detecting movement of a finger on a touch screen or detection of movement of a pointing device.

19. The system ofclaim 16, wherein receiving the first action from the first user includes detecting movement of a user device based on information received from a sensor associated with the user device.

20. The system ofclaim 16, wherein:

receiving the first action from the first user includes receiving a message from the first user and determining a context from the messaging stream; and

modifying the display of the animated object based on the first action includes modifying the display of the animated object based on the context from the messaging stream.

Images