US20160299658A1 - Capturing and sending multimedia as electronic messages - Google Patents

Abstract

One or more embodiments described herein include methods and systems of capturing and sending multimedia content items as electronic message. More specifically, systems and methods described herein provide users the ability to easily and effectively capture multimedia content items for inclusion in a communication session without navigating away from the communication session. Additionally, systems and methods described herein allow a multimedia content item to be sent to one or more co-users immediately following the capture of the multimedia content item without further user interaction. In other words, the system and methods can capture and automatically send a multimedia content item in response to a single user interaction.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
• The present application is a continuation of U.S. application Ser. No. 14/314,623, filed Jun. 25, 2014, which claims priority to and the benefit of U.S. Provisional Application No. 61/985,456 filed Apr. 28, 2014. The entire contents of the foregoing application are hereby incorporated by reference in their entirety.
BACKGROUND
• 1. Technical Field
• One or more embodiments relate generally to electronic messaging systems and methods. More specifically, one or more embodiments relate to systems and methods for increasing functionality in an electronic messaging system.
• 2. Background and Relevant Art
• Computing devices (e.g., computers, tablets, and smart phones) provide numerous ways for people to connect and communicate with one another. For example, a variety of electronic messaging systems provide various methods to send and receive electronic messages. For instance, a computing device can allow a user to communicate with other users using text messaging, instant messaging, social network posting, and other forms of electronic communication. In addition, an electronic communication may include a variety of content including text, images, video, audio, and/or other multimedia. In general, electronic communication has become a popular way for people to connect and communicate with one another.
• Including multimedia in electronic communications has become an especially popular way to add humor, context, and information to an electronic communication session. For example, a user may send a digital photograph to a co-user indicating his location. Similarly, a user may send a video laughing in response to an electronic message that includes a joke. Thus, including multimedia is an easy way to add a layer of expression to an electronic communication session that is typically difficult with only textual electronic messages.
• Conventional processes for including multimedia in an electronic communication are generally problematic. For example, a user typical navigates away from an electronic communication interface in order to capture a digital photograph or video for inclusion in an electronic communication session. Navigating away from the electronic communication interface, however, can cause a user to miss messages or otherwise make adding a multimedia content item time consuming and frustrating for a user.
• Additionally, capturing a multimedia content item and including the multimedia content item in an electronic communication is a process that typically includes multiple user interactions. For example, generally a user interacts with a user interface in order to transition from an electronic communication interface to a camera viewfinder interface. More user interactions are generally required to capture the multimedia content item (i.e., photograph or video), transition back to the electronic communication interface, and finally send the multimedia content item to a co-user as part of an electronic communication. The multiple user interactions typically needed to capture multimedia and include the captured multimedia in an electronic communication add extra steps and hassle to the process of composing an electronic communication.
• Thus, there are several disadvantages to current methods for capturing and sending multimedia in a messaging application.
SUMMARY
• One or more embodiments provide benefits and/or solve one or more of the foregoing or other problems in the art with methods and systems that provide enhanced features for electronic messaging systems. For example, methods and systems described herein allow users greater functionality for including multimedia content items in an electronic communication session. Furthermore, one or more embodiments can provide the foregoing or other benefits easily and intuitively through a single user interface of the electronic messaging system.
• In addition to the foregoing, systems and methods of one or more embodiments allow a user to capture electronic multimedia without transitioning away from the electronic messaging system. For example, in one or more embodiments, a user interface of the electronic messaging system displays both a communication thread with electronic messages sent between co-users and a camera viewfinder allowing a user to frame and capture electronic multimedia (e.g., a photograph or video). Thus, a user may capture electronic multimedia without navigating away from the communication thread.
• Furthermore, systems and methods of one or more embodiments allow a user to capture electronic multimedia without requiring surplus user interactions. For example, in one or more embodiments, a user may send electronic multimedia (i.e., a photograph or video) automatically upon capturing the electronic multimedia. Thus, one or more embodiments can foster spontaneous, speedy, unrehearsed or edited communication.
• Additional features and advantages of the present invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of such exemplary embodiments. The features and advantages of such embodiments may be realized and obtained by means of the instruments and combinations particularly pointed out in the appended claims. These and other features will become more fully apparent from the following description and appended claims, or may be learned by the practice of such exemplary embodiments as set forth hereinafter.
BRIEF DESCRIPTION OF THE DRAWINGS
• In order to describe the manner in which the above recited and other advantages and features can be obtained, a more particular description of the aspects of one or more embodiments briefly described above will be rendered by reference to specific embodiments thereof that are illustrated in the appended drawings. It should be noted that the figures are not drawn to scale, and that elements of similar structure or function are generally represented by like reference numerals for illustrative purposes throughout the figures. Understanding that these drawings depict only typical embodiments and are not therefore to be considered to be limiting of scope, one or more embodiments of the invention will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
• FIG. 1 illustrates a schematic diagram of an electronic messaging system in accordance with one or more embodiments;
• FIG. 2 illustrates a block diagram of an environment for implementing the system ofFIG. 1 in accordance with one or more embodiments;
• FIGS. 3A-3E illustrate user interfaces for capturing and sending a multimedia content item in accordance with one or more embodiments;
• FIGS. 4A-4G illustrate user interfaces for capturing and sending a multimedia content item in accordance with one or more embodiments;
• FIG. 5 illustrates a flowchart of a series of acts in a method of capturing and sending multimedia content items as electronic messages in accordance with one or more embodiments;
• FIG. 6 illustrates a flowchart of a series of acts in another method of capturing and sending multimedia content items as electronic messages in accordance with one or more embodiments;
• FIG. 7 illustrates a block diagram of an exemplary computing device in accordance with one or more embodiments; and
• FIG. 8 is an example network environment of a social networking system in accordance with one or more embodiments.
DETAILED DESCRIPTION
• One or more embodiments include an electronic messaging system that provides users with efficient and effective user experiences when sending multimedia content items as electronic messages. More specifically, one or more embodiments described herein allow users to easily and intuitively create multimedia content items for sending as an electronic message. In particular, the electronic messaging system described herein can allow a user to quickly and easily create and send a digital photograph or digital video as a message.
• Furthermore, the electronic messaging system can allow a user to create a digital photograph or digital video without navigating away from a communication thread. For example, one or more embodiments provide a user interface containing a communication thread as well as a camera viewfinder. Thus, one or more embodiments allow a user to capture multimedia while simultaneously receiving and reading messages.
• Furthermore, systems and methods of one or more embodiments allow a user to capture electronic multimedia without requiring surplus user interactions. For example, the electronic messaging system may capture different types of multimedia via the camera viewfinder in response to different types of user input. Additionally, the electronic messaging system may capture a digital photograph via the camera viewfinder in response to a detected tap touch gesture. Additionally, the electronic messaging system may capture a digital video via the camera viewfinder in response to a detected press-and-hold touch gesture.
• One or more embodiments automatically add the captured multimedia to the communication thread immediately upon completion of the user interaction used to capture the multimedia. For example, the electronic messaging system may add a captured digital photograph to the communication thread immediately following a detected tap touch gesture used to capture the digital photograph. Additionally, the electronic messaging system may add a captured digital video to the communication thread immediately upon a detected release of a press-and-hold touch gesture used to capture the digital video. Thus, one or more embodiments can foster spontaneous, speedy, unrehearsed or edited communication.
• FIG. 1 illustrates an example embodiment of anelectronic messaging system100. As shown, theelectronic messaging system100 may include, but is not limited to, a user interface manager102 (or simply “UI manager”), a user input detector104, amultimedia manager106, acommunication manager108, and adata storage110. Each of the components102-110 of theelectronic messaging system100 may be in communication with one another using any suitable communication technologies. Although the disclosure herein shows the components102-110 to be separate inFIG. 1, any of the components102-110 may be combined into fewer components, such as into a single facility or module, or divided into more components as may serve one or more embodiments. In addition, the components102-110 may be located on, or implemented by, one or more computing devices, such as those described below in relation toFIG. 7. Alternatively, portions of theelectronic messaging system100 can be located on a computing device, while other portions of theelectronic messaging system100 are located on, or form part of, a social networking system, such as that described below in reference toFIG. 8.
• The components102-110 can comprise software, hardware, or both. For example, the components102-110 can comprise one or more instructions stored on a computer readable storage medium and executable by a processor of one or more computing devices. When executed by the one or more processors, the computer-executable instructions of theelectronic messaging system100 can cause a computing device(s) to perform the methods described herein. Alternatively, the components102-110 can comprise hardware, such as a special-purpose processing device to perform a certain function. Additionally or alternatively, the components102-110 can comprise a combination of computer-executable instructions and hardware.
• As mentioned above, and as shown inFIG. 1, theelectronic messaging system100 can include a user interface manager102. The user interface manager102 provides, manages, updates, and/or controls graphical user interfaces (or simply “user interfaces”) that allow a user to view and interact with display elements. For example, the user interface manager102 may identify, display, update, or otherwise provide various user interfaces that contain one or more display elements in various layouts.
• More specifically, the user interface manager102 can display a variety of display elements within a graphical user interface. For example, the user interface manager102 may display a graphical user interface on a display of a computing device. For instance, display elements include, but are not limited to: buttons, text boxes, menus, thumbnails, scroll bars, hyperlinks, etc. In one or more embodiments, the user interface manager102 can display and format display elements in any one of a variety of layouts.
• Furthermore, the user interface manager102 can also update, remove, resize, or reposition display elements in response to user interactions. For example, as will be described in more detail below, theelectronic messaging system100 may detect user input in a variety of ways. For instance, in one or more embodiments, the detected user input may cause the user interface manager102 to update a graphical user interface based on the detected input. Similarly, in one or more embodiments, the detected user input may cause the user interface manager102 to resize one or more display elements, to reposition one or more display elements within the graphical user interface, or to otherwise change or remove one or more display elements within the graphical user interface.
• Additionally, the user interface manager102 can selectively update certain areas of a user interface in response to user interactions. For example, in one or more embodiments, detected user input may cause the user interface manager102 to update or change within only one area of a graphical user interface. In one or more embodiments, upon a detected user interaction, the user interface manager102 may update one area within a user interface from one type of display to a second type of display, while continuing to display another area within the user interface with no updates.
• Along similar lines, the user interface manager102 can reorganize a user interface in response to user interactions. For example, in one or more embodiments, detected user input may cause the user interface manager102 to split a graphical user interface into two or more areas. In one or more embodiments, upon a detected user interaction, the user interface manager102 may reorganize a user interface from only displaying one area with a first collection of display elements to displaying two areas with the first collection of display elements in the first area and a second collection of display elements in the second area. Likewise, in one or more embodiments, the user interface manager102 may also consolidate or remove areas within a graphical user interface in response to detected user interactions.
• As mentioned above, and as illustrated inFIG. 1, theelectronic messaging system100 may further include a user input detector104. The user input detector104 detects, receives, and/or facilitates user input in any suitable manner. In some examples, the user input detector104 detects one or more user interactions. As referred to herein, a “user interaction” means a single input, a combination of inputs, received from a user by way of one or more input devices, or via one or more touch gestures. A user interaction can have variable duration and may take place anywhere on the graphical user interface managed by the user interface manager102 described above.
• For example, the user input detector104 can detect a user interaction from a keyboard, mouse, touch screen display, or any other input device. In the event a touch screen display is utilized, the user input detector104 can detect one or more touch gestures that form a user interaction (e.g., tap gestures, swipe gestures, pinch gestures, etc.) provided by a user by way of the touch screen. In one or more embodiments, the user input detector104 can detect touch gestures in relation to and/or directed at one or more display elements displayed as part of the graphical user interface presented on the touch screen display. The user input detector104 may report any detected touch gesture in relation to and/or directed at one or more display elements to user interface manager102.
• The user input detector104 may additionally, or alternatively, receive data representative of a user interaction. For example, the user input detector104 may receive one or more user configurable parameters from a user, one or more user commands from the user, and/or any other suitable user input. For example, the user input detector104 can receive voice commands or otherwise sense, detect, or receive user input.
• As mentioned above, and as illustrated inFIG. 1, theelectronic messaging system100 may further include amultimedia manager106. Themultimedia manager106 captures, packages, and stores multimedia inputs for inclusion in a communication session. For example, in one or more embodiments, themultimedia manager106 can interface with one or more cameras of a computing device. For example, in response to a detected input, themultimedia manager106 may capture multimedia via the one or more cameras and create an accompanying multimedia content item.
• For example, in one or more embodiments, themultimedia manager106 may interface with at least one camera of a computing device and provide a camera viewfinder to the user interface manager102. In one or more embodiments, the user interface manager102 may display the provided camera viewfinder as part of a user interface including a communication thread. Thus, in one or more embodiments, the user interface manager102 may simultaneously display the camera viewfinder and communication thread.
• Additionally, themultimedia manager106 may capture multimedia via the camera viewfinder in response to a detected user input. For example, themultimedia manager106 may capture an image in response to a detected tap touch gesture, and create a digital photograph multimedia content item containing the image. Also, themultimedia manager106 may capture a video in response to a detected press-and-hold touch gesture, and create a digital video multimedia content item. In one or more alternative embodiments, themultimedia manager106 may capture and create other types of multimedia in response to other types of detected inputs. For example, themultimedia manager106 may capture a dozen rapid images in burst mode in response to a double tap touch gesture, or may capture only audio in response to a two-finger press-and-hold touch gesture, etc.
• Themultimedia manager106 may also add a captured multimedia content item to a communication thread. For example, in one or more embodiments, upon a detected completion of a user interaction used to capture the multimedia, themultimedia manager106 may add the multimedia content item to the communication thread. For instance, in one or more embodiments, themultimedia manager106 may add a digital photograph to the communication thread immediately upon completion of a detected tap touch gesture used to capture the digital photograph without further user action. Similarly, in one or more embodiments, the multimedia manage106 may add a digital video to the communication thread immediately upon completion of a detected press-and-hold touch gesture used to capture the digital video. Thus, in response to the same (and in one or more embodiments a single) user interaction, themultimedia manager106 can capture a multimedia content item, sent the multimedia item as an electronic message, and add the multimedia content item to a communication thread.
• In one or more embodiments, themultimedia manager106 may package the multimedia content item for display once it is has been added to the communication thread. For example, themultimedia manager106 may package a digital video multimedia content item into a playback control capable of playing the digital video multimedia. Themultimedia manager106 may then add the playback control with the packaged digital video multimedia content item to the communication thread. Thus, themultimedia manager106 can allow the digital video to be played directly from the communication thread, rather than from a third party multimedia player.
• Additionally, themultimedia manager106 may cancel or delete a multimedia content item prior to adding the multimedia content item to the communication thread. For example, in one or more embodiments, themultimedia manager106 may cancel the capture of a digital photograph or digital video in response to a detected user interaction. For instance, themultimedia manager106 may cancel the capture of a digital video in response to a detected swipe. In this case, themultimedia manager106 discards any portion of the digital video or image that has already been captured and does not send a message or add anything to the communication thread.
• Furthermore, themultimedia manager106 may store the multimedia content items captured via the camera viewfinder. For example, in one or more embodiments, themultimedia manager106 may store a captured multimedia content item in the file storage of a computing device after sending and adding the multimedia content item to the communication thread. Thus, the captured multimedia content item may be later accessed by the electronic messaging system, or by another third party system. In one or more alternative embodiments, themultimedia manager106 may immediately discard the captured multimedia content item after sending and adding the multimedia content item to the communication thread. Additionally, themultimedia manager106 may receive a user configuration specifying whether to store or discard captured multimedia content items.
• Themultimedia manager106 may also provide options for adding effects to captured multimedia content items. For example, in one or more embodiments, themultimedia manager106 may provide a variety of effects that may be added to captured multimedia content items such as, but not limited to: color effects (i.e., black and white, sepia, color, etc.), overlay effects (i.e., add a border, add a caption, etc.), sharpness and contrast effects, facial recognition and tagging effects, or any other effects suitable for multimedia content items. In one or more embodiments, themultimedia manager106 may accept a configuration regarding added effects prior to capturing a multimedia content item, sending the multimedia content item as a message, and adding the captured multimedia content item to the communication thread.
• As mentioned above, and as illustrated inFIG. 1, theelectronic messaging system100 may further include acommunication manager108. Thecommunication manager108 can facilitate receiving and sending data to and from theelectronic messaging system100, or a computing device upon which theelectronic messaging system100 is implemented. In particular, thecommunication manager108 can instruct or activate one or more communication interfaces of a computing device, as described below to send or receive data, particularly data related to electronic communications. Furthermore, thecommunication manager108 can package or format content items to be sent or received from theelectronic messaging system100 in any necessary form that is able to be sent through one or more communication channels and using an appropriate communication protocol, as described further below with reference toFIG. 7.
• Furthermore, thecommunication manager108 may automatically send, to one or more co-users, captured multimedia provided by themultimedia manager106. For example, in one or more embodiments, in response to a detected completion of a user interaction and without further user interaction, thecommunication manager108 may send captured multimedia content item to one or more co-users of the communication system. In this way, theelectronic messaging system100 can foster spontaneous, real-time communication. This is in contrast to systems that require a user-initiated send event prior to sending a multimedia content item. In alternative embodiments, thecommunication manager108 can send a message upon a user selecting a send option.
• As discussed above, theelectronic messaging system100 can include adata storage110, as illustrated inFIG. 1. Thedata storage110 may maintainmultimedia data112 representative of data associated with multimedia content items. For example, themultimedia data112 may include, but is not limited to: captured multimedia content items, multimedia effect options and configurations, and multimedia storage options and configurations.
• FIG. 2 is a schematic diagram illustrating anexample system200, within which one or more embodiments of theelectronic messaging system100 can be implemented. As illustrated inFIG. 2, thesystem200 can includecomputing devices202,204, anetwork206, and acommunication server208. Thecomputing devices202,204, thenetwork206, and thecommunication server208 may be communicatively coupled, as shown inFIG. 2. AlthoughFIG. 2 illustrates a particular arrangement of thecomputing devices202,204, thenetwork206, and thecommunication server208, various additional arrangements are possible. For example, thecomputing devices202,204 may directly communicate with thecommunication server208, bypassing thenetwork206, or alternatively, may directly communicate with each other.
• Thecomputing devices202,204, thenetwork206, and thecommunication server208 may communicate using any communication platforms and technologies suitable for transporting data and/or communication signals. For example, thecomputing devices202,204, thenetwork206, and thecommunication server208 may communicate via any known communication technologies, devices, media, and protocols supportive of remote data communications, examples of which will be described in more detail below with respect toFIG. 7. In addition, in certain embodiments, thecomputing devices202,204, and thecommunication server208 may communicate via thenetwork206, which may include one or more social networks as described further below with respect toFIG. 8.
• Thecommunication server208 may generate, store, receive, and transmit electronic communication data. For example, thecommunication server208 may receive an electronic communication from thecomputing device202 and send the received electronic communication to thecomputing device204. In particular, thecommunication server208 can transmit electronic messages between one or more users of thesystem200. Thecommunication server208 can receive a wide range of electronic communication types, including but not limited to, text messages, instant messages, social-networking messages, social-networking posts, emails, and any other form of electronic communication. Additional details regarding thecommunication server208 will be discussed below with respect toFIG. 7.
• Thenetwork206 may represent a network or collection of networks (such as the Internet, a corporate intranet, a virtual private network (VPN), a local area network (LAN), a wireless local network (WLAN), a cellular network, a wide area network (WAN), a metropolitan area network (MAN), or a combination of two or more such networks. Thus, thenetwork206 may be any suitable network over which thecomputing device202 may access thecommunication server208 and/or thecomputing device204, or vice versa. Thenetwork206 will be discussed in more detail below with regard toFIGS. 7 and 8.
• In addition to the system and network elements of thesystem200,FIG. 2 illustrates that auser210 can be associated with thecomputing device202, and that auser212 can be associated with thecomputing device204. AlthoughFIG. 2 illustrates only twousers210,212, thesystem200 can include a large number of users, with each of the users interacting with thesystem200 through one or more computing devices. For example, theuser210 can interact with thecomputing device202 for the purpose of composing, and sending an electronic communication (e.g., instant message). Theuser210 may interact with thecomputing device202 by way of a user interface, managed by the user interface manager102, on thecomputing device202. For example, theuser210 can utilize the user interface to cause thecomputing device202 to compose and send an electronic communication to one or more of the plurality of users of thesystem200.
• In one or more embodiments, the components102-110, as described with regard toFIG. 1, may be implemented on one or more of thecomputing devices202,204 and thecommunication server208. For example, thecomputing devices202,204, and thecommunication server208 may communicate across thenetwork206 via thecommunication manager108 of theelectronic messaging system100. In one or more embodiments, thecomputing devices202,204 may receive user inputs via the user input detector104. Likewise, in one or more embodiments, thecomputing devices202,204 may provide graphical user interfaces via the user interface manager102. Furthermore, in one or more embodiments each of thecomputing devices202,204 can include an instance of theelectronic messaging system100.
• As will be described in more detail below, each of the components100-110 of theelectronic messaging system100 as described with regard toFIGS. 1 and 2, can provide, along and/or in combination with the other components of theelectronic messaging system100, one or more graphical user interfaces. In particular, the components102-110 can allow a user to interact with a collection of display elements for a variety of purposes. In particular,FIGS. 3A-4G and the description that follows illustrate various example embodiments of the user interfaces and features that are in accordance with general principles as described above.
• In some examples, a computing device (i.e.,computing device202,204 ofFIG. 2) can implement part or all of theelectronic messaging system100. For example,FIG. 3A illustrates acomputing device300 that may implement one or more of the components102-110 of theelectronic messaging system100. As illustrated inFIG. 3A, thecomputing device300 is a handheld device, such as a mobile phone device (e.g., a smartphone). As used herein, the term “handheld device” refers to a device sized and configured to be held/operated in a single hand of a user. In additional or alternative example, however, any other suitable computing device, such as, but not limited to, a tablet device, a handheld device, larger wireless devices, laptop or desktop computer, a personal-digital assistant device, and/or any other suitable computing device can perform one or more of the processes and/or operations described herein.
• Thecomputing device300 can include any of the features and components described below in reference to acomputing device700 ofFIG. 7. As illustrated inFIG. 3A, thecomputing device300 includes atouch screen display302 that can display or provide user interfaces and by way of which user input may be received and/or detected. As used herein, a “touch screen display” refers to the display of a touch screen device. In one or more embodiments, a touch screen device may be acomputing device202,204 with at least one surface upon which auser210,212 may perform touch gestures (e.g., a laptop, a tablet computer, a personal digital assistant, a media player, a mobile phone). Additionally or alternatively, thecomputing device300 may include any other suitable input device, such as a touch pad or those described below in reference toFIG. 7.
• FIG. 3A illustrates atouch screen display302 of thecomputing device300 displaying one embodiment of a graphical user interface, in particular a messaginggraphical user interface304. For example, the user interface manager102 provides various display areas and display elements as part of the messaginggraphical user interface304. In one or more embodiments, the user interface manager102 provides acommunication thread306, as well as a message input control palette ortoolbar310.
• As described above, thecommunication manager108 of theelectronic messaging system100 can facilitate receiving and sending data. In one or more embodiments, thecommunication manager108 facilitates receiving and sending electronic communications between thecomputing devices202,204. Also in one or more embodiments, the user interface manager102 displays electronic communications sent and received via thecommunication manager108. In one or more embodiments, the user interface manager102 can display electronic communications sent and received via thecommunication manager108 in thecommunication thread306 within the messaginggraphical user interface304.
• For example, as illustrated inFIG. 3A, the user interface manager102 provides thecommunication thread306 that includeselectronic messages308asent from an account of a user of thecommunication device300. Similarly, thecommunication thread306 can includeelectronic messages308breceived by the account of the user of thecomputing device300. In one or more embodiments, the user interface manager102 organizes thecommunication thread306 such that new messages are added to the bottom of thecommunication thread306 so that older messages are displayed at the top of thecommunication thread306. In alternative embodiments, the user interface manager102 may organize themessages308a,308bin any manner that may indicate to a user the chronological or other relationship between themessages308a,308b.
• The user interface manager102 provides a variety of electronic communication characteristics to help a user distinguish between electronic communications in thecommunication thread306. For example, as illustrated inFIG. 3A, the user interface manager102 displays theelectronic messages308asent from an account of the user of thecomputing device300 pointed toward one side (i.e., the right side) of the messaginggraphical user interface304. On the other hand, the user interface manager102 displays theelectronic messages308breceived by thecommunication manager108 pointed toward the opposite side (i.e., the left side) of the messaginggraphical user interface304. In one or more embodiments, the positioning and orientation of theelectronic messages308a,308bprovides a clear indicator to a user of thecomputing device300 of the origin of the various electronic communications displayed within the messaginggraphical user interface304.
• Another characteristic provided by the user interface manager102 that helps a user distinguish electronic communications may be a color of the electronic communications. For example, as shown inFIG. 3A, the user interface manager102 displays sentelectronic messages308ain a first color and receivedelectronic messages308bin a second color. In one or more embodiments, the first and second colors may be black and white, respectively, with an inverted typeface color. In an alternative embodiment, the user interface manager102 may display theelectronic messages308a,308bwith white backgrounds and different colored outlines.
• In yet another alternative embodiment, the user interface manager102 may display theelectronic messages308a,308bwith backgrounds of different patterns, in different fonts, in different sizes or in any other manner that may distinguish the sentelectronic messages308afrom the receivedelectronic messages308b.For example, in one or more embodiments, the user interface manager102 displays sentelectronic messages308awith white typeface on a blue background. Likewise, in one or more embodiments, the user interface manager102 displays receivedelectronic messages308bwith black typeface on a grey background.
• As mentioned above, the user interface manager102 may also provide a message input control palette ortoolbar310. As illustrated inFIG. 3A, the user interface manager102 displays the message input control palette ortoolbar310 as part of the messaginggraphical user interface304. In one or more embodiments, the message input control palette ortool bar310 includes a variety of selectable message input controls that provide a user with various message input options or other options. For example, inFIG. 3A, the message input control palette ortoolbar310 includes atext input control312a,a cameraviewfinder input control312b,amultimedia input control312c,asymbol input control312d,and asound input control312e.In one or more alternative embodiments, the message input control palette ortoolbar310 may provide the input controls312a-312ein a different order, may provide other input controls not displayed inFIG. 3A, or may omit one or more of the input controls312a-312eshown inFIG. 3A.
• As will be described below in greater detail, a user may interact with any of the input controls312a-312ein order to compose and send different types of electronic communications. For example, if a user interacts with thetext input control312a,the user interface manager102 may provide a touch screen display keyboard in a portion of the messaginggraphical user interface304 that the user may utilize to compose a textual message. Similarly, if a user interacts with themultimedia input control312c,the user interface manager102 may provide a multimedia content item display area (e.g., for displaying digital photographs, digital videos, etc.) within a portion of the messaginggraphical user interface304. Furthermore, if a user interacts with thesound input control312e,the user interface manager102 may provide a sound recording control by way of which the user can record a voice or other sound message. Likewise, as will be described in more detail below, if a user interacts with the cameraviewfinder input control312b,the user interface manager102 may provide a digital camera interface within a portion of the messaginggraphical user interface304 that the user may utilize to capture, send, and add a digital photograph or digital video to thecommunication thread306.
• A user may interact with any of the message input controls312a-ein order to compose and send a message to one or more co-users via theelectronic messaging system100. For example, inFIG. 3B, a user'sfinger314 is shown interacting with the cameraviewfinder input control312b.In one or more embodiments, the user input detector104 can detect interactions (e.g., a tap touch gesture) of the user'sfinger314 with the cameraviewfinder input control312b.The user interface manager102 may display aninput control indicator318 to indicate which input control312a-eis currently active. Additionally, as shown inFIG. 3B, upon the user input detector104 detecting a tap touch gesture on the cameraviewfinder input control312b,the user interface manager102 may display acamera viewfinder316. In other words, in response to the detected user interaction theelectronic messaging system100 can activate a camera of thecomputing device300 and display within the camera viewfinder316 a data (image/video) stream from the camera of thecomputing device300.
• In particular, as illustrated byFIG. 3B, the user interface manager102 can provide thecommunication thread306 in a first portion (i.e., the upper portion) of themessaging user interface304. The user interface manager102 can provide thecamera viewfinder316 in a second portion (i.e., the lower portion) of themessaging user interface304. Thus, the user interface manager102 can allow the user to view thecommunication thread306 and any new messages, while also being able to view and capture multimedia. In alternative embodiments the user interface manager102 can arrange thecommunication thread306 and thecamera viewfinder316 horizontally or in another arrangement other than a vertical arrangement.
• In one or more embodiments, themultimedia manager106 may interface with one or more cameras of thecomputing device300 and may provide thecamera viewfinder316 based on the one or more cameras of thecomputing device300. For example, in one or more embodiments, thecomputing device300 may include a back facing camera that faces away from a user. In one or more embodiments, themultimedia manager106 may interface with the back facing camera and provide images captured by the back facing camera within thecamera viewfinder316. In one or more alternative embodiments, thecomputing device300 may include a back facing camera as well as a front facing camera (i.e., a camera that faces the user). In another embodiment, themultimedia manager106 may interface with either the back facing camera or the front facing camera and provide the same image viewed by either the back facing camera or the front facing camera within thecamera viewfinder316.
• For example, as shown inFIG. 3B, themultimedia manager106 may interface with a front facing camera of thecomputing device300. Accordingly, thecamera viewfinder316 includes the same image viewed by the front facing camera (i.e., an image of the user). In one or more embodiments, themultimedia manager106 may continuously update thecamera viewfinder316, such that the image displayed in thecamera viewfinder316 matches the image viewed by the camera themultimedia manager106. In particular, themultimedia manager106 may continuously update thecamera viewfinder316 as long as the cameraviewfinder input control312bis active, as indicated by theinput control indicator318.
• Themultimedia manager106 may capture a multimedia content item via thecamera viewfinder316 in response to a user interaction. For example, as shown inFIG. 3C, the multimedia manager102 may capture a multimedia content item via thecamera viewfinder316 in response to a detected user interaction on the camera viewfinder. In one or more embodiments, the user input detector104 may detect a touch gesture of a user'sfinger314 with thecamera viewfinder316. In one or more embodiments, themultimedia manager106 may capture a digital photograph in response to a detected tap touch gesture of the user'sfinger314 with thecamera viewfinder316. In one or more alternative embodiments, themultimedia manager106 may capture a digital photograph in response to another type of user interaction, such as a spoken command, a change in the orientation of the computing device300 (i.e., portrait to landscape), or another type of user interaction suitable for this purpose.
• In one or more embodiments, thecommunication manager108 may immediately send the captured multimedia content item to one or more co-users. For example, in one or more embodiments, themultimedia manager106 may provide a multimedia content item to thecommunication manager108 immediately upon the capture of the multimedia content item. Thus, thecommunication manager108 may send a captured multimedia content item to one or more co-users immediately following a detected tap touch gesture interacting with thecamera viewfinder316.
• Furthermore, in one or more embodiments, the user interface manager102 may immediately add the captured multimedia content item to thecommunication thread306. For example, as shown inFIG. 3D, the user interface manager102 can add the capturedmultimedia content item320 to thecommunication thread306 in response to the detected user interaction described with regard toFIG. 3C. The capturedmultimedia content item320 may be a digital photograph captured by themultimedia manager106 in response to a detected tap touch gesture interaction with thecamera viewfinder316.
• Thus, theelectronic messaging system100 can allow a user to capture and send electronic multimedia without requiring surplus user interactions. For example, the electronic messaging system can automatically send the capturedmultimedia320 to one or more co-users via thecommunication server208 upon capture of themultimedia320. Furthermore, theelectronic messaging system100 can add the capturedmultimedia320 to thecommunication thread306 upon capture of themultimedia320. In other words, theelectronic messaging system100 can capture, send, and addmultimedia item320 to acommunication thread306 in response to a single user interaction (i.e., tap gesture). Thus, one or more embodiments can foster spontaneous, speedy, unrehearsed or edited communication.
• As shown inFIG. 3D, when sent to one or more co-users and when added to thecommunication thread306, themultimedia content item320 can have a size configured for display within acommunication thread306. In particular, themultimedia content item320 can occupy less than theentire communication thread306 both in a vertical direction and a horizontal direction. By not occupying the total vertical area of thecommunication thread306, thecommunication thread306 can display both themultimedia content item320 and one or more messages as shown byFIG. 3D. Along related lines, by not occupying the total horizontal area of thecommunication thread306, themultimedia content item320 can be positioned on one side of thecommunication thread306 so as to indicate whether themultimedia content item320 was a sent or received message.
• In one or more embodiments, themultimedia manager106 may continue to update thecamera viewfinder316 after themultimedia content item320 has been captured. For example, as shown inFIG. 3D, themultimedia manager106 can update thecamera viewfinder316 to include a different image than the image of the capturedmultimedia content item320. Thus, the user may continue to capture and send multimedia content items with no or little delay from theelectronic messaging system100.
• As described above, in one or more embodiments, themultimedia manager106 may be preconfigured to add certain display effects to the capturedmultimedia content item320. For example, in one or more embodiments, a user may preconfigure themultimedia manager106 to provide the capturedmultimedia content item320 in black and white. Additionally or alternatively, themultimedia manager106 may provide captured multimedia content items with other display effects, such as with enhanced sharpness and clarity, with a border, with a certain color scheme, with a certain image filter, or with any other display effect suitable for multimedia content items. Regardless of the embodiment, the user may preconfigure themultimedia manager106 to add one or more display effects to captured multimedia content items, such that no user interaction is required between the capture of the multimedia content item and the sending of the captured multimedia content item with the one or more co-users.
• FIG. 3D illustrates themultimedia content item320 added to thecommunication thread306 on thedevice300 of the user who sent themultimedia content item320. One will appreciate that when acomputing device204 of a recipient receives themultimedia content item320, an instance of theelectronic messaging system100 on therecipient computing device204 can add themultimedia content item320 to acommunication thread306. In particular, theelectronic messaging system100 on therecipient computing device204 can add themultimedia content item320 to acommunication thread306 in a manner similar to that shown inFIG. 3D, albeit on a left side of thecommunication thread306. Placement of themultimedia content item320 on the left side of thecommunication thread306 can indicate that themultimedia content item320 is a received message.
• In response to a detected user interaction, the user interface manager102 may replace thecamera viewfinder316 with another control. For example, as illustrated inFIG. 3E, the user input detector104 may detect a user interaction of thefinger314 of the user's hand interacting with thetext input control312awithin the message input control palette ortoolbar310. In one or more embodiments, in response to the detected selection of thetext input control312a(as indicated by the input control indicator318), the user interface manager102 may replace thecamera viewfinder316 with a touchscreen display keyboard322. In one or more alternative embodiments, the user interface manager102 may replace thecamera viewfinder316 with other types of controls in response to the detected selection of any of the input controls312a-312b.
• FIGS. 3A-3E illustrate a process for capturing and sending a multimedia content item, where the multimedia content item is a digital photograph. In one or more embodiments, themultimedia manager106 may also capture and send a multimedia content item that is a digital video. For example, as will be illustrated inFIGS. 4A-4G, themultimedia manager106 may capture a digital video, and provide the digital video to both thecommunication manager108 and the user interface manager102.
• As described above, in response to a detected selection of the cameraviewfinder input control312b,the user interface manager102 may update the messaginggraphical user interface304 to include acamera viewfinder316 provided by themultimedia manager106. In one or more embodiments, the user interface manager102 may update the messaginggraphical user interface304 to include thecamera viewfinder316 such that the messaginggraphical user interface304 still includes thecommunication thread306 in one portion of theuser interface304. As described above, in a preferred embodiment, themultimedia manager106 can continuously update thecamera viewfinder316 to include the most recent image viewed/captured by a camera of thecomputing device300.
• In response to a detected user interaction, themultimedia manager106 may capture a multimedia content item via thecamera viewfinder316, wherein the captured multimedia content item is a digital video. For example, the user input detector104 may detect a user interaction of the user'sfinger314 interacting with thecamera viewfinder316, such as a press-and-hold touch gesture. In one or more alternative embodiments, the detected user interaction may be a spoken command, holding thecomputing device300 very still for a certain amount of time, or any other type of user interaction suitable for this purpose.
• In response to a detected press-and-hold user interaction, themultimedia manager106 may record a digital video via thecamera viewfinder316. In one or more embodiments, themultimedia manager106 may also store the recorded digital video on thecomputing device300. Themultimedia manager106 can continue to capture and record the digital video via thecamera viewfinder316 during the duration of the detected press-and-hold user interaction.
• In one or more embodiments, the user interface manager102 may display one or more instructions regarding the capture of a multimedia content item digital video. For example, as shown inFIG. 4B, the user interface manager102 can display theinstruction324, which reads, “Swipe up to cancel video.” Thus, theinstruction324 informs a user how to cancel the cancel the capture of a digital video. In one or more alternative embodiments, theinstruction324 can give other types of information to the user. For example, in one alternative embodiment, themultimedia manager106 may determine that thecomputing device300 is not still enough to capture a usable digital video. Accordingly, in that alternative embodiment, the user interface manager102 may cause theinstruction324 to read, “Please hold still.”
• Additionally, the user interface manager102 may display an indicator regarding how long the captured digital video is at any given point during the capture of the digital video. For example, as illustrated inFIG. 4B, the user interface manager102 can display arecording time indicator326. In one or more embodiments, therecording time indicator328 may be a bar that extends from one side of the messaginggraphical user interface304 to indicate the length of the digital video recorded by themultimedia manager106 so far. Accordingly, in one or more embodiments, therecording time indicator326 indicates the length of the recording in real time.
• In one or more embodiments, themultimedia manager106 may be configured to allow recordings of a certain length (e.g., 60 seconds or less). In such embodiments, therecording time indicator326 can also provide an indication of how much longer the recording may be before themultimedia manager106 will stop recording (i.e., when the bar reaches the opposite side of the messaginggraphical user interface304 themultimedia manager106 must stop recording). In one or more embodiments, when the record is reaching the time limit, the user interface manager102 may update theinstruction324 with a warning, such as, “5 seconds remaining!”
• A user may desire to cancel the capture and recording of a digital video before thecommunication manager108 sends the digital video to one or more co-users. For example, as illustrated inFIG. 4B, themultimedia manager106 may cancel the capture and recording of a digital video in response to a detected user interaction along the direction of thearrow328. For instance, as described above, themultimedia manager106 may capture and record a digital video via thecamera viewfinder316 in response to a detected press-and-hold touch gesture. In one or more embodiments, the user input detector104 may detect an upward swipe gesture of thefinger314 of the user's hand during the press-and-hold touch gesture such that upon the detected release of the swipe gesture, the user'sfinger314 is no longer interacting with thecamera viewfinder316. In response to this detected user interaction, themultimedia manager106 may cancel the capture and recording of the digital video. As such, theelectronic messaging system100 may not automatically send any captured video or add any captured video to thecommunication thread306 in such embodiments.
• Additionally, in response to the detected user interaction described above, themultimedia manager106 may also discard any portion of the digital video that had already been recorded and/or stored. Thus, in one or more embodiments, in response to a detected swipe touch gesture during the recording of a digital video, themultimedia manager106 may delete the digital video. In one or more alternative embodiment, themultimedia manager106 may save or store the portion of the digital video that was recorded before the detected swipe gesture without providing that portion of the digital video to thecommunication manager108 and/or the user interface manager102.
• Once themultimedia manager106 has canceled the capture and recording of a digital video, as described above, the user interface manager102 may update the messaginggraphical user interface304. For example, as illustrated inFIG. 4C, the user interface manager102 can update the messaginggraphical user interface304 to again include the message input control palette ortoolbar310, rather than theinstruction324. Additionally, in one or more embodiments, the user interface manager102 can continue to display thecommunication thread304 and thecamera viewfinder316 provided by themultimedia manager106. As described above and as shown inFIG. 4C, theinput control indicator318 continues to indicate that the cameraviewfinder input control312bis active.
• Themultimedia manager106 may capture and record a digital video via thecamera viewfinder316 in response to a detected user interaction. For example, as illustrated inFIG. 4D, the user input detector104 may detect a press-and-hold touch gesture of thefinger314 of the user's hand with thecamera viewfinder316. In response to the detected press-and-hold touch gesture, themultimedia manager106 can capture and record a multimedia content item consisting of a digital video via thecamera viewfinder316. Also as described above, therecording time indicator326 can indicate a length of the recording.
• In one or more embodiments, thecommunication manager108 may send the captured multimedia content item (i.e., recorded digital video) to one or more co-users upon the detected release of a press-and-hold touch gesture. For example, as described above, the duration of a recorded digital video may be the same as the duration of a detected press-and-hold touch gesture of thefinger314 with thecamera viewfinder316. In a particular embodiment, upon the detected release of the press-and-hold touch gesture, themultimedia manager106 can provide the captured and recorded digital video to thecommunication manager108. In one or more alternative embodiments, themultimedia manager106 may provide the digital video to thecommunication manager108 in response to another type of user interaction, such as a spoken command, shaking thecommunication device300, or any other type of user interaction suitable for this purpose. Thecommunication manager108 can then send the recorded video as a message.
• Additionally, in one or more embodiments, in response to the detected release of the press-and-hold touch gesture, themultimedia manager106 may provide the multimedia content item (i.e., the recorded digital video) to the user interface manager102. Additionally or alternatively, before providing themultimedia content item330 to the user interface manager102, themultimedia manager106 may first package the multimedia content.
• In one or more embodiments, when added to thecommunication thread306, themultimedia content item330 can include aplayback control329. Theplayback control329 can comprise an interactive control that plays a digital video within thecommunication thread306 of the messaginggraphical user interface304 in response to a detected user interaction. For example, as illustrated inFIG. 4E, the user input detector104 may detect a tap touch gesture of thefinger314 of the user's hand with theplayback control329. In one or more embodiments, in response to the detected tap touch gesture on theplayback control329, the user interface manager102 can cause the recordeddigital video330 to play within thecommunication thread306. In one or more alternative embodiments, the user interface manager102 may play a digital video in response to other types of user interactions, such as a spoken command, a double tap, or any other type of user input suitable for this purpose. In still further embodiments, the user interface manager102 can automatically play the digital video in thecommunication thread306. In such embodiments, thedigital video330 may not include a play backcontrol329.
• As illustrated inFIG. 4F, and as described above, in one or more embodiments, the user interface manager102 continues to display the other display elements while the recordeddigital video330 plays. For example, as shown inFIG. 4F, the user interface manager102 can continue to display the message input control palette ortoolbar310 as well as thecamera viewfinder316.
• In one or more embodiments, the user interface manager102 may provide a playback indicator associated with the recordeddigital video330, in order to indicate how much of the digital video has been played and how much of the digital video remains un-played. For example, as illustrated inFIG. 4F, the user interface manager102 can display the playback indicator332. As shown, user interface manager102 has played approximately one-third of thedigital video330.
• As discussed above with regard to digital photographs, themultimedia manager106 may also provide options for adding effects to captured digital videos. For example, in one or more embodiments, themultimedia manager106 may provide a variety of effects that may be added to a captured digital video such as, but not limited to: color effects (i.e., altering the color of the digital video), overlay effects (i.e., add a border to a digital video), sound effects (i.e., add a background track to a digital video), or any other suitable effect. As described above, themultimedia manager106 may be preconfigured with one or more effects such that no user interaction is required between the capture of the digital video and the sending of the digital video with the one or more co-users.
• In response to a detected user interaction, the user interface manager102 may replace thecamera viewfinder316 with another control. For example, as illustrated inFIG. 4G, the user input detector104 may detect a user interaction of thefinger314 of the user's hand interacting with thetext input control312awithin the message input control palette ortoolbar310. In one or more embodiments, in response to the detected selection of thetext input control312a(as indicated by the input control indicator318), the user interface manager102 may replace thecamera viewfinder316 with a touchscreen display keyboard322. In one or more alternative embodiments, the user interface manager102 may replace thecamera viewfinder316 with other types of controls in response to the detected selection of any of the input controls312a-312b.
• FIGS. 1-4G, the corresponding text, and the examples, provide a number of different systems and devices for capturing and including multimedia content item in a communication session. In addition to the foregoing, embodiments of the present invention can also be described in terms of flowcharts comprising acts and steps in a method for accomplishing a particular result. For example,FIGS. 5 and 6 illustrate flowcharts of exemplary methods in accordance with one or more embodiments of the present invention. The methods described in relation toFIGS. 5 and 6 may be performed with less or more steps/acts or the steps/acts may be performed in differing orders. Additionally, the steps/acts described herein may be repeated or performed in parallel with one another or in parallel with different instances of the same or similar steps/acts.
• FIG. 5 illustrates a flowchart of oneexample method500 of capturing and sending multimedia as electronic messages. Themethod500 includes anact502 of providing a messaging graphical user interface. In particular, theact502 can involve providing a messaginggraphical user interface304 that includes acommunication thread306. In one or more embodiments, thecommunication thread306 may include a plurality ofelectronic messages308a,308bexchanged between a user and one or more co-users.
• Themethod500 further includes anact504 of detecting a selection of a camera viewfinder input control. In particular, theact504 can involve detecting a tap touch gesture interacting with the cameraviewfinder input control312b.In one or more embodiments, detecting a selection of a cameraviewfinder input control312bmay include detecting a selection of a cameraviewfinder input control312bfrom a palette of one or more additional input controls310.
• Furthermore, themethod500 includes anact506 of providing a camera viewfinder. In particular, theact504 can involve providing acamera viewfinder316 within a portion of the messaginggraphical user interface304. In one or more embodiments, the messaginggraphical user interface304 may include thecommunication thread306 in a first portion and thecamera viewfinder316 in a second portion.
• Themethod500 also includes anact508 of detecting an interaction with the camera viewfinder. In particular, theact508 can involve detecting a first user interaction with thecamera viewfinder316. For example, in one or more embodiments, detecting the first user interaction with thecamera viewfinder316 can include detecting a tap touch gesture with thecamera viewfinder316. Themethod500 may further include detecting a second user interaction with thecamera viewfinder316. For example, in one or more embodiments, detecting the second user interaction with thecamera viewfinder316 can include detecting a press-and-hold touch gesture with thecamera viewfinder316.
• Additionally, themethod500 includes anact510 of capturing a multimedia content item. In particular, theact510 can involve, in response to the detected first user interaction, capturing amultimedia content item320 and sending the capturedmultimedia content item320 as anelectronic message308a,308b.For example, in one or more embodiments, capturing amultimedia content item320 includes capturing a digital photograph in response to a detected tap touch gesture. Furthermore, in one or more embodiments, capturing amultimedia content item320 includes capturing a digital video in response to a detected press-and-hold touch gesture. In one or more embodiments, the duration of the captured digital video may be the same as the duration of the detected press-and-hold touch gesture.
• Themethod500 may further include adding the capturedmultimedia content item320 to thecommunication thread306. For example, in one or more embodiments, themethod500 may include adding a captured digital photograph to thecommunication thread306. Additionally, in one or more embodiments, themethod500 may include, in response to a detected release of a press-and-hold touch gesture, adding aplayback control330 to a captured digital video to thecommunication thread306.
• FIG. 6 illustrates a flowchart of amethod600 of capturing and sending multimedia as electronic messages. Themethod600 includes anact602 of providing a messaging graphical user interface. In particular, theact502 can involve providing a messaginggraphical user interface304 with acommunication thread306 in a first portion of the messaginggraphical user interface304. In one or more embodiments, thecommunication thread306 may include a plurality ofelectronic messages308a,308bexchanged between a user and one or more co-users.
• Themethod600 further includes anact604 of detecting a selection of a camera viewfinder input control. In particular, theact604 can include detecting a tap touch gesture interacting with the cameraviewfinder input control312b.In one or more embodiments, detecting a selection of a cameraviewfinder input control312bmay include detecting a selection of acamera viewfinder control312bfrom a palette of input controls310.
• Themethod600 also includes anact606 of providing a camera viewfinder. In particular, theact606 can involve, in response to the selection of the cameraviewfinder input control312b,providing acamera viewfinder316 within a second portion of the messaginggraphical user interface304. In one or more embodiments, the first portion of the messaginggraphical user interface304 and the second portion of the messaginggraphical user interface304 are displayed simultaneously.
• Themethod600 may further include detecting a tap touch gesture within the second portion of the messaginggraphical user interface304. For example, in one or more embodiments, the tap touch gesture may interact with thecamera viewfinder316. In response to the detected tap touch gesture within the second portion of the messaginggraphical user interface304, themethod600 may also include capturing a digital photograph via thecamera viewfinder316. Themethod600 may further include sending the captured digital photograph and adding the captured digital photograph to thecommunication thread306 in the first portion of the messaginggraphical user interface304.
• Additionally, themethod600 may include detecting a press-and-hold touch gesture within the second portion of the messaginggraphical user interface304. During the duration of the detected press-and-hold touch gesture within the second portion of the messaginggraphical user interface304, themethod600 may include capturing a digital video via thecamera viewfinder316. Additionally, in response to a detected release of the press-and-hold touch gesture, themethod600 may include sending the captured digital video. Also in response to the detected release of the press-and-hold touch gesture, themethod600 may include adding aplayback control330 capable of playing the captured digital video to thecommunication thread306 in the first portion of the messaginggraphical user interface304.
• Furthermore, themethod600 may include detecting a tap touch gesture with aplayback control330. For example, in one or more embodiments, detecting a tap touch gesture with aplayback control330 may include detecting a tap touch gesture with aplayback control330 in thecommunication thread306 in the first portion of the messaginggraphical user interface304. In response to the detected tap touch gesture with theplayback control330, themethod600 may include playing the captured digital video in thecommunication thread306 in the first portion of the messaginggraphical user interface304.
• Themethod600 may include detecting a selection of a message input control312a-efrom a palette of message input controls310. For example, detecting a selection of a message input control312a-emay include detecting a tap touch gesture interacting with amessage input control312a.In response to the detected selection, themethod600 may further include removing thecamera viewfinder316 from the second portion of the messaginggraphical user interface304.
• Embodiments of the present disclosure may comprise or utilize a special purpose or general-purpose computer including computer hardware, such as, for example, one or more processors and system memory, as discussed in greater detail below. Embodiments within the scope of the present disclosure also include physical and other computer-readable media for carrying or storing computer-executable instructions and/or data structures. In particular, one or more of the processes described herein may be implemented at least in part as instructions embodied in a non-transitory computer-readable medium and executable by one or more computing devices (e.g., any of the media content access devices described herein). In general, a processor (e.g., a microprocessor) receives instructions, from a non-transitory computer-readable medium, (e.g., a memory, etc.), and executes those instructions, thereby performing one or more processes, including one or more of the processes described herein.
• Computer-readable media can be any available media that can be accessed by a general purpose or special purpose computer system. Computer-readable media that store computer-executable instructions are non-transitory computer-readable storage media (devices). Computer-readable media that carry computer-executable instructions are transmission media. Thus, by way of example, and not limitation, embodiments of the disclosure can comprise at least two distinctly different kinds of computer-readable media: non-transitory computer-readable storage media (devices) and transmission media.
• Non-transitory computer-readable storage media (devices) includes RAM, ROM, EEPROM, CD-ROM, solid state drives (“SSDs”) (e.g., based on RAM), Flash memory, phase-change memory (“PCM”), other types of memory, other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store desired program code means in the form of computer-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer.
• A “network” is defined as one or more data links that enable the transport of electronic data between computer systems and/or modules and/or other electronic devices. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) to a computer, the computer properly views the connection as a transmission medium. Transmissions media can include a network and/or data links which can be used to carry desired program code means in the form of computer-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer. Combinations of the above should also be included within the scope of computer-readable media.
• Further, upon reaching various computer system components, program code means in the form of computer-executable instructions or data structures can be transferred automatically from transmission media to non-transitory computer-readable storage media (devices) (or vice versa). For example, computer-executable instructions or data structures received over a network or data link can be buffered in RAM within a network interface module (e.g., a “NIC”), and then eventually transferred to computer system RAM and/or to less volatile computer storage media (devices) at a computer system. Thus, it should be understood that non-transitory computer-readable storage media (devices) can be included in computer system components that also (or even primarily) utilize transmission media.
• Computer-executable instructions comprise, for example, instructions and data which, when executed at a processor, cause a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions. In some embodiments, computer-executable instructions are executed on a general-purpose computer to turn the general-purpose computer into a special purpose computer implementing elements of the disclosure. The computer executable instructions may be, for example, binaries, intermediate format instructions such as assembly language, or even source code. Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the described features or acts described above. Rather, the described features and acts are disclosed as example forms of implementing the claims.
• Those skilled in the art will appreciate that the disclosure may be practiced in network computing environments with many types of computer system configurations, including, personal computers, desktop computers, laptop computers, message processors, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile telephones, PDAs, tablets, pagers, routers, switches, and the like. The disclosure may also be practiced in distributed system environments where local and remote computer systems, which are linked (either by hardwired data links, wireless data links, or by a combination of hardwired and wireless data links) through a network, both perform tasks. In a distributed system environment, program modules may be located in both local and remote memory storage devices.
• Embodiments of the present disclosure can also be implemented in cloud computing environments. In this description, “cloud computing” is defined as a model for enabling on-demand network access to a shared pool of configurable computing resources. For example, cloud computing can be employed in the marketplace to offer ubiquitous and convenient on-demand access to the shared pool of configurable computing resources. The shared pool of configurable computing resources can be rapidly provisioned via virtualization and released with low management effort or service provider interaction, and then scaled accordingly.
• A cloud-computing model can be composed of various characteristics such as, for example, on-demand self-service, broad network access, resource pooling, rapid elasticity, measured service, and so forth. A cloud-computing model can also expose various service models, such as, for example, Software as a Service (“SaaS”), Platform as a Service (“PaaS”), and Infrastructure as a Service (“IaaS”). A cloud-computing model can also be deployed using different deployment models such as private cloud, community cloud, public cloud, hybrid cloud, and so forth. In this description and in the claims, a “cloud-computing environment” is an environment in which cloud computing is employed.
• FIG. 7 illustrates a block diagram ofexemplary computing device700 that may be configured to perform one or more of the processes described above. One will appreciate that one or more computing devices such as thecomputing device700 may implement theelectronic messaging system100. As shown byFIG. 7, thecomputing device700 can comprise a processor702, amemory704, a storage device706, an I/O interface708, and acommunication interface710, which may be communicatively coupled by way of acommunication infrastructure712. While anexemplary computing device700 is shown inFIG. 7, the components illustrated inFIG. 7 are not intended to be limiting. Additional or alternative components may be used in other embodiments. Furthermore, in certain embodiments, thecomputing device700 can include fewer components than those shown inFIG. 7. Components of thecomputing device700 shown inFIG. 7 will now be described in additional detail.
• In one or more embodiments, the processor702 includes hardware for executing instructions, such as those making up a computer program. As an example and not by way of limitation, to execute instructions, the processor702 may retrieve (or fetch) the instructions from an internal register, an internal cache, thememory704, or the storage device706 and decode and execute them. In one or more embodiments, the processor702 may include one or more internal caches for data, instructions, or addresses. As an example and not by way of limitation, the processor702 may include one or more instruction caches, one or more data caches, and one or more translation lookaside buffers (TLBs). Instructions in the instruction caches may be copies of instructions in thememory704 or the storage706.
• Thememory704 may be used for storing data, metadata, and programs for execution by the processor(s). Thememory704 may include one or more of volatile and non-volatile memories, such as Random Access Memory (“RAM”), Read Only Memory (“ROM”), a solid state disk (“SSD”), Flash, Phase Change Memory (“PCM”), or other types of data storage. Thememory704 may be internal or distributed memory.
• The storage device706 includes storage for storing data or instructions. As an example and not by way of limitation, storage device706 can comprise a non-transitory storage medium described above. The storage device706 may include a hard disk drive (HDD), a floppy disk drive, flash memory, an optical disc, a magneto-optical disc, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these. The storage device706 may include removable or non-removable (or fixed) media, where appropriate. The storage device706 may be internal or external to thecomputing device700. In one or more embodiments, the storage device706 is non-volatile, solid-state memory. In other embodiments, the storage device706 includes read-only memory (ROM). Where appropriate, this ROM may be mask programmed ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), electrically alterable ROM (EAROM), or flash memory or a combination of two or more of these.
• The I/O interface708 allows a user to provide input to, receive output from, and otherwise transfer data to and receive data fromcomputing device700. The I/O interface708 may include a mouse, a keypad or a keyboard, a touch screen, a camera, an optical scanner, network interface, modem, other known I/O devices or a combination of such I/O interfaces. The I/O interface708 may include one or more devices for presenting output to a user, including, but not limited to, a graphics engine, a display (e.g., a display screen), one or more output drivers (e.g., display drivers), one or more audio speakers, and one or more audio drivers. In certain embodiments, the I/O interface708 is configured to provide graphical data to a display for presentation to a user. The graphical data may be representative of one or more graphical user interfaces and/or any other graphical content as may serve a particular implementation.
• Thecommunication interface710 can include hardware, software, or both. In any event, thecommunication interface710 can provide one or more interfaces for communication (such as, for example, packet-based communication) between thecomputing device700 and one or more other computing devices or networks. As an example and not by way of limitation, thecommunication interface710 may include a network interface controller (NIC) or network adapter for communicating with an Ethernet or other wire-based network or a wireless NIC (WNIC) or wireless adapter for communicating with a wireless network, such as a WI-FI.
• Additionally or alternatively, thecommunication interface710 may facilitate communications with an ad hoc network, a personal area network (PAN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), or one or more portions of the Internet or a combination of two or more of these. One or more portions of one or more of these networks may be wired or wireless. As an example, thecommunication interface710 may facilitate communications with a wireless PAN (WPAN) (such as, for example, a BLUETOOTH WPAN), a WI-FI network, a WI-MAX network, a cellular telephone network (such as, for example, a Global System for Mobile Communications (GSM) network), or other suitable wireless network or a combination thereof.
• Additionally, thecommunication interface710 may facilitate communications various communication protocols. Examples of communication protocols that may be used include, but are not limited to, data transmission media, communications devices, Transmission Control Protocol (“TCP”), Internet Protocol (“IP”), File Transfer Protocol (“FTP”), Telnet, Hypertext Transfer Protocol (“HTTP”), Hypertext Transfer Protocol Secure (“HTTPS”), Session Initiation Protocol (“SIP”), Simple Object Access Protocol (“SOAP”), Extensible Mark-up Language (“XML”) and variations thereof, Simple Mail Transfer Protocol (“SMTP”), Real-Time Transport Protocol (“RTP”), User Datagram Protocol (“UDP”), Global System for Mobile Communications (“GSM”) technologies, Code Division Multiple Access (“CDMA”) technologies, Time Division Multiple Access (“TDMA”) technologies, Short Message Service (“SMS”), Multimedia Message Service (“MMS”), radio frequency (“RF”) signaling technologies, Long Term Evolution (“LTE”) technologies, wireless communication technologies, in-band and out-of-band signaling technologies, and other suitable communications networks and technologies.
• Thecommunication infrastructure712 may include hardware, software, or both that couples components of thecomputing device700 to each other. As an example and not by way of limitation, thecommunication infrastructure712 may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a front-side bus (FSB), a HYPERTRANSPORT (HT) interconnect, an Industry Standard Architecture (ISA) bus, an INFINIBAND interconnect, a low-pin-count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCIe) bus, a serial advanced technology attachment (SATA) bus, a Video Electronics Standards Association local (VLB) bus, or another suitable bus or a combination thereof.
• As mentioned above, thenetwork206 and/orcommunication server208 can comprise a social-networking system. A social-networking system may enable its users (such as persons or organizations) to interact with the system and with each other. The social-networking system may, with input from a user, create and store in the social-networking system a user profile associated with the user. The user profile may include demographic information, communication-channel information, and information on personal interests of the user. The social-networking system may also, with input from a user, create and store a record of relationships of the user with other users of the social-networking system, as well as provide services (e.g. wall posts, photo-sharing, event organization, messaging, games, or advertisements) to facilitate social interaction between or among users.
• The social-networking system may store records of users and relationships between users in a social graph comprising a plurality of nodes and a plurality of edges connecting the nodes. The nodes may comprise a plurality of user nodes and a plurality of concept nodes. A user node of the social graph may correspond to a user of the social-networking system. A user may be an individual (human user), an entity (e.g., an enterprise, business, or third party application), or a group (e.g., of individuals or entities). A user node corresponding to a user may comprise information provided by the user and information gathered by various systems, including the social-networking system.
• For example, the user may provide his or her name, profile picture, city of residence, contact information, birth date, gender, marital status, family status, employment, educational background, preferences, interests, and other demographic information to be included in the user node. Each user node of the social graph may have a corresponding web page (typically known as a profile page). In response to a request including a user name, the social-networking system can access a user node corresponding to the user name, and construct a profile page including the name, a profile picture, and other information associated with the user. A profile page of a first user may display to a second user all or a portion of the first user's information based on one or more privacy settings by the first user and the relationship between the first user and the second user.
• A concept node may correspond to a concept of the social-networking system. For example, a concept can represent a real-world entity, such as a movie, a song, a sports team, a celebrity, a group, a restaurant, or a place or a location. An administrative user of a concept node corresponding to a concept may create or update the concept node by providing information of the concept (e.g., by filling out an online form), causing the social-networking system to associate the information with the concept node. For example and without limitation, information associated with a concept can include a name or a title, one or more images (e.g., an image of cover page of a book), a web site (e.g., an URL address) or contact information (e.g., a phone number, an email address). Each concept node of the social graph may correspond to a web page. For example, in response to a request including a name, the social-networking system can access a concept node corresponding to the name, and construct a web page including the name and other information associated with the concept.
• An edge between a pair of nodes may represent a relationship between the pair of nodes. For example, an edge between two user nodes can represent a friendship between two users. For another example, the social-networking system may construct a web page (or a structured document) of a concept node (e.g., a restaurant, a celebrity), incorporating one or more selectable buttons (e.g., “like”, “check in”) in the web page. A user can access the page using a web browser hosted by the user's client device and select a selectable button, causing the client device to transmit to the social-networking system a request to create an edge between a user node of the user and a concept node of the concept, indicating a relationship between the user and the concept (e.g., the user checks in a restaurant, or the user “likes” a celebrity).
• As an example, a user may provide (or change) his or her city of residence, causing the social-networking system to create an edge between a user node corresponding to the user and a concept node corresponding to the city declared by the user as his or her city of residence. In addition, the degree of separation between any two nodes is defined as the minimum number of hops required to traverse the social graph from one node to the other. A degree of separation between two nodes can be considered a measure of relatedness between the users or the concepts represented by the two nodes in the social graph. For example, two users having user nodes that are directly connected by an edge (i.e., are first-degree nodes) may be described as “connected users” or “friends.” Similarly, two users having user nodes that are connected only through another user node (i.e., are second-degree nodes) may be described as “friends of friends.”
• A social-networking system may support a variety of applications, such as photo sharing, on-line calendars and events, gaming, instant messaging, and advertising. For example, the social-networking system may also include media sharing capabilities. Also, the social-networking system may allow users to post photographs and other multimedia content items to a user's profile page (typically known as “wall posts” or “timeline posts”) or in a photo album, both of which may be accessible to other users of the social-networking system depending upon the user's configured privacy settings. The social-networking system may also allow users to configure events. For example, a first user may configure an event with attributes including time and date of the event, location of the event and other users invited to the event. The invited users may receive invitations to the event and respond (such as by accepting the invitation or declining it). Furthermore, the social-networking system may allow users to maintain a personal calendar. Similarly to events, the calendar entries may include times, dates, locations and identities of other users.
• FIG. 8 illustrates an example network environment of a social-networking system. In one or more embodiments, a social-networking system802 may comprise one or more data stores. For example, the social-networking system802 may store a social graph comprising user nodes, concept nodes, and edges between nodes as described earlier. Each user node may comprise one or more data objects corresponding to information associated with or describing a user. Each concept node may comprise one or more data objects corresponding to information associated with a concept. Each edge between a pair of nodes may comprise one or more data objects corresponding to information associated with a relationship between users (or between a user and a concept, or between concepts) corresponding to the pair of nodes.
• In one or more embodiments, the social-networking system802 may comprise one or more computing devices (e.g., servers) hosting functionality directed to operation of the social-networking system. A user of the social-networking system802 may access the social-networking system802 using a client device such asclient device806. For instance, theclient device806 can interact with the social-networking system802 through anetwork804.
• Theclient device806 may be a desktop computer, laptop computer, tablet computer, personal digital assistant (PDA), in- or out-of-car navigation system, smart phone or other cellular or mobile phone, or mobile gaming device, other mobile device, or other suitable computing devices.Client device806 may execute one or more client applications, such as a web browser (e.g., Microsoft Windows Internet Explorer, Mozilla Firefox, Apple Safari, Google Chrome, Opera, etc.) or a native or special-purpose client application (e.g., Facebook for iPhone or iPad, Facebook for Android, etc.), to access and view content over anetwork804.
• Network804 may represent a network or collection of networks (such as the Internet, a corporate intranet, a virtual private network (VPN), a local area network (LAN), a wireless local area network (WLAN), a cellular network, a wide area network (WAN), a metropolitan area network (MAN), or a combination of two or more such networks) over whichclient devices806 may access the social-networking system802.
• While these methods, systems, and user interfaces utilize both publicly available information as well as information provided by users of the social-networking system, all use of such information is to be explicitly subject to all privacy settings of the involved users and the privacy policy of the social-networking system as a whole.
• In the foregoing specification, the invention has been described with reference to specific exemplary embodiments thereof. Various embodiments and aspects of the invention(s) are described with reference to details discussed herein, and the accompanying drawings illustrate the various embodiments. The description above and drawings are illustrative of the invention and are not to be construed as limiting the invention. Numerous specific details are described to provide a thorough understanding of various embodiments of the present invention.
• The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes that come within the meaning and range of equivalency of the claims are to be embraced within their scope.

Claims (20)

What is claimed is:

1. A method comprising:

providing, at a computing device, a viewfinder displaying a live data stream from a camera of the computing device in an area of a messaging graphical user interface; and

in response to a first user interaction with the viewfinder:

capturing, by the camera of the computing device, a multimedia content item; and

sending, by the computing device, the captured multimedia content item as an electronic message.

2. The method as recited inclaim 1, wherein detecting the first user interaction comprises detecting a tap touch gesture with the camera viewfinder.

3. The method as recited inclaim 2, wherein capturing a multimedia content item comprises capturing a digital photograph in response to the detected tap touch gesture.

4. The method as recited inclaim 3, further comprising adding the captured digital photograph to the communication thread.

5. The method as recited inclaim 1, further comprising detecting a second user interaction with the camera viewfinder.

6. The method as recited inclaim 5, wherein detecting the second user interaction with the camera viewfinder comprises detecting a press-and-hold touch gesture with the camera viewfinder.

7. The method as recited inclaim 6, further comprising capturing a multimedia content item in response to the second user interaction, wherein the multimedia content item comprises a digital video.

8. The method as recited inclaim 7, wherein a duration of the captured digital video is the same as a duration of the detected press-and-hold touch gesture.

9. The method as recited inclaim 8, further comprising, in response to a detected release of the press-and-hold touch gesture, adding a playback control capable of playing the captured digital video to a communication thread in the messaging graphical user interface.

10. A mobile computing device comprising:

a touch screen display;

a camera;

one or more processors; and

a non-transitory storage medium storing computer-readable instructions, that when executed by the one or more processors, cause the mobile computing device to perform steps comprising:

providing, on the touch screen display, a viewfinder displaying a live data stream from the camera in a first area of the touch screen display; and

in response to a first user interaction with the first area of the touch screen display:

capturing, by the camera, a multimedia content item; and

sending, by the mobile computing device, the captured multimedia content item as an electronic message.

11. The mobile computing device as recited inclaim 10, further comprising:

detecting the first user interaction with the first area of the touch screen display by detecting a tap touch gesture within the first area of the touch screen display; and

wherein capturing, by the camera, a multimedia content item comprises capturing a digital photograph via the camera.

12. The mobile computing device as recited inclaim 11, further comprising: adding the captured digital photograph to a communication thread in a second area of the touch screen display in response to the tap touch gesture.

13. The mobile computing device as recited inclaim 10, further comprising:

detecting the first user interaction with the first area of the touch screen display by detecting a press-and-hold touch gesture within the first area of the touch screen display; and

wherein capturing, by the camera, a multimedia content item comprises capturing a digital video via the camera during a duration of the detected press-and-hold touch gesture.

14. The mobile computing device as recited inclaim 13, further comprising, in response to a detected release of the press-and-hold touch gesture, sending the captured digital video.

15. The mobile computing device as recited inclaim 14, further comprising, in response to the detected release of the press-and-hold touch gesture, adding a playback control capable of playing the captured digital video to a communication thread within a second area of the touch screen display.

16. The mobile computing device as recited inclaim 15, further comprising:

detecting a tap touch gesture with the playback control; and

in response to the detected tap touch gesture with the playback control, playing the captured digital video in the communication thread.

17. The mobile computing device as recited inclaim 16, further comprising:

detecting a selection of a message input control from a palette of message input controls; and

in response to the detected selection, removing the camera viewfinder from the touch screen display.

18. A non-transitory computer readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, cause a computer system to:

provide a viewfinder displaying a live data stream from a camera of the computing system in a first area of a messaging graphical user interface; and

in response to a first user interaction with the viewfinder:

capture, by the camera of the computing system, a multimedia content item; and

send the captured multimedia content item as an electronic message.

19. The non-transitory computer readable storage medium as recited in18, further comprising computer-executable instructions that, when executed cause the computer system to:

detect a tap touch gesture within the viewfinder;

in response to the detected tap touch gesture, capture the multimedia content item by capturing a digital photograph; and

add the captured digital photograph to a communication thread in a second area of the messaging graphical user interface.

20. The non-transitory computer readable storage medium as recited inclaim 18, further comprising computer-executable instructions that, when executed cause the computer system to:

detect a press-and-hold touch gesture within the viewfinder;

during a duration of the detected press-and-hold touch gesture, capture the multimedia content item by capturing a digital video; and

add a playback control capable of playing back the captured digital video to a communication thread in a second area of the messaging graphical user interface.

Images