US20170237986A1 - Video encoding method and electronic device adapted thereto - Google Patents

Abstract

A video encoding method and an electronic device adapted to the method are provided. The electronic device includes: a wireless communication circuit configured to communicate with a first electronic device, a touchscreen configured to display a user interface for performing a video call, a speaker, a microphone, one or more processors electrically connected to the communication circuit, the touchscreen, the speaker, and the microphone, and a memory electrically connected to the one or more processors, wherein the memory stores instructions that, when executed, cause the one or more processors to: receive a signal related to an incoming video call from the first electronic device via the wireless communication circuit, receive a user input accepting the video call via the user interface, transmit a signal accepting the video call to the first electronic device via the wireless communication circuit in response to the user input, receive a video stream from the first electronic device via the wireless communication circuit, wherein the video stream has been adapted at the first electronic device, based at least partly on: status information on the electronic device and/or status information on wireless communication between the electronic device and the first electronic device, display the received video stream on the touchscreen while providing voice from the video call, using the speaker, receive voice, using the microphone, and transmit the received voice to the first electronic device, using the wireless communication circuit.

Description

CROSS-REFERENCE TO RELATED APPLICATION
• This application is based on and claims priority under 35 U.S.C. §119 to Korean Patent Application No. 10-2016-0015656 filed on Feb. 11, 2016, in the Korean Intellectual Property Office, and Korean Patent Application No. 10-2016-0110572 filed on Aug. 30, 2016, in the Korean Intellectual Property Office, the disclosures of which are incorporated by reference herein in their entireties.
BACKGROUND1. Field
• The present disclosure relates generally to a video encoding method and an electronic device adapted to the method.
2. Description of Prior Art
• With the development of mobile communication technology and hardware technology for electronic devices, a real-time video call is possible between electronic devices and high-resolution video data can also be transmitted in real time between electronic devices.
• When a real-time video call is connected between electronic devices, the electronic device takes videos of the users via the cameras, encodes the taken video data, and transmits the encoded video data to each party's electronic devices via a network. A real time video call may refer, for example, to a video call allowing two or more users to make a video all to each other in such a way that users' electronic devices synchronize video data with voice data, compress the data, and transmit the compressed data to each other in streaming mode.
• During the video call between two electronic devices, the electronic devices take videos, encode the videos, and transmit the encoded data to each other.
• However, when an electronic device encodes video data suitable for playing back between stationary devices with high resolution and large battery capacity (level) and transmits the encoded data to a wearable device with low resolution and small (limited) battery capacity, the wearable device may have difficulty in playing back the encoded video data. The encoding process is suitable for playing back video data between electronic devices with high resolution and large battery capacity (level), but is not suitable for wearable devices with low resolution, low (limited) transfer rate, and small (limited) battery capacity to receive and play back encoded video data. That is, the wearable devices may take a relatively long time to receive video data encoded by and transmitted from the electronic device, due to the limited transfer rate and may consume an excessive amount of battery power.
SUMMARY
• The present disclosure addresses the above problems and disadvantages, and provides at least the advantages described below. Accordingly, the present disclosure provides a video encoding method and an electronic device adapted to the method.
• In accordance with an example aspect of the present disclosure, an electronic device is provided. The electronic device includes: a wireless communication circuit configured to communicate with a first electronic device, a touchscreen configured to display a user interface for performing a video call, a speaker, a microphone, one or more processors electrically connected to the communication circuit, the touchscreen, the speaker, and the microphone, and a memory electrically connected to the one or more processors, wherein the memory stores instructions that, when executed, cause the one or more processors to: receive a signal related to an incoming video call from the first electronic device via the wireless communication circuit, receive a user input accepting the video call via the user interface, transmit a signal accepting the video call to the first electronic device via the wireless communication circuit in response to the user input, receive a video stream from the first electronic device via the wireless communication circuit, wherein the video stream has been adapted at the first electronic device, based at least partly on: status information on the electronic device and/or status information on wireless communication between the electronic device and the first electronic device, display the received video stream on the touchscreen while providing voice from the video call, using the speaker, receive voice, using the microphone, and transmit the received voice to the first electronic device, using the wireless communication circuit.
BRIEF DESCRIPTION OF THE DRAWINGS
• The above and other aspects, features and attendant advantages of the present disclosure will be more apparent and readily understood from the following detailed description, taken in conjunction with the accompanying drawings, in which like reference numerals refer to like elements, and wherein:
• FIG. 1 is a diagram illustrating an example network environment according to various example embodiments of the present disclosure;
• FIG. 2 is a block diagram illustrating an example electronic device according to various example embodiments of the present disclosure;
• FIG. 3 is a block diagram illustrating an example program module according to various example embodiments of the present disclosure;
• FIG. 4 is a block diagram illustrating an example connection between first to third electronic devices according to various example embodiments of the present disclosure;
• FIG. 5 is a block diagram illustrating an example electronic device according to various example embodiments of the present disclosure;
• FIG. 6 is a signal flow diagram illustrating an example method for a first electronic device to encode a video, while transmitting/receiving signals to/from second and third electronic devices, according to various example embodiments of the present disclosure;
• FIG. 7 is a signal flow diagram illustrating an example method for a first electronic device to encode a video, while transmitting/receiving signals to/from second and third electronic devices, according to various example embodiments of the present disclosure;
• FIG. 8 is a signal flow diagram illustrating an example method for a first electronic device to encode a video, while transmitting/receiving signals to/from second and third electronic devices, according to various example embodiments of the present disclosure;
• FIG. 9 is a signal flow diagram illustrating an example method for a second electronic device to encode a video, while transmitting/receiving signals to/from first and third electronic devices, according to various example embodiments of the present disclosure;
• FIG. 10 is a diagram illustrating an example method of encoding video data in a first electronic device according to various example embodiments of the present disclosure;
• FIG. 11 is a diagram illustrating an example method of encoding video data in a first electronic device according to various example embodiments of the present disclosure;
• FIG. 12 is a diagram illustrating an example method of reproducing encoded video data in a third electronic device according to various example embodiments of the present disclosure;
• FIG. 13 is a diagram illustrating an example method of encoding video data in a second electronic device according to various example embodiments of the present disclosure;
• FIG. 14A is a diagram illustrating an example method of encoding video data in a second electronic device according to various example embodiments of the present disclosure;
• FIG. 14B is a diagram illustrating an example post process according to various example embodiments of the present disclosure;
• FIG. 15 is a diagram illustrating an example method of encoding video data in a second electronic device according to various example embodiments of the present disclosure;
• FIG. 16 is a flowchart illustrating an example method of reproducing video data in a third electronic device according to various example embodiments of the present disclosure;
• FIGS. 17A and 17B are diagrams illustrating an example method of encoding video data in a second electronic device according to various example embodiments of the present disclosure;
• FIG. 18 is a diagram illustrating an example method of encoding video data in a second electronic device according to various example embodiments of the present disclosure;
• FIGS. 19A and 19B are diagrams illustrating an example user interface related to the reception/transmission of a video call according to various example embodiments of the present disclosure;
• FIGS. 20A, 20B, 20C and 20D are diagrams illustrating an example user interface for receiving a video call according to various example embodiments of the present disclosure;
• FIG. 20E is a flowchart illustrating an example method of performing a video call in a third electronic device according to various example embodiments of the present disclosure;
• FIGS. 21A and 21B are diagrams illustrating an example user interface depending on pressure levels of the user input according to various example embodiments of the present disclosure;
• FIG. 21C is a flowchart illustrating example functions depending on pressure levels of the user input according to various example embodiments of the present disclosure;
• FIG. 21D is a flowchart illustrating example functions depending on pressure levels of the user input according to various example embodiments of the present disclosure;
• FIG. 21E is a flowchart illustrating example functions depending on directions in which a user input is detected, according to various example embodiments of the present disclosure;
• FIG. 22A are diagrams illustrating an example user interface including an indicator indicating the quality of video call according to various example embodiments of the present disclosure;
• FIG. 22B is a flowchart illustrating an example method of adjusting the quality of video call according to various example embodiments of the present disclosure;
• FIGS. 23A and 23B are diagrams illustrating an example user interface for switching a video call device according to various example embodiments of the present disclosure;
• FIG. 23C is a flowchart illustrating an example method of switching a video call to a fourth electronic device according to various example embodiments of the present disclosure;
• FIG. 24 is a diagram illustrating example operations of switching a video call to a fourth electronic device according to various example embodiments of the present disclosure;
• FIG. 25 is a signal flow diagram illustrating an example method of switching a video call to a fourth electronic device, flowing signals between first, second and fourth electronic devices, according to various example embodiments of the present disclosure;
• FIG. 26 is a signal flow diagram illustrating an example method of switching a video call to a fourth electronic device using an account management server, flowing signals between first, second and fourth electronic devices, according to various example embodiments of the present disclosure;
• FIG. 27 is a diagram illustrating an example user interface when a third electronic device discovers nearby electronic devices and switches a video call to an electronic device, according to various example embodiments of the present disclosure;
• FIG. 28 is a diagram illustrating example connections among first to fourth electronic devices according to various example embodiments of the present disclosure;
• FIG. 29 is a flowchart illustrating an example multiple connection method according to various example embodiments of the present disclosure;
• FIG. 30 is a flowchart illustrating an example method of storing video data according to various example embodiments of the present disclosure; and
• FIG. 31 is a diagram illustrating an example configuration of software according to various example embodiments of the present disclosure.
DETAILED DESCRIPTION
• Hereinafter, the present disclosure is described with reference to the accompanying drawings. Although various example embodiments are illustrated in the drawings and related detailed descriptions are discussed in the disclosure, the present disclosure may have various modifications and several embodiments. However, various embodiments of the present disclosure are not limited to a specific implementation form and it should be understood that the present disclosure includes all changes and/or equivalents and substitutes included in the spirit and scope of various embodiments of the present disclosure. In connection with descriptions of the drawings, similar components are designated by the same reference numeral.
• In various embodiments of the present disclosure, the terms such as “include”, “have”, “may include” or “may have” may be construed to denote a certain characteristic, number, step, operation, constituent element, component or a combination thereof, but may not be construed to exclude the existence of or a possibility of addition of one or more other characteristics, numbers, steps, operations, constituent elements, components or combinations thereof.
• In various embodiments of the present disclosure, the expression “or” or “at least one of A or/and B” includes any or all of combinations of words listed together. For example, the expression “A or B” or “at least A or/and B” may include A, may include B, or may include both A and B.
• The expression “1”, “2”, “first”, or “second” used in various embodiments of the present disclosure may modify various components of the various embodiments but does not limit the corresponding components. For example, the above expressions do not limit the sequence and/or importance of the components. The expressions may be used for distinguishing one component from other components. For example, a first user device and a second user device indicate different user devices although both of them are user devices. For example, without departing from the scope of the present disclosure, a first structural element may be referred to as a second structural element. Similarly, the second structural element also may be referred to as the first structural element.
• When it is stated that a component is “(operatively or communicatively) coupled to” or “connected to” another component, the component may be directly coupled or connected to another component or a new component may exist between the component and another component. On the other hand, when it is stated that a component is “directly coupled to” or “directly connected to” another component, a new component does not exist between the component and another component. In the present disclosure, the expression “configured (or set) to do” may be used interchangeably with, for example, “suitable for doing,” “having the capacity to do,” “designed to do,” “adapted to do,” “made to do,” or “capable of doing.” The expression “configured (or set) to do” may not necessarily be used to refer to only something in hardware for which it is “specifically designed to do.” Instead, the expression “a device configured to do” may indicate that the device is “capable of doing” something with other devices or parts. For example, the expression “a processor configured (or set) to do A, B and C” may refer to a dedicated processor (e.g., an embedded processor) or a generic-purpose processor (e.g., CPU or application processor or any other processing circuitry) that may execute one or more software programs stored in a memory device to perform corresponding functions.
• According to various embodiments, examples of the electronic device may include a smartphone, a tablet Personal Computer (PC), a mobile phone, a video phone, an electronic book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a Personal Digital Assistant (PDA), a Portable Multimedia Player (PMP), an MP3 player, a medical device, a camera, and a wearable device, or the like, but is not limited thereto. Examples of the wearable device may include an accessory type device (such as, watch, ring, bracelet, ankle bracelet, necklace, glasses, contact lens, and Head-Mount Device (HMD)), a textile or clothes type device (such as electronic clothes), a body-attached type (such as skin pad and tattoo), and a bio-implemented type, or the like, but is not limited thereto. According to an embodiment, examples of the electronic device may include a television, a Digital Video Disc (DVD) player, an audio player, a refrigerator, an air conditioner, a cleaner, an oven, a microwave oven, a laundry machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a media box (such as Samsung HomeSync™, apple TV™, and google TV™), a game console (such as Xbox™ and PlayStation™), an electronic dictionary, an electronic key, a camcorder, and an electronic frame, or the like, but is not limited thereto.
• According to an embodiment, examples of the electronic device may include a medical device (such as portable medical sensors (including glucometer, heart rate sensor, tonometer, and body thermometer), Magnetic Resonance Angiography (MRA) device, Magnetic Resonance Imaging (MRI) device, Computed Tomography (CT) device, camcorder, and microwave scanner), a navigation device, a Global navigation Satellite System (GNSS), an Event Data Recorder (EDR), a Flight Data Recorder (FDR), an automotive infotainment device, marine electronic equipment (such as marine navigation system and gyro compass), aviation electronics (avionics), an automotive head unit, an industrial or household robot, an Automatic Teller Machine (ATM), a Point Of Sales (POS) terminal, and an Internet-of-Things (IoT) device (such as electric bulb, sensor, sprinkler system, fire alarm system, temperature controller, street lamp, toaster, fitness equipment, hot water tank, heater, and boiler), or the like, but is not limited thereto.
• According to an embodiment, examples of the electronic device may include furniture, a building/structure, a part of a vehicle, an electronic board, an electronic signature receiving device, a projector, and a sensor (such as water, electricity, gas, and electric wave meters), or the like, but is not limited thereto. According to various embodiments, the electronic device may be flexible or a combination of at least two of the aforementioned devices. According to an embodiment, the electronic device is not limited to the aforementioned devices.
• In the disclosure, the term “user” may denote a person who uses the electronic device or a device (e.g., artificial intelligent electronic device) which uses the electronic device.
• FIG. 1 is a diagram illustrating an example network environment including electronic devices according to various example embodiments.
• Referring toFIG. 1, electronic device (anelectronic device101, a firstexternal device102 and a second external device104) orserver106 may be connected withnetwork162 through short-range communication164.
• Theelectronic device101, in anetwork environment100, includes abus110, a processor (e.g., including processing circuitry)120, amemory130, an input/output interface (e.g., including input/output circuitry)150, adisplay160, and a communication interface (e.g., including communication circuitry)170. According to some embodiments, theelectronic device101 may omit at least one of the components or further include another component.
• Thebus110 may be a circuit connecting the above described components110-170 and transmitting communication (e.g., a control message or data) between the above described components.
• Theprocessor120 may include various processing circuitry, such as, for example, and without limitation one or more of a dedicated processor, a central processing unit (CPU), application processor (AP) or communication processor (CP). For example, theprocessor120 may control at least one component of theelectronic device101 and/or execute calculation relating to communication or data processing.
• Thememory130 may include volatile and/or non-volatile memory. For example, thememory130 may store command or data relating to at least one component of theelectronic device101. According to some embodiment, thememory130 may store software and/orprogram140. For example, theprogram140 may include akernel141,middleware143, an application programming interface (API)145, and/or anapplication147 and so on. At least one portion of thekernel141, themiddleware143 and theAPI145 may be defined as operating system (OS).
• Thekernel141 controls or manages system resources (e.g., thebus110, theprocessor120, or the memory130) used for executing an operation or function implemented by the remaining other program, for example, themiddleware143, theAPI145, or theapplication147. Further, thekernel141 provides an interface for accessing individual components of theelectronic device101 from themiddleware143, theAPI145, or theapplication147 to control or manage the components.
• Themiddleware143 performs a relay function of allowing theAPI145 or theapplication147 to communicate with thekernel141 to exchange data. Further, in operation requests received from theapplication147, themiddleware143 performs a control for the operation requests (e.g., scheduling or load balancing) by using a method of assigning a priority, by which system resources (e.g., thebus110, theprocessor120, thememory130 and the like) of theelectronic device101 may be used, to theapplication147.
• TheAPI145 is an interface by which theapplication147 may control a function provided by thekernel141 or themiddleware143 and includes, for example, at least one interface or function (e.g., command) for a file control, a window control, image processing, or a character control.
• The input/output interface150 may include various input/output circuitry configured to provide an interface to transmit command or data input by a user or another external device to another component(s) of theelectronic device101. Further, the input/output interface150 may output the command or data received from the another component(s) of theelectronic device101 to the user or the another external device.
• Thedisplay160 may include, for example, liquid crystal display (LCD), light emitting diode (LED), organic LED (OLED), or micro electro mechanical system (MEMS) display, or electronic paper display, or the like, but is not limited thereto. Thedisplay160 may display, for example, various contents (text, image, video, icon, or symbol, and so on) to a user. Thedisplay160 may include a touch screen, and receive touch, gesture, approaching, or hovering input using a part of body of the user.
• Thecommunication interface170 may include various communication circuitry configured to set communication of theelectronic device101 and external device (e.g., a firstexternal device102, a secondexternal device104, or a server1106). For example, thecommunication interface170 may be connected with thenetwork162 through wireless communication or wire communication and communicate with the external device (e.g., a secondexternal device104 or server106).
• Wireless communication may use, as cellular communication protocol, at least one of LTE (long-term evolution), LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), GSM (Global System for Mobile Communications), and the like, for example. A short-range communication164 may include, for example, at least one of Wi-Fi, Bluetooth, Near Field Communication (NFC), Magnetic Secure Transmission or near field Magnetic data Stripe Transmission (MST), and Global Navigation Satellite System (GNSS), and the like. The GNSS may include at least one of, for example, a Global Positioning System (GPS), a Global navigation satellite system (Glonass), a Beidou Navigation Satellite System (hereinafter, referred to as “Beidou”), and Galileo (European global satellite-based navigation system). Hereinafter, the “GPS” may be interchangeably used with the “GNSS” in the disclosure. Wired communication may include, for example, at least one of USB (universal serial bus), HDMI (high definition multimedia interface), RS-232 (recommended standard-232), POTS (plain old telephone service), and the like. Thenetwork162 may include telecommunication network, for example, at least one of a computer network (e.g., LAN or WAN), internet, and a telephone network.
• Each of the firstexternal device102 and the secondexternal device104 may be same type or different type of device with theelectronic device101. According to some embodiment, theserver106 may include one or more group of servers. According to various embodiment, at least one portion of executions executed by the electronic device may be performed by one or more electronic devices (e.g., externalelectronic device102,104, or server106). According to some embodiments, when theelectronic device101 should perform a function or service automatically, theelectronic device101 may request performing of at least one function to another device (e.g., externalelectronic device102,104, or server106). The another device (e.g., externalelectronic device102,104, or server106) may perform the requested function or additional function, and may transfer a result of the performance to theelectronic device101. Theelectronic device101 may additionally process the received result to provide the requested function or service. For the above, cloud computing technology, distributed computing technology, or client-server computing technology may be used, for example.
• FIG. 2 is a block diagram illustrating an example electronic device according to various example embodiments.
• Referring toFIG. 2, anelectronic device201 may include, for example, a whole or a part of theelectronic device101 illustrated inFIG. 1. Theelectronic device201 includes one or more APs (e.g., including processing circuitry)210, a communication module (e.g., including communication circuitry)220, a subscriber identification module (SIM)card224, amemory230, asensor module240, an input device (e.g., including input circuitry)250, adisplay260, an interface (e.g., including interface circuitry)270, anaudio module280, acamera module291, apower managing module295, abattery296, anindicator297, and amotor298.
• TheAP210 may include various processing circuitry and operates an OS or an application program so as to control a plurality of hardware or software component elements connected to theAP210 and execute various data processing and calculations including multimedia data. TheAP210 may be implemented by, for example, a system on chip (SoC). According to an embodiment, theprocessor210 may further include a graphics processing unit (GPU) and/or image signal processor. TheAP210 may include at least one portion of components illustrated inFIG. 2 (e.g., a cellular module221). TheAP210 may load command or data received from at least one of another component (e.g., non-volatile memory), store various data in the non-volatile memory.
• Thecommunication module220 may include the same or similar components with thecommunication interface170 ofFIG. 1. Thecommunication module220 may include various communication circuitry therein, such as, for example, and without limitation, acellular module221, a Wi-Fi module223, aBT module225, aGPS module227, a NFC module228, and a radio frequency (RF)module229.
• Thecellular module221 provides a voice, a call, a video call, a short message service (SMS), or an internet service through a communication network (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro, GSM and the like). Further, thecellular module221 may distinguish and authenticate electronic devices within a communication network by using a SIM (e.g., the SIM card224). According to an embodiment, thecellular module221 performs at least some of the functions which may be provided by theAP210. For example, thecellular module221 may perform at least some of the multimedia control functions. According to an embodiment, thecellular module221 may include a CP.
• Each of the Wi-Fi module223, theBT module225, theGPS module227, and the NFC module228 may include, for example, a processor for processing data transmitted/received through the corresponding module.
• According to various embodiments, at least part of thecellular module221, the Wi-Fi module223, theBT module225, theGPS module227, and the NFC module228 may be included in one integrated chip (IC) or one IC package.
• TheRF module229 transmits/receives data, for example, an RF signal. Although not illustrated, theRF module229 may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), antenna and the like.
• According to various embodiments, at least one of thecellular module221, the Wi-Fi module223, theBT module225, theGPS module227, and the NFC module228 may transmit/receive an RF signal through a separate RF.
• TheSIM card224 may refer, for example, to a card including a SIM and may be inserted into a slot formed in a particular portion of the electronic device. TheSIM card224 includes unique identification information (e.g., integrated circuit card identifier (ICCID)) or subscriber information (e.g., international mobile subscriber identity (IMSI).
• The memory230 (e.g., memory130) may include aninternal memory232 and/or anexternal memory234. The internal memory1232 may include, for example, at least one of a volatile memory (e.g., a random access memory (RAM), a dynamic RAM (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM), and the like), and a non-volatile Memory (e.g., a read only memory (ROM), a one time programmable ROM (OTPROM), a programmable ROM (PROM), an erasable and programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM), a mask ROM, a flash ROM, a not and (NAND) flash memory, a not or (NOR) flash memory, etc.), a hard drive, a solid state drive (SSD), etc.
• According to an embodiment, theexternal memory234 may further include a flash drive, for example, a compact flash (CF), a secure digital (SD), a micro-SD, a mini-SD, an extreme digital (xD), or a memory stick. The external memory1234 may be functionally connected to theelectronic device201 through various interfaces. According to an embodiment, theelectronic device201 may further include a storage device (or storage medium) such as a hard drive.
• Thesensor module240 measures a physical quantity or detects an operation state of theelectronic device201, and converts the measured or detected information to an electronic signal. Thesensor module240 may include, for example, at least one of agesture sensor240A, agyro sensor240B, an atmospheric pressure (barometer)sensor240C, amagnetic sensor240D, anacceleration sensor240E, agrip sensor240F, aproximity sensor240G, acolor sensor240H (e.g., red, green, and blue (RGB) sensor)240H, a biometric sensor240I, a temperature/humidity sensor240J, an illuminance (e.g., light)sensor240K, and a ultraviolet (UV)sensor240M. Additionally or alternatively, thesensor module240 may include, for example, an E-nose sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris sensor, a fingerprint sensor (not illustrated), and the like. Thesensor module240 may further include a control circuit for controlling one or more sensors included in thesensor module240. In embodiments, theelectronic device201 is capable of including a processor, configured as part of theprocessor210 or a separate component, for controlling thesensor module240. In this case, while theprocessor210 is operating in sleep mode, the processor is capable of controlling thesensor module240.
• Theinput device250 may include various input circuitry, such as, for example, and without limitation, atouch panel252, a (digital)pen sensor254, a key256, and anultrasonic input device258. For example, thetouch panel252 may recognize a touch input in at least one type of a capacitive type, a resistive type, an infrared type, and an acoustic wave type. Thetouch panel252 may further include a control circuit. In the capacitive type, thetouch panel252 may recognize proximity as well as a direct touch. Thetouch panel252 may further include a tactile layer. In this event, thetouch panel252 provides a tactile reaction to the user.
• The (digital)pen sensor254 may be implemented, for example, using a method identical or similar to a method of receiving a touch input of the user, or using a separate recognition sheet. The key256 may include, for example, a physical button, an optical key, or a key pad. Theultrasonic input device258 is a device which may detect an acoustic wave by a microphone (e.g., a microphone288) through an input means generating an ultrasonic signal to identify data and may perform wireless recognition.
• The display260 (e.g., display160) includes apanel262, a hologram unit ordevice264, and aprojector266. Thepanel262 may be implemented to be, for example, flexible, transparent, or wearable. Thepanel262 may also be incorporated into one module together with thetouch panel252. The According to one embodiment, thepanel262 may include a pressure sensor (or force sensor) capable of measuring the intensity of the pressure on the user's touch. The pressure sensor may be integrated with thetouch panel252, or may be implemented by one or more sensors separate from thetouch panel252. Thehologram device264 shows a stereoscopic image in the air by using interference of light. Theprojector266 projects light on a screen to display an image. For example, the screen may be located inside or outside theelectronic device201. According to an embodiment, thedisplay260 may further include a control circuit for controlling thepanel262, thehologram device264, and theprojector266.
• Theinterface270 may include various interface circuitry, such as, for example, and without limitation, aHDMI272, anUSB274, anoptical interface276, and a D-subminiature (D-sub)278. Theinterface270 may be included in, for example, thecommunication interface170 illustrated inFIG. 1. Additionally or alternatively, theinterface270 may include, for example, a mobile high-definition link (MHL) interface, an SD card/multi-media card (MMC), or an infrared data association (IrDA) standard interface.
• Theaudio module280 bi-directionally converts a sound and an electronic signal. At least some components of theaudio module280 may be included in, for example, the input/output interface150 illustrated inFIG. 1. Theaudio module280 processes sound information input or output through, for example, aspeaker282, areceiver284, anearphone286, themicrophone288 and the like.
• Thecamera module291 is a device which may photograph a still image and a video. According to an embodiment, thecamera module291 may include one or more image sensors (e.g., a front sensor or a back sensor), an image signal processor (ISP) (not shown) or a flash (e.g., an LED or xenon lamp).
• Thepower managing module295 manages power of theelectronic device201. Although not illustrated, thepower managing module295 may include, for example, a power management integrated circuit (PMIC), a charger IC, or a battery or fuel gauge.
• The PMIC may be mounted to, for example, an integrated circuit or a SoC semiconductor. A charging method may be divided into wired and wireless methods. The charger IC charges a battery and prevent over voltage or over current from flowing from a charger. According to an embodiment, the charger IC includes a charger IC for at least one of the wired charging method and the wireless charging method. The wireless charging method may include, for example, a magnetic resonance method, a magnetic induction method and an electromagnetic wave method, and additional circuits for wireless charging, for example, circuits such as a coil loop, a resonant circuit, a rectifier and the like may be added.
• The battery fuel gauge measures, for example, a remaining quantity of thebattery296, or a voltage, a current, or a temperature during charging. Thebattery296 may store or generate electricity and supply power to theelectronic device201 by using the stored or generated electricity. Thebattery296 may include a rechargeable battery or a solar battery.
• Theindicator297 shows particular statuses of theelectronic device201 or a part (e.g., AP210) of theelectronic device201, for example, a booting status, a message status, a charging status and the like. Themotor298 converts an electrical signal to a mechanical vibration. Although not illustrated, theelectronic device201 may include a processing unit (e.g., GPU) for supporting a module TV. The processing unit for supporting the mobile TV may process, for example, media data according to a standard of digital multimedia broadcasting (DMB), digital video broadcasting (DVB), media flow and the like.
• Each of the components of the electronic device according to various embodiments may be implemented by one or more components and the name of the corresponding component may vary depending on a type of the electronic device. The electronic device according to various embodiments may include at least one of the above described components, a few of the components may be omitted, or additional components may be further included. Also, some of the components of the electronic device according to various embodiments may be combined to form a single entity, and thus may equivalently execute functions of the corresponding components before being combined.
• FIG. 3 is a block diagram illustrating an example programming module according to various example embodiments.
• Referring toFIG. 3, aprogramming module310 may be included, e.g. stored, in theelectronic apparatus100, e.g. thememory130, as illustrated inFIG. 1. At least a part of the programming module310 (e.g., program140) may be realized by software, firmware, hardware, and/or combinations of two or more thereof. Theprogramming module310 may include an OS that is implemented in hardware, e.g., the hardware200 to control resources related to an electronic device, e.g., theelectronic device100, and/or various applications. e.g.,application147, driven on the OS. For example, the OS may be Android, iOS, Windows, Symbian, Tizen, Bada, and the like.
• Referring toFIG. 3, theprogramming module310 may include a kernel320 (e.g.,kernel141, middleware330 (e.g., middleware143), an API360 (e.g., API145), and the applications370 (e.g., application147). At least part of theprogram module310 may be preloaded on the electronic device or downloaded from a server (e.g., anelectronic device102,104,server106, etc.).
• Thekernel320 may include asystem resource manager321 and/or adevice driver323. Thesystem resource manager321 may control, allocate, and/or collect system resources. Thesystem resource manager321 may include, for example, a process manager, a memory manager, and a file system manager. Thedevice driver323 may include, for example, a display driver, a camera driver, a BT driver, a shared memory driver, a USB driver, a keypad driver, a Wi-Fi driver, and an audio driver. Further, according to an embodiment, thedevice driver323 may include an inter-process communication (IPC) driver (not illustrated).
• Themiddleware330 may include a plurality of modules implemented in advance for providing functions commonly used by theapplications370. Further, themiddleware330 may provide the functions through theAPI360 such that theapplications370 may efficiently use restricted system resources within the electronic apparatus. For example, as illustrated inFIG. 3, themiddleware330 may include at least one of aruntime library335, anapplication manager341, awindow manager342, amultimedia manager343, aresource manager344, apower manager345, adatabase manager346, apackage manager347, a connectivity (e.g., connection)manager348, anotification manager349, alocation manager350, agraphic manager351, and asecurity manager352.
• Theruntime library335 may include a library module that a compiler uses in order to add a new function through a programming language while one of theapplications370 is being executed. According to an embodiment, theruntime library335 may perform an input/output, memory management, and/or a function for an arithmetic function.
• Theapplication manager341 may manage a life cycle of at least one of theapplications370. Thewindow manager342 may manage graphical user interface (GUI) resources used by a screen. Themultimedia manager343 may detect formats used for reproduction of various media files, and may perform encoding and/or decoding of a media file by using a codec suitable for the corresponding format. Theresource manager344 may manage resources such as a source code, a memory, and a storage space of at least one of theapplications370.
• Thepower manager345 may manage a battery and/or power, while operating together with a basic input/output system (BIOS), and may provide power information used for operation. Thedatabase manager346 may manage generation, search, and/or change of a database to be used by at least one of theapplications370. Thepackage manager347 may manage installation and/or an update of an application distributed in a form of a package file.
• For example, theconnectivity manager348 may manage wireless connectivity such as Wi-Fi or BT. Thenotification manager349 may display and/or notify of an event, such as an arrival message, a promise, a proximity notification, and the like, in such a way that does not disturb a user. Thelocation manager350 may manage location information of an electronic apparatus. Thegraphic manager351 may manage a graphic effect which will be provided to a user, and/or a user interface related to the graphic effect. Thesecurity manager352 may provide all security functions used for system security and/or user authentication. According to an embodiment, when an electronic apparatus, e.g., theelectronic apparatus100, has a telephone call function, themiddleware330 may further include a telephony manager (not illustrated) for managing a voice and/or video communication function of the electronic apparatus.
• Themiddleware330 may generate and use a new middleware module through various functional combinations of the aforementioned internal element modules. Themiddleware330 may provide modules specialized according to types of OSs in order to provide differentiated functions. Further, themiddleware330 may dynamically remove some of the existing elements and/or add new elements. Accordingly, themiddleware330 may exclude some of the elements described in the various embodiments, further include other elements, and/or substitute the elements with elements having a different name and performing a similar function.
• TheAPI360 is a set of API programming functions, and may be provided with a different configuration according to the OS. For example, in a case of Android or iOS, one API set may be provided for each of platforms, and in a case of Tizen, two or more API sets may be provided.
• Theapplications370 may include one or more applications for performing various functions, e.g.,home371,dialer372, SMS/MMS373, instant message (IM)374,browser375,camera376,alarm377, contact378,voice dial379,email380,calendar381,media player382,album383,clock384, health care (e.g., an application for measuring amount of exercise, blood sugar level, etc.), and environment information (e.g., an application for providing atmospheric pressure, humidity, temperature, etc.), not shown.
• According to an embodiment, theapplications370 are capable of including an application for supporting information exchange between an electronic device and an external device, which is hereafter called ‘information exchange application’. The information exchange application is capable of including a notification relay application for relaying specific information to external devices or a device management application for managing external devices.
• For example, the notification relay application is capable of including a function for relaying notification information, created in other applications of the electronic device to external devices. In addition, the notification relay application is capable of receiving notification information from external devices to provide the received information to the user.
• The device management application is capable of managing (e.g., installing, removing or updating) at least one function of an external device communicating with the electronic device. Examples of the function are a function of turning-on/off the external device or part of the external device, a function of controlling the brightness (or resolution) of the display, applications running on the external device, services provided by the external device, etc. Examples of the services are a call service, messaging service, etc.
• According to an embodiment, theapplications370 are capable of including an application (e.g., a health care application of a mobile medical device, etc.) specified attributes of an external device. According to an embodiment, theapplications370 are capable of including applications received from an external device. According to an embodiment, theapplications370 are capable of including a preloaded application or third party applications that can be downloaded from a server. It should be understood that the components of theprogram module310 may be called different names according to types of operating systems.
• According to various embodiments, at least part of theprogram module310 can be implemented with software, firmware, hardware, or any combination of two or more of them. At least part of theprogram module310 can be implemented (e.g., executed) by a processor (e.g., processor210). At least part of theprograming module310 may include modules, programs, routines, sets of instructions or processes, etc., in order to perform one or more functions.
• The term “module” used in the disclosure may refer to, for example, a unit including at least one combination of hardware (e.g., circuitry), software, and firmware. The “module” may be interchangeably used with a term, such as unit, logic, logical block, component, and/or circuit. The “module” may be a minimum unit of an integrally configured article and/or a part thereof. The “module” may be a minimum unit performing at least one function and/or a part thereof. The “module” may be mechanically and/or electronically implemented. For example, the “module” according to the disclosure may include at least one of processing circuitry (e.g., a CPU), a dedicated processor, an application-specific IC (ASIC) chip, a field-programmable gate arrays (FPGA), and a programmable-logic device for performing operations which has been known and/or are to be developed.
• According to various embodiments, at least some of the devices (e.g., modules or functions thereof) or the method (e.g., operations) according to the disclosure may be implemented by a command stored in a computer-readable storage medium in a programming module form. When the instructions are executed by at least one processor (e.g., the processor120), the at least one processor may perform functions corresponding to the instructions. The computer-readable storage medium may be, for example, thememory130. At least a part of the programming module may be implemented (e.g., executed) by, for example, theprocessor120. At least some of the programming modules may include, for example, a module, a program, a routine, a set of instructions or a process for performing one or more functions.
• The computer-readable recording medium may include magnetic media such as a hard disk, a floppy disk, and a magnetic tape, optical media such as a compact disc ROM (CD-ROM) and a DVD, magneto-optical media such as a floptical disk, and hardware devices specially configured to store and perform a program instruction (e.g., programming module), such as a ROM, a RAM, a flash memory and the like. In addition, the program instructions may include high class language codes, which may be executed in a computer by using an interpreter, as well as machine codes made by a compiler. The aforementioned hardware device may be configured to operate as one or more software modules in order to perform the operation of the disclosure, and vice versa.
• The module or programming module of the disclosure may include at least one of the aforementioned components with omission of some components or addition of other components. The operations of the modules, programming modules, or other components may be executed in series, in parallel, recursively, or heuristically. Also, some operations may be executed in different order, omitted, or extended with other operations.
• FIG. 4 is a block diagram illustrating an example connection between first to third electronic devices according to various embodiments of the present disclosure.
• With reference toFIG. 4, various embodiments of the present disclosure are described assuming that: a firstelectronic device401 is an electronic device (calling electronic device) transmitting a video call request signal; a secondelectronic device403 is an electronic device (referred to herein as electronic device) receiving the video call request signal from the firstelectronic device401; and a thirdelectronic device405 is an electronic device, connected to the secondelectronic device403, which receives the video call request signal from the secondelectronic device403 and performs a video call with the firstelectronic device401. For example, the thirdelectronic device405 may be a wearable device whose display size is, for example, less than or equal to 4 inches.
• In various embodiments of the present disclosure, the firstelectronic device401 and the secondelectronic device403 are connected to each other via afirst network411, e.g., 3G or LTE network. The secondelectronic device403 and the thirdelectronic device405 are connected to each other via asecond network413, e.g., a low-power network, such as a Bluetooth or Wi-Fi network.
• In various embodiments of the present disclosure, the thirdelectronic device405 has a display which is smaller in size than those of the firstelectronic device401 and the secondelectronic device403. For example, the thirdelectronic device405 has a display size of 4 inches. The firstelectronic device401 and the secondelectronic device403 have a display size of 7 inches. The smaller the display size of the thirdelectronic device405, the lower the resolution that the thirdelectronic device405 supports compared to the firstelectronic device401 and the secondelectronic device403. As described above, the thirdelectronic device405 is capable of operating according to: a signal detected via its sensor; or a control signal received from the secondelectronic device403 via thesecond network413, e.g., a low power network such as Bluetooth or Wi-Fi network.
• In various embodiments of the present disclosure, video data, related to a video call performed by the thirdelectronic device405 connected to the first and secondelectronic devices401 and403 via thesecond network413, may be processed (e.g., encoded) by the firstelectronic device401 or the secondelectronic device403.
• Processing video data related to a video call performed by the firstelectronic device401 will be described in greater detail below with reference toFIGS. 6 to 8.
• Processing video data related to a video call performed by the secondelectronic device403 will be described in greater detail below with reference toFIG. 9.
• FIG. 5 is a block diagram illustrating an example electronic device according to various embodiments of the present disclosure.
• With reference toFIG. 5, the electronic device may include awireless communication circuit510, amemory520, atouchscreen530, asensor540, acamera550, anaudio processing560, and aprocessor570.
• In various embodiments of the present disclosure, the electronic device serves as: an electronic device (calling electronic device) making a video call request, e.g., the firstelectronic device401 illustrated inFIG. 4; an electronic device (called electronic device) receiving the video call request, e.g., the secondelectronic device403 illustrated inFIG. 4; and an electronic device accepting the video call request and performing a video call, e.g., the thirdelectronic device405 illustrated inFIG. 4.
• In various embodiments of the present disclosure, the wireless communication circuit510 (e.g., the communication interfaces170 and220 illustrated inFIGS. 1 and 2, respectively) may include various communication circuitry and is capable of connecting to (including) first and second networks. The first network is capable of connecting, in communication, an electronic device (calling electronic device) making a video call request, e.g., the firstelectronic device401 illustrated inFIG. 4, and an electronic device (called electronic device) receiving the video call request, e.g., the secondelectronic device403 illustrated inFIG. 4. The second network is capable of connecting, in communication, the electronic device (called electronic device) receiving the video call request, e.g., the secondelectronic device403 illustrated inFIG. 4, and an electronic device accepting the video call request and performing a video call, e.g., the thirdelectronic device405 illustrated inFIG. 4. The electronic devices are capable of transmitting/receiving a video call request signal and the acceptance signal in response to the video call request signal to/from each other via the first and second networks. The electronic devices are capable of transmitting/receiving video data for a video call and information regarding the electronic devices to/from each other via the first and second networks.
• In various embodiments of the present disclosure, the memory520 (e.g., thememory130 illustrated inFIG. 1 and thememory230 illustrated inFIG. 2) is capable of storing information regarding at least one electronic device capable of performing a video call, e.g., a type of electronic device, a display size, a form (e.g., a circle, a rectangle, a square, or the like), the battery capacity; the screen resolution, CPU power consumption, etc. Thememory520 is also capable of mapping and storing a function or a user interface, displayed according to: a direction in which the user input is detected, a user input, a duration of the user input, a level of a hovering input, or a pressure level of the user input.
• In various embodiments of the present disclosure, thetouchscreen530 is capable of including a display unit531 (e.g., displays160 and260 illustrated inFIGS. 1 and 2 respectively) and a touch panel533 (e.g., theinput module250 illustrated inFIG. 2), configuring into a single body.
• In various embodiments of the present disclosure, thedisplay unit531 is capable of displaying a user interface for controlling functions related to a video call. Thedisplay unit531 is capable of displaying video data for performing a video call. When thedisplay unit531 detects a user input under the control of theprocessor570, it is capable of displaying a user interface, based on a duration of the detected user input, a pressure level of the detected user input, or a direction in which the user input is detected. When thedisplay unit531 detects a hovering input under the control of theprocessor570, it is capable of analyzing a level of the detected hovering input and displaying a user interface mapped to the analyzed hovering input level.
• In various embodiments of the present disclosure, the sensor540 (e.g., thesensor module240 illustrated inFIG. 2) is capable of measuring a physical quantity or detecting an operation state of the electronic device, and converting the measured or detected physical quantity into an electrical signal. Thesensor540 is capable of including at least one of the following: a gesture sensor, a gyro sensor, an acceleration sensor, and a geomagnetic sensor. In various embodiments of the present disclosure, when thesensor540 includes a geomagnetic sensor, the electronic device is capable of measuring a movement angle of its head via the geomagnetic sensor. When thesensor540 includes an acceleration sensor and a gyro sensor, the electronic device is capable of detecting its movement via the acceleration sensor and the gyro sensor. Thesensor540 is capable of transferring, to theprocessor570, the sensed information according to the movement of the electronic device and the measured movement angle of the electronic device. Thesensor540 is capable of collecting external environment information of the electronic device, including at least one of the following: weather information, brightness information, and sound information.
• In various embodiments of the present disclosure, when the electronic device serves as a first electronic device401 (e.g., a calling electronic device making a video call request), theprocessor570 controls: the camera550 (e.g., thecamera module291 illustrated inFIG. 2) to take a video of a subject; and thewireless communication circuit510 to transmit the video data taken from the subject to the secondelectronic device403.
• In various embodiments of the present disclosure, when the electronic device serves as a third electronic device405 (e.g., an electronic device accepting a video call request and performing a video call), theprocessor570 controls: thecamera550 to take a video of a subject; and thewireless communication circuit510 to transmit the video data taken from the subject to the secondelectronic device403. Thecamera550 is capable of recognizing at least one of the following: a user's face and a user's iris from the video data taken from a subject. In various embodiments of the present disclosure, the audio processing unit560 (e.g., theaudio module280 illustrated inFIG. 2) is connected to a speaker (SPK)561 and/or a microphone (MIC)563. Thespeaker561 outputs audio signals transmitted/received during the call (transmission sound or reception sound), audio signals including a received message, audio signals when an audio file stored in the memory433 is played, etc. The microphone563 receives a user's voice or other audios.
• In various embodiments of the present disclosure, when theaudio processing unit560 receives a voice for controlling functions related to a video call via the microphone563, it is capable of transferring the voice signal to theprocessor570. Theaudio processing unit560 is capable of extracting voices from the video data received from the firstelectronic device401, under the control of theprocessor570, and outputting the extracted voices via thespeaker561. Theaudio processing unit560 is capable of outputting, via thespeaker561, audio signals related to a notification of switching to a video call, the reception of a video call, etc.
• In various embodiments of the present disclosure, when the electronic device serves as a first electronic device401 (e.g., a calling electronic device making a video call request), the processor570 (e.g.,processors120 and210 illustrated inFIGS. 1 and 2 respectively) is capable of requesting the video call connection from the second electronic device403 (e.g., a called electronic device receiving the video call request) or the third electronic device405 (e.g., an electronic device accepting the video call request and performing a video call), via thewireless communication circuit510. When theprocessor570 receives an acceptance signal in response to the video call connection request from the secondelectronic device403 or the thirdelectronic device405, it is capable of obtaining status information regarding the secondelectronic device403, status information regarding the thirdelectronic device405, and network connection information.
• In various embodiments of the present disclosure, theprocessor570 is capable of determining an encoding scheme for video data (e.g., video stream) taken by thecamera550, based on the obtained information. Theprocessor570 is capable of encoding video data, based on the determined encoding scheme, and transmitting the encoded video data to the secondelectronic device403 or the thirdelectronic device405. Theprocessor570 is capable of creating a number of images, extracting audio signals, based on the video data, and transmitting the created and extracted result to the secondelectronic device403 or the thirdelectronic device405. Theprocessor570 is capable of: detecting at least one of the following, a maximum resolution, a maximum picture quality, and a maximum fps, supported by the secondelectronic device403 or the thirdelectronic device405; adjusting at least one of the maximum resolution, the maximum picture quality, and the maximum fps, based on status information regarding the second network; and encoding video data based on at least one of the adjusted resolution, the adjusted picture quality, and the adjusted fps. In various embodiments of the present disclosure, when theprocessor570 receives video data for the thirdelectronic device405 from the secondelectronic device403, it is capable of determining an encoding scheme, based on the received video data, and encoding the video data based on the determined encoding scheme. In various embodiments of the present disclosure, when theprocessor570 receives a value for adjusting quality of video data (e.g., a value of change in picture quality, a value of change in resolution, a value of change in fps) from the secondelectronic device403, it is capable of encoding the video data based on the received quality adjustment value and a transfer rate based on the network states, and transmitting the encoded video data to the secondelectronic device403.
• It should be understood that the operation of determining an encoding scheme and the operation of encoding video data based on the determined encoding scheme, described above, may also be applied to the secondelectronic device403 in the same ways as the firstelectronic device401.
• In various embodiments of the present disclosure, in a state where the electronic device serves as a second electronic device403 (e.g., a called electronic device receiving the video call request), when theprocessor570 receives a video call request signal from the first electronic device401 (e.g., a calling electronic device making a video call request) via thewireless communication circuit510, theprocessor570 is capable of transmitting the video call request signal to the third electronic device405 (e.g., an electronic device accepting the video call request and performing a video call). When theprocessor570 receives an acceptance signal in response to the video call connection request from the thirdelectronic device405, it is capable of transmitting the acceptance signal to the firstelectronic device401. Theprocessor570 is capable of forwarding controls signals and video data for a video call between the first and thirdelectronic devices401 and405.
• In various embodiments of the present disclosure, when the electronic device serves as a third electronic device405 (e.g., an electronic device accepting the video call request and performing a video call), theprocessor570 is capable of receiving a video call request signal from the second electronic device403 (e.g., a called electronic device receiving the video call request) viawireless communication circuit510. When theprocessor570 detects a user input accepting the video call request, it is capable of transmitting an acceptance signal in response to the video call request to the secondelectronic device403. Theprocessor570 is capable of: receiving video data, encoded based on information the second network and status information regarding the thirdelectronic device405, from the secondelectronic device403; and reproducing the received video data. In various embodiments of the present disclosure, theprocessor570 is capable of: receiving a number of images and audio signals, created based on information the second network and status information regarding the thirdelectronic device405, from the secondelectronic device403; and reproducing the received images and audio signals.
• In various embodiments of the present disclosure, theprocessor570 takes a video of a subject via thecamera550 and transmits the video data taken from the subject to the secondelectronic device403. Theprocessor570 is capable of encoding video data, based on status information regarding the thirdelectronic device405 and status information regarding the second network, and transmitting the encoded video data to the secondelectronic device403. In various embodiments of the present disclosure, theprocessor570 is capable of displaying the encoded video data and an indicator for adjusting the quality of the video data. Theprocessor570 is capable of detecting an input for adjusting the quality of video data via the indicator. Theprocessor570 is capable of determining a quality adjustment value corresponding to the detected input (e.g., a value of change in picture quality, a value of change in resolution, a value of change in fps), and transmitting the determined value to the secondelectronic device403. Theprocessor570 is capable of receiving video data, encoded based on the adjusted quality value, from the secondelectronic device403, and reproducing the encoded video data. Theprocessor570 is capable of detecting the movement of the thirdelectronic device405 via thesensor540. Theprocessor570 collects sensed information regarding the movement of the thirdelectronic device405 and reproduces video data and/or audio signals, based on the sensed information. For example, when theprocessor570 ascertains that the sensed information regarding the movement of the electronic device is within a preset range, it reproduces the audio signals and stores the video data in thememory520. When theprocessor570 ascertains that the sensed information regarding the movement of the electronic device is not within a preset range, it reproduces video data stored in thememory520. When theprocessor570 detects a signal for switching a video call currently in progress to other devices, it is capable of searching for and displaying at least one electronic device to which the video call can be switched. When theprocessor570 detects an input selecting an electronic device to be switched for the video call from among one or more electronic devices which is/are displayed, for a preset period of time, it is capable of transmitting a video call switching signal to the selected electronic device. On the other hand, when theprocessor570 has not detected an input selecting an electronic device to be switched for the video call from among one or more electronic devices which is/are displayed, for a preset period of time, it is capable of capable of: analyzing status information regarding the one or more electronic devices which are displayed, information status regarding the second network; assigning the priority to electronic devices; and automatically selecting an electronic device with higher priority as an electronic device to be switched for the video call.
• In various embodiments of the present disclosure, an electronic device is implemented to include: a wireless communication circuit configured to communicate with a first electronic device, a touchscreen configured to display a user interface for performing a video call, a speaker, a microphone, one or more processors electrically connected to the communication circuit, the touchscreen, the speaker, and the microphone, and a memory electrically connected to the one or more processors. The memory stores instructions that, when executed, cause the one or more processors to: receive a signal related to an incoming video call from the first electronic device via the wireless communication circuit, receive a user input accepting the video call via the user interface, transmit a signal accepting the video call to the first electronic device via the wireless communication circuit in response to the user input, receive a video stream from the first electronic device via the wireless communication circuit, the video stream has been adapted at the first electronic device, based at least partly on: status information on the electronic device and/or status information on wireless communication between the electronic device and the first electronic device, display the received video stream on the touchscreen while providing voice from the video call, using the speaker, receive voice, using the microphone, and transmit the received voice to the first electronic device, using the wireless communication circuit.
• According to various embodiments, the instructions further cause the one or more processors to: detect an alteration in a state of the electronic device or an alteration in a state of the wireless communication, and receive a video steam, which differs from the received video stream by at least one of: a resolution, picture quality, and a frame rate, from the first electronic device via the wireless communication circuit, the status information on the electronic device includes at least one of: a type of the electronic device, a size of the touchscreen, processing power of the processor, a maximum resolution of the touchscreen, a battery status or level, memory status or capacity, or presence/absence of a camera, and the status information on the communication includes a video call quality level for performing a video call.
• According to various embodiments, the electronic device further includes a camera. The instructions further cause the one or more processors to: adapt a video stream taken by the camera, based at least partly on the status information on the electronic device and the status information on the wireless communication circuit, and transmit the adapted video stream to the first electronic device via the communication.
• According to various embodiments, the instructions further cause the one or more processors to: detect at least one of a face or an iris of the user via the camera while receiving the video stream, and display the received video stream on the touchscreen only while at least one of a face or an iris of the user is detected.
• According to various embodiments, the instructions further cause the one or more processors to: display an indicator to adjust a quality of the received video stream, detect an input for adjusting the quality of video stream via the indicator, determine an encoding scheme corresponding to the adjusted quality of video stream, transmit the determined encoding scheme to the first electronic device, receive a video stream, adapted based on the encoding scheme, from the first electronic device, and display the received video stream.
• According to various embodiments, the instructions further cause the one or more processors to: set a region of interest (ROI) in the displayed video stream, transmit the ROI to the first electronic device, receive, from the first electronic device, a video stream, adapted based on at least one of: focus, crop, change in picture quality, or exposure adjustment, with respect to the ROI, and display the received video stream.
• According to various embodiments, the electronic device further includes at least one motion sensor. The instructions further cause the one or more processors to: detect orientation of the electronic device using the sensor, while receiving the video stream, and display the received video stream on the touchscreen only while the detected orientation is in a selected range.
• According to various embodiments, the instructions further cause the one or more processors to: display the received video stream, receive a user input for forwarding the video call, display at least one external display device to which the video call can be forwarded, receive a user selection of one of the at least one external display device, and forward the video call to the selected external display device.
• According to various embodiments, the instructions further cause the one or more processors to: analyze the status information on the electronic device and the status information on the wireless communication, and display a selectable the user interface on the touchscreen, the user interface is indicative of at least one operation related to the video call, based on the analyzed status information on the electronic device and the analyzed status information on the wireless communication, the operation is related to at least one of a quality of the video stream, a voice only call, a video call using a second electronic device, or a voice call using the second electronic device.
• According to various embodiments, the instructions further cause the one or more processors to: receive another video call request via the first electronic device from a third electronic device while performing the video call, detect an input for accepting the received video call request, further receive a video stream of the other video call via the first electronic device from the third electronic device, and display a screen of the video call on a first region of the touchscreen, and another screen of the other video call on a second region of the touchscreen.
• According to various embodiments, the electronic device further includes at least one motion sensor. The instructions further cause the one or more processors to: detect an input pressing against the touchscreen while providing voice from the video call, using the speaker, determine a pressure level of the detected input, and perform an operation, based at least partly on the detected pressure level.
• According to various embodiments, the instructions further cause the one or more processors to: detect a touch gesture input using the touchscreen, while providing voice from the video call, using the speaker, determine a direction of the input, and perform an operation, based at least partly on the detected direction.
• According to various embodiments, the instructions further cause the one or more processors to: detect an input via the touchscreen for storing at least a portion of the received video stream, and transmit, to the first electronic device, a request for storing, in the first electronic device, the at least a portion of the video stream, the request includes information on time when the input is detected.
• According to various embodiments, the instructions further cause the one or more processors to: detect a touch gesture input using the touchscreen, while providing voice from the video call, using the speaker, determine a direction of the input, and perform an operation, based at least partly on the detected direction.
• According to various embodiments, the instructions further cause the one or more processors to: detect an input via the touchscreen for storing at least a portion of the received video stream, and transmit, to the first electronic device, a request for storing, in the first electronic device, the at least a portion of the video stream, the request includes information on time when the input is detected.
• According to various embodiments, the instructions further cause the one or more processors to: receive, from the first electronic device, information on at least one electronic device capable of performing the video call, display an indication of the at least one electronic device on the touchscreen, receive a user input for selecting one of the at least one electronic device, and transmit a signal for forwarding the video call to the selected electronic device to the first electronic device, using the wireless communication circuit.
• According to various embodiments, the wireless communication circuit comprises at least one of: a Bluetooth modem or Wi-Fi modem.
• According to various embodiments, the electronic device is smartwatch and the first electronic device is a smartphone.
• In various embodiments of the present disclosure, an electronic device is implemented to include: a first wireless communication circuit configured to communicate with a first electronic device, a second wireless communication circuit configured to communicate with a second electronic device, a touchscreen configured to display a user interface to perform a video call, a speaker, a microphone, one or more processors electrically connected to the first wireless communication circuit, a second wireless communication circuit, the touchscreen, the speaker, and the microphone, and a memory electrically connected to the one or more processors. The memory stores instructions that, when executed, cause the one or more processors to: receive a video call request from the first electronic device via the first wireless communication circuit, display the received video call request on the touchscreen, create a notification based on the received video call request, transmit the created notification to the second electronic device via the second wireless communication, receive a signal accepting the video call request from the second electronic device via the second wireless communication circuit, stop displaying the video call request in response to the received signal accepting the video call request, receive and adapt a video stream from the first electronic device, based at least partly on status information on the second electronic device and status information on the communication between the electronic device and the second electronic device, transmit the adapted video stream to the second electronic device via the second wireless communication circuit, and transmit voice, received from the second electronic device via the second wireless communication circuit, to the first electronic device via the first wireless communication circuit.
• According to various embodiments, the instructions further cause the one or more processors to: receive, from the second electronic device, at least one of a maximum resolution, a maximum level of picture quality, or a maximum frame rate (fps) of a video stream supported by the second electronic device, adapt at least one of a resolution, a level of picture quality, or a fps of the video stream within the at least one of a maximum resolution, a maximum level of picture quality, or a maximum fps, based at least partly on the status information on the communication.
• According to various embodiments, the instructions further cause the one or more processors to: receive, from a third electronic device, a video call forwarding request and information on the third electronic device, transmit video call connection information to the third electronic device, and transmit information on the third electronic device to the first electronic device via the first wireless communication circuit.
• In various embodiments of the present disclosure, an electronic device is implemented to include: a first wireless communication circuit configured to communicate with a first electronic device, a touchscreen configured to display a user interface to perform a video call, a speaker, a microphone, one or more processors electrically connected to the first wireless communication circuit, the touchscreen, the speaker, and the microphone, and a memory electrically connected to the one or more processors. The memory stores instructions that, when executed, cause the one or more processors to: transmit a video call request signal to the first electronic device via the first wireless communication circuit, via the first wireless communication circuit, receive, from the first electronic device, a signal accepting the video call request, status information on a second electronic device, and status information on communication between the first electronic device and the second electronic device, adapt a video stream, based at least partly on the received status information on the second electronic device and the received status information on the communication, transmit the adapted video stream to the first electronic device via the first wireless communication circuit, and receive a voice from the first electronic device.
• Although it is not shown inFIG. 5, it should be understood that the first to third electronic devices are capable of further including components for added functions, e.g., a Global Positioning System (GPS) module for receiving location information, a broadcast receiving module, etc.
• FIG. 6 is a signal flow diagram illustrating an example method for a first electronic device to encode a video, while transmitting/receiving signals to/from second and third electronic devices, according to various example embodiments of the present disclosure.
• In various embodiments of the present disclosure, when the first electronic device601 (e.g., the firstelectronic device401 illustrated inFIG. 4) needs to make a video call with the third electronic device605 (e.g., the thirdelectronic device405 illustrated inFIG. 4) which is connected to the second electronic device603 (e.g., the secondelectronic device403 illustrated inFIG. 4) via the second network (e.g., thesecond network413 illustrated inFIG. 4), it is capable of converting video data for the video call into video data suitable for the state of the thirdelectronic device605 or the state of the second network.
• In various embodiments of the present disclosure, the firstelectronic device601 may be identical or similar to part or the entire part of the firstelectronic device401. The secondelectronic device603 may be identical or similar to part or the entire part of the secondelectronic device403. The thirdelectronic device605 may be identical or similar to part or the entire part of the thirdelectronic device405.
• With reference toFIG. 6, the firstelectronic device601 is capable of making a video call connection request to the secondelectronic device603 via the first network (e.g., thefirst network411 illustrated inFIG. 4) inoperation611. The secondelectronic device603 is capable of transmitting, to the thirdelectronic device605 via the second network, a notification notifying that a video call connection request has been received from the firstelectronic device601 inoperation613. The thirdelectronic device605 accepts the video call connection request and transmits the acceptance signal to the secondelectronic device603 inoperation615. The secondelectronic device603 forwards the received video call connection acceptance signal to the firstelectronic device601 inoperation617.
• In various embodiments of the present disclosure, the firstelectronic device601 is capable of obtaining: status information regarding the secondelectronic device603 from the secondelectronic device603; status information regarding the thirdelectronic device605 connected to the secondelectronic device603 via the second network; and network connection information. The status information regarding the secondelectronic device603 may contain at least one of the following: type information, display size, processing power, supporting maximum resolution, battery status (e.g., battery level), memory status, and presence/absence of a camera. The status information regarding the thirdelectronic device605 may contain at least one of the following: type information, display size, processing power, supporting maximum resolution, battery status (e.g., battery level), memory status, and presence/absence of a camera. The network connection information may contain status information regarding the first or second network.
• In various embodiments of the present disclosure, the firstelectronic device601 is capable of determining an encoding scheme, based on the obtained information, inoperation619. The firstelectronic device601 is capable of encoding (e.g., adapting) video data for performing a video call, based on the determined encoding scheme, inoperation621, and transmitting the encoded (e.g., adapted) video data to the secondelectronic device603 inoperation623.
• In various embodiments of the present disclosure, the encoding scheme may include a transcoding scheme, a scalable encoding scheme, or a mirroring scheme. The firstelectronic device601 is capable of encoding video data based on at least one of the transcoding scheme, the scalable encoding scheme, and the mirroring scheme. The secondelectronic device603 is capable of forwarding the encoded video data, received from the firstelectronic device601, to the thirdelectronic device605 inoperation625. The thirdelectronic device605 is capable of playing back the encoded video data, received from the secondelectronic device603, inoperation627.
• The process of encoding video data via the transcoding scheme will be described in detail later with reference toFIGS. 10 to 16.
• The process of encoding video data via the scalable encoding scheme will be described in greater detail below with reference toFIGS. 17A and 17B.
• The process of encoding video data via the mirroring scheme will be described in detail later with reference toFIG. 18.
• In various embodiments of the present disclosure, the thirdelectronic device605 is capable of receiving a voice using the microphone (e.g., the microphone563) inoperation629, and transmitting the voice signal to the secondelectronic device603 inoperation631. The secondelectronic device603 is capable of forwarding the received voice signal to the firstelectronic device601 inoperation633.
• In various embodiments of the present disclosure, when the thirdelectronic device605 is configured to include a camera, it is capable of encoding videos taken by the camera, and transmitting the encoded video data along with a voice signal to the secondelectronic device603. For example, as described above referring to 4, the thirdelectronic device605 may support a lower resolution than the firstelectronic device601 and the secondelectronic device603 do. When the resolution that the thirdelectronic device605 supports is lower than the resolution that the firstelectronic device601 and the secondelectronic device603 support, the thirdelectronic device605 is capable of encoding video data transferred from the camera into video data of low quality which can be reproduced with relatively low power. The thirdelectronic device605 is capable of transmitting the video data encoded in low quality along with a voice signal to the secondelectronic device603. It should be understood that the present disclosure is not limited to the embodiments. The thirdelectronic device605 may also encode video data transferred from the camera into images or an image sequence, and transmit, to the secondelectronic device603, the images along with a voice signal or the image sequence along with a voice signal.
• FIG. 7 is a signal flow diagram illustrating an example method for a first electronic device to encode a video, while transmitting/receiving signals to/from second and third electronic devices, according to various example embodiments of the present disclosure.
• In various embodiments of the present disclosure, when the first electronic device701 (e.g., the firstelectronic device401 illustrated inFIG. 4 or the firstelectronic device601 illustrated inFIG. 6) needs to make a video call with the third electronic device705 (e.g., the thirdelectronic device405 illustrated inFIG. 4 or the thirdelectronic device605 illustrated inFIG. 6) which is connected to the second electronic device703 (e.g., the secondelectronic device403 illustrated inFIG. 4 or the secondelectronic device603 illustrated inFIG. 6) via the second network (e.g., the second network413), it is capable of converting its video data for a video call into video data suitable for the thirdelectronic device705, based on information regarding the thirdelectronic device705 received from aserver711.
• In various embodiments of the present disclosure, theserver711 is capable of managing electronic devices capable of performing a video call, based on user accounts. For example, theserver711 is capable of monitoring an electronic device registered based on a user account, and updating status information regarding the electronic device, in real-time, based on the monitoring result. That is, theserver711 is capable of monitoring the electronic device and determining whether the electronic device is possible to perform a video call, based on the status information regarding the electronic device. The status information regarding the electronic device may include a state indicating whether the electronic device is currently in use, a state indicating whether the electronic device is turned on/off, a state indicating whether the user is away from the electronic device, etc. The firstelectronic device701 is capable of selecting an electronic device to perform a video call from, e.g., a phonebook, based on the status information regarding the electronic device updated by theserver711, and transmitting a video call request signal to the selected electronic device.
• With reference toFIG. 7, the thirdelectronic device705 is capable of transmitting a registration request to the secondelectronic device703 inoperation721. For example, the thirdelectronic device705 is capable of requesting the secondelectronic device703 to register the thirdelectronic device705 as an electronic device capable of performing a video call in theserver711. When the secondelectronic device703 receives a registration request from the thirdelectronic device705 inoperation721, it is capable of making an update request to theserver711 inoperation723. For example, the secondelectronic device703 is capable of requesting theserver711 to register or update information regarding the thirdelectronic device705 therein. Theserver711 is capable of requesting the firstelectronic device701 to update information regarding the thirdelectronic device705, based on the updated information regarding the thirdelectronic device705, inoperation725.
• In various embodiments of the present disclosure, the firstelectronic device701 is capable of making a video call request to a specified electronic device, based on information registered in theserver711, e.g., information regarding electronic devices capable of performing a video call. For example, the firstelectronic device701 is capable of updating information regarding the secondelectronic device703 or the thirdelectronic device705, received from theserver711, and identifying an electronic device capable of performing a video call, e.g., the thirdelectronic device705, based on the updated information. Theserver711 is capable of obtaining, from the secondelectronic device703, and storing at least one of the following: type information regarding the secondelectronic device703 and the thirdelectronic device705, display size, processing power, maximum resolution that the thirdelectronic device705 supports, battery status (e.g., battery level), memory status, presence/absence of a camera, status information regarding the first network (e.g., thefirst network411 illustrated inFIG. 4), and status information regarding the second network.
• The firstelectronic device701 is capable of determining the thirdelectronic device705 as an electronic device capable of performing a video call, and making a video call connection request to the secondelectronic device703 via the first network inoperation727. The secondelectronic device703 is capable of transmitting, to the thirdelectronic device705 via the second network, a notification notifying that a video call connection request has been received from the firstelectronic device701 inoperation729. The thirdelectronic device705 accepts the video call connection request and transmits the acceptance signal to the secondelectronic device703 inoperation731. The secondelectronic device703 forwards the received video call connection acceptance signal to the firstelectronic device701 inoperation733.
• The firstelectronic device701 is capable of determining an encoding scheme, based on information regarding the secondelectronic device703, information regarding the thirdelectronic device705 connected to the secondelectronic device703, and network connection information, stored in theserver711, inoperation735. The firstelectronic device701 is capable of encoding video data for performing a video call, based on the determined encoding scheme, inoperation737, and transmitting the encoded video data to the secondelectronic device703 inoperation739. The secondelectronic device703 is capable of forwarding the encoded video data, received from the firstelectronic device701, to the thirdelectronic device705 inoperation741. The thirdelectronic device705 is capable of playing back the encoded video data, received from the secondelectronic device703, inoperation743.
• In various embodiments of the present disclosure, the thirdelectronic device705 is capable of receiving a voice using the microphone (e.g., the microphone563) inoperation745, and transmitting the voice signal to the secondelectronic device703 inoperation747. The secondelectronic device703 is capable of forwarding the received voice signal to the firstelectronic device701 inoperation749.
• FIG. 8 is a signal flow diagram illustrating an example method for a first electronic device to encode a video, while transmitting/receiving signals to/from second and third electronic devices, according to various example embodiments of the present disclosure.
• With reference toFIG. 8, the first electronic device801 (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, or the firstelectronic device701 illustrated inFIG. 7) is capable of making a video call connection request to a second electronic device803 (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, or the secondelectronic device703 illustrated inFIG. 7) via the first network (e.g., thefirst network411 illustrated inFIG. 4) inoperation811. The secondelectronic device803 is capable of transmitting, to the thirdelectronic device805 via the second network (e.g., thesecond network413 illustrated inFIG. 4), a notification notifying that a video call connection request has been received from the firstelectronic device801 inoperation813. The thirdelectronic device805 accepts the video call connection request and transmits the acceptance signal to the secondelectronic device803 inoperation815.
• In various embodiments of the present disclosure, the thirdelectronic device805 is capable of transmitting video data of the thirdelectronic device805 along with the acceptance signal to the secondelectronic device803 inoperation815.
• In various embodiments of the present disclosure, the thirdelectronic device805 may be equipped with a camera. In this case, the thirdelectronic device805 is capable of transmitting video data obtained via the camera to the secondelectronic device803. For example, the thirdelectronic device805 is capable of encoding the obtained video data based on its status information and status information regarding the second network. The thirdelectronic device805 is capable of transmitting the encoded video data to the secondelectronic device803.
• In various embodiments of the present disclosure, the secondelectronic device803 is capable of forwarding the acceptance signal and the encoded video data, received from the thirdelectronic device805, to the firstelectronic device801 inoperation817. Alternatively, the thirdelectronic device805 is capable of only creating a voice signal and transmitting the voice signal to the secondelectronic device803.
• The firstelectronic device801 is capable of detecting the quality of video data encoded by the thirdelectronic device805, received from the secondelectronic device803, inoperation819. For example, the firstelectronic device801 is capable of detecting the received, encoded video data, in terms of the encoding scheme, the quality, or the size.
• The firstelectronic device801 is capable of determining an encoding scheme for video data to be transmitted, based on the detected video scheme, quality, or size, of the video data received from the thirdelectronic device805 inoperation821. It should be understood that the determination of an encoding scheme for video data to be transmitted is not limited to only information related to the video data listed above. That is, the firstelectronic device801 is also capable of determining an encoding scheme for video data, using display size and processing power of the thirdelectronic device805, maximum resolution that the thirdelectronic device805 supports, battery status (e.g., battery level), memory status, presence/absence of a camera, status information regarding the first network, and status information regarding the second network, received from the secondelectronic device803, as well as video data of the thirdelectronic device805, inoperation821.
• The firstelectronic device801 is capable of encoding video data, based on the determined encoding scheme, inoperation823, and transmitting the encoded video data to the secondelectronic device803 inoperation825. The secondelectronic device803 is capable of forwarding the encoded video data, received from the firstelectronic device801, to the thirdelectronic device805 inoperation827. The thirdelectronic device805 is capable of playing back the encoded video data, received from the secondelectronic device803, inoperation829. The thirdelectronic device805 is capable of receiving a voice using the microphone (e.g., the microphone563) inoperation831, and transmitting the voice signal to the secondelectronic device803 inoperation833. The secondelectronic device803 is capable of forwarding the received voice signal to the firstelectronic device801 inoperation835.
• FIG. 9 is a signal flow diagram illustrating an example method for a second electronic device to encode a video, while transmitting/receiving signals to/from first and third electronic devices, according to various example embodiments of the present disclosure.
• In various embodiments of the present disclosure, when the second electronic device903 (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, or the secondelectronic device803 illustrated inFIG. 8) needs to make a video call with the third electronic device905 (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, or the thirdelectronic device805 illustrated inFIG. 8) which is connected to the secondelectronic device903 and the first electronic device901 (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7 or the firstelectronic device801 illustrated inFIG. 8), via the second network (e.g., thesecond network413 illustrated inFIG. 4), it is capable of converting video data for performing a video call into video data suitable for the thirdelectronic device905.
• With reference toFIG. 9, the firstelectronic device901 is capable of making a video call connection request to the secondelectronic device903 via the first network (e.g., thefirst network411 illustrated inFIG. 4) inoperation911. The secondelectronic device903 is capable of transmitting, to the thirdelectronic device905 via the second network, a notification notifying that a video call connection request has been received from the firstelectronic device901 inoperation913. The thirdelectronic device905 accepts the video call connection request and transmits the acceptance signal to the secondelectronic device903 inoperation915. The secondelectronic device903 forwards the received video call connection acceptance signal to the firstelectronic device901 inoperation917.
• In various embodiments of the present disclosure, the firstelectronic device901 is capable of transmitting video data for video call, obtained via the camera, to the secondelectronic device903 inoperation919. The secondelectronic device903 is capable of determining an encoding scheme for encoding video data received from the firstelectronic device901, based on status information regarding the third electronic device905 (e.g., type, screen size, processing power, maximum resolution, battery status, memory status, presence/absence of a camera, etc. of the third electronic device905), status information regarding the first network, status information regarding the second network, inoperation921. The secondelectronic device903 is capable of encoding video data for performing a video call based on the determined encoding scheme inoperation923, and transmitting the encoded video data to the thirdelectronic device905 inoperation925. The thirdelectronic device905 is capable of playing back the received video data inoperation927. When the thirdelectronic device905 receives a voice using the microphone (e.g., the microphone563) inoperation929, it is capable of transmitting the voice signal to the secondelectronic device903 inoperation931. The secondelectronic device903 is capable of forwarding the received voice signal to the firstelectronic device901 inoperation933.
• FIG. 10 is a diagram illustrating an example method of encoding video data in a first electronic device according to various example embodiments of the present disclosure;
• In various embodiments of the present disclosure, the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8 or the firstelectronic device901 illustrated inFIG. 9) or the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8 or the secondelectronic device903 illustrated inFIG. 9) is capable of converting video data of the first electronic device into video call suitable for the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8 or the thirdelectronic device905 illustrated inFIG. 9) using a transcoding scheme.
• Although the embodiment ofFIG. 10 is described assuming that the first electronic device encodes video data, it should be understood that the present disclosure is not limited to the embodiment. The video data encoding method may also be applied to the second electronic device in the same way as the first electronic device.
• In various embodiments of the present disclosure, the first or second electronic device is suitable for playback of video data which has a resolution of Full HD (1920×1080) or HD (1280×720) and a frame rate of 30 frames per second (fps). The third electronic device is suitable for playback of video data which has a resolution of QVGA (320×204), CIF (352×288), or QCIF (176×240) and a frame rate of 15 or 30 fps, without the degradation of picture quality. Since the third electronic device has a smaller screen size and a lower resolution than the first or second electronic device does, it does not need to play back video data in the same resolution of Full HD (1920×1080) or HD (1280×720) and at the frame rate of 30 fps as the first or second electronic device does. When the second and third electronic devices are connected to each other via the second network (e.g., thesecond network413 illustrated inFIG. 4), e.g., a low-power network such as Bluetooth or Wi-Fi network, the second electronic device has difficulty in securing a transfer rate for streaming a large size file to the third electronic device, and the third electronic device consumes a large amount of battery power when streaming and playing video data of high picture quality, which depletes its battery level.
• In an embodiment, the third electronic device is capable of playing back video data which has a resolution of QVGA (320×204), CIF (352×288), or QCIF (176×240) and a frame rate of 15 or 30 fps, on its relatively small size screen, efficiently, without the degradation of picture quality. Since the third electronic device has a relatively small size screen playing back video data, the user may have difficulty in finding the degradation of picture quality which is caused as video data is compressed at a relatively high compression ratio. In order to resolve the problem, various embodiments of the present disclosure are capable of reducing a file size of video stream and thus decreasing a bandwidth required for streaming. Therefore, various embodiments have advantages in an environment where the network quality is low or a network whose bandwidth is used for low-power connection.
• In various embodiments of the present disclosure, a transcoding scheme parameter is used to convert video data of the first electronic device into video data suitable for the third electronic device using a transcoding scheme. The transcoding scheme parameter may include picture quality (a compression ratio), fps (the number of frames per second), resolution (resize), focus, or crop.
• In various embodiments of the present disclosure, the first electronic device is capable of determining a transcoding scheme parameter used for the encoding, based on: information regarding the third electronic device (e.g., a type of the third electronic device, display size, presence/absence of a camera, processing power, supporting codec, current battery level, memory usage, the number of applications in use, or a type of application), connected to the second electronic device via the second network, or the second electronic device; information (state/signal quality) regarding the first network (e.g., thefirst network411 illustrated inFIG. 4) connecting the first and second electronic devices; and information (state/signal quality) regarding the second network connecting the second and third electronic devices.
• With reference toFIG. 10, the first electronic device is capable of detecting a maximum frame rate (fps), a maximum level of picture quality, or a maximum resolution of video data, which may be required by the third electronic device, inoperation1001.
• The first electronic device is capable of determining an available transfer rate (bit rate), based on a network state inoperation1003. The network state may include information (state/signal quality) regarding the first network connecting the first and second electronic devices and information (state/signal quality) regarding the second network connecting the second and third electronic devices.
• In various embodiments of the present disclosure, the first electronic device is capable of determining I-frame refresh, picture quality, frame rate (fps), and resolution, corresponding to the determined transfer rate (bit rate). More specifically, the first electronic device is capable of determining a resolution for video data corresponding to the transfer rate (bit rate) inoperation1005, and resizing the video data based on the determined resolution inoperation1007. The first electronic device is capable of determining a frame rate (fps) for video data, corresponding to the transfer rate (bit rate) inoperation1009, and altering a frame rate for the video data, based on the determined frame rate inoperation1011. The first electronic device is capable of determining a level of picture quality (compression ratio) for video data corresponding to the transfer rate (bit rate) inoperation1013, and altering a compression ratio of the video data, based on the determined picture quality(compression ratio) inoperation1015. The first electronic device is capable of determining I-frame refresh for video data, corresponding to the transfer rate (bit rate) inoperation1017.
• In various embodiments of the present disclosure, the first electronic device is capable of encoding video data, based on the altered resolution, the altered frame rate (fps), the altered picture quality, or the altered I-frame refresh inoperation1019. The first electronic device is capable of transmitting the encoded video data to the second electronic device via the first network inoperation1021.
• FIG. 11 is a diagram illustrating an example method of encoding video data in a first electronic device according to various embodiments of the present disclosure.
• With reference toFIG. 11, the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, or the firstelectronic device901 illustrated inFIG. 9) is capable of including anetwork interface1101, avideo call client1103, anetwork manager1105, avideo call manager1107, animage processor1109, acamera sensor1111, a capturedimage processing unit1113, acamera driver1115, anencoder driver1117, anencoder1119, and amemory1121.
• With reference toFIG. 11,reference number1131 represents the flow of a control signal andreference number1133 represents the flow of a video call signal from the first electronic device to the second electronic device1123 (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, or the secondelectronic device903 illustrated inFIG. 9).
• In various embodiments of the present disclosure, thenetwork manager1105 is capable of performing network connection management operations, e.g., connection establishment, connection monitoring, connection adjustments, connection tear down, etc. Thenetwork manager1105 is capable of creating packets from data to be transmitted, to comply with the network environment, and de-packeting and recovering received packets to corresponding signals. Thenetwork manager1105 is capable of measuring the network quality, using feedback data, such as packet loss information, round trip delay, etc. Thenetwork manager1105 is also capable of measuring the network quality via training sequences received at a certain interval from the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, or the thirdelectronic device905 illustrated inFIG. 9). . Thenetwork manager1105 transfers the measured network quality to thevideo call manager1107.
• In various embodiments of the present disclosure, thevideo call client1103 is an application for performing a video call. When thevideo call client1103 detects a user input for a video call, it is capable of transferring the user input signal to thevideo call manager1107.
• Thevideo call manager1107 is a module for controlling video call. Thevideo call manager1107 is capable of controlling thenetwork manager1105, theencoder driver1117, etc. to provide video call services. Thevideo call manager1107 is capable of controlling functions for performing a video call, based on user inputs received from thevideo call client1103. Thevideo call manager1107 is capable of loading information regarding the third electronic device from thememory1121 and performing a video call based on the loaded information. For example, thevideo call manager1107 is capable of controlling the quality of video data required for a video call, based on part of the information regarding the third electronic device stored in thememory1121.
• In order to perform a video call with the third electronic device, thevideo call manager1107 is capable of determining a required transfer rate (e.g., a maximum bit rate), based on the attributes of the third electronic device obtained from thenetwork manager1105, thememory1121, and thevideo call client1103. Thevideo call manager1107 is capable of detecting a network state of the second network (e.g., thesecond network413 illustrated inFIG. 4) via thenetwork manager1105, and determining a transfer rate (bit rate) based on the network state. Thevideo call manager1107 is capable of determining: a resolution, frame rate (fps) or picture quality corresponding to the determined transfer rate (bit rate); and an encoding scheme for encoding video data in theencoder1119, based on the determined resolution, frame rate (fps) or picture quality.
• In various embodiments of the present disclosure, thevideo call manager1107 is capable of controlling a vertical blanking interval (VBI) signal for thecamera sensor1111. Thevideo call manager1107 is capable of adjusting a frame rate in such a way that it controls a VBI of thecamera sensor1111 to drop frames of the video data input via thecamera sensor1111. For example, when the frame rate of video data received via thecamera sensor1111 is 30 fps, thevideo call manager1107 adjusts the frame rate from 30 fps to 15 fps, by dropping frames of the video data.
• In various embodiments of the present disclosure, thenetwork manager1105 is capable of adjusting a frame rate of video data which is being encoded, by controlling a buffer to drop frames. Thenetwork manager1105 is capable of adjusting a frame rate of received, encoded video data, by dropping the frames of the video data. For example, when thenetwork manager1105 receives encoded video data at a frame rate of 30 fps, it is capable of adjusting the frame rate to 15 fps, by dropping frames of the received video data.
• In various embodiments of the present disclosure, thecamera sensor1111 is capable of obtaining and transferring video data to the capturedimage processing unit1113. The capturedimage processing unit1113 is capable of transferring the received video data to theimage processor1109 via thecamera driver1115.
• In various embodiments of the present disclosure, thecamera sensor1111 is capable of obtaining video data during a certain interval and transmitting the obtained video data to theimage processor1109 via thecamera driver1115.
• In various embodiments of the present disclosure, theimage processor1109 is capable of adjusting the size and the picture quality of video data. Theimage processor1109 is capable of adjusting: the size of video data by cropping a screen; and the picture quality of video data, such as the reduction of image, the alteration in quantization level of image, etc., corresponding to the display ratio of the third electronic device. For example, the image processor1109: recognizes a user's face or an object from video data, determines a region of interest (ROI); and crops the image of the video data to comply with the attribute of the third electronic device, based on the ROI.
• Alternatively, theimage processor1109 is capable of applying different encoding schemes to the ROI and the other region, or a non-ROI, based on the ROI. That is, various embodiments of the present disclosure are capable of providing ROI with higher quality video for ROI than the other region (or non-ROI). More specifically, ROI is displayed in higher quality of video than non-ROI. Theimage processor1109 is capable of transferring the video data, adjusted in picture quality and size, to theencoder1119 via theencoder driver1117.
• In various embodiments of the present disclosure, theencoder1119 is capable of encoding the received adjusted video data, based on the encoding scheme, and transmitting the encoded video data to the second electronic device via thenetwork manager1105 and thenetwork interface1101.
• In various embodiments of the present disclosure, thememory1121 is implemented with volatile or non-volatile storage. Thememory1121 is capable of storing information regarding one or more electronic devices, e.g., wearable devices. Thememory1121 is also capable of storing various information regarding one or more electronic devices, such as a type of electronic device, a display size, a battery capacity (level), etc. The various information regarding one or more electronic devices may be used when thevideo call manager1107 controls a video call. The information regarding electronic devices may be obtained when the first or second electronic device discovers connectable devices or from a history of stored connection information. The information regarding electronic devices may contain information registered in the manufacturing process.
• FIG. 12 is a diagram illustrating an example method of reproducing encoded video data in a third electronic device according to various example embodiments of the present disclosure.
• In various embodiments of the present disclosure, the thirdelectronic device405 is capable of playing back the encoded video data received from the secondelectronic device403.
• With reference toFIG. 12, third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, or the thirdelectronic device905 illustrated inFIG. 9) is capable of including a network interface1201 (e.g., thenetwork interface1101 illustrated inFIG. 11), a network manager1203 (e.g., thenetwork manager1105 illustrated inFIG. 11), adecoder driver1205, adecoder1207, a video call client1209 (e.g., thevideo call client1103 illustrated inFIG. 11), and a video call manager1211 (e.g., thevideo call manager1107 illustrated inFIG. 11).
• In various embodiments of the present disclosure,reference number12211131 represents the flow of a control signal andreference number1223 represents the flow of signals for receiving and playing back encoded video data from the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, or the secondelectronic device1123 illustrated inFIG. 11).
• In various embodiments of the present disclosure, the third electronic device is capable of receiving video data optimized for the third electronic device, from the second electronic device via thenetwork manager1203. Thedecoder driver1205 and thedecoder1207 transfers the received video data to thevideo call client1209, thereby playing back the video data. The third electronic device is capable of transmitting its information or network quality-related status information regarding the second electronic device, via thenetwork manager1203. In various embodiments of the present disclosure, the third electronic device is capable of transmitting, to the second electronic device, network quality-related status information regarding its nearby other electronic devices and information regarding the nearby electronic devices.
• In various embodiments of the present disclosure, the third electronic device is capable of: determining a transcoding scheme parameter. The third electronic device is capable of transmitting the determined parameter to the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, or the firstelectronic device901 illustrated inFIG. 9) or the second electronic device; and requesting to encode the video data. The first or second electronic device is capable of encoding video data based on the parameter, in response to the encoding request received from the third electronic device, and transmitting the encoded video data to the third electronic device.
• FIG. 13 is a diagram illustrating an example method of encoding video data in a second electronic device according to various embodiments of the present disclosure.
• With reference toFIG. 13, the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, or the secondelectronic device1215 illustrated inFIG. 12) is capable of including a network interface1301 (e.g., thenetwork interface1101 illustrated inFIG. 11, or thenetwork interface1201 illustrated inFIG. 12), a network manager1303 (e.g., thenetwork manager1105 illustrated inFIG. 11, or thenetwork manager1203 illustrated inFIG. 12), atranscoder driver1305, an encoder/decoder1307, a video call manager1309 (e.g., thevideo call manager1107 illustrated inFIG. 11 or thevideo call manager1211 illustrated inFIG. 12), a video call client1311 (e.g., thevideo call client1103 illustrated inFIG. 11 or thevideo call client1209 illustrated inFIG. 12), and a memory1313 (e.g., thememory1121 illustrated inFIG. 11).
• In various embodiments of the present disclosure,reference number1321 represents the flow of a control signal.Reference number1323 represents the flow of a signal from the first electronic device1315 (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, or the firstelectronic device901 illustrated inFIG. 9) to the second electronic device.Reference number1325 represents the flow of a signal from the second electronic device to the third electronic device1317 (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, or the thirdelectronic device905 illustrated inFIG. 9).
• In various embodiments of the present disclosure, since thenetwork interface1301,network manager1303,video call manager1309,video call client1311, andmemory1311 are identical to thenetwork interface1101,network manager1105,video call client1103,video call manager1107, andmemory1121 which are described above referring toFIG. 11, their detailed description will be omitted below.
• In various embodiments of the present disclosure, thevideo call client1311 is an application for performing a video call. Thevideo call client1311 is capable of detecting inputs for selecting an electronic device in order to perform a video call and adjusting the quality of video data.
• In various embodiments of the present disclosure, thenetwork manager1303 is capable of performing network connection management operations, e.g., connection establishment, connection monitoring, connection adjustments, connection tear down, etc. Thenetwork manager1303 is capable of measuring the network quality, using feedback data, such as packet loss information, round trip delay, etc. Thenetwork manager1303 is also capable of measuring the network quality via training sequences received at a certain interval from the thirdelectronic device1317. Thenetwork manager1303 is capable of transferring the measured network quality to thevideo call manager1311.
• In various embodiments of the present disclosure, thetranscoder driver1305 is capable of: determining the picture quality, frame rate (fps) or resolution of video data, using the encoding parameter that thevideo call manager1311 determined based on encoding criterions (e.g., attribute information regarding the second electronic device and the thirdelectronic device1317, status information regarding the first network (e.g., thefirst network411 illustrated inFIG. 4), or status information regarding the second network (e.g., thesecond network413 illustrated inFIG. 4); and converting the video data into video data suitable for the thirdelectronic device1317, based on the determined picture quality, frame rate (fps) or resolution of video data.
• In various embodiments of the present disclosure, thememory1313 is capable of storing information regarding one or more electronic devices, e.g., a type of electronic device, a display size, a battery capacity, etc.
• Thevideo call manager1309 is a module for controlling video call. Thevideo call manager1309 is capable of controlling thenetwork manager1303, the encoder/decoder driver1307, etc. to provide video call services. Thevideo call manager1311 is capable of controlling functions for performing a video call, based on user inputs received from thevideo call client1311. Thevideo call manager1309 is capable of loading information regarding the thirdelectronic device1317, e.g., wearable device, from thememory1313, performing a video call, and controlling the quality of video data.
• Thevideo call manager1309 is capable of determining a required transfer rate (maximum bit rate) based on the attributes of the thirdelectronic device1317 in order to perform a video call using video data obtained from thenetwork manager1303, thememory1313, and thevideo call client1311. Thevideo call manager1309 is capable of estimating a quality level of the second network connecting the thirdelectronic device1317 and the second electronic device, from thenetwork manager1303, and determining an available transfer rate (bit rate), based on the estimated quality level. Thevideo call manager1309 is capable of determining: the picture quality, frame rate (fps) or resolution corresponding to the determined transfer rate (bit rate); and an encoding scheme for encoding video data, based on the determined picture quality, frame rate (fps) or resolution.
• In various embodiments of the present disclosure, thevideo call manager1309 is capable of adjusting the size and the picture quality of video data, via an image processor of thetranscoder driver1305. The image processor is capable of reducing the size in screen for video data to a certain ration or adjusting the picture quality of video data by altering the quantization level. Alternatively, the image processor: crops a screen of video data to adjust the size; recognizes a user's face or an object to set a region of interest (ROI); and crops the ROI, complying with the attribute of the thirdelectronic device1317, e.g., the display size.
• For example, it is assumed that the firstelectronic device1315 has a touchscreen whose height is larger than the width and the thirdelectronic device1317 has a touchscreen whose height and width are identical to each other, i.e., a square. In this case, the image processor of the firstelectronic device1315 sets an ROI (e.g., face), as a portrait shape, in a video, crops the set ROI from the video, and transmits the cropped video data to the thirdelectronic device1317. When the second electronic device does not detect or track the ROI from the video data, it may crop the center portion from the video data and transmit the center-cropped video data to the thirdelectronic device1317 or may transmit the video data without performing the cropping operation to the thirdelectronic device1317.
• In various embodiments of the present disclosure, the ROI may be set, based on a graphic tool for a rectangle, a circle, etc., a closed loop, a touch input, a duration of a touch input, etc.
• In various embodiments of the present disclosure, the second electronic device is capable of encoding the set ROI with different levels of quality. For example, when a user's face is set as an ROI, the image processor of the second electronic device adjusts quantization levels on the face and its neighboring part in such a way as to create: video data of high picture quality for the ROI; and video data of low picture quality for the non-ROI.
• In various embodiments of the present disclosure, the second electronic device is capable of receiving an ROI selected by the thirdelectronic device1317.
• In various embodiments of the present disclosure, one or more ROls may be set. The ROI may be altered during a video call.
• FIG. 14A is a diagram illustrating an example method of encoding video data in a second electronic device according to various embodiments of the present disclosure.
• In various embodiments of the present disclosure, the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, or the secondelectronic device1215 illustrated inFIG. 12) is capable of converting video data, e.g., video stream, received from the first electronic device1401 (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, or the firstelectronic device901 illustrated inFIG. 9), into analogue audio signals and digital still images and transmitting the analogue audio signals and digital still images to the third electronic device1413 (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, or the thirdelectronic device905 illustrated inFIG. 9). For example, the thirdelectronic device1413 is capable of: continuously outputting audio signals received from the second electronic device; and outputting video signals, asynchronous with the audio signals. For example, when the quality of the second network (e.g., thesecond network413 illustrated inFIG. 4) connecting the second electronic device and the thirdelectronic device1413 is a relatively low level or the battery level of the thirdelectronic device1413 is relatively low, the thirdelectronic device1413 outputs: audio signals in a continuous manner; and video signals in a manner asynchronous with the audio signals, thereby maintaining the video call service with a minimum of resources.
• With reference toFIG. 14A,reference number1421 represents the flow of a control signal.Reference number1423 represents the flow of a video call signal from the firstelectronic device1401 to the second electronic device.Reference number1425 represents the flow of signals transmitting encoded video data from the second electronic device to the thirdelectronic device1413.
• In various embodiments of the present disclosure, after the encoding process is performed, thedecoder1407 is capable of processing the video data process via apost process1406. For example, thepost process1406 is capable of creating a still image based on the video data decoded by thedecoder1407. Thedecoder1407 is capable of separating the video data received from thedecoder driver1405 into a voice signal and a video signal and decoding the separated signals. Thedecoder1407 is capable of transmitting the decoded voice signal to the thirdelectronic device1413 via a channel separated by thenetwork manager1403. Thedecoder1407 is capable of transferring the decoded video signal to thepost process1406. Thepost process1406 is capable of converting the video signal into a still image, and transmitting the still image to the thirdelectronic device1413, via thedecoder driver1405 and the network manager1403 (e.g., thenetwork manager1105 illustrated inFIG. 11, thenetwork manager1203 illustrated inFIG. 12, or thenetwork manager1303 illustrated inFIG. 13).
• Thepost process1406 is described in detail as follows, with reference toFIG. 14B.
• FIG. 14B is a diagram illustrating an example post process according to various embodiments of the present disclosure.
• With reference toFIG. 14B, thepost process1406 is capable of including an intra-frame (I-frame)extractor1415, acomparator1417, and animage creator1419.
• In various embodiments of the present disclosure,reference number1421 represents the flow of a control signal.Reference number1423 represents the flow of a video call signal from the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, or the firstelectronic device1401 illustrated inFIG. 14A) to the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, or the secondelectronic device1215 illustrated inFIG. 12).Reference number1425 represents the flow of signals transmitting encoded video data from the second electronic device to the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, or the thirdelectronic device1413 illustrated inFIG. 14A).
• In various embodiments of the present disclosure, the I-frame extractor1415, thecomparator1417, and theimage creator1419 are capable of transmitting/receiving control signals to/from thevideo call manager1409. The I-frame extractor1415 is capable of: receiving video data decoded by thedecoder1407; extracting an I-frame from the received video data; and transferring the I-frame to thecomparator1417.
• Thecomparator1417 is capable of comparing a previous I-frame, e.g., a first I-frame, with a current I-framed, e.g., a second I-frame, in terms of similarity. Thecomparator1417 is capable of determining a degree of similarity, based on criterions received from thevideo call manager1409, and adjusting the number of images to be created from the video data, based on the determined similarity. For example, when thecomparator1417 ascertains that the similarity exceeds criterions, it is capable of transferring the second I-frame to theimage creator1419. Theimage creator1419 is capable of creating a still image based on the second I-frame. Theimage creator1419 is capable of transmitting the created still image to the third electronic device via thenetwork manager1403.
• FIG. 15 is a diagram illustrating an example method of encoding video data in a second electronic device according to various example embodiments of the present disclosure.
• With reference toFIG. 15,reference number1551 represents the flow of a control signal.Reference number1553 represents the flow of a video call signal from the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, or the firstelectronic device1401 illustrated inFIG. 14A) to the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, or the secondelectronic device1215 illustrated inFIG. 12).Reference number1555 represents the flow of signals transmitting encoded video data from the second electronic device to the third electronic device1505 (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, or the thirdelectronic device1413 illustrated inFIG. 14A).
• In various embodiments of the present disclosure, the second electronic device creates a still image in such a way that the decoder1507 (e.g., thedecoder1407 illustrated inFIG. 14A or 14B) decodes avideo1521 received from the first electronic device via the first network1523 (e.g., thefirst network411 illustrated inFIG. 4). The post process1506 (e.g., thepost process1406 illustrated inFIG. 14A or 14B) is capable of receiving the decoded video data from thedecoder1507. The I-frame extractor1515 (e.g., the I-frame extractor1415 illustrated inFIG. 14B) of thepost process1506 extracts an I-frame from the received video data and transfers the I-frame to the comparator1517 (e.g., thecomparator1417 illustrated inFIG. 14B). Thecomparator1517 is capable of comparing a previous I-frame, e.g., a first I-frame, with a current I-framed, e.g., a second I-frame, and determining a degree of similarity, based oncriterions1535 received from the video call manager. For example, when thecomparator1517 ascertains that the similarity exceeds the criterions1535 (e.g., the displacement of a video is relatively large), it is capable of transferring the second I-frame to the image creator1519 (e.g., theimage creator1419 illustrated inFIG. 14B).
• In various embodiments of the present disclosure, thecomparator1517 of the second electronic device is capable of adjusting a cycle for obtaining still images, based on: status information (e.g., signal quality) regarding a network connecting the second electronic device and the thirdelectronic device1505, e.g., thesecond network1531; and information regarding the third electronic device1505 (e.g., a type of electronic device, display size, processing power, maximum resolution, current battery level (capacity), memory usage, presence/absence of a camera, video call windows size (a resolution difference between when performing a video call via a multi-window and the entire screen), supporting codec, the number of applications in use, a type of application, etc.), from the thirdelectronic device1505, via the second network1531 (e.g., thesecond network413 illustrated inFIG. 4). For example, when the second electronic device ascertains that the quality of thesecond network1531 is a relatively high level to perform a video call and the battery level is relatively high, it is capable of setting the cycle for obtaining still images to 1 second. When the second electronic device ascertains that the quality of thesecond network1531 is a relatively high level to perform a video call but the battery level is relatively low, it is capable of setting the cycle for obtaining still images to 3 seconds. When the second electronic device ascertains that the quality of thesecond network1531 is a relatively low level to perform a video call and the battery level is relatively low, it is capable of setting the cycle for obtaining still images to 5 seconds. Although the embodiment sets the cycle for obtaining still images to 1, 3 and 5 seconds based on the quality of thesecond network1531 and the battery level, it should be understood that the present disclosure is not limited to the embodiment. It should be understood that the cycle for obtaining still images may also be set to any other value.
• In various embodiments of the present disclosure, theimage creator1519 is capable of creating still images based on the second I-frame received from thecomparator1517.
• In various embodiments of the present disclosure, the I-frames may be stored in a buffer before they are transferred to theimage creator1519. Each I-frame may be stored in the buffer, along with an assigned identification code, using a number, a mark, a character, or the like. The identification code may be assigned, based on time information, sequence information, calling and called parties' accounts, information regarding electronic devices providing services (e.g., a name or a mac address of an electronic device). When the second electronic device receives a request for capturing or storing a displayed video from the thirdelectronic device1505, it is capable of: searching the buffer for a high-resolution image which has not been encoded with an I-frame, corresponding to video data corresponding to the capture or storage request, using an identification code assigned to the I-frame; and storing the video image as a high-resolution video.
• The high-resolution video may be stored in the second electronic device or the thirdelectronic device1505. The buffer may be a cyclic buffer.
• Theimage creator1519 is capable of transmitting the created still image to the thirdelectronic device1505 via the network manager, e.g.,BT modem1533.
• Although the embodiment is described in such a way to create still images in comparison of I-frames, it should be understood that the present disclosure is not limited thereto. The embodiment may also be modified in such a way that still images are created based on direction (movement) vector variation, key frame variation, dominant color variation of video, a cycle of a specified time interval, any circle of a random time interval, etc.
• Various embodiments of the present disclosure are capable of using the change in content of video data as a trigger point for creating an image. For example, when theimage creator1519 of the second electronic device detects a change in a specified region of video data, e.g., a change in creation or modification of a subtitle, a change in a character's face or the number of characters in a video, etc., it is capable of recognizing the change as a trigger point and creating a still image. When theimage creator1519 of the second electronic device ascertains that a specified video is illustrated or a specified region is changed in a video, it is capable of creating a still image. For example, theimage creator1519 of the second electronic device is capable of obtaining a still image each time that score information is illustrated in a specified region of a TV screen displaying a baseball game broadcast. When theimage creator1519 recognizes a change in score information via thecomparator1517 of the second electronic device, it is capable of creating a still image.
• In various embodiments of the present disclosure, theimage creator1519 is capable of determining the size and/or the picture quality of a still image, based on information regarding the thirdelectronic device1505 and thesecond network1531. For example, when the thirdelectronic device1505 has a relatively small size of display, it is capable of altering the size of a video to a size suitable for a display window, regardless of a size of the video, or adjusting a quantization level of a video, thereby adjusting the picture quality of the still image.
• In various embodiments of the present disclosure, the second electronic device is capable of transmitting, in real-time: the created stillimage1541 to the thirdelectronic device1505 via a serial port profile (SPP)1543 of theBT modem1533; and theaudio signal1545 to the thirdelectronic device1505, via a hands free profile (HFP)1547 of theBT modem1533.
• In various embodiments of the present disclosure, theSPP1543 and theHFP1547 are capable of connecting to different electronic devices respectively. For example, thestill image1541 is transmitted via theSPP1543 to the thirdelectronic device1505 and played back therein. Theaudio signal1545 is transmitted via theHFP1547 to an external speaker or an audio device such as a Bluetooth headset and played back thereby.
• Although the embodiment is described in such a way that video data and voice signals are transmitted to the thirdelectronic device1505 using different methods, it should be understood that the present disclosure is not limited to those embodiments. The embodiment may be modified in such a way as to encode video data and voice signals into a single file and transmit the file to the electronic device. For example, after encrypting voice signals into an image file or an image file into voice signals, the second electronic device is capable of transmitting the encrypted result to the thirdelectronic device1505 via the SPP of the Bluetooth.
• In various embodiments of the present disclosure, the video data and the voice signals, required to perform a video call, may be played back selectively according to conditions. For example, according to status information regarding the electronic device and the quality of network, video data and voice data may be played back or voice data may only be played back. The configuration for selectively playing back video data or voice data, based on network status information, is described in detail below.
• In various embodiments of the present disclosure, when the quality of the first network (e.g., thefirst network411 illustrated inFIG. 4 or thefirst network1523 illustrated inFIG. 15) or the second network (e.g., thesecond network413 illustrated inFIG. 4 or thesecond network1531 illustrated inFIG. 15) is relatively high to perform a video call, and the battery level of the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, or the thirdelectronic device1505 illustrated inFIG. 15) is relatively high, the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, or the secondelectronic device1215 illustrated inFIG. 12) is capable of: adjusting video data for performing a video call, using a transcoding scheme parameter suitable for the network quality; and encoding the video data, via the transcoding scheme. That is, the second electronic device is capable of: adjusting resolution, frame rate (fps) or picture quality of video data to create video data which can be used for a video call at a relatively low transfer rate, and transmitting the video data to the third electronic device.
• In various embodiments of the present disclosure, when the quality of the first or second network is deteriorated, the second electronic device transmits, to the third electronic device, audio signals, in real-time, and still images, instead of video data, at a certain interval (e.g., a transfer cycle determined the network state). Therefore, the user may be provided with a limited video call service.
• In various embodiments of the present disclosure, when the quality of the first or second network is further deteriorated, the second electronic device does not transmit, to the third electronic device, video data, but transmits only audio signals, so that the user can perform a voice call.
• In various embodiments of the present disclosure, when the quality of the first or second network is worst or the distance between the second and third electronic devices exceeds a threshold, the second electronic device determines that it cannot provide the third electronic device with a video call service, and thus switches a video call to another electronic device or terminates the video call.
• In another embodiment, while the second electronic device is performing a video call via the third electronic device, it is capable of detecting the movement of the third electronic device. The third electronic device is capable of: estimating the quality of a network connecting to the second electronic device, based on the moving direction and the displacement change; and providing a corresponding notification to the second electronic device. For example, when the third electronic device detects the decrease in the network quality since it moves away from the second electronic device, it is capable of notifying the second electronic device that the video call quality is deteriorated, via a notification, such as vibration, a message, etc.
• FIG. 16 is a flowchart illustrating an example method of reproducing video data in a third electronic device according to various example embodiments of the present disclosure.
• In various embodiments of the present disclosure, the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, or the thirdelectronic device1505 illustrated inFIG. 15) detects the movement, it is capable of controlling a video call service according to the movement.
• With reference toFIG. 16, the third electronic device is capable of performing a video call inoperation1601. The third electronic device is capable of determining whether it detects its movement inoperation1603.
• When the third electronic device detects its movement inoperation1603, it collects sensed information regarding its movement via the sensor inoperation1605. The third electronic device selectively plays back video data or audio signals, based on the collected sensed information inoperation1607.
• For example, the third electronic device is capable of measuring a movement angle of its head, using a geomagnetic sensor. The third electronic device is capable of detecting its movement, using an acceleration sensor and a gyro sensor. The third electronic device is capable of collecting sensed information according to its movement, via the geomagnetic sensor, acceleration sensor or gyro sensor.
• In various embodiments of the present disclosure, the third electronic device is implemented with a watch. In this case, the third electronic device is capable of controlling the playback of video data according to the movement of a user's hand wearing the watch (e.g., a movement angle of the head of the watch, measured by geomagnetic sensor). For example, when the user puts the hand down (e.g., when a movement angle of the head of the third electronic device changes from 0° to 90°), the third electronic device determines that the user is performing a video call, via only voice, without viewing a video of a video call. When the user puts the hand up (e.g., when a movement angle of the head of the third electronic device changes from 90° to 0°), the third electronic device determines that the user is performing a video call, via a video and voice, viewing a video of the video call. That is, in various embodiments of the present disclosure, the third electronic device analyzes the collected sensed information and ascertains that the movement of the electronic device is within a preset range, it is capable of storing video data in the memory, while reproducing the audio. On the other hand, when the third electronic device ascertains that the movement of the electronic device is not within a preset range, it is capable of reproducing video streams stored in the memory.
• In various embodiments of the present disclosure, when the third electronic device is equipped with a video input module, e.g., a camera, it is capable of obtaining the movement of a user's eyes via the sensor, determining whether the user fixes their eyes on the screen, and controlling the playback of video data based on the determination. Alternatively, the third electronic device is capable of performing the recognition of a user's face and/or iris, and determining whether the user fixes their eyes on the screen.
• In various embodiments of the present disclosure, when the third electronic device ascertains that the user is performing a video call, using only voice, it stores the video data in a buffer, without updating the video data, and receives only the voice.
• When the third electronic device recognizes the face and/or iris, via the camera, it is capable of playing back a video stored in a buffer, in a slide show mode, at a relatively high speed. Therefore, the user may check the updated images without missing out.
• In various embodiments of the present disclosure, a playback speed of slides may vary depending on the number of images to be played back. For example, when a slide playback time has been set to a specified period of time, 30 images and 10 images may set their playback speeds to different values to be played within the set period of time. Alternatively, a required time for playback may vary depending on the number of images to be played back. Therefore, various embodiments of the present disclosure are capable of preventing images from being played back too fast or slow.
• Various embodiments of the present disclosure are capable of compressing and storing the displayed video data. For example, when third electronic device does not recognize a user's face and/or iris, it determines that the user has not fixed their eyes on the screen and stores video data corresponding to when the user does not gaze.
• In various embodiments of the present disclosure, when the third electronic device recognizes a user's face and/or iris via the camera, it is capable of playing back video data which has been compressed and stored.
• In various embodiments of the present disclosure, when the third electronic device does not recognize a user's face and/or iris via the camera, it is capable of extracting a key frame from the video data, and creating and storing an image. When the third electronic device recognizes a user's face and/or iris via the camera, it is capable of playing back stored images in a slideshow mode.
• FIGS. 17A and 17B are diagrams illustrating an example method of encoding video data in a second electronic device according to various example embodiments of the present disclosure.
• In various embodiments of the present disclosure, the second electronic device1703 (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, or the secondelectronic device1215 illustrated inFIG. 12) is capable of encoding video data using a scalable encoding (spatial and time domain) scheme. The scalable encoding is processes of dividing input video streams into video streams of two or more layers, i.e., a hierarchical structure, and encoding the video streams. In the scalable encoding, a video sequence may be compressed into a number layers, e.g., a base layer and one or more enhanced layers. The base layer is bit streams which can be independently decoded and may contain information for restoring a minimum quality of video. The enhanced layer is additional bit streams to improve the base layer bit stream and may be decoded along with the base layer. Therefore, the scalable encoding is capable of encoding a number of video layers into one bit stream. That is, the hierarchical streams may be played back using only a base layer. When the hierarchical streams may be played back with enhanced layers that differ from the base layer, high quality of video in layers may be obtained according to the number of enhanced layers in use.
• In various embodiments of the present disclosure, the secondelectronic device1703 is capable of receiving all layers of scalable encoding signals from the first electronic device1701 (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, or the firstelectronic device1401 illustrated inFIG. 14A). The secondelectronic device1703 is capable of transmitting only a base layer of the received all layers to the third electronic device1705 (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, or the thirdelectronic device1505 illustrated inFIG. 15). Alternatively, the secondelectronic device1703 is capable of: determining an enhanced layer to be transmitted along with a base layer, based on basic information and current status information regarding the thirdelectronic device1705 or status information regarding the second network between the secondelectronic device1703 and the third electronic device1705 (e.g., thesecond network413 illustrated inFIG. 4, or thesecond network1531 illustrated inFIG. 15); and transmitting the base layer and the determined enhanced layer to the thirdelectronic device1705.
• In various embodiments of the present disclosure, when the firstelectronic device1701 performs the encoding operation using a scalable encoding scheme and transmits the encoded result to the secondelectronic device1703, the secondelectronic device1703 is capable of determining enhanced layers to be transmitted to the thirdelectronic device1705, based on current status information and basic information regarding the third electronic device1705 (e.g., type, display size, display shape (e.g., circle, rectangle, or square), battery capacity, display resolution, CPU power) or status information regarding the second network between the secondelectronic device1703 and the third electronic device1705 (e.g., thesecond network413 illustrated inFIG. 4 or thesecond network1531 illustrated inFIG. 15). That is, the secondelectronic device1703 is capable of transmitting, to the thirdelectronic device1705 to which a current video call is made, a base layer received from the firstelectronic device1701 or a combination of the base layer with at least one enhanced layer, considering a state of the thirdelectronic device1705.
• In various embodiments of the present disclosure, information regarding the secondelectronic device1703 may have been registered in a user account cooperation server. Alternatively, when the firstelectronic device1701 makes a call to the secondelectronic device1703, it is capable of obtaining the information regarding the secondelectronic device1703 from the secondelectronic device1703. For example, the user account cooperation server is capable of managing users' electronic devices and information regarding the electronic devices (e.g., status information), based on user accounts (e.g., IDs). The user account cooperation server is capable of providing a calling electronic device (e.g., first electronic device) to make a video call with information regarding a called electronic device.
• It is assumed that the secondelectronic device1703 is connected, via Bluetooth, with a thirdelectronic device1705, e.g., a watch with a screen of 2 inches, as illustrated inFIG. 17A, and a car kit with a screen of 7 inches as illustrated in FIG.17B, and this status information, as use information regarding a user's devices, is updated in the user account cooperation server.
• In various embodiments of the present disclosure, the firstelectronic device1701 is capable of determining a scheme for encoding video data, e.g., a scalable encoding scheme, based on device information stored in the user account cooperation server.
• For example, the user may set the electronic device, and the watch and the car kit (a car entertainment system, a car control system, etc.), connected to the electronic device, to be in use, and may register the watch and the car kit in the user account cooperation server. The user account cooperation server is capable of monitoring the registered electronic devices, e.g., a watch, a car kit, etc. In a state where the user account cooperation server is monitoring a vehicle as a registered electronic device, when it detects the change in its status information, it is capable of updating the status information regarding the vehicle.
• In various embodiments of the present disclosure, the firstelectronic device1701 may configure enhanced layers in various types according to time and spatial requirements. The firstelectronic device1701 transmits the variously configured, enhanced layers to the thirdelectronic device1705 connected to the secondelectronic device1703 via the second network. The firstelectronic device1701 is capable of creating a base layer and enhanced layers, considering a temporal resolution (7.5 fps, 15 fps, or 30 fps) and a spatial resolution (QCIF, CIF, or QVGA).
• Since the user account cooperation server stores information regarding a watch and a car kit, the firstelectronic device1701 is capable of performing a video call with the watch and/or the car kit. The firstelectronic device1701 is capable of encoding video data for a video call with the watch and the car kit. For example, the firstelectronic device1701 is capable of: encoding, based on abase layer1711, video data to enhanced layer #1 (1713) of low quality for a watch, enhanced layer #2 (1715) of high quality for a watch, enhanced layer #3 (1717) of low quality for a car kit, and enhanced layer #4 (1719) of high quality for a car kit; and transmitting the encoded results to the secondelectronic device1703.
• For example, when the thirdelectronic device1705 receives a video call via a watch as illustrated inFIG. 17A, the secondelectronic device1703 is capable of transmitting: to the watch, only thebase layer1711, based on status information regarding the second network, and current information regarding the watch, such as the memory usage, the battery level, etc.; or to the thirdelectronic device1705, enhanced layer #1 (1713) corresponding to encoded video data of low quality for the watch and thebase layer1711.
• When the thirdelectronic device1705 receives a video call via a car kit as illustrated inFIG. 17B, the secondelectronic device1703 is capable of transmitting: to the car kit, only thebase layer1711, based on status information regarding the second network, and current information regarding the car kit, such as the memory usage, CPU power, process occupancy by the operating system, etc.; or to the thirdelectronic device1705, enhanced layer #3 (1717) corresponding to encoded video data of low quality for the car kit and thebase layer1711.
• FIG. 18 is a diagram illustrating an example method of encoding video data in a second electronic device according to various example embodiments of the present disclosure.
• With reference toFIG. 18, the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A or 17B) is capable of encoding video data using a mirroring/resized-mirroring scheme.
• In various embodiments of the present disclosure, the second electronic device is capable of transmitting mirroring video data resized based on video data received from the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, the firstelectronic device1401 illustrated inFIG. 14A, the firstelectronic device1701 illustrated inFIG. 17A or 17B) to the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIG. 17A or 17B). The second electronic device is capable of determining a resize of video data, based on information regarding the third electronic device (e.g., type, display size, CPU power, screen shape, battery level, or memory usage) and status information regarding the second network (e.g., thesecond network413 illustrated inFIG. 4, or thesecond network1531 illustrated inFIG. 15) connecting the second and third electronic devices.
• In various embodiments of the present disclosure, the second electronic device is capable of moving the focus of mirroring video data or cropping mirroring video data, using the content and the display shape (e.g., circle, square, or rectangle) of the third electronic device, and transmitting the result to the third electronic device. The second electronic device is capable of: focusing or cropping mirroring video data with respect to the center; or focusing or cropping mirroring video data, using the facial recognition or the object recognition, and transmitting the result to the third electronic device.
• The third electronic device is an electronic device with a display shaped as a square as illustrated in diagram1803 ora circle as illustrated in diagram1805. When video data displayed on a rectangle display screen of theelectronic device1801 whose height is larger than the width needs to be displayed on a square or circle display screen of theelectronic device1803 or1805, the second electronic device recognizes only the face region in the video data displayed on theelectronic device1801 and crops the region for the display shape, e.g., asquare shape1803 or acircle shape1805. The second electronic device is capable of transmitting only the cropped face region to the third electronic device. The third electronic device is capable of displaying the video data corresponding to the face region, received from the second electronic device.
• FIGS. 19A and 19B are diagrams illustrating an example user interface related to the reception/transmission of a video call according to various example embodiments of the present disclosure.
• With reference toFIGS. 19A and 19B, the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A or 17B) receives a video call request from the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, the firstelectronic device1401 illustrated inFIG. 14A, the firstelectronic device1701 illustrated inFIG. 17A or 17B), and transmits a notification to the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIG. 17A or 17B) connected to the second electronic device via the second network (e.g., thesecond network413 illustrated inFIG. 4, or thesecond network1531 illustrated inFIG. 15). After receiving the notification, the third electronic device is capable of: determining whether it can make a video call, based on status information regarding the second network connected to the second electronic device, information regarding battery level, memory usage, process schedule, etc. of the second and third electronic devices; and displaying the determination on the display screen.
• For example, when the quality of the second network is relatively high to perform a video call and the battery level is also high level, the third electronic device is capable of displaying a user interface of icons corresponding to video calling1901 to the second electronic device, video calling1903 to third electronic device, voice calling1905 to the third electronic device,call rejection1907, etc. as illustrated inFIG. 19A.
• In various embodiments of the present disclosure, when the third electronic device receives video data for a video call, it is capable of displaying a user interface for receiving a video of low quality or high quality, along with video call quality information such as frame rate (fps), resolution information regarding the video data, etc.
• In various embodiments of the present disclosure, when the third electronic device makes a video call to an external electronic device, e.g., the first electronic device is capable of: determining whether a video call is possible, based on status information regarding the second network with the second electronic device, status information regarding the first network (e.g., thefirst network411 illustrated inFIG. 4, or thefirst network1523 illustrated inFIG. 15), information regarding the first to third electronic devices, such as battery level, memory status, schedule states of the processor, etc.; and displaying the determination on the user interface. For example, when the quality of the second network is relatively low to perform a video call or the battery level is relatively low, the third electronic device is capable of displaying a user interface of icons corresponding to video calling1913 using only voice to an external electronic device, e.g., first electronic device, and video calling1911 with the second electronic device, etc., as illustrated inFIG. 19B.
• In various embodiments of the present disclosure, the third electronic device is capable of serving as a controller or a hub for connecting a video call to another electronic device. In this case, the first electronic device is capable of performing a video call using a device which is registered in the first to third electronic devices via the third electronic device or a device which is not registered but is available.
• FIGS. 20A, 20B, 20C and 20D are diagrams illustrating an example user interface for receiving a video call according to various example embodiments of the present disclosure.
• With reference toFIGS. 20A to 20D, the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the firstelectronic device1701 illustrated inFIG. 17A or 17B) is capable of displaying: the third electronic device or an electronic device connected to the third electronic device; an electronic device connected to or registered in the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A or 17B); and an electronic device which is not registered in the second or third electronic device but is connectable. When the third electronic device receives an input for selecting one of the displayed electronic devices capable of performing a video call, it is capable of transmitting a video call signal to the selected electronic device.
• In various embodiments of the present disclosure, the size of an icon representing an electronic device capable of performing a video call may indicate a level of video call quality. The video call quality level may be determined based on the quality of network with each electronic device and a state of each electronic device. The size of the icon may be proportional to the video call quality level. For example, the larger the size of the icon, the higher the video call quality level. That is, the smaller the size of the icon, the lower the video call quality level.
• Although the embodiment is descried in such a way that the size of the icon representing an electronic device capable of performing a video call varies depending on levels of video call quality, it should be understood that the present disclosure is not limited to the embodiment. An icon presenting an electronic device suitable for a video call is displayed in such a way as to vary the shape, the color (e.g., brightness/black-and-white), or the outline. Alternatively, an electronic device suitable for a video call may be displayed with different icons according to levels of video call quality, e.g., a broken icon showing a relatively low level of quality. That is, various embodiments of the present disclosure are capable of indicating levels of video call quality, by varying size, icon shape or color of an icon or a combination thereof.
• As illustrated inFIGS. 20A to 20D, the third electronic device is capable of displaying icons representing electronic devices capable of performing a video call. For example, the third electronic device is capable of displaying anicon2011 representing a TV, anicon2013 representing a smartphone, anicon2015 representing a car kit, anicon2017 representing a tablet PC, anicon2019 representing a headset, anicon2021 representing video call rejection, and anicon2023 representing a watch.
• For example, the third electronic device is capable of displaying theTV icon2011 larger in size than the other electronic devices, e.g., thesmartphone icon2013, thecar kit icon2015, thetable PC icon2017, theheadset icon2019, the videocall rejection icon2021, and thewatch icon2023. That is, when theTV icon2011 is selected, the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, the firstelectronic device1401 illustrated inFIG. 14A, the firstelectronic device1701 illustrated inFIG. 17A or 17B) is capable of performing a video call of high quality with the TV. Thecar kit icon2015 is relatively smaller in size that theTV icon2111. That is, when thecar kit icon2015 is selected, the communication state with the car kit may be performed in a lower level of quality than the communication state with the TV. In this case, the first electronic device is capable of: performing a video call by receiving voice signals, in real-time, and the video at a certain interval, from the car kit; or performing a video call, using only voice.
• Although the embodiment is described in such a way that the size of an icon representing a specified electronic device is adjusted based on levels of video call quality, it should be understood that the present disclosure is not limited to the embodiment. The size of an icon representing a specified electronic device may also be adjusted based on a user's use history, a user's use pattern, context awareness information, etc. The icon representing a specified electronic device may be relocated to another location. For example, the icon representing a specified electronic device may be displayed in a form arranged according to the size. The number of icons, types or attributes of electronic device to be displayed on the third electronic device may be set by the user.
• In various embodiments of the present disclosure, when the third electronic device: receives a video call; ascertains the change from an electronic device to make a video call to another during a video call; or detects a user's input for changing an electronic device to make a call during a video call, it is capable of displaying electronic devices capable of performing a video call on the user interface.
• In various embodiments of the present disclosure, the third electronic device is capable of analyzing: states of the displayed electronic devices capable of performing a video call; or the quality of networks with the displayed electronic devices capable of performing a video call. The third electronic device is capable of determining priority based on the analysis and displaying icons corresponding to electronic devices in different sizes based on the determined priority.
• In various embodiments of the present disclosure, the third electronic device is capable of analyzing: the change in states (e.g., the change in battery level) of the displayed electronic devices capable of performing a video call; or the quality of networks with the displayed electronic devices capable of performing a video call, in real-time or at a certain time interval. The third electronic device is capable of adjusting icons corresponding to the electronic devices in size or display location, and displaying the adjusted icons.
• Various embodiments of the present disclosure are capable of obtaining the network quality of each electronic device or status information regarding the electronic device, based on a certain time interval, an average of time intervals, or a threshold, and updating the size and/or location of each of the icons representing the electronic devices. Therefore, various embodiments of the present disclosure are capable of preventing the size of each of the icons representing the electronic devices from being changed suddenly.
• Various embodiments of the present disclosure are capable of displaying icons representing electronic devices along with additional information, respectively. For example, the additional information may contain an owner (account subscriber) of an electronic device, a name set for an electronic device, authority information, etc.
• In various embodiments of the present disclosure, when the third electronic device receives an input for selecting a specified electronic device, it is capable of transmitting a video call connection signal to the selected, specified electronic device. For example, when the third electronic device detects aninput2025 for selecting awatch icon2023 as illustrated inFIG. 20A, aninput2041 for dragging thewatch icon2023 into an originator display window orvideo call window2001 as illustrated inFIG. 20B, or aninput2051 for dragging thewatch icon2023 into the originator display window orvideo call window2001 as illustrated inFIG. 20C, it is capable of transmitting a video call connection signal to the watch.
• In various embodiments of the present disclosure, the third electronic device may be implemented with a watch without a stem. In this case, a video call is performed by selecting an icon representing the electronic device. Alternatively, the third electronic device may be implemented with a watch with a stem (not shown). In this case, a video call is performed by controlling the stem to select an icon representing the electronic device. Alternatively, the third electronic device may be implemented with a watch with a wheel shaped as a circle as illustrated inFIG. 20D. In this case, a video call is performed by rotating thewheel2061 to select an icon representing the electronic device.
• FIG. 20E is a flowchart illustrating an example method of performing a video call in a third electronic device according to various embodiments of the present disclosure.
• With reference toFIG. 20E, a third electronic device is capable of receiving a video call inoperation2071.
• In various embodiments of the present disclosure, when the third electronic device receives a video call, it may determine whether it is worn by the user.
• In various embodiments of the present disclosure, the third electronic device is capable of determining whether it is worn by the user, via a sensor, e.g., a geomagnetic sensor, a gravity sensor, a heart-rate sensor, a temperature sensor, etc. For example, when the third electronic device is a watch, it is capable of determining whether it is worn by the user in such a way that a hall effect sensor detects whether the watch chains/straps are coupled.
• In various embodiments of the present disclosure, when the third electronic device ascertains that it is worn by the user, it is capable of transmitting a sensor signal corresponding to the state of being worn to the second electronic device. The second electronic device does not display a notification based on the received sensor signal and transmits a control signal to the third electronic device so that the notification is displayed only on the third electronic device. Therefore, the second electronic device does not display a notification of an incoming video call on its display screen; however, the third electronic device directly performs a video call and displays the notification of an incoming video call on its display screen.
• In various embodiments of the present disclosure, the third electronic device is capable of displaying notifications of an incoming video call, varying according to locations of the second electronic device. For example, when the second electronic device is in a living room, the third electronic device is capable of outputting a first notification sound to notify an incoming video call. When the second electronic device is in a bedroom, the third electronic device is capable of outputting a second notification sound to notify an incoming video call. When the second electronic device is in a dining room, the third electronic device is capable of outputting vibration to notify an incoming video call. When the second electronic device is near the entrance, the third electronic device is capable of turning the flash on/off to notify the reception of a video call request. In various embodiments of the present disclosure, the third electronic device is capable of obtaining a location of the second electronic device, via an indoor navigation using Wi-Fi, BLE, etc., or via a communication network, such as GPS, LTE, or 3G, etc.
• In various embodiments of the present disclosure, when receiving a video call request, the third electronic device is capable of displaying additional information containing a location of the second electronic device, along with a notification indicating the video call request reception. For example, the third electronic device is capable of displaying a location of the second electronic device obtained from map information stored in the memory, along with a name of a location that the user has registered or an attribute and a name of a location stored in a server.
• In various embodiments of the present disclosure, when receiving a video call request, the third electronic device is capable of displaying an arrow mark indicating a location of the second electronic device, along with a notification of the video call request reception. For example, the third electronic device is capable of displaying map information, direction information, information regarding a distance from the third electronic device to the second electronic device, and an estimated period of time to reach the second electronic device based on the distance. The distance information may be displayed in various forms, such as number, color, icon, etc.
• In various embodiments of the present disclosure, the third electronic device is capable of displaying at least one electronic device capable of performing a video call inoperation2073. The third electronic device is capable of displaying: the third electronic device or an electronic device connected to the third electronic device; an electronic device registered in or connected to the second electronic device; and an electronic device which is not registered in the second or third electronic device but is connectable to the second electronic device.
• In various embodiments of the present disclosure, the third electronic device is capable of displaying at least one electronic device using icons. The size of an icon may be determined based on video call quality level (e.g., a state of an electronic device, such as a battery level or a network state), a user's use history, a user's use pattern, context awareness information, etc. For example, the third electronic device is capable of setting an icon of an electronic device whose video call quality level is relatively high to be larger in size than a preset size. The third electronic device is also capable of analyzing a user's use history or a user's use pattern, and setting an icon of an electronic device with which the user has frequently performed a video call to be larger in size than a preset size. In contrast, the third electronic device is capable of setting an icon of an electronic device whose video call quality level is relatively low to be smaller in size than a preset size. The third electronic device is also capable of analyzing a user's use history or a user's use pattern, and setting an icon of an electronic device with which the user has not frequently performed a video call to be smaller in size than a preset size.
• In various embodiments of the present disclosure, the third electronic device is capable of detecting an input for selecting an electronic device to perform a video call from one or more displayed electronic devices inoperation2075. The third electronic device is capable of transmitting a video call signal to the selected electronic device inoperation2077. For example, as described above with reference toFIGS. 20A to 20C, the third electronic device is capable of selecting an electronic device to perform a video call, by detecting: a touch input applied to an electronic device to perform a video call; an input for dragging an icon representing an electronic device to perform a video call to an originator display window or video call window; or an input for dragging an originator display window or video call window to an icon representing an electronic device to perform a video call.
• In various embodiments of the present disclosure, the third electronic device may be implemented with a watch without a stem. In this case, a video call is performed by selecting an icon representing the electronic device. Alternatively, the third electronic device may be implemented with a watch with a stem (not shown). In this case, a video call is performed by controlling the stem to select an icon representing the electronic device. Alternatively, the third electronic device may be implemented with a watch with a wheel shaped as a circle. In this case, a video call is performed by rotating the wheel to select an icon representing the electronic device.
• FIGS. 21A and 21B are diagrams illustrating an example user interface depending on pressure levels of the user input according to various example embodiments of the present disclosure.
• With reference toFIGS. 21A and 21B, when the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIG. 17A or 17B) detects an input for switching a video call, it is capable of arranging icons of at least one electronic device, to which it can switch a video call, to meet its shape. Examples of the cons of at least one electronic device are anicon2101 representing a TV, anicon2103 representing a tablet PC, anicon2105 representing a headset, anicon2107 representing a smartphone, anicon2109 representing a car kit, and anicon2111 representing video call end.
• In various embodiments of the present disclosure, the third electronic device is capable of performing different functions according to pressure levels of the user input selecting an icon presenting a specified electronic device. For example, when the third electronic device detects a touch input ofpressure level1, it is capable of switching a video call to a specified electronic device on which the touch input ofpressure level1 is detected. When the third electronic device detects a touch input ofpressure level2, it is capable of transmitting a notification to a specified electronic device on which the touch input ofpressure level2 is detected. The notification allows the user to intuitively identify a specified electronic device to which a video call is switched.
• For example, when the third electronic device detects atouch input2113 ofpressure level2 applied to aTV icon2101 of the displayed icons, it is capable of transmitting a notification to the TV corresponding to theTV icon2101. Based on the received notification, the TV is capable of: controlling the TV screen to blink; displaying a specified image pattern on at least part of the TV screen; and displaying information regarding the user, e.g., user account information or information regarding the third electronic device on at least part of the TV screen. Alternatively, when the third electronic device detects atouch input2113 ofpressure level2 applied to aTV icon2101 of the displayed icons, it is capable of changing a user interface, using “device change,” and displaying the user interface, as illustrated inFIGS. 21A and 21B.
• Various embodiments of the present disclosure display a screen illustrated ion the TV and a screen illustrated on the display of the third electronic device, temporarily matching the screens with each other, so that the user can intuitively identify the electronic device to which a video call signal is transmitted, before connecting the video call.
• In various embodiments of the present disclosure, the third electronic device is capable of temporarily displaying an icon representing an electronic device to which a video call will be switched, by an altering function, on a screen showing icons representing electronic devices to which a video call can be switched. Alternatively, the third electronic device is capable of temporarily displaying an icon representing an electronic device to which a video call will be switched, by an altering function, at a location displaying an originator's information.
• In various embodiments of the present disclosure, when the third electronic device detects a touch input ofpressure level3, it is capable of displaying details of the electronic device on which the touch input ofpressure level3 is detected. For example, the third electronic device is capable of displaying details related to attributes of the electronic device on which the touch input is detected and network connection attributes.
• FIG. 21C is a flowchart illustrating example functions depending on pressure levels of the user input according to various example embodiments of the present disclosure.
• With reference toFIG. 21C, when the third electronic device detects an input for switching a video call inoperation2131, it is capable of displaying at least one electronic device to which a video call can be switched inoperation2133.
• The third electronic device is capable of detecting an input for selecting an electronic device to which a video call is switched from at least one displayed electronic device, and detecting a pressure level of the detected input inoperation2135. The third electronic device is capable of performing a function related to the selected electronic device, based on the pressure level of the detected input inoperation2137.
• For example, when the third electronic device detects a touch input ofpressure level1, it is capable of switching a video call to the electronic device on which the touch input ofpressure level1 is detected. When third electronic device detects a touch input ofpressure level2, it is capable of transmitting a notification to the electronic device on which the touch input ofpressure level2 is detected, so that the electronic device can output the notification. When the thirdelectronic device405 detects a touch input ofpressure level3, it is capable of displaying attribute information regarding the electronic device on which the touch input ofpressure level3 is detected, for example, information regarding the electronic device on which the touch input is detected or network information.
• FIG. 21D is a flowchart illustrating example functions depending on pressure levels of the user input according to various example embodiments of the present disclosure.
• In various embodiments of the present disclosure, the third electronic device is capable of performing different functions according to detected user inputs and pressure levels of the detected user input.
• In various embodiments of the present disclosure, the third electronic device is capable of recognizing objects of video data, based on locations where a user input is detected, and adjusting at least one of the following: resolution, focus, and exposure, according to pressure levels applied to a corresponding object.
• In various embodiments of the present disclosure, the third electronic device is capable of displaying different user interfaces, based on at least one of the following: a user input, a duration of the user input, an area of the user input (e.g., an area of a user's finger), and a level of hovering input (e.g., an input tool, such as a user's finger, a stylus, etc., or a distance between the input tool to the touchscreen).
• With reference toFIG. 21D, the third electronic device is capable of performing a video call inoperation2141. The third electronic device is capable of detecting a user input inoperation2143. The third electronic device is capable of obtaining a pressure level of the detected user input inoperation2145. The third electronic device is capable of performing a function corresponding to the pressure level of the user input inoperation2147.
• For example, when the third electronic device detects a user input on part of the region of display during a video call, it is capable of displaying a video call menu. When the third electronic device detects a user input ofpressure level1, it is capable of displaying a user interface for changing a resolution of video data. When the third electronic device detects a user input ofpressure level2, it is capable of displaying a user interface for switching a video call. When the third electronic device detects a user input ofpressure level3, it is capable of displaying a user interface for altering picture quality of video data.
• In various embodiments of the present disclosure, when the third electronic device detects a user input ofpressure level1 on at least part of the region of a video displayed on the screen, it is capable of capturing and storing the video data as still images during a specified time interval or a key frame interval while the user input is maintained inpressure level1. When the third electronic device detects a user input ofpressure level2 on at least part of the region of a video displayed on the screen, it is capable of storing the video data as a moving image (video) while the user input is maintained inpressure level2.
• In various embodiments of the present disclosure, the third electronic device is capable of displaying at least part of the image or moving image (video), stored according to the user input ofpressure level2, on at least part of the display screen, for a preset period of time. For example, the third electronic device is capable of displaying an image, stored in response to the user input ofpressure level2, on at least part of the display screen showing video data, e.g., a snap-shot of a certain size on the bottom of the screen. Alternatively, the third electronic device is capable of displaying an icon, indicating that a moving image (video) is being recorded in response to the user input ofpressure level2, on at least part of the display screen. Therefore, various embodiments of the present disclosure allow the user to intuitively recognize that an image or a moving image (video) is being stored (or recorded), via an icon indicating the state of a snap-shot or recording.
• In various embodiments of the present disclosure, when third electronic device detects a user input ofpressure level1 on part of the region of a video being displayed, it is capable of requesting a video of high-resolution, corresponding to a video when the user input ofpressure level1 is detected, from the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, the firstelectronic device1401 illustrated inFIG. 14A, the firstelectronic device1701 illustrated inFIG. 17A or 17B) or the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A or 17B). When the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the secondelectronic device1703 illustrated inFIG. 17A or 17B) detects a user input ofpressure level2 on part of the region of a video being displayed, it is capable of requesting the first or second electronic device to adjust the focus of the camera, with respect to the region where the user input ofpressure level2 is detected. When the third electronic device detects a user input ofpressure level3 on part of the region of a video being displayed, it is capable of requesting the first or second electronic device to adjust the exposure of the camera, with respect to the region where the user input ofpressure level3 is detected.
• Although the embodiment is described in such a way as to perform different functions according to pressure levels of the user input, it should be understood that the present disclosure is not limited thereto. The embodiment may also be modified in such a way as to perform different functions according to directions in which the user input is detected, which is described in detail, below, with reference toFIG. 21E.
• FIG. 21E is a flowchart illustrating example functions depending on directions in which a user input is detected, according to various embodiments of the present disclosure.
• In various embodiments of the present disclosure, the third electronic device is capable of performing different functions according to directions in which a user input is detected.
• With reference toFIG. 21E, the third electronic device is capable of performing a video call inoperation2151. The third electronic device is capable of detecting a user input inoperation2153. In various embodiments of the present disclosure, the user input may include swipe input and/or drag input. The third electronic device is capable of identifying a direction of the detected user input inoperation2155, and performing a function corresponding to the direction of the detected user input inoperation2157.
• In various embodiments of the present disclosure with reference toFIG. 21E, it is assumed that the user input is a swipe action. When the third electronic device detects a user input, e.g., swipe, on at least part of the display screen during a video call, it is capable of displaying a menu related to video call. The third electronic device is capable of analyzing a direction in which the swipe is detected. The swipe action may be performed from left-to-right, from right to left, from top to bottom, and from bottom to top.
• For example, when the third electronic device detects a swipe action from left to right, it is capable of displaying a user interface for altering resolution of video data. When the third electronic device detects a swipe action from right to left, it is capable of displaying a user interface for switching a video call. When the third electronic device detects a swipe action from top to bottom, it is capable of displaying a user interface for changing picture quality of video data. It should be understood that the present disclosure is not limited to the functions according to the swipe actions. The resolution, focus and exposure of a video may also be adjusted according to directions of the swipe.
• As described above, various embodiments of the present disclosure are capable of displaying different user interfaces or performing different functions, based on at least one of the following: a user input, a duration of the user input, a hovering level, a pressure level of the user input, and a direction in which the user input is detected. various embodiments are also capable of: mapping a displayed user interface, based on at least one of the following: a user input, a duration of the user input, a level of hovering input (e.g., a distance between an input tool (e.g., a user's finger or a stylus) and a touchscreen), a pressure level of the user input, and a direction in which the user input is detected; and storing the mapping result in the memory.
• FIG. 22A are diagrams illustrating an example user interface including an indicator indicating the quality of video call according to various example embodiments of the present disclosure.
• With reference to diagram2201 ofFIG. 22A, the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the secondelectronic device1703 illustrated inFIG. 17A or 17B) is capable of displayingvideo data2209 and anindicator2211 indicating the video call quality during a video call. As illustrated in diagram2203, the third electronic device is also capable of displayingvideo data2209, anindicator2211 indicating the video call quality, and a button213 for lowering down the resolution (quality) of video data.
• As illustrated in diagram2205, the third electronic device is capable of displayingvideo data2209 and the video call quality determined based on its information and the network state, and showing a user interface including anindicator2215 for controlling the video call quality. For example, theindicator2215 may include a maximum of availablevideo call quality2221, determined based on a network state and information regarding the third electronic device, and thevideo call quality2223 currently in use. The user may intuitively adjust a level of video call quality on theindicator2215, using aslide control2223.
• For example, theindicator2215 indicates a maximum of availablevideo call quality2221 and thevideo call quality2223 currently in use. When the third electronic device detects an input2225 (e.g., an input for selecting and dragging a video call quality region in the right or left) for adjusting video call quality on theindicator2215, it is capable of adjusting the video call quality. The third electronic device is capable of determining an encoding scheme corresponding to the adjusted video call quality. The third electronic device is capable of transmitting the determined encoding scheme to the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, the firstelectronic device1401 illustrated inFIG. 14A, the firstelectronic device1701 illustrated inFIG. 17A or 17B). The first or second electronic device is capable of encoding video data based on the encoding scheme and transmitting the encoded video data to the third electronic device. The third electronic device is capable of reproducing the received, encoded video data.
• As illustrated in diagram2207, when theindicator2231 is shaded near the left end in the left region with respect to acriterion2230, it indicates that the video call quality is relatively low. When theindicator2233 is shaded in the left region from the left end up to thecriterion2230, it indicates that the video call quality is intermediate. When theindicator2235 is shaded, extending from the left end to the right region with respect to thecriterion2230, it indicates that the video call quality is relatively high.
• Although the embodiment is described in such a way that the video call quality is adjusted by controlling the indicator, it should be understood that the present disclosure is not limited thereto. For example, when the third electronic device is a watch which is equipped with a stem (not shown) or a wheel (not shown), the video call quality is adjusted via the rotation of the stem or wheel, a voice input, a gesture input, or a combination thereof.
• For example, when battery power consumption needs to be reduced or multi-tasking process needs for other tasks, various embodiments allow the user to minimize the level of video call quality. Therefore, various embodiments of the present disclosure are capable of adjusting the level of video call quality according to a use's conditions, thereby providing the user with a relatively high degree of video call service satisfaction.
• In various embodiments of the present disclosure, when the third electronic device receives and displays video data for video call, it is capable of displaying information regarding the video call quality such as a video data resolution, a frame rate (fps), etc., along with the video data. When the third electronic device detects an input for adjusting the indicator, it is capable of displaying information regarding the video call quality corresponding to the adjusted level of indicator. Since various embodiments of the present disclosure display video data for video call along with information regarding the video call quality, the user may intuitively recognize information regarding the currently displayed video data or information regarding the video data according to the adjusted indicator.
• FIG. 22B is a flowchart illustrating an example method of adjusting the quality of video call according to various example embodiments of the present disclosure.
• With reference toFIG. 22B, while the third electronic device displays video data for video call inoperation2241, it is capable of determining whether an input for adjusting the quality of video data is detected inoperation2243.
• In various embodiments of the present disclosure, the third electronic device is capable of displaying video data for video call and an indicator for adjusting the quality of video data on part of the display unit. The indicator may include the current quality of video data a maximum available quality of video data determined based on a state of the third electronic device or a network state.
• When the third electronic device has not detected an input for adjusting the quality of video data via the indicator inoperation2243, it returns tooperation2241 and displays video data.
• On the other hand, when the third electronic device detects an input for adjusting the quality of video data via the indicator inoperation2243, it is capable of determining an encoding scheme based on the adjusted video call quality inoperation2245, and transmitting the determined encoding scheme to the second electronic device inoperation2247.
• When the embodiment is implemented in such a way that to encode video data in the second electronic device, the second electronic device is capable of encoding video data based on the encoding scheme, received from the third electronic device, and transmitting the encoded video data to the third electronic device. Alternatively, when the embodiment is implemented in such a way that to encode video data in the first electronic device, the second electronic device is capable of transmitting the encoding scheme, received from the third electronic device, to the first electronic device. In this case, the second electronic device receives, from the first electronic device, the video data that the first electronic device encoded based on the encoding scheme, and forwards the received encoded video data to the third electronic device.
• The third electronic device is capable of receiving the video data, encoded based on the encoding scheme, from the second electronic device, and displaying the received video data inoperation2249.
• FIGS. 23A and 23B are diagrams illustrating an example user interface for switching a video call according to various embodiments of the present disclosure.
• In various embodiments of the present disclosure, when the third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIG. 17A or 17B) moves or is affected by external interference signals during a video call, it is capable of detecting the change in a state of a second network (e.g., thesecond network413 illustrated inFIG. 4, or thesecond network1531 illustrated inFIG. 15). The third electronic device is also capable of detecting: the change in battery status during a video call, shortage of memory capacity due to multi-tasking, and insufficiency of processing power in the third electronic device; the quality degradation of the first network (e.g., thefirst network411 illustrated inFIG. 4, or thefirst network1523 illustrated inFIG. 15) connecting the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, the firstelectronic device1401 illustrated inFIG. 14A, the firstelectronic device1701 illustrated inFIG. 17A or 17B) and the second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A or 17B); and the change in the video call quality during a video call, which is caused by to the change in battery level, short of memory capacity or insufficiency of processing power in the first or second electronic device.
• In various embodiments of the present disclosure, when the third electronic device detects the change in the video call quality, it is capable of requesting the first or second electronic device performing an encoding operation to change its encoding scheme. The third electronic device is capable of: receiving, from the first or second electronic device, video data encoded based on an encoding scheme changed according to the encoding scheme change request; and reproducing the received video data.
• In various embodiments of the present disclosure, when the third electronic device is in a state so that it cannot perform a video call, it is capable of switching the video call to a voice call. When the third electronic device is in a worse state so that it cannot perform a video call, it ends a call and switches a video call to the second electronic device or another electronic device connected to the second electronic device. When the video call is switched to a voice call or when the video call is switched to another electronic device connected to the second electronic device, the third electronic device is capable of informing the user of a video call switching notification, via a user interface (e.g., a pop-up message) for switching a video call to a voice call or another electronic device, a voice, or vibration.
• In various embodiments of the present disclosure, the third electronic device is capable of: obtaining information regarding currently connectable electronic devices from the second electronic device; and displaying electronic devices to which a video call is switched, according to priority assigned, based on a user's use pattern, a state of each electronic device or network connection states.
• In various embodiments of the present disclosure, when the third electronic device is in an environment not suitable for providing a video call service, it is capable of displaying a pop-up message including electronic devices to which it can be connected and switched, so that the user can select a corresponding one of the displayed electronic devices. For example, as illustrated inFIG. 23A, a pop-upmessage2311 for switching a video call shows electronic devices connected to the second electronic device to which a video call can be switched, e.g., asmartphone2313 and acar kit2315. When the third electronic device detects an input for selecting one of the electronic devices illustrated in the pop-upmessage2311, e.g., asmartphone2313 or acar kit2315, it is capable of transmitting a video call switching signal to the selected electronic device.
• In various embodiments of the present disclosure, a video call switching operation is processed by the third electronic device performing a video call or the second electronic device. For example, when the third electronic device detects a signal changing the video call quality during a video call, the second electronic device is capable of displaying a pop-upmessage2331 for a video call switching operation as illustrated inFIG. 23B. When the second electronic device detects an input for selecting one of the electronic devices, e.g., awatch2333, acar kit2335 and aphone2337, illustrated in the pop-upmessage2331, it is capable of transmitting a video call switching signal to the selected electronic device.
• In various embodiments of the present disclosure, when the third electronic device has not detected an input for selecting an electronic device to which a video call is switched, it is capable of automatically selecting an optimal electronic device from among electronic devices to which a video call can be switched. The optimal electronic device may be selected, based on status information regarding each electronic device (e.g., battery level, process power, or memory status), a condition as to whether the user is currently using the electronic device, using network connection information, or previous connection information.
• FIG. 23C is a flowchart illustrating an example method of switching a video call to a third electronic device according to various example embodiments of the present disclosure.
• With reference toFIG. 23C, a third electronic device is capable of determining whether it detects a signal according to the change of the video call quality inoperation2341. For example, the third electronic device is capable of detecting a signal showing the change in the state of a second network, which is caused due to the location change or the presence of an external interference signals, during a video call. Alternatively, the third electronic device is capable of detecting a signal according to the change of the video call quality, which is caused by: the change in battery status, shortage of memory capacity, and insufficiency of processing power in the third electronic device; the quality degradation of the first network connecting the first and second electronic devices; and the change in battery level, short of memory capacity or insufficiency of processing power in the first or second electronic device.
• When the third electronic device detects the signal according to the change of the video call quality inoperation2341, it is capable of displaying at least one electronic device to which a video call is switched inoperation2343. For example, as illustrated inFIG. 23A, the third electronic device is capable of displaying a pop-up message including at least one electronic device to which a video call can be switched.
• The third electronic device is capable of determining whether an input for selecting an electronic device to which a video call is switched within a preset period of time is detected inoperation2345. When the third electronic device detects an input for selecting an electronic device to which a video call is switched within a preset period of time inoperation2345, it is capable of transmitting a signal for switching a video call to the selected electronic device inoperation2349. For example, when the third electronic device detects an input for selecting one of the electronic devices to which a video call is switched in a pop-up message, it is capable of transmitting a video call signal to the selected electronic device. Therefore, the first electronic device and the selected electronic device perform a video call to each other.
• On the other hand, when the third electronic device has not detected an input for selecting an electronic device to which a video call is switched within a preset period of time inoperation2345, it is capable of automatically selecting an electronic device to which a video call is switched, based on a preset condition, inoperation2347, and transmitting a signal for switching a video call to the selected electronic device inoperation2349. In various embodiments of the present disclosure, the preset condition may be a state of at least one electronic device to which a video call can be switched and network status information. The third electronic device is capable of receiving priority, determined based on a state of at least one of the electronic devices to which a video call can be switched or network status information, from the second electronic device, and automatically switching a video call to an electronic device with high priority.
• Although the embodiments are described in such a way as to: determine whether an input for selecting an electronic device to which a video call is switched is detected within a preset period of time; and switch a video call to the selected electronic device based on the determination, it should be understood that the present disclosure is not limited thereto. The embodiments may also display a pop-up window showing an option as to whether an electronic device to which a video call is switched is selected automatically or according to a user input. When the electronic device determines to select an electronic device to which a video call is switched, according to a user input, via the displayed pop-up window, it is capable of performingoperations2345 and2349 illustrated inFIG. 23C. When the electronic device determines to select an electronic device to which a video call is switched, automatically, on the displayed pop-up window, it is capable of performingoperations2347 and2349 illustrated inFIG. 23C.
• FIG. 24 is a diagram illustrating example operations of switching a video call to a fourth electronic device according to various example embodiments of the present disclosure.
• With reference toFIG. 24, various embodiments of the present disclosure are capable of switching a video call currently in service to a standalone device with an access function to a standalone network, e.g., a fourthelectronic device2411.
• In various embodiments of the present disclosure, the first electronic device2401 (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, the firstelectronic device1401 illustrated inFIG. 14A, the firstelectronic device1701 illustrated inFIG. 17A or 17B) and the second electronic device2405 (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A or 17B) are connected to each other via the first network2403 (e.g., thefirst network411 illustrated inFIG. 4, thefirst network1523 illustrated inFIG. 15). The secondelectronic device2405 and the third electronic device2409 (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIG. 17A or 17B) are connected to each other via the second network2407 (e.g., thesecond network413 illustrated inFIG. 4, or thesecond network1531 illustrated inFIG. 15). In addition, a fourthelectronic device2411 is capable of connecting to an external network independently via athird network2413, e.g., Wi-Fi, etc. Alternatively, the fourthelectronic device2411 is also capable of connecting to an external network via a wired network.
• The fourthelectronic device2411 is a device which is connected to or registered in the secondelectronic device2405. Alternatively, the fourthelectronic device2411 may be a new device which is not connected to or is not registered in the secondelectronic device2405. The fourthelectronic device2411 may be devices for public use, such as a TV or a monitor installed in public places. The owner and the user of the secondelectronic device2405 may differ from those of the fourthelectronic device2411.
• The secondelectronic device2405 or the thirdelectronic device2409, connected to the secondelectronic device2405 via thesecond network2407, is capable of requesting to switch a video call currently in service to the fourthelectronic device2411. The fourthelectronic device2411 is capable of requesting the secondelectronic device2405 or the thirdelectronic device2409 to switch a video call. The fourthelectronic device2411 and the secondelectronic device2405 or the thirdelectronic device2409 are capable of performing the transmission/reception of data for switching a video call to each other, as inoperations2417 and2419. Examples of the data for switching a video call are IP information, MAC information, secure certification information, VPN configuration information, or electronic device identification information. For example, the fourthelectronic device2411 is capable of requesting the secondelectronic device2405 or the thirdelectronic device2409 to switch a video call, via an NFC tagging, RFID, BLE, BT broadcasting, etc.
• In various embodiments of the present disclosure, the thirdelectronic device2409 providing a video call service or the secondelectronic device2405, connected to the thirdelectronic device2409 via thesecond network2407, is capable of displaying an image pattern, QR code or encryption data, in order to switch a video call. The fourthelectronic device2411 is capable of obtaining video call information from the displayed image pattern, QR code or encryption data via an image sensor, and requesting the connection of a video call.
• For example, when the fourthelectronic device2411 detects an input for selecting a menu for requesting to switch a video call, e.g., “video call connecting,” it is capable of activating a camera and transmitting a pattern of brightness signals of an LED or LCD screen or a flash to the secondelectronic device2405 or the thirdelectronic device2409. The secondelectronic device2405 of the thirdelectronic device2409 is capable of temporarily displaying a specified image pattern for switching a video call on the display unit, based on the pattern of signals received from the fourthelectronic device2411. The fourthelectronic device2411 is capable of reading the specified image pattern via the image sensor and performing the transmission/reception of data for switching a video call, based on the specified image pattern.
• In various embodiments of the present disclosure, the secondelectronic device2405 or the thirdelectronic device2409 is capable of accepting a video call with the fourthelectronic device2411, before connecting to the fourthelectronic device2411 or transmitting data for switching a video call.
• In various embodiments of the present disclosure, the fourthelectronic device2411 is capable of inserting information regarding the fourthelectronic device2411 into a specified ultrasonic or sonic wave pattern, and making a video call request to the secondelectronic device2405 or the thirdelectronic device2409 via a speaker and a microphone or transmitting/receiving data for switching a video call to/from the secondelectronic device2405 or the thirdelectronic device2409.
• For example, the fourthelectronic device2411 is capable of inserting its information, e.g., type, MAC information, connection information, etc., into a specified ultrasonic or sonic wave pattern or a BLE signal, and transmitting the information to the secondelectronic device2405 or the thirdelectronic device2409. The secondelectronic device2405 or the thirdelectronic device2409 is capable of determining video call data to be transmitted to the fourthelectronic device2411, based on the received information regarding the fourthelectronic device2411, and displaying the video call data on the display unit. When the secondelectronic device2405 or the thirdelectronic device2409 detects an input for selecting the determined video call data, it is capable of switching a video call to the fourthelectronic device2411.
• In various embodiments of the present disclosure, the thirdelectronic device2409 is capable of discovering nearby electronic devices to be connectable via a video call during a video call connection waiting, and displaying the discovered electronic devices. The thirdelectronic device2409 is capable of selecting one of the displayed electronic devices to be connectable via a video call.
• In various embodiments of the present disclosure, the thirdelectronic device2409 is capable of temporarily registering the fourthelectronic device2411 in an account server in the process of discovering and registering nearby electronic devices to be connectable via a video call.
• FIG. 25 is a signal flow diagram illustrating an example method of switching a video call to a fourth electronic device, flowing signals between first, second and fourth electronic devices, according to various example embodiments of the present disclosure.
• With reference toFIG. 25, a fourth electronic device2507 (e.g., the fourthelectronic device2411 illustrated inFIG. 24) is capable of requesting a second electronic device2503 (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A and 17B, or the secondelectronic device2405 illustrated inFIG. 24) to switch a video call, and transmitting information regarding the fourthelectronic device2507 to the secondelectronic device2503 inoperation2511. When the secondelectronic device2503 receives information regarding the fourthelectronic device2507 and a video call switching request signal from the fourthelectronic device2507, it is capable of transmitting, to the fourthelectronic device2507, a signal for authenticating the fourthelectronic device2507 and a signal for accepting the video call switching request by the fourthelectronic device2507 inoperation2513. The secondelectronic device2503 is capable of transmitting information regarding the video call connection with the first electronic device2501 (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, the firstelectronic device1401 illustrated inFIG. 14A, the firstelectronic device1701 illustrated inFIGS. 17A and 17B, or the firstelectronic device2401 illustrated inFIG. 24) to the fourthelectronic device2507 inoperation2515. The secondelectronic device2503 is capable of transmitting information regarding the fourthelectronic device2507 to the firstelectronic device2501 inoperation2517. The firstelectronic device2501 is capable of determining an encoding scheme, based on the information regarding the fourthelectronic device2507, inoperation2519, and encoding video data based on the encoding scheme inoperation2521. The firstelectronic device2501 is capable of transmitting the encoded video data to the fourthelectronic device2507 and switching a video call to the fourthelectronic device2507 inoperation2523. The fourthelectronic device2507 is capable of reproducing the received, encoded video data inoperation2525. The fourthelectronic device2507 receives a voice using the microphone (e.g., the microphone563) inoperation2527, and transmits the voice signal to the secondelectronic device2503 inoperation2529. The secondelectronic device2503 is capable of forwarding the received voice signal to the firstelectronic device2501 inoperation2531. Therefore, the firstelectronic device2501 and the fourthelectronic device2507 perform a video call with each other.
• Although the embodiment is described in such a way that the secondelectronic device2503 controls a video call switching to the fourthelectronic device2507, it should be understood that the present disclosure is not limited thereto. For example, although it is not shown inFIG. 25, a third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIGS. 17A and 17B, or the thirdelectronic device2409 illustrated inFIG. 24) may control a video call switching to the fourthelectronic device2507.
• In various embodiments of the present disclosure, when a video call is switched to the fourthelectronic device2507, the firstelectronic device2501 and the fourthelectronic device2507 perform a video call with each other, via the relay of the secondelectronic device2503. Alternatively, when a video call is switched to the fourthelectronic device2507, the firstelectronic device2501 and the fourthelectronic device2507 perform a video call with each other via a standalone network (e.g., thethird network2413 illustrated inFIG. 24)2415, without the relay of the secondelectronic device2503.
• In another embodiment, while the secondelectronic device2503 performs a video call with the firstelectronic device2501, it is capable of receiving a video call request signal from a standalone device, e.g., the fourthelectronic device2507. In various embodiments of the present disclosure, the secondelectronic device2503 is capable of establishing a new video call connection with the fourthelectronic device2507, while maintaining a video call with the firstelectronic device2501, thereby performing a three-way video call. The newly joined, fourthelectronic device2507 is capable of obtaining information regarding the video call connection with the firstelectronic device2501 from the secondelectronic device2503. The fourthelectronic device2507 is capable of joining a video call with the secondelectronic device2503, based on the obtained information regarding the video call connection with the firstelectronic device2501, thereby performing a three-way video call with the firstelectronic device2501. That is, the firstelectronic device2501, the secondelectronic device2503, and the fourthelectronic device2507 are capable of performing a three-way video call, and the secondelectronic device2503 and the fourthelectronic device2507 are capable of performing a one-to-one video call with the firstelectronic device2501. Various embodiments of the present disclosure enable the secondelectronic device2503 to make a video call with the firstelectronic device2501, without providing information regarding the secondelectronic device2503 to other nearby devices, thereby increasing a user's usability of video call service.
• In various embodiments of the present disclosure, after switching a video call to the fourthelectronic device2507, the secondelectronic device2503 may maintain the authority for controlling a video call of the fourthelectronic device2507 or the fourthelectronic device2507 to which the video call is switched may control the video call.
• FIG. 26 is a signal flow diagram illustrating an example method of switching a video call to a fourth electronic device using an account management server, flowing signals between first, second and fourth electronic devices, according to various example embodiments of the present disclosure.
• With reference toFIG. 26, various example embodiments of the present disclosure are capable of switching a video call from a third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIGS. 17A and 17B, or the thirdelectronic device2409 illustrated inFIG. 24) to a fourth electronic device2607 (e.g., the fourthelectronic device2411 illustrated inFIG. 24, the fourthelectronic device2507 illustrated inFIG. 25), using anaccount management server2600. The fourthelectronic device2607 is capable of requesting the second electronic device2603 (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A and 17B, the secondelectronic device2405 illustrated inFIG. 24, or the secondelectronic device2503 illustrated inFIG. 25) to switch a video call, and transmitting its information to the secondelectronic device2603 inoperation2611. When the secondelectronic device2603 receives a video call switching request signal and information regarding the fourthelectronic device2607, it is capable of authenticating the fourthelectronic device2607 inoperation2613. The secondelectronic device2603 is capable of transmitting, to the fourthelectronic device2607, a signal for accepting the video call switching request by the fourthelectronic device2607 inoperation2615.
• Although the embodiment is described in such a way that the secondelectronic device2603 authenticates the fourthelectronic device2607 inoperation2613, it should be understood that the present disclosure is not limited thereto. For example, the embodiment may be modified in such a way that a third electronic device, connected to an electronic device performing a video call, e.g., the secondelectronic device2603 via a second network (e.g., thesecond network413 illustrated inFIG. 4, thesecond network1531 illustrated inFIG. 15, or thesecond network2407 illustrated inFIG. 24), selects another electronic device, e.g., the fourthelectronic device2607, and switches a video call, and, in this case, it may not perform the authentication for the fourthelectronic device2607.
• The secondelectronic device2603 is capable of transmitting information regarding the video call connection with the first electronic device2601 (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, the firstelectronic device1401 illustrated inFIG. 14A, the firstelectronic device1701 illustrated inFIGS. 17A and 17B, the firstelectronic device2401 illustrated inFIG. 24, or the firstelectronic device2501 illustrated inFIG. 25) to fourthelectronic device2607 inoperation2617.
• In various embodiments of the present disclosure, the secondelectronic device2603 is capable of temporarily registering information regarding the fourthelectronic device2607 in aserver2600 inoperation2619.
• In various embodiments of the present disclosure, theserver2600 is capable of including a user account server. The user account server is capable of registering and managing user accounts and users' electronic devices. For example, the user account server is capable of managing a user's electronic device and information regarding the electronic device (e.g., status information) based on a user account. As described above, the user account server is capable of providing a method of temporarily registering an electronic device and performing a video call with the temporarily registered electronic device, as well as the user account-based management method. For example, when the user account server has registered a smartphone, a tablet PC, and a watch, based on a user account, it is capable of temporarily registering an electronic device, e.g., a TV, without using the user account. In this case, an electronic device performs a video call with the TV, temporarily registered in the user account server, without a user account.
• In various embodiments of the present disclosure, the firstelectronic device2601 is capable of receiving and updating information regarding the fourthelectronic device2607, as an electronic device to perform a video call, from theserver2600 inoperation2621. The secondelectronic device2603 is capable of transmitting information regarding the fourthelectronic device2607 to the firstelectronic device2601 inoperation2623.
• In various embodiments of the present disclosure, the fourthelectronic device2607 is capable of making a video call connection request to the firstelectronic device2601, based on information regarding the video call connection with the firstelectronic device2601, inoperation2625. The firstelectronic device2601 is capable of determining an encoding scheme, based on the information regarding the fourthelectronic device2607, inoperation2627, and encoding video data based on the encoding scheme inoperation2629. The firstelectronic device2601 is capable of transmitting the encoded video data to the fourthelectronic device2607 and switching a video call to the fourthelectronic device2607 inoperation2631. The fourthelectronic device2607 is capable of performing a video call with the firstelectronic device2601, reproducing the received, encoded video data inoperation2633. The fourthelectronic device2607 receives a voice using the microphone (e.g., the microphone563) inoperation2635, and transmits the voice signal to the secondelectronic device2603 inoperation2637. The secondelectronic device2603 is capable of forwarding the received voice signal to the firstelectronic device2601 inoperation2639. Therefore, the firstelectronic device2601 and the fourthelectronic device2607 perform a video call with each other.
• When the video call is ended, information regarding the fourthelectronic device2607, temporarily registered in theaccount management server2600, may be removed.
• Although the embodiment is described in such a way that the secondelectronic device2603 controls a video call switching to the fourthelectronic device2607, it should be understood that the present disclosure is not limited thereto. For example, although it is not shown inFIG. 26, a third electronic device may control a video call switching to the fourthelectronic device2507.
• In various embodiments of the present disclosure, when a video call is switched to the fourthelectronic device2607, the firstelectronic device2601 and the fourthelectronic device2607 perform a video call with each other, via the relay of the secondelectronic device2603. Alternatively, when a video call is switched to the fourthelectronic device2607, the firstelectronic device2601 and the fourthelectronic device2607 perform a video call with each other via a standalone network (e.g., thethird network2413 illustrated inFIG. 24), without the relay of the secondelectronic device2603.
• FIG. 27 is a diagram illustrating an example user interface when a third electronic device discovers nearby electronic devices and switches a video call to an electronic device, according to various example embodiments of the present disclosure.
• With reference toFIG. 27, a third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIGS. 17A and 17B, or the thirdelectronic device2409 illustrated inFIG. 24) is capable of discovering electronic devices to which a video call can be switched. For example, the third electronic device is capable of discovering electronic devices to which a video call can be switched, via at least one of the following: BLE, Wi-Fi, and Zigbee. The third electronic device is capable of displaying electronic devices which are connected to the same network as the third electronic device and to which a video call can be switched, in response to the operation for discovering electronic devices. For example, the third electronic device is capable of discovering electronic devices such as home appliances, electric apparatuses, health care devices, remote metering devices, smart home system, smart cars, etc., connected to a network to which the third electronic device is connected, and sharing information regarding the discovered electronic devices with each other.
• In various embodiments of the present disclosure, electronic devices to which a video call can be switched may or may not be registered, based on user accounts (a user account server). When an electronic device has been registered based on a user account, the third electronic device is capable of displaying an icon (e.g., a profile photo/picture) representing the registered electronic device, along with the account information. When an electronic device has not been registered based on a user account, the third electronic device is capable of displaying only an icon of the electronic device showing a connectable state, without showing account information. In various embodiments of the present disclosure, the account information may be contained in the discovery signal or may be obtained from a user account server, based on the discovery signal.
• In various embodiments of the present disclosure, when the third electronic device receives an input for selecting a specified one of the discovered electronic devices to which a video call can be switched, it is capable of controlling the first electronic device (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device2401 illustrated inFIG. 24, the firstelectronic device2501 illustrated inFIG. 25, or the firstelectronic device2601 illustrated inFIG. 26) and the selected, specified electronic device to perform a video call to each other.
• For example, as illustrated inFIG. 27, the third electronic device is capable of displaying a pop-upwindow2701 includingJesse2703,Kathryn2705, andTV icon2707 to which a video call can be switched, in response to the operation for discovering electronic devices to which a video call can be switched. In various embodiments of the present disclosure, when the third electronic device discovers an electronic device registered based on user account, it is capable of displaying icons corresponding to electronic devices ofJesse2703 andKathryn2705, along with accountinformation regarding Jesse2703 andKathryn2705. On the other hand, when the third electronic device discovers an electronic device which has not been registered based on user account, it is capable of displaying only anicon2707 representing a TV. When the third electronic device receives an input for selecting one of the icons representing electronic devices ofJesse2703 andKathryn2705 andTV2707, it is capable of switching a video call to the electronic device or the TV corresponding to the selected icon.
• In another embodiment of the present disclosure, a video call switching operation may also be performed via infrared communication. For example, various embodiments of the present disclosure are capable of selecting an electronic device to which a video call to be switched, by using a remote controller, an infrared light emitting unit of an electronic device, and a light receiving unit of a TV remote control. For example, electronic devices which need to perform a video call may exchange a signal for switching a video call and information regarding the electronic devices with each other via infrared communication. Therefore, various embodiments of the present disclosure allow users to intuitively switch a video call from one to another electronic device.
• FIG. 28 is a diagram illustrating an example connection among first to fourth electronic devices according to various example embodiments of the present disclosure.
• Various embodiments of the present disclosure are capable of performing a video call via a chain structure of an extended connection device or two or more electronic devices.
• With reference toFIG. 28, a first electronic device2801 (e.g., the firstelectronic device401 illustrated inFIG. 4, the firstelectronic device601 illustrated inFIG. 6, the firstelectronic device701 illustrated inFIG. 7, the firstelectronic device801 illustrated inFIG. 8, the firstelectronic device901 illustrated inFIG. 9, the firstelectronic device1401 illustrated inFIG. 14A, the firstelectronic device1701 illustrated inFIGS. 17A and 17B, the firstelectronic device2401 illustrated inFIG. 24, the firstelectronic device2501 illustrated inFIG. 25, or the firstelectronic device2601 illustrated inFIG. 26) is capable of connecting to a second electronic device2803 (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A and 17B, the secondelectronic device2405 illustrated inFIG. 24, the secondelectronic device2503 illustrated inFIG. 25, or the secondelectronic device2603 illustrated inFIG. 26) via a first network2821 (e.g., thefirst network411 illustrated inFIG. 4, thefirst network1523 illustrated inFIG. 15, or thefirst network2403 illustrated inFIG. 24). The secondelectronic device2803 is capable of connecting to a third electronic device2805 (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIGS. 17A and 17B, or the thirdelectronic device2409 illustrated inFIG. 24) via a second network2823 (e.g., thesecond network413 illustrated inFIG. 4, thesecond network1531 illustrated inFIG. 15, or thesecond network2407 illustrated inFIG. 24). The thirdelectronic device2805 is capable of connecting to ahome network server2807 via athird network2825. The fourthelectronic device2809 is capable of connecting to thehome network server2807 via afourth network2827.
• In various embodiments of the present disclosure, thehome network server2807 allows for the connection of a number of electronic devices. Thehome network server2807 is capable of connecting to an Internet of things (IoT) network. For example, thehome network server2807 is connected with n^thelectronic devices2811 (n is a positive integer) including the fourthelectronic device2809 via n^thnetwork2829 (n is a positive integer). Thehome network server2807 is capable of registering electronic devices over a wide area and also monitoring status information regarding the registered electronic devices. Therefore, users can recognize status information regarding the electronic devices registered in thehome network server2807 and immediately check whether electronic devices may perform a video call based on the status information.
• In various embodiments of the present disclosure, thehome network server2807 is capable of connecting a video call between the firstelectronic device2801 and the thirdelectronic device2805 to the fourthelectronic device2809.
• For example, when three or more electronic devices are connected in chain structure, one of the three or more electronic devices, in the middle of the chain structure, e.g., thehome network server2807, is capable of relaying information regarding the connected electronic devices and information regarding the network to the electronic devices.
• In various embodiments of the present disclosure, thehome network server2807 is capable of serving as an encoder. For example, thehome network server2807 is capable of controlling the firstelectronic device2801, the secondelectronic device2803, the thirdelectronic device2805, and the encoder of thehome network server2807 to transmit video data to the fourthelectronic device2809. When thefirst network2821, connecting the firstelectronic device2801 and the secondelectronic device2803, thesecond network2823, connecting the secondelectronic device2803 and the thirdelectronic device2805, and thethird network2825, connecting the thirdelectronic device2805 and thehome network server2807, have a relatively high level of quality, respectively, the firstelectronic device2801 or the secondelectronic device2803 is capable of transmitting video data for video call to thehome network server2807, without encoding the video data.
• In various embodiments of the present disclosure, thehome network server2807 is capable of encoding the received video data for video call, based on an encoding scheme, e.g., a transcoding scheme. For example, when thehome network server2807 employs a stationary power supply, it may encode video data more efficiently using its power supply than using a battery of the firstelectronic device2801 or the secondelectronic device2803.
• In various embodiments of the present disclosure, the process of encoding video data using a scalable encoding scheme is capable of transmitting part of the layers received from individual electronic devices to the next, connected electronic device, thereby maximizing a scalable encoding effect. For example, the firstelectronic device2801 is capable of transmitting a base layer and anenhanced layer #1 to the secondelectronic device2803, according to conditions. The secondelectronic device2803 is capable of transmitting the received base layer and the receivedenhanced layer #1 to the thirdelectronic device2805. The thirdelectronic device2805 detects a signal for switching a video call to the fourthelectronic device2809, it is capable of transmitting the base layer and theenhanced layer #1, received the secondelectronic device2803, to thehome network server2807. Thehome network server2807 is capable of transmitting, to the fourthelectronic device2809, not all the base layer and theenhanced layer #1, received from the thirdelectronic device2805, but only the base layer, according to conditions.
• Various embodiments of the present disclosure are capable of switching a video call, based on the thirdelectronic device2805 or thehome network server2807.
• FIG. 29 is a flowchart illustrating an example multiple connection method according to various example embodiments of the present disclosure.
• In various embodiments of the present disclosure, a second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A and 17B, the secondelectronic device2405 illustrated inFIG. 24, the secondelectronic device2503 illustrated inFIG. 25, the secondelectronic device2603 illustrated inFIG. 26, or the secondelectronic device2803 illustrated inFIG. 28) or a third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIGS. 17A and 17B, the thirdelectronic device2409 illustrated inFIG. 24, or the thirdelectronic device2805 illustrated inFIG. 28), connected to the second electronic device, is capable of independently performing a multiple video call. In various embodiments of the present disclosure, when a multiple video call is performed via the second electronic device or the third electronic device connected to the second electronic device, the second or third electronic device is capable of performing a first video call, e.g., a video calling which is performed in a normal way by transmitting/receiving video and voice signals, and a second video call with another electronic device newly joined, e.g., a video calling which is performed in such a way as to transmit/receive a video data, using a speech to text (STT) or text to speech (TTS) function.
• With reference toFIG. 29, the third electronic device is capable of performing a first video call inoperation2901. For example, the third electronic device has been performing a first video call, via a tablet PC.
• The third electronic device is capable of receiving a second video call request from a newly joined electronic device inoperation2903. For example, the third electronic device is capable of receiving a second video call request from a new electronic device while performing a first video call via the tablet PC.
• The third electronic device is capable of accepting a second video call inoperation2905. For example, the third electronic device is capable of: selecting another electronic device, e.g., a TV or a car kit, instead of the tablet PC, as an electronic device to perform a second video call; and perform a second video call with the newly selected electronic device.
• The third electronic device is capable of displaying first video data for a first video call and second video data for a second video call inoperation2907. For example, the first video call is referred to as a normal video call performed in such a way as to transmit/receive video and voice signals. The second video call is referred as a video call performed in such a way as to process voice information using an STT/TTS function, while displaying only an image on screen. For example, the third electronic device is capable of displaying subtitles for the voice information. When the third electronic device detects an input for entering characters/letters/text, it is capable of transmitting voice signals for the received characters/letters/text to the other party's electronic device. The third electronic device may employ a separate input device for entering characters/letters/text, e.g., a Bluetooth keyboard.
• In various embodiments of the present disclosure, the third electronic device is capable of discerning between an enabled video call and a video call in an idle state (e.g., a disenabled video call), using a control device, e.g., a watch, etc. For example, the third electronic device is capable of transmitting/receiving a voice signal when a video call is enabled. When the third electronic device receives a voice signal from the other party's electronic device when a video call is in an idle state, it is capable of notifying the user that a voice signal has been received from the other party's electronic device, by outputting a notification, vibration, blinking, a beep sound, etc.
• In various embodiments of the present disclosure, the third electronic device is capable of performing a first video call and a second video call inoperation2909. For example, the third electronic device is capable of splitting its screen into two areas and displaying first video data for a first video call on one of the two areas (a first area) and second video data for a second video call on the other area (a second area). The two split areas may be adjusted by the user. As described above, the first video call and the second video call are simultaneously performed in such a way that the first video call is performed as a normal video call and the second video call is performed using an STT/TTS function. Various embodiments are capable of discerning between an enabled video call and a video call in an idle state, and simultaneously performing a first video call and a second video call. In various embodiments of the present disclosure, notifications according to voice information may be displayed via individual windows. The third electronic device may output a notification via a watch.
• FIG. 30 is a flowchart illustrating an example method of storing video data according to various embodiments of the present disclosure.
• In various embodiments of the present disclosure, a second electronic device (e.g., the secondelectronic device403 illustrated inFIG. 4, the secondelectronic device603 illustrated inFIG. 6, the secondelectronic device703 illustrated inFIG. 7, the secondelectronic device803 illustrated inFIG. 8, the secondelectronic device903 illustrated inFIG. 9, the secondelectronic device1123 illustrated inFIG. 11, the secondelectronic device1215 illustrated inFIG. 12, the secondelectronic device1703 illustrated inFIG. 17A and 17B, the secondelectronic device2405 illustrated inFIG. 24, the secondelectronic device2503 illustrated inFIG. 25, the secondelectronic device2603 illustrated inFIG. 26, or the secondelectronic device2803 illustrated inFIG. 28) receiving a video call or a third electronic device (e.g., the thirdelectronic device405 illustrated inFIG. 4, the thirdelectronic device605 illustrated inFIG. 6, the thirdelectronic device705 illustrated inFIG. 7, the thirdelectronic device805 illustrated inFIG. 8, the thirdelectronic device905 illustrated inFIG. 9, the thirdelectronic device1413 illustrated inFIG. 14A, the thirdelectronic device1505 illustrated inFIG. 15, the thirdelectronic device1705 illustrated inFIGS. 17A and 17B, the thirdelectronic device2409 illustrated inFIG. 24, or the thirdelectronic device2805 illustrated inFIG. 28) connected to the second electronic device is capable of storing video call according to a user's setting or a user's selection. For example, a screen or voices of the video data may be stored. Alternatively, a screen and voices are stored together.
• With reference toFIG. 30, the third electronic device performs a video call inoperation3001. During a video call, the third electronic device is capable of detecting an input for storing video data inoperation3003. When detecting an input for storing video data, the third electronic device is capable of transmitting the detected input to the second electronic device. The second electronic device is capable of requesting the first electronic device performing a video call to transmit video data to store a video, based on the received input. For example, when the second electronic device receives an input for capturing or storing a specified screen from the third electronic device, while reproducing video data for video call, it is capable of requesting the first electronic device, which creates the video data for performing a video call, to transmit video data for the specified screen, e.g., images. When the first electronic device receives a request for transmission of video data for a specified screen from the second electronic device, it is capable of extracting video call corresponding to the specified screen and transmitting the extracted video data to the second electronic device. The first electronic device is capable of transmitting high quality of images, referred to as images not re-processed considering network status information, etc., to the second electronic device. The high quality of images may be transmitted via a control signal channel or a newly established channel.
• In various embodiments of the present disclosure, the third electronic device is capable of storing video data inoperation3005. For example, the third electronic device is capable of storing video call for a specified screen, based on external conditions of the second or third electronic device. For example, when the first electronic device is in an external environment where it is bright and nosy, and the second electronic device is in an external environment where it is dark and quiet, the third electronic device is capable of storing video call for a specified screen at a low level of brightness and a low level of volume corresponding to the external condition of the second electronic device. That is, images or voices may be captured and stored, considering information regarding the surrounding environment of the second or third electronic device.
• In various embodiments of the present disclosure, when the third electronic device transmits an input for storing a video running on a screen to the second electronic device, it may receive video data before video-processing from the second electronic device and may store the received video data. Therefore, the user's electronic device is capable of obtaining higher quality of video data. In this case, the video may be transmitted to and stored in the third electronic device or may be stored in the second electronic device. For example, when an external TV, as an electronic device to provide a video call service, is temporarily selected, the third electronic device is capable of storing the video in the second or third electronic device, instead of the TV providing a video call service. That is, an electronic device to store video data may be set according to attributes of the electronic device, e.g., a condition as to whether the account is registered, a condition as to whether a type of electronic device is a device for public use, etc.
• In various embodiments of the present disclosure, the video may be stored in a cloud storage. The cloud storage may include a cloud storage of electronic device owner's account, a cloud server of an account receiving a video call service, etc. The cloud storage may be selected by the user or according to attributes of an electronic device, e.g., a condition as to whether the account is registered, a condition as to whether a type of electronic device is a device for public use, etc.
• In various embodiments of the present disclosure, when the third electronic device stores video data, e.g., a video and voices, it is capable of inserting a meta tag, e.g., a video call time, a place where a video call is made, or information regarding an electronic device, in the video data or marking a video or an image with a watermark shape.
• In various embodiments of the present disclosure, when the third electronic device needs to store video data in small size or only voices, it is capable of extracting key frames and storing them using an image sliding method. For example, the third electronic device is capable of extracting key frames from video data for an interval of 10 minutes and storing the frames using an image sliding method. Therefore, various embodiments of the present disclosure are capable of storing video data reduced in storage capacity. The video may be stored in a format, synchronized with voice.
• In various embodiments of the present disclosure, the stored video data may be inserted into or removed from a specified image via an editor. Voice and video of existing video data may be synchronized with each other, regardless of inserted/removed images.
• FIG. 31 is a diagram illustrating an example configuration of software according to various example embodiments of the present disclosure.
• With reference toFIG. 31, various embodiments of the present disclosure are capable of providing a video calling method and a user interface, using application programming interface (API). Various embodiments of the present disclosure allow applications of electronic device manufacturers and third party applications to execute a video call and provide a corresponding user interface, using the API. For example, when anAPI3105 calls an API-Callingcomponents3101 for parameters for performing avideo call3109, it is capable of receiving aparameter return value3103 from the API-Callingcomponents3101. The API is capable of transferring theparameter return value3103 to the API-Implementing components3107. The API-Implementing components3107 are capable of implementing a user interface for performing a video call, using theparameter return value3103.
• As described above, the video encoding method according to various embodiments of the present disclosure enables an electronic device receiving a video call to provide video data suitable for video calling to a wearable device connected to the electronic device, so that the user can easily make the video call with the wearable device on his/her body. The electronic device is adapted to the video encoding method.
• The video encoding method according to various embodiments of the present disclosure is capable of analyzing states of a wearable device, in real time, and providing encoded video data, based on the analysis result, to the wearable device, so that the wearable device can smoothly make a video call although the wearable device has a limited battery level and a limited transfer rate. The electronic device is adapted to the video encoding method.
• Although the video encoding method and electronic device adapted thereto according to various embodiments have been described, the scope of the disclosure is not limited thereto, and various changes and modifications can be made without departing from the essential features of the disclosure by those skilled in the art. Accordingly, the embodiments disclosed are provided merely for describing, but not limiting, the technical idea of the disclosure, and the scope of the technical idea of the disclosure is not limited by the various example embodiments. The scope of the disclosure should be construed by the appended claims, and all technical ideas within a range equivalent to the scope should be understood as being included in the scope of the disclosure.

Claims (20)

What is claimed is:

1. An electronic device comprising:

a wireless communication circuit configured to communicate with a first electronic device;

a touchscreen configured to display a user interface for performing a video call;

a speaker;

a microphone;

one or more processors electrically connected to the communication circuit, the touchscreen, the speaker, and the microphone; and

a memory electrically connected to the one or more processors,

wherein the memory stores instructions that, when executed, cause the one or more processors to:

receive a signal related to an incoming video call from the first electronic device via the wireless communication circuit;

receive a user input accepting the video call via the user interface;

transmit a signal accepting the video call to the first electronic device via the wireless communication circuit in response to the user input;

receive a video stream from the first electronic device via the wireless communication circuit, wherein the video stream has been adapted at the first electronic device, based at least partly on:

status information on the electronic device and/or

status information on wireless communication between the electronic device and the first electronic device;

display the received video stream on the touchscreen while providing voice from the video call, using the speaker;

receive voice, using the microphone; and

transmit the received voice to the first electronic device, using the wireless communication circuit.

2. The electronic device ofclaim 1, wherein the instructions further cause the one or more processors to:

detect an alteration in a state of the electronic device or an alteration in a state of the wireless communication; and

receive a video steam, which differs from the received video stream by at least one of: a resolution, picture quality, and a frame rate, from the first electronic device via the wireless communication circuit,

wherein the status information on the electronic device includes at least one of: a type of the electronic device, a size of the touchscreen, processing power of the processor, a maximum resolution of the touchscreen, a battery status or level, memory status or capacity, or presence/absence of a camera, and

the status information on the communication includes a video call quality level for performing a video call.

3. The electronic device ofclaim 2, further comprising:

a camera,

wherein the instructions further cause the one or more processors to:

adapt a video stream taken by the camera, based at least partly on the status information on the electronic device and the status information on the wireless communication circuit; and

transmit the adapted video stream to the first electronic device via the communication.

4. The electronic device ofclaim 3, wherein the instructions further cause the one or more processors to:

detect at least one of a face or an iris of the user via the camera while receiving the video stream; and

display the received video stream on the touchscreen only while at least one of a face or an iris of the user is detected.

5. The electronic device ofclaim 1, wherein the instructions further cause the one or more processors to:

display an indicator to adjust a quality of the received video stream;

detect an input for adjusting the quality of video stream via the indicator;

determine an encoding scheme corresponding to the adjusted quality of video stream;

transmit the determined encoding scheme to the first electronic device;

receive a video stream, adapted based on the encoding scheme, from the first electronic device; and

display the received video stream.

6. The electronic device ofclaim 1, wherein the instructions further cause the one or more processors to:

set a region of interest (ROI) in the displayed video stream;

transmit the ROI to the first electronic device;

receive, from the first electronic device, a video stream, adapted based on at least one of: focus, crop, change in picture quality, or exposure adjustment, with respect to the ROI; and

display the received video stream.

7. The electronic device ofclaim 1, further comprising at least one motion sensor wherein the instructions further cause the one or more processors to:

detect orientation of the electronic device using the sensor, while receiving the video stream; and

display the received video stream on the touchscreen only while the detected orientation is in a selected range.

8. The electronic device ofclaim 1, wherein the instructions further cause the one or more processors to:

display the received video stream;

receive a user input for forwarding the video call;

display at least one external display device to which the video call can be forwarded;

receive a user selection of one of the at least one external display device; and

forward the video call to the selected external display device.

9. The electronic device ofclaim 1, wherein the instructions further cause the one or more processors to:

analyze the status information on the electronic device and the status information on the wireless communication; and

display a selectable the user interface on the touchscreen, wherein the user interface is indicative of at least one operation related to the video call, based on the analyzed status information on the electronic device and the analyzed status information on the wireless communication,

wherein the operation is related to at least one of a quality of the video stream, a voice only call, a video call using a second electronic device, or a voice call using the second electronic device.

10. The electronic device ofclaim 1, wherein the instructions further cause the one or more processors to:

receive another video call request via the first electronic device from a third electronic device while performing the video call;

detect an input for accepting the received video call request;

further receive a video stream of the other video call via the first electronic device from the third electronic device; and

display a screen of the video call on a first region of the touchscreen, and another screen of the other video call on

a second region of the touchscreen.

11. The electronic device ofclaim 1, further comprising a pressure detection sensor,

wherein the instructions further cause the one or more processors to:

detect an input pressing against the touchscreen while providing voice from the video call, using the speaker;

determine a pressure level of the detected input; and

perform an operation, based at least partly on the detected pressure level.

12. The electronic device ofclaim 1, wherein the instructions further cause the one or more processors to:

detect a touch gesture input using the touchscreen, while providing voice from the video call, using the speaker;

determine a direction of the input; and

perform an operation, based at least partly on the detected direction.

13. The electronic device ofclaim 1, wherein the instructions further cause the one or more processors to:

detect an input via the touchscreen for storing at least a portion of the received video stream; and

transmit, to the first electronic device, a request for storing, in the first electronic device, the at least a portion of the video stream, wherein the request includes information on time when the input is detected

14. The electronic device ofclaim 1, wherein the instructions further cause the one or more processors to:

receive, from the first electronic device, information on at least one electronic device capable of performing the video call;

display an indication of the at least one electronic device on the touchscreen;

receive a user input for selecting one of the at least one electronic device; and

transmit a signal for forwarding the video call to the selected electronic device to the first electronic device, using the wireless communication circuit.

15. The electronic device ofclaim 1, wherein:

the wireless communication circuit comprises at least one of: a Bluetooth modem or Wi-Fi modem.

16. The electronic device ofclaim 1, wherein the electronic device is smartwatch and the first electronic device is a smartphone.

17. An electronic device comprising:

a first wireless communication circuit configured to communicate with a first electronic device;

a second wireless communication circuit configured to communicate with a second electronic device;

a touchscreen configured to display a user interface to perform a video call;

a speaker;

a microphone;

one or more processors electrically connected to the first wireless communication circuit, a second wireless communication circuit, the touchscreen, the speaker, and the microphone; and

a memory electrically connected to the one or more processors,

wherein the memory stores instructions that, when executed, cause the one or more processors to:

receive a video call request from the first electronic device via the first wireless communication circuit;

display the received video call request on the touchscreen;

create a notification based on the received video call request;

transmit the created notification to the second electronic device via the second wireless communication;

receive a signal accepting the video call request from the second electronic device via the second wireless communication circuit;

stop displaying the video call request in response to the received signal accepting the video call request;

receive and adapt a video stream from the first electronic device, based at least partly on status information on the second electronic device and status information on the communication between the electronic device and the second electronic device;

transmit the adapted video stream to the second electronic device via the second wireless communication circuit; and

transmit voice, received from the second electronic device via the second wireless communication circuit, to the first electronic device via the first wireless communication circuit.

18. The electronic device ofclaim 17, wherein the instructions further cause the one or more processors to:

receive, from the second electronic device, at least one of a maximum resolution, a maximum level of picture quality, or a maximum frame rate (fps) of a video stream supported by the second electronic device;

adapt at least one of a resolution, a level of picture quality, or a fps of the video stream within the at least one of a maximum resolution, a maximum level of picture quality, or a maximum fps, based at least partly on the status information on the communication.

19. The electronic device ofclaim 17, wherein the instructions further cause the one or more processors to:

receive, from a third electronic device, a video call forwarding request and information on the third electronic device;

transmit video call connection information to the third electronic device; and

transmit information on the third electronic device to the first electronic device via the first wireless communication circuit.

20. An electronic device comprising:

a first wireless communication circuit configured to communicate with a first electronic device;

a touchscreen configured to display a user interface to perform a video call;

a speaker;

a microphone;

one or more processors electrically connected to the first wireless communication circuit, the touchscreen, the speaker, and the microphone; and

a memory electrically connected to the one or more processors,

wherein the memory stores instructions that, when executed, cause the one or more processors to:

transmit a video call request signal to the first electronic device via the first wireless communication circuit;

via the first wireless communication circuit, receive, from the first electronic device,

a signal accepting the video call request,

status information on a second electronic device, and

status information on communication between the first electronic device and the second electronic device;

adapt a video stream, based at least partly on the received status information on the second electronic device and the received status information on the communication;

transmit the adapted video stream to the first electronic device via the first wireless communication circuit; and

receive a voice from the first electronic device.

Images