US20150138300A1

Movatterモバイル変換

Info

Publication number: US20150138300A1
Application number: US14/566,652
Authority: US
Inventors: Sten Tamkivi
Original assignee: Skype Ltd Ireland; Microsoft Technology Licensing LLC
Current assignee: Skype Ltd Ireland; Microsoft Technology Licensing LLC
Priority date: 2011-09-02
Filing date: 2014-12-10
Publication date: 2015-05-21
Also published as: US20160277711A1; US9716859B2

Abstract

A mobile device, and a method and computer program product for displaying a streaming video image at the mobile device during a packet based video call via a channel established over a wireless communication network, the method comprising:

receiving a speed indication of the mobile device and sending said indication to a communication client application; and responsive to receiving said indication, the communication client application configured to limit the amount of information in the streaming video image that is supplied for display on a display means of the mobile device during the video call when the speed of the mobile device is greater than, or equal to, a first predetermined speed threshold.

Description

RELATED APPLICATIONS

This application is a continuation-in-part of and claims priority to U.S. patent application Ser. No. 13/341,642, filed on Dec. 30, 2011. U.S. patent application Ser. No. 13/341,642 claims priority under 35 USC §119 or §365 to Great Britain Patent Application No. 1115207.1, filed Sep. 2, 2011, the disclosures of which are incorporate in their entirety.

BACKGROUND

Some communication systems allow the user of a device, such as a personal computer, to conduct voice or video calls over a packet-based computer network such as the Internet. Such communication systems include voice or video over internet protocol (VoIP) systems. These systems are beneficial to the user as they are often of significantly lower cost than conventional fixed line or mobile cellular networks. This may particularly be the case for long-distance communication. To use a VoIP system, the user installs and executes client software on their device. The client software sets up the VoIP connections as well as providing other functions such as registration and authentication. In addition to voice communication, the client may also set up connections for other communication media such as instant messaging (“IM”), SMS messaging, file transfer and voicemail.

Mobile devices are commonly used to place voice over IP calls when a user of the device is driving. Such communication is aided by use of a hands free device which enables the user to concentrate on driving whilst a voice over IP call takes place.

With increasing mobile bandwidths, there is increasing interest in providing packet-based video calls via client applications running on mobile devices such as Internet-enabled mobile phones. These mobile devices comprise transceivers such as short-range RF transceivers operating on one or more unlicensed bands for accessing the Internet via wireless access points (e.g. of Wi-Fi access points of WLAN networks), and/or cellular transceivers operating on one or more licensed bands for accessing the Internet via a packet-based service of a cellular network such as GPRS (General Packet Radio Service) or HSPA (High Speed Packet Access).

Video calls take up a large amount of device and network resource, and it is not uncommon for video calls to fail or suffer reduced quality due to insufficient resource. To date attempts to solve this problem have focused on trying to hide such issues from a user as far as possible.

SUMMARY

Various embodiments are based on a novel concept, namely to intentionally restrict video information displayed to a user in dependence on a user condition, in particular the speed of a mobile device, so as not to distract the user when driving and prevent transmitting video information unnecessarily, where it is not required.

According to one aspect there is provided a method of displaying a streaming video image at a mobile device during a packet based video call via a channel established over a wireless communication network, the method comprising: receiving a speed indication of the mobile device and sending said indication to a communication client application; and responsive to receiving said indication, the communication client application configured to limit the amount of information in the streaming video image that is supplied for display on a display means of the mobile device during the video call when the speed of the mobile device is greater than, or equal to, a first predetermined speed threshold.

In one or more embodiments, the communication client application is configured to supply information in the streaming video image to the display means without limiting said information when the speed of the mobile device is less than the first predetermined speed threshold.

In one or more embodiments, wherein the communication client application is configured to limit the amount of information in the streaming video image by at least one of: dropping video frames of the streaming video image; reducing the display size of the streaming video image; and reducing the resolution of the streaming video image.

In one or more embodiments, the communication client application is configured to generate an indication in the display to notify a viewer that information in the streaming video image has been limited. The indication may adjust the image by (i) adding animation effects to the incoming video signal; or (ii) adding visual text and/or icons to the incoming video signal.

In one or more embodiments, the communication client application is configured to prevent display of the streaming video image when the speed of the mobile device is greater than or equal to a second predetermined speed threshold, and to limit the amount of information in the streaming video image when the speed of the mobile device is less than the second predetermined speed threshold.

In one or more embodiments, the communication client application receives state information of the mobile device, the state information used in addition to said speed indication to limit the amount of information in the streaming video image. The state information of the mobile may include at least one of a physical orientation of the mobile device, a vibration level of the mobile device, and whether an external hands free device is connected to the mobile device.

In one or more embodiments, the communication client application is configured to receive a notification of a travelling mode of operation and to limit the amount of information in the streaming video image when the mobile device is in the travelling mode of operation.

In one or more embodiments, the method further comprises presenting an option to answer the video call in the travelling mode to a user of the mobile device, the communication client application configured to receive the notification of the travelling mode responsive the user selecting the travelling mode of operation. The option to answer the video call in the travelling mode may only be presented to a user of the mobile device when the speed of the mobile device is above a predetermined speed threshold associated with the travelling mode.

In one or more embodiments, a sensor senses a physical orientation of the mobile device, wherein the travelling mode is only enabled when the speed of the mobile device is above a predetermined speed threshold associated with the travelling mode and the mobile device has a physical orientation that indicates that a user of the mobile device is not viewing the screen.

In one embodiment, the method comprises: executing the communication client application in an application layer on a processor at the mobile device; and receiving a video signal over the channel at a link layer of the mobile device; the communication client application configured to limit the information in the video signal received over the channel prior to display on said display means in the form of the streaming video image.

In this embodiment a speed detector at the mobile device receives the speed indication of the mobile device and sends the speed indication to the communication client application.

In another embodiment, the method comprises: executing the communication client application on communication processing apparatus at a remote device; the mobile device sending said indication to the communication client application over said channel; and the communication client application at the remote device configured to limit the amount of information in the video signal prior to transmission, over said channel, to the mobile device.

In this embodiment a speed detector at the mobile device detects said speed indication of the mobile device.

In one or more embodiments, the speed detector comprises a Global Positioning System (GPS) module.

In one or more embodiments, the video call is an Internet protocol-based video call.

According to a second aspect there is provided a mobile device comprising: wireless access circuitry configured to access a wireless communication network; display means; means for executing a communication client application to conduct a packet-based video call with a remote device via a channel established over the wireless communication network, said means coupled to the wireless access circuitry and the display means, wherein during the video call the communication client application is configured to receive, via the wireless access circuitry, a video signal transmitted over said channel from a remote device and display the video signal on said display means in the form of a streaming video image; and detection means arranged to detect a speed of the mobile device and send an indication of the speed of the mobile device to the communication client application, whereby responsive to receiving said indication, the communication client application configured to limit the amount of information in the streaming video image received over the channel prior to display on said display means during the video call when the speed of the mobile device is greater than, or equal to, a first predetermined speed threshold.

According to a third aspect there is provided a mobile device comprising: wireless access circuitry configured to access a wireless communication network; display means; means for executing a communication client application to conduct a packet-based video call with a remote device via a channel established over the wireless communication network, said means coupled to the wireless access circuitry; and detection means arranged to detect a speed of the mobile device and send an indication of the speed of the mobile device to the communication client application, whereby responsive to receiving said indication, the communication client application configured to transmit, via the wireless access circuitry, an indication of the speed of the mobile device to the remote device over the channel; the communication client configured to supply to the display means a streaming video image comprising information in a video signal received via the channel without limiting the information.

In one or more embodiments, the mobile device is one of: an Internet-enabled mobile telephone;

a handheld game console; a personal digital assistant (PDA); a tablet computer; a laptop computer.

According to a fourth aspect there is provided a user device comprising: wireless access circuitry configured to access a wireless communication network; means for executing a communication client application to conduct a packet-based video call with a mobile device via a channel established over the wireless communication network, said means coupled to the wireless access circuitry, wherein during the video call the communication client application is configured to receive, via the wireless access circuitry, an indication of a speed of the mobile device, the speed indication transmitted over said channel from the mobile device; and means for capturing video data and outputting a video signal;

the communication client application configured to generate the video signal for transmission, over said channel, to the mobile device during the video call and to limit the amount of information in the video signal generated for transmission when the speed of the mobile device is greater than, or equal to, a first predetermined speed threshold.

In one or more embodiments, the wireless communication network is the Internet.

According to a fifth aspect there is provided a computer program product for operating a mobile device comprising wireless access circuitry, display means, and communication processing apparatus, the program product comprising code embodied on a computer readable medium and configured so as when executed on the processing apparatus to: use the wireless access circuitry to establish a packet-based video call with a remote device via a channel established over a wireless communication network and receive a video signal transmitted over said channel from a remote device and display the video signal on said display means in the form of a streaming video image; use detection means to receive a speed indication of the mobile device; and limit the amount of information received in the video signal that is supplied for display on said display means during a video call when the speed of the mobile device is greater than, or equal to, a first predetermined speed threshold.

According to a sixth aspect there is provided a computer program product for operating a user device comprising wireless access circuitry, means for capturing video data and communication processing apparatus, the program product comprising code embodied on a computer readable medium and configured so as when executed on the processing apparatus to: use the wireless access circuitry to establish a packet-based video call with a mobile device via a channel established over a wireless communication network and receive via the wireless access circuitry, an indication of a speed of the mobile device, the speed indication transmitted over said channel from the mobile device; use the means for capturing video data to capture video data and output a video signal; use the wireless access circuitry to transmit the video signal over said channel to the mobile device during the video call; and limit the amount of information generated in the video signal for transmission, over the channel, when the speed of the remote device is greater than, or equal to, a first predetermined speed threshold.

Various embodiments enable a mobile device to operate in a way that will prevent or reduce the risk of a driver using the device becoming distracted, or to reduce the amount of data sent to a user who is unable to clearly view the incoming video.

It will be appreciated that a user of a mobile device would become easily distracted from driving if the user must divert his attention to look at his mobile device for long periods of time whilst a video over IP call is taking place. This has serious safety implications for the safety of the driver, in particular when the user using the mobile device is travelling at high speed.

Furthermore, there is a problem in that even if a mobile device has sufficient processing and bandwidth resources to support packet-based video calling, using these resources for too long will be wasteful of battery life and/or may be expensive if the connection is charged per unit data. Packet-based video calling is therefore still restricted by the available resources when accessed through a mobile device. Furthermore, from a network operator's perspective it may still be desirable to try to avoid excessive network traffic. It is thus advantageous to restrict the amount of video data where a user cannot clearly view the incoming video.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic representation of a communication system,

FIG. 2ais a schematic representation of a mobile terminal,

FIG. 2bis a schematic block diagram of a mobile terminal,

FIG. 2cis a schematic block diagram of a user terminal,

FIG. 3ais a schematic representation of a protocol stack,

FIG. 3bis a schematic representation of a communication system,

FIG. 4aillustrates a method of controlling the display of an incoming video signal,

FIG. 4billustrates another method of controlling the display of an incoming video signal,

FIG. 5aillustrates a method of presenting a call option,

FIG. 5billustrates another method of presenting a call option,

FIG. 6 illustrates a method of enabling a mode of operation of a mobile terminal.

DETAILED DESCRIPTION

FIG. 1 is a schematic illustration of acommunication system100 comprising a packet-basednetwork101 such as the Internet, and a mobilecellular network103. The mobilecellular network103 comprises a plurality of base stations104 (sometimes referred to as node Bs in 3GPP terminology). Eachbase station104 is arranged to serve a corresponding cell of thecellular network103. Further, the packet-switchednetwork101 comprises a plurality ofwireless access points106 such as Wi-Fi access points for accessing the Internet. These may be the access points of one or more wireless local area networks (WLANs).

A plurality of user terminals102 are arranged to communicate over thenetworks101 and/or103. At least one of the user terminals102 comprises a mobile device such as an Internet-enabled mobile phone, and others of the user terminals102 may comprise for example desktop or laptop PCs.

An examplemobile device102ais shown schematically inFIGS. 2aand2b. Themobile device102acomprises a processing apparatus in the form of one or more processor units (CPUs)211 coupled to amemory213 storing a communication client application. Theprocessor211 is also coupled to: anRF transceiver207 for accessing theInternet101, amicrophone202, aspeaker203, ascreen buffer217 for outputting video signals to thescreen201 of thedevice102a, and at least one of a front-facingcamera204 facing in the same direction as thescreen201 and a rear-facingcamera205 facing on the opposite direction to thescreen201. Themobile device102aalso comprises one or morephysical sensors215 coupled to theprocessor211, for sensing a state of themobile device102a, and aspeed detector209 for determining the speed of the mobile device, as will be discussed shortly.

Thephysical sensors215 may include accelerometers, gyroscopes, proximity sensors, and so forth. Thephysical sensors215 may also include sensors for battery charge state, connection to an external power supply, and such.

Anexample user terminal102bis shown schematically inFIG. 2c. Theuser terminal102bcomprises a processing apparatus in the form of one or more processor units (CPUs)218 coupled to amemory220 storing a communication client application. Theprocessor218 is also coupled to anRF transceiver216 for accessing theInternet101 and acamera107. Theuser terminal102bmay also comprisemicrophone212 for receiving audio signals, adisplay224 such as a screen, an input device such as akeyboard206 ormouse208, and an output device such as aspeaker210.

Each user terminal102 comprises one or

more transceivers

207,216 for accessing the one ormore networks101 and/or103. For example, each user terminal102 may comprise a cellular wireless transceiver for accessing the mobilecellular network103 via thebase stations104, and/or a wired or wireless modem for accessing theInternet101. In the case of a wireless modem, this typically comprises a short-range wireless transceiver (e.g. Wi-Fi) for accessing theInternet101 via the wireless access points106.

Access to theInternet101 may also be achieved by other means such as GPRS (General Packet Radio Service) or HSPA (High Speed Packet Access). At a higher level of the cellular hierarchy, thecellular network103 comprises a plurality ofcellular controller stations105 each coupled to a plurality of thebase stations104. Thecontroller stations105 are coupled to a traditional circuit-switched portion of the mobilecellular network103 but also to theInternet101. Thecontroller stations105 are thus arranged to allow access to packet-based communications via thebase stations104, including access to theInternet101. Thecontroller stations105 may be referred to for example as Base Station Controllers (BSCs) in GSM/EDGE terminology or Radio Network Controllers (RNCs) in UMTS or HSPA terminology.

Each user terminal102 further comprises a

non-volatile memory

213,220 such as an electronic erasable and programmable memory (EEPROM, or “flash” memory) coupled to the

processor

211,218. The memory stores communications code arranged to be executed on the processor, and configured so as when executed to engage in communications over theInternet101 and/orcellular network103.

The memory also stores code for other applications that may be executed on the processor, for example a navigation application, a photo application, a music player application, and so forth. Applications, executed by the processor, may be executed under the control of, and using services provided by, an operating system. For example, the operating system provide services that monitor and report device state information. The device state information may be received from thesensors215, such as battery charge state, speed, acceleration, and so forth. The device state information is also determined by the operating system, for example, application execution status. The application execution status indicates whether an application is running in the foreground (and is displayed on themobile device102a) or is running in the background (and is not displayed on themobile device102a).

The operating system also receives device state information from short-range wireless andcellular transceivers207 that indicate which transceiver(s) are active for an internet connect, the type of wireless connection in use (Wi-Fi, GPRS, EDGE, UMTS, HSPA, LTE, and such), the modulation and coding scheme in use with a wireless network, an indication that themobile device102ais roaming away from the home network of themobile device102a, and so forth.

The communications code can comprise a communication client application for performing communications such as voice or video calls with other user terminals102 over theInternet101, via a short-

range wireless transceiver

207,216 andwireless access points106, and/or via a

cellular wireless transceiver

207,216,base stations104 andcontroller stations105 of thecellular network103 as discussed above. However, one or more of the user terminals102 involved could alternatively communicate via a wired modem, e.g. in the case of a call between a mobile terminal and a desktop PC.

In this manner, amobile device102ais arranged to establish a call with another,remote terminal102bvia the Internet101 (or other packet-based network). In the example shown theremote terminal102bis a desktop computer, but in other embodiments could be another mobile device.

Particularly, if the video calling feature is enabled by the user, the call comprises a live video call between the

mobile device

102aand102b. The video call comprises an exchange of signals captured in real-time by the

devices

102aand102b, transmitted in the form of IP packets via theInternet101. The exchanged signals may comprise an incoming video signal from theremote terminal102bfor decoding by the client application on themobile device102aand output to thescreen201. The exchanged signals may comprise an outgoing video signal captured by one of the

cameras

204 or205 of the mobile terminal102 and encoded by the client on themobile device102afor transmission to theremote device102b. The exchanged signals may comprise both incoming and outgoing video signals, although alternatively the video call need not be bidirectional and could comprise video transmitted in only one direction from only one of the user devices102. The exchanged signals can also comprise an incoming audio signal from theremote device102bfor output via thespeaker203 on themobile device102a, and/or an outgoing audio signal captured by themicrophone202 on themobile device102afor transmission to theremote device102b. In the case of a phone call, the audio signals are typically speech signals encoded and decoded according to a suitable speech codec.

As will be familiar to a person skilled in the art, the basic mechanism by which user devices can communicate over a network such as the Internet can be considered as a protocol stack (embodied in the software running on each user device). There are a number of different protocol stacks depending on the communication type, but one is shown at301 inFIG. 3aas representative.

In this stack, the lowest layer is thelink layer316 which is responsible for conveying bits over an RF link between

devices

102aand102b. Thelink layer316 is responsible for conveying RF traffic in the form of (typically encoded) bits, modulated onto a carrier frequency.

Theinternet layer314 is the packet protocol responsible for immediate packet routing. Those skilled in the art will understand that a packet of data comprises both a header portion and a payload. The header comprises the internetwork address (e.g. IP address) of the destination user device, and the payload comprises the actual user data desired by the communication client application to be transmitted. When a routing node receives a packet, its IP layer software examines the IP address and determines the next adjacent routing node to which to route the packet (or end-user terminal device if the destination device is adjacent).

Thetransport layer312 adds additional header information wrapped on top of the IP header to provide services such as port numbering, congestion control and acknowledgement of packet receipt.

Finally, theapplication layer310 relates to the user information to be included in the packet payload, e.g. audio or video content of a voice or video call, or user text for an IM message. A client application operating on theapplication layer310 is free to include any content it wishes in the payload as appropriate to the application in question.

One embodiment will now be described with reference toFIG. 3b. During a video call avideo signal320 is transmitted from thedevice102bto themobile device102aover a channel established over thenetwork101. TheRF transceiver207 at themobile device102areceives thevideo signal320. Theprocessor211 executes code represented by the protocol stack shown inFIG. 3a. The receivedvideo signal320 is sent up the layers of the protocol stack to theapplication layer310, where the client application operates.

The client application running on theprocessor211 of themobile device102ais configured to detect, based on an input from thespeed detector209, the speed of the mobile102a. The client application is further configured to limit the amount of information in the received video signal that is sent to screenbuffer217 for outputting to thescreen201 during a video call based on the detected speed of themobile device102a. Operations conducted on thetransport layer312 in addition to operations conducted on theapplication layer310 may be implemented in order to limit the amount of information in the received video signal.

It is important to note that in this embodiment the amount of information in thevideo signal320 that is to be displayed on thescreen201 is only restricted after thevideo signal320 has been received by theRF transceiver207 at themobile device102a. That is, as much information in the video signal as is conveyed to the network is received by theRF transceiver207 at thelink layer316 and supplied to the client application.

As will now be discussed with reference toFIG. 4a, in this embodiment the presentation of video during a video call may be adapted when themobile device102ais operating in a “travelling mode”.

The operation of themobile device102ain the travelling mode is shown inFIG. 4 and commences atnode A401 wherebyuser108aof themobile device102ais conducting a video call withuser108bof theremote device102b. Atstep402, thespeed detector209 detects the speed of themobile device102aand sends the detected speed to the communication client application. This detected speed is then compared to a first predetermined speed threshold atstep403. This first predetermined speed threshold may be for example 30 km/h, those skilled in the art will appreciate that this threshold speed value is merely an example and is not limiting in any way.

If it is determined atstep403 that the detected speed of the mobile device is less than the first predetermined speed threshold then theincoming video signal320 fromremote device102bis displayed in aconventional manner404. An example scenario where this may occur is where theuser108ais in a car moving slowly in dense city traffic. In this scenario theuser108amay conduct a video call withuser108bwithout the video call being a distraction to theuser108aas any changes in the user's environment will occur slowly and theuser108awill be able to concentrate on both the video call and his environment in which he is driving.

If it is determined atstep403 that the detected speed of the mobile device is greater than, or equal to, the first predetermined speed threshold, then the detected speed is compared with a second predetermined speed threshold atstep405. This second predetermined speed threshold may be for example 70 km/h, those skilled in the art will appreciate that this threshold speed value is merely an example and is not limiting in any way. If it is determined atstep405 that the detected speed is greater than, or equal to, the first predetermined speed threshold but less than the second predetermined speed threshold then the display of theincoming video signal320 fromremote device102bis adjusted atstep406. An example scenario where this may occur is where theuser108ais in a car moving at normal city speeds (30 km/h-69 km/h). In this scenario theuser108amay conduct a video call withuser108bwhere the video call may become a distraction to theuser108aas the user must concentrate on changes in his environment that are occurring quickly as well as the video call.

Atstep406, one or more adjustments may be made to the display of theincoming video signal320 fromremote device102bto prevent theuser108abecoming distracted. These adjustments to the display of theincoming video signal320 may include for example dropping video frames such that the video appears to be a sequence of frozen images (i.e. still images); reducing the display size of the video displayed on thescreen201; and reducing the resolution of the incoming video signal.

Furthermore the display of theincoming video signal320 may be augmented by presenting visual clues (i.e. text or icons) to the user along with the incoming video signal to indicate the travelling mode of operation is active, or adding animation effects (such as blurring or slow motion) to the incoming video signal to show to the user that the change in transmission quality is a conscious decision by the communication client application, not unintentionally caused by technological constraints, such as insufficient device or network resource.

It is important to note that in this embodiment the augmentation of thevideo signal320 that is to be displayed on thescreen201 is only implemented after thevideo signal320 has been received by theRF transceiver207 at themobile device102a.

If it is determined atstep405 that the detected speed of the mobile device is greater than, or equal to, the second predetermined speed threshold, then the display of the incoming video is stopped atstep407. An example scenario where this may occur is where theuser108ais in a car travelling at high speeds (speeds greater than or equal to 70 km/h). In this scenario ifuser108awas to conduct a video call withuser108bthe video call would become a distraction to theuser108aas the user would have to concentrate on changes in his environment that are occurring very quickly as well as the video call. Conducting a video call whilst travelling at this high speed is potentially very dangerous therefore the display of theincoming video signal320 is stopped.

The operations implemented at

steps

406 and407 are temporary operations. It will be appreciated that in a given journey, a user's speed may vary greatly and thus the display of anincoming video signal320 can be adjusted accordingly. That is, theuser108amay start a journey at low speed (below 30 km/h) and a video call may be displayed in a conventional manner, when the user's speed increases (to between 30 km/h and 69 km/h) an appropriate adjustment may be made to the display of the incoming video signal, and if the user speed was to be equal to or exceed a certain level (greater than 70 km/h) the display of theincoming video signal320 would be stopped temporarily. When the display of theincoming video signal320 is stopped, an incoming audio signal from theremote device102bmay still be output via thespeaker203 so that communication between

users

108aand108bcan be maintained. If theuser108a's speed drops back down to below 70 km/h theincoming video signal320 would then be displayed touser108a, albeit potentially in adjusted form.

WhilstFIG. 4aillustrates two predetermined speed threshold levels for simplicity, it will be appreciated that any number of predetermined speed threshold levels may be used. In the case of using more than two predetermined speed threshold levels, it will be appreciated that one or more adjustments to theincoming video signal320 may be configured for each threshold level.

In addition to speed detection, the client application running on theprocessor211 of themobile device102amay be configured to detect additional readings relating to the state of themobile device102abased on an input from one ormore sensors215 and control the display of the video call onscreen201 based on the detected speed and the additional readings, this is shown inFIG. 4b.

As shown inFIG. 4b, speed information (S1-S3) determined by

steps

403 and405 is provided to adisplay control block408. Using the same example predetermined speed threshold levels as discussed above with reference toFIG. 4a, speed information S1 indicates to the client application thatuser108ais travelling below 30 km/h, speed information S2 indicates to the client application thatuser108ais travelling between 30 km/h and 69 km/h, and speed information S3 indicates to the client application thatuser108ais travelling at a speed that is equal to or exceeds 70 km/h.

These indications of the speed of themobile device102aspeed information (S1-S3) are supplied to thedisplay control block408. In addition to these indications of the speed of themobile device102a, additional readings relating to the state of themobile device102aare supplied to the display control block408 online409. The device state information and the speed information S1-S3 are used by the display control block408 to determine the most appropriate way of presenting anincoming video signal320 during a video call.

One or morephysical sensors215 coupled to theprocessor211, are used to sense a state of themobile device102aand send device state information to the client application running on theprocessor211. The device state information may include for example a physical orientation of themobile device102a(i.e. whether the device is in a horizontal or vertical position); a vibration level of themobile device102aor whether an external hands-free device is connected to themobile device102a.

If auser108ais travelling below the first predetermined speed threshold of 30 km/h and themobile device102ais experiencing a high level of vibration, then thedisplay control block408 may adjust the display of theincoming video signal320 or indeed stop the display of theincoming video signal320. This is in contrast to the operation ofFIG. 4awhere theincoming video signal320 fromremote device102bis displayed in a conventional manner whenuser108ais travelling below the first predetermined speed threshold of 30 km/h. An example scenario of where this may occur is when theuser108ais in a car moving slowly over rough terrain, therefore theuser108amust concentrate on changes in his environment as well as the video call, therefore one or more adjustments may be made to the display of theincoming video signal320 or the display of the incoming may be stopped to prevent theuser108abecoming distracted.

In an example, the communication client application may evaluate one or more sensor inputs over time to determine if themobile device102ais in a situation where an adjustment to the display of theincoming video signal320 should be made to reduce driver distraction. For example, a pattern of accelerations and decelerations from the accelerometer over a period of a few minutes may indicate that the driver is in stop-and-go traffic or a pattern of accelerometer and/or gyroscope readings may indicate that the driver is traversing a winding, mountain road and should not be distracted.

In another example, if the device state information indicates that the mobile device is in a horizontal position which indicates that theuser108ais not viewing thescreen201 of themobile device102a, then the display of the incoming video may be stopped even if the user is travelling at a speed less than the second predetermined speed threshold. This has several advantages including preserving battery life, reducing the cost of the video call if the connection is charged per unit data, and reducing network traffic.

In another example, device state information may be used without considering speed. Device state information may indicate that the communication client application is running in the background and thus is not displaying incoming video. For example, the user of themobile device102amay be using a navigation application that is displaying maps, or the user may be surfing the Web and be viewing content with a browser while only listening to the call.

An example method of enabling themobile device102ain the travelling mode of operation will now be discussed with reference toFIG. 5a.

When theuser108aof themobile device102areceives an incoming video call (step501) fromuser108bthe communication client application is arranged to provideuser108awith an option to answer the video call in the travelling mode (step502). This may be by way of a text-based message displayed on thescreen201 or alternatively an audio message output fromspeaker203. Theuser108amay respond to this message by making a physical selection by, for example, pressing a button of themobile device102aor touching thescreen201 in an appropriate position, or by speaking intomicrophone202.

Atstep503 it is determined if theuser102ahas selected to answer the video call in the travelling mode.

If theuser102aselects not to answer the video call in the travelling mode, it is determined atstep504 whether theuser102awishes to reject the video call. If it is determined atstep504 that theuser102awishes to reject the video call the video call is not answered (step506). If it is determined atstep504 that theuser102adoes not wish to reject the video call, the video call is answered atstep505 and will progress as normal.

If theuser102aselects to answer the video call in the travelling mode, then the video call is answered atstep507 and the communication client application operates in the travelling mode during the video call, as illustrated inFIG. 5aby the method proceeding tonode A401 previously shown inFIGS. 4aand4b.

The travellingmode option502 may only be presented to theuser108aif it is detected that theuser108ais travelling above a predetermined speed threshold associated with the travelling mode of operation. This method of enabling themobile device102ain the travelling mode of operation will now be discussed with reference toFIG. 5b.

As shown inFIG. 5b, when an incoming video call is received, instead of immediately proceeding to step502 (shown inFIG. 5a) of providinguser108awith an option to answer the video call in the travelling mode, thespeed detector209 detects the speed of themobile device102a(step508). The speed of themobile device102ais then compared, atstep509, to a predetermined speed threshold associated with the travelling mode of operation.

If the speed of themobile device102ais greater than or equal to the predetermined speed threshold associated with the travelling mode of operation then theuser102ais provided with an option to answer the video call in the travelling mode. However if the speed of themobile device102ais less than the predetermined speed threshold associated with the travelling mode of operation then theuser102ais provided with an option to answer the video call in a normal mode of operation (step510). It will be appreciated that the user may then select to answer the video call in the normal mode of operation or reject the video call. The predetermined speed threshold associated with the travelling mode of operation may be for example 5 km/h, those skilled in the art will appreciate that this threshold speed value is merely an example and is not limiting in any way.

Another example method of enabling themobile device102ain the travelling mode of operation will now be discussed with reference toFIG. 6.

Atstep601, thespeed detector209 detects the speed of themobile device102a. The speed of themobile device102ais then compared, atstep602, to a predetermined speed threshold associated with the travelling mode of operation. If the speed of themobile device102ais not greater than or equal to the predetermined speed threshold associated with the travelling mode of operation, then the travelling mode is disabled atstep606 if the travelling mode of operation has already been enabled. If the speed of themobile device102ais greater than or equal to the predetermined speed threshold associated with the travelling mode of operation, then the physical orientation of themobile device102ais determined atstep603.

Atstep604, it is determined whether the physical orientation of themobile device102aindicates that theuser108ais viewing thescreen201. If the physical orientation of themobile device102aindicates that theuser108ais viewing thescreen201, then the travelling mode is disabled atstep607 if the travelling mode of operation has already been enabled.

If the physical orientation of themobile device102aindicates that theuser108ais not viewing the screen201 (for example the mobile device is lying horizontally with thescreen201 faced up), then the travelling mode of operation is enabled atstep605. Thus the display of theincoming video signal320 is only adjusted or stopped when theuser108ais not viewing the screen; advantages of this have been previously described with reference toFIG. 4b.

It will be appreciated that it may be difficult to determine that the physical orientation of themobile device102aindicates that theuser108ais viewing thescreen201. For example themobile device102amay be being used by a passenger in a car or by a user seated on a moving train and it is therefore safe to display video without enabling the travelling mode.

If it is determined that theuser108ais not viewing thescreen201 atstep604, a message may be displayed (step not shown inFIG. 6) onscreen201 before enabling the travelling mode atstep605 to warn the user that the mobile device is going to enable the travelling mode and provide an option to prevent the mobile device from entering the travelling mode. If themobile device102ahas received no user input after a certain period of time has elapsed following the display of the message (indicating that theuser108ais not viewing the screen201) then the method proceeds to step605. However if themobile device102areceives a user input responsive to displaying this message the method proceeds to step607 where the travelling mode of operation is disabled if it has already been enabled.

Alternatively, if it is determined that theuser108ais not viewing thescreen201 atstep604, a message may be displayed (step not shown inFIG. 6) onscreen201 after enabling the travelling mode atstep605 to advise that the mobile device has entered the travelling mode and provide an option to disable the travelling mode. If themobile device102ahas received no user input after a certain period of time has elapsed following the display of the message (indicating that theuser108ais not viewing the screen201) then the travelling mode remains enabled and the method proceeds to step601. However if themobile device102areceives a user input responsive to displaying this message the method proceeds to step607 where the travelling mode of operation is disabled.

In a further example of travelling mode, the selection of enabling travelling mode may be made evaluating device state information to enable or disable travelling mode. Device state information comprising the state of active communication links may be evaluated, such as the state of Wi-Fi and cellular connections of themobile device102a. For example, if Wi-Fi is the active connection to the Internet, travelling mode is disabled and if the cellular connection is the active connection, travelling mode is enabled.

In the above described embodiment, the methods of controlling the display of theincoming video signal320 are implemented by a communication client application executed on aprocessor211 of themobile device102aafter the incoming video signal has been received.

An alternative embodiment will now be described referring back toFIG. 3b.

In this alternative embodiment, if the travelling mode has been enabled on themobile device102a(as discussed with reference toFIGS. 5a,5b, and6) the methods of controlling the display of a video signal displayed onscreen201 of themobile device102aare implemented by a communication client application executed on a processor of theremote device102bbefore the video signal is transmitted to themobile device102a.

In this alternative embodiment thespeed detector209 detects the speed of themobile device102aand instead of sending the detected speed to the communication client application executed on aprocessor211 of themobile device102a, the detectedspeed330 and/ordevice status information350 is sent totransceiver207 so that it can be transmitted via the channel established over thenetwork101 to theremote device102b.

Thetransceiver216 at theremote device102bis configured to receive the detectedspeed330 and/or thedevice state information350.

Theprocessor218 at theremote device102bexecutes code represented by the protocol stack shown inFIG. 3a. The detectedspeed330 and/or thedevice state information350 is sent to theapplication layer310 of the protocol stack where a client application operates.

During a video call,camera107 at theremote device102bis configured to capture video data and send the video data to the client application executed at theremote device102b. The client application running on theprocessor218 of theremote device102bis configured to receive the detectedspeed330 and/ordevice state information350 of themobile device102a. The client application is further configured to limit the amount of information in transmittedvideo signal340 that is transmitted fromtransceiver216 during a video call based on the detected speed and/or device state information of themobile device102a.

It is important to note that in this alternative embodiment the amount of information in thevideo signal340 that is to be displayed on thescreen201 is restricted (if required) before thevideo signal340 is supplied to theRF transceiver216 at theremote device102bfor transmission over the network. This has the additional advantage that network bandwidth is conserved in travelling mode. When received, all the (restricted) information in the video signal is played out at thescreen201.

In a further example, thedevice state information350 may indicate that themobile device102ais roaming. In response to receiving the indication that themobile device102ais roaming, the communication client application on theremote device102blimits the amount of information in transmittedvideo signal340, for example by reducing a video encoding rate. Reducing the amount of information transmitted in thevideo signal340 reduces network bandwidth usage and associated charges incurred by the user of themobile device102awhile roaming.

In an additional example, thedevice state information350 may indicate that the charge state of the battery in themobile device102ais low and the communication client application on theremote device102blimits the amount of information in transmittedvideo signal340 reducing the bandwidth of the transmittedvideo signal340 to reduce power consumption in a video decoder at themobile device102a.

It will be appreciated that in this alternative embodiment, the threshold levels as shown inFIGS. 4aand4bmay be used by the client application executed at theremote device102bto determine whether the information invideo signal340 is to be restricted, and if the information invideo signal340 is to be restricted, by what degree.

In this alternative embodiment, theremote device102bmay become aware that it is to limit the transmitted video340 (if required) responsive to receiving a message received from themobile device102athat is sent via the channel established over thenetwork101. This information may be signalled prior to the video call being answered, such as during call set up or using presence information.

There may be a certain degree of overlap between the two embodiments described hereinabove. For example, if during a video callmobile device102areaches a certain speed threshold, the detectedspeed330 can be transmitted via the channel established over thenetwork101 to theremote device102b. As described above, the client application running on theprocessor218 of theremote device102bis configured to receive the detectedspeed330 of themobile device102aand limit the amount of information in the transmittedvideo signal340 that is transmitted fromtransceiver216 as appropriate. It will be appreciated that there will be a period of time when themobile device102awill receive incoming video signal340 (that has not been limited in any way) prior to the client application executed onremote device102blimiting the transmitted video340 (if required). Therefore, the client application running on theprocessor211 of themobile device102amay be configured to immediately limit the amount of information in the received video signal340 (that has not been limited in any way) based on the detected speed of themobile device102a.

It will be appreciated that in both embodiments discussed hereinabove, the speed of themobile device102ais initially detected byspeed detector209. The speed detector may comprise a global positioning system (GPS) module to determine the speed ofmobile device102a. Alternatively the speed of themobile device102amay be determined by taking a direct speed measurement if the mobile device is connected to, or integrated entirely into, a vehicle such that the mobile device has access to the vehicle's metrics.

Speed may detected by other methods, such as dead reckoning using the gyroscope sensor or by combining the outputs of sensors, such as using the GPS module and the gyroscope to improve accuracy of speed detection.

It should be understood that the block and flow diagrams may include more or fewer elements, be arranged differently, or be represented differently. It should be understood that implementation may dictate the block and flow diagrams and the number of block and flow diagrams illustrating the execution of the embodiments. It should be understood that elements of the block and flow diagrams described above may be implemented in software, hardware, or firmware. In addition, the elements of the block and flow diagrams described above may be combined or divided in any manner in software, hardware, or firmware. If implemented in software, the software may be written in any language that can support the embodiments disclosed herein. The software may be stored on any form of non-transitory computer readable medium, such as random access memory (RAM), read only memory (ROM), compact disk read only memory (CD-ROM), flash memory, hard drive, and so forth. In operation, a general purpose or application specific processor loads and executes the software in a manner well understood in the art.

While this subject matter has been particularly shown and described with reference to various embodiments, it will be understood to those skilled in the art that various changes in form and detail may be made without departing from the scope of the claimed subject matter.

Claims

What is claimed is:

1. A method of displaying a video image by a communication client application at a mobile device during a video call over a wireless communication network, the method comprising:

receiving an indication of device state of the mobile device at the communication client;

determining the received indication of the device state meets a first condition; and

responsive to the determining that the first condition is met, limiting an amount of information from a received video signal that is supplied for display on a display of the mobile device during the video call.

2. The method ofclaim 1, further comprising:

sending the indication of the device state from the mobile device to a remote communication client application executing on a remote device, the sending being effective to enable the remote communication client application to:

determine if the indication of the device state meets a second condition; and

responsive to determining that the second condition is met, limit the amount of information in the video signal at the remote communication client application prior to transmission to the mobile device.

3. The method ofclaim 2, wherein the indication of the device state indicates that the communication client application at the mobile device is executing in a background mode, and wherein the limiting the amount of information at the remote communication client application comprises transmitting only an audio portion of the video call.

4. The method ofclaim 2, wherein the indication of the device state indicates that the mobile device is roaming, and wherein the limiting the amount of information at the remote communication client application comprises reducing a video encoding rate at the remote communication client application.

5. The method ofclaim 1 wherein the indication of the device state of the mobile device includes at least one of: a battery charge state, a type of wireless connection, an execution mode for the communication client application, a roaming communication state, or a travelling mode indication.

6. The method ofclaim 1, further comprising:

detecting a speed of the mobile device; and

receiving an indication of the detected speed at the communication client application that is conducting the video call on the mobile device.

7. The method ofclaim 6, further comprising:

responsive to determining the received indication of the detected speed exceeds a threshold, limiting the amount of information from the received video signal that is supplied for display on the display of the mobile device during the video call.

8. The method ofclaim 6, wherein the indication of the determined speed is used in addition to the indication of the device state to determine to limit the amount of information in the received video signal that is supplied to the display.

9. The method ofclaim 1, the method further comprising the communication client application:

receiving a notification of a travelling mode of operation; and

limiting the amount of information from the received video signal that is supplied for display during the travelling mode of operation.

10. The method ofclaim 1, the method further comprising the communication client application:

determining, based on the received indication of the device state, to initiate the travelling mode of operation; and

11. The method ofclaim 10, wherein the received indication of device state is an indication of the type of wireless connection.

12. A user device comprising:

wireless access circuitry configured to access a wireless communication network;

a video capture device configured to capture video data and output a video signal;

one or more processors, coupled to the wireless access circuitry and the video capture device, configured to execute a communication client application to perform operations comprising:

conducting a video call with a mobile device via a channel established over the wireless communication network;

receiving, via the wireless access circuitry, an indication of a device state of the mobile device, the indication of the device state transmitted over the channel from the mobile device; and

responsive to the receiving the indication of the device state, limiting the amount of information from the video signal that is transmitted to the mobile device in the video call.

13. The user device ofclaim 12, wherein the indication of the device state indicates that the communication client application at the mobile device is executing in a background mode.

14. The user device ofclaim 13, wherein the limiting the amount of information comprises transmitting only an audio portion of the video call.

15. The user device ofclaim 12, wherein the indication of the device state indicates that the mobile device is roaming, and wherein the limiting the amount of information comprises reducing a video encoding rate at the communication client application.

16. The user device ofclaim 12, wherein the indication of the device state indicates a wireless connection type at the mobile device.

17. The user device ofclaim 12, the communication client application to perform operations comprising:

receiving an indication of a detected speed from the mobile device; and

responsive to receiving the indication of the detected speed, limiting the amount of information from the video signal that is transmitted to the mobile device in the video call.

18. A mobile device comprising:

a display;

one or more sensors configured to detect a device state of the mobile device;

a processor, coupled to the wireless access circuitry, the display, and the one or more sensors, configured to execute a communication client application to perform operations comprising:

conducting a video call with a remote device via a channel established over the wireless communication network;

receiving an indication of the detected device state from the one or more sensors;

responsive to the receiving the indication, transmitting the indication of the device state to the remote device over the channel; and

supplying, to the display, a streaming video image comprising information in a video signal received via the channel without limiting the information supplied to the display.

19. The mobile device ofclaim 18, wherein the indication of device state of the mobile device includes at least one of a battery charge state, a type of wireless connection, an execution mode for the communication client application, a roaming communication state, or a travelling mode indication.

20. The mobile device ofclaim 18, further comprising:

a speed detector configured to detect a speed of the mobile device; and

the communication client application configured to perform operations comprising:

receiving an indication of the detected speed from the speed detector at the communication client application that is conducting the video call on the mobile device; and

responsive to the receiving the indication, transmitting the indication of the detected speed to the remote device over the channel, the transmitting the received indication being effective to cause the remote device to limit the amount of information transmitted in the video call.