The U.S. utility patent for the Serial No. 14/984,714 that patent application claims were submitted on December 30th, 2015The application of the priority of application, Application Serial No. 14/984,714 is fully incorporated herein by reference.
Modern telecommunication systems include the different of the second generation, the third generation and forth generation (2G, 3G and 4G) cellular radio access technologyStructure mixes, these technologies can intersect compatibility, and can co-operate to provide data communication services.The whole world is mobile logicalLetter system (GSM) is an example of 2G telecommunication technologies；Universal Mobile Communication System (UMTS) is that one of 3G telecommunication technologies showsExample；And long term evolution (LTE), including LTE is advanced and evolved high speed grouping access (HSPA+) is showing for 4G telecommunication technologiesExample.
Constitute modem telecommunication network infrastructure include be configurable to generate, send, receiving, relaying and/orRouting packet is so that data service can be asked by user equipment (UE) and be supplied to the multiple and different of user equipmentComponent or equipment (herein referred as node), which subscribes to one or more service providers by realization telecommunication networkOr the plan that Network communication providers provide.
However, data service and/or the data communication provided via node may frequently encounter due to a large amount of user andThe problem of UE leads to service degradation via telecommunication network access and request data.For example, since the height to digital content transmitsDemand (that is, data transmission overload), the problem of leading to service degradation, may be associated with data traffic congestion, and this may leadIt causes packet loss, queuing data packet's delay, connection and the communication of other data and connectivity problem can not be established.If serviceProvider or Network communication providers do not solve these problems, then can reduce the network service quality (QoS) at UE and final useThe user experience quality (QoE) at family.
Specific implementation mode
Technique described herein is determined by using widely network-based method the problem of leading to service degradationBasic reason (such as what problem having occurred, problem occurs why, where problem has occurred in telecommunication network) is come for serviceThe chance of the QoE of optimization data service is presented in provider and/or network provider.In order to determine the basic reason of problem, theseTechnology can from telecommunication network multiple and different nodes (or from the communication interface between two nodes in telecommunication network) orPerson collects different tracking files from the multiple or single layer of the communication protocol stack from one of equipment.Each tracking file includesThe mark for many different data grouping for being generated via the node in telecommunication network, receive, sending, relay and/or routeing(identification) daily record, and each tracking file journalization entry can be associated with timestamp.Once collection finishes,Different tracking files from multiple and different nodes can be associated by these technologies, to use widely network-based pointAnalysis services optimization chance to identify.Additionally or alternatively, these technologies can be by the communication protocol stack from one of equipmentDifferent layers data correlation, or can simply determine the performance metric of the data of the certain layer from particular device.ExampleSuch as, in association tracking file and after determining that QoE has gone through the reduction of certain degree, these technologies can provide alert notificationWith the recommendation for optimization, so as to realize remedial action the basic reason that solves the problems, such as.
In various embodiments, when tracking file association and analysis determination key performance indicators (KPI) are unsatisfactory for and QoEWhen associated minimum service level or service goal, these technologies provide alert notification and recommendation to network administrator.ThenNetwork administrator can initiate remedial action.In alternative embodiments, when service level or service goal are not satisfied, trackingThe collection of file, the association for tracking file and analysis and the realization of remedial action can automatically be held via preset network configurationRow.
In some embodiments, client device can collect the diagnosis about client device, such as clientThe operation log of each independent assembly of equipment or report.Diagnosis can be filtered and/or be combined to generate client device QoEDiagnostic file can be sent to network node for analyzing.In some embodiments, the QoE run at network nodeAnalyzer can analyze client device QoE diagnostic files leads to reduction to determine equipment KPI, equipment QoE and/or determineThe basic reason of the problems in the network of QoE or equipment (such as call drop).In some embodiments, it is determined from QoE diagnostic filesQoE diagnostic files and/or KPI can be polymerized to form polymerization QoE diagnosis or polymerization KPI database, can by withIn further analysis network to determine the basic reason of problem.For example, can be poly- for individual call, from individual equipmentIt closes in the boundary of the equipment KPI of calling or the polymerization calling from multiple equipment and executes basic reason analysis.In some embodimentsIn, QoE diagnostic files and/or KPI can be indexed according to position, time, device type, plant issue or access technology.
In some embodiments, client device can collect user equipment living document, including indicating equipment is variousThe diagnosis of the state of the physics movement of the state, equipment of component and/or the physical environment of client device.Various visitors can be combinedFamily end equipment QoE diagnostic files analyze client device living document, to determine that client device is undergoing the QoE of reductionShi Zengjia confidence levels.In some embodiments, equipment living document can be polymerize and is associated with polymerization QoE diagnostic files, with trueThe pattern of the user behavior for the QoE that fixed instruction reduces.In some embodiments, when equipment dynamic mode/behavior is determined, netNetwork resource can be assigned and/or retain for subsequent action.In some embodiments, when equipment dynamic instruction clientWhen equipment may be interrupted (for example, when user is inactive), message, alarm can be presented on a client deviceAnd/or advertisement.
Technique described herein and/or system can be changed by identifying the communication for the Quality of experience (QoE) that decline is presentedThe function of network is calculated into the function of computing device and/or improvement.By identifying that the QoE reduced, service provider can be distributedInternet resources and/or the additional resource of deployment improve the function of network.For example, if at least partly by low signal intensity(for example, low received signal strength indicator symbol (RSSI)) causes QoE to reduce, then service provider can dispose additional base station withIncrease signal strength.In another example, determine that the equipment dynamic of equipment QoE or client device can improve what identification reducedThe confidence level of QoE, this can allow service provider and/or network provider to adjust network characteristic (for example, software and/or hardPart) to improve the QoE of equipment.
Figure 1A is depicted for from using the different nodes of telecommunication network exchange data packets to collect multiple tracking filesIllustrative environment 100.For this purpose, environment 100 may include client device 102 (being considered as node herein) including multiple shiftingsMTN104, one or more data servers 108 and the Quality of experience of dynamic telecommunication network (MTN) node 106 (1) ... 106 (N)(QoE) optimization system 110.Moreover, environment 100 shows the tracking file recorded at each node.For example, client device102 is associated with one or more client device node tracking files 112, and MTN nodes 106 (1) ... 106 (N) are eachFrom associated with one or more MTN node trackings files 114 (1) ... 114 (N).In various embodiments, each data clothesBeing engaged in device 108 can be associated with one or more data server nodes tracking file 116.
As described above, client device 102 can also be referred to as UE.Therefore, client device 102 may include but unlimitedIn smart phone, mobile phone, mobile phone, tablet computer, portable computer, laptop computer, personal digital assistant(PDA), electronic book equipment, handheld games unit, personal media player device, wearable device or voice can be generatedAnd/or numerical data, voice and/or numerical data is asked by MTN 104, passes through MTN 104 and receives voice and/or digital numberVoice and/or any other portable electronic device of numerical data are exchanged according to, and/or by MTN 104.
MTN 104, which can be configured as, realizes the second generation, the third generation and forth generation (2G, 3G and 4G) honeycomb discussed aboveIt is one or more in wireless access technology.Therefore, GSM, UMTS and/or LTE/LTE advanced telecom may be implemented in MTN 104Technology.Different types of MTN nodes 106 (1) ... 106 during GSM, UMTS, LTE, LTE be advanced and/or HSPA+ telecommunication technologies(N) it can include but is not limited to the combination of the following terms：Base transceiver station BTS (such as node B, enhancement mode node B), radioNetwork controller (RNC), Serving GPRS Support Node (SGSN), in Gateway GPRS Support Node (GGSN), agency, mobile switchThe heart (MSC), mobility management entity (MME), gateway (SGW), packet data network (PDN) gateway (PGW), evolution groupingData gateway (e-PDG) is configured as that data are transmitted and/or route between client device 102 and data server 108Any other data service controlled entity of grouping.MTN nodes 106 (1) ... 106 (N) can be configured with generation and/or recordThe hardware and software of entry in MTN node trackings file 114 (1) ... 114 (N).Although Figure 1A shows MTN 104,It should be understood that technology discussed here can also be realized with other network technologies, such as wide area network in the context of this document(WAN), the node of the part of Metropolitan Area Network (MAN) (MAN), LAN (LAN), neighborhood net (NAN), personal area network (PAN) etc..
In various embodiments, as discussed further herein, it is each track entry include with by being used for MTN nodesThe packet of the interface communication of 106 (1) ... 106 (N) it is associated or with by MTN nodes 106 (1) ... 106 (N) routing numberAccording to the associated mark of grouping.In various embodiments, some in MTN nodes 106 (1) ... 106 (N) can be configured asAccess provide data communication services (such as so that client can access the information at data server 108) IP-basedA part for the core network (for example, Backhaul, carrier wave Ethernet) of network.Data server 108 can be by being based on webpageContent supplier possess and/or operate, including but not limited to：GoogleAmazonDeng.
In various embodiments, MTN 104 can be configured as using wired and or wireless links in client deviceExchange data packets between 102 and data server 108.In addition, MTN 104 can be configured as determining communication path or communication" pipeline " so that packet can be routed accordingly and exchange.
The data service and data access application discussed in this document can include but is not limited to web page browsing, video flowing,Any application on video conference, online game, social media application program or client device 102 or setting, are configuredTo generate data by MTN 104 and exchanging data with data server 108.
In various embodiments, QoE optimization systems 110 may be configured to monitor and determine and special services level or clothesBusiness target (for example, threshold value or model) associated KPI for different data service whether it is satisfied or is unsatisfactory for, can be withInfluence QoE.The example of the KPI of the other application executed for web page browsing and on client device 102 may include netPage the load time, domain name system (DNS) search the time, transmission control protocol (TCP) Connection Time, TCP two-way times (RTT),Hypertext transfer protocol (HTTP) response time etc..It is held for video flowing and video conference and on client device 102The example of the KPI of capable other application may include using start delay, catalogue browsing, search delay, video start delay, soonInto postpone with rewinding, multiple buffered events, the duration per buffered event, rate buffer, video frame rate etc. again.For UE'sOther KPI may include application layer KPI (such as average/min/max bit rate, bursts of traffic, transmission data byteAmount), transport layer KPI (such as transmission control protocol (TCP) retransmit and TCP resetting), radio layer KPI (such as radio links(RLC) is controlled to retransmit and RLC two-way times (RTT)) and physical layer KPI (such as physics re-transmission, physics RTT, physical uplink link(UL) interference, UE power, RACH times).KPI provided above is only shown as example, and therefore, list is not exhaustive.On the contrary, service provider and/or network provider may consider that a large amount of different KPI, these KPI help to measure and be carriedThe associated QoE of data service of confession.
Figure 1B depicts showing for a part for the architectural framework 150 of QoE optimization systems 110 according to an embodiment of the present disclosureExample.As shown, the QoE analyzers 152 of architectural framework 150 can receive one or more tracking files 154 (1), 154(2)…154(J).QoE analyzers 152 can determine from one or more tracking files 154 (1), 154 (2) ... 154 (J)The performance metric associated with KPI 156 of the data of all or subset.QoE analyzers 152 can also be associated with from one orMore are tracked files 154 (1), the data of 154 (2) ... 154 (J) and are closed based on performance threshold or the analysis of performance model 158Whether connection data are presented reduction with one or more tracking files 154 (1) of determination, 154 (2) ... 154 (J) communication representedQoE.Then the performance metric generated by QoE analyzers 152 or associated data can be used to generate one or more figuresIndicate 160 and/or one or more text representations 162.Alternatively, or in addition, when QoE analyzers 152 determine by one orWhen the QoE reduced is presented in the communication that more tracking files 154 (1), 154 (2) ... 154 (J) are indicated, alarm 164 can be provided.
In various embodiments, one or more tracking files 154 (1), 154 (2) ... 154 (J) can be from singleThe tracking file (such as tracking file 112,114 or 116) of a node, or can be the tracking file from multiple nodes(for example, multiple in tracking file 112,114 or 116).Each tracking file 154 may include from equipment (such as clientOne of end equipment 102, MTN nodes 106 or data server 108) communication protocol stack (for example, communication protocol stack 222)Single layer or multiple layers of data from this equipment.For example, tracking file 154 may include transmission control protocol(TCP) daily record, packet capture (PCAP) daily record, the expansible diagnostic module of high pass (QXDM) daily record, using daily record (for example,LogCat daily records) etc..The data being included in tracking file 154 can be associated with any kind of communication, such as channel radioLetter, the communication etc. based on packet radio.The example of such communication is described further herein.
Data can be extracted from tracking file by automatic daily record parser tool, can for example be connect with tracking fileIt is associated to receive module 410 (as further discussed herein in regard to Fig. 4).The data for tracking file 154 and/or extraction then can be withIt is stored in the tracking document data bank 412 of QoE optimization systems 110 (as further discussed herein about Fig. 4).In some realitiesIt applies in example, another module of tracking file reception module 410 or QoE optimization systems 110 then can will be from tracking file 154The data and/or tracking file 154 of extraction are supplied to QoE analyzers 152 in itself.
QoE analyzers 152 (can such as track file association mould by one or more modules of QoE optimization systems 110Block 414 intersects file analyzing module 416 and tracking sequence (sorting) module 422) it realizes.In some embodiments, QoEAnalyzer 152 can be retrieved associated with single layer (for example, radio layer) in the tracking file 154 for being included in individual equipmentData.Such data can be retrieved for example from tracking document data bank 412, or can be by tracking file reception module410 are supplied to QoE analyzers 152.
Then QoE analyzers 152 can determine performance metric associated with the KPI for the data for receiving/retrieving.Work as instituteWhen the data of reception/retrieval are associated with radio layer, QoE analyzers 152 can determine and such as RLC re-transmissions, packet loss, networkSignaling, radio resource control (RRC) state duration, radio state conversion time, in different radio statesTime of cost, the number of radio state conversion or the associated property of radio layer KPI that reconfigures the response time etcIt can measurement.When the data for receiving/retrieving are with network, transmission or associated internet layer, QoE analyzers 152 can determine withSuch as domain name service (DNS) RTT, TCP RTT, hypertext transfer protocol (HTTP) RTT, TCP re-transmissions, TCP duplicate acknowledgments, TCPThe associated performance metrics of KPI of resetting, TCP failures, delta frame or sequence number etc.QoE analyzers 152 then can be by instituteThe instruction of determining performance metric and their associated KPI are supplied to another module of QoE optimization systems 110, such asIt presents and notification module 424.Other modules then can generate for some or all performance metrics graphical representation 160 orOne or both of text representation 162 for some or all performance metrics.
Figure 12 to Figure 16 is the example of the graphical representation 160 of the performance metric determined by QoE analyzers 152.In fig. 12,Graphical representation 1200 is radio state synoptic diagram.In fig. 13, graphical representation 1300 is one or more search keystrokesThe chart of http response time.In fig. 14, graphical representation 1400 is one or more search keystroke http response timesThe chart of component.In fig.15, graphical representation 1500 is to search for the chart of keystroke response time and the correlation of radio state.In figure 16, graphical representation 1600 is the chart of HTTP keystroke http response time and the correlation of radio state.It can be withGenerate or alternatively generate any amount of other types for performance metric associated with KPI 156 or associated dataChart and figure.
Figure 17 is the example of the text representation 162 of the performance metric determined by QoE analyzers 152.As shown in figure 17, textIndicate that 1700 be radio state conversion log.It can also generate or alternatively generate for property associated with KPI 156Other any amount of texts or daily record of energy measurement or associated data indicate.
Return to Figure 1B, QoE analyzers 152 can also retrieve or alternatively retrieve and be included in one of individual equipment orMultiple layers (for example, radio layer and network layer) associated data in more tracking files 154.For example, can fromSuch data are retrieved in track document data bank 412, or can provide it to QoE by tracking file reception module 410Analyzer 152.QoE analyzers 152 then can be associated with each other by the data for receiving/retrieving from different layers.For example, byAssociated data can indicate packet.QoE analyzers 152 can by from first layer expression packet data withThe data of expression packet from the second layer are associated.In some embodiments, QoE analyzers 152 can be based on firstThe expression of the IP payload of packet in layer and the second layer carrys out associated data.As described above, by QoE analyzers 152 intoCapable association can be realized by the module (such as, tracking file association module 414) of QoE optimization systems 110.Phase between layerClosing property is described in further detail below in reference to Fig. 6.
In some embodiments, QoE analyzers 152 can also from or alternatively from multiple tracking files of multiple equipmentData are retrieved in 154.For example, such data can be retrieved from tracking document data bank 412, or can be by tracking textPart receiving module 410 provides it to QoE analyzers 152.Then, QoE analyzers 152 can be with associated data.Data can be with baseIt is associated in tracking mark (tracking ID).Each equipment can be to identical packet, request/response pair or communication sessionUse identical tracking ID.Association of the QoE analyzers 152 between the tracking file 154 of multiple equipment can be optimized by QoE isThe module (such as, track file association module 414) of system 110 is realized.This association is further retouched in more detail hereinIt states.
In various embodiments, then QoE analyzers 152 can be based on any one of performance threshold or model 158 or twoPerson carrys out analyzing and associating data.Performance threshold or model 158 can be static or study.For example, performance threshold or model 158 canTo indicate packet, request/response or the representative communication of session.When associated data and performance threshold or model 158 mismatchOr when except tolerance threshold value, QoE analyzers 152 can determine shows the QoE declined by the communication that associated data indicates.AssociationThis analysis of data can be realized by the module (such as intersecting file analyzing module 416) of QoE optimization systems 110.ThisAnalysis is further more fully described herein.
When QoE analyzers 152, which are determined, shows the QoE declined by the communication that associated data indicates, QoE optimization systems110 module can provide the alarm 164 to the QoE of decline.Presentation and notification module 424 can be the examples of this module,And the alarm of the QoE of decline can be provided in response to the QoE declined by the determination of QoE analyzers 152.
Additionally or alternatively, the module (such as presenting and notification module 424) of QoE optimization systems 110 can generate passJoin the graphical representation 160 or text representation 162 of data.
Fig. 1 C depict example context 170, and client device 102 can be by one or more client devices whereinQoE diagnostic files 176 are sent to QoE analyzers 180, and analyze and can be executed by QoE analyzers 180.In some embodimentsIn, other than one or more client device QoE diagnostic files 176 or instead of one or more client devicesQoE diagnostic files 176, QoE analyzers 180 can receive tracking file 174 (1), 174 (2) ... 174 (K) and one or moreMultiple client equipment tracks file 178.
QoE analyzers 180 can correspond to the QoE analyzers 152 of Figure 1B, and can be by the one of QoE optimization systems 110A or more module is realized.In some embodiments, QoE analyzers 180 can be excellent with QoE analyzers 152 and/or QoEChange system 110 executes operation parallel, and in some embodiments, QoE analyzers 180 can substitute QoE analyzers 152 and/orQoE optimization systems 110 execute operation.
In some embodiments, one or more tracking files 174 (1), 174 (2) ... 174 (K) can correspond to Figure 1ATracking file 114 and 116 and Figure 1B tracking file 154.In some embodiments, one or more clients are setStandby tracking file 178 can correspond to one or more client devices tracking file 112 and the tracking of Figure 1B of Figure 1AFile 154.
Client device 102 may include client device Quality of experience (QoE) module 172, can use hardware, firmwareOr software is implemented to carry out the operation or execution of generation, aggregation, collection, formulation, filtering, division, estimation, record, trackingOne or more client device QoE diagnostic files 176 are sent to any pretreatment or post-processing of QoE analyzers 180.In some embodiments, client device QoE modules 172 can monitor some or all operations of client device, and canCorrespond to the operation log each operated or report to generate or collect.For example, client device QoE modules 172 can monitorCall state, user interface state, IP multimedia subsystem (IMS) Session initiation Protocol (SIP) of client device 102 disappearBreath, the switching of client device 102, real-time transport protocol (RTP) statistics, call setting, signal data, radio bands data,Position data, timestamp and device data.In some embodiments, client device QoE modules 172 can create monitoring clientThe operation log that end equipment 102 operates, and in some embodiments, client device QoE modules 172 can collect and filter quiltThe data being included in one or more client device QoE diagnostic files 176.In some embodiments, one or moreA client device QoE diagnostic files 176 may be embodied in the information for generating, assembling and/or collecting on client device 102,KPI and/or client device QoE can be determined (by client device QoE modules 172 or QoE analyzers by the information180).In some embodiments, QoE modules 172 for example are intended to monitor between the application in client device 102 by monitoringMessage, to determine the mode of operation of client device 102.Client device QoE modules are also discussed in conjunction with Figure 18 to Figure 21172 and one or more client device QoE diagnostic files 176.
QoE analyzers 180 may include network KPI modules 182, QoE polymerizers module 184 and QoE trend modules 186.In addition, QoE analyzers 180 can include such as processor of one or more processors 402 etc, such as memory 404Etc memory, such as equipment OS 406 equipment OS and Fig. 4 some or all modules 408-426 (such as herein in regard toWhat Fig. 4 was further discussed).
QoE analyzers 180 can receive one or more client device QoE diagnostic files 176 and can analyzeOne or more files 176 are to determine the QoE or the reduction that are determined for client device 102 and are undergoing declineThe KPI of QoE, or can determine that client device 102 had previously had gone through the KPI of decline or reduction QoE.At someIn embodiment, KPI can before being sent to QoE analyzers 180 by client device 102 (or by client device QoE mouldsBlock 172) it determines.For example, it is (all can be based on real-time packet oriented protocol (RTP) data by client device voice quality QoE KPISuch as RTP Loss Rates) and sip message tracking data (such as codec type and sample rate) (such as herein in regard to Figure 18 to Figure 21Further discuss) it is predicted.The example of QoE decline or reduction may be call drop, the increase of call drop frequency, voice, videoOr data communication quality declines and call setup problem, connection delay can not connect.In some embodiments,QoE analyzers 180 can based on the mode of operation of client device 102, the KPI that is measured or determined by client device 102 and/Or the QoE or QoS that is measured or determined by client device 102 determines decline or reduction QoE.
As non-limiting example, the QoE KPI for audio call can indicate whether calling loses, whether exhalesCry the presence for establishing any silent period unsuccessfully, in audio call and amount (for example, being not desired to caused by data transmission faultThe silence wanted), Mean Opinion Score number (MOS scores) (eictic word sound calling quality, in the range of 0 to 5), supply state, registrationTime quantum needed for state and/or call setup.It for example, can for " good " QoE of LTE voices (VoLTE) callingTo be " without call drop ", " failing without call setup ", " without silent period ", " average value of 4.3MOS ", " does not supply and askTopic ", " no registration problem " and " 4 seconds call set-up times ".On the other hand, for example, " poor " QoE VoLTE callings canWith include the instruction of " call setup success " still " 9 seconds call set-up times ".In this illustration, call set-up time canCan be 5 seconds longer than average call settling time, this can be shown that QoE reductions.In addition, " poor " QoE VoLTE callings may includeThe instruction of " starting 30 seconds silent periods after entering calling 40 seconds " and " call drop occurs after silent period ".In addition, " worse " QoEThe example of VoLTE callings may include the instruction of " call drop (due to matching supply problem) immediately after trial ".Such as above and below the disclosureIt should be understood that these examples of the QoE for VoLTE callings are illustrative and may include other factors, refer in textShow and/or time span.
Network KPI modules 182 can execute operation to determine or estimate the KPI or QoS of client device 102.Network KPIModule 182 can determine the network-based of client device 102 based on the data or parameter that can be used for QoE analyzers 180KPI, such as one or more client device tracking files 178 and/or tracking file 174.In some embodiments, networkKPI modules 182 can be based in part on the QoS of client device 102, or be based in part on from one or more clientsEquipment tracks the KPI that file 178 and/or one or more tracking files 174 determine, to determine the base of client device 102In the KPI of network.
QoE polymerizers module 184 can polymerize from one or more client device QoE diagnostic files 176 and/or netIt is the determination of network KPI modules 182 or being received from client device 102 (for example, such as being determined by client device QoE modules 172) client device KPI or client device QoE.In some embodiments, QoE polymerizers module 184 can use one orMore client devices QoE diagnostic files 176 polymerize KPI, and in some embodiments, and QoE polymerizers module 184 can be withConverging network and equipment QoE KPI, and in some embodiments, equipment QoE KPI can be by a variety of communications (for example, voiceCalling) it is polymerize for multiple client equipment.
QoE trend modules 186 can determine the QoE trend of individual customer end equipment 102, or can determine and be connected toThe multiple client equipment of MTN 104 and/or the QoE trend of node.In some embodiments, QoE trend modules 186 can be withTime aggregation is directed to one or more client device QoE diagnostic files 176 of single client equipment 102, and at otherIn embodiment, QoE trend modules 186 can polymerize the QoE diagnostic files that multiple equipment is directed in any time section.In some realitiesIt applies in example, QoE polymerizers module 184 can polymerize the client device determined by QoE analyzers 180 or client device 102KPI and/or QoE.In some embodiments, QoE trend modules 186 can generate the figure and/or text representation of trend data,And/or the alarm that instruction trend has been detected or can be repaired can be generated.QoE analyzers 180, network KPI mouldsBlock 182, QoE polymerizers module 184 and QoE trend modules 186 are discussed also in relation with Figure 18 to Figure 21.
Figure 22 to Figure 24 is the figure of the polymerization unit KPI and/or QoE metric according to an embodiment of the present disclosure for showing trendThe example that shape indicates.In some embodiments, graphical representation 2200,2300 and 2400 can be by QoE analyzers 180 for individualClient device 102 determines, or can be directed in certain period and be indicated by QoE analyzers 180 and/or QoE trend modules 186The aggregated data of multiple equipment determines.In fig. 22, graphical representation 2200 is point to the cutting off rate in each region or marketAnalysis.In fig 23, graphical representation 2300 is the chart of the cutting off rate and call drop source that are indexed according to device model.In fig. 24,Graphical representation 2400 is the chart of the cutting off rate indexed on period T1, T2, T3, T4 and T5 by access technology.Client is setOther any amount of figures and chart of standby KPI and/or QoE can also be generated or be alternatively generated.
Fig. 2 shows the exemplary components of client device 102, it is configured as wirelessly sending to data to MTN 104Request or by MTN 104 from data server 108 receive data.Therefore, client device 102 may include one orMore processors 202, the radio transceiver 204 for being wirelessly communicated with MTN 104 and storage device operating system(OS) 208 memory 206, be configured as through 104 requests of MTN/various software applications 210 of reception data, network interfaceModule 212 and client device node tracking file 112.
In various embodiments, the application 210 at client device 102 is stored in can include but is not limited to through NWeb browser applications 214, the video streaming of software application 220 apply 218 etc. using 216, game on line.In client deviceDuring being executed on 102, each can be configured as using 210 makes client device 102 be initiated by MTN 104 and data serviceThe data of device 108 communicate.
Client device 102 can be configured as passes through electricity using any public wireless and/or cable network access technologyCommunication network is communicated.In addition, client device 102 can be configured as any compatible equipment OS of operation, including but not limited toMicrosoft WindowsGoogleAppleLinuxAnd appointWhat his common mobile device OS.
Each in one or more processors 202 may include one or more central processing unit (CPU),It has the multiple arithmetic logic unit (ALU) for executing arithmetic sum logical operation, and from processor cache grade memoryExtraction instruction and storage content one or more control units (CU), then program execute during by call ALU comeIt executes instruction.In one implementation, one or more processors 202 can be configured as execution and be stored in memoryEach software application 210 in 206.In various embodiments, Network Interface Module 212 can be configured as detection for applicationOne of 210 action (for example, operation, order, user's input) and triggering generation data transfer request and transmission data passThe action of defeated request.
Memory 206 can be realized using the computer-readable medium of such as computer storage media etc.ComputerReadable medium includes at least two kinds of computer-readable medium, i.e. computer storage media and communication media.Computer is depositedStorage media includes such as information of computer-readable instruction, data structure, program module or other data etc for storageAny method or technique realize volatile and non-volatile, removable and nonremovable medium.Computer storage mediaIncluding but not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or itsHis optical storage, cassette, tape, disk storage or other magnetic storage apparatus or can be used for storing information so that computing device accessesAny other non-transmission medium.On the contrary, communication media can be presented as computer-readable instruction, data structure, program moduleOr other data in modulated data signal, such as carrier wave or other transmission mechanisms.
In various embodiments, memory 206 can store client device QoE modules 172, as shown in Figure 1 C.
In various embodiments, client device node tracking file 112 can correspond to the net with client device 102Each layer in multiple layers of 212 associated communication protocol stack 222 of network interface module.For example, communication protocol stack 222Multiple layers can correspond to characterize open system interconnection (OSI) mould with the function of Standardization Communication system in terms of level of abstractionType.Multiple layers are also can correspond to Internet protocol (IP) external member.For example, in various embodiments, client device 102 can be withRecord is used for physical layer, data link/radio layer, network layer/internet layer, transport layer, session layer, presentation layer and applicationThe single client device node of each in layer etc. tracks file 112, because packet is generated and configured between layersFor being communicated from client device 102 to data server 108 by MTN 104.
In addition, client device 102 can be with recording needle to the single client of specific one group of layer of communication protocol stack 212Device node tracks file 112.For example, client device 102 can be with recording needle to the first client of application/presentation/session layerEnd equipment node tracking file 112, for transmission/network layer the second client device node tracking file 112, be directed to dataThe third client device node tracking file 112 of link layer and the 4th client device node tracking text for physical layerPart 112.By recording tracking file at the level of client device 102, QoE optimization systems 110 can be in collecting layerThe basic reason of problem is determined after the tracking file (compared with node level) of grade with finer rank.This may be furtherHelp when to identify the remedial action for optimizing QoE.
Similar to multiple and different layers at client device 102, in MTN nodes 106 (1) ... 106 (N) each andEach in data server 108 can also record each layer different tracking file (for example, 114 (1) ... 114 (N) and116), or define 106/ data server 108 of MTN nodes communication protocol stack layer one or more combinations.Therefore, with finer grade at QoE optimization systems 110 can also be in MTN nodes 106 (1) ... 106 (N) and data server 108Not Shi Bie problem basic reason.
Fig. 3 A, which are shown, is configured as being recorded in client device node tracking file 112, MTN node trackings file 114(1) ... the sample data grouping 300 in one of 114 (N) or data server node tracking file 116.Packet 300 can be withWith it is one or more communicate or data exchange/formatting protocol (such as TCP, IP, HTTP or be directed toward is carried out by MTN 104Other agreements of communication or exchanging contents) associatedly configure.
In various embodiments, packet 300 may include header portion 302 and payload portions 304.Data pointGroup can also include the part of N number of field, and at least part is used to create tracking ID 306 for packet.In various implementationsExample in, for creates track ID 306 field can be header portion 302, payload portions 304 a part or its groupIt closes.
In various embodiments, one or more in N number of field can be with the road that is typically included in packetBy with addressing information be associated or field in one or more can be defined and be unique for specific protocol's.For example, field may include the address packet data protocol (PDP), source port number, destination port numbers, verification and number (be used forIPv4 or IPv6), sequence number, confirm number, the address Internet protocol (IP), source address, can in destination-address or packetTo help distinguish between any other field of a packet and another packet.In addition, field may also help in identificationRequest/response sequence or response pair or the ad-hoc communication session established so that even if tracking ID 306 may not be as a wholeAccurate matched, packet correctly can also be matched and/or be associated with.
Therefore, tracking ID 306 can be combined by the group of single field or two fields, three fields, four fields etc.At.Field for constituting tracking ID 306 is more, more can help to ensure that tracking ID 306 is unique for packetOr associated data packet is associated so that can by their communication path come tracking data be grouped.At least oneIn a embodiment, tracking ID 306 includes four fields：Pdp address, verification and number, source port number and destination port numbers.
Fig. 3 B depict example tracking file 308, can correspond to the client device section recorded at client devicePoint tracking file 112, the MTN node trackings file 114 (1) ... 114 (N) recorded at MTN nodes 106 (1) ... 106 (N) orThe data server node recorded at data server 108 tracks file 116.It may include QoE optimization systems to track file 308110 node identifiers 310 that can be used, so that it knows tracking file after QoE optimization systems 110 collect tracking fileIt is related to which node (for example, one of client device 102, MTN nodes 106 (1) ... 106 (N) or data server 108)Connection.Therefore, QoE optimization systems 110 will identify one or more nodes at the basic reason place of generation problem, soRemedial action is correspondingly realized afterwards.
In various embodiments, tracking file 308 is configured as record via node or node interface (for example, tracking arranges312) entry of the packet transmitted is (for example, the tracking ID 306 in tracking row 312 can correspond to carry out using the nodeMultiple and different client devices of communication).In addition, tracking file 308 is configured as connecing in the form of the timestamp of each entryReceive timing information 314, and by timestamp it is associated with entry/store, as shown in the figure.Therefore, tracking file 308 can sequenceGround records the list associated multiple the packet ID and timestamp such as when be received, send, routeing with packet.
At each node, by using time source (for example, local zone time source or remote time source) logging timestamp.In one embodiment, time source can be public for node or at least some nodes.Alternatively, for each node orAt least some nodes, time source can be different.Therefore, the timing information for merging and (coming from multiple tracking files)314 can be the timing information of approximate merging, because some nodes can use different time sources, these time sources may notIt is synchronous.
Fig. 4 shows the exemplary components of QoE optimization systems 110.In various embodiments, QoE optimization systems 110 can beService provider entity or telecommunications provider entity can be the parts of one of MTN nodes 106 (1) ... 106 (N), or106 via network connection and MTN nodes 106 (1) ..., (N) is communicated.In addition, in various embodiments, QoE optimization systems 110 canTo be the independent utility as a part for client device 102 or data server 108.
In various embodiments, QoE optimization systems 110 can be one or more servers or computing device, packetInclude the memory 404 of one or more processors 402 and storage device OS 406 and enable QoE optimization systems 110 withThe Network Interface Module 408 of track file reception module 410, tracking file is communicated and received from the node in Figure 1A, and will be withTrack file is stored in from the data retrieved in tracking file in tracking document data bank 412.
Each in one or more processors 402 of QoE optimization systems 110 may include having to execute arithmetic sumOne or more CPU of multiple ALU of logical operation, and instruction and content are extracted from processor cache memory,Then one or more CU executed instruction during program executes as desired by ALU is called.It is one or moreProcessor 402 can be additionally configured to execute the module being stored in memory 404.
Memory 404 can be realized using the computer-readable medium of such as computer storage media.It is computer-readableMedium includes at least two kinds of computer-readable medium, i.e. computer storage media and communication media.Computer storage is situated betweenMatter includes times of such as information of computer-readable instruction, data structure, program module or other data etc for storageThe volatile and non-volatile of what method or technique realization, removable and nonremovable medium.Computer storage media includesBut be not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or otherOptical storage, cassette, tape, disk storage or other magnetic storage apparatus, or can be used for storing information so that computing device accessesAny other non-transmission medium.On the contrary, communication media can include computer-readable instruction, data structure, program module orOther data in modulated data signal, such as carrier wave or other transmission mechanisms.
In various embodiments, memory 404 can also store tracking file association module 414, intersect file analysis mouldBlock 416, control module 418, key performance indicators (KPI) module 420, tracking sorting module 422, presentation and notification module424 and remedial-action module 426.
In various embodiments, memory 404 can further store network KPI modules 182, QoE polymerizers module 184With QoE trend modules 186, as shown in Figure 1 C.
The tracking file association module 414 described above for QoE analyzers 152 is configured as merging and/or with otherMode associated client device node tracking file 112, MTN node trackings file 114 (1) ... 114 (N) and/or data serviceDevice node tracking file 116.By merging and/or being associated with tracking file, tracking file association module 414, which matches, comes from different sectionsThe possibility tracking ID associated with identical data packet 306 of point.Correspondingly, when packet is passed from client device 102One or more data servers 108 are sent and/or are routed to (for example, via the lines/paths determined in MTN 104Uplink), or from one or more data servers 108 transmitted and/or be routed to client device 102 (for example,Via the downlink of the lines/paths determined in MTN 104) when, tracking ID 306 is kept constant.In at least some implementationsIn example, tracking file association module 414 can merge or otherwise be associated with the subset of the sum of collected tracking file.
In some embodiments, tracking file association module 414, which is additionally configured to matching, may not have identical tracking ID306 but can by reference to by response bag it is associated with request bag (for example, expression response bag " 2 " order indicator in response toRequest bag " 1 ") tracking ID 306 in one or more fields and respective request/response packet for matching.IntoIn the embodiment of one step, tracking file association module 414 can by reference to by packet it is associated with communication session withOne or more fields in track ID 306 match the one group of number communicated in the communication session (for example, video flowing) of foundationAccording to grouping.Tracking file association module 414 comes matching request packet and response bag using one or more fields, or matching is being builtThe packet transmitted in vertical communication session, may depend on used communication protocol type.
In various embodiments, once tracking file association module 414 merges or otherwise association tracks file simultaneouslyTracking of the matching for individual data grouping, request/response packet pair or the packet communicated in the communication session of foundationID 306, then intersect that file analyzing module 416 can execute network communication analysis using correlation and determination may lead to QoEThe basic reason of the problem of reduction.In various embodiments, intersect file analyzing module 416 to can be used for matched tracking ID306 timing information 314 is come the basic reason that executes network communication analysis and the problem of determination can be identified via timing problems.ShowExample network communication analysis can be related to：Packetization delay, delay mapping, switch rate, congestion window, packet loss, packet error probability, re-transmissionThe position of request and the quantity of retransmission request etc..In addition, the result from network communication analysis can be identified along communication pathOne or more nodes, these nodes are the basic reasons of problem, and why one or more nodes are to ask for identificationThe basic reason of topic.Therefore, QoE optimization systems 110 can be identified by eliminating problem or subproblem via remedial actionOptimize the chance of QoE.
In various embodiments, intersect file analyzing module 416 can according to the instruction received from control module 418 come acrossMultiple associated tracking files execute analysis.Control module 418 can receive to be executed by network administrator it is certain types ofAnalysis.For example, network administrator can input the order for identifying one or more KPI to be analyzed to control module 418, with trueService level or service goal defined in protecting are satisfied or are not satisfied.In various embodiments, KPI modules 420 are in visitorThe different application 210 executed in family end equipment 102 is as defined above listed different KPI.In addition, KPI modules 420 can also defineSuch as by service provider or network telecommunication provider (such as the net by serving as the agency of service provider or network telecommunication providerNetwork administrator) special services of KPI that define are horizontal or service goal (such as performance threshold or model 158).
In some embodiments, intersect file analyzing module 416 and can be performed automatically analysis.Therefore, network administrator canTo be configured to the tracking file reception module 410 of QoE optimization systems 110 to collect different tracking files so that they can be withIt is tracked file association module 414 to merge or be otherwise associated with, and intersecting file analyzing module 416 can be periodically squareFormula (per hour, daily, every two days etc.) executes the analysis of certain type.In various embodiments, this automatically analyze can be directed to it is eachThe specific combination of KPI or KPI is individually performed.It in other embodiments, can be to being configured to execute on client device 102The specific applications of various applications 210 execute automatic and periodicity analysis.
In various embodiments, intersect file analyzing module 416 can use tracking sorting module 422 to by collect withTrack Piece file mergence or otherwise associated tracking ID 306 is ranked up.This sequence or screening can contribute to by intersectingThe analysis that file analyzing module 416 executes.For example, tracking sorting module 422 can be sorted using one or more fieldsID is tracked, it is being sent from particular client device 102 (such as specific user or subscriber) to identification or be sent to particular customerThe packet of end equipment 102.Tracking sorting module 422 can with usage time stamp come to tracking ID 306 be ranked up, toIdentify the packet in specific timing window.Tracking sorting module 422 can using one or more fields with sort withTrack ID306, to identify the packet for coming from particular types of devices (for example, model from manufacturer).Tracking sequence mouldBlock 422 can be using one or more fields with the tracking ID 306 that sorts, to be identified as the data point of specific application transmissionGroup.Tracking sorting module 422 can be using one or more fields to be ranked up to tracking ID 306, to identify transmissionTo particular source/from particular source (for example, data server 108) transmit packet.
In various embodiments, after intersecting file analyzing module 416 and executing network performance analysis, QoE optimization systems110 format and present notice or alarm (for example, via graphic user interface) using presentation and notification module 424, such asAlarm 164.In one embodiment, notice can state that network communication is good and meet at present one or more KPI andService level.Therefore, QoE is currently without reduction.In alternative embodiments, alarm can report that network communication is causing QoE to dropIt is low, because one or more KPI and special services level are not satisfied at present.In this alternative embodiment, it presents and notifiesModule 424 can convey the position of the basic reason of problem and/or one or more reasons of problem (for example, one or moreMultiple nodes).
In some embodiments, it presents and notification module 424 can be additionally configured to generate graphical representation 160 or text tableShow 162, as described in more detail in this.In addition, presenting and notification module 424 can enable the users of QoE optimization systems 110It is enough to initiate to save from one of client device 102, MTN nodes 106 or data server 108 to client device 102, MTNPut the test communication of the packet of the other of 106 or data server 108.Then, associated with test communicationData will indicate in some or all trace files 112-116 and can be used for collecting and analyzing.
In various embodiments, remedial-action module 426 may include the instruction for repairing identified network communication problem.Therefore, remedial-action module can be accessed to determine the problem of being directed to notification module 424 by intersecting file analyzing module and/or presentingOne or more suggested solutions, and selected solution is then presented via graphic user interface, so as toTo realize them.In at least one embodiment, remedial-action module 426 be configured to respond to problem identification and automaticallyRealize solution.
Fig. 5 is shown in first node 502 (for example, client device 102 or UE) and fourth node 504 (for example, dataServer 108) between via the part that can be MTN 104 second node 506 (for example, RNC) and third node 508The example timing diagram 500 for the packet that (for example, core network node) exchanges.This example is provided to show QoE optimization systemsHow 110 can identify network communication problem using the timing information 314 in tracking file 308.Therefore, first node 502Record tracking entry, the note in MTN node trackings file 114 (1) of second node 506 in client node tracks file 112Record tracking entry, third node 508 record tracking entry and fourth node in MTN node trackings file 114 (2) are takingIt is engaged in recording tracking entry in device node tracking file 116.Although four nodes are depicted in Figure 5, in the upper of this documentHereinafter it is understood that the packet between client device 102 and data server 108 can be related in exchangingAdditional nodes in additional node, especially MTN 104.Exemplary timing diagram 500 in Fig. 5 is indicated through the multiple of networkThe horizontal relevance of the packet of node transmission.Horizontal relevance can be closed based on packet head information using horizontal unique tracking IDJoin the packet on multiple nodes.On the contrary, vertical association refer to when they multiple and different layers (for example, osi model layer orStorehouse) in packet when being transmitted at individual node, as further discussed about Fig. 6.Vertical association can useVertical unique tracking ID based on IP payload come when packet is transmitted by layer associated data be grouped.
Fig. 5 shows the primary data that fourth node 504 (for example, via uplink) is sent to from first node 502Grouping and the response packet that first node 502 (for example, via downlink) is sent to from fourth node 504.AccordinglyGround, Fig. 5 show the RTT 510 at first node 502, indicate the transmission being grouped in primary data and response packetTime between reception.
It generates as shown in figure 5, primary data is grouped at first node 502 and arrives second node 506 by sending 512.Therefore, first node 502 can record the entry of the packet with timestamp in client node tracks file 112(for example, being labeled as " 1 " in Figure 5).Second node 506 receives primary data grouping, can access, changes and/or add roadBy information, primary data grouping relaying 514 is then arrived into third node 508.Associated with the function, second node 506 can be withThe entry of packet of the record with timestamp (for example, be labeled as in Figure 5 in MTN node trackings file 114 (1)“2”).Similarly, third node 508 receives the packet of relaying, can access, changes and/or add routing iinformation, thenData packet relay 516 is arrived into fourth node 504.Here, third node 508 can be in MTN node trackings file 114 (2)Record the entry (for example, being labeled as " 3 " in Figure 5) of the packet with timestamp.
Then, fourth node 504 receives primary data and is grouped and generates and send 518 response bags, in server nodeThe entry of the packet that receives of the record with timestamp and/or the response packet of transmission in file 116 is tracked to ringThe entry (for example, being labeled as " 4 " in Figure 5) answered.Similar to uplink, third node 508 and second node 506 are 520With 522 at response bag routing and relaying returned into first node 502, and record the entry (example of the response bag with timestampSuch as, " 5 " and " 6 " are labeled as).Then first node 502 records the entry of the response bag with timestamp (for example, marking in Figure 5It is denoted as " 7 "), and RTT is completed.
When QoE optimization systems 110 collect tracking file associated with the example timing diagram in Fig. 5, QoE optimization systems110 can determine that RTT 510 is longer than normal value or than for desired by specific application currently in use at first node 502It is longer.After this determination, QoE optimization systems 110 can utilize the tracking file merged and separated timestamp (as closed aboveDiscussed in Fig. 4) come between calculate node each data packet communications delay (either uplink or downlink chainRoad), and identifying during uplink and/or downlink may be to being longer than maximum one or more of desired RTT contributionMultiple nodes (for example, in which node data packetization delay).
In various embodiments, the timing diagram 500 of Fig. 5 can indicate between client device 102 and data server 108TCP shake hands (handshake) (for example, synchronization request and confirm respond).In other embodiments, the timing diagram 500 of Fig. 5 canTo indicate the dns lookup between client device 102 and dns server.In a still further embodiment, the timing diagram of Fig. 5500 can indicate the HTTP request between client device 102 and data server 108 and packet response.
Fig. 6 shows the communication protocol stack (such as communication protocol stack 222) when packet at individual nodeThe example of the vertical association 600 of packet is indicated when generating and/or communicate therebetween at multiple and different layers (N for example, 1 ...).For example, different layers can be associated with osi model, and can be physical layer, data link layer, network layer, transport layer, meetingSession layer, presentation layer and application layer (and sublayer in layer).In addition, vertical association can be used based on the vertical of IP payloadUnique tracking ID come when packet is transmitted by layer associated data be grouped.It is described in further detail above by reference to Figure 1BThis vertical association.
Fig. 7 to Figure 11 presents illustrative process.Each process is illustrated as the set of box, generation in logical flow chartThe sequence of operations that table can be realized with hardware, software, or its combination.In the context of software, box indicates that computer can be heldRow instruction, when executed by one or more processors, executes the operation.In general, computer executable instructions can be withIncluding executing specific function or realizing routine, program, object, component, the data structure etc. of particular abstract data type.Description behaviourThe sequence of work, which is not intended to, to be interpreted to limit, and can in any order and/or be combined in parallel any amount of describedBox realizes the process.For discussion purposes, referring to Fig.1 the example context 100, the exemplary architecture of Figure 1B of A, Fig. 2 andThe exemplary components of Fig. 4, the sample data grouping of Fig. 3 A, the example tracking file of Fig. 3 B, the example timing diagram of Fig. 5 and/or Fig. 6Example is vertically associated with to describe the process in Fig. 7-Figure 11.
Fig. 7 shows the flow chart of the instantiation procedure 700 for recording the entry in tracking file.Instantiation procedure 700 canWith generation, transmission, reception, transmission, routing, relaying and/or store packet node (for example, client device 102,MTN nodes 106 (1) ... 106 (N), data server 108) at be performed.
At box 702, node monitoring generates via node, receives by node transmission, at node, sent out by nodeGive, by node-routing, relay and/or be stored in the packet of node by node.As discussed above, in various embodimentsIn, monitoring may be at node level (for example, single tracking file of node) or level (for example, multiple tracking text of nodePart).
At box 704, node creates in tracking file 306 and records the one or more of monitored packetEntry.As discussed above, each entry may include the tracking ID for indicating to distinguish packet and other packets306 one or more fields.In various embodiments, node can from the different layers of node it is associated it is different trackingThe independent entry of recorded data packets in file.Alternatively, node can be recorded in the single tracking file of node and different layersThe independent entry of associated packet.
At box 706, when recording entry in tracking file 306, node adds the time to each tracking ID 306Stamp.Therefore, node can be with access time source with the timing information of each entry of determination.
At frame 708, one or more tracking files are sent to QoE optimization systems 110 by node.In various embodimentsIn, node can will track text in response to the request (for example, periodic request or on-demand request) from QoE optimization systems 110Part is sent to QoE optimization systems 110.In alternative embodiments, node is known that or report time table, and when according to reportBetween table actively send tracking file to QoE optimization systems 110.
Fig. 8 is shown for collecting tracking file, merging tracking file and executing the instantiation procedure of network communication analysis800 flow chart.Instantiation procedure 800 can be executed by the component of the part as QoE optimization systems 110.
At box 802, tracking file reception module 410 can be from multiple nodes (for example, client device 102, MTNNode 106 (1) and data server 108) tracking file is collected automatically.In various embodiments, tracking file reception module 410Tracking file can be collected automatically according to periodic schedule.In various embodiments, tracking file reception module 410 can be fromAutomatically tracking file is collected in the Node subsets identified in MTN 104.
At box 804, tracking file association module 414 merges collected tracking file.In various embodiments, it closesAnd may include merging the tracking file for corresponding to the different layers (for example, level) at individual node, and merge from different sectionsThe tracking file that point (for example, node level) receives.
At box 806, intersect the tracking file of the analysis merging of file analyzing module 416 to determine the use of client deviceWhether the QoE at family has already decreased to predefined level.In various embodiments, intersect file analyzing module 416 and use tracking IDTimestamp execute analysis, the grouping of tracking ID matching individual datas, request/response packet to, as established communicationOne group of packet of a part for session.In addition, the part as analysis, intersecting file analyzing module 416 can identify(for example, via KPI modules 420 and/or control module 418) one or more KPI to be assessed and associated with KPISpecial services level or service goal.If special services level is not satisfied (for example, web page loading time is longer than two seconds, RTTMore than one second etc.), then it can be found that QoE is reduced to predefined level.As a part for analysis, intersect file analyzing module416 can be ranked up combined tracking ID using tracking sorting module 422, so as to execute analysis.
At box 808, intersect the basic original for the problem of identification of file analyzing module 416 may be the QoE for causing to reduceOne or more nodes in institute's recognition node of cause and/or one or more layers.
At box 810, presents and notification module 424 can format and generate report or alarm, to be transmitted via GUITo network administrator.Report or alarm can provide the result for intersecting tracking file analysis.
At box 812, remedial action may be implemented to solve the problems, such as the QoE for causing to reduce in remedial-action module 426.In various embodiments, remedial action can automatically be realized according to the predefined instruction in control module 418.In other embodimentIn, remedial action can be realized in response to being supplied to selection and the input of control module 418 by network administrator.
Fig. 9 is shown for collecting tracking file, merging tracking file and executing another example of network communication analysisThe flow chart of process 900.Instantiation procedure 900 can be executed by the component of the part as QoE optimization systems 110.
At box 902, control module 418 can be received from network administrator and be tracked for being collected from multiple and different nodesFile is to carry out the request for intersecting tracking file analysis.
At box 904, tracking file reception module 410 can be from multiple nodes (for example, client device 102, MTNNode 106 (1) and data server 108) collect tracking file.
At box 906, tracking file association module 414 merges collected tracking file.In various embodiments, it closesAnd may include merging the tracking file for corresponding to the different layers (for example, level) at individual node, and merge from different sectionsThe tracking file that point (for example, node level) receives.
At box 908, intersection file analyzing module 416 can be identified as the intersection asked tracking file analysis and carryFor one or more tracking ID on basis.
At box 910, intersecting file analyzing module 416 can be determined and requested friendship based on the tracking ID identifiedWhether the fork tracking associated KPI of file analysis meets defined level.
At box 912, presents and notification module 424 can format result and result is sent to the net of requirement analysisNetwork administrator.
At box 914, remedial action may be implemented to solve the problems, such as in remedial-action module 426.
Figure 10 shows the performance metric for receiving tracking file, determining the data that tracking file includes, and rawAt the flow chart of another instantiation procedure 1000 of the graphical representation or text representation of performance metric.Instantiation procedure 1000 can be by makingIt is executed for the component of a part for QoE optimization systems 110.
At box 1002, QoE optimization systems 110 can receive tracking file from the equipment for participating in wireless communication.TrackingFile can include at least data associated with the radio layer of the communication protocol stack of equipment.The equipment can be that user setsOne in standby, telecomm base station, wireless access point, radio network controller or core telecommunications network element.Tracking file canWith with for measuring radio-frequency performance data collection and idagnostic logout tool it is associated.In some embodiments, file is tracked alsoMay include data associated with the internet layer of the communication protocol stack of equipment, network layer or transport layer.Alternatively, QoE is excellentChange system 110 can receive another tracking file at 1002 from equipment, and another tracking file may include and equipmentInternet layer, network layer or the associated data of transport layer of communication protocol stack.
At 1004, QoE optimization systems 110 can be based at least partially on data associated with radio layer come to setStandby determination one or more performance metrics associated with the key performance indicators of radio layer.Radio layer it is keyEnergy indicator may include at least one of the following：Wireless spread-spectrum technology (RLC) re-transmission, packet loss, network signal, radio moneySource controls (RRC) state duration, radio state conversion time, the time spent in different radio electricity condition, wirelessThe quantity of electricity condition conversion reconfigures the response time.Equally at 1004, QoE optimization systems 110 can be at least partlyIt is determined and internet layer, network layer or transmission for equipment based on data associated with internet layer, network layer or transport layerThe associated one or more additional performance metrics of key performance indicators of layer.For internet layer, network layer or biographyThe key performance indicators of defeated layer may include domain name service (DNS) two-way time (RTT), transmission control protocol (TCP) RTT,In hypertext transfer protocol (HTTP) RTT, TCP re-transmissions, TCP duplicate acknowledgments, TCP resetting, TCP failures, delta frame or sequence numberIt is at least one.
At 1006, QoE optimization systems 110 can generate one or more figures of one or more performance metricsOr text representation.Figure or text representation include at least one of figure, chart or daily record expression (see, for example, Figure 12 and figure13).Moreover, at 1006, QoE optimization systems 110 can generate one of one or more extra performance indicators or moreMultiple additional graphics or text representation.
At 1008, QoE optimization systems 110 can be analyzed based on one or more in performance threshold or performance modelData.At 1010, based on analysis, QoE optimization systems 110 can determine that the QoE declined is presented in wireless communication.
Figure 11 shows the flow chart of another instantiation procedure 1100, and the instantiation procedure 1100 is one or more for receivingTracking file, make it is associated with the associated tracking file data of the different layers of equipment or distinct device, based on threshold value or modelAnalyzing and associating data, and determine that communication associated with associated data shows the QoE declined.Instantiation procedure 1100 can be byThe component of a part as QoE optimization systems 110 executes.
At box 1102, QoE optimization systems 110 can receive tracking from the equipment for participating in the communication based on packet radioFile.It tracks the first data of the first layer that file may include the communication protocol stack for equipment and is used for communication protocol heapSecond data of the second layer of stack.Communication based on packet radio may include from remote service or remote website in user equipmentLocate the packet received.
At 1104, QoE optimization systems 110 can be based on the effective of the packet indicated by the first data and the second dataLoad is associated with the second data by the first data.Association may include by the expression of the payload in the first data and theThe expression of payload in two data is associated.
At 1106, when the multiple equipment of the communication based on packet radio from participation or relaying receives multiple tracking filesWhen, QoE optimization systems 110 can be associated with those tracking files.
At 1108, QoE optimization systems 110 can based on one in communication performance threshold value or communication performance model or moreIt is multiple come analyzing and associating data.If multiple tracking files are associated, QoE optimization systems 110 can also analyzing and associating withTrack file.
At 1110, it is based on the analysis, QoE optimization systems 110 can determine that the communication based on packet radio is presented and declineQoE.
At 1112, QoE optimization systems 110 can generate the figure or text representation of associated data.Optionally or additionallyGround, at 1114, QoE optimization systems 110 can provide alarm when the QoE declined is presented in the communication based on packet radio.
Figure 18 depicts one or more client device Quality of experience (QoE) diagnosis according to an embodiment of the present disclosureThe example of file 176.In various embodiments, one or more QoE diagnostic files 176 can be set by the client in Fig. 1 CStandby QoE modules 172 generate.In some embodiments, one or more client device QoE diagnostic files 176 may includeWith the module of tracking equipment operation and the client device 102 of state, component and the related diagnostic file of operation.In some implementationsIn example, one or more QoE diagnostic files 176 may be embodied in generation on client device 102, aggregation and/or collectionInformation can determine client device KPI and/or QoE from the information.One or more client device QoE diagnostic files176 can with it is one or more communicate or data exchange/formatting protocol (such as, TCP, IP, HTTP or be directed toward pass through MTN104 carry out other agreements of communication or exchanging contents) it is configured in association.For example, one or more QoE diagnostic files176 can be configured with format (such as JSON (JavaScript object representation)) based on extensible markup language (XML).In some embodiments, other than one or more client devices track file 178 or instead of one or moreClient device tracks file 178, and client device 102 can also send one or more QoE diagnostic files 176, such as schemesShown in 1C.In various embodiments, one or more client device QoE diagnostic files 176 may include with audio call,Video call and/or the related information of data transmission including client device 102.In some embodiments, one or moreA client device QoE diagnostic files 176 may include the activity or operation for indicating client device 102 when making a callTime sequencing diagnostic file or daily record.
In various embodiments, one or more client device QoE diagnostic files 176 may include and call state1802, user interface (UI) state 1804, one or more IP multimedia subsystem (IMS) Session initiation Protocol (SIP) disappearBreath 1806, switching 1808, real-time transport protocol (RTP) statistics 1810, call setting 1812, signal data 1814, radio frequency lineBand data 1816,1822 relevant data of position 1818, timestamp 1820 and/or device data.
In various embodiments, 1802 data of call state can indicate when call try, when establish calling (exampleSuch as, when calling starts ring), when connect calling (for example, when voice or video data start), and when disconnect and exhalingIt cries.In various embodiments, call state 1802 is continually updated during the call.
In various embodiments, user interface (UI) state 1804 can indicate the user interface in client device 1804Locate the input received.For example, UI states 1804 can indicate to receive input to initiate or terminate calling, mute or holding is exhaledCry, input telephone number or equipment identities, change volume etc..UI states 1804 can be tracked to be received at client device 102Some or all inputs arrived, and can reflect that user's actually enters or input trial.In some embodiments, UI states1804 can be limited to the data for certain applications, such as be configured for answering on the client device of voice or video callWith.In some embodiments, UI states 1804 can indicate to come from touch screen, display, stylus or various button (such as soundsMeasure button or power knob) the input received.UI states 1804 can indicate the user received input be successfully orIt is unsuccessful.UI states 1804 can also track the data shown on the display of client device 1804, such as in callingBefore, during or after the screen that shows.
In various embodiments, one or more IP multimedia subsystem (IMS) Session initiation Protocol (SIP) message1806 may include by client device 102 carry out for the session information each communicated.One or more IMS SIP disappearBreath 1806 may include type of message (for example, text, data file, video, image, music, audio etc.), conversation descriptionAgreement (SDP) parameter and reason-code (for example, giving out information in response to the event during operation, state code and return code)Etc field.The example of reason-code may include the error message for the error event that instruction detects during operation, orPerson's instruction operates successful message during traffic operation.
In various embodiments, 1808 data of switching can record the handover operation and shape of the client device for communicationState.In some embodiments, switching 1808 data can record base station between, cutting between access point or between base station and access pointChange operation.For example, switching 1808 can indicate single wireless electricity voice call continuity (SRVCC), circuit switched fallback(CSFB), (inter-radio access technology (RAT)) mobility (for example, conversion between 2G/3G and LTE) and LTE between systemX2 switches.
In various embodiments, the various packet statistics of 1810 instruction of real-time transport protocol (RTP) statistics, are such as groupedLoss, packetization delay, delay jitter, the byte of transmission/reception, the grouping of transmission/reception, total bytes, total packet, grouping are lostMistake rate, discarded ratio of packet, loss burst rate and burst-length, gap Loss Rate and gap length, round-trip delay, one-way latency,Echo path delay, collision rate etc..
In various embodiments, call setting 1812 can indicate the setting of client device, such as operation mode or exhaleIt is preference.For example, call setting 1812 may indicate whether to activate or disable voice (VoLTE) on LTE, be preferred or fairPerhaps WiFi callings, time call registration, subscriber identity module (SIM) card supply etc..
In various embodiments, signal data 1814 may include the parameter of indication signal intensity and/or quality, such as connectReceive signal strength indicator (RSSI), Reference Signal Received Power (RSRP), Reference Signal Received Quality (RSRQ), signal interferencePlus noise (SINR) ratio, received signal code power (RSCP), Ec/Io (for example, the reception energy (code bit) of each chip with it is dryDisturb the ratio of horizontal (as unit of dB)), signal-to-noise ratio (SNR) etc..
In various embodiments, radio bands data 1816 can indicate that client device is to use special frequency band (exampleAs 2,4 or 12) or carrier wave polymerization (such as 2 and 4).In some embodiments, on radio bands data 1816 may includeUplink frequency, down-link frequencies, frequency bandwidth, Duplex Spacing and/or band gap.
In various embodiments, position 1818 can indicate any before, during or after communicating or communicating trialThe position of the client device at moment.It position 1818 can be by the combination of GPS location data, base station identity or position sources Lai reallyIt is fixed.In some embodiments, position 1818 may include the mobile network code, MNC (MNC) and mobile country code being applied in combination(MCC) to uniquely identify Mobile Network Operator network.In some embodiments, position 1818 may include base station or cellIdentity and/or latitude, longitude and altitude information.
In various embodiments, timestamp 1820 can uniquely identify one or more client device QoE diagnosisThe time for some or all of data points that file 176 includes.In some embodiments, timestamp 1820 can be by local zone timeSource or remote time source provide.For example, each operation log, report or intention (intent) can have associated timestamp1820。
In various embodiments, device data 1822 can indicate the equipment and/or system information of client device 102,Brand, model, operating system, operation version, hardware component, component software, chip manufacturer, upgrade history etc..EquipmentData 1822 also can indicate that installation or any application operated and/or software on client device 102, and for anyThe software version of related software.
Figure 19 to Figure 21 presents illustrative process.Each process is illustrated as the set of box in logical flow chart,Represent the sequence of operations that can be realized with hardware, software, or its combination.In the context of software, box indicates that computer canIt executes instruction, when executing the instruction by one or more processors, executes the operation.Refer in general, computer is executableOrder may include routine, program, object, component, the data structure etc. for executing specific function or realizing particular abstract data type.The sequence of description operation is not intended to and is interpreted to limit, and in any order and/or can be combined in parallel any amount of instituteBox is described to realize the process.
Figure 19 is according to an embodiment of the present disclosure for collecting diagnosis, filtering diagnosis and sending client device QoEThe flow chart of the instantiation procedure 1900 of diagnostic file.In some embodiments, client device QoE diagnostic files correspond to Fig. 1 CWith one or more client device QoE diagnostic files 176 in Figure 18.For example, instantiation procedure 1900 can be by clientEquipment 102 executes.
At 1902, diagnosis is collected.In some embodiments, diagnosis may include for being determined in further analysisEquipment report, operation log, intention or other data of client device KPI and/or QoE.Client device QoE modules 172Diagnosis can be collected in client device 102.In some embodiments, client device QoE modules 172 can be used as clientBackground process (for example, as process without a head or tracking collector without a head) in end equipment 102 is operated, and can be collectedDiagnosis, daily record, report or intention from the hardware and/or software run on client device 102 are (that is, client deviceThe message between application in 102, is typically used in further action).In some embodiments, it collects and examines at a predetermined intervalIt is disconnected, such as every five seconds for example, 5 minutes every, daily, weekly or any other predetermined space.In some embodiments, in response to coming from QoEThe request of optimization system 110 diagnoses (for example, periodically request or on-demand request) to collect.In alternative embodiments, clientEnd equipment 102 is known that report time table, and can be diagnosed according to report time table active collection.In some embodimentsIn, in response to such as initiating communication, end communicates, when detecting error event, or in response to by client device 102The application of operation or the diagnostic data of Software Create, daily record data are intended to collect diagnosis.In some embodiments, it waits collectingDiagnosis include diagnosis (or may include message) in conjunction with Figure 21 discussion in conjunction with Figure 18 discussion.In some embodiments,Diagnosis to be collected is generated as the debugging file for various applications, process or thread, rather than by client device QoEModule 172 generates.In some embodiments, file by being written the various applications of file, file or catalogue Lai passive by diagnosisGround is collected, and in other embodiments, various assemblies are by active poll and collect data.
At 1904, diagnosis is filtered.In some embodiments, filtering is executed in response to detecting error message, andIn some embodiments, filtering is executed based on call state, calling progress or unique call identity.In some embodiments,Filtering is executed to reduce the data volume to be transmitted in client device QoE diagnostic files.In some embodiments, in response to canDiagnosis filtering 1904 is executed with the priority of portfolio or the mistake detected on bandwidth, network.In some embodiments,Execute diagnosis filtering 1904 with include all operation logs associated with specific communications (for example, audio call), equipment report,Diagnostic file or intention, or include all data associated with communication position (for example, if diagnosis specific position it is basicReason).For example, it is relevant to filter and select and be monitored to determine the type of the KPI of equipment QoE to execute operation 1904Equipment report, daily record or intention.In a non-limiting example, client device can be directed to audio call and generate for 20 dayWill, and generate 10 daily records for data call (such as web page browsing).If these daily records are with order by merging in clientIt is reported in equipment, then can execute operation 1904 to identify daily record for audio call and by this 20 audio call daysWill is separated to be included in client side diagnostics QoE files.In some embodiments, diagnosis filtering is executed in response to user preference1904.In some embodiments, diagnosis filtering 1904 may include anonymous and encryption diagnosis.In some embodiments, it diagnosedFilter 1904 includes that data format is turned to standardized format.For example, diagnosis filtering 1904 may include that will be received in operation 1902Collection multiple intentions be stored as such as JSON (JavaScript object representation) etc based on extensible markup language (XML)Format.
At 1906, one or more client device QoE diagnostic files are sent.In some embodiments, oneOr more client device QoE diagnostic files equipment communication period or through equipment communication in sent in real time.One orMore client devices QoE diagnostic files can be sent to the QoE analyzers 180 of Fig. 1 C, for example, when network flow is low,In bottom line, or in off-peak period.For example, only can just be sent out when client device 102 is connected to WiFi networkOne or more client device QoE diagnostic files are sent, or can be sent at network flow low night one or moreA client device QoE diagnostic files.In some embodiments, in addition to one or more client devices track file 178Except or replace one or more client devices to track file 178, one or more client device QoE diagnosis textPart 176 can be sent to QoE analyzers 180.
Figure 20 is the flow according to an embodiment of the present disclosure for receiving with the instantiation procedure 2000 of analytical equipment diagnosisFigure.Instantiation procedure 2000 can be held by the component (such as by QoE analyzers 180) of the part as QoE optimization systems 110Row, and in some embodiments, the operation of some or all of process 2000 can be executed by client device.
At 2002, device diagnostic is requested.In some embodiments, QoE analyzers 180 can be from client device102 request diagnosis.In some embodiments, request 2002 may include that setting client device is set to the transmission of QoE analyzers 180The timetable of standby diagnosis, and in some embodiments, request may be on-demand request.In some embodiments, to device diagnosticQuantity, type, frequency, format and the specification that 2002 request can be diagnosed with designated equipment, and in some embodiments, request2002 may include the request to one or more client device QoE diagnostic files 176.In some embodiments, it asks2002 can be in response to the identification of network problem, and such as by the identification of QoE trend modules 186, there are network problems.In some implementationsIn example, request 2002 can decline or reduce in response to client or customer complaint or report QoE.
At 2004, device diagnostic is received.In some embodiments, device diagnostic is as one or more clientsEquipment QoE diagnostic files 176 are received.For example, device diagnostic can be as the JSON XML file quilts from client deviceIt receives, and may include equipment report, operation log, equipment intention, and/or communicate related information with equipment.At someIn embodiment, multiple equipment diagnosis is received from single client equipment, and in some embodiments, from multiple client equipmentReceive multiple equipment diagnosis.In some embodiments, the device diagnostic received is send one or more in operation 1906Multiple client equipment QoE diagnostic files.
At 2006, the device diagnostic that receives determines equipment KPI and/or QoE from operation 2004.In some realitiesIt applies in example, analytical equipment report, operation log, equipment are intended to and/or communicate relevant information with equipment to determine equipment KPI,It can therefrom determine equipment QoE.For example, if equipment KPI includes the instruction of " call set-up time ", analytical equipment diagnosis withDetermine call setup operation involved in equipment operation and timestamp with determination " call set-up time ".As another example,It can be based on real-time packet oriented protocol (RTP) data (such as RTP Loss Rates) and sip message tracking data (such as code/decode typeAnd sample rate) predict voice quality equipment KPI.It should be understood that it can be in operation 2006 such as in the context of the disclosureThe middle any amount of equipment KPI of determination.
At 2008, equipment KPI and/or QoE is polymerize.In some embodiments, equipment KPI and/or QoE is at one sectionIn polymerize for individual device, and in some embodiments, equipment KPI and/or QoE be directed to position, device characteristics or certainOther a polymerization measurements or parameter are directed to the multiple equipment at individual time point and are polymerize whithin a period of time.In some embodimentsIn, equipment KPI and/or QoE is polymerize and is indexed by one of device type, device location, QoE problems or access technology.ExampleSuch as, it is indexed for the equipment KPI and/or QoE of particular device to create specific to device type, hardware component type, softwareThe database of the KPI and/or QoE of component type etc..In another example, all devices KPI and/or the QoE quilt of specific positionPolymerization, and in another example, the equipment KPI (such as increased cutting off rate) for QoE problems can be polymerize.At someIn example, equipment KPI and/or QoE can be carried out according to the access technology of 2G/3G, LTE, VoLTE, Wi-Fi calling etc.Index.In some embodiments, device diagnostic file is polymerize before determining equipment KPI and/or QoE.
At 2010, network KPI is determined.In some embodiments, can based on by QoE analyzers 180 receive withTrack file 174 or 180 determines network KPI.In some embodiments, network KPI can refer to QoS data.In some embodimentsIn, network KPI can be similar to the client device KPI and/or QoE undergone at client device 102.
At 2012, compare the equipment KPI and/or QoE of the determination and network KPI determined at 2010 at 2006.In some embodiments, relatively operation 2012 is can perform to detect any decline or reduction QoE problems.For example, can be with baseCutting off rate is determined in the equipment KPI and/or QoE determined at 2006, and can also be based on the network KPI determined at 2010To determine cutting off rate.In some embodiments, equipment cutting off rate can be compared with Network Call-drop Rate.In one example,Less than the possibility that the Network Call-drop Rate of equipment cutting off rate can indicate QoE decline or reduction.
At 2014, compare equipment KPI and/or QoE and the equipment KPI and/or QoE of polymerization.In some embodiments,Equipment KPI and/or QoE for individual device is compared with the equipment KPI and/or QoE of the polymerization for being associated with individual device.In some embodiments, by the equipment KPI and/or QoE of individual device and the equipment polymerizeing for being associated with multiple client equipmentKPI and/or QoE are compared.
The example of process 2000 is as described below.For example, the first client device 102 can undergo at first positionWords (for example, the QoE for declining or reducing).First client device 102 can send instruction client device situation in call dropOne or more client device QoE diagnostic files 176 of (for example, operation log, equipment are intended to, equipment report).QoE pointsParser 180 can receive one or more client device QoE diagnostic files 176 (for example, operation 2004), can operateEquipment KPI and/or QoE are determined in 2006, and can be by identified client device KPI and/or QoE and QoE analyzersThe equipment KPI and/or QoE of 180 polymerizations for previously having received and having determined from multiple client equipment are compared (for example, operation2006 and 2008).In this illustration, the equipment KPI and/or QoE of polymerization can pass through device type, QoE problems and/or visitorFamily end equipment position indexes.Therefore, the first client of the call drop (for example, the QoE reduced) at instruction first position is setStandby KPI and/or QoE with and the equipment KPI and/or QoE of the relevant polymerization in first position be compared (for example, operating 2014).
At 2016, the basic reason of the QoE reduced is determined.In the above example, the first client device will be come fromEquipment KPI and/or QoE be compared with the equipment KPI and/or QoE of polymerization, to determine the basic original of call drop at first positionCause.In this illustration, the signal strength of the first client device at first position may be lower before call drop.It is logicalIt crosses and compares the signal strength undergone at the first client device and the equipment KPI and/or QoE that polymerize, it may be determined that is basic formerCause.For example, if the equipment KPI and/or QoE of the polymerization at first position also show low signal intensity, data may tableClear signal intensity is relatively low at first position, and receives possible needs and be upgraded (for example, by service provider).However, such asEquipment KPI and/or QoE the indication signal intensity of polymerization at fruit first position does not reduce or declines (for example, other equipment does not haveHave similar problems), then the basic reason that QoE is reduced may be the first client device.In some embodiments, if parameter is lowIn performance threshold or model, or less than the acceptable average value or intermediate value of the device diagnostic determination via polymerization, then parameter can quiltIt is considered " low ".
In another example, the equipment KPI and/or QoE (for example, polymerizeing in operation 2008) of polymerization can be indicatedThe QoE of reduction.In some embodiments, the equipment KPI and/or QoE of polymerization by device model or can pass through operating systemVersion indexes.In one example, it may be determined that the equipment with specific operation system version may be undergoing reductionQoE.In such a case, it is possible to determine that the basic reason of (for example, in operation 2016) QoE is specific operation system version.In another example, the QoE of reduction may be specific for device type.In this case, the QoE's of reduction is basicReason may be device type.
In further example, the equipment KPI and/or QoE of polymerization can pass through location index.If the data of polymerizationIn specific position (or in specific position and specific time) display problem trend, then can determine (for example, in operation 2016)The basic reason of QoE is conventional or temporary network problem.
In some embodiments, can be determined without reference to the equipment KPI and/or QoE of polymerization (for example,Operation 2016 in) reduce QoE basic reason.In one example, one or more client device QoE diagnostic files176 can indicate to have carried out call attempt (for example, call state=trial), be followed by " not supplying " error code (for example,Call setting=do not supply), followed by instruction that client device disconnects (for example, call state=disconnect).In such example, the basic reason of the QoE of reduction may be confirmed as the SIM card that do not supply at 2016.In addition, at someIn embodiment, QoE analyzers 180 can execute self-regeneration by sending software upgrading to client device, to supplySIM card, to correct mistake.
As another example, it can be determined by checking one or more client device QoE diagnostic files 176The basic reason for the QoE that (for example, in operation 2016) reduces.In one example, one or more client device QoEDiagnostic file 176 may include being reflected in operation log (or equipment report or meaning in client device communication using codecFigure).Client device QoE diagnostic files can indicate that codec handover operation has occurred before call failure.ThisIn the case of, codec conversion operation may be confirmed as the basic reason of the QoE reduced.In addition, in the context of the disclosureIn it is understood that network-based KPI may not determine the basic reason of the QoE of this reduction in this example,Because codec conversion may be opaque to network-based KPI.
Figure 21 is the stream according to an embodiment of the present disclosure for generating and/or sending the instantiation procedure 2100 of diagnostic messageCheng Tu.For example, instantiation procedure 2100 can be executed by client device 102.
Process 2100 may include some or all of generating and/or sending message 2102-2116.In some embodimentsIn, diagnostic message 2102-2106, which can not be, to be sequentially generated and/or sends, but single when detecting generation trigger eventIt solely generates and/or sends.In some embodiments, message 2102-2116 can correspond to one or more clients and setStandby QoE diagnostic files 176.In some embodiments, message 2102-2116 can be individually created and in single client equipmentIt is sent in QoE diagnostic files.The sequence of description operation/message is not intended to be interpreted to limit, and any amount of describedOperation can in any order and/or the parallel combined is to realize the process and/or send message described herein.
At 2102, call status message can be generated and/or sent.In various embodiments, when the shape of audio callWhen state changes, call status message can be generated and/or sent.The variation of call state may include the variation of following call stateOr the variation from following call state：Attempt, establish, connecting, disconnecting, keeping, terminating, incoming call, decrease, not weakening,CSFB starts, CSFB succeeds, CSFB fails, SRVCC starts, SRVCC succeeds, SRVCCC fails, ASRVCC starts, ASRVCC atWork(, ASRVCC failures, EPDG_HO starts, EPDG_HO succeeds and/or EPDG_HO failures.
At 2104, user interface (UI) status message is generated and/or sent.In various embodiments, as the UI of callingWhen state changes, UI status messages can be generated and/or sent.In some embodiments, only in the active voice call session phaseBetween generate and/or send UI status messages.The variation of UI states may include the variation of following UI states or come from following UI statesVariation：Calling presses, terminates to press, it is mute press, cancel it is mute press, keep pressing, not keeping pressing, calling connection,Calling disconnects, jingle bell and screen opening, screen are closed.
At 2106, switching state message can be generated and/or sent.In various embodiments, it is exhaled when ongoingWhen crying from a channel transfer for being connected to network or being switched to one other channel, it can generate and/or send switching state and disappearBreath.In some embodiments, switching state message is generated and/or sent only during movable voice call session.Switch shapeState message can be sent together with following one or more switching state information：INTER_HO starts, INTER_HO fails,INTER_HO successes, INTRA_HO starts, INTRA_HO fails, INTRA_HO succeeds and measurement report has delivered.
At 2108, signaling message is generated and/or sent.In various embodiments, signaling message can be indicated in activityIP multimedia subsystem (IMS) session setup when is delivered or sent during packet-switched voice call by client device 102Agreement (SIP) message.In some embodiments, signaling message may include the content of the IMS sip messages in signaling message.
At 2110, real-time transport protocol (RPT) downlink (DL) message is generated and/or sent.In some embodimentsIn, RPT DL message can be generated and/or be sent with regular schedule interval during call active.In some embodiments, RTPDL message may include RTP DL Loss Rates, RPT DL delay (for example, the end-to-end round trip between selected grouping in streamDelay), RTP DL shake being (for example, prolonging between being grouped caused by network congestion, incorrect queuing or configuration errorLate) and/or RTP DL measurement periods.
At 2112, RTP upload messages are generated and/or sent.In some embodiments, RTP upload messages may includeStatistics similar to RTP DL message but for uplink packet.
At 2114, generation and/or sending application message related to calls.In various embodiments, what indicates using message related to callsShi Faqi mobile originatings.In various embodiments, it can indicate to initiate to exhale on a client device using message related to callsThe specific application cried.
At 2116, encryption message is generated and/or sent.In various embodiments, encryption message indicates client deviceWhen negotiation encipherment scheme with network is completed.
The example of process 2100 is presented below.In order to initiate audio call at the first client device, user presses" transmission " button in the user interface of first client device.In such an example, message 2104 can be by the first clientEnd equipment generates (for example, instruction " calling is pressed ").Next, the first client device can be set in operation in the first clientAudio call is initiated in application in standby, and the message 2102 of instruction call state (such as " trial ") can be generated.In conjunction withAudio call is initiated, the first client device sends to network and asks, and network responds the first client device audio call and builtIt is vertical, and the first client device starts to export ring-back tone.Correspondingly, the first client device can generate 2102 (example of messageSuch as " having been established ").Second client device can reply the voice call request from the first client device, and correspondingGround, the first client device can generate the message 2102 for indicating newer call state (for example, " having connected ").When progress languageWhen sound calls, the first client device monitors uplink and/or downlink and generates the message of instruction connection status.ExampleSuch as, the first client device can receive 100% packets of voice sent from the second client device in special time period, andAnd the RTP DL message 2110 that zero percentage that can generate instruction grouping is lost.In the subsequent period, the first clientEquipment can receive 75% packets of voice sent from the second client device, and can generate what instruction 25% was lostRTP DL message 2110.Next, the first client device can initiate the switching of 3G network, and can generate instruction shouldThe switching state message 2106 (such as " INTER_HO starts ") of conversion.In this example, (and finger is generated in handover successShow the message 2106 of " INTER_HO successes ") after, calling can be dropped, and the first client device generates and indicates the shapeThe switching state message 2106 (for example, " having disconnected ") of state.As will be understood that in the context of the disclosure, these messageIt can be sent in real time, or single report can be combined into (for example, the client for being formatted as single JSON containers is setStandby diagnostic file), and network node (such as at night) can be sent to and analyzed, to determine the first client deviceKPI and/or QoE.As will be further understood that in the context of the disclosure, which is illustrative, and audio callMay include any amount of generation message.
As described above, Figure 22 to figure Figure 24 is the figure table of the equipment QoE metric of polymerization according to an embodiment of the present disclosureThe example shown.In some embodiments, graphical representation 2200,2300 and 2400 can be directed to individual customer by QoE analyzers 180End equipment 102 determines, or can be directed to by QoE analyzers 180 and/or QoE trend modules 186 and indicate more in a period of timeThe aggregated data of a equipment determines.In fig. 22, graphical representation 2200 is point to the equipment cutting off rate in each area or marketAnalysis.In fig 23, graphical representation 2300 is the chart in the source of the cutting off rate and call drop that are indexed according to device model.In Figure 24In, graphical representation 2400 is the chart of the cutting off rate indexed on period T1, T2, T3, T4 and T5 by access technology.It can alsoGenerate or alternatively generate any amount of other kinds of chart and figure of client device QoE.
Figure 25 depicts example context 2500 according to an embodiment of the present disclosure, can collect visitor from client device whereinFamily end equipment QoE diagnostic files, tracking file and equipment living document and executable QoE analyses.For example, in example contextIn 2500, client device 102 can be by one or more client device QoE diagnostic files 176, one or more visitorsFamily end equipment tracking file 178 and one or more client device living documents 2502 are sent to QoE analyzers 180, andAnd analysis can be executed by QoE analyzers 180.
Client device 102 can correspond to combine the client device 102 of each attached drawing description in the disclosure.OneIn a little embodiments, client device 102 may include client device Quality of experience (QoE) module 172, can monitor clientSome or all of end equipment operate and can generate or collect operation log corresponding with each operating or report, such as hereinIt is described.For example, in some embodiments of the present disclosure, net monitoring, is collected, assembles and/or generated to the record of QoE modules 172Network signal indicator is to determine the quality of call quality or network connection.
Client device 102 can also include one or more sensors, including accelerometer 2504, optical sensor2506, global positioning system (GPS) sensor 2508, Proximity Sensor 2510, temperature sensor 2512 and humidity sensor2514.For example, client device 102 can be monitored from the defeated of sensor 2504,2506,2508,2510,2512 and 2514Go out, to generate one or more equipment living documents 2502 of client device.The one or more of client device setStandby living document 2502 can with it is one or more communicate or data exchange/formatting protocol (such as TCP, IP, HTTP refer toTo other agreements for carrying out communication or exchanging contents by MTN 104) it is configured in association.For example, client deviceOne or more equipment living documents 2502 can be with such as JSON (JavaScript object representation) etc based on canThe format of extending mark language (XML) configures.File 2502 can by request periodically, continuously be generated and/orIt sends, and/or each communication (for example, audio call, data session etc.) associated with client device can be directed to and generatedFile 2502.In some embodiments, the equipment living document 2502 of client device can be with client device QoE diagnosis textsPart 176 for example, being used for transmission/reception client in signal file or in any combinations of file together by including (settingThe equipment dynamic of standby QoE diagnosis and client device).
In accordance with an embodiment of the present disclosure, accelerometer 2504 can monitor at one of such as space { X, Y, Z } etc orThe acceleration of the client device in more directions.In some embodiments, accelerometer 2504 may include gyroscope and/orGravity sensor, to provide additional resolution ratio in the movement for determining client device 2504.Optical sensor 2506 can superviseDepending on the ambient light in 102 local environment of client device, and partly can be used to adjust client device 102 screen it is brightDegree and/or the change location (for example, from indoor moving to outdoor, traveling etc. in tunnel) for determining client device.GPS is sensedDevice 2508 is determined for position, rate, speed, height, time of client device etc..Proximity Sensor 2510 can be withFor determining client device 102 when close to surface, such as when client device 102 is oriented in surface (such as desk)Upper display downwards (display-down) when, or as the user of 102 Proximity operation equipment of client device (such as when withWhen family is kept the device at during call on the ear of user).In some embodiments, Proximity Sensor 2510 can closeThe display for closing and opening client device 102, to reduce power consumption and/or prevent the operation temperature of equipment from increasing.Temperature passesSensor 2512 can determine the ambient air temperature for the environment that client device 102 is just operating wherein, and/or can determine visitorThe operation temperature of family end equipment 102.Humidity sensor 2512 can determine the environmental wet that client device 102 is just operating whereinDegree, and/or can determine the interior humidity of client device 102.Additional sensor may include heart rate sensor, fingerprint biographySensor, biometric sensor, magnetic field sensor, pressure sensor (such as barometer), camera, infrared sensor, condenser typeSensor etc..
QoE analyzers 180 may include QoE analyzer modules 2516, equipment dynamic module 2518, polymerizer module 2520With remedial-action module 2522.In addition, QoE analyzers 180 can include processor (such as one or more processors402), some or all modules 408- of memory (such as memory 404), equipment OS (such as equipment OS 406) and Fig. 4426 (as further discussed herein in regard to Fig. 4).
QoE analyzers 180 can receive one or more client device QoE diagnostic files 176 and one or moreA client device tracks file, and can analyze one or more files 176 and/or 178, can be used for really with determiningDetermine client device 102 to be undergoing decline or reduction QoE or can determine that client device 102 previously had been subjected toSuch as the KPI according to QoE decline described in the disclosure or reduction.In some embodiments, QoE analyzer modules 2516The QoE of client device 102 can be determined with Study document 176 and/or 178.
QoE analyzers 180 can further receive one or more equipment living documents 2502 of client device simultaneouslyAnd one or more files 2502 can be analyzed via equipment dynamic module 2518.For example, equipment dynamic module can assemble,It collects, formulation, filtering, divide, estimation, record, tracking or execute to the one of the client device received from client device 102Any pretreatment or post-processing of a or more equipment living document 2502.In some embodiments, equipment dynamic module2518 can with analytical equipment living document 2502 with determine the sensing data from client device 102 user behavior and/Or pattern or characteristic, it can indicate that user is unsatisfied with the QoE of client device.
Polymerizer module 2520 can polymerize the equipment living document of the client device received from multiple client equipment.In some embodiments, polymerizer module 2520 can be dynamic come polymerization unit by device type, device location, communication operation etc.State.In addition, polymerizer module 2520 can polymerize the equipment dynamic of client device and be associated with QoE and diagnose and/or set with specificThe associated tracking file of standby and/or communication session.In some embodiments, polymerizer module 2520 can polymerize and be discussed hereinVarious files, and with increased confidence level determine reduce QoE it is associated with client device.In some embodiments, gatherClutch module 2520 can update based on the equipment living document received from multiple client equipment and/or adjust instruction dropThe pattern of low QoE.
In various embodiments, remedial-action module 2522 may include the finger for repairing identified network communication problemIt enables.Remedial-action module 2522 can determine the solution of one or more suggestions for problem, then via figureThe solution of selection is presented to one of the following or more by user interface：Client associated with client device,Customer Service Department associated with service supplier and business associated with service provider or engineering department, so as toTo realize solution.In at least one embodiment, remedial-action module 2522 be configured to respond to problem identification andIt is automatic to realize solution.
Illustrative process is presented in Figure 26 to Figure 29.Each process is shown as the set of the box in logical flow chart,Represent the sequence of operations that can be realized with hardware, software, or its combination.In the context of software, box indicates that computer canIt executes instruction, when executing the instruction by one or more processors, executes the operation.Refer in general, computer is executableOrder may include routine, program, object, component, the data structure etc. for executing specific function or realizing particular abstract data type.The sequence of description operation is not intended to and is interpreted to limit, and in any order and/or can be combined in parallel any amount of instituteBox is described to realize the process.
Figure 26 is the instantiation procedure according to an embodiment of the present disclosure for being associated with QoE diagnostic files and equipment living document2600 flow chart.For example, instantiation procedure 2600 can be executed by QoE analyzers 180.
At 2602, which includes receiving one or more client device Quality of experience (QoE) diagnostic files.ExampleSuch as, operation 2602 may include receiving client device QoE diagnostic files 176, such as described in conjunction with Figure 18.This document 176May include such as call state, user interface state, IMS sip messages, switching, RTP statistics, call setting, signal data,The information of the client device of radio bands data, position, timestamp and/or device data etc.
At 2604, which includes receiving one or more client device equipment living documents.For example, operation2604 may include the equipment living document 2502 for receiving client device comprising description accelerometer 2504, optical sensor2506, one in GPS sensor 2508, Proximity Sensor 2510, temperature sensor 2512 and humidity sensor 2514Or more operation information.For example, operation 2604 may include periodically, continuously or in response to request (such as QoEThe request of analyzer 180) receive file 2502.For example, QoE analyzers 180 can determine QoE diagnostic files 176, instructionThere may be the QoE of reduction at client device 102.In some embodiments, in order to confirm the QoE states of reduction, QoE pointsParser 180 can ask equipment living document associated with the QoE states of reduction suspected 2502.In some embodiments,Client device 102 can be related to client device it is each communication after sending device living document 2502.
At 2606, the operation include will in operation 2602 one or more QoE diagnostic files that receive withOne or more equipment living documents received in operation 2604 are associated.For example, operation 2606 may include examining QoEDisconnected file is associated with the equipment dynamic (for example, from initiating to completing audio call) based on communication session.In some embodiments,Device diagnostic and/or QoE diagnosis across all data associated with particular client device, across multiple client equipment,Across special time period (for example, it is daily, weekly, per annual period etc.), striding equipment type, polymerize across customer type etc..
At 2608, operation includes determining that equipment communication shows the Quality of experience (QoE) of decline.For example, QoE analyzers180 can determine the QoE of instruction decline using the association between equipment QoE diagnostic files 176 and equipment living document 2502Client device user behavior or pattern.That is, the association in operation 2606 can increase and be by traffic classThe confidence threshold value of the decision of the QoE declined is presented, it is additional logical that this can allow service provider and/or network provider to excludeThe failure of letter is to improve performance (for example, to improve speech quality).In some embodiments, operation 2608 may include that will setStandby dynamic and instruction decline/database of the preassigned pattern of QoE that reduces is compared.In some embodiments, Ke YixiangClient device sends message, it is desirable that user confirms the QoE declined, thus increases the confidence level determined in operation 2608.
In some embodiments, when QoE diagnostic files 176 indicate that the QoE declined can be presented at client device 102When, it can be with inquiring client terminal equipment 102 to ask the confirmation to the QoE of decline.In some embodiments, client device 102The user at place can by response to message notifying (for example, " whether your call quality is satisfied with"), by selecting on the touchscreenResponse (for example, answer by showing "Yes" or "No") is selected or by being responded with voice command, to confirm declineQoE.In some embodiments, it if quality is " bad " from the perspective of user, can show on a client deviceShow message with the physically mobile device in AD HOC.In this way, the physical motion of client device can be advanceIt determines, with user experience indicated or bad.For example, user can first mode shake or mobile client device withIndicate good user experience, or can shake in a second mode or mobile client device with indicate difference user experience.ClassAs, any pattern associated with any sensor can be used for client device and service provide between transmission one orMore message (for example, display can be with cycle of modes).
Figure 27 is the flow according to an embodiment of the present disclosure for determining the instantiation procedure 2700 of the QoE based on contextFigure.Instantiation procedure 2700 can be additional to or be executed instead of the process 2600 of Figure 26.
At 2702, operation includes determination user interface state, such as to determine that the opening of the display of client device 102/Off status.For example, user interface state can be provided by the user interface state 1804 of client device QoE diagnostic files 176,And/or it can be provided by the equipment living document 2502 of client device.In some embodiments, operation 2702 may include trueDetermine the quantity for the time that display has been opened and/or has closed in the given time, and/or determines ON/OFF frequency or period.In some embodiments, operation 2702 can distinguish transformation of the display from "Off" to "ON" and from "ON" to "Off", and oneIn a little embodiments, it may not be necessary to distinguish.
At 2704, which can include determining that one or more call quality indicators, such as to determine that passing in real timeDefeated grouping (RTP) downlink discarding, the instruction of signal level and/or packet loss.In some embodiments, for example, oneOr more call quality indicator can be included in QoE diagnostic files 176.
At 2706, which includes determining the QoE based on context.For example, user circle determined in operation 2702Surface state can provide " prompt (hint) " or indicator about the QoE presented at client device 102.Operation 2706 canCall drop occurs within a predetermined period of time and can refer to the instruction and RTP downlinks that determine display cycle opening and closingShow user's rapidly mobile device just between their ear and their frontal face, is still connected with to find the callingIt visually indicates.In some embodiments, the speed and frequency that user interface state recycles can indicateThe QoE of existing poor voice quality and reduction.In some embodiments, process 2700 may include realizing remedial action to solveThe QoE of reduction is experienced, and disposes additional Internet resources, update software etc..
Figure 28 is another instantiation procedure 2800 according to an embodiment of the present disclosure for determining the QoE based on contextFlow chart.Instantiation procedure 2800 can be affixed to or process instead of being discussed herein executes.In some embodiments, it comes fromThe data of multiple sensors can be combined to provide the QoE based on context, including determine the QoE of indicating emergency situation.
At 2802, which includes determining optical sensor state.For example, operation 2802 can be from including and optical sensor2506 and/or 2510 associated information of Proximity Sensor equipment living document 2502 determine optical sensor state.For example,Operation 2802 can include determining that the ambient light for the environment that client device 102 is just operating wherein.It can determine from oneOr more additional sensors data to assist in environment that client device 102 is just operating wherein (that is, GPS is sensedThe instruction of the accuracy of device 2508, temperature sensor 2512, humidity sensor 2514 etc.).
At 2804, operation includes determining accelerometer state comprising determines quick deceleration.In some embodiments,Quick deceleration can be determined by the GPS data that is provided in equipment living document 2502 and/or accelerometer data.At someIn embodiment, it may be considered that about the quick deceleration to slow down present in car accident or beyond the emergency braking situation in vehicleAnd existing deceleration.
At 2806, operation includes determining speech quality indicator, such as to determine that received signal strength indicator symbol (RSSI).In some embodiments, signal strength and/or quality can be determined using other call qualities and/or signal quality characteristic.In some embodiments, for example, one or more call quality indicators can be included in QoE diagnostic files 176.
At 2808, which includes determining accident (incident) probability.In some embodiments, 2802 Hes are being operatedIn 2804 determine equipment dynamic bind in 2806 determine call quality indicator, and in associated base station or beeOne or more urgent calls received at nest tower are combined, and can indicate to drive into the feelings that the vehicle in tunnel has smashedCondition.The non-limiting example provides a kind of scene, wherein can be determined using equipment dynamic and client device QoE diagnosisThe QoE based on context of client device.In some embodiments, as described herein, device diagnostic and/or visitor can be usedFamily end equipment QoE diagnoses to determine emergency.In some embodiments, process 2800 can include determining that and/or receive volumeExternal information, GPS information, the information from navigation application, be placed in cell or in network additional urgent calling etc., withJust increase the confidence level of the accident of determination.
At 2810, which includes that the operation 2808 of accident occurs based on determination to distribute Internet resources for promptly ringingIt answers.In some embodiments, distribution Internet resources may include reserved for emergency responder it is one or more in communication bandA channel and/or time slot.In some embodiments, audio call associated with one or more emergency responders, groupingAnd/or communication, or information associated with reporting emergency accident (for example, people etc. of onlooker, participation accident) can be preferential,To reduce communication delay and/or ensure the high QoE and QoS at client device.
Figure 29 is another instantiation procedure 2900 according to an embodiment of the present disclosure for determining the QoE based on contextFlow chart.In some embodiments, it can determine that user is possible to make alarm, message, advertisement etc. based on the QoE of contextThe case where response, as described herein.For example, in some embodiments, process 2900 can be executed by client device 102.
At 2902, operation includes determining call quality indicator, such as to determine that received signal strength indicator symbol (RSSI).For example, the unexpected reduction of RSSI can be determined with time tracking RSSI, this can indicate that the QoE at client device dropsIt is low.In some embodiments, signal strength and/or matter can be determined using other call qualities and/or signal quality characteristicAmount.In some embodiments, for example, one or more call quality indicators can be included in QoE diagnostic files 176In.
At 2904, operation includes determining accelerometer state, such as to determine that gradually accelerating.In some embodiments, byStep accelerates to determine via the GPS data and/or accelerometer data that provide in equipment living document 2502.In some realitiesIt applies in example, gradually accelerates upward or downward to accelerate see, for example associated with elevator.
At 2906, operation includes determining the Quality of experience (QoE) based on context.For example, operation 2906 can useThe call quality indicator determined in operation 2902 and accelerometer state 2904 determines that client device 102 comes intoElevator, and user associated with client device can receive one or more message, alarm and/or advertisement.
For example, service provider may want to message being communicated to client device, such as special preferential treatment, alarm, billDeng.However, as in the context of the disclosure this it appears that, for example, when user is operating vehicle, alarm or disappearBreath may disperse the attention of the user of client device.By determining that the QoE based on context, process 2900 can determine userAlarm, message and/or advertisement can be received.In some instances, if client device consume it is more more than predetermined thresholdData, then user can increase amount of available data by checking advertisement.In some embodiments, process 2900 can such as portionDivide ground based on the variation for the accuracy for determining GPS signal to determine that client device is indoors or in outdoor, to determineWhen user can check message, alarm, special preferential treatment and advertisement.
At 2908, the advertisement of pre high speed buffer store can be presented in operation on client device 102.In some embodimentsIn, the advertisement of pre high speed buffer store can be presented, rather than transmit advertisement as a stream from network, the chance that advertisement is presented to user canIt cannot make a phone call to be happened at user or (when such as in elevator, or work as client device using the time of network connectionWhen the QoE reduced is presented).Therefore, when user cannot use network connection, the wide of pre high speed buffer store can be presented to userIt accuses.In this way, other than improving the function of network, service optimization is presented in the QoE based on context.
Conclusion
Although with the theme of the language description specific to structural features and or methods of action, but it is to be understood that instituteThe theme limited in attached claim is not necessarily limited to described specific features or action.But specific features and action quiltIt is disclosed as realizing the exemplary form of claim.