Invention content
In view of the deficiencies of the prior art, it the present invention provides a kind of cloud desktop picture update method and virtual machine, solvesImage update occupied bandwidth is big, plays the problem of interim card.
In order to achieve the above object, the present invention is achieved by the following technical programs：
A kind of cloud desktop picture update method, including：
Obtain changed region in the key frame that shows of cloud desktop, using the image information in the region of variation asFresh information, the fresh information carry undated parameter；
The fresh information is sent to client, the image shown for the client refreshes.
Into a step, changed region in the key frame for obtaining cloud desktop and showing, by the region of variationInterior image information carries undated parameter as fresh information, the fresh information, including:
The undated parameter in changed region in the key frame is obtained, according to the sequencing of acquisition will be multipleUndated parameter is added in update queue；
When the size for updating queue is more than predetermined threshold value, the undated parameter in the update queue is emptied, and obtainTake the key frame of cloud desktop；
Wherein, the undated parameter includes the origin coordinates of update area and regional extent parameter.
Into a step, it is described the fresh information is sent to client, including：
The fresh information is obtained according to the undated parameter, the fresh information is sent to client.
Into a step, the fresh information is sent to client, including：
The fresh information is sent to client by default compression quality.
Into a step, further include：The client receives the fresh information, and according to the undated parameter by described inImage information is performed to shield and be rendered.
The present invention also provides a kind of virtual machine, including：
Acquisition module, for obtaining changed region in the key frame that shows of cloud desktop according to parameter preset, by instituteThe image information in region of variation is stated as fresh information, the fresh information carries undated parameter；
Sending module, for the fresh information to be sent to client, the image that is shown for the client refreshes.
Further, the acquisition module includes：
Updating unit, for obtaining the undated parameter in changed region in the key frame, according to the priority of acquisitionSequence adds in multiple undated parameters in update queue；
Unit is emptied, it is described in the update queue for when the size for updating queue is more than predetermined threshold value, emptyingUndated parameter, and obtain the key frame of cloud desktop；
Wherein, the undated parameter includes the origin coordinates of update area and regional extent parameter.
Further, the sending module includes：
The fresh information for obtaining the fresh information according to the undated parameter, is sent to visitor by extraction unitFamily end.
Further, the sending module includes：
Compression unit, for the fresh information to be sent to client by default compression quality.
Further, the client receives the fresh information, and according to the undated parameter by described image informationShield in execution and render.
An embodiment of the present invention provides a kind of cloud desktop picture update method and virtual machines.Has following advantageous effect：
Fresh information is used as to client transmissions by the image information for capturing region of variation in key frame, due to transmissionFresh information is only the image of the subregion in key frame, and disappearing for network bandwidth is greatly reduced compared to full frame key frame is transmittedConsumption, solves the problems, such as client terminal playing interim card.
Specific embodiment
Purpose, technical scheme and advantage to make the embodiment of the present invention are clearer, below in conjunction with the embodiment of the present inventionIn attached drawing, the technical solution in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment isPart of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the artAll other embodiments obtained without creative efforts shall fall within the protection scope of the present invention.
Fig. 1 is the flow chart of cloud desktop picture update method shown in an embodiment in the present invention.As shown in Figure 1, thisInvention, which provides a kind of cloud desktop picture update method, can solve the problems, such as that bandwidth consumption is big in cloud desktop picture renewal process.The partyMethod can be applied in win10 operating systems in Spice QXL actuation techniques, naturally it is also possible to applied to other cloud desktop systemsIn, the present invention is without limitation.This method includes the following steps：
In a step 101：Changed region in the key frame that cloud desktop is shown is obtained, it will be in the region of variationImage information carries undated parameter as fresh information, the fresh information.
Key frame described in the step is the full screen pictures shown at virtual machine service end, and the acquisition of the key frame existsRemote interface one group of desktop sectional drawing of operation of Desktop Duplication API offers is provided in win10 operating systemsCooperation scheme is realized.In the present embodiment, the capture of screen can be carried out based on the interface of DXGI, is occurred so as to obtain in key frameThe region of variation, the region of variation, that is, update area, the image in the update area is as update main body.
For example, cloud desktop plays a video file, image is shown by frame sequence according to reproduction time in video file, andThe image of present frame and the image of former frame can have display variation in playing process, i.e., between two field pictures in same areaThe content of interior display is different, and when the content shown in other regions is identical, then it only needs to update the different content,All images need not be updated.Using region changed in the key frame as update area, by the image in the update areaInformation, for client display update, can substantially reduce the interior of more new content occupancy as the fresh information for being transferred to clientIt deposits, while less bandwidth is also occupied in transmission process.In addition, the interface based on DXGI carries out to realize acquisition during screen captureKey frame changes the coordinate parameters in region, and the coordinate parameters are as undated parameter；It can thus be obtained according to undated parameterThe image information in the region that changes in key frame, which is used as to update the data, is transferred to client.
In a step 102：The fresh information is sent to client, the image shown for the client refreshes.
In this step, the image information (such as image of jpeg format) that server-side in above-mentioned steps obtains is passed through into netNetwork is transferred to client, and client refreshes the image of its display according to the described image information received.Client is refreshing itThe image of display only refreshes the described image information that display receives on this image, therefore reduces figure of the client to receptionAs the processing pressure of information, partial interior resource can be discharged.
There is above-described embodiment it is found that the present invention is used as fresh information by capturing the image information of region of variation in key frameTo client transmissions, since the fresh information of transmission is only the image of the subregion in key frame, compared to the full frame main picture of transmissionFace greatly reduces the consumption of network bandwidth, solves the problems, such as client terminal playing interim card.
Based on above-described embodiment, cloud desktop picture update method provided by the invention further includes step 103.As shown in Fig. 2,In step 103：The client receives the fresh information, and is performed described image information according to the undated parameterScreen renders.
In this step, shown client first does the fresh information after the fresh information for receiving server-side transmissionThen pretreatment performs and shields rendering.For example, the fresh information of server-side transmission is compressed file, client is terminated to receiving thisIt is decompressed after compressed file, then the undated parameter in reading fresh information determines to be updated in the displayed imageRegion, the changed region which obtains with server-side on key frame is identical, and region to be updated is being determinedThe upper screen for performing image information in the fresh information of reception in the region to be updated afterwards renders.
By Fig. 1 and embodiment shown in Fig. 2 it is found that the data interaction in the present invention between server-side and client is：The image information in the region that changes in key frame is captured by server-side, wherein the region that changes is considered as update area, it is describedImage information be considered as image to be updated；And changed region is as more in the key frame that client is determined according to server-sideThen new region updates the image to be updated in the update area.Step performed by the two is similar to：Client is shownFirst image, latter image of the image that server-side is shown for the play sequence of described first image, the image is as the second figurePicture；Server-side takes off topography in the update area of the second image and is transferred to client, and client again takes off server-sideThe first image update for being shown in client of topography's update, make first image update into second image.
The present invention is further described below by a specific embodiment：
Fig. 3 is the flow chart of cloud desktop picture update method shown in another embodiment in the present invention.As shown in figure 3,The update method includes：
In step 301：Initialize memory, queue.
By taking SPICE (independent computation environment simple protocol) as an example, SPICE is a remote computer solution party to increase incomeCase provides client and accesses long-range display and equipment (for example, keyboard, mouse, audio), can greatly mitigate clientCPU and GPU task.In this step, one piece of memory (buffer) is initialized in SPICE server-sides, the memory is whole for storingThe key frame information of screen, and initialize the queue of the corresponding undated parameter of an each update area of storage..Wherein, it is described moreNew parameter includes the origin coordinates of update area and regional extent parameter；For example, the starting that undated parameter includes update area is satIt marks (x, y), the length and width (w, h) of the rectangle of update area.
In step 302：Record the initial information of key frame.
The key frame that server-side is shown can be obtained according to parameter preset when obtaining cloud desktop picture；Such as by broadcasting frame sequenceRow obtain the key frame that server-side is shown, can be shown in win10 operating systems based on DXGI interfaces capture server-side eachFrame image.Certainly, also can be with every two frame or other parameter capture images, it can be according to different demands and network bandwidth setting capture frequencyRate, and the higher user's operation experience of capture frequency is more smooth.If server-side is in playing video file, in this step, recordThe initial information of key frame includes the first frame image for the video file that record server-side is shown and the first frame image is shownUndated parameter (0,0, full frame wide h, it is full frame it is high w).
In step 303：Capture update area information.
In the step after the capture update area information first frame image of video file that i.e. capture server-side is shownEach frame image, and the differential position region between adjacent two field pictures and the differential position region are obtained on whole frame imagePosition coordinate parameters.Wherein position coordinate parameters, that is, above-mentioned undated parameter, including origin coordinates (x, y), the rectangle of update areaLength and width (w, h).Fig. 4 is the key frame obtained in medium cloud desktop picture update method of the present invention and the schematic diagram of update area.As shown in figure 4, region shown in phantom in figure, that is, above-mentioned differential position region namely update area.In this frame image, moreThe undated parameter of new region is (0,20,1376,816), and the region other than the update area is had shown that in client orPerson says existing image, without update.
In step 304：The rectangle parameter of update area is added in into update queue.
Above-mentioned undated parameter is that the rectangle parameter of image is shown based on DXGI interfaces capture server-side, which is addedEnter in the queue in step 301.Server-side can separately open a thread to read the rectangle parameter in the queue, then according to readingThe rectangle parameter acquiring update area taken.In the present embodiment, it obtains changed in the key frame that the server-side is shownThe image information in region is intercepted according to rectangle parameter (undated parameter) on the key frame, thus server-side obtains more new districtDomain only needs storage rectangle parameter, and the update of picture is then carried out according to the rectangle parameter.It, can basis in actual applicationThe sequencing of acquisition adds in multiple rectangle parameters (undated parameter) in update queue；For example, it is obtained according to frame sequenceThen the rectangle parameter of each frame image adds in the rectangle parameter in update queue, server-side is realized according to the update queueUpdate to client image.
In step 305：Judge queue whether more than 15 frames；If step 306 is performed more than 15 frames in queue, if in queueIt is less than 15 frames and performs step 307.
It is data cached in step is used to solve the problems, such as because of memory that client is caused to show picture delay too much.Wherein,Predetermined threshold value 15 is only an example value provided in this embodiment, naturally it is also possible to which, using other predetermined threshold values, the present invention is to thisIt is not limited.
Within step 306：Queue is emptied, obtains the image of whole screen.
When the size for updating queue is more than predetermined threshold value 15, the undated parameter in the update queue is emptied, andObtain the key frame of cloud desktop.In the key frame for obtaining cloud desktop, based on the key frame as initial information, then according to frameThe rectangle parameter of acquisition is added in update queue by the update area of each frame after the sequence capturing key frame.
In step 307：Obtain image information.
In this step, server-side is according to image information of the undated parameter acquisition as fresh information, by the imageInformation, which is used as to update the data, is sent to client.Storage has the key frame information for the whole screen for playing video in the memory of server-side(image in such as Fig. 4), the thread that server-side starts reads the rectangle parameter in update row, then according to right in the rectangle parameterAnswer the specific coordinate of key frame and the wide high image letter specified update area in the key frame, then obtain in the update areaBreath.
In step 308：Image information compression is sent to client.
In this step, the network transmission figure can be utilized to reduce by being further processed image information (fresh information)As the occupied bandwidth of information.In the present embodiment, described image is compressed by the way that the fresh information is pressed default compression qualityThen the compressed image information is sent to client by information again.For example, jpeg format image information can gotJPEG compression is carried out to the image information according to 75% compression quality afterwards；It is of course also possible to the compression according to other percentagesQuality compresses the image information, and the present invention is without limitation.
From the foregoing, it will be observed that the undated parameter of more new images that the present invention is got by DXGI interfaces, which is addedEnter to update queue, and the image information that (buffer) stores whole screen is updated according to undated parameter, further according to undated parameterSpecific coordinate and width be high, and memory copying changes the assigned picture region in buffer.By full frame picture in compared with the prior artFace is shown without compression transmission to Spice client display screens, can greatly reduce network bandwidth, is shown in spice clientsThe picture seen in display screen can be very smooth, and user experience is also improved.
The present invention also provides a kind of virtual machines of the above-mentioned cloud desktop picture update method of correspondence.Fig. 5 is a reality in the present inventionApply the module frame chart of the virtual machine shown in example.As shown in figure 5, the virtual machine includes：
Acquisition module 51, for obtaining changed region in the key frame that cloud desktop shows, by the region of variationInterior image information carries undated parameter as fresh information, the fresh information；
Sending module 52, for the fresh information to be sent to client, the image that is shown for the client refreshes.The client receives the fresh information, and performs to shield by described image information according to the undated parameter and render.
In another embodiment, which further includes client, and the client receives the fresh information, and according toDescribed image information is performed to shield and be rendered by the undated parameter.
As shown in fig. 6, the acquisition module 51 includes：
Updating unit 511, for obtaining the undated parameter in changed region in the key frame, according to the elder generation of acquisitionSequence adds in multiple undated parameters in update queue afterwards；
Unit 512 is emptied, for when the size for updating queue is more than predetermined threshold value, emptying the institute in the update queueUndated parameter is stated, and obtains the key frame of cloud desktop；
Wherein, the undated parameter includes the origin coordinates of update area and regional extent parameter.
As shown in fig. 7, the sending module 52 includes：
For obtaining the fresh information according to the undated parameter, the fresh information is sent to for extraction unit 521Client.
The sending module 52 further includes：
Compression unit 522, for the fresh information to be sent to client by default compression quality.
The realization process of modules, the function of unit and effect specifically refers to corresponding step in the above method in above deviceRapid realization process, details are not described herein.
It should be noted that herein, relational terms such as first and second and the like are used merely to a realityBody or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operationIn any this practical relationship or sequence.Moreover, term " comprising ", "comprising" or its any other variant are intended toNon-exclusive inclusion, so that process, method, article or equipment including a series of elements not only will including thoseElement, but also including other elements that are not explicitly listed or further include as this process, method, article or equipmentIntrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded thatAlso there are other identical elements in process, method, article or equipment including the element.
The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although with reference to the foregoing embodimentsThe present invention is described in detail, it will be understood by those of ordinary skill in the art that：It still can be to aforementioned each implementationTechnical solution recorded in example modifies or carries out equivalent replacement to which part technical characteristic；And these modification orIt replaces, the spirit and scope for various embodiments of the present invention technical solution that it does not separate the essence of the corresponding technical solution.