[go: up one dir, main page]

CN105227603A - virtual desktop image processing method, device, virtual desktop server and thin terminal - Google Patents

virtual desktop image processing method, device, virtual desktop server and thin terminal Download PDF

Info

Publication number
CN105227603A
CN105227603A CN201410283784.3A CN201410283784A CN105227603A CN 105227603 A CN105227603 A CN 105227603A CN 201410283784 A CN201410283784 A CN 201410283784A CN 105227603 A CN105227603 A CN 105227603A
Authority
CN
China
Prior art keywords
virtual desktop
image
position offset
change
scrolling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201410283784.3A
Other languages
Chinese (zh)
Inventor
胡泊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201410283784.3A priority Critical patent/CN105227603A/en
Priority to PCT/CN2015/071765 priority patent/WO2015196804A1/en
Publication of CN105227603A publication Critical patent/CN105227603A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/452Remote windowing, e.g. X-Window System, desktop virtualisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/08Protocols specially adapted for terminal emulation, e.g. Telnet

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Digital Computer Display Output (AREA)
  • Information Transfer Between Computers (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The invention provides a kind of virtual desktop image processing method, device, virtual desktop server and thin terminal, wherein, the method comprises: judge whether the image that virtual desktop current active window shows change of rolling occurs; When judged result is for being, the accumulative position offset of the accumulative generation of image within a predetermined period of time rolling change, and there is the accumulative difference part changed of rolling; Position offset will be added up, and accumulative difference part sends to for thin terminal corresponding to virtual desktop display, pass through the present invention, solve in correlation technique exist virtual desktop image procossing numerous and diverse, and the problem of the significant wastage network bandwidth, and then reach the process of simplification virtual desktop, effectively save the effect of the network bandwidth.

Description

虚拟桌面图像处理方法、装置、虚拟桌面服务器及瘦终端Virtual desktop image processing method, device, virtual desktop server and thin terminal

技术领域technical field

本发明涉及通信领域,具体而言,涉及一种虚拟桌面图像处理方法、装置、虚拟桌面服务器及瘦终端。The present invention relates to the communication field, in particular to a virtual desktop image processing method and device, a virtual desktop server and a thin terminal.

背景技术Background technique

虚拟桌面是云计算的一个重要应用,与传统的个人电脑(PersonalComputer,简称为PC)机和笔记本相比,本地桌面被运行在远程数据中心的虚拟桌面所代替。虚拟桌面中的内容以图像的方式回传到使用者的屏幕上。这样只要虚拟桌面上存在更改,就需要以图像的方式向使用者的本地传送,而在相关技术的很多虚拟桌面办公场景中,很多操作是使用者使用鼠标中键浏览文档。例如,大部分场合操作者滚动鼠标中键时,会连续发出多个鼠标中键的命令,每次鼠标中键的命令都对应一次界面的刷新。再例如,另外一个浏览文档的动作为按住鼠标左键拖动滚动条进行浏览,这样鼠标每托动一次就会产生相应的刷新。Virtual desktop is an important application of cloud computing. Compared with traditional personal computer (PC for short) machines and notebooks, local desktops are replaced by virtual desktops running in remote data centers. The content in the virtual desktop is returned to the user's screen in the form of images. In this way, as long as there is a change on the virtual desktop, it needs to be transmitted to the user's local in the form of an image, and in many virtual desktop office scenarios in the related art, many operations are for the user to use the middle mouse button to browse documents. For example, in most cases, when the operator scrolls the middle mouse button, multiple middle mouse button commands will be issued continuously, and each middle mouse button command corresponds to an interface refresh. For another example, another action to browse documents is to hold down the left mouse button and drag the scroll bar to browse, so that every time the mouse is dragged, a corresponding refresh will be generated.

然而,对于虚拟桌面的每一次操作,图像的变化都不是特别大,但是对于这样的变化虚拟桌面每次都需要对图像进行更新,并将新的图像发送给使用者本地,不仅存在处理繁杂的问题,而且对网络带宽也是极大的浪费。However, for each operation of the virtual desktop, the change of the image is not particularly large, but for such a change, the virtual desktop needs to update the image every time, and send the new image to the user's local, which not only has complicated processing problem, but also a great waste of network bandwidth.

因此,在相关技术中存在对虚拟桌面图像处理繁杂,以及极大浪费网络带宽的问题。Therefore, there are problems in the related art that the image processing of the virtual desktop is complicated and the network bandwidth is greatly wasted.

发明内容Contents of the invention

本发明提供了一种虚拟桌面图像处理方法、装置、虚拟桌面服务器及瘦终端,以至少解决相关技术中存在对虚拟桌面图像处理繁杂,以及极大浪费网络带宽的问题。The present invention provides a virtual desktop image processing method and device, a virtual desktop server and a thin terminal to at least solve the problems of complicated virtual desktop image processing and huge waste of network bandwidth in the related art.

根据本发明的一个方面,提供了一种虚拟桌面图像处理方法,包括:判断虚拟桌面当前活动窗口显示的图像是否发生滚动变化;在判断结果为是的情况下,累计在预定时间段内所述图像发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;将所述累计位置偏移量,以及所述累计区别部分发送给用于所述虚拟桌面显示对应的瘦终端。According to one aspect of the present invention, a virtual desktop image processing method is provided, including: judging whether the image displayed in the current active window of the virtual desktop has scrolled; The cumulative position offset of the image scrolling change, and the cumulative difference part of the scrolling change; sending the cumulative position offset and the cumulative difference part to the thin terminal corresponding to the virtual desktop display.

优选地,在累计在所述预定时间段内所述图像发生滚动变化的所述累计位置偏移量,以及发生滚动变化的所述累计区别部分之前,还包括:获取所述图像单次滚动变化对应的单次位置偏移量;将所述单次位置偏移量发送给所述瘦终端。Preferably, before accumulating the accumulative position offset of the scrolling change of the image within the predetermined period of time, and the accumulated difference part of the scrolling change, further comprising: acquiring a single scrolling change of the image A corresponding single position offset; sending the single position offset to the thin terminal.

优选地,在判断所述虚拟桌面当前活动窗口显示的所述图像是否发生滚动变化之前,还包括:判断所述虚拟桌面当前活动窗口显示的所述图像对应的应用是否为采用滚动条进行滚动操作的应用,在判断结果为是的情况下,判断所述虚拟桌面当前活动窗口显示的所述图像是否发生滚动变化。Preferably, before judging whether the image displayed in the current active window of the virtual desktop is scrolled, it also includes: judging whether the application corresponding to the image displayed in the current active window of the virtual desktop uses a scroll bar for scrolling If the result of the judgment is yes, it is judged whether the image displayed on the current active window of the virtual desktop is scrolled.

根据本发明的另一方面,提供了一种虚拟桌面图像处理方法,包括:显示虚拟桌面发送的当前活动窗口显示的图像;接收所述虚拟桌面对所述图像在预定时间段内发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;依据所述累计位置偏移量,以及所述累计区别部分对显示的所述图像进行更新显示。According to another aspect of the present invention, a virtual desktop image processing method is provided, including: displaying the image displayed by the current active window sent by the virtual desktop; The accumulated position offset, and the accumulated difference part where scrolling changes occur; the displayed image is updated and displayed according to the accumulated position offset and the accumulated difference part.

优选地,在接收所述虚拟桌面对所述图像在所述预定时间段内发生滚动变化的所述累计位置偏移量,以及发生滚动变化的所述累计区别部分之前,还包括:接收所述虚拟桌面发送的所述图像单次滚动变化对应的单次位置偏移量;采用空白渐变的方式更新显示所述单次位置偏移量对应的区别部分。Preferably, before receiving the accumulated position offset of the virtual desktop with respect to the scrolling change of the image within the predetermined time period, and the cumulative difference part of the scrolling change, the method further includes: receiving the The single position offset corresponding to the single scrolling change of the image sent by the virtual desktop; the difference part corresponding to the single position offset is updated and displayed in a blank gradient manner.

根据本发明的还一方面,提供了一种虚拟桌面图像处理装置,包括:第一判断模块,用于判断虚拟桌面当前活动窗口显示的图像是否发生滚动变化;累计模块,用于在判断结果为是的情况下,累计在预定时间段内所述图像发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;第一发送模块,用于将所述累计位置偏移量,以及所述累计区别部分发送给用于所述虚拟桌面显示对应的瘦终端。According to another aspect of the present invention, a virtual desktop image processing device is provided, including: a first judging module, used to judge whether the image displayed in the current active window of the virtual desktop is scrolled; In the case of yes, accumulating the cumulative position offset of the scrolling change of the image within a predetermined period of time, and the cumulative difference part of the scrolling change; the first sending module is used to transfer the cumulative position offset, and The accumulated difference part is sent to the corresponding thin terminal for displaying the virtual desktop.

优选地,该装置还包括:获取模块,用于获取所述图像单次滚动变化对应的单次位置偏移量;第二发送模块,用于将所述单次位置偏移量发送给所述瘦终端。Preferably, the device further includes: an acquisition module, configured to acquire a single position offset corresponding to a single scroll change of the image; a second sending module, configured to send the single position offset to the thin terminal.

优选地,该装置还包括:第二判断模块,用于判断所述虚拟桌面当前活动窗口显示的所述图像对应的应用是否为采用滚动条进行滚动操作的应用,在判断结果为是的情况下,判断所述虚拟桌面当前活动窗口显示的所述图像是否发生滚动变化。Preferably, the device further includes: a second judging module, configured to judge whether the application corresponding to the image displayed in the current active window of the virtual desktop is an application using scroll bars for scrolling operations, and if the judging result is yes , judging whether the image displayed in the current active window of the virtual desktop is scrolled or not.

根据本发明的再一方面,提供了一种虚拟桌面服务器,包括上述任一项所述的装置。According to yet another aspect of the present invention, a virtual desktop server is provided, including the device described in any one of the above.

根据本发明的又一方面,提供了一种虚拟桌面图像处理装置,包括:第一显示模块,用于显示虚拟桌面发送的当前活动窗口显示的图像;第一接收模块,用于接收所述虚拟桌面对所述图像在预定时间段内发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;更新模块,用于依据所述累计位置偏移量,以及所述累计区别部分对显示的所述图像进行更新显示。According to yet another aspect of the present invention, a virtual desktop image processing device is provided, including: a first display module, configured to display the image displayed by the current active window sent by the virtual desktop; a first receiving module, configured to receive the virtual desktop The cumulative position offset of the desktop with respect to the scrolling change of the image within a predetermined period of time, and the cumulative difference part where the scrolling change occurs; an update module, configured to use the cumulative position offset and the cumulative difference part to The displayed image is updated for display.

优选地,该装置还包括:第二接收模块,用于接收所述虚拟桌面发送的所述图像单次滚动变化对应的单次位置偏移量;第二显示模块,用于采用空白渐变的方式更新显示所述单次位置偏移量对应的区别部分。Preferably, the device further includes: a second receiving module, configured to receive a single position offset corresponding to a single scrolling change of the image sent by the virtual desktop; a second display module, configured to use a blank gradient The difference part corresponding to the single position offset is updated and displayed.

根据本发明的还一方面,提供了一种瘦终端,包括上述任一项所述的装置。According to still another aspect of the present invention, a thin terminal is provided, including the device described in any one of the foregoing.

通过本发明,采用判断虚拟桌面当前活动窗口显示的图像是否发生滚动变化;在判断结果为是的情况下,累计在预定时间段内所述图像发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;将所述累计位置偏移量,以及所述累计区别部分发送给用于所述虚拟桌面显示对应的瘦终端,解决了相关技术中存在对虚拟桌面图像处理繁杂,以及极大浪费网络带宽的问题,进而达到了简化虚拟桌面处理,有效节省网络带宽的效果。According to the present invention, it is used to judge whether the image displayed in the current active window of the virtual desktop is scrolled; if the judgment result is yes, the cumulative position offset of the image scrolled within a predetermined period of time is accumulated, and the scrolling occurs. The changed accumulative difference part; sending the accumulative position offset and the accumulative difference part to the thin terminal corresponding to the virtual desktop display solves the problem of complex virtual desktop image processing and extremely It solves the problem of wasting network bandwidth, and then achieves the effect of simplifying virtual desktop processing and effectively saving network bandwidth.

附图说明Description of drawings

此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The accompanying drawings described here are used to provide a further understanding of the present invention and constitute a part of the application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention. In the attached picture:

图1是根据本发明实施例的虚拟桌面图像处理方法一的流程图;Fig. 1 is a flowchart of a virtual desktop image processing method 1 according to an embodiment of the present invention;

图2是根据本发明实施例的虚拟桌面图像处理方法二的流程图;2 is a flowchart of a second method for processing virtual desktop images according to an embodiment of the present invention;

图3是根据本发明实施例的虚拟桌面图像处理装置一的结构框图;3 is a structural block diagram of a virtual desktop image processing device 1 according to an embodiment of the present invention;

图4是根据本发明实施例的虚拟桌面图像处理装置一的优选结构框图一;4 is a preferred structural block diagram 1 of a virtual desktop image processing device 1 according to an embodiment of the present invention;

图5是根据本发明实施例的虚拟桌面图像处理装置一的优选结构框图二;Fig. 5 is a preferred structural block diagram 2 of a virtual desktop image processing device 1 according to an embodiment of the present invention;

图6是根据本发明实施例的虚拟桌面服务器的结构框图;6 is a structural block diagram of a virtual desktop server according to an embodiment of the present invention;

图7是根据本发明实施例的虚拟桌面图像处理装置二的结构框图;7 is a structural block diagram of a second virtual desktop image processing device according to an embodiment of the present invention;

图8是根据本发明实施例的虚拟桌面图像处理装置二的优选结构框图;Fig. 8 is a preferred structural block diagram of a second virtual desktop image processing device according to an embodiment of the present invention;

图9是根据本发明实施例的瘦终端的结构框图;FIG. 9 is a structural block diagram of a thin terminal according to an embodiment of the present invention;

图10是根据本发明优选实施方式的虚拟桌面图像处理方法中首个活动窗口示意图;10 is a schematic diagram of the first active window in the virtual desktop image processing method according to the preferred embodiment of the present invention;

图11是根据本发明优选实施方式的虚拟桌面图像处理方法中窗口图像滚动偏移量计算示意图;Fig. 11 is a schematic diagram of calculation of window image scrolling offset in a virtual desktop image processing method according to a preferred embodiment of the present invention;

图12是根据本发明优选实施方式的虚拟桌面图像处理方法中瘦终端根据偏移量绘制显示区示意图;12 is a schematic diagram of the thin terminal drawing the display area according to the offset in the virtual desktop image processing method according to the preferred embodiment of the present invention;

图13是根据本发明优选实施方式的虚拟桌面图像处理方法中瘦终端根据偏移量+变化区间绘制显示区示意图。Fig. 13 is a schematic diagram of the thin terminal drawing the display area according to the offset + change interval in the virtual desktop image processing method according to the preferred embodiment of the present invention.

具体实施方式detailed description

下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

在本实施例中提供了一种虚拟桌面图像处理方法,图1是根据本发明实施例的虚拟桌面图像处理方法一的流程图,如图1所示,该流程包括如下步骤:In this embodiment, a virtual desktop image processing method is provided. FIG. 1 is a flowchart of a virtual desktop image processing method 1 according to an embodiment of the present invention. As shown in FIG. 1 , the process includes the following steps:

步骤S102,判断虚拟桌面当前活动窗口显示的图像是否发生滚动变化;Step S102, judging whether the image displayed in the current active window of the virtual desktop has scrolled;

步骤S104,在判断结果为是的情况下,累计在预定时间段内图像发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;Step S104, if the result of the judgment is yes, accumulating the accumulated position offset of the scrolling change of the image within a predetermined time period, and the cumulative difference part of the scrolling change;

步骤S106,将累计位置偏移量,以及累计区别部分发送给用于虚拟桌面显示对应的瘦终端。Step S106, sending the accumulated position offset and the accumulated difference to the corresponding thin terminal for displaying the virtual desktop.

通过上述步骤,对于虚拟桌面一方而言,累计在预定时间段内虚拟桌面图像发生滚动变化的累计位置偏移值,以及累计区别部分,并仅将累计位置偏移值以及累计区别部分发送给瘦终端,相对于相关技术中只要图像发生的变化及将变化部分的图像发送给瘦终端,采用上述方法,不仅能够有效地减少对虚拟桌面图像处理的繁杂度,而且不必每次均向瘦终端发送图像,不仅简化了虚拟桌面的图像处理,而且大大地节省了网络带宽。Through the above steps, for the virtual desktop side, the accumulated position offset value and the accumulated difference part of the scrolling change of the virtual desktop image within a predetermined period of time are accumulated, and only the accumulated position offset value and the accumulated difference part are sent to the thin For the terminal, compared with the related art, as long as the image changes and the image of the changed part is sent to the thin terminal, the above method can not only effectively reduce the complexity of processing the virtual desktop image, but also does not need to send the image to the thin terminal every time. Image not only simplifies the image processing of the virtual desktop, but also greatly saves network bandwidth.

优选地,在累计在预定时间段内图像发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分之前,还包括:获取图像单次滚动变化对应的单次位置偏移量;将单次位置偏移量发送给瘦终端。这样瘦终端就可以依据每次发生的位置偏移量,在本地的桌面窗口上对显示的内容进行预加载,即让用户感知到远程终端正在对发生滚动操作的图像进行处理。仅将单次位置偏移量发送给瘦终端,所花费的带宽并不多,而且能够有效提高使用者的阅读适应感。Preferably, before accumulating the cumulative position offset of the scrolling change of the image within a predetermined period of time, and the cumulative difference part of the scrolling change, it also includes: acquiring a single position offset corresponding to a single scrolling change of the image; A single position offset is sent to the thin terminal. In this way, the thin terminal can preload the displayed content on the local desktop window according to the position offset each time, that is, to make the user perceive that the remote terminal is processing the scrolling image. Only sending a single position offset to the thin terminal does not consume much bandwidth, and can effectively improve the user's reading adaptability.

为了有效排除误判的可能性,在判断虚拟桌面当前活动窗口显示的图像是否发生滚动变化之前,还可以先判断虚拟桌面当前活动窗口显示的图像对应的应用是否为采用滚动条进行滚动操作的应用,在判断结果为是的情况下,判断虚拟桌面当前活动窗口显示的图像是否发生滚动变化。即在确定是对滚动浏览操作的窗口适用。In order to effectively eliminate the possibility of misjudgment, before judging whether the image displayed in the current active window of the virtual desktop is scrolled, it is also possible to first judge whether the application corresponding to the image displayed in the current active window of the virtual desktop is an application that uses scroll bars for scrolling operations , if the judgment result is yes, it is judged whether the image displayed in the current active window of the virtual desktop is scrolled. That is, it is determined to be applicable to the window of the scrolling operation.

图2是根据本发明实施例的虚拟桌面图像处理方法二的流程图,如图2所示,该流程包括如下步骤:Fig. 2 is a flow chart of a second virtual desktop image processing method according to an embodiment of the present invention. As shown in Fig. 2, the process includes the following steps:

步骤S202,显示虚拟桌面发送的当前活动窗口显示的图像;Step S202, displaying the image displayed on the current active window sent by the virtual desktop;

步骤S204,接收虚拟桌面对图像在预定时间段内发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;Step S204, receiving the cumulative position offset of the virtual desktop image scrolling within a predetermined period of time, and the cumulative difference of the scrolling change;

步骤S206,依据累计位置偏移量,以及累计区别部分对显示的图像进行更新显示。Step S206, updating and displaying the displayed image according to the accumulated position offset and the accumulated difference.

通过上述步骤,对于瘦终端一方而言,依据虚拟桌面图像在预定时间段内的累计位置偏移量,以及累计区别部分对显示的图像进行更新显示,相对于相关技术中只要图像发生的变化及接收虚拟桌面一侧发送的变化部分的图像,采用上述方法,不仅能够有效地减少对虚拟桌面图像处理的繁杂度,而且不必每次均向瘦终端发送图像,不仅简化了虚拟桌面以及瘦终端对图像的处理,而且大大地节省了网络带宽。Through the above steps, for the thin terminal side, the displayed image is updated and displayed according to the accumulated position offset of the virtual desktop image within a predetermined period of time and the accumulated difference. Compared with the related art, as long as the image changes and Receiving the image of the changed part sent by the side of the virtual desktop, using the above method, not only can effectively reduce the complexity of the virtual desktop image processing, but also does not need to send the image to the thin terminal every time, which not only simplifies the virtual desktop and the thin terminal. Image processing, and greatly save network bandwidth.

对应地,在接收虚拟桌面对图像在预定时间段内发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分之前,考虑瘦终端在该预定时间段内的等待,可以先接收虚拟桌面发送的图像单次滚动变化对应的单次位置偏移量;采用空白渐变的方式更新显示单次位置偏移量对应的区别部分。通过这样的处理,不仅不会浪费太多的网络带宽,而且有效地提高了瘦终端一侧使用者的浏览舒适感。Correspondingly, before receiving the cumulative position offset of the virtual desktop image scrolling change within a predetermined time period, and the cumulative difference part of the scrolling change, considering the waiting of the thin terminal within the predetermined time period, the virtual desktop can be received first. The single position offset corresponding to the single scrolling change of the image sent by the desktop; the difference part corresponding to the single position offset is updated and displayed in the way of blank gradient. Through such processing, not only will not too much network bandwidth be wasted, but also the browsing comfort of the user on the side of the thin terminal is effectively improved.

在本实施例中还提供了一种虚拟桌面图像处理装置,该装置用于实现上述实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。In this embodiment, a virtual desktop image processing device is also provided, and the device is used to implement the above embodiments and preferred implementation modes, and what has been described will not be repeated. As used below, the term "module" may be a combination of software and/or hardware that realizes a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.

图3是根据本发明实施例的虚拟桌面图像处理装置一的结构框图,如图3所示,该装置包括第一判断模块32、累计模块34和第一发送模块36,下面对该装置进行说明。Fig. 3 is a structural block diagram of a virtual desktop image processing device 1 according to an embodiment of the present invention. As shown in Fig. 3 , the device includes a first judging module 32, an accumulating module 34 and a first sending module 36, and the device will be described below illustrate.

第一判断模块32,用于判断虚拟桌面当前活动窗口显示的图像是否发生滚动变化;累计模块34,连接至上述第一判断模块32,用于在判断结果为是的情况下,累计在预定时间段内图像发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;第一发送模块36,连接至上述累计模块34,用于将累计位置偏移量,以及累计区别部分发送给用于虚拟桌面显示对应的瘦终端。The first judging module 32 is used to judge whether the image displayed in the current active window of the virtual desktop is scrolled; the accumulation module 34 is connected to the above-mentioned first judging module 32, and is used to accumulate in the predetermined time when the judging result is yes The accumulative position offset of the scrolling change of the image in the segment, and the accumulative difference part of the scrolling change; the first sending module 36 is connected to the above-mentioned accumulative module 34, and is used to send the accumulative position offset and the accumulative difference part to It is used to display the corresponding thin terminal on the virtual desktop.

图4是根据本发明实施例的虚拟桌面图像处理装置一的优选结构框图一,如图4所示,该装置除包括图3所示的所有模块外,还包括获取模块42和第二发送模块44,下面对该装置进行说明。Fig. 4 is a preferred structural block diagram 1 of a virtual desktop image processing device 1 according to an embodiment of the present invention. As shown in Fig. 4, in addition to all the modules shown in Fig. 3, the device also includes an acquisition module 42 and a second sending module 44, the device will be described below.

获取模块42,连接至上述第一判断模块32,用于获取图像单次滚动变化对应的单次位置偏移量;第二发送模块44,连接至上述获取模块42和累计模块34,用于将单次位置偏移量发送给瘦终端。The acquiring module 42 is connected to the above-mentioned first judging module 32, and is used to acquire a single position offset corresponding to a single scrolling change of the image; the second sending module 44 is connected to the above-mentioned acquiring module 42 and the accumulation module 34, and is used to A single position offset is sent to the thin terminal.

图5是根据本发明实施例的虚拟桌面图像处理装置一的优选结构框图二,如图5所示,该装置除包括图3所示的所有模块外,该装置还包括:第二判断模块52,下面对该第二判断模块52进行说明。Fig. 5 is a preferred structural block diagram 2 of a virtual desktop image processing device 1 according to an embodiment of the present invention. As shown in Fig. 5 , in addition to all the modules shown in Fig. 3 , the device also includes: a second judging module 52 , the second judging module 52 will be described below.

第二判断模块52,连接至上述第一判断模块32,用于判断虚拟桌面当前活动窗口显示的图像对应的应用是否为采用滚动条进行滚动操作的应用,在判断结果为是的情况下,判断虚拟桌面当前活动窗口显示的图像是否发生滚动变化。The second judging module 52 is connected to the above-mentioned first judging module 32, and is used to judge whether the application corresponding to the image displayed in the current active window of the virtual desktop is an application that uses a scroll bar to perform a scrolling operation. If the judging result is yes, judging Whether the image displayed in the current active window of the virtual desktop is scrolled.

图6是根据本发明实施例的虚拟桌面服务器的结构框图,如图6所示,该虚拟桌面服务器60包括上述任一项的虚拟桌面图像处理装置一62。FIG. 6 is a structural block diagram of a virtual desktop server according to an embodiment of the present invention. As shown in FIG. 6 , the virtual desktop server 60 includes any one of the virtual desktop image processing apparatuses 1 62 described above.

图7是根据本发明实施例的虚拟桌面图像处理装置二的结构框图,如图7所示,该装置包括第一显示模块72、第一接收模块74和更新模块76,下面对该装置进行说明。Fig. 7 is a structural block diagram of a virtual desktop image processing device 2 according to an embodiment of the present invention. As shown in Fig. 7, the device includes a first display module 72, a first receiving module 74 and an update module 76, and the device will be described below illustrate.

第一显示模块72,用于显示虚拟桌面发送的当前活动窗口显示的图像;第一接收模块74,连接至上述第一显示模块72,用于接收虚拟桌面对图像在预定时间段内发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;更新模块76,连接至上述第一接收模块74,用于依据累计位置偏移量,以及累计区别部分对显示的图像进行更新显示。The first display module 72 is used to display the image displayed on the current active window sent by the virtual desktop; the first receiving module 74 is connected to the first display module 72 and is used to receive the scrolling change of the virtual desktop image within a predetermined period of time The cumulative position offset, and the cumulative difference part that scrolls; the update module 76 is connected to the first receiving module 74, and is used to update and display the displayed image according to the cumulative position shift and the cumulative difference part.

图8是根据本发明实施例的虚拟桌面图像处理装置二的优选结构框图,如图8所示,该装置除包括图7所示的所有模块外,该装置还包括:第二接收模块82和第二显示模块84,下面对该装置进行说明。Fig. 8 is a preferred structural block diagram of a virtual desktop image processing device 2 according to an embodiment of the present invention. As shown in Fig. 8, in addition to all the modules shown in Fig. 7, the device also includes: a second receiving module 82 and The second display module 84, the device will be described below.

第二接收模块82,连接至上述第一显示模块72,用于接收虚拟桌面发送的图像单次滚动变化对应的单次位置偏移量;第二显示模块84,连接至上述第二接收模块82和第一接收模块74,用于采用空白渐变的方式更新显示单次位置偏移量对应的区别部分。The second receiving module 82 is connected to the above-mentioned first display module 72, and is used to receive a single position offset corresponding to a single scroll change of the image sent by the virtual desktop; the second display module 84 is connected to the above-mentioned second receiving module 82 and the first receiving module 74, configured to update and display the difference part corresponding to a single position offset in a manner of blank gradation.

图9是根据本发明实施例的瘦终端的结构框图,如图9所示,该瘦终端90包括上述任一项的虚拟桌面图像处理装置二92。FIG. 9 is a structural block diagram of a thin terminal according to an embodiment of the present invention. As shown in FIG. 9 , the thin terminal 90 includes the virtual desktop image processing apparatus 2 92 described above.

针对相关技术中,鼠标操作虚拟桌面的两种场景,在本实施例中分别提出了相应的图像处理方法,例如,对于第一种,即,大部分场合操作者滚动鼠标中键时,会连续发出多个鼠标中键的命令,每次鼠标中键的命令都对应一次界面的刷新。因此当发生鼠标中键操作时引起虚拟桌面图像变化时,暂时不将图像发送到客户端的屏幕上,而是监控后面是否有鼠标中键操作到来,如果没有则将本次鼠标中键所引起的变化的图像发送到客户端的屏幕上。当最后一个鼠标中键命令到来后,虚拟桌面对图像变化部分进行分析(例如,逐行扫描编码分析法),和上一幅传送到客户端的屏幕上的图像进行比较——得出变化部分和没有变化的部分。仅将变化部分的内容传送到客户端(即瘦终端);对于第二种,即一个浏览文档的动作为按住鼠标左键拖动滚动条进行浏览,这样鼠标每托动一次就会产生相应的刷新。虚拟桌面根据当前活动的窗口所归属的应用(例如WORD程序写字板程序)判断出滚动条的大概位置——例如在窗口的右边。当鼠标移动(鼠标位置和滚动条区间吻合)+左键被按住的动作到来并引发活动窗口中内容变化时,暂时不将图像发送到客户端的屏幕上,而是监控后面是否有鼠标移动+左键被按住的动作持续到来,如果没有则将本次操作所引起的变化的图像发送到客户端的屏幕上。当最后一个鼠标移动+左键被按住的动作命令到来后,虚拟桌面对图像变化部分进行分析(例如采用逐行扫描编码分析法),和上一幅传送到客户端的屏幕上的图像进行比较——得出变化部分和没有变化的部分。仅将变化部分的内容传送到客户端。需要说明的是,对于上述两种鼠标操作,如果瘦客户端为触摸屏设备,手指在触摸屏设备上的滑动也可以被翻译为鼠标中键的滚动操作,上述处理方式依然适用。Aiming at the two scenarios of the mouse operating the virtual desktop in the related art, corresponding image processing methods are respectively proposed in this embodiment, for example, for the first one, that is, when the operator rolls the middle mouse Issue multiple middle mouse button commands, and each middle mouse button command corresponds to a refresh of the interface. Therefore, when the virtual desktop image changes when the middle mouse button operation occurs, the image will not be sent to the client's screen for the time being, but will monitor whether there is a middle mouse button operation coming later. If not, the image caused by the middle mouse button will be The changed image is sent to the client's screen. When the last middle mouse button command arrives, the virtual desktop analyzes the changed part of the image (for example, progressive scan code analysis method) and compares it with the image on the screen that was sent to the client last time - to obtain the changed part and There are no changing parts. Only the content of the changed part is transmitted to the client (that is, the thin terminal); for the second type, that is, an action to browse the document is to press and hold the left mouse button and drag the scroll bar to browse, so that every time the mouse is moved, a corresponding file will be generated. refresh. The virtual desktop determines the approximate position of the scroll bar—for example, on the right side of the window—according to the application to which the currently active window belongs (for example, the Word program tablet program). When the mouse moves (the mouse position coincides with the range of the scroll bar) + the left button is held down and the content in the active window changes, the image will not be sent to the client's screen temporarily, but whether there is mouse movement behind + The action of the left button being pressed continues to come, if not, the image of the change caused by this operation will be sent to the client's screen. When the last mouse movement + left button is held down action command arrives, the virtual desktop analyzes the changed part of the image (for example, using progressive scan encoding analysis method), and compares it with the last image sent to the client on the screen - Get the part that changed and the part that didn't change. Only the content of the changed part is transmitted to the client. It should be noted that, for the above two mouse operations, if the thin client is a touch screen device, the sliding of the finger on the touch screen device can also be translated into a scrolling operation of the middle mouse button, and the above processing method is still applicable.

下面对本发明实施例的虚拟桌面图像处理方案进行说明。The virtual desktop image processing solution of the embodiment of the present invention will be described below.

在采用上述方案进行虚拟桌面图像处理时,可以先对虚拟桌面当前活动窗口的应用程序进行判断,依据当前活动窗口的应用程序的应用类型来判断是否能够使用上述处理方案,例如,可以采用以下较为简单的判断方法,当前主要使用微软视窗的操作系统,当虚拟桌面中的视窗操作系统产生新的窗口时,虚拟桌面可以通过窗口标题中的字符串获得新窗口的应用类型——例如,应用为MicrosoftWord,MicrosoftExcel,记事本,IE等;可以根据该窗口标题中的字符串来判断应用的类型,从而决定是否采用上述处理方式。下面举例说明。对于目前视窗系统中常用的应用——例如MicrosoftWord,MicrosoftExcel,记事本,IE等,这些应用都有滚动条,而且滚动条的位置非常固定:(1):上下滚动条都位于窗口的最右端的竖状狭长区域;(2):左右滚动条都位于窗口的最下端的横状狭长区域;虚拟桌面很容易计算出滚动条区间在应用窗口中区域的大概坐标。因此,对上述应用的浏览是采用滚动操作的,即可以采用上述虚拟桌面的图像处理方案。When using the above solution to process the virtual desktop image, you can first judge the application program of the current active window of the virtual desktop, and judge whether the above processing solution can be used according to the application type of the application program in the current active window. For example, the following comparison can be adopted A simple way to judge. At present, the operating system of Microsoft Windows is mainly used. When the Windows operating system in the virtual desktop generates a new window, the virtual desktop can obtain the application type of the new window through the string in the window title—for example, the application is MicrosoftWord, MicrosoftExcel, Notepad, IE, etc.; you can judge the type of application according to the character string in the window title, so as to decide whether to adopt the above processing method. The following example illustrates. For the commonly used applications in the current window system - such as Microsoft Word, Microsoft Excel, Notepad, IE, etc., these applications have scroll bars, and the positions of the scroll bars are very fixed: (1): The upper and lower scroll bars are located at the far right of the window Vertical narrow area; (2): The left and right scroll bars are located in the horizontal narrow area at the bottom of the window; the virtual desktop can easily calculate the approximate coordinates of the scroll bar area in the application window. Therefore, the scrolling operation is used to browse the above applications, that is, the image processing scheme of the above virtual desktop can be used.

下面结合上述两种鼠标操作场景分别说明。The following describes respectively in combination with the above two mouse operation scenarios.

鼠标中键的操作场景:当一个窗口变为活动窗口时,虚拟桌面将当前窗口的图像发给瘦客户端,瘦客户端在界面上完成显示。同时,虚拟桌面和瘦客户端同时保存窗口中的该图像为首幅图像。下面通过鼠标中键的方式对图像进行滚动变化,即当虚拟桌面收到鼠标中键的命令时,虚拟桌面如果产生了图像变化,则虚拟桌面将对图像的变化进行分析比较处理;Middle mouse button operation scenario: When a window becomes the active window, the virtual desktop sends the image of the current window to the thin client, and the thin client completes the display on the interface. At the same time, the virtual desktop and the thin client simultaneously save the image in the window as the first image. Next, the image is scrolled and changed by means of the middle mouse button, that is, when the virtual desktop receives the command of the middle mouse button, if there is an image change on the virtual desktop, the virtual desktop will analyze and compare the image changes;

S1,发生图像变化的区间是否在当前活动窗口的范围内,如果不在活动窗口的范围内,则不继续处理;S1, whether the interval where the image change occurs is within the range of the current active window, if not within the range of the active window, do not continue processing;

S2,如果发生图像变化的区间在活动窗口的范围内,则继续以下处理:对新的图像进行缓存,并根据滚动的方向可以判断出新图像针对上一幅图像时发生了上移还是下移。然后计算出窗口图像滚动的偏移量(例如10行像素的高度),将偏移量(例如向上滚动10行像素)发送到客户端——这个信息量非常小,对网络带宽占用可以忽略不计;S2, if the image change interval is within the range of the active window, continue the following processing: cache the new image, and judge whether the new image has moved up or down for the previous image according to the scrolling direction . Then calculate the offset of window image scrolling (for example, the height of 10 lines of pixels), and send the offset (for example, scrolling up by 10 lines of pixels) to the client-this amount of information is very small, and the network bandwidth consumption is negligible ;

S3,瘦客户端根据发过来的滚动偏移量进行显示更新——例如将原来的缓存在瘦客户端的图像向上滚动10行像素,由于虚拟桌面并没有把变化部分的图像(新进行窗口底部10行像素)发送到瘦客户端,瘦客户端可以采用空白渐变的方式在界面上显示窗口底部的10行像素点,给操作者以视觉体验方面的平衡;S3, the thin client performs display update according to the scroll offset sent over—for example, the original cached image on the thin client is scrolled up by 10 lines of pixels, because the virtual desktop does not update the image of the changed part (the new image at the bottom of the window is 10 Lines of pixels) are sent to the thin client, and the thin client can display the 10 lines of pixels at the bottom of the window on the interface in a blank gradient manner, giving the operator a balance in visual experience;

S4,虚拟桌面继续监控在指定时间内是否有新的鼠标中键命令到来。如果有新的鼠标中键到来,则循环继续进行上面S2,S3步骤的操作;S4, the virtual desktop continues to monitor whether a new middle mouse button command arrives within a specified time. If there is a new middle mouse button arrival, then the loop continues to carry out the operation of the above S2, S3 steps;

S5,当没有鼠标中键的操作到来后,将累积计算出最新的图像(没有鼠标中键到来后)和首幅图像(第一个鼠标中键到来前)进行对比,计算出偏移量(即上述累计位置偏移量),将偏移量(例如,向上滚动80行像素的高度)+新出现的80行像素的信息发送到瘦客户端;S5, when there is no operation of the middle mouse button, the latest image (after the arrival of no middle mouse button) is accumulated and compared with the first image (before the arrival of the first middle mouse button), and the offset is calculated ( That is, the above-mentioned cumulative position offset), and send the information of the offset (for example, the height of scrolling up 80 rows of pixels) + the newly appearing 80 rows of pixels to the thin client;

S6,瘦客户端将缓存在本地首幅图像(第一个鼠标中键到来前)向上偏移80行像素,然后叠加新出现的80行像素的信息,形成新的图像并缓存在瘦客户端;S6, the thin client will cache the first local image (before the arrival of the first middle mouse button) and shift upwards by 80 rows of pixels, and then superimpose the information of the new 80 rows of pixels to form a new image and cache it on the thin client ;

S7,对于触摸屏中用手指滑动代替鼠标中间的操作,上述处理流程依然适用。S7, for the operation of replacing the middle of the mouse with finger sliding on the touch screen, the above processing flow is still applicable.

鼠标移动+鼠标左键的操作场景:当虚拟桌面收到鼠标移动+鼠标左键按下的命令时,虚拟桌面如果产生了图像变化,则虚拟桌面将对图像的变化进行分析比较处理;Operation scenario of mouse movement + left mouse button: When the virtual desktop receives the command of mouse movement + left mouse button press, if the image changes on the virtual desktop, the virtual desktop will analyze and compare the image changes;

S1,发生图像变化的区间是否在当前活动窗口的范围内,如果不在活动窗口的范围内,则结束处理;同时判断鼠标的位置是否在滚动区间,如果不在滚动区间则本发明所描述的方法不适用。如果是活动窗口发生了变化并且鼠标当前位置在滚动区间,则使用下面S2~S5步骤的方法;S1, whether the interval where the image change occurs is within the scope of the current active window, if not within the scope of the active window, then end the processing; simultaneously determine whether the position of the mouse is in the scrolling interval, if not in the scrolling interval then the method described in the present invention does not Be applicable. If the active window has changed and the current position of the mouse is in the scrolling range, use the method in steps S2-S5 below;

S2,虚拟桌面首先缓存新图像,然后虚拟桌面向瘦客户端发送滚动的命令,瘦客户端采用空白+顺时滚动图标的方法显示区间,使得操作者明白拖动滚动条的动作在发生作用;S2, the virtual desktop first caches the new image, and then the virtual desktop sends a scroll command to the thin client, and the thin client uses a blank + clockwise scrolling icon to display the interval, so that the operator understands that the action of dragging the scroll bar is working;

S3,虚拟桌面继续监控在指定时间内是否有新的鼠标移动+鼠标左键按下的命令到来。如果有新的鼠标中键到来,则循环继续进行上面S2步骤的操作;S3, the virtual desktop continues to monitor whether there is a new mouse movement + mouse left button press command arrives within the specified time. If there is a new middle mouse button arrival, the cycle continues to carry out the operation of the above S2 step;

S4,当没有鼠标移动+鼠标左键的操作到来后,将累积计算出最新的图像(没有鼠标移动+鼠标左键到来后)和首幅图像(第一个鼠标移动+鼠标左键到来前)进行对比,计算出偏移量,将偏移量(例如向上滚动200行像素的高度)+新出现的200行像素的信息发送到瘦客户端;S4, when there is no mouse movement + left mouse button operation, the latest image (after no mouse movement + left mouse button arrival) and the first image (before the first mouse movement + left mouse button arrival) will be accumulated and calculated Make a comparison, calculate the offset, and send the offset (for example, the height of scrolling up 200 rows of pixels) + the information of the newly appearing 200 rows of pixels to the thin client;

S5,瘦客户端将缓存在本地首幅图像(第一个鼠标中键到来前)向上偏移200行像素,然后叠加新出现的200行像素的信息,形成新的图像并缓存在瘦客户端。S5, the thin client will cache the first local image (before the arrival of the first middle mouse button) and shift upwards by 200 rows of pixels, and then superimpose the information of the new 200 rows of pixels to form a new image and cache it on the thin client .

下面结合处理流程示意图对本发明优选实施方式进行说明。A preferred embodiment of the present invention will be described below in combination with a schematic diagram of a processing flow.

图10是根据本发明优选实施方式的虚拟桌面图像处理方法中首个活动窗口示意图,如图10所示,虚拟桌面在出现新的活动窗口后,对活动窗口的图像进行缓存,并发送到瘦客户端,瘦客户端同时对窗口的图像进行缓存。Fig. 10 is a schematic diagram of the first active window in the virtual desktop image processing method according to a preferred embodiment of the present invention. As shown in Fig. 10, after a new active window appears on the virtual desktop, the image of the active window is cached and sent to the thin On the client side, the thin client also caches the image of the window.

图11是根据本发明优选实施方式的虚拟桌面图像处理方法中窗口图像滚动偏移量计算示意图,如图11所示,当鼠标中键引起显示区发生滚动变化时,虚拟桌面先缓存下新的图像,然后和原来图像进行比较,计算出滚动偏移量,计算的方法如下:Fig. 11 is a schematic diagram of calculation of window image scrolling offset in the virtual desktop image processing method according to a preferred embodiment of the present invention. As shown in Fig. 11, when the middle mouse button causes the display area to scroll and change, the virtual desktop first caches the new image, and then compare it with the original image to calculate the scroll offset. The calculation method is as follows:

(1)使用新图像在显示区的第1行(图11中的N+1行)和原来图像在显示区的第1行(图11中的1行)进行比较,如果不同就和原来图像在显示区的第2行进行比较,直到找到相同的为止(假设原来图像在显示区的第11行);(1) Use the first line of the new image in the display area (line N+1 in Figure 11) and the first line of the original image in the display area (line 1 in Figure 11) to compare, if different, it will be the same as the original image Compare in line 2 of the display area until the same one is found (assuming the original image is in line 11 of the display area);

(2)使用新图像在显示区的第2~X(X可以配置)行和原来图像的(12~10+X)进行逐行对比,如果全部相同说明偏移量寻找正确。否则继续第(1)步的查找过程——用新图像在显示区的第1行和原来图像的第12行重新开始比对。(2) Use the new image to compare the 2nd to X (X can be configured) lines of the display area and the (12 to 10+X) of the original image line by line. If they are all the same, it means that the offset is found correctly. Otherwise, continue the search process of step (1)—use the new image on the first line of the display area and the 12th line of the original image to start the comparison again.

图12是根据本发明优选实施方式的虚拟桌面图像处理方法中瘦终端根据偏移量绘制显示区示意图,如图12所示,虚拟桌面将偏移量发给瘦客户端,瘦客户端根据偏移量重新绘制窗口显示区。Fig. 12 is a schematic diagram of the thin terminal drawing the display area according to the offset in the virtual desktop image processing method according to the preferred embodiment of the present invention. As shown in Fig. 12, the virtual desktop sends the offset to the thin client, and the thin client Offset repaints the window display area.

虚拟桌面监控在指定时间内(可以配置,例如0.2秒)是否有新的鼠标中键命令到来。如果在指定时间内有鼠标中键指令到来,则继续进行图11,图12所示的操作处理。如果在指定时间内没有鼠标中键指令到来,则继续进行以下的处理。The virtual desktop monitors whether a new middle mouse button command arrives within a specified time (configurable, for example, 0.2 seconds). If there is a middle mouse button instruction to arrive within the designated time, then continue to perform the operation process shown in Fig. 11 and Fig. 12 . If no middle mouse button instruction arrives within the specified time, then proceed with the following processing.

图13是根据本发明优选实施方式的虚拟桌面图像处理方法中瘦终端根据偏移量+变化区间绘制显示区示意图,如图13所示,计算出累积偏移量,将偏移量和新出现的像素行发送给瘦客户端,瘦客户端根据偏移量+变化的区间重新绘制窗口显示区。Fig. 13 is a schematic diagram of the thin terminal drawing the display area according to the offset + change interval in the virtual desktop image processing method according to the preferred embodiment of the present invention. As shown in Fig. 13, the cumulative offset is calculated, and the offset and the new occurrence The pixel row is sent to the thin client, and the thin client redraws the window display area according to the offset + changed interval.

需要说明的是,对于按住鼠标左键+移动鼠标的操作方法(拖动滚动条),和鼠标中键基本类似,不同在于虚拟桌面在鼠标移动的过程中,不再计算每次移动的偏移量而是在鼠标停止移动后计算总体的偏移量。瘦客户端在鼠标移动过程中整个界面显示旋转的时针表示界面正处于刷新的过程。It should be noted that the operation method of holding down the left mouse button + moving the mouse (dragging the scroll bar) is basically similar to the middle mouse button, the difference is that the virtual desktop does not calculate the offset of each movement during the mouse movement process. Offset instead calculates the overall offset after the mouse stops moving. During the mouse movement process of the thin client, the whole interface displays a rotating hour hand, indicating that the interface is in the process of being refreshed.

通过上述实施例及优选实施方式,针对虚拟桌面的常用场景,通过监控应用类型,用户操作和分析图像变化的方法,只将最后图像的变化部分进行传送,大大节省了网络带宽。同时因为针对应用类型进行了判断,排除了误判的可能。Through the above embodiments and preferred implementations, for common scenarios of virtual desktops, by monitoring application types, user operations and analyzing image changes, only the changed part of the final image is transmitted, which greatly saves network bandwidth. At the same time, because the judgment is made according to the application type, the possibility of misjudgment is eliminated.

显然,本领域的技术人员应该明白,上述的本发明的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。Obviously, those skilled in the art should understand that each module or each step of the above-mentioned present invention can be realized by a general-purpose computing device, and they can be concentrated on a single computing device, or distributed in a network formed by multiple computing devices Alternatively, they may be implemented in program code executable by a computing device so that they may be stored in a storage device to be executed by a computing device, and in some cases, in an order different from that shown here The steps shown or described are carried out, or they are separately fabricated into individual integrated circuit modules, or multiple modules or steps among them are fabricated into a single integrated circuit module for implementation. As such, the present invention is not limited to any specific combination of hardware and software.

以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (12)

1.一种虚拟桌面图像处理方法,其特征在于,包括:1. A virtual desktop image processing method, characterized in that, comprising: 判断虚拟桌面当前活动窗口显示的图像是否发生滚动变化;Determine whether the image displayed in the current active window of the virtual desktop has scrolled; 在判断结果为是的情况下,累计在预定时间段内所述图像发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;If the judgment result is yes, accumulating the accumulated position offset of the scrolling change of the image within the predetermined time period, and the cumulative difference part of the scrolling change; 将所述累计位置偏移量,以及所述累计区别部分发送给用于所述虚拟桌面显示对应的瘦终端。Sending the accumulated position offset and the accumulated difference part to the corresponding thin terminal for displaying the virtual desktop. 2.根据权利要求1所述的方法,其特征在于,在累计在所述预定时间段内所述图像发生滚动变化的所述累计位置偏移量,以及发生滚动变化的所述累计区别部分之前,还包括:2. The method according to claim 1, characterized in that, before accumulating the accumulated position offset of the rolling change of the image within the predetermined time period and the accumulated difference part of the rolling change ,Also includes: 获取所述图像单次滚动变化对应的单次位置偏移量;Acquiring a single position offset corresponding to a single scrolling change of the image; 将所述单次位置偏移量发送给所述瘦终端。Send the single position offset to the thin terminal. 3.根据权利要求1所述的方法,其特征在于,在判断所述虚拟桌面当前活动窗口显示的所述图像是否发生滚动变化之前,还包括:3. The method according to claim 1, further comprising: 判断所述虚拟桌面当前活动窗口显示的所述图像对应的应用是否为采用滚动条进行滚动操作的应用,在判断结果为是的情况下,判断所述虚拟桌面当前活动窗口显示的所述图像是否发生滚动变化。Judging whether the application corresponding to the image displayed in the current active window of the virtual desktop is an application that uses a scroll bar for scrolling operations, and if the judgment result is yes, judging whether the image displayed in the current active window of the virtual desktop is A scrolling change occurred. 4.一种虚拟桌面图像处理方法,其特征在于,包括:4. A virtual desktop image processing method, comprising: 显示虚拟桌面发送的当前活动窗口显示的图像;Display the image displayed by the current active window sent by the virtual desktop; 接收所述虚拟桌面对所述图像在预定时间段内发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;receiving the cumulative position offset of the virtual desktop for the scrolling change of the image within a predetermined period of time, and the cumulative difference part of the scrolling change; 依据所述累计位置偏移量,以及所述累计区别部分对显示的所述图像进行更新显示。The displayed image is updated and displayed according to the accumulated position offset and the accumulated difference part. 5.根据权利要求1所述的方法,其特征在于,在接收所述虚拟桌面对所述图像在所述预定时间段内发生滚动变化的所述累计位置偏移量,以及发生滚动变化的所述累计区别部分之前,还包括:5. The method according to claim 1, characterized in that, after receiving the cumulative position offset of the scrolling change of the virtual desktop to the image within the predetermined time period, and the scrolling change of the virtual desktop Before the cumulative differences section above, also include: 接收所述虚拟桌面发送的所述图像单次滚动变化对应的单次位置偏移量;receiving a single position offset corresponding to a single scroll change of the image sent by the virtual desktop; 采用空白渐变的方式更新显示所述单次位置偏移量对应的区别部分。The difference part corresponding to the single position offset is updated and displayed in a blank gradient manner. 6.一种虚拟桌面图像处理装置,其特征在于,包括:6. A virtual desktop image processing device, comprising: 第一判断模块,用于判断虚拟桌面当前活动窗口显示的图像是否发生滚动变化;The first judging module is used to judge whether the image displayed in the current active window of the virtual desktop is scrolled; 累计模块,用于在判断结果为是的情况下,累计在预定时间段内所述图像发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;An accumulative module, used to accumulate the cumulative position offset of the rolling change of the image within a predetermined time period and the cumulative difference part of the rolling change when the judgment result is yes; 第一发送模块,用于将所述累计位置偏移量,以及所述累计区别部分发送给用于所述虚拟桌面显示对应的瘦终端。The first sending module is configured to send the accumulated position offset and the accumulated difference part to the corresponding thin terminal for displaying the virtual desktop. 7.根据权利要求6所述的装置,其特征在于,还包括:7. The device according to claim 6, further comprising: 获取模块,用于获取所述图像单次滚动变化对应的单次位置偏移量;An acquisition module, configured to acquire a single position offset corresponding to a single scroll change of the image; 第二发送模块,用于将所述单次位置偏移量发送给所述瘦终端。The second sending module is configured to send the single position offset to the thin terminal. 8.根据权利要求6所述的装置,其特征在于,还包括:8. The device according to claim 6, further comprising: 第二判断模块,用于判断所述虚拟桌面当前活动窗口显示的所述图像对应的应用是否为采用滚动条进行滚动操作的应用,在判断结果为是的情况下,判断所述虚拟桌面当前活动窗口显示的所述图像是否发生滚动变化。The second judging module is used to judge whether the application corresponding to the image displayed in the current active window of the virtual desktop is an application that uses a scroll bar for scrolling operation, and if the judging result is yes, judge that the virtual desktop is currently active Whether the image displayed in the window is scrolled. 9.一种虚拟桌面服务器,其特征在于,包括权利要求6至8中任一项所述的装置。9. A virtual desktop server, comprising the device according to any one of claims 6-8. 10.一种虚拟桌面图像处理装置,其特征在于,包括:10. A virtual desktop image processing device, comprising: 第一显示模块,用于显示虚拟桌面发送的当前活动窗口显示的图像;The first display module is used to display the image displayed by the current active window sent by the virtual desktop; 第一接收模块,用于接收所述虚拟桌面对所述图像在预定时间段内发生滚动变化的累计位置偏移量,以及发生滚动变化的累计区别部分;The first receiving module is configured to receive the cumulative position offset of the virtual desktop with respect to the scrolling change of the image within a predetermined period of time, and the cumulative difference part of the scrolling change; 更新模块,用于依据所述累计位置偏移量,以及所述累计区别部分对显示的所述图像进行更新显示。An updating module, configured to update and display the displayed image according to the accumulated position offset and the accumulated difference part. 11.根据权利要求10所述的装置,其特征在于,还包括:11. The device according to claim 10, further comprising: 第二接收模块,用于接收所述虚拟桌面发送的所述图像单次滚动变化对应的单次位置偏移量;The second receiving module is configured to receive a single position offset corresponding to a single scroll change of the image sent by the virtual desktop; 第二显示模块,用于采用空白渐变的方式更新显示所述单次位置偏移量对应的区别部分。The second display module is configured to update and display the difference part corresponding to the single position offset in a blank gradient manner. 12.一种瘦终端,其特征在于,包括:权利要求10至11中任一项所述的装置。12. A thin terminal, comprising: the device according to any one of claims 10-11.
CN201410283784.3A 2014-06-23 2014-06-23 virtual desktop image processing method, device, virtual desktop server and thin terminal Withdrawn CN105227603A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201410283784.3A CN105227603A (en) 2014-06-23 2014-06-23 virtual desktop image processing method, device, virtual desktop server and thin terminal
PCT/CN2015/071765 WO2015196804A1 (en) 2014-06-23 2015-01-28 Virtual desktop image processing method and device, virtual desktop server and thin terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410283784.3A CN105227603A (en) 2014-06-23 2014-06-23 virtual desktop image processing method, device, virtual desktop server and thin terminal

Publications (1)

Publication Number Publication Date
CN105227603A true CN105227603A (en) 2016-01-06

Family

ID=54936694

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410283784.3A Withdrawn CN105227603A (en) 2014-06-23 2014-06-23 virtual desktop image processing method, device, virtual desktop server and thin terminal

Country Status (2)

Country Link
CN (1) CN105227603A (en)
WO (1) WO2015196804A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106020756A (en) * 2016-05-13 2016-10-12 江苏云途腾科技有限责任公司 Method and apparatus for updating virtual desktop
CN106383705A (en) * 2016-08-31 2017-02-08 杭州华为数字技术有限公司 Method and device for setting mouse display state in application thin client
CN107682694A (en) * 2017-07-07 2018-02-09 西安万像电子科技有限公司 Image coding/decoding method, apparatus and system
CN108153573A (en) * 2017-12-26 2018-06-12 合肥中科云巢科技有限公司 Cloud desktop picture update method and virtual machine
CN111953986A (en) * 2020-07-23 2020-11-17 西安万像电子科技有限公司 Image processing method and device
CN117591225A (en) * 2023-12-05 2024-02-23 太极计算机股份有限公司 Optimization method and system for rolling dragging window in cloud desktop

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101420610A (en) * 2007-10-26 2009-04-29 闪联信息技术工程中心有限公司 Method for displaying remote desktop content and apparatus thereof
CN102027464A (en) * 2008-05-12 2011-04-20 微软公司 Virtual desktop view scrolling
CN102164166A (en) * 2011-02-21 2011-08-24 北京奇虎科技有限公司 A partition transmission method and system for remote control
CN102566910A (en) * 2011-12-14 2012-07-11 广州杰赛科技股份有限公司 Virtual desktop system and method for refreshing on-screen display of virtual desktop client
US20130067344A1 (en) * 2011-09-08 2013-03-14 Microsoft Corporation Remoting desktop displays using move regions
CN103294438A (en) * 2013-06-21 2013-09-11 镇江冈山电子有限公司 Transmission control method and system of virtual desktop images

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101192131B (en) * 2006-11-30 2012-04-11 重庆优腾信息技术有限公司 Method for processing table top background, device and operation system table top interface system
WO2011123840A2 (en) * 2010-04-01 2011-10-06 Citrix Systems, Inc. Interacting with remote applications displayed within a virtual desktop of a tablet computing device
CN103412701B (en) * 2012-11-01 2016-08-31 华为技术有限公司 remote desktop image processing method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101420610A (en) * 2007-10-26 2009-04-29 闪联信息技术工程中心有限公司 Method for displaying remote desktop content and apparatus thereof
CN102027464A (en) * 2008-05-12 2011-04-20 微软公司 Virtual desktop view scrolling
CN102164166A (en) * 2011-02-21 2011-08-24 北京奇虎科技有限公司 A partition transmission method and system for remote control
US20130067344A1 (en) * 2011-09-08 2013-03-14 Microsoft Corporation Remoting desktop displays using move regions
CN102566910A (en) * 2011-12-14 2012-07-11 广州杰赛科技股份有限公司 Virtual desktop system and method for refreshing on-screen display of virtual desktop client
CN103294438A (en) * 2013-06-21 2013-09-11 镇江冈山电子有限公司 Transmission control method and system of virtual desktop images

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106020756A (en) * 2016-05-13 2016-10-12 江苏云途腾科技有限责任公司 Method and apparatus for updating virtual desktop
CN106383705A (en) * 2016-08-31 2017-02-08 杭州华为数字技术有限公司 Method and device for setting mouse display state in application thin client
CN107682694A (en) * 2017-07-07 2018-02-09 西安万像电子科技有限公司 Image coding/decoding method, apparatus and system
CN107682694B (en) * 2017-07-07 2020-02-04 西安万像电子科技有限公司 Image coding and decoding method, device and system
CN108153573A (en) * 2017-12-26 2018-06-12 合肥中科云巢科技有限公司 Cloud desktop picture update method and virtual machine
CN111953986A (en) * 2020-07-23 2020-11-17 西安万像电子科技有限公司 Image processing method and device
CN117591225A (en) * 2023-12-05 2024-02-23 太极计算机股份有限公司 Optimization method and system for rolling dragging window in cloud desktop
CN117591225B (en) * 2023-12-05 2024-06-11 太极计算机股份有限公司 Optimization method and system for rolling dragging window in cloud desktop

Also Published As

Publication number Publication date
WO2015196804A1 (en) 2015-12-30

Similar Documents

Publication Publication Date Title
JP5324411B2 (en) Advertisement distribution apparatus, method and program
CN105227603A (en) virtual desktop image processing method, device, virtual desktop server and thin terminal
CN115878935B (en) Method, system, device, equipment and medium for partial refreshing of chart
CN108885536B (en) A method, device and terminal equipment for follow chirality compensation
CN107870795B (en) Method and device for displaying electronic map
US11030978B2 (en) Location-based display of pixel history
JP6359396B2 (en) Advertisement display device, advertisement display method, and advertisement display program
CN113204401A (en) Browser rendering method, terminal and storage medium
JP5563703B2 (en) Content distribution apparatus, content distribution method, content distribution program, and terminal program
CN103914228B (en) A kind of operating method of mobile terminal and its touch-screen
CN109800039B (en) User interface display method and device, electronic equipment and storage medium
CN112883306B (en) A page display method and device
JP6339550B2 (en) Terminal program, terminal device, and terminal control method
JP5997328B2 (en) Program and terminal device
JP5805289B2 (en) Apparatus and distribution method
EP3208997A1 (en) Method and device for updating virtual desktop
CN109960562A (en) A kind of information displaying method, device and computer readable storage medium
CN103543975A (en) Cloud computing terminal display optimization method and system based on RDP (remote desktop protocol)
JP2019015812A (en) TERMINAL DEVICE, DISPLAY SYSTEM, AND TERMINAL DEVICE CONTROL METHOD
JP6520674B2 (en) Display system, display terminal, display method, and display program
JP6279679B2 (en) Program, terminal device, device, and distribution method
JP6655880B2 (en) Display control device, display control method and program
JP6312901B2 (en) Terminal program, terminal device, and terminal control method
JP6101654B2 (en) Distribution apparatus, distribution method, distribution program, and control program
JP6577731B2 (en) Terminal device, display control method, and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20160106