[go: up one dir, main page]

CN116136785A - Method, device, electronic device and storage medium for directional screen capture of multi-person projection - Google Patents

Method, device, electronic device and storage medium for directional screen capture of multi-person projection Download PDF

Info

Publication number
CN116136785A
CN116136785A CN202111369850.5A CN202111369850A CN116136785A CN 116136785 A CN116136785 A CN 116136785A CN 202111369850 A CN202111369850 A CN 202111369850A CN 116136785 A CN116136785 A CN 116136785A
Authority
CN
China
Prior art keywords
screenshot
screen
thumbnail
client terminal
video stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111369850.5A
Other languages
Chinese (zh)
Other versions
CN116136785B (en
Inventor
陶林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shizhen Information Technology Co Ltd
Original Assignee
Guangzhou Shizhen Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shizhen Information Technology Co Ltd filed Critical Guangzhou Shizhen Information Technology Co Ltd
Priority to CN202111369850.5A priority Critical patent/CN116136785B/en
Publication of CN116136785A publication Critical patent/CN116136785A/en
Application granted granted Critical
Publication of CN116136785B publication Critical patent/CN116136785B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明实施例公开了多人投屏的定向截屏方法、装置、电子设备和存储介质。该方法用于投屏服务端,其包括:接收多个客户终端协同操作过程中,至少一个客户终端发送的投屏视频流;将所述投屏视频流的缩略图发送到每个所述客户终端进行显示,所述缩略图显示于协作交互界面同一信息块,每个所述缩略图中对应显示有截图控件;接收在所述协作交互界面触发所述截图控件生成的截图指令,获取所述截图指令对应的缩略图标识;根据所述缩略图标识从对应的投屏视频流截取帧图像,将所述帧图像发送到请求终端进行显示,所述请求终端为发送所述截图指令的客户终端。本方案实现了用户在客户终端对多路投屏的定向自主截屏。

Figure 202111369850

The embodiment of the invention discloses a directional screen capture method, device, electronic equipment and storage medium for multi-person screen projection. The method is used for a screen projection server, which includes: receiving a screen projection video stream sent by at least one client terminal during the cooperative operation of multiple client terminals; sending a thumbnail of the screen projection video stream to each of the clients The terminal displays, the thumbnails are displayed in the same information block of the collaborative interaction interface, and a screenshot control is correspondingly displayed in each of the thumbnails; receiving a screenshot instruction generated by triggering the screenshot control on the collaborative interaction interface, and obtaining the The thumbnail identification corresponding to the screenshot command; according to the thumbnail identification, the frame image is intercepted from the corresponding screen projection video stream, and the frame image is sent to the requesting terminal for display, and the requesting terminal is the client terminal that sends the screenshot command . This solution realizes the user's directional and autonomous screen capture of multi-channel projection screens on the client terminal.

Figure 202111369850

Description

多人投屏的定向截屏方法、装置、电子设备和存储介质Method, device, electronic device and storage medium for directional screen capture of multi-person projection

技术领域technical field

本发明实施例涉及交互技术领域,尤其涉及多人投屏的定向截屏方法、装置、电子设备和存储介质。Embodiments of the present invention relate to the field of interactive technologies, and in particular, relate to a directional screen capture method, device, electronic device and storage medium for multi-person screen projection.

背景技术Background technique

在信息技术背景下的会议场景中,经常出现多人围绕会议设备呈现的焦点信息进行讨论。在这一讨论过程中,可能会有多人同时进行投屏,然后根据会议进程切换当前显示的投屏画面。In a meeting scene under the background of information technology, many people often discuss around the focus information presented by the meeting equipment. During this discussion, there may be multiple people casting screens at the same time, and then switch the currently displayed screen casting screen according to the progress of the meeting.

多人投屏过程中,参与会议讨论的人可能会有对某一投屏画面有保存的需要,现有的技术方案只能对当前显示的画面通过对投屏显示设备的操作进行截屏,用户无法对屏幕数据进行自主定向截屏。During the process of multi-person screen projection, the people participating in the meeting discussion may have the need to save a certain screen projection screen. The existing technical solutions can only take screenshots of the currently displayed screen through the operation of the screen projection display device. It is not possible to take self-directed screenshots of screen data.

发明内容Contents of the invention

本发明提供了一种多人投屏的定向截屏方法、装置、电子设备和存储介质,以解决现有用户无法对屏幕数据进行自主定向截屏的技术问题。The invention provides a directional screen capture method, device, electronic equipment and storage medium for multi-person projection to solve the technical problem that existing users cannot perform directional screen capture of screen data independently.

第一方面,本发明实施例提供了一种多人投屏的定向截屏方法,用于投屏服务端,包括:In the first aspect, the embodiment of the present invention provides a directional screen capture method for multi-person screen projection, which is used for the screen projection server, including:

接收多个客户终端协同操作过程中,至少一个客户终端发送的投屏视频流;Receive the screen-casting video stream sent by at least one client terminal during the collaborative operation of multiple client terminals;

将所述投屏视频流的缩略图发送到每个所述客户终端进行显示,所述缩略图显示于协作交互界面同一信息块,每个所述缩略图中对应显示有截图控件;Sending the thumbnail of the screen-casting video stream to each of the client terminals for display, the thumbnail is displayed in the same information block of the collaborative interactive interface, and each of the thumbnails is correspondingly displayed with a screenshot control;

接收在所述协作交互界面触发所述截图控件生成的截图指令,获取所述截图指令对应的缩略图标识;receiving a screenshot instruction generated by triggering the screenshot control on the collaborative interaction interface, and acquiring a thumbnail identifier corresponding to the screenshot instruction;

根据所述缩略图标识从对应的投屏视频流截取帧图像,将所述帧图像发送到请求终端进行显示,所述请求终端为发送所述截图指令的客户终端。Capture a frame image from the corresponding screen-casting video stream according to the thumbnail identifier, and send the frame image to a requesting terminal for display, and the requesting terminal is the client terminal that sends the screenshot command.

第二方面,本发明实施例还提供了一种多人投屏的定向截屏装置,用于投屏服务端,包括:In the second aspect, the embodiment of the present invention also provides a directional screen capture device for multi-person screen projection, which is used for the screen projection server, including:

视频流接收单元,用于接收多个客户终端协同操作过程中,至少一个客户终端发送的投屏视频流;The video stream receiving unit is used to receive the projection video stream sent by at least one client terminal during the collaborative operation of multiple client terminals;

缩略图发送单元,用于将所述投屏视频流的缩略图发送到每个所述客户终端进行显示,所述缩略图显示于协作交互界面同一信息块,每个所述缩略图中对应显示有截图控件;A thumbnail image sending unit, configured to send the thumbnail image of the projected screen video stream to each of the client terminals for display, the thumbnail images are displayed in the same information block of the collaborative interaction interface, and each of the thumbnail images is correspondingly displayed There is a screenshot control;

截图指令接收单元,用于接收在所述协作交互界面触发所述截图控件生成的截图指令,获取所述截图指令对应的缩略图标识;A screenshot instruction receiving unit, configured to receive a screenshot instruction generated by triggering the screenshot control on the collaborative interaction interface, and obtain a thumbnail identifier corresponding to the screenshot instruction;

截图发送单元,用于根据所述缩略图标识从对应的投屏视频流截取帧图像,将所述帧图像发送到请求终端进行显示,所述请求终端为发送所述截图指令的客户终端。A screenshot sending unit, configured to intercept a frame image from the corresponding screen-casting video stream according to the thumbnail identifier, and send the frame image to a requesting terminal for display, and the requesting terminal is the client terminal sending the screenshot instruction.

第三方面,本发明实施例还提供了一种电子设备,包括:In a third aspect, an embodiment of the present invention also provides an electronic device, including:

一个或多个处理器;one or more processors;

存储器,用于存储一个或多个程序;memory for storing one or more programs;

当所述一个或多个程序被所述一个或多个处理器执行,使得所述电子设备实现如第一方面所述的多人投屏的定向截屏方法。When the one or more programs are executed by the one or more processors, the electronic device implements the directional screen capture method for multi-person screen projection as described in the first aspect.

第四方面,本发明实施例还提供了计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如第一方面所述的多人投屏的定向截屏方法。In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the method for directional screen capture by multi-person projection as described in the first aspect is implemented.

上述多人投屏的定向截屏方法、装置、电子设备和存储介质,该方法用于投屏服务端,包括:接收多个客户终端协同操作过程中,至少一个客户终端发送的投屏视频流;将所述投屏视频流的缩略图发送到每个所述客户终端进行显示,所述缩略图显示于协作交互界面同一信息块,每个所述缩略图中对应显示有截图控件;接收在所述协作交互界面触发所述截图控件生成的截图指令,获取所述截图指令对应的缩略图标识;根据所述缩略图标识从对应的投屏视频流截取帧图像,将所述帧图像发送到请求终端进行显示,所述请求终端为发送所述截图指令的客户终端。通过投屏服务端将投屏视频流发送到每个客户终端以缩略图的方式进行预览显示,用户通过缩略图中的截图控件发送截图指令,投屏服务端根据截图指令截取对应的帧图像发送到对应客户终端,实现了用户在客户终端对多路投屏的定向自主截屏。The above directional screen capture method, device, electronic device and storage medium for multi-person screen projection, the method is used on the screen projection server, including: receiving the screen projection video stream sent by at least one client terminal during the collaborative operation of multiple client terminals; Send the thumbnail of the screen-casting video stream to each of the client terminals for display, the thumbnail is displayed in the same information block of the collaborative interaction interface, and each of the thumbnails is correspondingly displayed with a screenshot control; The collaborative interaction interface triggers the screenshot command generated by the screenshot control, and obtains the thumbnail identifier corresponding to the screenshot instruction; intercepts the frame image from the corresponding screen-casting video stream according to the thumbnail identifier, and sends the frame image to the requesting The terminal displays, and the requesting terminal is the client terminal that sends the screenshot instruction. The screen-casting server sends the screen-casting video stream to each client terminal for preview display in the form of a thumbnail, the user sends a screenshot command through the screenshot control in the thumbnail, and the screen-casting server captures the corresponding frame image according to the screenshot command and sends it To the corresponding client terminal, it realizes the directional and autonomous screen capture of the multi-channel projection screen by the user on the client terminal.

附图说明Description of drawings

图1为本发明实施例提供的一种多人投屏的定向截屏方法的方法流程图;Fig. 1 is a method flow chart of a directional screen capture method for multi-person projection provided by an embodiment of the present invention;

图2为交互平板的界面示意图;Figure 2 is a schematic diagram of the interface of the interactive panel;

图3为本发明实施例协作交互时交互平板与客户终端的架构示意图;FIG. 3 is a schematic diagram of the architecture of an interactive tablet and a client terminal during collaborative interaction according to an embodiment of the present invention;

图4为在缩略图中点击截图控件的示意图;FIG. 4 is a schematic diagram of clicking a screenshot control in a thumbnail;

图5为在协作交互界面点击缩略图的示意图;FIG. 5 is a schematic diagram of clicking a thumbnail on the collaborative interaction interface;

图6为在预览图中点击截图控件的示意图;FIG. 6 is a schematic diagram of clicking the screenshot control in the preview image;

图7为本发明实施例提供的一种多人投屏的定向截屏装置的结构示意图;FIG. 7 is a schematic structural diagram of a directional screen capture device for multi-person projection according to an embodiment of the present invention;

图8为本发明实施例提供的一种电子设备的结构示意图。FIG. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention.

具体实施方式Detailed ways

下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是,此处所描述的具体实施例用于解释本发明,而非对本发明的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本发明相关的部分而非全部结构。The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are used to explain the present invention rather than limit the present invention. In addition, it should be noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings but not all structures.

需要注意的是,由于篇幅所限,本申请说明书没有穷举所有可选的实施方式,本领域技术人员在阅读本申请说明书后,应该能够想到,只要技术特征不互相矛盾,那么技术特征的任意组合均可以构成可选的实施方式。It should be noted that due to space limitations, this application description does not list all optional implementation modes. After reading this application description, those skilled in the art should be able to imagine that as long as the technical features do not contradict each other, then any of the technical features Any combination can constitute an optional embodiment.

下面对各实施例进行详细说明。Each embodiment will be described in detail below.

图1为本发明实施例提供的一种多人投屏的定向截屏方法的方法流程图,如图所示,该多人投屏的定向截屏方法,包括:Fig. 1 is a method flowchart of a directional screen capture method for multi-person projection provided by an embodiment of the present invention. As shown in the figure, the directional screen capture method for multi-person projection includes:

步骤S110:接收多个客户终端协同操作过程中,至少一个客户终端发送的投屏视频流。Step S110: Receive the screen-casting video stream sent by at least one client terminal during the coordinated operation of multiple client terminals.

会议、教学、讨论、头脑风暴等多人交互场景下,多个参与者之间的信息传递在很长一段历史时期都通过说话、视觉和听觉实现,这种信息传递能给参与者很好的沟通体验,但是对沟通过程中的信息记录依赖于参与者按个人习惯和能力进行记录,实际传递的信息可能会丢失。In conferences, teaching, discussions, brainstorming and other multi-person interaction scenarios, the transmission of information between multiple participants has been achieved through speech, vision and hearing for a long period of time. This kind of information transmission can give participants a good Communication experience, but the recording of information in the communication process relies on the participants to record according to their personal habits and abilities, and the actual information transmitted may be lost.

随着信息技术的发展,多人交互场景下的信息展示和信息记录有了更丰富的手段,尤其是基于交互平板的多人交互,每个参与者可以将需要展示的内容集中到交互平板进行展示,并且在交互平板接收和保存协作沟通过程中的各种信息。With the development of information technology, there are more means for information display and information recording in the multi-person interaction scene, especially the multi-person interaction based on the interactive tablet. Each participant can concentrate the content to be displayed on the interactive tablet. Display, and receive and save various information in the process of collaborative communication on the interactive tablet.

本方案中所说的交互平板,可以是通过触控技术对显示在显示平板上的内容进行操控和实现人机交互操作的一体化设备,其集成了投影机、电子白板、幕布、音响、电视机以及视频会议终端等一种或多种功能。The interactive panel mentioned in this solution can be an integrated device that controls the content displayed on the display panel and realizes human-computer interaction through touch technology. It integrates projectors, electronic whiteboards, curtains, audio, TV One or more functions such as machine and video conferencing terminal.

一般而言,如图2所示,交互平板11包括至少一块显示屏12。例如,交互平板11配置有一块具有触摸功能的显示屏12,且该显示屏12可以是电容屏、电阻屏或者电磁屏。在本实施例中,进一步的,用户可以通过手指或触控笔触控显示屏12的方式实现触控操作,相应的,交互平板12检测触控位置,并根据触控位置进行响应,以实现触控功能。典型的,交互平板11安装有至少一种操作系统,其中,操作系统包括但不限定于安卓系统、Linux系统及Windows系统。Generally speaking, as shown in FIG. 2 , the interactive panel 11 includes at least one display screen 12 . For example, the interactive panel 11 is configured with a display screen 12 with a touch function, and the display screen 12 may be a capacitive screen, a resistive screen or an electromagnetic screen. In this embodiment, further, the user can realize the touch operation by touching the display screen 12 with a finger or a stylus. Correspondingly, the interactive panel 12 detects the touch position and responds according to the touch position to realize touch control function. Typically, the interactive tablet 11 is installed with at least one operating system, wherein the operating system includes but not limited to Android system, Linux system and Windows system.

交互平板作为主要用于支持多人沟通场景的交互设备,其中的软件主要用于实现多人沟通场景下的功能需求。例如,交互平板可以安装至少一个具有文稿演示功能的应用程序,其中,该应用程序可以为操作系统自带的应用程序;同时,也安装有从第三方设备或者服务器中下载的应用程序。可选的,具有文稿演示功能的程序除了显示已经编辑好的内容这一基础功能,还具有其他演示过程中的编辑功能,如插入表格、插入图片、插图图形、绘制表格、绘制图形等功能,以实现信息展示过程中的用户信息输入和输入内容的实时展示,进而提高文稿演示过程中的信息展示和交互效果。例如,交互平板可以安装至少一个具有白板功能的应用程序,用户可以基于该应用程序实现多人协作沟通场景下的实时书写记录、修改和保存。The interactive tablet is an interactive device mainly used to support multi-person communication scenarios, and the software in it is mainly used to realize the functional requirements in multi-person communication scenarios. For example, the interactive tablet can install at least one application program with a document presentation function, wherein the application program can be an application program built in the operating system; meanwhile, an application program downloaded from a third-party device or server is also installed. Optionally, in addition to the basic function of displaying the edited content, the program with the presentation function also has other editing functions during the presentation process, such as inserting tables, inserting pictures, illustration graphics, drawing tables, drawing graphics, etc. In order to realize the real-time display of user information input and input content in the information display process, and further improve the information display and interaction effect in the document presentation process. For example, the interactive tablet can be installed with at least one application program with a whiteboard function, based on which the user can realize real-time writing, recording, modification and storage under the scenario of multi-person collaboration and communication.

本方案中,为进一步提高多人沟通场景下文件传递方面的便利性,交互平板可以安装一应用程序,实现对投屏画面的接收和显示,由此使用图3所示的架构支持多人沟通场景下的数据传输,即多人沟通的参与者中的一个或多个,将客户终端连接到交互平板,参与者在客户终端完成协作交互的所有操作的数据基础是协作平台。即每个参与者使用的客户终端不再仅与交互平板11进行数据传输,交互平板11也不再是多人沟通场景下唯一的数据汇集点。每个客户终端在保留与交互平板11的必要连接的同时,还需要与协作平台的数据连接,使得每个客户终端在多人沟通过程中的操作以及对应的数据都在协作平台进行全面的记录和管理,协作平台搭建于服务器。协作平台可以理解为对协作交互过程中所有操作以及对应数据进行后台管理的平台,协作交互的应用界面可以理解为后台管理平台中的数据在客户终端用于用户交互的界面。在图3所示的具体场景中,客户终端可以是个人计算机21,也可以是移动终端22,单个参与者可以只连接个人计算机21或移动终端22,也可以同时连接个人计算机21和移动终端11。在交互过程中,参与者将需要在交互平板11进行显示的内容文件发送到交互平板11,或者直接在客户终端进行显示并投屏到交互平板11进行显示。在这种架构支持下,多人沟通不再仅仅是聚焦于交互平板11的沟通,而是所有参与者在各自的客户终端进行操作,以实现更好的沟通效果,多人沟通过程也是协作交互的过程。In this solution, in order to further improve the convenience of file transfer in multi-person communication scenarios, an application program can be installed on the interactive tablet to receive and display the projected screen, thereby using the architecture shown in Figure 3 to support multi-person communication The data transmission in the scene, that is, one or more participants in the multi-person communication connects the client terminal to the interactive tablet, and the data basis for all the operations of the participants to complete the collaborative interaction on the client terminal is the collaboration platform. That is, the client terminal used by each participant no longer only performs data transmission with the interactive tablet 11, and the interactive tablet 11 is no longer the only data collection point in the multi-person communication scenario. While retaining the necessary connection with the interactive tablet 11, each client terminal also needs a data connection with the collaboration platform, so that the operation and corresponding data of each client terminal in the multi-person communication process are fully recorded on the collaboration platform and management, the collaboration platform is built on the server. The collaboration platform can be understood as a platform for background management of all operations and corresponding data in the process of collaboration interaction, and the application interface of collaboration interaction can be understood as the interface where the data in the background management platform is used for user interaction on the client terminal. In the specific scenario shown in Figure 3, the client terminal can be a personal computer 21 or a mobile terminal 22, and a single participant can only connect to the personal computer 21 or the mobile terminal 22, or can connect to the personal computer 21 and the mobile terminal 11 at the same time . During the interaction process, the participant sends the content file to be displayed on the interactive panel 11 to the interactive panel 11, or directly displays it on the client terminal and projects it to the interactive panel 11 for display. With the support of this architecture, multi-person communication is no longer just focused on the communication of the interactive tablet 11, but all participants operate on their respective client terminals to achieve better communication effects. The multi-person communication process is also a collaborative interaction the process of.

如图4所示,参与者在客户终端进行操作实现协作交互,协作交互具体包括多人沟通场景下参与者与交互平板、其它客户终端以及自身进行信息传递的所有操作。在协作交互过程中,所有和交互平板以及其他参与者之间的文件或数据收发都在一个应用界面30完成,该应用界面即为协作交互的应用界面30。在该应用界面中,具体可以实现多人沟通过程中的文件传输、文件接收、投屏发送、视频发起、视频接通、白板等操作,以及数据汇总展示等多人沟通的后续操作。As shown in Figure 4, the participants perform operations on the client terminal to realize collaborative interaction, and the collaborative interaction specifically includes all operations of information transmission between the participant and the interactive tablet, other client terminals, and itself in the multi-person communication scenario. During the collaborative interaction process, all file or data transmission and reception with the interactive tablet and other participants are completed on an application interface 30 , which is the application interface 30 for collaborative interaction. In this application interface, operations such as file transfer, file reception, screen projection sending, video initiation, video connection, whiteboard and other operations during multi-person communication can be realized, as well as follow-up operations of multi-person communication such as data summary and display.

在协作交互中,所有数据产生的用户基础是群组,一个群组中包括多个用户标识,每个用户标识分别对应一个参与者,一个用户标识可以加入到不同的群组。用户标识对应的协作交互的应用界面上,可以显示该用户标识加入的所有群组,接收第一激活操作为接收到确认当前显示哪个群组相关数据的操作。群组的信息保存在专用提供协作交互相关数据存储的服务器,该服务器中还保存有群组所有基于协作交互产生的关联数据,并用于提供各个客户终端之间的数据传输服务。In collaborative interaction, the user basis for all data generation is a group, a group includes multiple user IDs, each user ID corresponds to a participant, and a user ID can be added to different groups. All groups joined by the user ID can be displayed on the collaborative interaction application interface corresponding to the user ID, and receiving the first activation operation is an operation of confirming which group related data is currently displayed. The information of the group is stored in a server dedicated to provide data storage related to collaborative interaction. The server also stores all associated data generated by the group based on collaborative interaction, and is used to provide data transmission services between various client terminals.

客户终端的投屏是数据传输服务的重要内容,在本方案中实现多人投屏过程中的截图时,客户终端发送的投屏视频流根据不同的连接方式在不同的投屏服务端进行汇总处理。例如一种方式中,投屏服务端为交互平板,客户终端与所述交互平板通过同一局域网连接,客户终端通过局域网将投屏视频流发送到交互平板,交互平板对应也通过局域网向客户终端发送数据,整个多人协作过程中的数据由交互平板发送到位于服务器的协作平台进行统一存储管理。又例如另一种方式中,所述投屏服务端为服务器,所述客户终端与所述服务器通过广域网连接,客户终端通过广域网将投屏视频流发送到服务器,服务器对应也通过广域网向客户终端发送数据,服务器还通过广域网向交互平板发送当前投屏显示的数据,并接收多人协作过程中在交互平板生成的数据,整个多人协作过程中的数据由服务器进行统一存储管理。The screen projection of the client terminal is an important part of the data transmission service. In this solution, when screenshots are taken in the process of multi-person projection, the screen projection video stream sent by the client terminal is summarized on different screen projection servers according to different connection methods. deal with. For example, in one mode, the screen projection server is an interactive flat panel, and the client terminal and the interactive flat panel are connected through the same local area network. The client terminal sends the screen projection video stream to the interactive flat panel through the local area network, and the interactive flat panel also sends the video stream to the client terminal through the local area network. Data, the data in the entire multi-person collaboration process is sent from the interactive tablet to the collaboration platform located on the server for unified storage and management. In another example, the screen projection server is a server, and the client terminal is connected to the server through a wide area network. The client terminal sends the screen projection video stream to the server through the wide area network, and the server also sends the video stream to the client terminal through the wide area network. To send data, the server also sends the data currently displayed on the screen to the interactive tablet through the WAN, and receives the data generated on the interactive tablet during the multi-person collaboration process. The data in the entire multi-person collaboration process is stored and managed by the server in a unified manner.

步骤S120:将所述投屏视频流的缩略图发送到每个所述客户终端进行显示,所述缩略图显示于协作交互界面同一信息块,每个所述缩略图中对应显示有截图控件。Step S120: Send the thumbnail of the screen-casting video stream to each of the client terminals for display, the thumbnail is displayed in the same information block of the collaborative interaction interface, and each thumbnail is correspondingly displayed with a screenshot control.

客户终端的协作交互通过协作交互界面实现,多人协作过程中的参与者以群组的方式进行组织,每个群组对应一个群组记录界面,协作交互界面中根据当前协作交互的群组显示对应的群组记录界面,每个群组产生的数据在群组记录界面中以信息块的方式按时序显示,每个信息块中显示一个数据。如图4所示,群组记录界面33中显示有XXX项目沟通群组的相关基础信息,例如群组主题、最近修改时间,以及多个协作控件34,通过这些协作控件34,每个参与者用于支持多人沟通的协作交互都进行集中记录。例如其中的文件控件、笔记控件和白板控件,分别用户实现文件上传、笔记添加和白板书写。在现有技术中,文件上传可能要复制或在线传输到交互平板,或者在预约多用户沟通的时候上传,以作为沟通的焦点,供其他参与者提前查看;笔记添加可能要通过专有的笔记编辑应用;白板书写只能通过单独的白板软件实现。而在本方案中,所有的操作都在群组记录界面33触发,从而可以实现所有操作在群组记录界面33中的记录,当然,也包括对应数据在群组记录界面33中的记录。The collaborative interaction of the client terminal is realized through the collaborative interactive interface. Participants in the multi-person collaborative process are organized in groups. Each group corresponds to a group record interface. In the corresponding group recording interface, the data generated by each group is displayed in time series in the form of information blocks in the group recording interface, and one data is displayed in each information block. As shown in Figure 4, the relevant basic information of the XXX project communication group is displayed in the group record interface 33, such as the group theme, the latest modification time, and a plurality of collaboration controls 34. Through these collaboration controls 34, each participant Collaborative interactions used to support multi-person communication are centrally recorded. For example, the file control, note control and whiteboard control among them allow users to upload files, add notes and write on the whiteboard respectively. In the existing technology, file uploads may need to be copied or transmitted online to the interactive tablet, or uploaded when multi-user communication is reserved, as the focus of communication for other participants to view in advance; notes may be added through proprietary notes Editing application; whiteboard writing is only possible with separate whiteboard software. In this solution, all operations are triggered on the group recording interface 33 , so that all operations can be recorded on the group recording interface 33 , and of course, corresponding data can also be recorded on the group recording interface 33 .

多人交互过程,当前投屏的数据也是群组产生的数据的一种,群组在进行多人交互时,有至少一个客户终端处于投屏状态,处于投屏状态的客户终端对应的投屏视频流发送到投屏服务端之后,投屏服务端将接收到的所有视频流根据在交互平板以及客户终端的操作进行处理,其中在客户终端的基础操作是投屏服务端根据投屏视频流生成对应的缩略图之后,将缩略图发送到客户终端进行显示,缩略图中还显示有截图控件,当在截图控件检测到触发操作时,确认接收到对应指令。缩略图可以是静态的图片,也可以按一定周期根据投屏视频流更新的图像,还可以是根据投屏视频流同步实时更新的图像。In the process of multi-person interaction, the current screen projection data is also a type of data generated by the group. When the group is interacting with multiple people, at least one client terminal is in the screen projection state, and the client terminal in the screen projection state corresponds to the screen projection After the video stream is sent to the screen projection server, the screen projection server will process all the received video streams according to the operations on the interactive tablet and the client terminal. After the corresponding thumbnail is generated, the thumbnail is sent to the client terminal for display, and a screenshot control is also displayed in the thumbnail. When a trigger operation is detected in the screenshot control, it is confirmed that the corresponding instruction is received. The thumbnail can be a static picture, or an image updated according to the screen-casting video stream at a certain period, or an image synchronously updated in real time according to the screen-casting video stream.

如图4所示,假设XXX项目沟通群组在进行多人交互时,有3个客户终端处于投屏状态,每个客户终端对应的投屏视频流发送到投屏服务端之后,投屏服务端将接收到的所有投屏视频流生成对应的缩略图321,然后将缩略图321发送到客户终端进行显示,具体显示于协作交互界面30中对应的群组记录界面33的信息块32,每个缩略图321中还对一个显示有截图控件322。As shown in Figure 4, it is assumed that when the XXX project communication group is interacting with multiple people, there are three client terminals in the screen projection state. After the screen projection video stream corresponding to each client terminal is sent to the screen projection server, the screen projection service The terminal will generate corresponding thumbnails 321 for all screen-casting video streams received, and then send the thumbnails 321 to the client terminal for display, specifically displayed in the information block 32 of the corresponding group recording interface 33 in the collaborative interaction interface 30, every A screenshot control 322 is also displayed for one of the thumbnail images 321.

步骤S130:接收在所述协作交互界面触发所述截图控件生成的截图指令,获取所述截图指令对应的缩略图标识。Step S130: receiving a screenshot command generated by the screenshot control triggered on the collaborative interaction interface, and acquiring a thumbnail identifier corresponding to the screenshot command.

如图4所示,如果在投屏1对应的缩略图321中的截图控件322检测到触发操作,例如在截图控件322的显示区域检测到鼠标点击、快捷键选中、触控操作选择中的任意一种操作,即认为接收到由对应的参与者实施的触发操作。客户终端则对应生成对投屏1的截图指令,并将截图指令发送到投屏服务端,投屏服务端对应接收该截图指令,并获取截图指令对应的缩略图标识(例如投屏1)。As shown in FIG. 4, if the screenshot control 322 in the thumbnail image 321 corresponding to the projection screen 1 detects a trigger operation, for example, any mouse click, shortcut key selection, and touch operation selection are detected in the display area of the screenshot control 322. An action that is considered to have received a trigger action performed by the corresponding actor. The client terminal correspondingly generates a screenshot command for screen projection 1, and sends the screenshot command to the screen projection server, and the screen projection server receives the screenshot command and obtains the thumbnail identifier corresponding to the screenshot command (for example, screen projection 1).

在具体实现过程中,客户终端的截图指令生成可以进一步通过如下交互过程实现:In the specific implementation process, the screenshot command generation of the client terminal can be further realized through the following interactive process:

在客户终端接收在所述缩略图生成的预览指令,显示所述缩略图对应的预览图,所述截图控件在所述预览图中显示;receiving a preview instruction generated on the thumbnail at the client terminal, displaying a preview image corresponding to the thumbnail, and displaying the screenshot control in the preview image;

接收在所述预览图中触发所述截图控件生成的截图指令。and receiving a screenshot instruction that triggers generation of the screenshot control in the preview image.

如图5所示,在客户终端显示的缩略图321,可能因为显示窗口过小,用户无法清楚查看缩略图322中具体内容,此时可以通过在缩略图321的显示区域接收到的触发操作,确认接收到预览指令,响应该预览指令,在信息块32中显示缩略图321对应的预览图321’,在较大窗口内对投屏内容进行更清楚的显示,便于用户确认截图目标。截图控件322也对应调整到预览图321’中显示,截图指令继续对应在截图控件322生成。As shown in Figure 5, the thumbnail image 321 displayed on the client terminal may not be able to clearly view the specific content in the thumbnail image 322 because the display window is too small. At this time, the trigger operation received in the display area of the thumbnail image 321, After confirming that the preview instruction is received, in response to the preview instruction, the preview image 321' corresponding to the thumbnail image 321 is displayed in the information block 32, and the projected screen content is displayed more clearly in a larger window, which is convenient for the user to confirm the screenshot target. The screenshot control 322 is also correspondingly adjusted to be displayed in the preview image 321', and the screenshot instruction continues to be correspondingly generated in the screenshot control 322.

步骤S140:根据所述缩略图标识从对应的投屏视频流截取帧图像,将所述帧图像发送到请求终端进行显示,所述请求终端为发送所述截图指令的客户终端。Step S140: Capture a frame image from the corresponding screen-casting video stream according to the thumbnail identifier, and send the frame image to a requesting terminal for display. The requesting terminal is the client terminal that sends the screenshot instruction.

根据缩略图标识确认对应的投屏视频流,然后从投屏视频流中截取帧图像,具体的截图、发送和显示过程通过现有图像处理和传输的技术即可实现,在此不对截图和传输过程进行底层说明。Confirm the corresponding screen-casting video stream according to the thumbnail logo, and then intercept the frame image from the screen-casting video stream. The specific screenshot, sending and display process can be realized through the existing image processing and transmission technology, and the screenshot and transmission are not mentioned here. The process is described at the bottom level.

考虑到是截取另一个参与者的投屏内容,为保证信息的保护,在执行步骤S140之前,进一步通过如下步骤进行截图确认:Considering that it is intercepting another participant's screen projection content, in order to ensure the protection of information, before performing step S140, further confirm the screenshot through the following steps:

根据所述截图指令生成截图请求,将所述截图请求发送到所述缩略图标识对应的客户终端,以在所述协作交互界面显示;Generate a screenshot request according to the screenshot instruction, and send the screenshot request to the client terminal corresponding to the thumbnail identifier for display on the collaborative interaction interface;

确认在所述协作交互界面接收到对所述截图请求的确认操作。Acknowledging that the confirmation operation for the screenshot request is received on the collaborative interaction interface.

即投屏服务端在接收到截图指令之后,对应生成截图请求发送到缩略图标识对应的客户终端,也就是截图的目标客户终端,在确认接收到该客户终端的确认操作之后,再进行截图和发送。That is, after receiving the screenshot command, the screen projection server generates a screenshot request and sends it to the client terminal corresponding to the thumbnail logo, that is, the target client terminal of the screenshot. After confirming that the client terminal has received the confirmation operation, the screenshot and send.

适应于本方案中基于协作交互界面的多人协作设计,截图也是协作交互过程中生成的数据,对应接收到的帧图像也显示于协作交互界面新建的信息块。Adapted to the multi-person collaborative design based on the collaborative interactive interface in this solution, the screenshot is also the data generated during the collaborative interactive process, and the corresponding received frame image is also displayed in the newly created information block of the collaborative interactive interface.

所述帧图像在所述请求终端登录的用户标识对应的存储空间中按时序保存;所述用户标识在客户终端登录时,对应的存储空间中的数据在所述协作交互界面按时序在对应的信息块中显示。在群组协作交互中,对数据的处理可能是一个连续的过程,例如白板输入,会不断输入,直至输入没有必要或者沟通过程结束。那么在这一过程中,仅生成一个白板文件,并将白板文件记录到一个对应的信息块,信息块在群组记录中按时序记录。基于此,已经实现了协作交互过程中数据的全流程有序记录,用户通过访问协作交互的应用界面,即可快速获得依次多用户沟通的所有沟通过程行为以及对应产生的数据,缩短了文件流转过程中冗长的操作链路,提高了信息流转的效率。The frame image is saved in time sequence in the storage space corresponding to the user ID requesting the terminal to log in; when the user ID logs in at the client terminal, the data in the corresponding storage space is stored in the corresponding storage space in time sequence on the collaborative interaction interface. displayed in the information block. In group collaborative interaction, the processing of data may be a continuous process, such as whiteboard input, which will continue to be input until the input is unnecessary or the communication process ends. Then in this process, only one whiteboard file is generated, and the whiteboard file is recorded into a corresponding information block, and the information blocks are recorded in time sequence in the group record. Based on this, the entire process of data in the process of collaborative interaction has been recorded in an orderly manner. By accessing the application interface of collaborative interaction, users can quickly obtain all communication process behaviors and corresponding data generated by sequential multi-user communication, which shortens file circulation. The lengthy operation link in the process improves the efficiency of information flow.

上述方法,用于投屏服务端,包括:接收多个客户终端协同操作过程中,至少一个客户终端发送的投屏视频流;将所述投屏视频流的缩略图发送到每个所述客户终端进行显示,所述缩略图显示于协作交互界面同一信息块,每个所述缩略图中对应显示有截图控件;接收在所述协作交互界面触发所述截图控件生成的截图指令,获取所述截图指令对应的缩略图标识;根据所述缩略图标识从对应的投屏视频流截取帧图像,将所述帧图像发送到请求终端进行显示,所述请求终端为发送所述截图指令的客户终端。通过投屏服务端将投屏视频流发送到每个客户终端以缩略图的方式进行预览显示,用户通过缩略图中的截图控件发送截图指令,投屏服务端根据截图指令截取对应的帧图像发送到对应客户终端,实现了用户在客户终端对多路投屏的定向自主截屏。The above method is used for the screen projection server, including: receiving the screen projection video stream sent by at least one client terminal during the cooperative operation of multiple client terminals; sending the thumbnail of the screen projection video stream to each of the clients The terminal displays, the thumbnails are displayed in the same information block of the collaborative interaction interface, and a screenshot control is correspondingly displayed in each of the thumbnails; receiving a screenshot instruction that triggers the generation of the screenshot control on the collaborative interaction interface, and obtaining the The thumbnail identification corresponding to the screenshot instruction; according to the thumbnail identification, the frame image is intercepted from the corresponding screen-casting video stream, and the frame image is sent to the requesting terminal for display, and the requesting terminal is the client terminal that sends the screenshot instruction . The screen-casting server sends the screen-casting video stream to each client terminal for preview display in the form of a thumbnail, the user sends a screenshot command through the screenshot control in the thumbnail, and the screen-casting server captures the corresponding frame image according to the screenshot command and sends it To the corresponding client terminal, it realizes the directional and autonomous screen capture of the multi-channel projection screen by the user on the client terminal.

图7为本发明实施例提供的一种多人投屏的定向截屏装置的结构示意图。参考图7,该多人投屏的定向截屏装置包括:视频流接收单元210、缩略图发送单元220、截图指令接收单元230和截图发送单元240。FIG. 7 is a schematic structural diagram of a directional screen capture device for multi-person projection according to an embodiment of the present invention. Referring to FIG. 7 , the directional screenshot device for multi-person projection includes: a video stream receiving unit 210 , a thumbnail image sending unit 220 , a screenshot instruction receiving unit 230 and a screenshot sending unit 240 .

其中,视频流接收单元210,用于接收多个客户终端协同操作过程中,至少一个客户终端发送的投屏视频流;缩略图发送单元220,用于将所述投屏视频流的缩略图发送到每个所述客户终端进行显示,所述缩略图显示于协作交互界面同一信息块,每个所述缩略图中对应显示有截图控件;截图指令接收单元230,用于接收在所述协作交互界面触发所述截图控件生成的截图指令,获取所述截图指令对应的缩略图标识;截图发送单元240,用于根据所述缩略图标识从对应的投屏视频流截取帧图像,将所述帧图像发送到请求终端进行显示,所述请求终端为发送所述截图指令的客户终端。Among them, the video stream receiving unit 210 is used to receive the screen-casting video stream sent by at least one client terminal during the cooperative operation of multiple client terminals; the thumbnail image sending unit 220 is used to send the thumbnail image of the screen-casting video stream Each of the client terminals is displayed, and the thumbnails are displayed in the same information block of the collaborative interaction interface, and a screenshot control is correspondingly displayed in each of the thumbnails; the screenshot instruction receiving unit 230 is configured to receive The interface triggers the screenshot instruction generated by the screenshot control to obtain the thumbnail identifier corresponding to the screenshot instruction; the screenshot sending unit 240 is configured to intercept a frame image from the corresponding screen-casting video stream according to the thumbnail identifier, and send the frame The image is sent to the requesting terminal for display, and the requesting terminal is the client terminal that sends the screenshot instruction.

在上述实施例的基础上,所述截图指令通过如下方式生成:On the basis of the foregoing embodiments, the screenshot instruction is generated in the following manner:

在客户终端接收在所述缩略图生成的预览指令,显示所述缩略图对应的预览图,所述截图控件在所述预览图中显示;receiving a preview instruction generated on the thumbnail at the client terminal, displaying a preview image corresponding to the thumbnail, and displaying the screenshot control in the preview image;

接收在所述预览图中触发所述截图控件生成的截图指令。and receiving a screenshot instruction that triggers generation of the screenshot control in the preview image.

在上述实施例的基础上,所述装置,还包括:On the basis of the foregoing embodiments, the device further includes:

截图请求发送单元,用于根据所述截图指令生成截图请求,将所述截图请求发送到所述缩略图标识对应的客户终端,以在所述协作交互界面显示;A screenshot request sending unit, configured to generate a screenshot request according to the screenshot instruction, and send the screenshot request to the client terminal corresponding to the thumbnail identifier for display on the collaborative interaction interface;

截图操作确认单元,用于确认在所述协作交互界面接收到对所述截图请求的确认操作。A screenshot operation confirming unit, configured to confirm that a confirmation operation for the screenshot request is received on the collaborative interaction interface.

在上述实施例的基础上所述帧图像显示于所述协作交互界面新建的信息块。On the basis of the above embodiments, the frame image is displayed on the newly created information block of the collaborative interaction interface.

在上述实施例的基础上,所述帧图像在所述请求终端登录的用户标识对应的存储空间中按时序保存;On the basis of the above embodiments, the frame images are saved in time sequence in the storage space corresponding to the user ID requesting terminal login;

所述用户标识在客户终端登录时,对应的存储空间中的数据在所述协作交互界面按时序在对应的信息块中显示。When the user ID logs in at the client terminal, the data in the corresponding storage space is displayed in the corresponding information block in time sequence on the collaborative interaction interface.

在上述实施例的基础上,所述投屏服务端为交互平板,所述客户终端与所述交互平板通过同一局域网连接。On the basis of the above embodiments, the screen projection server is an interactive tablet, and the client terminal and the interactive tablet are connected through the same local area network.

在上述实施例的基础上,所述投屏服务端为服务器,所述客户终端与所述服务器通过广域网连接。On the basis of the above embodiments, the screen projection server is a server, and the client terminal is connected to the server through a wide area network.

本发明实施例提供的多人投屏的定向截屏装置包含在电子设备中,且可用于执行上述实施例中提供的任一多人投屏的定向截屏方法,具备相应的功能和有益效果。The directional screen capture device for multi-person projection provided by the embodiment of the present invention is included in an electronic device, and can be used to execute any directional screen capture method for multi-person projection provided in the above embodiments, and has corresponding functions and beneficial effects.

值得注意的是,上述多人投屏的定向截屏装置的实施例中,所包括的各个单元和模块只是按照功能逻辑进行划分的,但并不局限于上述的划分,只要能够实现相应的功能即可;另外,各功能单元的具体名称也只是为了便于相互区分,并不用于限制本发明的保护范围。It is worth noting that, in the embodiment of the above-mentioned directional screen-capturing device for multi-person projection, the units and modules included are only divided according to functional logic, but are not limited to the above-mentioned divisions, as long as the corresponding functions can be realized. Yes; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present invention.

图8为本发明实施例提供的一种电子设备的结构示意图。如图8所示,该电子设备包括处理器310、存储器320、输入装置330、输出装置340以及通信装置350;电子设备中处理器310的数量可以是一个或多个,图8中以一个处理器310为例;电子设备中的处理器310、存储器320、输入装置330、输出装置340以及通信装置350可以通过总线或其他方式连接,图8中以通过总线连接为例。FIG. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. As shown in Figure 8, the electronic device includes a processor 310, a memory 320, an input device 330, an output device 340, and a communication device 350; The processor 310 is taken as an example; the processor 310, memory 320, input device 330, output device 340, and communication device 350 in the electronic device can be connected via a bus or in other ways. In FIG. 8, the connection via a bus is taken as an example.

存储器320作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序以及模块,如本发明实施例中的多人投屏的定向截屏方法对应的程序指令/模块(例如,多人投屏的定向截屏装置中的视频流接收单元210、缩略图发送单元220、截图指令接收单元230和截图发送单元240)。处理器310通过运行存储在存储器320中的软件程序、指令以及模块,从而执行电子设备的各种功能应用以及数据处理,即实现上述的多人投屏的定向截屏方法。The memory 320, as a computer-readable storage medium, can be used to store software programs, computer-executable programs and modules, such as program instructions/modules corresponding to the directional screenshot method of multi-person projection in the embodiment of the present invention (for example, multi-person The video stream receiving unit 210, the thumbnail image sending unit 220, the screenshot command receiving unit 230 and the screenshot sending unit 240 in the directional screen capture device for screen projection). The processor 310 executes various functional applications and data processing of the electronic device by running the software programs, instructions and modules stored in the memory 320 , that is, realizes the above-mentioned directional screen capture method of multi-person screen projection.

存储器320可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据电子设备的使用所创建的数据等。此外,存储器320可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中,存储器320可进一步包括相对于处理器310远程设置的存储器,这些远程存储器可以通过网络连接至电子设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 320 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the electronic device, and the like. In addition, the memory 320 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices. In some examples, the memory 320 may further include memory located remotely relative to the processor 310, and these remote memories may be connected to the electronic device through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

输入装置330可用于接收输入的数字或字符信息,以及产生与电子设备的用户设置以及功能控制有关的键信号输入。输出装置340可包括显示屏等显示设备。The input device 330 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the electronic device. The output device 340 may include a display device such as a display screen.

上述电子设备包含多人投屏的定向截屏装置,可以用于执行任意多人投屏的定向截屏方法,具备相应的功能和有益效果。The above-mentioned electronic equipment includes a directional screen capture device for multi-person projection, which can be used to execute any directional screen capture method for multi-person projection, and has corresponding functions and beneficial effects.

本发明实施例还提供一种包含计算机可执行指令的存储介质,所述计算机可执行指令在由计算机处理器执行时用于执行本申请任意实施例中提供的多人投屏的定向截屏方法中的相关操作,且具备相应的功能和有益效果。An embodiment of the present invention also provides a storage medium containing computer-executable instructions, and the computer-executable instructions are used to perform the directional screen capture method for multi-person projection provided in any embodiment of the present application when executed by a computer processor related operations, and have corresponding functions and beneficial effects.

本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein. The present application is described with reference to flowcharts and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram. These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram. These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow chart or blocks of the flowchart and/or the block or blocks of the block diagrams.

在一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。存储器可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。存储器是计算机可读介质的示例。In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. Memory may include non-permanent storage in computer readable media, in the form of random access memory (RAM) and/or nonvolatile memory such as read only memory (ROM) or flash RAM. The memory is an example of a computer readable medium.

计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体(transitory media),如调制的数据信号和载波。Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridge, tape magnetic disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media excludes transitory computer-readable media, such as modulated data signals and carrier waves.

还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes Other elements not expressly listed, or elements inherent in the process, method, commodity, or apparatus are also included. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

注意,上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解,本发明不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此,虽然通过以上实施例对本发明进行了较为详细的说明,但是本发明不仅仅限于以上实施例,在不脱离本发明构思的情况下,还可以包括更多其他等效实施例,而本发明的范围由所附的权利要求范围决定。Note that the above are only preferred embodiments of the present invention and applied technical principles. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, rearrangements and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present invention, and the present invention The scope is determined by the scope of the appended claims.

Claims (10)

1.一种多人投屏的定向截屏方法,用于投屏服务端,其特征在于,包括:1. A directional screen capture method for multi-person screen projection, used for screen projection server, is characterized in that, comprising: 接收多个客户终端协同操作过程中,至少一个客户终端发送的投屏视频流;Receive the screen-casting video stream sent by at least one client terminal during the collaborative operation of multiple client terminals; 将所述投屏视频流的缩略图发送到每个所述客户终端进行显示,所述缩略图显示于协作交互界面同一信息块,每个所述缩略图中对应显示有截图控件;Sending the thumbnail of the screen-casting video stream to each of the client terminals for display, the thumbnail is displayed in the same information block of the collaborative interactive interface, and each of the thumbnails is correspondingly displayed with a screenshot control; 接收在所述协作交互界面触发所述截图控件生成的截图指令,获取所述截图指令对应的缩略图标识;receiving a screenshot instruction generated by triggering the screenshot control on the collaborative interaction interface, and acquiring a thumbnail identifier corresponding to the screenshot instruction; 根据所述缩略图标识从对应的投屏视频流截取帧图像,将所述帧图像发送到请求终端进行显示,所述请求终端为发送所述截图指令的客户终端。Capture a frame image from the corresponding screen-casting video stream according to the thumbnail identifier, and send the frame image to a requesting terminal for display, and the requesting terminal is the client terminal that sends the screenshot instruction. 2.根据权利要求1所述的方法,其特征在于,所述截图指令通过如下方式生成:2. The method according to claim 1, wherein the screenshot instruction is generated in the following manner: 在客户终端接收在所述缩略图生成的预览指令,显示所述缩略图对应的预览图,所述截图控件在所述预览图中显示;receiving a preview instruction generated on the thumbnail at the client terminal, displaying a preview image corresponding to the thumbnail, and displaying the screenshot control in the preview image; 接收在所述预览图中触发所述截图控件生成的截图指令。and receiving a screenshot instruction that triggers generation of the screenshot control in the preview image. 3.根据权利要求1所述的方法,其特征在于,所述根据所述缩略图标识从对应的投屏视频流截取帧图像,将所述帧图像发送到请求终端进行显示之前,还包括:3. The method according to claim 1, wherein the step of intercepting a frame image from the corresponding screen-casting video stream according to the thumbnail identification, and sending the frame image to the requesting terminal for displaying, further includes: 根据所述截图指令生成截图请求,将所述截图请求发送到所述缩略图标识对应的客户终端,以在所述协作交互界面显示;Generate a screenshot request according to the screenshot instruction, and send the screenshot request to the client terminal corresponding to the thumbnail identifier for display on the collaborative interaction interface; 确认在所述协作交互界面接收到对所述截图请求的确认操作。Acknowledging that the confirmation operation for the screenshot request is received on the collaborative interaction interface. 4.根据权利要求1所述的方法,其特征在于,所述帧图像显示于所述协作交互界面新建的信息块。4. The method according to claim 1, wherein the frame image is displayed on a newly created information block of the collaborative interaction interface. 5.根据权利要求4所述的方法,其特征在于,所述帧图像在所述请求终端登录的用户标识对应的存储空间中按时序保存;5. The method according to claim 4, wherein the frame images are saved in time sequence in the storage space corresponding to the user ID requesting terminal login; 所述用户标识在客户终端登录时,对应的存储空间中的数据在所述协作交互界面按时序在对应的信息块中显示。When the user ID logs in at the client terminal, the data in the corresponding storage space is displayed in the corresponding information block in time sequence on the collaborative interaction interface. 6.根据权利要求1所述的方法,其特征在于,所述投屏服务端为交互平板,所述客户终端与所述交互平板通过同一局域网连接。6. The method according to claim 1, wherein the screen projection server is an interactive tablet, and the client terminal and the interactive tablet are connected through the same local area network. 7.根据权利要求1所述的方法,其特征在于,所述投屏服务端为服务器,所述客户终端与所述服务器通过广域网连接。7. The method according to claim 1, wherein the screen projection server is a server, and the client terminal is connected to the server through a wide area network. 8.一种多人投屏的定向截屏装置,用于投屏服务端,其特征在于,包括:8. A directional screen capture device for multi-person screen projection, used for screen projection server, characterized in that it includes: 视频流接收单元,用于接收多个客户终端协同操作过程中,至少一个客户终端发送的投屏视频流;The video stream receiving unit is used to receive the projection video stream sent by at least one client terminal during the collaborative operation of multiple client terminals; 缩略图发送单元,用于将所述投屏视频流的缩略图发送到每个所述客户终端进行显示,所述缩略图显示于协作交互界面同一信息块,每个所述缩略图中对应显示有截图控件;A thumbnail image sending unit, configured to send the thumbnail image of the projected screen video stream to each of the client terminals for display, the thumbnail images are displayed in the same information block of the collaborative interaction interface, and each of the thumbnail images is correspondingly displayed There is a screenshot control; 截图指令接收单元,用于接收在所述协作交互界面触发所述截图控件生成的截图指令,获取所述截图指令对应的缩略图标识;A screenshot instruction receiving unit, configured to receive a screenshot instruction generated by triggering the screenshot control on the collaborative interaction interface, and obtain a thumbnail identifier corresponding to the screenshot instruction; 截图发送单元,用于根据所述缩略图标识从对应的投屏视频流截取帧图像,将所述帧图像发送到请求终端进行显示,所述请求终端为发送所述截图指令的客户终端。A screenshot sending unit, configured to intercept a frame image from the corresponding screen-casting video stream according to the thumbnail identifier, and send the frame image to a requesting terminal for display, and the requesting terminal is the client terminal sending the screenshot instruction. 9.一种电子设备,其特征在于,包括:9. An electronic device, characterized in that it comprises: 一个或多个处理器;one or more processors; 存储器,用于存储一个或多个程序;memory for storing one or more programs; 当所述一个或多个程序被所述一个或多个处理器执行,使得所述交互平板实现如权利要求1-7任一所述的多人投屏的定向截屏方法。When the one or more programs are executed by the one or more processors, the interactive tablet realizes the directional screen capture method for multi-person projection according to any one of claims 1-7. 10.一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现如权利要求1-7任一所述的多人投屏的定向截屏方法。10. A computer-readable storage medium, on which a computer program is stored, characterized in that, when the program is executed by a processor, the directional screen capture method for multi-person projection according to any one of claims 1-7 is implemented.
CN202111369850.5A 2021-11-18 2021-11-18 Directional screen capturing method and device for multi-user screen projection, electronic equipment and storage medium Active CN116136785B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111369850.5A CN116136785B (en) 2021-11-18 2021-11-18 Directional screen capturing method and device for multi-user screen projection, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111369850.5A CN116136785B (en) 2021-11-18 2021-11-18 Directional screen capturing method and device for multi-user screen projection, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN116136785A true CN116136785A (en) 2023-05-19
CN116136785B CN116136785B (en) 2025-11-11

Family

ID=86334293

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111369850.5A Active CN116136785B (en) 2021-11-18 2021-11-18 Directional screen capturing method and device for multi-user screen projection, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116136785B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120177130A1 (en) * 2010-12-10 2012-07-12 Delta Vidyo Inc. Video stream presentation system and protocol
CN106471802A (en) * 2014-09-09 2017-03-01 谷歌公司 Real-time video transformation in video conferencing
CN108023926A (en) * 2017-09-19 2018-05-11 上海优熠电子科技有限公司 Courseware content controls dissemination system
CN108491131A (en) * 2018-01-19 2018-09-04 广州视源电子科技股份有限公司 Operation method and device of intelligent interaction panel and intelligent interaction panel
CN108933965A (en) * 2017-05-26 2018-12-04 腾讯科技(深圳)有限公司 screen content sharing method, device and storage medium
CN113194278A (en) * 2021-03-23 2021-07-30 视联动力信息技术股份有限公司 Conference control method and device and computer readable storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120177130A1 (en) * 2010-12-10 2012-07-12 Delta Vidyo Inc. Video stream presentation system and protocol
CN106471802A (en) * 2014-09-09 2017-03-01 谷歌公司 Real-time video transformation in video conferencing
CN108933965A (en) * 2017-05-26 2018-12-04 腾讯科技(深圳)有限公司 screen content sharing method, device and storage medium
CN108023926A (en) * 2017-09-19 2018-05-11 上海优熠电子科技有限公司 Courseware content controls dissemination system
CN108491131A (en) * 2018-01-19 2018-09-04 广州视源电子科技股份有限公司 Operation method and device of intelligent interaction panel and intelligent interaction panel
CN113194278A (en) * 2021-03-23 2021-07-30 视联动力信息技术股份有限公司 Conference control method and device and computer readable storage medium

Also Published As

Publication number Publication date
CN116136785B (en) 2025-11-11

Similar Documents

Publication Publication Date Title
US11140106B2 (en) Method, device and storage medium for interactive message in video page
US20240155177A1 (en) Synchronizing video content among clients in a collaboration system
CN107659416B (en) Conference record sharing method and device, conference terminal and storage medium
KR101934932B1 (en) Network training recording and playback method and system
CN107534704B (en) An information processing method, device and medium connected via a communication network
CN111580764B (en) Screen sharing method, device, device and storage medium of intelligent interactive flat panel
CN106572139B (en) Multi-terminal control method, terminal, server and system
CN110198478B (en) Interactive recording and broadcasting method, system, client, device, equipment and storage medium
CN116980391B (en) File transmission method, device, electronic device and storage medium
CN114071170B (en) A method and device for webcast interaction
CN107862034A (en) Method, device and equipment for rapidly saving files and storage medium
CN116136785B (en) Directional screen capturing method and device for multi-user screen projection, electronic equipment and storage medium
US20250335514A1 (en) Document display method and device related thereto
CN114969580B (en) Conference content recording method, device, conference system and storage medium
CN117792810A (en) Window sharing method, device, electronic device and storage medium
JP2016099773A (en) Terminal device, playback method, program, and screen sharing system
CN116743953A (en) Method, device, medium and computer program product for displaying online conference interface
CN116266085A (en) Window display method and device for collaborative interaction, electronic equipment and storage medium
CN116266092A (en) Collaborative interaction method, device, electronic device and storage medium
CN116974779A (en) Cross-equipment screenshot method and device, electronic equipment and storage medium
CN116648696A (en) Collaborative information display control method, electronic device and storage medium
CN117896353A (en) Teleconference opening method, terminal device and storage medium
CN119383365A (en) Remote classroom live broadcast method, system, storage medium and electronic device
CN116339590A (en) Information window display method and device for multiple data sources, flat panel and storage medium
HK40086456A (en) Image processing method, device, equipment and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant