WO2018120448A1 - Method and apparatus for controlling large-screen display device - Google Patents
Method and apparatus for controlling large-screen display device Download PDFInfo
- Publication number
- WO2018120448A1 WO2018120448A1 PCT/CN2017/077306 CN2017077306W WO2018120448A1 WO 2018120448 A1 WO2018120448 A1 WO 2018120448A1 CN 2017077306 W CN2017077306 W CN 2017077306W WO 2018120448 A1 WO2018120448 A1 WO 2018120448A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display
- touch
- smart pen
- display screen
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
Definitions
- Embodiments of the present invention relate to the field of computer technologies, and in particular, to a control method and a control apparatus for a large-screen display device.
- a display device with a display screen exceeding 50 inches can be called a large screen display device.
- Large-screen display devices can be used for office, teaching, and publicity. For example, a video conferencing device or a teaching playback device.
- the display screen only displays the display interface of the application, so that the user can perform the operation, and the functions of other applications cannot be performed at this time.
- the display interface all becomes a whiteboard interface, and the user can perform operations such as writing in the interface.
- the user wants to call other functions, he needs to close the whiteboard interface before performing other operations.
- an embodiment of the present invention provides a control method and a control device for a large-screen display device, so as to implement a display interface for simultaneously displaying a plurality of application functions when a large-screen display device is used.
- an embodiment of the present invention provides a control method for a large-screen display device, including:
- a corresponding touch operation is obtained in the display frame.
- the embodiment of the present invention further provides a control device for a large-screen display device, including:
- a masking module for popping a mask layer on the display screen according to the touch request
- a trajectory acquiring module configured to acquire at least one touch trajectory of the smart pen on the smear layer
- a display box ejecting module configured to pop up a display frame corresponding to the touch track on the display screen
- An operation obtaining module is configured to obtain a corresponding touch operation in the display frame.
- the control method and the control device for the large-screen display device provided by the embodiment of the present invention, by acquiring the touch request of the smart pen on the display screen, popping the mask layer on the display screen, and according to the smart pen touching on the mask layer At least one touch track, a display frame corresponding to the touch track is popped up on the display screen, and a corresponding touch operation method is obtained in the display frame, so that the touch operation is performed on the plurality of display frames in the display device by using the smart pen
- the technical effect is convenient for the user to delimit the display area of the display frame in the display screen according to his actual needs, and does not need to exit the display interface of the currently executing application.
- FIG. 1 is a flowchart of a control method for a large-screen display device according to Embodiment 1 of the present invention
- FIG. 2a is a flowchart of a method for controlling a large-screen display device according to Embodiment 2 of the present invention
- FIG. 2b is a flowchart of a method for closing a mask layer according to Embodiment 2 of the present invention.
- FIG. 2c is a schematic diagram of a display screen according to Embodiment 2 of the present invention.
- FIG. 2 is a schematic diagram of a display screen with a mask layer according to Embodiment 2 of the present invention
- FIG. 2 e is a schematic diagram of a display screen with a virtual rectangular frame according to Embodiment 2 of the present invention.
- FIG. 2f is a schematic diagram of a display screen with a surface view according to Embodiment 2 of the present invention.
- FIG. 3 is a schematic structural diagram of a control apparatus for a large-screen display device according to Embodiment 3 of the present invention.
- FIG. 1 is a flowchart of a method for controlling a large-screen display device according to Embodiment 1 of the present invention. This embodiment is applicable to the case where at least one display frame is simultaneously displayed on the display screen of the large-screen display device.
- the control method for the large-screen display device provided by the embodiment may be performed by a control device for a large-screen display device, and the control device may be implemented by software and/or hardware and integrated in the large-screen display device.
- control method for a large-screen display device specifically includes:
- the display device is a smart device with a touch screen, such as a teaching play device, a video conference device, and the like in a large screen display device.
- the touch request of the smart pen on the display screen is a request by the user to perform a touch operation on the display area by the smart pen.
- the display device and the smart pen are connected in advance through infrared, Bluetooth, wireless hotspot or wireless local area network, and can perform data interaction after synchronization.
- the user can operate the setting button of the smart pen to issue a touch request, wherein the setting button can be operated by clicking the button, double clicking the button, or long pressing the button.
- the setting button of the smart pen receives the user operation, a corresponding button signal is generated, and the button signal is sent to the display device, and the display device determines whether the signal corresponding to the touch request is determined by parsing the button signal.
- the mask covers the current display.
- the mask can cover all of the display screens and can also be overlaid on some of the display screens.
- a mask covering all of the display screens is popped up on the display screen.
- a mask layer is popped up on the display screen where no image is displayed on the display screen.
- the transparency, fill pattern, and color of the mask can be set according to the actual situation.
- the pop-up mask is equivalent to locking the current display. After the mask is popped up, the user confirms that the touch track can be entered.
- the touch position is obtained, thereby acquiring the touch track.
- the smart pen can input at least one touch track.
- multiple touch tracks can be input at the same time, or one touch track can be input, and another touch track can be input.
- the plurality of touch trajectories do not overlap each other, and if there are overlapping touch trajectories, the mutually overlapping touch trajectories are defaulted to the same touch trajectory.
- the specific form of the touch track is not limited in this embodiment, and may be a diagonal, a circle, a rectangle, or a triangle.
- the touch trajectory is acquired, it is impossible to discriminate whether or not the touch operation is issued by the smart pen based only on the touch operation on the smear layer. Therefore, when the touch operation is acquired, the synchronization signal of the smart pen is synchronously received, and the touch operation is determined according to the synchronization signal as a touch operation issued by the smart pen.
- the specific manner in which the smart pen sends a synchronization signal is not limited in this embodiment. For example, when it is detected that a certain button of the smart pen is continuously pressed, it is confirmed that the synchronization signal is received. For another example, when it is detected that the pressure value received by the pressure sensor provided on the tip of the smart pen is higher than a preset value, it is confirmed that the synchronization signal is received.
- the touch operation may not be the touch operation issued by the smart pen. At this time, the user may be prompted to use the smart pen to perform the touch operation, if it is not received within a certain period of time Synchronize the signal to turn off the mask.
- the mask is closed.
- the mask close command is received after the mask is popped, the mask is turned off according to the mask close command, and thereafter, the acquired touch track defaults to the user's operation on the current application display screen.
- a display frame corresponding to the touch track is popped up on the display screen.
- the corresponding display frame is determined according to each touch track, and the display is popped up in the display screen. Frame while closing the mask.
- the pop-up position of the display frame is the same as the capture position of the touch track.
- the determining whether the display frame meets the pop-up condition may be determining whether the size of the display frame satisfies the preset display frame size, or determining whether the display frame pop-up position already has a pop-up display frame.
- the display frame popped up on the display screen is located on the same display layer as the mask layer, that is, over the current display screen, and can also be understood as floating display of the display frame on the display screen.
- the display frame can be a surface view rectangular view frame.
- the advantage of using the surfaceview rectangular view box is that the function implementation in the display box does not affect the implementation of the functions in the main thread, and the response speed is accelerated when the functions of multiple applications are simultaneously implemented.
- a display screen that needs to execute an application is displayed in the display box, and a touch operation corresponding to the application is acquired.
- the executable application can be determined according to the actual needs of the user, such as an electronic whiteboard, a calculator, a screenshot application, and a timer.
- the application corresponding to the display frame needs to be input together, or after the display frame is popped up, the application list appears in the set position of the display screen, and after obtaining the application selected by the user, determining the display The application that the box needs to execute. For example, if the user issues a touch command through the setting button of the smart pen and turns on the electronic whiteboard application, the display device displays the display screen of the electronic whiteboard in the pop-up display box. For another example, after the display box is popped up, the application list is displayed in the display box, and after the selection instruction is acquired, the application display screen corresponding to the selection instruction is displayed in the display box.
- display The display area of the non-display frame continues to display the original display and continues to execute the original application. That is, the function of simultaneously responding to multiple applications in the display device is realized.
- the display device needs to synchronously acquire a signal sent by the smart pen to determine that the touch operation is an operation issued by the smart pen.
- the corresponding display frame is closed.
- the exit instruction is an instruction to close the display box, and the specific operation rule may be set according to actual conditions. For example, when detecting that the user clicks the exit button in the display box through the smart pen, it is determined that the exit instruction is detected. For another example, when it is detected that the user clicks the setting button of the interactive smart pen, it is determined that the exit instruction is detected.
- the user can use the large-screen display device to perform a video conference.
- the sales plan of the product is displayed in the display screen
- the calculator is to be used to calculate the sales amount
- the user can use the smart pen directly after using the control method provided in this embodiment.
- the technical solution provided by the embodiment provides a touch request on the display screen by acquiring a touch request of the smart pen, and pops up corresponding to the touch track on the display screen according to at least one touch track of the smart pen.
- the technical means for obtaining a corresponding touch operation in the display box realizes the technical effect of performing a touch operation on a plurality of display frames in the display device by using the smart pen, which facilitates the user to draw in the display screen according to his actual needs.
- the display area of the display box is fixed, and the desired application is opened in the display box, and the display interface of the currently executing application does not need to be exited.
- FIG. 2a is a flowchart of a method for controlling a large-screen display device according to Embodiment 2 of the present invention. This embodiment is embodied on the basis of the above embodiment. Referring to FIG. 2a, the control method provided in this embodiment specifically includes:
- the specific form of the first button signal is not limited in this embodiment.
- the first button signal is a signal generated when the setting button of the smart pen is pressed, and at this time, the signal carries information that the setting button is pressed. If the display device parses the acquired signal, and obtains information including that the set button is pressed in the signal, the signal is determined as the first button signal.
- S205 Determine whether the second button signal of the smart pen is synchronously received. If the second key signal of the smart pen is synchronously received, S207 is performed. Otherwise, S206.
- the display device when the touch track is acquired on the mask layer, the display device only responds to the touch track sent by the smart pen, and the other touch tracks do not respond. Therefore, it is necessary to determine whether the touch track is a touch track issued by the smart pen.
- the specific manner of determining may be whether the second button signal of the smart pen is synchronously received, wherein the specific form of the second button signal may be related to the specific form of the first button signal. Same, it can be different.
- S204 and S205 are performed synchronously. That is, when the display device acquires at least one touch track on the mask, it is determined whether the second button signal of the smart pen is synchronously received. Wherein, when the smart pen performs a touch operation on the mask layer, the display device can immediately detect the touch operation, and when the smart pen sends the second button signal, the display device needs to acquire the second button signal and analyze, so the display device first A touch operation is detected and then a second key signal is received. At this time, a time interval may be set. When the touch operation is detected, if the second button signal is received within the time interval, it is confirmed that the second button signal of the smart pen is synchronously received. If the second button signal is not received within the time interval, it is confirmed that the second button signal of the smart pen is not synchronously received.
- a prompt box may pop up to prompt the user that the current touch track is unrecognizable. Please input the touch track using a synchronized smart pen.
- the operation area is a virtual display frame generated according to the touch track, that is, an area where the display frame is subsequently popped up.
- the current operating area is displayed in real time in the display screen according to the touch track received in real time, so that the user determines the size and position of the display frame during the touch process.
- the operation area may be displayed in the form of a dotted rectangle in the current mask, or may be displayed in a rectangular frame of different fill colors in the current mask.
- connection line between the first point of the touch track and the current point may be used as a diagonal line to generate an operation area, or the operation area may be generated according to the boundary point of the touch track, for example, determining the top position.
- the lowest, leftmost, and rightmost track points determine the operating area based on the above track points.
- the display device stops receiving the second button signal, it is confirmed that the smart pen stops performing the touch operation, and at this time, the final operation region corresponding to the touch track determination is obtained.
- S209. Determine whether the operation area is greater than or equal to a preset area size. If the operated area is greater than or equal to the preset area size, S210 is performed, and if the operation area is smaller than the preset area size, S213 is performed.
- the preset area size is a minimum area for generating an operation area, which can be set according to actual conditions. If the operation area is greater than or equal to the preset area size, it indicates that the touch track input by the user can generate a display frame. If the operation area is smaller than the preset area size, it means that the touch track input by the user cannot generate a display frame.
- the pop-up position of the display frame is the same as the position of the operation area. That is, the display frame pops up at the position of the operation area.
- the specific prompting manner may be at least one of closing an operation area, a pop-up prompt box, and a warning sound.
- control method may further include:
- the third button signal can be the same as the first button signal.
- the first button signal is generated, and at this time, the display device is based on the first button signal.
- the mask layer is popped up, and when the setting button of the smart pen is pressed again, the third button signal is generated, and the display device performs subsequent operations according to the third button signal.
- the third button signal may also be different from the first button signal, and only needs to satisfy the difference between the third button signal and the second button signal. If the third button signal is the same as the second button signal, the display device is configured according to The received signal cannot distinguish whether the subsequent operation is to close the mask or display the touch track on the mask.
- the large-screen display device receives the signal that the first setting button of the smart pen is pressed, it is determined that the first button signal is received, and the mask layer is popped in the display screen according to the first button signal. Further, when the large-screen display device receives the signal that the second setting button of the smart pen is pressed, it is determined that the third button signal is received and the Mongolian city is turned off.
- the display device is a 65-inch video teaching device, and the operating system is an Android system.
- the display device is also configured with a smart pen that has been synchronized and wirelessly connected via Bluetooth.
- the display device opens the presentation application and displays the courseware in the display. Among them, the display screen showing the teaching courseware is shown in Figure 2c.
- FIG. 2d is a layer covering the upper layer of the display screen of FIG. 2c with a transparency of 55%. 2d is only an exemplary display, and the display form of the mask in practical applications is not limited thereto.
- the mask is popped up, if the display device does not acquire the touch track and receives the cancellation request from the smart pen, the mask is cancelled.
- the cancellation request is when the user presses the above setting button again, A pen-generated message.
- the display device After the mask is popped up, if the display device acquires the touch track of the smart pen, referring to FIG. 2e, the moving distance between the first writing point of the touch track 21 and the current writing point is diagonal 22, and a layer is generated on the mask layer. A dotted rectangle 23, the operating area. In practical applications, the diagonal 22 may not be displayed on the display screen.
- the smart pen After the smart pen leaves the display screen, it is determined that the size of the dotted rectangular frame 23 is the final size. It is judged whether the size satisfies the set minimum area size. If it is satisfied, save the size of the area. If not, the dotted rectangle 23 is closed, and a prompt box is displayed prompting the user to re-enter the touch track.
- Figure 2f is a schematic illustration of a surface view popped up in the display.
- the mask layer is closed, and a surface rectangle view frame 24 equal in size to the dotted rectangle frame is popped up in the display screen, wherein the position of the surface rectangle view frame 24 and the dotted rectangle are displayed.
- Block 23 is displayed in the same position in the display.
- an application list (not shown) is displayed in the surface rectangle view box 24, and when the display device detects that the whiteboard application is selected, the selected message is sent to the whiteboard application in a broadcast manner, so that the whiteboard is applied to the surface.
- a corresponding display interface is displayed in the rectangular view frame 24. The user can write in the range of the surface rectangular view frame 24 through the smart pen, and the remaining positions of the display continue to display the teaching courseware. At this time, the user can not only write in the range of the surface rectangular view frame 24 through the smart pen, but also can continue to perform page turning and the like on the teaching courseware.
- the technical solution provided by the embodiment generates a touch request by acquiring the first button information of the smart pen, pops a mask layer on the display screen according to the touch request, and forms an operation area according to the touch track acquired in the mask layer, if the operation area is larger than Equal to the preset area size, the mask is closed, and a display frame equal in size to the operation area is popped up in the display screen, so that the user performs a touch operation in the display box, if If the area is smaller than the preset area size, the user is prompted to re-enter the touch track, and the technical means for determining whether the operation area corresponding to the touch track is greater than or equal to the size of the preset area is implemented, and multiple pairs of smart pens are used in the display screen.
- the display box performs the technical effect of the touch operation, which facilitates the user to delimit the display area of the display frame in the display screen according to his actual needs, and opens the required application in the display box without exiting the display interface of the currently executing application.
- setting the operation area can make the user clear the size of the display frame generated according to the current touch trajectory, and can also make the final display frame more in line with the user's needs.
- FIG. 3 is a schematic structural diagram of a control apparatus for a large-screen display device according to Embodiment 3 of the present invention.
- the control device for the large-screen display device provided in this embodiment includes: a request acquisition module 301, a mask pop-up module 302, a track acquisition module 303, a display frame pop-up module 304, and an operation acquisition module 305.
- the request obtaining module 301 is configured to obtain a touch request of the smart pen on the display screen; the masking pop-up module 302 is configured to pop the mask layer on the display screen according to the touch request; and the track acquiring module 303 is configured to be in the mask layer
- the at least one touch track of the smart pen is obtained.
- the display box pop-up module 304 is configured to pop up a display frame corresponding to the touch track on the display screen.
- the operation obtaining module 305 is configured to obtain a corresponding touch operation in the display frame. .
- the technical solution provided by the embodiment provides a touch panel on the display screen by acquiring a touch request of the smart pen, and pops a display frame corresponding to the touch track on the display screen according to at least one touch track of the smart pen, in the display box.
- the technical means for obtaining the corresponding touch operation realizes the technical effect of performing a touch operation on the plurality of display frames in the display device by using the smart pen, and is convenient for the user to delimit the display area of the display frame in the display screen according to the actual needs of the user. And open the desired app in the display box, and no need Exit the display interface of the currently executing application.
- the request obtaining module 301 includes: a first signal unit, configured to acquire a first button signal of the smart pen; and a request generating unit, configured to generate a touch of the smart pen on the display screen according to the first button signal request.
- the trajectory obtaining module 303 includes: a trajectory acquiring unit, configured to acquire at least one touch trajectory on the smear layer; and a second signal unit, configured to receive the smart The second button signal of the pen determines at least one touch track as at least one touch track of the smart pen.
- the display frame pop-up module 304 includes: an area determining unit, configured to determine a corresponding operation area according to each touch track; and a first pop-up unit for popping up the same size as the operation area on the display screen. Display box.
- the first pop-up unit is specifically configured to: if the operation area is greater than or equal to the preset area size, pop up a display frame of the same size as the operation area on the display screen.
- the first pop-up unit includes: a prompting sub-unit, configured to prompt to re-enter the touch track if the operation area is smaller than the preset area size; and return to the sub-unit for returning execution on the mask layer, Acquiring at least one touch track of the smart pen, and when the operation area is greater than or equal to the preset area size, a display frame equal in size to the operation area is popped up on the display screen.
- the method further includes: a first signal module, configured to acquire a third button signal of the smart pen; and a mask closing module, configured to close the mask layer according to the third button signal.
- the display frame is a surface view rectangular view frame.
- the control device for the large-screen display device provided in this embodiment may be used to execute the control method for the large-screen display device provided by any of the foregoing embodiments, and has corresponding functions and beneficial effects.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
本发明实施例涉及计算机技术领域,尤其涉及一种用于大屏显示设备的控制方法和控制装置。Embodiments of the present invention relate to the field of computer technologies, and in particular, to a control method and a control apparatus for a large-screen display device.
随着科技的发展,智能显示设备已经进入了人们的日常生活中。其中,显示屏幕超过50寸的显示设备可以称之为大屏显示设备。大屏显示设备可以应用于办公、教学以及宣传等。例如,视频会议设备或者教学播放设备。With the development of technology, intelligent display devices have entered people's daily lives. Among them, a display device with a display screen exceeding 50 inches can be called a large screen display device. Large-screen display devices can be used for office, teaching, and publicity. For example, a video conferencing device or a teaching playback device.
在显示设备的使用过程中,若使用者想要实现某个应用的功能,则在开启该应用后,显示画面仅显示该应用的显示界面,以便用户进行操作,这时其他应用的功能则不能实现。例如,使用者想要在终端中实现电子白板的功能,则在开启电子白板功能后,显示界面全部变成白板界面,使用者可以在该界面中进行书写等操作。此时,使用者若想要调用其它的功能,则需要先关闭白板界面,再进行其他操作。During the use of the display device, if the user wants to implement the function of an application, after the application is opened, the display screen only displays the display interface of the application, so that the user can perform the operation, and the functions of other applications cannot be performed at this time. achieve. For example, if the user wants to implement the function of the electronic whiteboard in the terminal, after the electronic whiteboard function is turned on, the display interface all becomes a whiteboard interface, and the user can perform operations such as writing in the interface. At this point, if the user wants to call other functions, he needs to close the whiteboard interface before performing other operations.
发明内容Summary of the invention
有鉴于此,本发明实施例提供一种用于大屏显示设备的控制方法和控制装置,以在使用大屏显示设备时,实现同时显示多个应用功能的显示界面。In view of this, an embodiment of the present invention provides a control method and a control device for a large-screen display device, so as to implement a display interface for simultaneously displaying a plurality of application functions when a large-screen display device is used.
第一方面,本发明实施例提供了一种用于大屏显示设备的控制方法,包括:In a first aspect, an embodiment of the present invention provides a control method for a large-screen display device, including:
获取智能笔在显示屏上的触摸请求; Obtaining a touch request of the smart pen on the display screen;
根据所述触摸请求,在所述显示屏上弹出蒙层;Popping a layer on the display screen according to the touch request;
在所述蒙层上,获取所述智能笔的至少一条触摸轨迹;Obtaining at least one touch track of the smart pen on the mask layer;
在所述显示屏上弹出与所述触摸轨迹一一对应的显示框;Displaying a display frame corresponding to the touch track one by one on the display screen;
在所述显示框中获取对应的触摸操作。A corresponding touch operation is obtained in the display frame.
第二方面,本发明实施例还提供了一种用于大屏显示设备的控制装置,包括:In a second aspect, the embodiment of the present invention further provides a control device for a large-screen display device, including:
请求获取模块,用于获取智能笔在显示屏上的触摸请求;Requesting an acquisition module for obtaining a touch request of the smart pen on the display screen;
蒙层弹出模块,用于根据所述触摸请求,在所述显示屏上弹出蒙层;a masking module for popping a mask layer on the display screen according to the touch request;
轨迹获取模块,用于在所述蒙层上,获取所述智能笔的至少一条触摸轨迹;a trajectory acquiring module, configured to acquire at least one touch trajectory of the smart pen on the smear layer;
显示框弹出模块,用于在所述显示屏上弹出与所述触摸轨迹一一对应的显示框;a display box ejecting module, configured to pop up a display frame corresponding to the touch track on the display screen;
操作获取模块,用于在所述显示框中获取对应的触摸操作。An operation obtaining module is configured to obtain a corresponding touch operation in the display frame.
本发明实施例提供的用于大屏显示设备的控制方法和控制装置,通过获取智能笔在显示屏上的触摸请求,在显示屏上弹出蒙层,并根据智能笔在蒙层上触摸时的至少一条触摸轨迹,在显示屏上弹出与触摸轨迹一一对应的显示框,在显示框中获取对应的触摸操作的技术手段,实现了利用智能笔在显示设备中对多个显示框执行触摸操作的技术效果,方便了用户根据自己的实际需求在显示屏中划定显示框的显示区域,且无需退出当前执行应用的显示界面。The control method and the control device for the large-screen display device provided by the embodiment of the present invention, by acquiring the touch request of the smart pen on the display screen, popping the mask layer on the display screen, and according to the smart pen touching on the mask layer At least one touch track, a display frame corresponding to the touch track is popped up on the display screen, and a corresponding touch operation method is obtained in the display frame, so that the touch operation is performed on the plurality of display frames in the display device by using the smart pen The technical effect is convenient for the user to delimit the display area of the display frame in the display screen according to his actual needs, and does not need to exit the display interface of the currently executing application.
通过阅读参照以下附图所作的对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:Other features, objects, and advantages of the present invention will become more apparent from the Detailed Description of Description
图1为本发明实施例一提供的一种用于大屏显示设备的控制方法的流程图; 1 is a flowchart of a control method for a large-screen display device according to Embodiment 1 of the present invention;
图2a为本发明实施例二提供的一种用于大屏显示设备的控制方法的流程图;2a is a flowchart of a method for controlling a large-screen display device according to Embodiment 2 of the present invention;
图2b为本发明实施例二提供的一种蒙层关闭方法的流程图;2b is a flowchart of a method for closing a mask layer according to Embodiment 2 of the present invention;
图2c为本发明实施例二提供的一种显示画面的示意图;2c is a schematic diagram of a display screen according to Embodiment 2 of the present invention;
图2d为本发明实施例二提供的一种带有蒙层的显示画面的示意图;FIG. 2 is a schematic diagram of a display screen with a mask layer according to Embodiment 2 of the present invention; FIG.
图2e为本发明实施例二提供的一种带有虚拟矩形框的显示画面的示意图;2 e is a schematic diagram of a display screen with a virtual rectangular frame according to Embodiment 2 of the present invention;
图2f为本发明实施例二提供的一种带有surface视图的显示画面的示意图;2f is a schematic diagram of a display screen with a surface view according to Embodiment 2 of the present invention;
图3为本发明实施例三提供的一种用于大屏显示设备的控制装置的结构示意图。FIG. 3 is a schematic structural diagram of a control apparatus for a large-screen display device according to Embodiment 3 of the present invention.
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是,此处所描述的具体实施例仅仅用于解释本发明,而非对本发明的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本发明相关的部分而非全部内容。The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. It should also be noted that, for ease of description, only some, but not all, of the present invention are shown in the drawings.
实施例一Embodiment 1
图1为本发明实施例一提供的一种用于大屏显示设备的控制方法的流程图。本实施例适用于在大屏显示设备的显示屏上同时显示至少一个显示框的情形。本实施例提供的用于大屏显示设备的控制方法可以由用于大屏显示设备的控制装置执行,该控制装置可以通过软件和/或硬件的方式实现,并集成在大屏显示设备中。FIG. 1 is a flowchart of a method for controlling a large-screen display device according to Embodiment 1 of the present invention. This embodiment is applicable to the case where at least one display frame is simultaneously displayed on the display screen of the large-screen display device. The control method for the large-screen display device provided by the embodiment may be performed by a control device for a large-screen display device, and the control device may be implemented by software and/or hardware and integrated in the large-screen display device.
参考图1,本实施例提供的用于大屏显示设备的控制方法具体包括: Referring to FIG. 1, the control method for a large-screen display device provided by this embodiment specifically includes:
S110、获取智能笔在显示屏上的触摸请求。S110. Acquire a touch request of the smart pen on the display screen.
在本实施例中,显示设备为带有可触摸显示屏的智能设备,例如大屏显示设备中的教学播放设备、视频会议设备等。In this embodiment, the display device is a smart device with a touch screen, such as a teaching play device, a video conference device, and the like in a large screen display device.
具体的,智能笔在显示屏上的触摸请求为用户通过智能笔发出的对显示屏进行划定区域的触摸操作的请求。Specifically, the touch request of the smart pen on the display screen is a request by the user to perform a touch operation on the display area by the smart pen.
具体的,显示设备与智能笔预先通过红外线、蓝牙、无线热点或者无线局域网连接,并在同步后可以进行数据的交互。用户可以对智能笔的设定按键进行操作以发出触摸请求,其中,对设定按键进行操作可以是点击该按键、双击该按键或者是长按该按键等。当智能笔的设定按键接收到用户操作时,生成对应的按键信号,并将该按键信号发送至显示设备中,显示设备通过解析该按键信号确定是否为与触摸请求对应的信号。Specifically, the display device and the smart pen are connected in advance through infrared, Bluetooth, wireless hotspot or wireless local area network, and can perform data interaction after synchronization. The user can operate the setting button of the smart pen to issue a touch request, wherein the setting button can be operated by clicking the button, double clicking the button, or long pressing the button. When the setting button of the smart pen receives the user operation, a corresponding button signal is generated, and the button signal is sent to the display device, and the display device determines whether the signal corresponding to the touch request is determined by parsing the button signal.
S120、根据触摸请求,在显示屏上弹出蒙层。S120. Pop the mask layer on the display according to the touch request.
示例性的,蒙层覆盖于当前显示画面之上。其中,蒙层可以覆盖于全部的显示画面之上,还可以覆盖于部分显示画面之上。例如,根据触摸请求,在显示屏上弹出覆盖于全部显示画面的蒙层。又如,根据触摸请求,在显示屏中没有显示图像的显示画面上弹出蒙层。该蒙层的透明度、填充样式以及颜色可以根据实际情况进行设定。Exemplarily, the mask covers the current display. The mask can cover all of the display screens and can also be overlaid on some of the display screens. For example, according to the touch request, a mask covering all of the display screens is popped up on the display screen. For another example, according to the touch request, a mask layer is popped up on the display screen where no image is displayed on the display screen. The transparency, fill pattern, and color of the mask can be set according to the actual situation.
当显示屏上弹出蒙层时,用户不能对当前应用的显示画面进行操作。即弹出蒙层相当于锁定了当前的显示画面。在弹出蒙层后,用户确认可以输入触摸轨迹。When the mask is popped up on the display, the user cannot operate on the display of the current application. That is, the pop-up mask is equivalent to locking the current display. After the mask is popped up, the user confirms that the touch track can be entered.
一般而言,在实际应用过程中,根据触摸请求也可以仅锁定当前的显示画面。而设置弹出蒙层的好处是,可以提示用户当前显示画面已经锁定,可以输入触摸轨迹。 In general, in the actual application process, only the current display screen can be locked according to the touch request. The advantage of setting the pop-up mask is that the user can be prompted to display the current display screen, and the touch track can be input.
S130、在蒙层上,获取智能笔的至少一条触摸轨迹。S130: Obtain at least one touch track of the smart pen on the mask layer.
示例性的,根据智能笔在蒙层上的触摸操作,得到触摸位置,进而获取触摸轨迹。可选的,智能笔可以输入至少一条触摸轨迹。其中,可以同时输入多条触摸轨迹,也可以输入一条触摸轨迹后,输入另一条触摸轨迹。进一步的,多条触摸轨迹不相互重叠,若出现相互重叠的触摸轨迹,则将相互重叠的触摸轨迹默认为同一条触摸轨迹。Exemplarily, according to the touch operation of the smart pen on the mask layer, the touch position is obtained, thereby acquiring the touch track. Optionally, the smart pen can input at least one touch track. Among them, multiple touch tracks can be input at the same time, or one touch track can be input, and another touch track can be input. Further, the plurality of touch trajectories do not overlap each other, and if there are overlapping touch trajectories, the mutually overlapping touch trajectories are defaulted to the same touch trajectory.
其中,触摸轨迹的具体形式本实施例不作限定,可以是对角线、圆圈、矩形或者三角形等。The specific form of the touch track is not limited in this embodiment, and may be a diagonal, a circle, a rectangle, or a triangle.
由于获取触摸轨迹时,仅根据蒙层上的触摸操作是无法判别出是否为智能笔发出的触摸操作。因此,在获取触摸操作时,同步接收智能笔的同步信号,根据该同步信号确定触摸操作为智能笔发出的触摸操作。其中,智能笔发出同步信号的具体方式本实施例不作限定,例如,检测到智能笔的某个按键持续被按下时,确认接收到同步信号。又如,检测到智能笔的笔头上设置的压力传感器接收的压力值高于预设值时,确认接收到同步信号。如果在获取触摸操作时,没有接收到同步信号,则说明该触摸操作可能不是智能笔发出的触摸操作,此时,可以提示用户使用智能笔进行触摸操作,如果在一段时间内,还是没有接收到同步信号,则可以关闭蒙层。Since the touch trajectory is acquired, it is impossible to discriminate whether or not the touch operation is issued by the smart pen based only on the touch operation on the smear layer. Therefore, when the touch operation is acquired, the synchronization signal of the smart pen is synchronously received, and the touch operation is determined according to the synchronization signal as a touch operation issued by the smart pen. The specific manner in which the smart pen sends a synchronization signal is not limited in this embodiment. For example, when it is detected that a certain button of the smart pen is continuously pressed, it is confirmed that the synchronization signal is received. For another example, when it is detected that the pressure value received by the pressure sensor provided on the tip of the smart pen is higher than a preset value, it is confirmed that the synchronization signal is received. If the synchronization signal is not received when the touch operation is acquired, the touch operation may not be the touch operation issued by the smart pen. At this time, the user may be prompted to use the smart pen to perform the touch operation, if it is not received within a certain period of time Synchronize the signal to turn off the mask.
进一步的,若弹出蒙层后的一段时间内,比如两分钟内,没有获取到触摸轨迹,则关闭该蒙层。或者,若弹出蒙层后,接收到蒙层关闭指令,则根据该蒙层关闭指令关闭该蒙层,此后,获取的触摸轨迹默认为用户对当前应用显示画面的操作。Further, if the touch track is not acquired within a period of time after the mask is popped up, for example, within two minutes, the mask is closed. Alternatively, if the mask close command is received after the mask is popped, the mask is turned off according to the mask close command, and thereafter, the acquired touch track defaults to the user's operation on the current application display screen.
S140、在显示屏上弹出与触摸轨迹一一对应的显示框。S140. A display frame corresponding to the touch track is popped up on the display screen.
具体的,根据每条触摸轨迹确定对应的显示框,并在显示屏中弹出该显示 框,同时关闭蒙层。其中,显示框的弹出位置与触摸轨迹的获取位置相同。Specifically, the corresponding display frame is determined according to each touch track, and the display is popped up in the display screen. Frame while closing the mask. The pop-up position of the display frame is the same as the capture position of the touch track.
可选的,在弹出显示框前,可以先判断显示框是否满足弹出条件。若满足弹出条件,则弹出对应的显示框,若不满足弹出条件,则提示用户重新输入触摸轨迹,并再判断根据触摸轨迹生成的显示框是否满足弹出条件。其中,判断显示框是否满足弹出条件可以是判断显示框的大小是否满足预设的显示框大小,还可以是判断显示框弹出位置是否已经存在被弹出的显示框。Optionally, before the display box is popped up, you can first determine whether the display box meets the pop-up condition. If the pop-up condition is met, the corresponding display frame is popped up. If the pop-up condition is not met, the user is prompted to re-enter the touch track, and it is determined whether the display frame generated according to the touch track satisfies the pop-up condition. The determining whether the display frame meets the pop-up condition may be determining whether the size of the display frame satisfies the preset display frame size, or determining whether the display frame pop-up position already has a pop-up display frame.
显示屏上弹出的显示框与蒙层位于同一显示层,即覆盖于当前显示画面之上,也可以理解为在显示画面上悬浮显示该显示框。The display frame popped up on the display screen is located on the same display layer as the mask layer, that is, over the current display screen, and can also be understood as floating display of the display frame on the display screen.
其中,显示框可以为surfaceview矩形视图框。采用surfaceview矩形视图框的好处是可以保证显示框中的功能实现不影响主线程中功能的实现,在同时实现多个应用的功能时,加快响应速度。The display frame can be a surface view rectangular view frame. The advantage of using the surfaceview rectangular view box is that the function implementation in the display box does not affect the implementation of the functions in the main thread, and the response speed is accelerated when the functions of multiple applications are simultaneously implemented.
S150、在显示框中获取对应的触摸操作。S150. Obtain a corresponding touch operation in the display box.
具体的,在显示框中显示需要执行应用的显示画面,并获取与该应用对应的触摸操作。Specifically, a display screen that needs to execute an application is displayed in the display box, and a touch operation corresponding to the application is acquired.
其中,可执行应用可以根据用户的实际需求确定,比如,电子白板、计算器、截图应用以及计时器等。Among them, the executable application can be determined according to the actual needs of the user, such as an electronic whiteboard, a calculator, a screenshot application, and a timer.
可选的,在输入触摸指令时,一同输入对应的显示框需要执行的应用,或者在弹出显示框后,在显示屏的设定位置出现应用列表,并在获取用户选择的应用后,确定显示框需要执行的应用。例如,若用户通过智能笔的设定按键发出触摸指令以及开启电子白板应用,则显示设备在弹出的显示框中显示电子白板的显示画面。又如,在弹出显示框后,在显示框中显示应用列表,并在获取选择指令后,在显示框中显示与选择指令对应的应用显示画面。Optionally, when the touch command is input, the application corresponding to the display frame needs to be input together, or after the display frame is popped up, the application list appears in the set position of the display screen, and after obtaining the application selected by the user, determining the display The application that the box needs to execute. For example, if the user issues a touch command through the setting button of the smart pen and turns on the electronic whiteboard application, the display device displays the display screen of the electronic whiteboard in the pop-up display box. For another example, after the display box is popped up, the application list is displayed in the display box, and after the selection instruction is acquired, the application display screen corresponding to the selection instruction is displayed in the display box.
进一步的,用户可以在不同的显示框中输入不同的触摸操作。同时,显示 屏非显示框的显示区域继续显示原有的显示画面,并继续执行原有的应用。即实现了在显示设备中同时响应多个应用的功能。Further, the user can input different touch operations in different display boxes. At the same time, display The display area of the non-display frame continues to display the original display and continues to execute the original application. That is, the function of simultaneously responding to multiple applications in the display device is realized.
其中,显示框中获取的触摸操作为用户利用智能笔发出的触摸操作时,显示设备需要同步获取智能笔发出的信号,以确定该触摸操作为智能笔发出的操作。Wherein, when the touch operation acquired in the display box is a touch operation issued by the user using the smart pen, the display device needs to synchronously acquire a signal sent by the smart pen to determine that the touch operation is an operation issued by the smart pen.
可选的,显示设备检测到退出指令后,关闭对应的显示框。其中,退出指令为关闭显示框的指令,其具体的操作规则可根据实际情况进行设定,例如,当检测到用户通过智能笔点击显示框中的退出按钮时,确定检测到退出指令。又如,当检测到用户点击交互的智能笔的设定按键时,确定检测到退出指令。Optionally, after the display device detects the exit instruction, the corresponding display frame is closed. The exit instruction is an instruction to close the display box, and the specific operation rule may be set according to actual conditions. For example, when detecting that the user clicks the exit button in the display box through the smart pen, it is determined that the exit instruction is detected. For another example, when it is detected that the user clicks the setting button of the interactive smart pen, it is determined that the exit instruction is detected.
本实施例的应用场景一Application scenario 1 of this embodiment
用户使用大屏显示设备进行视频会议,在显示屏中显示商品的销售计划时,如果想要开启计算器对销售额进行计算,则采用本实施例提供的控制方法后,用户可以利用智能笔直接在销售计划显示画面中选择某个区域显示计算器,并进行计算。上述过程中,无需关闭当前显示画面,同时,还可以对显示画面进行上下翻页、退出等操作。The user can use the large-screen display device to perform a video conference. When the sales plan of the product is displayed in the display screen, if the calculator is to be used to calculate the sales amount, the user can use the smart pen directly after using the control method provided in this embodiment. Select an area display calculator on the sales plan display screen and perform calculations. In the above process, it is not necessary to close the current display screen, and at the same time, the display screen can be turned up and down, exited, and the like.
本实施例的应用场景二Application scenario 2 of this embodiment
用户在使用大屏显示设备进行教学时,在显示屏中显示某课件,若用户想到一个例子想进行书写讲解,则采用本实施例提供的控制方法后,可以直接利用智能笔在当前的课件显示界面上,划定区域开启悬浮的电子白板功能,在电子白板中进行书写,并在讲解完成后,关闭电子白板。上述过程中,无需关闭课件显示界面,同时,还可以继续对课件进行上下翻页、退出等操作。When the user uses the large-screen display device to teach, a certain courseware is displayed on the display screen. If the user wants to write an explanation, the user can directly use the smart pen to display the current courseware after using the control method provided by the embodiment. On the interface, the area is opened to enable the floating whiteboard function, writing in the electronic whiteboard, and after the explanation is completed, the electronic whiteboard is closed. In the above process, it is not necessary to close the courseware display interface, and at the same time, it is also possible to continue to page up and exit the courseware.
本实施例提供的技术方案,通过获取智能笔的触摸请求在显示屏上弹出蒙层,并根据智能笔的至少一条触摸轨迹,在显示屏上弹出与触摸轨迹对应的显 示框,在显示框中获取对应的触摸操作的技术手段,实现了利用智能笔在显示设备中对多个显示框执行触摸操作的技术效果,方便了用户根据自己的实际需求在显示屏中划定显示框的显示区域,并在显示框中开启需要的应用,且无需退出当前执行应用的显示界面。The technical solution provided by the embodiment provides a touch request on the display screen by acquiring a touch request of the smart pen, and pops up corresponding to the touch track on the display screen according to at least one touch track of the smart pen. The technical means for obtaining a corresponding touch operation in the display box realizes the technical effect of performing a touch operation on a plurality of display frames in the display device by using the smart pen, which facilitates the user to draw in the display screen according to his actual needs. The display area of the display box is fixed, and the desired application is opened in the display box, and the display interface of the currently executing application does not need to be exited.
实施例二Embodiment 2
图2a为本发明实施例二提供的一种用于大屏显示设备的控制方法的流程图。本实施例是在上述实施例的基础上进行具体化。参考图2a,本实施例提供的控制方法具体包括:2a is a flowchart of a method for controlling a large-screen display device according to Embodiment 2 of the present invention. This embodiment is embodied on the basis of the above embodiment. Referring to FIG. 2a, the control method provided in this embodiment specifically includes:
S201、获取智能笔的第一按键信号。S201. Acquire a first button signal of the smart pen.
其中,第一按键信号的具体形式本实施例不做限定。例如,第一按键信号是智能笔的设定按键被按下时生成的信号,此时,该信号中携带设定按键被按下的信息。如果显示设备对获取的信号进行解析时,得到该信号中包括设定按键被按下的信息,则将该信号确定为第一按键信号。The specific form of the first button signal is not limited in this embodiment. For example, the first button signal is a signal generated when the setting button of the smart pen is pressed, and at this time, the signal carries information that the setting button is pressed. If the display device parses the acquired signal, and obtains information including that the set button is pressed in the signal, the signal is determined as the first button signal.
S202、根据第一按键信号生成智能笔在显示屏上的触摸请求。S202. Generate a touch request of the smart pen on the display screen according to the first button signal.
S203、根据触摸请求,在显示屏上弹出蒙层。S203. Pop the mask layer on the display according to the touch request.
S204、获取蒙层上的至少一条触摸轨迹。S204. Acquire at least one touch track on the mask layer.
S205、判断是否同步接收到智能笔的第二按键信号。如果同步接收到智能笔的第二按键信号,则执行S207。否则,S206。S205. Determine whether the second button signal of the smart pen is synchronously received. If the second key signal of the smart pen is synchronously received, S207 is performed. Otherwise, S206.
示例性的,在蒙层上获取触摸轨迹时,显示设备只对智能笔发出的触摸轨迹进行响应,其他的触摸轨迹不进行响应,因此,需要判断该触摸轨迹是否为智能笔发出的触摸轨迹。具体的判断方式可以为是否同步接收到智能笔的第二按键信号,其中,第二按键信号的具体形式可以跟第一按键信号的具体形式相 同,也可以不同。Exemplarily, when the touch track is acquired on the mask layer, the display device only responds to the touch track sent by the smart pen, and the other touch tracks do not respond. Therefore, it is necessary to determine whether the touch track is a touch track issued by the smart pen. The specific manner of determining may be whether the second button signal of the smart pen is synchronously received, wherein the specific form of the second button signal may be related to the specific form of the first button signal. Same, it can be different.
需要说明的是,S204和S205是同步进行的。即显示设备在获取蒙层上的至少一条触摸轨迹时,判断是否同步接收到智能笔的第二按键信号。其中,由于智能笔在蒙层上执行触摸操作时,显示设备可以立即检测到触摸操作,而智能笔发送第二按键信号时,显示设备需要获取第二按键信号并进行解析,所以显示设备会先检测到触摸操作然后接收到第二按键信号。此时,可以设定一个时间间隔,当检测到触摸操作后,如果该时间间隔内接收到第二按键信号,则确认同步接收到智能笔的第二按键信号。如果该时间间隔内没有接收到第二按键信号,则确认没有同步接收到智能笔的第二按键信号。It should be noted that S204 and S205 are performed synchronously. That is, when the display device acquires at least one touch track on the mask, it is determined whether the second button signal of the smart pen is synchronously received. Wherein, when the smart pen performs a touch operation on the mask layer, the display device can immediately detect the touch operation, and when the smart pen sends the second button signal, the display device needs to acquire the second button signal and analyze, so the display device first A touch operation is detected and then a second key signal is received. At this time, a time interval may be set. When the touch operation is detected, if the second button signal is received within the time interval, it is confirmed that the second button signal of the smart pen is synchronously received. If the second button signal is not received within the time interval, it is confirmed that the second button signal of the smart pen is not synchronously received.
S206、关闭蒙层。S206, closing the mask.
进一步的,关闭蒙层后,退出操作。Further, after closing the mask, the operation is exited.
可选的,在关闭蒙层前,可以弹出提示框,以提示用户当前触摸轨迹不可识别,请使用同步的智能笔输入触摸轨迹。Optionally, before the mask is closed, a prompt box may pop up to prompt the user that the current touch track is unrecognizable. Please input the touch track using a synchronized smart pen.
S207、将至少一条触摸轨迹确定为智能笔的至少一条触摸轨迹。S207. Determine at least one touch track as at least one touch track of the smart pen.
S208、根据每条触摸轨迹确定对应的操作区域。S208. Determine a corresponding operation area according to each touch track.
进一步的,操作区域为根据触摸轨迹生成的虚拟显示框,即后续弹出显示框的区域。可选的,根据实时接收的触摸轨迹在显示屏中实时显示当前的操作区域,以使用户在触摸过程中,确定显示框的大小和位置。其中,操作区域可以在当前蒙层中以虚线矩形框的形式显示,还可以在当前蒙层中以不同填充颜色矩形框的形式显示。Further, the operation area is a virtual display frame generated according to the touch track, that is, an area where the display frame is subsequently popped up. Optionally, the current operating area is displayed in real time in the display screen according to the touch track received in real time, so that the user determines the size and position of the display frame during the touch process. The operation area may be displayed in the form of a dotted rectangle in the current mask, or may be displayed in a rectangular frame of different fill colors in the current mask.
在生成操作区域时,可以是将触摸轨迹的第一个点和当前点之间的连线作为对角线,生成操作区域,还可以是根据触摸轨迹的边界点生成操作区域,例如,确定最上、最下、最左以及最右的轨迹点,根据上述轨迹点确定操作区域。 When the operation area is generated, the connection line between the first point of the touch track and the current point may be used as a diagonal line to generate an operation area, or the operation area may be generated according to the boundary point of the touch track, for example, determining the top position. The lowest, leftmost, and rightmost track points determine the operating area based on the above track points.
进一步的,当显示设备停止接收第二按键信号时,确认智能笔停止执行触摸操作,此时,得到最终的与触摸轨迹确定对应的操作区域。Further, when the display device stops receiving the second button signal, it is confirmed that the smart pen stops performing the touch operation, and at this time, the final operation region corresponding to the touch track determination is obtained.
S209、判断操作区域是否大于等于预设的区域大小。如果所操作区域大于等于预设的区域大小,则执行S210,如果操作区域小于预设的区域大小,则执行S213。S209. Determine whether the operation area is greater than or equal to a preset area size. If the operated area is greater than or equal to the preset area size, S210 is performed, and if the operation area is smaller than the preset area size, S213 is performed.
其中,预设的区域大小为生成操作区域的最小区域,其可以根据实际情况进行设定。如果操作区域大于等于预设的区域大小,则说明用户输入的触摸轨迹可以生成显示框。如果操作区域小于预设的区域大小,则说明用户输入的触摸轨迹不能生成显示框。The preset area size is a minimum area for generating an operation area, which can be set according to actual conditions. If the operation area is greater than or equal to the preset area size, it indicates that the touch track input by the user can generate a display frame. If the operation area is smaller than the preset area size, it means that the touch track input by the user cannot generate a display frame.
S210、关闭蒙层。执行S211。S210, closing the mask. Execute S211.
S211、在显示屏上弹出与操作区域大小相等的显示框。执行S212。S211. A display frame having the same size as the operation area is popped up on the display screen. Execution S212.
其中,显示框的弹出位置与操作区域的位置相同。即在操作区域的位置处弹出显示框。The pop-up position of the display frame is the same as the position of the operation area. That is, the display frame pops up at the position of the operation area.
S212、在显示框中获取对应的触摸操作。S212. Obtain a corresponding touch operation in the display box.
S213、提示重新录入触摸轨迹。返回执行S204。S213. Prompt to re-enter the touch track. Return to execution S204.
具体的,如果操作区域小于预设的区域大小,则提示用户重新录入触摸轨迹,并返回执行S204,直到根据触摸轨迹生成的操作区域的大小大于等于预设的区域大小为止。具体的提示方式可以是关闭操作区域、弹出提示框以及发出警示音中的至少一种。Specifically, if the operation area is smaller than the preset area size, the user is prompted to re-enter the touch track, and the process returns to S204 until the size of the operation area generated according to the touch track is greater than or equal to the preset area size. The specific prompting manner may be at least one of closing an operation area, a pop-up prompt box, and a warning sound.
在上述实施例的基础上,参考图2b,该控制方法还可以包括:Based on the foregoing embodiment, referring to FIG. 2b, the control method may further include:
S214、获取智能笔的第三按键信号。S214. Acquire a third button signal of the smart pen.
可选的,第三按键信号可以跟第一按键信号相同。例如,当智能笔的设定按键第一次被按下时,生成第一按键信号,此时显示设备根据该第一按键信号 弹出蒙层,当智能笔的设定按键再次被按下时,生成第三按键信号,此时显示设备根据该第三按键信号执行后续操作。需要说明的是,第三按键信号也可以与第一按键信号不同,仅需满足第三按键信号与第二按键信号不同即可,如果第三按键信号与第二按键信号相同,则显示设备根据接收的信号无法区分后续操作为关闭蒙层还是在蒙层上显示触摸轨迹。Optionally, the third button signal can be the same as the first button signal. For example, when the setting button of the smart pen is pressed for the first time, the first button signal is generated, and at this time, the display device is based on the first button signal. The mask layer is popped up, and when the setting button of the smart pen is pressed again, the third button signal is generated, and the display device performs subsequent operations according to the third button signal. It should be noted that the third button signal may also be different from the first button signal, and only needs to satisfy the difference between the third button signal and the second button signal. If the third button signal is the same as the second button signal, the display device is configured according to The received signal cannot distinguish whether the subsequent operation is to close the mask or display the touch track on the mask.
S215、根据第三按键信号关闭蒙层。S215. Close the mask according to the third button signal.
例如,大屏显示设备接收到智能笔的第一设定按键被按下的信号时,确定接收到第一按键信号,并根据第一按键信号在显示屏中弹出蒙层。进一步的,大屏显示设备接收到智能笔的第二设定按键被按下的信号时,确定接收到第三按键信号并关闭蒙城。For example, when the large-screen display device receives the signal that the first setting button of the smart pen is pressed, it is determined that the first button signal is received, and the mask layer is popped in the display screen according to the first button signal. Further, when the large-screen display device receives the signal that the second setting button of the smart pen is pressed, it is determined that the third button signal is received and the Mongolian city is turned off.
下面为对本实施例提供的控制方法的示例性描述。The following is an exemplary description of the control method provided by the present embodiment.
本示例中,显示设备为65寸的视频教学设备,且操作系统为安卓系统。该显示设备还配置有已经同步且通过蓝牙无线连接的智能笔。显示设备开启了演示文稿应用,并在显示画面中显示教学课件。其中,显示屏显示教学课件的显示画面如图2c所示。In this example, the display device is a 65-inch video teaching device, and the operating system is an Android system. The display device is also configured with a smart pen that has been synchronized and wirelessly connected via Bluetooth. The display device opens the presentation application and displays the courseware in the display. Among them, the display screen showing the teaching courseware is shown in Figure 2c.
具体的,当智能笔的设定按键被用户按下时,生成按键信号,并将该按键信号通过蓝牙信号传输至显示设备中。显示设备在接收到按键信号时,对其进行解析,确定该按键信号为第一按键信号,并生成触摸请求。根据该触摸请求在显示屏的当前显示画面中全屏覆盖一个蒙层。参考图2d,图2d为在图2c的显示画面的上层覆盖一蒙层,该蒙城的透明度为55%。其中,图2d仅为一种示例性的显示,实际应用中蒙层的显示形式并不限于此。Specifically, when the setting button of the smart pen is pressed by the user, the button signal is generated, and the button signal is transmitted to the display device through the Bluetooth signal. When the display device receives the button signal, it analyzes the button signal, determines that the button signal is the first button signal, and generates a touch request. According to the touch request, a mask is covered in full screen in the current display screen of the display screen. Referring to FIG. 2d, FIG. 2d is a layer covering the upper layer of the display screen of FIG. 2c with a transparency of 55%. 2d is only an exemplary display, and the display form of the mask in practical applications is not limited thereto.
弹出蒙层后,如果显示设备没有获取到触摸轨迹,且接收到智能笔发出的取消请求时,取消蒙层。其中,取消请求为用户再次按下上述设定按键时,智 能笔生成的消息。After the mask is popped up, if the display device does not acquire the touch track and receives the cancellation request from the smart pen, the mask is cancelled. Wherein, the cancellation request is when the user presses the above setting button again, A pen-generated message.
弹出蒙层后,如果显示设备获取到智能笔的触摸轨迹,则参考图2e,以触摸轨迹21的第一个书写点与当前书写点的移动距离为对角线22,在蒙层上生成一个虚线的矩形框23,即操作区域。实际应用中,对角线22也可以不显示在显示画面中。当智能笔离开显示屏后,确定虚线的矩形框23的大小为最终的大小。判断该大小是否满足设定的最小区域大小。若满足,则保存该区域大小。若不满足,则关闭虚线矩形框23,并弹出提示框提示用户重新输入触摸轨迹。After the mask is popped up, if the display device acquires the touch track of the smart pen, referring to FIG. 2e, the moving distance between the first writing point of the
图2f为在显示屏中弹出surface视图的示意图。参考图2f,在保存虚线矩形框23的大小后,关闭蒙层,并在显示屏中弹出与该虚线矩形框大小相等的surface矩形视图框24,其中,surface矩形视图框24的位置与虚线矩形框23在显示屏中显示的位置相同。Figure 2f is a schematic illustration of a surface view popped up in the display. Referring to FIG. 2f, after the size of the dotted
进一步的,在surface矩形视图框24中显示应用列表(图未示),当显示设备检测到白板应用被选择时,以广播的方式将被选择的消息发送至白板应用,以使白板应用在surface矩形视图框24中显示对应的显示界面。用户可以通过智能笔在surface矩形视图框24范围内进行书写,同时,显示屏的其余位置继续显示教学课件。此时,用户不仅可以通过智能笔在surface矩形视图框24范围内进行书写,还可以继续对教学课件执行翻页等操作。Further, an application list (not shown) is displayed in the surface
当检测到surface矩形视图框24中的关闭按钮25被点击时,关闭surface矩形视图框24,并在surface矩形视图框24位置继续显示教学课件。When it is detected that the
本实施例提供的技术方案,通过获取智能笔的第一按键信息生成触摸请求,根据该触摸请求在显示屏上弹出蒙层,并根据蒙层中获取的触摸轨迹形成操作区域,如果操作区域大于等于预设的区域大小,则关闭蒙层,并在显示屏中弹出与操作区域大小相等的显示框,以使用户在显示框中执行触摸操作,如果操 作区域小于预设的区域大小,则提示用户重新输入触摸轨迹,并判断与触摸轨迹对应的操作区域是否大于等于预设区域的大小的技术手段,实现了利用智能笔在显示屏中对多个显示框执行触摸操作的技术效果,方便了用户根据自己的实际需求在显示屏中划定显示框的显示区域,并在显示框中开启需要的应用,且无需退出当前执行应用的显示界面。同时,设定操作区域可以使用户明确根据当前触摸轨迹生成的显示框的大小,也可以使得最终的显示框更加符合用户的需求。The technical solution provided by the embodiment generates a touch request by acquiring the first button information of the smart pen, pops a mask layer on the display screen according to the touch request, and forms an operation area according to the touch track acquired in the mask layer, if the operation area is larger than Equal to the preset area size, the mask is closed, and a display frame equal in size to the operation area is popped up in the display screen, so that the user performs a touch operation in the display box, if If the area is smaller than the preset area size, the user is prompted to re-enter the touch track, and the technical means for determining whether the operation area corresponding to the touch track is greater than or equal to the size of the preset area is implemented, and multiple pairs of smart pens are used in the display screen. The display box performs the technical effect of the touch operation, which facilitates the user to delimit the display area of the display frame in the display screen according to his actual needs, and opens the required application in the display box without exiting the display interface of the currently executing application. At the same time, setting the operation area can make the user clear the size of the display frame generated according to the current touch trajectory, and can also make the final display frame more in line with the user's needs.
实施例三Embodiment 3
图3为本发明实施例三提供的一种用于大屏显示设备的控制装置的结构示意图。本实施例提供的用于大屏显示设备的控制装置包括:请求获取模块301、蒙层弹出模块302、轨迹获取模块303、显示框弹出模块304以及操作获取模块305。FIG. 3 is a schematic structural diagram of a control apparatus for a large-screen display device according to Embodiment 3 of the present invention. The control device for the large-screen display device provided in this embodiment includes: a
其中,请求获取模块301,用于获取智能笔在显示屏上的触摸请求;蒙层弹出模块302,用于根据触摸请求,在显示屏上弹出蒙层;轨迹获取模块303,用于在蒙层上,获取智能笔的至少一条触摸轨迹;显示框弹出模块304,用于在显示屏上弹出与触摸轨迹一一对应的显示框;操作获取模块305,用于在显示框中获取对应的触摸操作。The
本实施例提供的技术方案,通过获取智能笔的触摸请求在显示屏上弹出蒙层,并根据智能笔的至少一条触摸轨迹,在显示屏上弹出与触摸轨迹对应的显示框,在显示框中获取对应的触摸操作的技术手段,实现了利用智能笔在显示设备中对多个显示框执行触摸操作的技术效果,方便了用户根据自己的实际需求在显示屏中划定显示框的显示区域,并在显示框中开启需要的应用,且无需 退出当前执行应用的显示界面。The technical solution provided by the embodiment provides a touch panel on the display screen by acquiring a touch request of the smart pen, and pops a display frame corresponding to the touch track on the display screen according to at least one touch track of the smart pen, in the display box. The technical means for obtaining the corresponding touch operation realizes the technical effect of performing a touch operation on the plurality of display frames in the display device by using the smart pen, and is convenient for the user to delimit the display area of the display frame in the display screen according to the actual needs of the user. And open the desired app in the display box, and no need Exit the display interface of the currently executing application.
在上述实施例的基础上,请求获取模块301包括:第一信号单元,用于获取智能笔的第一按键信号;请求生成单元,用于根据第一按键信号生成智能笔在显示屏上的触摸请求。On the basis of the foregoing embodiment, the
在上述实施例的基础上,轨迹获取模块303包括:轨迹获取单元,用于获取蒙层上的至少一条触摸轨迹;第二信号单元,用于在获取至少一条触摸轨迹时,如果同步接收到智能笔的第二按键信号,则将至少一条触摸轨迹确定为智能笔的至少一条触摸轨迹。On the basis of the foregoing embodiment, the
在上述实施例的基础上,显示框弹出模块304包括:区域确定单元,用于根据每条触摸轨迹确定对应的操作区域;第一弹出单元,用于在显示屏上弹出与操作区域大小相等的显示框。On the basis of the foregoing embodiment, the display frame pop-up
在上述实施例的基础上,第一弹出单元具体用于:如果操作区域大于等于预设的区域大小,则在显示屏上弹出与操作区域大小相等的显示框。On the basis of the foregoing embodiment, the first pop-up unit is specifically configured to: if the operation area is greater than or equal to the preset area size, pop up a display frame of the same size as the operation area on the display screen.
在上述实施例的基础上,第一弹出单元包括:提示子单元,用于如果操作区域小于预设的区域大小,则提示重新录入触摸轨迹;返回子单元,用于返回执行在蒙层上,获取智能笔的至少一条触摸轨迹的操作,并在操作区域大于等于预设的区域大小时,在显示屏上弹出与操作区域大小相等的显示框。On the basis of the foregoing embodiment, the first pop-up unit includes: a prompting sub-unit, configured to prompt to re-enter the touch track if the operation area is smaller than the preset area size; and return to the sub-unit for returning execution on the mask layer, Acquiring at least one touch track of the smart pen, and when the operation area is greater than or equal to the preset area size, a display frame equal in size to the operation area is popped up on the display screen.
在上述实施例的基础上,还包括:第一信号模块,用于获取智能笔的第三按键信号;蒙层关闭模块,用于根据第三按键信号关闭蒙层。On the basis of the above embodiments, the method further includes: a first signal module, configured to acquire a third button signal of the smart pen; and a mask closing module, configured to close the mask layer according to the third button signal.
在上述实施例的基础上,显示框为surfaceview矩形视图框。Based on the above embodiment, the display frame is a surface view rectangular view frame.
本实施例提供的用于大屏显示设备的控制装置可以用于执行上述任意实施例提供的用于大屏显示设备的控制方法,具备相应的功能和有益效果。 The control device for the large-screen display device provided in this embodiment may be used to execute the control method for the large-screen display device provided by any of the foregoing embodiments, and has corresponding functions and beneficial effects.
注意,上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解,本发明不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此,虽然通过以上实施例对本发明进行了较为详细的说明,但是本发明不仅仅限于以上实施例,在不脱离本发明构思的情况下,还可以包括更多其他等效实施例,而本发明的范围由所附的权利要求范围决定。 Note that the above are only the preferred embodiments of the present invention and the technical principles applied thereto. Those skilled in the art will appreciate that the invention is not limited to the specific embodiments described herein, and that various modifications, changes and substitutions may be made without departing from the scope of the invention. Therefore, the present invention has been described in detail by the above embodiments, but the present invention is not limited to the above embodiments, and other equivalent embodiments may be included without departing from the inventive concept. The scope is determined by the scope of the appended claims.
Claims (10)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611216173.2 | 2016-12-26 | ||
| CN201611216173.2A CN106648432A (en) | 2016-12-26 | 2016-12-26 | Control method and control device for large-screen display equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2018120448A1 true WO2018120448A1 (en) | 2018-07-05 |
Family
ID=58827110
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/077306 Ceased WO2018120448A1 (en) | 2016-12-26 | 2017-03-20 | Method and apparatus for controlling large-screen display device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106648432A (en) |
| WO (1) | WO2018120448A1 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108376046B (en) * | 2018-01-25 | 2020-07-24 | 贝壳技术有限公司 | Method, interaction system and device suitable for remote interaction |
| CN109375981A (en) * | 2018-10-31 | 2019-02-22 | 四川长虹教育科技有限公司 | Touch exchange method for intelligent interaction large-size screen monitors |
| CN116931735B (en) * | 2023-08-03 | 2024-05-28 | 北京行者无疆科技有限公司 | AR (augmented reality) glasses display terminal equipment key suspension position identification system and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102214060A (en) * | 2010-04-12 | 2011-10-12 | 宏碁股份有限公司 | Touch electronic device and window control method thereof |
| CN102693059A (en) * | 2011-03-22 | 2012-09-26 | 联想(北京)有限公司 | Input content display method and display apparatus and electronic equipment |
| CN103092458A (en) * | 2011-09-20 | 2013-05-08 | 三星电子株式会社 | Apparatus And Method For Running Application In Mobile Terminal |
| CN103399640A (en) * | 2013-08-16 | 2013-11-20 | 贝壳网际(北京)安全技术有限公司 | Method and device for controlling according to user gesture and client |
| CN103428359A (en) * | 2012-05-21 | 2013-12-04 | Lg电子株式会社 | Mobile terminal and control method thereof |
| CN103577495A (en) * | 2012-08-09 | 2014-02-12 | 腾讯科技(深圳)有限公司 | Gesture operation method and gesture operation device of browser |
| CN103688239A (en) * | 2011-03-02 | 2014-03-26 | 朴宰贤 | Method for controlling drawing action using transparent window |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101887315B (en) * | 2010-07-23 | 2012-11-07 | 广州视源电子科技股份有限公司 | Electronic intelligent pen |
| CN102760005B (en) * | 2012-03-26 | 2017-03-01 | 联想(北京)有限公司 | A kind of method and device of control electronics |
| CN103500066B (en) * | 2013-09-30 | 2019-12-24 | 北京奇虎科技有限公司 | A screenshot device and method suitable for touch screen devices |
| CN105975201B (en) * | 2016-04-27 | 2019-02-15 | 努比亚技术有限公司 | Mobile terminal and its split screen processing method |
| CN106250152B (en) * | 2016-07-29 | 2019-09-27 | 北京金山安全软件有限公司 | Mobile terminal control method and device and mobile terminal |
-
2016
- 2016-12-26 CN CN201611216173.2A patent/CN106648432A/en active Pending
-
2017
- 2017-03-20 WO PCT/CN2017/077306 patent/WO2018120448A1/en not_active Ceased
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102214060A (en) * | 2010-04-12 | 2011-10-12 | 宏碁股份有限公司 | Touch electronic device and window control method thereof |
| CN103688239A (en) * | 2011-03-02 | 2014-03-26 | 朴宰贤 | Method for controlling drawing action using transparent window |
| CN102693059A (en) * | 2011-03-22 | 2012-09-26 | 联想(北京)有限公司 | Input content display method and display apparatus and electronic equipment |
| CN103092458A (en) * | 2011-09-20 | 2013-05-08 | 三星电子株式会社 | Apparatus And Method For Running Application In Mobile Terminal |
| CN103428359A (en) * | 2012-05-21 | 2013-12-04 | Lg电子株式会社 | Mobile terminal and control method thereof |
| CN103577495A (en) * | 2012-08-09 | 2014-02-12 | 腾讯科技(深圳)有限公司 | Gesture operation method and gesture operation device of browser |
| CN103399640A (en) * | 2013-08-16 | 2013-11-20 | 贝壳网际(北京)安全技术有限公司 | Method and device for controlling according to user gesture and client |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106648432A (en) | 2017-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12047706B2 (en) | Display apparatus and control methods thereof | |
| US9965039B2 (en) | Device and method for displaying user interface of virtual input device based on motion recognition | |
| CN110597444B (en) | Handwriting display method and device, terminal device and storage medium | |
| CN107577414A (en) | The method and mobile terminal of split screen display available | |
| CN112866734A (en) | Control method for automatically displaying handwriting input function and display device | |
| KR20040063153A (en) | Method and apparatus for a gesture-based user interface | |
| US20130159940A1 (en) | Gesture-Controlled Interactive Information Board | |
| CN110413187B (en) | Method and device for processing annotations of interactive intelligent equipment | |
| KR20160122753A (en) | Low-latency visual response to input via pre-generation of alternative graphical representations of application elements and input handling on a graphical processing unit | |
| KR20150124235A (en) | User terminal device, and Method for controlling for User terminal device, and multimedia system thereof | |
| CN109388321B (en) | Electronic whiteboard operation method and device | |
| CN107544730A (en) | Picture display method and device and readable storage medium | |
| WO2022073389A1 (en) | Video picture display method and electronic device | |
| WO2019192498A1 (en) | Window split screen display method, device and equipment | |
| WO2018010440A1 (en) | Projection picture adjusting method and apparatus, and projection terminal | |
| US11301124B2 (en) | User interface modification using preview panel | |
| WO2018120448A1 (en) | Method and apparatus for controlling large-screen display device | |
| CN113485613A (en) | Display equipment and method for realizing free-drawing screen edge painting | |
| CN105760092B (en) | A kind of application control method, apparatus and electronic equipment for touch panel device | |
| CN115550717A (en) | Display device and multi-finger touch display method | |
| CN115550716A (en) | Display device and color mixing display method | |
| CN115379254A (en) | Live broadcasting method, live broadcasting device and electronic equipment | |
| CN114281284A (en) | Display apparatus and image display method | |
| CN119828907A (en) | Display equipment and multi-screen display method | |
| CN119828908A (en) | Display device and display method of acceleration layer |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17887853 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17887853 Country of ref document: EP Kind code of ref document: A1 |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 211019) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17887853 Country of ref document: EP Kind code of ref document: A1 |