WO2019042473A1 - Method and apparatus for operating touch display screen, terminal device, and storage medium - Google Patents
Method and apparatus for operating touch display screen, terminal device, and storage medium Download PDFInfo
- Publication number
- WO2019042473A1 WO2019042473A1 PCT/CN2018/103987 CN2018103987W WO2019042473A1 WO 2019042473 A1 WO2019042473 A1 WO 2019042473A1 CN 2018103987 W CN2018103987 W CN 2018103987W WO 2019042473 A1 WO2019042473 A1 WO 2019042473A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display screen
- touch display
- terminal device
- camera
- predetermined
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72469—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/725—Cordless telephones
Definitions
- the present disclosure relates to, but is not limited to, the field of communication technologies, and in particular, to a method and apparatus for operating a touch display screen, a terminal device, and a storage medium.
- the touch display can serve as a very important input to the terminal device.
- the touch function of the touch display may be in an unusable failure state due to some unexpected factors, and the touch function may temporarily fail to return to the available active state. In this case, how to continue to effectively operate and control the terminal equipment becomes particularly important and critical.
- the function of the terminal device in which the touch function of the touch display screen is in a failure state is almost completely lost, and the user cannot effectively operate and control the terminal device in which the touch function of the touch display screen is in a failed state.
- the terminal device can be enabled.
- the data transmission port (for example, a USB port) then connects the terminal device to a device such as a computer through a data transmission port, so that the user can transfer or copy the information stored in the terminal device through computer software or an operation command.
- transferring or copying information stored in the terminal device by connecting the terminal device to a device such as a computer must be completed by means of a computer such as a terminal device.
- the present disclosure provides a method for operating a touch display screen, comprising: starting a camera of a terminal device, superimposing a focus frame formed by focusing of the camera when the camera is photographed on a display window of the touch display screen of the terminal device, without displaying a camera captured by the camera And detecting a position of the focus frame and detecting whether a predetermined physical button of the terminal device receives a pressing operation of a first predetermined manner; and a case where the predetermined physical button receives the pressing operation of the first predetermined mode Next, selecting a control in a display window of the touch display screen corresponding to the current position of the focus frame, and triggering an operation performed by the control.
- the present disclosure also provides an apparatus for operating a touch display screen, comprising: a processing module configured to activate a camera of the terminal device, and superimposing a focus frame formed by focusing of the camera when the camera is photographed on a display window of the touch display screen of the terminal device, instead of Displaying an image captured by the camera; the first detecting module is configured to detect a position of the focus frame, and detect whether a predetermined physical button of the terminal device receives a pressing operation of a first predetermined manner; and an execution module configured to be at the terminal device In the case that the predetermined physical button receives the pressing operation of the first predetermined manner, the control in the display window of the touch display screen corresponding to the current position of the focus frame is selected, and the operation corresponding to the control is triggered to be executed. .
- the present disclosure also provides a terminal device including a camera, a predetermined physical button, and a touch display screen, including the above-described device for operating a touch display screen.
- the present disclosure also provides a storage medium storing a computer program that, when executed, implements the above-described method of operating a touch screen.
- FIG. 1 is a flow chart of a method of operating a touch display screen in accordance with an embodiment of the present disclosure
- FIG. 2 is a schematic structural diagram of an apparatus for operating a touch display screen according to an embodiment of the present disclosure
- FIG. 3 is a functional block diagram of an apparatus for operating a touch display screen of an embodiment of the present disclosure
- FIG. 4 is a schematic diagram of a display window of a touch display screen of an embodiment of the present disclosure.
- FIG. 1 shows a flow chart of a method of operating a touch display screen of an embodiment of the present disclosure. As shown in FIG. 1, the method includes steps S102 to S106.
- the image captured by the camera may be processed in a predetermined processing manner so that the image captured by the camera is not presented on the display window of the touch display screen, and the focus frame formed by the focus of the camera is displayed on the touch display screen. On the display window.
- the position of the focus frame can be detected by tracking the movement of the focus frame.
- the control in the display window of the touch display screen may be selected according to the current position of the focus frame. For example, you can select a control with a large area covered by the focus frame, or you can select the current position of the reference point by using any point of the focus frame (for example, the point in the upper right corner of the focus frame, the center point, etc.) as the selection reference point. Corresponding to the controls in the display window of the touch display.
- the position of the center point of the focus frame can be determined according to the size and position of the focus frame, and then the position of the center point of the focus frame can be tracked and detected.
- selecting a control in the display window of the touch display screen corresponding to the current position of the focus frame and triggering the operation corresponding to the operation of the control is equivalent to the user touching the control in the display window of the touch display screen by touch to trigger the The process of the operation corresponding to the control.
- the pressing position of the first predetermined mode is received by the predetermined physical button to confirm the position of the focus frame, thereby selecting the control in the display window of the touch display screen corresponding to the current position of the focus frame and triggering the corresponding control.
- the operation of the operation enables the control in the display window of the touch display screen to be operated even if the touch function of the touch display screen fails.
- the position of the focus frame may be confirmed by receiving a pressing operation of the first predetermined manner by a predetermined physical button, thereby selecting a control in the display window of the touch display screen corresponding to the current position of the focus frame and triggering the corresponding control
- the operation performed by the operation is associated with the operation of the corresponding control in the display window of the touch display screen being touched to trigger the operation of the control, so that even if the touch function of the touch display screen is disabled, the focus can be formed by the camera when shooting.
- the focus frame operates on the controls in the display window of the touch display.
- the focus in the display window of the touch display screen that needs to be triggered is selected by the focus frame formed by the camera when the camera is photographed, and then the pressing operation of the first predetermined mode is received by the predetermined physical button to confirm the selection and trigger the corresponding control.
- Operation execution for example, changing the display interface in the display window of the touch display screen
- the process does not need to touch the touch function of the display screen, improves the multi-scene application capability of the terminal device, provides a better user experience, and solves the problem
- the touch function of the touch display screen is disabled, the user cannot effectively operate and control the terminal device, and the function of the terminal device is almost completely lost.
- the touch of the terminal device may be detected according to the predetermined detection method before the method of the embodiment is performed. Whether the touch function of the display screen is invalid, and when the touch function of the touch display screen of the terminal device fails, when the touch display screen of the terminal device is illuminated, a trigger signal for starting the camera is sent.
- the method corresponding to the operation of the touch display screen of the present embodiment is provided with an opening mechanism, that is, the above steps S102 to S106 are implemented in the case where the touch function of the touch display screen is disabled.
- the predetermined physical button receives the pressing operation of the second predetermined manner, and in the case that the predetermined physical button receives the pressing operation of the second predetermined mode,
- the display window of the touch display screen returns from the current display interface to the previous display interface. In this way, the user can quickly return to the previous display interface after erroneously selecting the control, thereby improving the user experience.
- the pressing operation of the second predetermined mode of the process may be to press the predetermined physical button twice in succession.
- the pressing operation of the first predetermined mode and the pressing operation of the second predetermined mode in this embodiment may be set and changed as needed, and are not specifically limited herein. Generally, the pressing operation of the first predetermined mode is different from the pressing operation of the second predetermined mode.
- FIG. 2 is a block diagram showing the structure of an apparatus for operating a touch display screen of an embodiment of the present disclosure.
- the apparatus for operating the touch display screen of the present embodiment may be disposed in a terminal device including a touch display screen.
- the apparatus for operating a touch display screen of the present embodiment may include a processing module 10, a first detecting module 11, and an executing module 12.
- the processing module 10 is configured to activate the camera of the terminal device, and superimpose the focus frame formed by the focus of the camera when the camera is photographed on the display window of the touch display screen of the terminal device, without displaying the image captured by the camera.
- the processing module 10 may process the image captured by the camera in a predetermined processing manner such that the image captured by the camera is not presented on the display window of the touch display screen, and the focus frame formed by the focus of the camera is displayed on the touch display. On the display window of the screen.
- the first detecting module 11 is coupled to the processing module 10, and the first detecting module 11 is configured to detect the position of the focus frame and detect whether the predetermined physical button of the terminal device receives the pressing operation of the first predetermined mode.
- the position of the focus frame can be detected by tracking the movement of the focus frame.
- the execution module 12 is coupled to the first detection module 11, and the execution module 12 is configured to select the display of the touch display screen corresponding to the current position of the focus frame if the predetermined physical button of the terminal device receives the pressing operation of the first predetermined mode.
- the control in the display window of the touch display screen can be selected according to the current position of the focus frame. For example, you can select a control with a large area covered by the focus frame, or you can select the current position of the reference point by using any point of the focus frame (for example, the point in the upper right corner of the focus frame, the center point, etc.) as the selection reference point.
- the first detecting module 11 is configured to determine the position of the center point of the focus frame according to the size and position of the focus frame, and then track and detect the position of the center point of the focus frame.
- the process of selecting the control in the display window of the touch display screen corresponding to the current position of the focus frame and triggering the operation corresponding to the operation of the control is equivalent to the user triggering by touching the control in the display window of the touch display screen to trigger The process that the control corresponds to.
- the pressing position of the first predetermined mode is received by the predetermined physical button to confirm the position of the focus frame, thereby selecting the control in the display window of the touch display screen corresponding to the current position of the focus frame and triggering the corresponding control.
- the operation of the operation enables the control in the display window of the touch display screen to be operated even if the touch function of the touch display screen fails.
- the device for operating the touch display screen may further include: a second detecting module 13 configured to detect whether a touch function of the touch display screen of the terminal device is invalid according to a predetermined detecting method;
- the sending module 14 is coupled to the processing module 10 and the second detecting module 13 and configured to send the startup terminal device when the touch display screen is illuminated when the touch function of the touch display screen of the terminal device is detected to be invalid.
- the trigger signal of the camera may further include: a second detecting module 13 configured to detect whether a touch function of the touch display screen of the terminal device is invalid according to a predetermined detecting method;
- the sending module 14 is coupled to the processing module 10 and the second detecting module 13 and configured to send the startup terminal device when the touch display screen is illuminated when the touch function of the touch display screen of the terminal device is detected to be invalid.
- the trigger signal of the camera may further include: a second detecting module 13 configured to detect whether a touch function of the touch display screen of the terminal device is invalid according to a predetermined detecting method;
- the first detection module 11 is further configured to detect whether a predetermined physical button receives a second predetermined manner of pressing operation
- the execution module 12 is further configured to receive a second predetermined manner of pressing operation at a predetermined physical button
- the display window of the touch display screen is returned from the current display interface to the previous display interface. In this way, the user can quickly return to the previous display interface after erroneously selecting the control, thereby improving the user experience.
- the pressing operation of the second predetermined mode of the process may be to press the predetermined physical button twice in succession.
- the pressing operation of the first predetermined mode and the pressing operation of the second predetermined mode in this embodiment may be set and changed as needed, and are not specifically limited herein. Generally, the pressing operation of the first predetermined mode is different from the pressing operation of the second predetermined mode.
- the method and apparatus for operating the touch display screen of the above embodiments can be implemented by software, hardware or a combination thereof, and the hardware can be a processor and integrated. Circuits, etc.
- the hardware may be a general-purpose hardware platform, and the essential or contributing portion of the technical solution of the embodiments of the present disclosure may be embodied in the form of a software product (eg, executable instructions) stored in the storage medium.
- a software product eg, executable instructions
- a magnetic disk, an optical disk a method and apparatus for operating a touch display screen of an embodiment of the present disclosure are implemented by reading and executing executable instructions of a software product through a general hardware platform.
- Embodiments of the present disclosure also provide a storage medium storing program code including executable instructions, the program code being executed to implement the steps of: activating a camera of a terminal device, a touch display screen of the terminal device The display window is superimposed to display the focus frame formed by the focus of the camera shooting, without displaying the image captured by the camera; detecting the position of the focus frame, and detecting whether the predetermined physical button of the terminal device receives the pressing operation of the first predetermined mode; When the predetermined physical button of the terminal device receives the pressing operation of the first predetermined manner, the control in the display window of the touch display screen corresponding to the current position of the focus frame is selected, and the operation corresponding to the control is triggered.
- the program code of the present embodiment can be scheduled before execution of the program code of the embodiment.
- the detecting method detects whether the touch function of the touch display screen of the terminal device is invalid. When the touch function of the touch display screen of the terminal device fails, when the touch display screen of the terminal device is illuminated, a trigger signal for starting the camera is sent. Thus, the opening mechanism corresponding to the execution of the program code of the present embodiment is set, that is, the program code of the present embodiment is executed in the case where the touch function of the touch display screen is disabled.
- the program code of the embodiment is further executed to: after detecting the execution of the operation corresponding to the trigger control, detecting whether the predetermined physical button receives the pressing operation of the second predetermined mode, and receiving at the predetermined physical button
- the display window of the touch display screen is returned from the current display interface to the previous display interface. In this way, the user can quickly return to the previous display interface after erroneously selecting the control, thereby improving the user experience.
- the pressing operation of the second predetermined mode of the process may be to press the predetermined physical button twice in succession.
- the pressing operation of the first predetermined mode and the pressing operation of the second predetermined mode in this embodiment may be set and changed as needed, and are not specifically limited herein. Generally, the pressing operation of the first predetermined mode is different from the pressing operation of the second predetermined mode.
- the foregoing storage medium may include, but is not limited to, a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk.
- ROM Read-Only Memory
- RAM Random Access Memory
- a medium that can store program code may include, but is not limited to, a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk.
- the processor executes program code stored in a storage medium to implement a method of operating a touch display screen of an embodiment of the present disclosure.
- program code stored in a storage medium to implement a method of operating a touch display screen of an embodiment of the present disclosure.
- modules or steps of an embodiment of the present disclosure may be implemented by a general-purpose computing device (eg, a processor), which may be integrated on a single computing device or distributed across multiple computing On the network of devices.
- various modules or steps of an embodiment of the present disclosure may be implemented by program code executable by a computing device, which may be stored and read by a computing device in a storage device.
- the steps shown or described in this disclosure may be performed in an order different than that shown or described.
- Modules or steps of the embodiments of the present disclosure may be separately implemented as individual integrated circuits, or portions of the modules or steps of the embodiments of the present disclosure may be integrated into a single integrated circuit.
- the present disclosure is not limited to any particular form of software, hardware or a combination thereof.
- the technical solution provided by the embodiments of the present disclosure enables the terminal device to be effectively operated and controlled after the touch function of the touch display screen of the terminal device is disabled. For example, after the touch function of the touch display screen of the terminal device is disabled, the front camera of the terminal device is activated, the display of the touch display screen of the terminal device is layered, the lower layer displays the normal output display window of the terminal device, and the upper layer superimposes the display camera.
- the change of the user's face position causes the movement of the face recognition frame, and the change of the distance between the user's face and the camera results in a change in the size of the face recognition frame, thereby enabling the person to be
- the face recognition frame is positioned to a desired position to select a desired control in the regular output display window of the terminal device, and then receives a predetermined manner of pressing operation in conjunction with the predetermined physical button to confirm selection of the desired control and trigger operation execution corresponding to the desired control.
- the technical solution of the embodiment of the present disclosure is applicable to a terminal device having, for example, a front camera, a touch display screen, and a physical button configured to perform an input operation, and the display function of the touch display screen of the terminal device is normal.
- FIG. 3 illustrates a functional block diagram of an apparatus for operating a touch display screen of an embodiment of the present disclosure.
- the apparatus for operating a touch display screen of an embodiment of the present disclosure may include a master device module, a display processing module, a data processing module, and an input/output module.
- the main control device module can be implemented, for example, by the second detecting module 13 and the sending module 14 shown in FIG. 2, configured to detect whether the touch function of the touch display screen of the terminal device is in a failure state according to a predetermined detecting method, and send a trigger signal to start the terminal.
- the front camera of the device For example, the front camera of the device.
- the display processing module can be implemented, for example, by the processing module 10 as shown in FIG. 2, configured to hierarchically process the display of the touch display screen of the terminal device, the lower layer display the normal output display window of the terminal device, and the upper layer superimposed display, for example, the front camera to the user's face.
- the partially recognized face recognition frame that is, the image captured by the front camera is filtered, and only the face recognition frame that the front camera recognizes the user's face is retained.
- the data processing module is implemented, for example, by the first detection module 11 shown in FIG. 2, configured to detect the position (eg, coordinates) of the face recognition frame, and report the position of the face recognition frame as an input to the input/output module.
- the coordinates of the center point of the face recognition frame can be reported as input to the input/output module.
- the input/output module is implemented, for example, by the execution module 12 shown in FIG. 2, configured to receive the location of the face recognition frame reported by the data processing module and to correspond to the corresponding control in the regular output display window of the terminal device. To select the control and trigger the corresponding action of the control.
- the following method of touching the display screen can be realized: when the touch function of the touch display screen of the terminal device fails, the front camera of the terminal device is activated, and the front camera is passed through Changing the relative position of the face of the user, changing the position and size of the face recognition frame of the front camera to identify the face of the user; detecting whether the predetermined physical button of the terminal device receives the pressing operation of the predetermined mode to confirm the face recognition frame Position; select the control in the display window of the touch display corresponding to the current position of the face recognition box, and trigger the operation corresponding to triggering the control.
- the identifier parameter that determines whether the touch function of the touch display screen of the terminal device is invalid may be written into the file system of the terminal device as a system parameter. If the touch function of the touch display screen of the terminal device is in a failed state, after the system of the terminal device is woken up, the front camera of the terminal device is activated, and the front camera is superimposed and displayed on the display window of the touch display screen of the terminal device.
- the face recognition box of the face does not display the image captured by the camera, and then adjusts the positional relationship between the user's face and the front camera, that is, adjusts the position and size of the face recognition frame in the display window of the touch display screen.
- the predetermined physical button When the user confirms that the current position and size of the face recognition frame corresponds to the desired control in the display window, the predetermined physical button may be pressed for confirmation, and after the predetermined physical button receives the pressing operation of the predetermined mode, the instruction is sent to the desired control.
- the desired control gets the corresponding instruction to trigger the corresponding operation of the control.
- the input/output module may be configured to issue an instruction to the corresponding control according to the location of the face recognition frame reported by the data processing module, and the corresponding control triggers the corresponding operation after obtaining the instruction, for example, entering the corresponding application. Or enter the next display interface of the corresponding application.
- controls in the embodiments of the present disclosure may be presented in the form of icons, characters, etc., and selecting, touching, etc. the controls may trigger the terminal device to perform corresponding operations.
- a plurality of controls in the form of icons or characters may be displayed in the display window of the touch display of the terminal device, and the controls may accept input operations (eg, selection, touch, etc.) to trigger the terminal device to perform corresponding operations.
- input operations eg, selection, touch, etc.
- the predetermined physical button in the embodiment of the present disclosure refers to a physics capable of receiving, for example, a pressing operation and sending an instruction to a corresponding (eg, selected by a face recognition frame) to trigger an operation corresponding to the operation of the control. button.
- FIG. 4 shows a schematic diagram of a display window of a touch display screen of an embodiment of the present disclosure.
- a plurality of controls 403 are displayed in the display window 401 of the touch display screen of the terminal device.
- any control 403 can be touched to trigger the corresponding operation execution.
- the camera of the terminal device is activated to superimpose and display the face recognition frame 402 of the user's face on the display window 401 of the touch display screen, and the positional relationship between the camera and the user can be adjusted.
- the position and size of the face recognition frame 402 is adjusted to select any of the controls 403 and trigger the corresponding operation to be performed.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
Description
相关领域的交叉引用Cross-references in related fields
本申请要求于2017年9月4日提交的题为“一种操作屏幕的方法、装置、移动终端和存储介质”的中国专利申请NO.201710786342.4的优先权,该中国专利申请的内容通过引用的方式整体合并于此。The present application claims priority to Chinese Patent Application No. 201710786342.4, filed on Sep. 4, 2009, entitled,,,,,,,,,,,,,, The way is integrated as a whole.
本公开涉及但不限于通讯技术领域,特别涉及操作触摸显示屏的方法及装置、终端设备和存储介质。The present disclosure relates to, but is not limited to, the field of communication technologies, and in particular, to a method and apparatus for operating a touch display screen, a terminal device, and a storage medium.
对于包括触摸显示屏的终端设备(例如移动终端)来说,触摸显示屏可作为该终端设备的非常重要的输入端。但是,在使用过程中,触摸显示屏的触摸功能可能会由于一些意外因素而处于不可用的失效状态,且该触摸功能可能暂时无法恢复至可用的有效状态。在这种情形下,如何能继续对终端设备进行有效操作和控制变得尤为重要和关键。For a terminal device (such as a mobile terminal) that includes a touch display, the touch display can serve as a very important input to the terminal device. However, during use, the touch function of the touch display may be in an unusable failure state due to some unexpected factors, and the touch function may temporarily fail to return to the available active state. In this case, how to continue to effectively operate and control the terminal equipment becomes particularly important and critical.
目前,触摸显示屏的触摸功能处于失效状态的终端设备的功能几乎完全丧失,用户无法对触摸显示屏的触摸功能处于失效状态的终端设备进行有效操作和控制。为了使得触摸显示屏的触摸功能处于失效状态的终端设备仍能保留一些用处,比如为了能够获取到触摸显示屏的触摸功能处于失效状态的终端设备中保存的全部或部分信息,可以启用终端设备的数据传输端口(例如,USB端口),然后使终端设备通过数据传输端口连接至计算机等设备,从而用户可通过计算机软件或操作命令来转移或拷贝终端设备中保存的信息。然而,通过将终端设备连接至计算机等设备来转移或拷贝终端设备中保存的信息必须借助终端设备之外的计算机等设备才能完成。At present, the function of the terminal device in which the touch function of the touch display screen is in a failure state is almost completely lost, and the user cannot effectively operate and control the terminal device in which the touch function of the touch display screen is in a failed state. In order to make the terminal device in which the touch function of the touch display screen is in a disabled state, some functions can still be retained, for example, in order to be able to obtain all or part of information stored in the terminal device in which the touch function of the touch display screen is in a failed state, the terminal device can be enabled. The data transmission port (for example, a USB port) then connects the terminal device to a device such as a computer through a data transmission port, so that the user can transfer or copy the information stored in the terminal device through computer software or an operation command. However, transferring or copying information stored in the terminal device by connecting the terminal device to a device such as a computer must be completed by means of a computer such as a terminal device.
公开内容Public content
本公开提供一种操作触摸显示屏的方法,包括:启动终端设备的摄像头,在终端设备的触摸显示屏的显示窗口上叠加显示所述摄像头拍摄时聚焦形成的焦点框,而不显示摄像头所捕获的图像;检测所述焦点框的位置,并检测终端设备的预定物理按键是否接收到第一预定方式的按压操作;以及在所述预定物理按键接收到所述第一预定方式的按压操作的情况下,选择所述焦点框的当前位置对应的触摸显示屏的显示窗口中的控件,并触发所述控件对应的操作执行。The present disclosure provides a method for operating a touch display screen, comprising: starting a camera of a terminal device, superimposing a focus frame formed by focusing of the camera when the camera is photographed on a display window of the touch display screen of the terminal device, without displaying a camera captured by the camera And detecting a position of the focus frame and detecting whether a predetermined physical button of the terminal device receives a pressing operation of a first predetermined manner; and a case where the predetermined physical button receives the pressing operation of the first predetermined mode Next, selecting a control in a display window of the touch display screen corresponding to the current position of the focus frame, and triggering an operation performed by the control.
本公开还提供一种操作触摸显示屏的装置,包括:处理模块,配置为启动终端设备的摄像头,在终端设备的触摸显示屏的显示窗口上叠加显示摄像头拍摄时聚焦形成的焦点框,而不显示摄像头所捕获的图像;第一检测模块,配置为检测所述焦点框的位置,并检测终端设备的预定物理按键是否接收到第一预定方式的按压操作;以及执行模块,配置为在终端设备的所述预定物理按键接收到所述第一预定方式的按压操作的情况下,选择所述焦点框的当前位置对应的触摸显示屏的显示窗口中的控件,并触发所述控件对应的操作执行。The present disclosure also provides an apparatus for operating a touch display screen, comprising: a processing module configured to activate a camera of the terminal device, and superimposing a focus frame formed by focusing of the camera when the camera is photographed on a display window of the touch display screen of the terminal device, instead of Displaying an image captured by the camera; the first detecting module is configured to detect a position of the focus frame, and detect whether a predetermined physical button of the terminal device receives a pressing operation of a first predetermined manner; and an execution module configured to be at the terminal device In the case that the predetermined physical button receives the pressing operation of the first predetermined manner, the control in the display window of the touch display screen corresponding to the current position of the focus frame is selected, and the operation corresponding to the control is triggered to be executed. .
本公开还提供一种包括摄像头、预定物理按键、触摸显示屏的终端设备,包括上述的操作触摸显示屏的装置。The present disclosure also provides a terminal device including a camera, a predetermined physical button, and a touch display screen, including the above-described device for operating a touch display screen.
本公开还提供一种存储介质,存储有计算机程序,所述计算机程序被执行时实现上述操作触摸显示屏的方法。The present disclosure also provides a storage medium storing a computer program that, when executed, implements the above-described method of operating a touch screen.
图1是本公开的实施例的操作触摸显示屏的方法的流程图;1 is a flow chart of a method of operating a touch display screen in accordance with an embodiment of the present disclosure;
图2是本公开的实施例的操作触摸显示屏的装置的结构示意图;2 is a schematic structural diagram of an apparatus for operating a touch display screen according to an embodiment of the present disclosure;
图3是本公开的实施例的操作触摸显示屏的装置的功能框图;3 is a functional block diagram of an apparatus for operating a touch display screen of an embodiment of the present disclosure;
图4是本公开的实施例的触摸显示屏的显示窗口的示意图。4 is a schematic diagram of a display window of a touch display screen of an embodiment of the present disclosure.
以下结合附图以及实施例,对本公开的技术方案进行详细说明。 应当理解,所描述的实施例仅仅用以解释本公开,并不旨在限定本公开。The technical solutions of the present disclosure will be described in detail below with reference to the accompanying drawings and embodiments. It is to be understood that the described embodiments are only illustrative of the disclosure and are not intended to be limiting.
图1示出了本公开的实施例的操作触摸显示屏的方法的流程图。如图1所示,所述方法包括步骤S102至S106。FIG. 1 shows a flow chart of a method of operating a touch display screen of an embodiment of the present disclosure. As shown in FIG. 1, the method includes steps S102 to S106.
S102,启动终端设备的摄像头,在终端设备的触摸显示屏的显示窗口上叠加显示摄像头拍摄时聚焦形成的焦点框,而不显示摄像头所捕获的图像。S102. Start a camera of the terminal device, and superimpose, on the display window of the touch display screen of the terminal device, a focus frame formed by focusing when the camera is photographed, without displaying an image captured by the camera.
该步骤中,可以以预定处理方式对摄像头所捕获的图像进行处理,以使得摄像头所捕获的图像不呈现在触摸显示屏的显示窗口上,而摄像头拍摄时聚焦形成的焦点框呈现在触摸显示屏的显示窗口上。In this step, the image captured by the camera may be processed in a predetermined processing manner so that the image captured by the camera is not presented on the display window of the touch display screen, and the focus frame formed by the focus of the camera is displayed on the touch display screen. On the display window.
S104,检测焦点框的位置,并检测终端设备的预定物理按键是否接收到第一预定方式的按压操作。S104. Detect a position of the focus frame, and detect whether the predetermined physical button of the terminal device receives the pressing operation of the first predetermined manner.
由于焦点框会根据被拍摄物体的位置等而移动,且焦点框的大小也会根据被拍摄物体与摄像头之间的距离而改变,因此,可以跟踪焦点框的移动而检测焦点框的位置。Since the focus frame moves according to the position of the object to be photographed, and the size of the focus frame is also changed according to the distance between the object to be photographed and the camera, the position of the focus frame can be detected by tracking the movement of the focus frame.
S106,在终端设备的预定物理按键接收到第一预定方式的按压操作的情况下,选择焦点框的当前位置对应的触摸显示屏的显示窗口中的控件,并触发该控件对应的操作执行。S106: In a case that the predetermined physical button of the terminal device receives the pressing operation of the first predetermined manner, the control in the display window of the touch display screen corresponding to the current position of the focus frame is selected, and the operation corresponding to the control is triggered.
当预定物理按键接收到第一预定方式的按压操作(例如单次按压)时,可以根据焦点框的当前位置来选择触摸显示屏的显示窗口中的控件。例如,可以选择被焦点框框住面积较大的控件,也可以以焦点框的任意点(例如,焦点框的右上角的点、中心点等)作为选择基准点,来选择选择基准点的当前位置对应的触摸显示屏的显示窗口中的控件。如果以焦点框的中心点作为选择基准点,则检测焦点框的位置时,可以根据焦点框的大小和位置确定焦点框的中心点的位置,然后跟踪并检测焦点框的中心点的位置。When the predetermined physical button receives the pressing operation of the first predetermined mode (for example, a single press), the control in the display window of the touch display screen may be selected according to the current position of the focus frame. For example, you can select a control with a large area covered by the focus frame, or you can select the current position of the reference point by using any point of the focus frame (for example, the point in the upper right corner of the focus frame, the center point, etc.) as the selection reference point. Corresponding to the controls in the display window of the touch display. If the center point of the focus frame is used as the selection reference point, when detecting the position of the focus frame, the position of the center point of the focus frame can be determined according to the size and position of the focus frame, and then the position of the center point of the focus frame can be tracked and detected.
该步骤中,选择焦点框的当前位置对应的触摸显示屏的显示窗口中的控件并触发该控件对应的操作执行的过程就相当于用户通过触摸选择触摸显示屏的显示窗口中的控件以触发该控件对应的操作执行的过程。In this step, selecting a control in the display window of the touch display screen corresponding to the current position of the focus frame and triggering the operation corresponding to the operation of the control is equivalent to the user touching the control in the display window of the touch display screen by touch to trigger the The process of the operation corresponding to the control.
然而,本实施例中,可以通过预定物理按键接收第一预定方式的按压操作来确认焦点框的位置,从而选择焦点框的当前位置对应的触摸显示屏的显示窗口中的控件并触发该控件对应的操作执行,即使触摸显示屏的触摸功能失效,也能够对触摸显示屏的显示窗口中的控件进行操作。However, in this embodiment, the pressing position of the first predetermined mode is received by the predetermined physical button to confirm the position of the focus frame, thereby selecting the control in the display window of the touch display screen corresponding to the current position of the focus frame and triggering the corresponding control. The operation of the operation enables the control in the display window of the touch display screen to be operated even if the touch function of the touch display screen fails.
在实际应用中,可预先将通过预定物理按键接收第一预定方式的按压操作来确认焦点框的位置从而选择焦点框的当前位置对应的触摸显示屏的显示窗口中的控件并触发该控件对应的操作执行的操作与触摸显示屏的显示窗口中的对应控件被触摸而触发该控件对应的操作执行的操作进行关联,这样,即使触摸显示屏的触摸功能失效,也可以通过摄像头拍摄时聚焦形成的焦点框来对触摸显示屏的显示窗口中的控件进行操作。In a practical application, the position of the focus frame may be confirmed by receiving a pressing operation of the first predetermined manner by a predetermined physical button, thereby selecting a control in the display window of the touch display screen corresponding to the current position of the focus frame and triggering the corresponding control The operation performed by the operation is associated with the operation of the corresponding control in the display window of the touch display screen being touched to trigger the operation of the control, so that even if the touch function of the touch display screen is disabled, the focus can be formed by the camera when shooting. The focus frame operates on the controls in the display window of the touch display.
本实施例中,通过摄像头拍摄时聚焦形成的焦点框来选择需要触发的触摸显示屏的显示窗口中的控件,再通过预定物理按键接收第一预定方式的按压操作来确认选择并触发控件对应的操作执行(例如,改变触摸显示屏的显示窗口中的显示界面),该过程无需触摸显示屏的触摸功能,提高了终端设备的多场景应用能力,提供了较好的用户体验,且解决了在触摸显示屏的触摸功能失效后用户无法对终端设备进行有效操作和控制、终端设备的功能几乎完全丧失的问题。In this embodiment, the focus in the display window of the touch display screen that needs to be triggered is selected by the focus frame formed by the camera when the camera is photographed, and then the pressing operation of the first predetermined mode is received by the predetermined physical button to confirm the selection and trigger the corresponding control. Operation execution (for example, changing the display interface in the display window of the touch display screen), the process does not need to touch the touch function of the display screen, improves the multi-scene application capability of the terminal device, provides a better user experience, and solves the problem After the touch function of the touch display screen is disabled, the user cannot effectively operate and control the terminal device, and the function of the terminal device is almost completely lost.
由于本实施例的方法比通过触摸选择触摸显示屏的显示窗口中的控件而触发该控件对应的操作执行复杂,因此,在执行本实施例的方法之前,可以按照预定检测方法检测终端设备的触摸显示屏的触摸功能是否失效,在终端设备的触摸显示屏的触摸功能失效的情况下,当终端设备的触摸显示屏被点亮时,发送启动摄像头的触发信号。这样,相当于为本实施例的操作触摸显示屏的方法设置了开启机制,即在触摸显示屏的触摸功能失效的情况下才实施上述步骤S102至S106。Since the method of the embodiment is more complicated to perform the operation corresponding to triggering the control by touching the control in the display window of the touch display screen, the touch of the terminal device may be detected according to the predetermined detection method before the method of the embodiment is performed. Whether the touch function of the display screen is invalid, and when the touch function of the touch display screen of the terminal device fails, when the touch display screen of the terminal device is illuminated, a trigger signal for starting the camera is sent. Thus, the method corresponding to the operation of the touch display screen of the present embodiment is provided with an opening mechanism, that is, the above steps S102 to S106 are implemented in the case where the touch function of the touch display screen is disabled.
在一些实施方式中,在触发控件对应的操作执行之后,还可以检测预定物理按键是否接收到第二预定方式的按压操作,并在预定物理按键接收到第二预定方式的按压操作的情况下,触摸显示屏的显示窗口从当前显示界面返回至前一显示界面。这样,使得用户在错误地 选择控件后能够快速地返回到前一显示界面,提高了用户体验。该过程的第二预定方式的按压操作可以是连续两次按压上述预定物理按键。In some embodiments, after the operation corresponding to the trigger control is performed, it is also possible to detect whether the predetermined physical button receives the pressing operation of the second predetermined manner, and in the case that the predetermined physical button receives the pressing operation of the second predetermined mode, The display window of the touch display screen returns from the current display interface to the previous display interface. In this way, the user can quickly return to the previous display interface after erroneously selecting the control, thereby improving the user experience. The pressing operation of the second predetermined mode of the process may be to press the predetermined physical button twice in succession.
应当理解的是,本实施例中的第一预定方式的按压操作和第二预定方式的按压操作可以根据需要进行设置和改变,在此不进行具体限定。一般来说,第一预定方式的按压操作不同于第二预定方式的按压操作。It should be understood that the pressing operation of the first predetermined mode and the pressing operation of the second predetermined mode in this embodiment may be set and changed as needed, and are not specifically limited herein. Generally, the pressing operation of the first predetermined mode is different from the pressing operation of the second predetermined mode.
图2示出了本公开的实施例的操作触摸显示屏的装置的结构示意图。本实施例的操作触摸显示屏的装置可设置在包括触摸显示屏的终端设备中。如图2所示,本实施例的操作触摸显示屏的装置可包括处理模块10、第一检测模块11和执行模块12。2 is a block diagram showing the structure of an apparatus for operating a touch display screen of an embodiment of the present disclosure. The apparatus for operating the touch display screen of the present embodiment may be disposed in a terminal device including a touch display screen. As shown in FIG. 2, the apparatus for operating a touch display screen of the present embodiment may include a processing module 10, a first detecting module 11, and an executing module 12.
处理模块10配置为启动终端设备的摄像头,在终端设备的触摸显示屏的显示窗口上叠加显示摄像头拍摄时聚焦形成的焦点框,而不显示摄像头所捕获的图像。The processing module 10 is configured to activate the camera of the terminal device, and superimpose the focus frame formed by the focus of the camera when the camera is photographed on the display window of the touch display screen of the terminal device, without displaying the image captured by the camera.
例如,处理模块10可以以预定处理方式对摄像头所捕获的图像进行处理,以使得摄像头所捕获的图像不呈现在触摸显示屏的显示窗口上,而摄像头拍摄时聚焦形成的焦点框呈现在触摸显示屏的显示窗口上。For example, the processing module 10 may process the image captured by the camera in a predetermined processing manner such that the image captured by the camera is not presented on the display window of the touch display screen, and the focus frame formed by the focus of the camera is displayed on the touch display. On the display window of the screen.
第一检测模块11与处理模块10耦合,且第一检测模块11配置为检测焦点框的位置,并检测终端设备的预定物理按键是否接收到第一预定方式的按压操作。The first detecting module 11 is coupled to the processing module 10, and the first detecting module 11 is configured to detect the position of the focus frame and detect whether the predetermined physical button of the terminal device receives the pressing operation of the first predetermined mode.
由于焦点框会根据被拍摄物体的位置等而移动,且焦点框的大小也会根据被拍摄物体与摄像头之间的距离而改变,因此,可以跟踪焦点框的移动而检测焦点框的位置。Since the focus frame moves according to the position of the object to be photographed, and the size of the focus frame is also changed according to the distance between the object to be photographed and the camera, the position of the focus frame can be detected by tracking the movement of the focus frame.
执行模块12与第一检测模块11耦合,且执行模块12配置为在终端设备的预定物理按键接收到第一预定方式的按压操作的情况下,选择焦点框的当前位置对应的触摸显示屏的显示窗口中的控件,并触发该控件对应的操作执行。The execution module 12 is coupled to the first detection module 11, and the execution module 12 is configured to select the display of the touch display screen corresponding to the current position of the focus frame if the predetermined physical button of the terminal device receives the pressing operation of the first predetermined mode. The control in the window and triggers the corresponding action execution of the control.
当预定物理按键接收到第一预定方式的按压操作(例如单次按压)时,就可以根据焦点框的当前位置来选择触摸显示屏的显示窗口 中的控件。例如,可以选择被焦点框框住面积较大的控件,也可以以焦点框的任意点(例如,焦点框的右上角的点、中心点等)作为选择基准点,来选择选择基准点的当前位置对应的触摸显示屏的显示窗口中的控件。如果以焦点框的中心点作为选择基准点,则第一检测模块11配置为根据焦点框的大小和位置确定焦点框的中心点的位置,然后跟踪并检测焦点框的中心点的位置。When the predetermined physical button receives the pressing operation of the first predetermined mode (e.g., a single press), the control in the display window of the touch display screen can be selected according to the current position of the focus frame. For example, you can select a control with a large area covered by the focus frame, or you can select the current position of the reference point by using any point of the focus frame (for example, the point in the upper right corner of the focus frame, the center point, etc.) as the selection reference point. Corresponding to the controls in the display window of the touch display. If the center point of the focus frame is used as the selection reference point, the first detecting module 11 is configured to determine the position of the center point of the focus frame according to the size and position of the focus frame, and then track and detect the position of the center point of the focus frame.
本实施例中,选择焦点框的当前位置对应的触摸显示屏的显示窗口中的控件并触发该控件对应的操作执行的过程就相当于用户通过触摸选择触摸显示屏的显示窗口中的控件以触发该控件对应的操作执行的过程。In this embodiment, the process of selecting the control in the display window of the touch display screen corresponding to the current position of the focus frame and triggering the operation corresponding to the operation of the control is equivalent to the user triggering by touching the control in the display window of the touch display screen to trigger The process that the control corresponds to.
然而,本实施例中,可以通过预定物理按键接收第一预定方式的按压操作来确认焦点框的位置,从而选择焦点框的当前位置对应的触摸显示屏的显示窗口中的控件并触发该控件对应的操作执行,即使触摸显示屏的触摸功能失效,也能够对触摸显示屏的显示窗口中的控件进行操作。However, in this embodiment, the pressing position of the first predetermined mode is received by the predetermined physical button to confirm the position of the focus frame, thereby selecting the control in the display window of the touch display screen corresponding to the current position of the focus frame and triggering the corresponding control. The operation of the operation enables the control in the display window of the touch display screen to be operated even if the touch function of the touch display screen fails.
在一些实施方式中,如图2所示,所述操作触摸显示屏的装置还可以包括:第二检测模块13,配置为按照预定检测方法检测终端设备的触摸显示屏的触摸功能是否失效;以及发送模块14,其与处理模块10和第二检测模块13耦合,配置为在检测到终端设备的触摸显示屏的触摸功能失效的情况下,当触摸显示屏被点亮时,发送启动终端设备的摄像头的触发信号。In some embodiments, as shown in FIG. 2, the device for operating the touch display screen may further include: a second detecting module 13 configured to detect whether a touch function of the touch display screen of the terminal device is invalid according to a predetermined detecting method; The sending module 14 is coupled to the processing module 10 and the second detecting module 13 and configured to send the startup terminal device when the touch display screen is illuminated when the touch function of the touch display screen of the terminal device is detected to be invalid. The trigger signal of the camera.
在一些实施方式中,第一检测模块11还配置为检测预定物理按键是否接收到第二预定方式的按压操作,执行模块12还配置为在预定物理按键接收到第二预定方式的按压操作的情况下,使得触摸显示屏的显示窗口从当前显示界面返回至前一显示界面。这样,使得用户在错误地选择控件后能够快速地返回到前一显示界面,提高了用户体验。该过程的第二预定方式的按压操作可以是连续两次按压上述预定物理按键。In some embodiments, the first detection module 11 is further configured to detect whether a predetermined physical button receives a second predetermined manner of pressing operation, and the execution module 12 is further configured to receive a second predetermined manner of pressing operation at a predetermined physical button Next, the display window of the touch display screen is returned from the current display interface to the previous display interface. In this way, the user can quickly return to the previous display interface after erroneously selecting the control, thereby improving the user experience. The pressing operation of the second predetermined mode of the process may be to press the predetermined physical button twice in succession.
应当理解的是,本实施例中的第一预定方式的按压操作和第二预定方式的按压操作可以根据需要进行设置和改变,在此不进行具体 限定。一般来说,第一预定方式的按压操作不同于第二预定方式的按压操作。It should be understood that the pressing operation of the first predetermined mode and the pressing operation of the second predetermined mode in this embodiment may be set and changed as needed, and are not specifically limited herein. Generally, the pressing operation of the first predetermined mode is different from the pressing operation of the second predetermined mode.
通过以上实施例及实施方式的描述,本领域的技术人员可以清楚地了解到,上述实施例的操作触摸显示屏的方法和装置可以通过软件、硬件或其结合实现,硬件可以为处理器、集成电路等。作为示例,硬件可以为通用硬件平台,本公开的实施例的技术方案本质上或者说做出贡献的部分可以以软件产品(例如,可执行指令)的形式体现出来,该软件产品存储在存储介质(如ROM/RAM、磁碟、光盘)中,通过通用硬件平台读取并执行软件产品的可执行指令,来实现本公开的实施例的操作触摸显示屏的方法及装置。Through the description of the above embodiments and implementations, those skilled in the art can clearly understand that the method and apparatus for operating the touch display screen of the above embodiments can be implemented by software, hardware or a combination thereof, and the hardware can be a processor and integrated. Circuits, etc. As an example, the hardware may be a general-purpose hardware platform, and the essential or contributing portion of the technical solution of the embodiments of the present disclosure may be embodied in the form of a software product (eg, executable instructions) stored in the storage medium. In a ROM/RAM, a magnetic disk, an optical disk, a method and apparatus for operating a touch display screen of an embodiment of the present disclosure are implemented by reading and executing executable instructions of a software product through a general hardware platform.
本公开的实施例还提供了一种存储介质,所述存储介质存储包含可执行指令的程序代码,所述程序代码被执行来实现以下步骤:启动终端设备的摄像头,在终端设备的触摸显示屏的显示窗口上叠加显示摄像头拍摄时聚焦形成的焦点框,而不显示摄像头所捕获的图像;检测焦点框的位置,并检测终端设备的预定物理按键是否接收到第一预定方式的按压操作;在终端设备的预定物理按键接收到第一预定方式的按压操作的情况下,选择焦点框的当前位置对应的触摸显示屏的显示窗口中的控件,并触发该控件对应的操作执行。Embodiments of the present disclosure also provide a storage medium storing program code including executable instructions, the program code being executed to implement the steps of: activating a camera of a terminal device, a touch display screen of the terminal device The display window is superimposed to display the focus frame formed by the focus of the camera shooting, without displaying the image captured by the camera; detecting the position of the focus frame, and detecting whether the predetermined physical button of the terminal device receives the pressing operation of the first predetermined mode; When the predetermined physical button of the terminal device receives the pressing operation of the first predetermined manner, the control in the display window of the touch display screen corresponding to the current position of the focus frame is selected, and the operation corresponding to the control is triggered.
由于执行本实施例的程序代码所实现的步骤比通过触摸选择触摸显示屏的显示窗口中的控件而触发该控件对应的操作执行复杂,因此,在执行本实施例的程序代码之前,可以按照预定检测方法检测终端设备的触摸显示屏的触摸功能是否失效,在终端设备的触摸显示屏的触摸功能失效的情况下,当终端设备的触摸显示屏被点亮时,发送启动摄像头的触发信号。这样,相当于为本实施例的程序代码的执行设置了开启机制,即在触摸显示屏的触摸功能失效的情况下才执行本实施例的程序代码。Since the step of executing the program code of the present embodiment is more complicated than the operation of triggering the control by touching the control in the display window of the touch display screen, the program code of the present embodiment can be scheduled before execution of the program code of the embodiment. The detecting method detects whether the touch function of the touch display screen of the terminal device is invalid. When the touch function of the touch display screen of the terminal device fails, when the touch display screen of the terminal device is illuminated, a trigger signal for starting the camera is sent. Thus, the opening mechanism corresponding to the execution of the program code of the present embodiment is set, that is, the program code of the present embodiment is executed in the case where the touch function of the touch display screen is disabled.
在一些实施方式中,本实施例的程序代码还被执行来实现以下步骤:在触发控件对应的操作执行之后,检测预定物理按键是否接收到第二预定方式的按压操作,并在预定物理按键接收到第二预定方式的按压操作的情况下,触摸显示屏的显示窗口从当前显示界面返回至 前一显示界面。这样,使得用户在错误地选择控件后能够快速地返回到前一显示界面,提高了用户体验。该过程的第二预定方式的按压操作可以是连续两次按压上述预定物理按键。In some embodiments, the program code of the embodiment is further executed to: after detecting the execution of the operation corresponding to the trigger control, detecting whether the predetermined physical button receives the pressing operation of the second predetermined mode, and receiving at the predetermined physical button In the case of the pressing operation of the second predetermined mode, the display window of the touch display screen is returned from the current display interface to the previous display interface. In this way, the user can quickly return to the previous display interface after erroneously selecting the control, thereby improving the user experience. The pressing operation of the second predetermined mode of the process may be to press the predetermined physical button twice in succession.
应当理解的是,本实施例中的第一预定方式的按压操作和第二预定方式的按压操作可以根据需要进行设置和改变,在此不进行具体限定。一般来说,第一预定方式的按压操作不同于第二预定方式的按压操作。It should be understood that the pressing operation of the first predetermined mode and the pressing operation of the second predetermined mode in this embodiment may be set and changed as needed, and are not specifically limited herein. Generally, the pressing operation of the first predetermined mode is different from the pressing operation of the second predetermined mode.
本实施例中,上述存储介质可以包括但不限于U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。In this embodiment, the foregoing storage medium may include, but is not limited to, a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk. A medium that can store program code.
在一些实施方式中,处理器执行存储介质中存储的程序代码以实现本公开的实施例的操作触摸显示屏的方法。本公开的实施例的操作触摸显示屏的方法的描述可以参考前述实施例及实施方式的描述,在此不再赘述。In some implementations, the processor executes program code stored in a storage medium to implement a method of operating a touch display screen of an embodiment of the present disclosure. For a description of the method for operating the touch screen of the embodiment of the present disclosure, reference may be made to the foregoing description of the embodiments and the embodiments, and details are not described herein.
本领域的技术人员应该明白,本公开的实施例的各模块或各步骤可以通过通用的计算装置(例如,处理器)来实现,它们可以集成在单个计算装置上,也可以分布在多个计算装置所组成的网络上。在一些实施方式中,本公开的实施例的各模块或各步骤可以通过计算装置可执行的程序代码来实现,可以将所述程序代码存储在存储装置中由计算装置来读取并执行。在一些实施方式中,可以以不同于本公开所示出或描述的顺序执行本公开所示出或描述的各步骤。本公开的实施例的各模块或各步骤可分别制作成各个集成电路来实现,或者本公开的实施例的各模块或各步骤中的部分可集成至单个集成电路来实现。本公开不限制于任何特定形式的软件、硬件或其结合。Those skilled in the art will appreciate that the various modules or steps of an embodiment of the present disclosure may be implemented by a general-purpose computing device (eg, a processor), which may be integrated on a single computing device or distributed across multiple computing On the network of devices. In some embodiments, various modules or steps of an embodiment of the present disclosure may be implemented by program code executable by a computing device, which may be stored and read by a computing device in a storage device. In some implementations, the steps shown or described in this disclosure may be performed in an order different than that shown or described. Modules or steps of the embodiments of the present disclosure may be separately implemented as individual integrated circuits, or portions of the modules or steps of the embodiments of the present disclosure may be integrated into a single integrated circuit. The present disclosure is not limited to any particular form of software, hardware or a combination thereof.
本公开的实施例提供的技术方案使得在终端设备的触摸显示屏的触摸功能失效后仍能有效地操作和控制终端设备。例如,在终端设备的触摸显示屏的触摸功能失效后,启动终端设备的前置摄像头,将终端设备的触摸显示屏的显示分层处理,下层显示终端设备的常规输出显示窗口,上层叠加显示摄像头对用户脸部识别的人脸识别框,用户脸部位置的变动导致人脸识别框的移动,用户脸部与摄像头之间的 距离的改变导致人脸识别框的大小的改变,从而可以将人脸识别框定位到期望的位置,以选择终端设备的常规输出显示窗口中的期望控件,然后结合预定物理按键接收预定方式的按压操作来确认选择该期望控件并触发该期望控件对应的操作执行。该情况下,本公开的实施例的技术方案适用于具有例如前置摄像头、触摸显示屏、及配置为进行输入操作的物理按键的终端设备,且终端设备的触摸显示屏的显示功能正常。The technical solution provided by the embodiments of the present disclosure enables the terminal device to be effectively operated and controlled after the touch function of the touch display screen of the terminal device is disabled. For example, after the touch function of the touch display screen of the terminal device is disabled, the front camera of the terminal device is activated, the display of the touch display screen of the terminal device is layered, the lower layer displays the normal output display window of the terminal device, and the upper layer superimposes the display camera. For the face recognition frame of the user's face recognition, the change of the user's face position causes the movement of the face recognition frame, and the change of the distance between the user's face and the camera results in a change in the size of the face recognition frame, thereby enabling the person to be The face recognition frame is positioned to a desired position to select a desired control in the regular output display window of the terminal device, and then receives a predetermined manner of pressing operation in conjunction with the predetermined physical button to confirm selection of the desired control and trigger operation execution corresponding to the desired control. In this case, the technical solution of the embodiment of the present disclosure is applicable to a terminal device having, for example, a front camera, a touch display screen, and a physical button configured to perform an input operation, and the display function of the touch display screen of the terminal device is normal.
图3示出了本公开的实施例的操作触摸显示屏的装置的功能框图。如图3所示,本公开的实施例的操作触摸显示屏的装置可以包括主控设备模块、显示处理模块、数据处理模块和输入/输出模块。FIG. 3 illustrates a functional block diagram of an apparatus for operating a touch display screen of an embodiment of the present disclosure. As shown in FIG. 3, the apparatus for operating a touch display screen of an embodiment of the present disclosure may include a master device module, a display processing module, a data processing module, and an input/output module.
主控设备模块例如可由图2所示的第二检测模块13和发送模块14实现,配置为按照预定检测方法检测终端设备的触摸显示屏的触摸功能是否处于失效状态,并发送触发信号以启动终端设备的例如前置摄像头。The main control device module can be implemented, for example, by the second detecting module 13 and the sending module 14 shown in FIG. 2, configured to detect whether the touch function of the touch display screen of the terminal device is in a failure state according to a predetermined detecting method, and send a trigger signal to start the terminal. For example, the front camera of the device.
显示处理模块例如可由如2所示的处理模块10实现,配置为将终端设备的触摸显示屏的显示分层处理,下层显示终端设备的常规输出显示窗口,上层叠加显示例如前置摄像头对用户脸部识别的人脸识别框,即,前置摄像头所捕获的图像被过滤,而仅保留前置摄像头对用户脸部识别的人脸识别框。The display processing module can be implemented, for example, by the processing module 10 as shown in FIG. 2, configured to hierarchically process the display of the touch display screen of the terminal device, the lower layer display the normal output display window of the terminal device, and the upper layer superimposed display, for example, the front camera to the user's face. The partially recognized face recognition frame, that is, the image captured by the front camera is filtered, and only the face recognition frame that the front camera recognizes the user's face is retained.
数据处理模块例如由图2所示的第一检测模块11实现,配置为检测人脸识别框的位置(例如坐标),并将人脸识别框的位置作为输入上报给输入/输出模块。The data processing module is implemented, for example, by the first detection module 11 shown in FIG. 2, configured to detect the position (eg, coordinates) of the face recognition frame, and report the position of the face recognition frame as an input to the input/output module.
在一些实施方式中,可以将人脸识别框的中心点的坐标作为输入上报给输入/输出模块。In some embodiments, the coordinates of the center point of the face recognition frame can be reported as input to the input/output module.
输入/输出模块例如由图2所示的执行模块12实现,配置为接收由数据处理模块上报的人脸识别框的位置,并将其对应至终端设备的常规输出显示窗口中的相应的控件,以选择该控件并触发该控件对应的操作执行。The input/output module is implemented, for example, by the execution module 12 shown in FIG. 2, configured to receive the location of the face recognition frame reported by the data processing module and to correspond to the corresponding control in the regular output display window of the terminal device. To select the control and trigger the corresponding action of the control.
利用图3所示的操作触摸显示屏的装置,能够实现如下操作触摸显示屏的方法:在终端设备的触摸显示屏的触摸功能失效的情况下, 启动终端设备的前置摄像头,通过前置摄像头和用户脸部的相对位置变化,改变前置摄像头识别用户脸部的人脸识别框的位置和大小;检测终端设备的预定物理按键是否接收到预定方式的按压操作,以确认人脸识别框的位置;选择人脸识别框的当前位置对应的触摸显示屏的显示窗口中的控件,并触发触发该控件对应的操作执行。By using the device for operating the touch screen shown in FIG. 3, the following method of touching the display screen can be realized: when the touch function of the touch display screen of the terminal device fails, the front camera of the terminal device is activated, and the front camera is passed through Changing the relative position of the face of the user, changing the position and size of the face recognition frame of the front camera to identify the face of the user; detecting whether the predetermined physical button of the terminal device receives the pressing operation of the predetermined mode to confirm the face recognition frame Position; select the control in the display window of the touch display corresponding to the current position of the face recognition box, and trigger the operation corresponding to triggering the control.
本实施例中,判断终端设备的触摸显示屏的触摸功能是否失效的标识参数可作为系统参数写入终端设备的文件系统中。如果终端设备的触摸显示屏的触摸功能处于失效的状态,在终端设备的系统被唤醒后,启动终端设备的前置摄像头,在终端设备的触摸显示屏的显示窗口上叠加显示前置摄像头识别用户脸部的人脸识别框,而不显示摄像头所捕获的图像,然后调整用户脸部和前置摄像头的位置关系,即调整人脸识别框在触摸显示屏的显示窗口中的位置和大小。In this embodiment, the identifier parameter that determines whether the touch function of the touch display screen of the terminal device is invalid may be written into the file system of the terminal device as a system parameter. If the touch function of the touch display screen of the terminal device is in a failed state, after the system of the terminal device is woken up, the front camera of the terminal device is activated, and the front camera is superimposed and displayed on the display window of the touch display screen of the terminal device. The face recognition box of the face does not display the image captured by the camera, and then adjusts the positional relationship between the user's face and the front camera, that is, adjusts the position and size of the face recognition frame in the display window of the touch display screen.
当用户确认人脸识别框的当前位置和大小在显示窗口中对应期望的控件时,可按下预定物理按键进行确认,预定物理按键接收到预定方式的按压操作后,向期望的控件发送指令,期望的控件得到相应的指令,以触发该控件对应的操作执行。When the user confirms that the current position and size of the face recognition frame corresponds to the desired control in the display window, the predetermined physical button may be pressed for confirmation, and after the predetermined physical button receives the pressing operation of the predetermined mode, the instruction is sent to the desired control. The desired control gets the corresponding instruction to trigger the corresponding operation of the control.
作为示例,上述输入/输出模块可配置为根据数据处理模块上报的人脸识别框的位置,向对应的控件发出指令,对应的控件得到指令后触发对应的操作执行,例如进入到对应的应用程序或是进入到对应的应用的下一显示界面。As an example, the input/output module may be configured to issue an instruction to the corresponding control according to the location of the face recognition frame reported by the data processing module, and the corresponding control triggers the corresponding operation after obtaining the instruction, for example, entering the corresponding application. Or enter the next display interface of the corresponding application.
应当理解,本公开的实施例中的控件可呈现为图标、字符等形式,对所述控件进行选择、触摸等可触发终端设备执行相应的操作。It should be understood that the controls in the embodiments of the present disclosure may be presented in the form of icons, characters, etc., and selecting, touching, etc. the controls may trigger the terminal device to perform corresponding operations.
作为示例,终端设备的触摸显示屏的显示窗口中可显示图标或字符形式的多个控件,这些控件可接受输入操作(例如,选择、触摸等),以触发终端设备执行相应的操作。As an example, a plurality of controls in the form of icons or characters may be displayed in the display window of the touch display of the terminal device, and the controls may accept input operations (eg, selection, touch, etc.) to trigger the terminal device to perform corresponding operations.
需要说明的是,本公开的实施例中的预定物理按键是指能够接收例如按压操作、并向相应的(例如,人脸识别框选择的)控件发送指令以触发该控件对应的操作执行的物理按键。It should be noted that the predetermined physical button in the embodiment of the present disclosure refers to a physics capable of receiving, for example, a pressing operation and sending an instruction to a corresponding (eg, selected by a face recognition frame) to trigger an operation corresponding to the operation of the control. button.
图4示出了本公开的实施例的触摸显示屏的显示窗口的示意图。如图4所示,终端设备的触摸显示屏的显示窗口401中显示有多个控 件403,在触摸显示屏的触摸功能有效的情况下,可触摸任意控件403来触发相应的操作执行,在触摸显示屏的触摸功能失效的情况下,启动终端设备的摄像头,以在触摸显示屏的显示窗口401上叠加显示摄像头识别用户脸部的人脸识别框402,可调整摄像头与用户之间的位置关系来调整人脸识别框402的位置和大小,以选择任意控件403,并触发相应的操作执行。4 shows a schematic diagram of a display window of a touch display screen of an embodiment of the present disclosure. As shown in FIG. 4, a plurality of
本公开的实施例及实施方式仅作为示例示出,在不脱离本公开的构思的情况下,本领域的技术人员将可以得到各种修改和变型,这些修改和变型应视为落入本公开的范围,本公开的范围不限于本公开所描述和示出的实施例及实施方式。The embodiments and the embodiments of the present disclosure are shown by way of example only, and various modifications and changes can be made by those skilled in the art without departing from the scope of the present disclosure. The scope of the present disclosure is not limited to the embodiments and embodiments described and illustrated in the present disclosure.
Claims (12)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710786342.4 | 2017-09-04 | ||
| CN201710786342.4A CN109426409A (en) | 2017-09-04 | 2017-09-04 | A kind of method, apparatus of operation display, mobile terminal and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019042473A1 true WO2019042473A1 (en) | 2019-03-07 |
Family
ID=65513543
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2018/103987 Ceased WO2019042473A1 (en) | 2017-09-04 | 2018-09-04 | Method and apparatus for operating touch display screen, terminal device, and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109426409A (en) |
| WO (1) | WO2019042473A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110941389A (en) * | 2019-11-27 | 2020-03-31 | 北京新势界科技有限公司 | Method and device for triggering AR information points by focus |
| CN111292703A (en) * | 2019-12-20 | 2020-06-16 | 深圳光启空间技术有限公司 | Screen brightness adjusting method and device |
| CN114153536B (en) * | 2021-11-12 | 2024-04-09 | 华东计算技术研究所(中国电子科技集团公司第三十二研究所) | Web page focus control method and system for physical buttons compatible with touch screen |
| CN115086561A (en) * | 2022-06-21 | 2022-09-20 | 易兆微电子(杭州)股份有限公司 | A kind of automatic zoom method, device, Selfie and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103593129A (en) * | 2012-08-13 | 2014-02-19 | 腾讯科技(深圳)有限公司 | Focus frame drawing method and system and touch device |
| CN105721910A (en) * | 2014-12-03 | 2016-06-29 | Tcl集团股份有限公司 | Focus control method for intelligent terminal, and intelligent terminal |
| CN106227438A (en) * | 2016-07-29 | 2016-12-14 | 宇龙计算机通信科技(深圳)有限公司 | Terminal control method and device |
| CN106878811A (en) * | 2017-01-18 | 2017-06-20 | 环球智达科技(北京)有限公司 | A kind of intelligent television application foci moves control program |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9207804B2 (en) * | 2014-01-07 | 2015-12-08 | Lenovo Enterprise Solutions PTE. LTD. | System and method for altering interactive element placement based around damaged regions on a touchscreen device |
| CN108322652A (en) * | 2015-06-16 | 2018-07-24 | 广东欧珀移动通信有限公司 | A focusing prompt method and terminal |
| CN105094602A (en) * | 2015-06-30 | 2015-11-25 | 努比亚技术有限公司 | Method and device for implementing key mode through mobile terminal |
-
2017
- 2017-09-04 CN CN201710786342.4A patent/CN109426409A/en active Pending
-
2018
- 2018-09-04 WO PCT/CN2018/103987 patent/WO2019042473A1/en not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103593129A (en) * | 2012-08-13 | 2014-02-19 | 腾讯科技(深圳)有限公司 | Focus frame drawing method and system and touch device |
| CN105721910A (en) * | 2014-12-03 | 2016-06-29 | Tcl集团股份有限公司 | Focus control method for intelligent terminal, and intelligent terminal |
| CN106227438A (en) * | 2016-07-29 | 2016-12-14 | 宇龙计算机通信科技(深圳)有限公司 | Terminal control method and device |
| CN106878811A (en) * | 2017-01-18 | 2017-06-20 | 环球智达科技(北京)有限公司 | A kind of intelligent television application foci moves control program |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109426409A (en) | 2019-03-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11128802B2 (en) | Photographing method and mobile terminal | |
| US20230412911A1 (en) | Method of controlling camera device and electronic device thereof | |
| CN112954210B (en) | Photographing method and device, electronic equipment and medium | |
| CN107566732B (en) | Method for controlling camera of device and device thereof | |
| CN106231178B (en) | A kind of self-timer method and mobile terminal | |
| EP2887648B1 (en) | Method of performing previewing and electronic device for implementing the same | |
| CN108712606B (en) | Prompting method, prompting device, storage medium and mobile terminal | |
| JP2020530631A (en) | Interaction locating methods, systems, storage media, and smart devices | |
| US20130239050A1 (en) | Display control device, display control method, and computer-readable recording medium | |
| JP6700708B2 (en) | Electronic device, control method thereof, program, and storage medium | |
| WO2019042473A1 (en) | Method and apparatus for operating touch display screen, terminal device, and storage medium | |
| KR102401467B1 (en) | Button setting method, device and recording medium | |
| EP3033868B1 (en) | Preventing an operation when a processing device communicates with an acquisition device | |
| KR20110006243A (en) | Manual focusing method and device in portable terminal | |
| CN106357961A (en) | Photographing method and mobile terminal | |
| CN106973237A (en) | A kind of image pickup method and mobile terminal | |
| CN117527952A (en) | Control method, electronic device and readable storage medium | |
| JP2019016299A (en) | Electronic apparatus having operation member arranged on different surfaces, control method thereof, program and storage medium | |
| CN104536640B (en) | Background image viewing method and device | |
| US12395601B2 (en) | Electronic apparatus, method of controlling the same, and computer-readable storage medium storing program | |
| CN105824458A (en) | Photographing control method and mobile terminal | |
| CN107105158B (en) | A kind of photographing method and mobile terminal | |
| US9756238B2 (en) | Image capturing apparatus for performing authentication of a photographer and organizing image data for each photographer and control method thereof | |
| TW201500967A (en) | Anti-theft method and computer system thereof | |
| CN107369130A (en) | A kind of image processing method and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18851793 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 18851793 Country of ref document: EP Kind code of ref document: A1 |