TWI598807B - Remote device control method and remote control system - Google Patents

Description

Remote device control method and remote control system

The present invention relates to a method of controlling a remote device, and more particularly to a control method and a remote control system for controlling a remote device by acquiring an image displayed by the remote device.

With the advancement of technology, more and more electronic devices can be used by a user. When the user is in the living room at home, the user may use a smart phone, a television, a laptop or a tablet. In the case of television, the television is usually paired with a remote control so that the user can remotely control the television (for example, switching channels). In the case of a notebook computer, the user may control the notebook via a wireless mouse or a wireless keyboard. However, too many electronic devices make the steps of controlling these electronic devices very complicated. Thus, how to use an electronic device to remotely control another electronic device and simplify these remote control steps are of interest to those skilled in the art.

Embodiments of the present invention provide a remote device control method and a remote control system using the same that allows a user to conveniently control a remote device.

An embodiment of the present invention provides a method for controlling a remote device, which is applicable to an electronic device. The control method includes: obtaining a first image displayed by a display unit of the remote device; generating a control interface according to the first image, and displaying the control interface on a touch unit of the electronic device; detecting the touch unit a control operation; generating a control message based on the coordinates of the control operation on the control interface; and transmitting the control message to the remote device, wherein the remote device operates according to the control message.

In another aspect, an embodiment of the present invention provides a remote control system including an electronic device and a remote device. The electronic device is configured to obtain a first image displayed by the display unit of the remote device, generate a control interface according to the first image, and display the control interface on the touch unit of the electronic device. The electronic device is also used to detect a control operation in the touch unit, according to which the coordinates of the control operation on the control interface generate a control message and transmit the control message to the remote device. The remote device operates according to this control message.

Based on the above, the control method and the remote control system provided by the embodiments of the present invention can allow the user to control the remote device through the electronic device after obtaining the image displayed by the remote device.

The above described features and advantages of the present invention will be more apparent from the following description.

100‧‧‧Remote control system

110‧‧‧Electronic devices

111‧‧‧Touch unit

112‧‧‧Image capture unit

113, 122‧‧‧ processor

114, 123‧‧‧ communication interface

115, 124‧‧‧ memory

116‧‧‧Detection module

117‧‧‧Analysis module

118, 126‧‧‧ control module

119, 127‧‧‧ transmission module

120‧‧‧Remote device

121‧‧‧Display unit

125‧‧‧ receiving module

S402, S404, S406, S408, S410, S412, S502, S504, S506, S508, S510, S602, S604, S606‧‧

810‧‧‧ cursor

910, 920‧‧‧ Dynamic bricks

S1102, S1104, S1106, S1108, S1110‧‧‧ steps of the control method of the remote device

1 is a schematic diagram showing a remote control system in accordance with an embodiment.

2 is a block diagram of an electronic device 110 in accordance with an embodiment.

FIG. 3 is a block diagram showing remote device 120, in accordance with an embodiment.

FIG. 4 is a flow chart showing the operation of the electronic device 110 according to an embodiment.

FIG. 5 is a flow chart showing the operation of the remote device 120 according to an embodiment.

FIG. 6 is a flow chart showing communication between the electronic device 110 and the remote device 120, according to an embodiment.

7-10 are schematic diagrams showing the electronic device 110 controlling the remote device 120 according to an embodiment.

11 is a flow chart showing a method of controlling a remote device, according to an embodiment.

1 is a schematic diagram showing a remote control system in accordance with an embodiment.

Referring to FIG. 1, the remote control system 100 includes an electronic device 110 and a remote device 120. The electronic device 110 includes a touch unit 111, and the remote device 120 includes a display unit 121. For example, the electronic device 110 is a smart phone and the remote device is a television. When the user wants to control the remote device 120 through the electronic device 110, the user can control the electronic device 110 to obtain an image (also referred to as a first image) displayed by the display unit 121 of the remote device 120. The electronic device 110 generates a control interface according to the first image, and displays the control interface on the touch unit 111. Next, the user can The remote device 120 is controlled by a control interface on the touch unit 111. The operation between the electronic device 110 and the remote device 120 will be described in detail below by way of embodiments.

2 is a block diagram of an electronic device 110 in accordance with an embodiment.

Referring to FIG. 2 , the electronic device 110 includes a touch unit 111 , an image capturing unit 112 , a processor 113 , a communication interface 114 , and a memory 115 . The electronic device 110 can be implemented as a smart phone, tablet, or other handheld electronic device.

The touch unit 111 is a function for providing touch and display. For example, the touch unit 111 is a display such as a liquid crystal display (LCD), a Light-Emitting Diode (LED) display, or a Field Emission Display (FED), and a resistive or a capacitor. A combination of touch panels and the like.

The image capturing unit 112 is configured to capture images or video. For example, the image capturing unit 112 includes an optical fixed focus lens or an optical zoom lens, and a photosensitive element such as a charge coupled device (CCD) or a complementary metal-oxygen semiconductor (CMOS) element.

The processor 113 is used to control the overall operation of the electronic device 110. For example, the processor 113 is a central processing unit (CPU), a microprocessor (Microprocessor), or a digital signal processor (DSP).

The communication interface 114 is used to send and receive signals. For example, the communication interface 114 is a device that complies with the Bluetooth or IEEE 802.11 (WiFi) standard.

The memory 115 is, for example, a dynamic random access memory (DRAM), a static random access memory (SRAM), a flash memory, or other memory. Memory The detection module 116, the analysis module 117, the control module 118 and the transmission module 119 are included in the 115. The processor 113 executes the various modules in the memory 115 to control a remote device. The operation of the detection module 116, the analysis module 117, the control module 118, and the transmission module 119 is as follows. The processor 113 executes the detection module 116, the analysis module 117, the control module 118, and the transmission module. The operation of group 119 will not be described below.

FIG. 3 is a block diagram showing remote device 120, in accordance with an embodiment.

Referring to FIG. 3, the remote device 120 includes a display unit 121, a processor 122, a communication interface 123, and a memory 124. The remote device 120 can be implemented as a television, a notebook computer, a computer, a server, or other home appliance.

The processor 122 is used to control the overall operation of the remote device 120. For example, processor 122 is a central processing unit, a microprocessor, or a digital signal processor. The communication interface 123 is, for example, a device that conforms to the Bluetooth or IEEE 802.11 (WiFi) standard. The receiving module 125, the control module 126 and the transmission module 127 are stored in the memory 124. The processor 122 executes the various modules in the memory 124 to receive control messages from the electronic device 110 and operates in accordance with the control messages. The following describes the operation of the receiving module 125, the control module 126, and the transmission module 127, and indicates that the processor 122 performs the operations performed by the receiving module 125, the control module 126, and the transmission module 127, and will not be described below. .

Referring back to FIG. 1, first, the electronic device 110 and the remote device 120 are in the same area network, for example, the electronic device 110 and the remote device 120 are connected to each other through WiFi. Alternatively, the electronic device 110 and the remote device 120 are connected to each other through Bluetooth transmission. In an embodiment, the environment in which the user is located includes a plurality of remote devices. For example, the user is at home or in the office, and the remote device is for example a television or Notebook computer. The user will first select a remote device to be controlled. For example, the electronic device 110 stores a database having information of a plurality of remote devices, and the user can select a remote device from the database. Alternatively, the user can capture the remote device to be controlled through the electronic device 110, and the electronic device 110 can identify which remote device is to be controlled according to the captured image.

After the user selects the remote device to be controlled, the detection module 116 obtains the first image displayed by the display unit 121. For example, the display unit 121 is playing a movie with one or more control elements (eg, buttons) for movie playback. Alternatively, the user is browsing the webpage through the remote device 120, so the first image includes a web page and one or more hyperlinks. Alternatively, the first image includes a plurality of icons, and each of the icons corresponds to an application. The invention does not limit the content of the first image.

In an embodiment, the user captures the first image through the image capturing unit 112 on the electronic device 110. The user can capture the first image through the camera physical button or the camera virtual button on the electronic device 110. Alternatively, the transmission module 127 on the remote device 120 actively transmits the first image being displayed to the electronic device 110, which is not limited thereto.

In another embodiment, the user picks up the electronic device 110 and causes the image capturing unit 112 to align with the remote device 120. The image capturing unit 112 continuously captures a plurality of live images and the instant images are displayed on the touch unit 111. The detecting module 116 determines whether the image capturing unit 112 is aligned with the remote device 120 for more than a preset time (for example, determining whether the remote device 120 is always displayed on the touch unit 111 or not) in). In an embodiment, the detecting module 116 can also determine whether the electronic device 110 is moved by using a gyroscope, thereby determining whether the image capturing unit 112 is aligned with the remote device 120 for more than a preset time. The present invention is not This limit. If the image capturing unit 112 is aligned with the remote device 120 for more than the preset time, the detecting module 116 controls the image capturing unit 112 to automatically capture the first image.

In an embodiment, after the instant image of the remote device 120 is displayed on the touch unit 111, the user can obtain the first image according to the instant image. Specifically, after the live image is displayed on the touch unit 111, the detecting module 116 detects a touch operation (for example, tap or drag) on the touch unit. And according to this touch operation, an operation range in the instant image is determined. For example, the user selects the range of the display unit 121 in the live image as the operating range. After determining the operating range, the detecting module 116 captures the first image within the operating range.

After obtaining the first image being displayed by the remote device 120, the control module 118 generates a control interface and displays the control interface on the touch unit 111. In one embodiment, the control interface includes a plurality of control elements, and the control elements in the control interface correspond to the control elements being displayed by the display unit 121 (as shown in FIG. 1). Alternatively, when the first image includes a web page, the control interface may include one or more hyperlinks; when the first image includes one or more icons, the control interface may also include one or more icons.

In an embodiment, the analysis module 117 also performs an image correction on the first image. This image correction includes affine transformation or image scaling. Since the portion corresponding to the display unit 121 in the first image may exhibit a trapezoidal shape due to the relationship of the photographing angle. Therefore, the analysis module 117 will perform the first image. Line affine transformation, which converts the trapezoid into a rectangle. In addition, the analysis module 117 also enlarges or reduces the first image so that the size of the first image can conform to the size of the touch unit 111. In an embodiment, the control module 117 generates a second image after performing image correction on the first image, and the control module 117 generates a control interface according to the second image.

After the control interface is generated, the control module 118 detects a control operation on the touch unit 111. The input type of this control operation may be a mouse input, a keyboard input or a touch input, and the present invention is not limited thereto. For example, the electronic device 110 can externally or internally have a keyboard or a mouse, and the user can select a coordinate on the touch unit 111 through the keyboard or the mouse to generate a control operation belonging to the mouse input and the keyboard input.

After detecting the control operation, the control module 118 generates a control message according to a coordinate (also referred to as the first coordinate) of the control interface on the control interface. For example, if the control operation is a tap that touches the touch input, and the control module 118 determines that the touched coordinates meet the coordinates of a "pause" button, the control module 118 generates a control message representing "pause". . Alternatively, the coordinates selected by the user through the keyboard or the mouse also conform to the coordinates of the "pause" button, and the control module 118 also generates a control message representing "pause". Next, the transmission module 119 transmits the control message to the remote device 120, and the remote device 120 operates according to the control message (ie, suspending the movie being played).

In one embodiment, the control message transmitted to the remote unit 120 will include a coordinate and a coordinate event. For example, the coordinate event is a click event. Thereby, the remote device 120 can learn the corresponding operation (for example, pressing a button) according to the coordinate and the coordinate event. However, since the resolution of the touch unit 111 and the display unit 121 may be different, Therefore, the coordinates of a control operation on the touch unit 111 must be converted into coordinates suitable for the display unit 121.

Specifically, the transmission module 119 receives a remote device information from the remote device 120 through the communication interface 114. The remote device information includes the resolution of the display unit 121, the photosensitive element spacing of the display unit 121, the identification information of the remote device 120, the distance between the remote device 120 and the electronic device 110, and the acceptability of the remote device 120. Enter an event, or a combination thereof. The photosensitive element pitch is a distance between each two photosensitive elements on the display unit 121 (for example, expressed as DPI (Dots Per Inch)). The identification information is, for example, the name of the remote device 120 or a serial number. The distance between the remote device 120 and the electronic device 110 can be calculated as the delay time of the network packet. The delay time of the network packet can be used to correct the control operation on the touch unit 111. For example, the touch unit 111 displays a web page, and at the nth second, the user performs a control operation representing "zoom in". However, due to the delay of the network packet, the display unit 121 has no way to perform the "enlargement" operation immediately, so the user performs an enlarged control operation again at the n+1th second. The electronic device 110 corrects the control operation of the touch unit 111 by the delay time of the network packet, so that the content displayed by the display unit 121 conforms to the user's expectation. On the other hand, the acceptable input category indicates the type of input that the remote device 120 can receive and recognize. For example, in one embodiment, the types of inputs that the remote device 120 can accept include keyboard input and mouse input.

The analysis module 117 will obtain the remote device information. In addition, the analysis module 117 also obtains a display information of the electronic device 110. This display information includes the resolution of the touch unit 111 and the photosensitive element pitch. According to the display information of the electronic device 110 and the remote device The control module 118 can convert the coordinate (also referred to as the first coordinate) of a control operation on the touch unit 111 into a coordinate (also referred to as a second coordinate) suitable for the display unit 121.

In addition, the control module 118 also generates a second input category based on the input type of the control operation (also referred to as the first input type) and the acceptable input type of the remote device 120. For example, the input type accepted by the remote unit 120 does not include a touch input, so the control module 118 converts a touch input into a mouse input. However, the control module 118 may also not change the input type of the control operation, and the present invention is not limited thereto.

Moreover, the control module 118 generates a coordinate event (also referred to as a second coordinate event) applicable to the remote device 120 according to a coordinate event (also referred to as a first coordinate event) of the control operation. Here, the coordinate event can be one of a click event and a drag event. For example, the control module 118 converts a tap on the touch unit 111 that belongs to the touch input into a click that belongs to the mouse input. Alternatively, the analysis module 117 can also convert the drag belonging to the touch input on the touch unit 111 into a drag belonging to the mouse input. The control message generated by the analysis module 117 includes the second coordinate, the second input type and the second coordinate event.

In an embodiment, the control message generated by the analysis module 117 may further include identification information of the electronic device 110, identification information of the remote device 120, connection time, a random number, and at least one connection setting. The connection time is used to calculate whether the electronic device 110 stops transmitting the control message to the remote device 120 for more than a second preset time. If the electronic device 110 stops transmitting the control message to the remote device 120 for more than the second predetermined time, the connection between the electronic device 110 and the remote device 120 is cut off. The random number is used to identify the message transmitted between the electronic device 110 and the remote device 120. E.g, After the remote device 120 obtains the random number in the control message, the remote device 120 sends a backhaul message to the electronic device 110, and the backhaul message includes the random number. Thereby, the electronic device 110 can recognize that the backhaul message is sent by the remote device 120. The connection settings will include the type of communication protocol or port.

FIG. 4 is a flow chart showing the operation of the electronic device 110 according to an embodiment.

Referring to FIG. 4, in step S402, the analysis module 117 analyzes the remote device information and the display information of the electronic device. For example, the analysis module 117 calculates a transition between the coordinates on the electronic device 110 and the coordinates on the remote device 120 based on the remote device information and the display information of the electronic device 110.

In step S404, the detection module 116 obtains the first image displayed by the display unit 121 of the remote device 120. In step S406, the control module 118 performs image correction on the first image and generates a control interface. In step S408, the control module 118 determines whether a control operation on the touch unit 111 is detected. If the result of step S408 is no, the process returns to step S402; if so, step S410 is performed. In step S410, the control module 118 converts the coordinate of the control operation, the input type and the coordinate event, and generates a control message. In step S412, the transmission module 119 transmits a control message to the remote device 120. However, the steps in FIG. 4 have been described in detail above, and will not be described again here.

FIG. 5 is a flow chart showing the operation of the remote device 120 according to an embodiment.

Referring to FIG. 5, in step S502, the receiving module 125 determines whether a control message is detected. If yes, proceed to step S504.

In step S504, the control module 126 parses the control message. For example, control module 126 will attempt to resolve the second coordinate, the second input category and the second coordinate event.

In step S506, the control module 126 determines whether the control message is successfully parsed. If the result of step S506 is YES, then step S508 is performed; if not, step S510 is performed.

In step S508, the control module 126 performs a corresponding operation according to the second coordinate, the second input category and the second coordinate event.

In step S510, the transmission module 127 transmits a reply message to the electronic device 110 to inform the retransmission control message.

FIG. 6 is a flow chart showing communication between the electronic device 110 and the remote device 120, according to an embodiment.

Referring to FIG. 6, in step S602, the electronic device 110 transmits a connection request to the remote device 120. The connection requirements include connection time, random number, identification information of the electronic device 110, identification information of the remote device 120, and connection settings.

In step S604, the remote device 120 transmits a reply message to the electronic device. The reply message includes a random number, identification information of the remote device 120, connection settings, and a message indicating whether the connection is successful. After receiving the reply message, the electronic device 110 determines whether the connection has been successfully completed. If the connection is not successful, the electronic device 110 repeats step S602; if the connection is successful, the electronic device 110 performs step S606 to transmit a control message to the remote device 120. After step S606, the electronic device 110 can continuously transmit a control message to the remote device 120.

7-10 are schematic diagrams showing the electronic device 110 controlling the remote device 120 according to an embodiment.

Referring to FIG. 7 , in an embodiment, the control interface on the electronic device 110 can be So it is a fixed interface. For example, in Figure 7, this control interface is an interface that simulates a television remote control that includes multiple buttons. Users can change the TV channel and sound size through this control interface.

Referring to FIG. 8, in an embodiment, the control interface on the electronic device 110 is a fixed interface, which is in the shape of a touch panel. The user can change the position of the upstream indicator 810 of the display unit 121 of the remote device 120 through the control interface on the touch unit 111. Alternatively, the user can also launch an application, input one or more buttons, or enlarge/reduce the display through the control interface on the touch unit 111, and the present invention is not limited thereto.

Referring to FIG. 9, in an embodiment, the control interface displayed on the touch unit 111 is a dynamic interface. The control module 118 synchronizes the image displayed by the control interface with the display unit 121 (also referred to as a third image), so that the control interface has the same content as the third image. For example, the control interface on the touch unit 111 includes a plurality of dynamic tiles; and the display unit 121 also displays a plurality of dynamic tiles. When the user clicks on the dynamic brick 910, the transmission module 119 transmits the corresponding control training to the remote device 120. After receiving the control message, the remote device 120 performs an operation corresponding to clicking on the dynamic tile 920. Alternatively, when the user moves the dynamic brick on the control interface, the dynamic brick on the display unit 121 also moves correspondingly (as shown in FIG. 10).

11 is a flow chart showing a method of controlling a remote device, according to an embodiment.

Referring to FIG. 11, in step S1102, the first image displayed by the display unit of the remote device is obtained. In step S1104, a control interface is generated according to the first image, and the control interface is displayed on the touch unit of the electronic device. In step S1106, Detects a control operation in the touch unit. In step S1108, a control message is generated based on the coordinates of the control operation on the control interface. In step S1110, the control message is transmitted to a remote device, wherein the remote device operates in accordance with the control message. However, the steps in Fig. 11 have been described in detail above, and will not be described again here. In one embodiment, the steps in Figure 11 are implemented as a plurality of code codes that are stored in a memory and executed by a processor. However, in another embodiment, the steps in Figure 11 are implemented as one or more circuits. The invention is not limited to the implementation of the steps of Figure 11 in a software or hardware manner.

In summary, the control method and the remote control system provided by the embodiments of the present invention can control a remote device through the electronic device after obtaining the screen displayed by the remote device. Moreover, the control interface on the electronic device can be a fixed interface or a non-fixed interface, so that the operation of controlling the remote device is flexible.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the invention, and any one of ordinary skill in the art can make some modifications and refinements without departing from the spirit and scope of the invention. The scope of the invention is defined by the scope of the appended claims.

S1102, S1104, S1106, S1108, S1110‧‧‧ steps of the control method of the remote device

Claims (16)

A remote device control method is applicable to an electronic device. The control method includes: capturing, by an image capturing unit of the electronic device, a first image displayed by a display unit of the remote device; Performing an image correction on an image to generate a second image, wherein the image correction includes an affine transformation or an image scaling; generating a control interface according to the second image, and displaying the control interface on a touch of the electronic device Touching a unit; detecting a control operation of the touch unit; generating a control message according to the first coordinate of the control interface on the control interface; and transmitting the control message to the remote device, wherein the remote The end device operates according to the control message. The method for controlling a remote device according to claim 1, wherein the step of obtaining the first image displayed by the display unit of the remote device comprises: determining whether an image capturing unit of the electronic device is The remote device is allowed to exceed the preset time; and if the image capturing unit is aligned with the remote device for more than the preset time, the first image is captured by the image capturing unit. The method for controlling a remote device according to claim 1, wherein the step of obtaining the first image displayed by the display unit of the remote device comprises: An image capturing unit of the electronic device captures an instant image of the remote device, and displays the instant image on the touch unit; detecting a touch operation on the touch unit; The touch operation determines an operation range on the live image; and obtains the first image within the operation range. The method for controlling a remote device according to claim 1, further comprising: receiving a remote device information from the remote device, wherein the remote device information includes one of the display units of the remote device Resolution, a photosensitive element spacing of the display unit of the remote device, an identification information of the remote device, a distance between the remote device and the electronic device, and an acceptable input type of the remote device , or a combination thereof. The method for controlling a remote device according to claim 4, wherein the step of generating the control message by the first coordinate on the control interface according to the control operation further comprises: displaying information according to a display of the electronic device The remote device information, the first coordinate of the control operation on the control interface is converted to a second coordinate applicable to the remote device; according to the acceptable input type of the remote device and a control operation An input type generates a second input category applicable to the remote device; and generating a second coordinate event applicable to the remote device according to a first coordinate event of the control operation, The display information includes a resolution of the touch unit of the electronic device and a distance between the photosensitive elements of the touch unit of the electronic device, and the first input type and the second input type are a mouse input, One of a keyboard input and a touch input, the first coordinate event and the second coordinate event being one of a click event and a drag event, and the control message includes the second coordinate, the second input Kind with the second coordinate event. The method for controlling a remote device according to claim 5, wherein the control message further includes an identification information of the electronic device, the identification information of the remote device, a connection time, a random number, and A connection setting. The method for controlling a remote device according to claim 1, further comprising: synchronizing the control interface with a third image displayed by the display unit of the remote device, and the control interface and the third image Have the same content. The method for controlling a remote device according to claim 1, wherein the control interface is a fixed interface. A remote control system includes: an electronic device; and a remote device, wherein the electronic device is configured to capture a first display displayed by a display unit of the remote device through an image capturing unit of the electronic device And performing image correction on the first image to generate a second image, wherein the image correction includes an affine transformation or an image scaling. The electronic device is configured to generate a control interface according to the second image, and display the control interface on a touch unit of the electronic device, the electronic device is configured to detect a control operation of the touch unit, according to The control operation generates a control message at a first coordinate of the control interface and transmits the control message to the remote device, wherein the remote device operates according to the control message. The remote control system of claim 9, wherein the electronic device is further configured to determine whether an image capturing unit of the electronic device is aligned with the remote device for more than a predetermined time, if the image is captured The unit is aligned with the remote device for the preset time, and the electronic device captures the first image through the image capturing unit. The remote control system of claim 9, wherein the electronic device is further configured to capture an instant image of the remote device through an image capturing unit of the electronic device, and display the instant image in The touch device is further configured to detect a touch operation on the touch unit, determine an operation range on the instant image according to the touch operation, and obtain the operation range in the operation range. The first image. The remote control system of claim 9, wherein the electronic device is further configured to receive a remote device information from the remote device, wherein the remote device information comprises the display unit of the remote device a resolution, a photosensitive element spacing of the display unit of the remote device, an identification information of the remote device, a distance between the remote device and the electronic device, and an acceptable input of the remote device Type, or a combination thereof. The remote control system of claim 12, wherein the electronic device is further configured to: operate the first operation on the control interface according to a display information of the electronic device and the remote device information The coordinates are converted to a second coordinate applicable to the remote device, and the electronic device is further configured to generate a second applicable to the remote device according to the acceptable input type of the remote device and a first input type of the control operation Inputting the type, the electronic device is further configured to generate a second coordinate event applicable to the remote device according to a first coordinate event of the control operation, wherein the display information includes a resolution of the touch unit of the electronic device a photosensitive element spacing of the touch unit of the electronic device, the first input category and the second input category being one of a mouse input, a keyboard input and a touch input, the first coordinate event and The second coordinate event is one of a click event and a drag event, and the control message includes the second coordinate, the second input category, and the second coordinate event. The remote control system of claim 13, wherein the control message further includes an identification information of the electronic device, the identification information of the remote device, a connection time, a random number, and a connection. Line setting. The remote control system of claim 9, wherein the electronic device is further configured to synchronize the control interface with a third image displayed by the display unit of the remote device, so that the control interface and the first The three images have the same content. The remote control system as described in claim 9 of the patent application, wherein the control The interface is a fixed interface.