[go: up one dir, main page]

CN105700812A - Control method and device for mobile equipment - Google Patents

Control method and device for mobile equipment Download PDF

Info

Publication number
CN105700812A
CN105700812A CN201610109094.5A CN201610109094A CN105700812A CN 105700812 A CN105700812 A CN 105700812A CN 201610109094 A CN201610109094 A CN 201610109094A CN 105700812 A CN105700812 A CN 105700812A
Authority
CN
China
Prior art keywords
user
finger
drone
control
movement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610109094.5A
Other languages
Chinese (zh)
Other versions
CN105700812B (en
Inventor
郑卫锋
其他发明人请求不公开姓名
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Little Shark Intelligent Technology Singapore Ltd
Original Assignee
PowerVision Robot Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by PowerVision Robot Inc filed Critical PowerVision Robot Inc
Priority to CN201610109094.5A priority Critical patent/CN105700812B/en
Publication of CN105700812A publication Critical patent/CN105700812A/en
Application granted granted Critical
Publication of CN105700812B publication Critical patent/CN105700812B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a control method and device for mobile equipment. The method comprises the steps that when a terminal detects that a screen of the terminal is pressed by a finger of a user, the initial position of the finger of the user on the screen is recorded; the terminal detects the position of the finger of the user on the screen, and a moving mode and a moving distance of the finger of the user are determined according to the current position of the finger of the user on the screen and the initial position of the finger of the user on the screen; the terminal determines a control mode on the mobile equipment according to the moving mode of the finger of the user; the control amount on the mobile equipment is determined according to the moving distance of the finger of the user; the terminal sends a control command to the mobile equipment according to the determined control mode and the determined control amount. By means of the control method and device for the mobile equipment, the control range on the mobile equipment is widened.

Description

可移动设备的控制方法及装置Mobile device control method and device

技术领域technical field

本申请涉及数据通信领域,尤其涉及可移动设备的控制方法及装置。The present application relates to the field of data communication, in particular to a control method and device for a mobile device.

背景技术Background technique

无人机是一种利用无线遥控设备和自备的程序控制装置操纵的不载人飞机。操作员通过操控无线遥控设备实现对无人机的控制。UAV is an unmanned aircraft operated by wireless remote control equipment and self-contained program control device. The operator controls the UAV by manipulating the wireless remote control device.

目前通用的做法是通过遥控器上的按键对无人机进行控制,这种方法的缺点是操作单一,控制简单,无法进行复杂的控制。The current general practice is to control the drone through the buttons on the remote controller. The disadvantage of this method is that the operation is single, the control is simple, and complex control cannot be performed.

发明内容Contents of the invention

本申请实施例提供可移动设备的控制方法及装置,以扩大对可移动设备如:无人机、无人机的云台、无人机的相机的控制范围。Embodiments of the present application provide a control method and device for a mobile device, so as to expand the control range of the mobile device such as a drone, a pan/tilt of the drone, and a camera of the drone.

本申请的技术方案是这样实现的:The technical scheme of the present application is realized like this:

一种可移动设备的控制方法,该方法包括:A method for controlling a mobile device, the method comprising:

终端检测到用户手指按住本终端的屏幕,则记录用户手指在屏幕上的初始位置;The terminal detects that the user's finger is pressing the screen of the terminal, and records the initial position of the user's finger on the screen;

终端检测用户手指在屏幕上的位置,根据用户手指在屏幕上的当前位置以及用户手指在屏幕上的初始位置,确定用户手指的移动方式和移动距离;The terminal detects the position of the user's finger on the screen, and determines the movement mode and distance of the user's finger according to the current position of the user's finger on the screen and the initial position of the user's finger on the screen;

终端根据用户手指的移动方式,确定对可移动设备的控制方式;根据用户手指的移动距离,确定对可移动设备的控制量;The terminal determines the control mode of the movable device according to the movement mode of the user's finger; determines the control amount of the movable device according to the movement distance of the user's finger;

终端根据确定的控制方式和控制量,向可移动设备发送控制命令。The terminal sends a control command to the mobile device according to the determined control mode and control amount.

一种可移动设备的控制装置,该装置位于终端上,该装置包括:A control device for a mobile device, the device is located on a terminal, and the device includes:

触摸检测及计算模块:检测到用户手指按住本终端的屏幕,则记录用户手指在屏幕上的初始位置,检测用户手指在屏幕上的位置,根据用户手指在屏幕上的当前位置以及用户手指在屏幕上的初始位置,确定用户手指的移动方式和移动距离;Touch detection and calculation module: detect the user's finger pressing the screen of the terminal, then record the initial position of the user's finger on the screen, detect the position of the user's finger on the screen, according to the current position of the user's finger on the screen and the position of the user's finger The initial position on the screen, which determines how and how far the user's finger moves;

控制模块:根据触摸检测及计算模块确定的用户手指的移动方式,确定对可移动设备的控制方式;根据触摸检测及计算模块确定的用户手指的移动距离,确定对可移动设备的控制量;根据确定的控制方式和控制量,向可移动设备发送控制命令。Control module: determine the control mode for the movable device according to the movement mode of the user's finger determined by the touch detection and calculation module; determine the control amount for the movable device according to the movement distance of the user's finger determined by the touch detection and calculation module; Determine the control method and control amount, and send control commands to the mobile device.

可见,本申请实施例通过终端检测用户手指在屏幕上的移动方式和移动距离,实现了对无人机和无人机的云台、相机的复杂控制,扩大了对无人机和无人机的云台、相机的控制范围。It can be seen that the embodiment of the present application detects the movement mode and distance of the user's finger on the screen through the terminal, and realizes the complex control of the UAV and the pan/tilt and camera of the UAV, and expands the control of the UAV and UAV. The control range of the PTZ and camera.

附图说明Description of drawings

图1为本申请实施例提供的可移动设备的控制方法流程图;FIG. 1 is a flow chart of a control method for a mobile device provided in an embodiment of the present application;

图2为本申请实施例提供的终端控制无人机的方法流程图;FIG. 2 is a flowchart of a method for controlling a drone by a terminal provided in an embodiment of the present application;

图3为本申请实施例提供的终端控制无人机的云台的方法流程图;FIG. 3 is a flow chart of a method for controlling the pan/tilt of a drone by a terminal provided in an embodiment of the present application;

图4为本申请实施例提供的终端控制无人机的相机的方法流程图;FIG. 4 is a flow chart of a method for controlling a camera of a drone by a terminal provided in an embodiment of the present application;

图5为本申请实施例提供的可移动设备的控制装置的组成示意图。FIG. 5 is a schematic composition diagram of a control apparatus for a mobile device provided by an embodiment of the present application.

具体实施方式detailed description

下面结合附图及具体实施例对本发明再作进一步详细的说明。The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

图1为本申请实施例提供的可移动设备的控制方法流程图,其具体步骤如下:FIG. 1 is a flow chart of a control method for a mobile device provided in an embodiment of the present application, and its specific steps are as follows:

步骤101:终端检测到用户手指按住本终端的屏幕,则记录用户手指在屏幕上的初始位置。Step 101: The terminal detects that the user's finger is pressing the screen of the terminal, and records the initial position of the user's finger on the screen.

步骤102:终端检测用户手指在屏幕上的位置,根据用户手指在屏幕上的当前位置以及用户手指在屏幕上的初始位置,确定用户手指的移动方式和移动距离。Step 102: The terminal detects the position of the user's finger on the screen, and determines the moving mode and moving distance of the user's finger according to the current position of the user's finger on the screen and the initial position of the user's finger on the screen.

步骤103:终端根据用户手指的移动方式,确定对可移动设备的控制方式;根据用户手指的移动距离,确定对可移动设备的控制量。Step 103: The terminal determines the control mode for the movable device according to the movement mode of the user's finger; determines the control amount for the movable device according to the movement distance of the user's finger.

步骤104:终端根据确定的控制方式和控制量,向可移动设备发送控制命令。Step 104: The terminal sends a control command to the mobile device according to the determined control mode and control amount.

一较佳实施例中,当可移动设备为无人机时,用户手指为用户双指;In a preferred embodiment, when the mobile device is a drone, the user's fingers are the user's two fingers;

当可移动设备为无人机的云台时,用户手指为用户单指。When the movable device is the gimbal of the drone, the user's finger is the user's single finger.

一较佳实施例中,当可移动设备为无人机时,步骤102中,确定用户手指的移动距离包括:In a preferred embodiment, when the mobile device is a drone, in step 102, determining the moving distance of the user's finger includes:

终端分别根据用户每个手指在屏幕上的当前位置和初始位置,计算用户每个手指的移动距离,然后将两个手指中较小的移动距离作为用户双指的移动距离。The terminal calculates the movement distance of each finger of the user according to the current position and the initial position of each finger of the user on the screen, and then uses the smaller movement distance of the two fingers as the movement distance of the user's two fingers.

一较佳实施例中,当可移动设备为无人机时,步骤103中,根据用户手指的移动方式,确定对无人机的控制方式包括:In a preferred embodiment, when the movable device is an unmanned aerial vehicle, in step 103, according to the movement mode of the user's finger, determining the control mode for the unmanned aerial vehicle includes:

当用户双指向上移动时,确定对无人机的控制方式为:控制无人机上升;When the user moves two fingers upwards, determine the control method for the drone as follows: control the drone to rise;

或/和,当用户双指向下移动时,确定对无人机的控制方式为:控制无人机下降;Or/and, when the user moves two fingers down, determine the control method for the drone as: control the drone to descend;

或/和,当用户双指向左移动时,确定对无人机的控制方式为:控制无人机向左飞行;Or/and, when the user moves two fingers to the left, determine the control method for the drone as: control the drone to fly to the left;

或/和,当用户双指向右移动时,确定对无人机的控制方式为:控制无人机向右飞行;Or/and, when the user moves two fingers to the right, determine the control method for the drone as: control the drone to fly to the right;

或/和,当用户双指合拢时,确定对无人机的控制方式为:控制无人机后退;Or/and, when the user pinches two fingers together, determine the control method for the drone as: control the drone to move backward;

或/和,当用户双指分离时,确定对无人机的控制方式为:控制无人机前进。Or/and, when the user separates the two fingers, it is determined that the control method for the drone is: control the drone to move forward.

一较佳实施例中,当可移动设备为无人机时,预先将用户双指的移动方式划分为三个集合:第一集合为向上和向下移动;第二集合为:向左和向右移动,第三集合为合拢和分离;In a preferred embodiment, when the mobile device is an unmanned aerial vehicle, the movement modes of the user's two fingers are divided into three sets in advance: the first set is moving up and down; the second set is: moving left and Move right, the third set is closing and separating;

步骤102中,确定用户手指的移动方式包括:In step 102, determining the movement mode of the user's finger includes:

终端确认本次移动为用户双指按住本终端的屏幕后、用户双指在本终端屏幕上抬起前之间的第二次及之后的有效移动,则比较本次移动方式与最近一次的有效移动方式是否属于同一集合,若是,确定本次移动有效,记录本次移动方式,并继续执行步骤103;否则,确定本次移动无效,忽略本次移动。The terminal confirms that this movement is the second and subsequent valid movement between the time the user presses the screen of the terminal with two fingers and the time before the user lifts the two fingers on the screen of the terminal, and then compares this movement with the latest Whether the valid movement modes belong to the same set, if so, determine that the movement is valid, record the movement mode, and proceed to step 103; otherwise, determine that the movement is invalid, and ignore the movement.

一较佳实施例中,当可移动设备为无人机的云台时,步骤102中确定用户手指的移动距离包括:In a preferred embodiment, when the movable device is a pan/tilt of an unmanned aerial vehicle, determining the moving distance of the user's finger in step 102 includes:

根据用户手指在屏幕上的向左或向右方向的移动,确定用户手指在向左或向右方向上的移动距离,同时根据用户手指在屏幕上的向上或向下方向上的移动,确定用户手指在向上或向下方向上的移动距离。According to the leftward or rightward movement of the user's finger on the screen, determine the moving distance of the user's finger in the leftward or rightward direction, and at the same time determine the user's fingertip according to the upward or downward movement of the user's finger on the screen The distance to move in the up or down direction.

一较佳实施例中,当可移动设备为无人机的云台时,步骤101中,终端记录用户手指在屏幕上的初始位置进一步包括:In a preferred embodiment, when the mobile device is a pan/tilt of a drone, in step 101, the terminal recording the initial position of the user's finger on the screen further includes:

终端以用户手指在屏幕上的初始位置为圆心,以预设半径值为半径在屏幕上画一个圆;The terminal takes the initial position of the user's finger on the screen as the center of the circle, and draws a circle on the screen with the preset radius as the radius;

步骤102中,确定用户手指的移动距离包括:In step 102, determining the moving distance of the user's finger includes:

当用户手指在一方向上的移动距离大于圆的半径时,则将用户手指在该方向上的移动距离强制为圆的半径。When the moving distance of the user's finger in a direction is greater than the radius of the circle, the moving distance of the user's finger in this direction is forced to be the radius of the circle.

一较佳实施例中,步骤103中,根据用户手指的移动距离,确定对可移动设备的控制量包括:In a preferred embodiment, in step 103, determining the amount of control on the movable device according to the moving distance of the user's finger includes:

将用户手指的移动距离除以预设的比例阈值得到一个比例值,再将该比例值乘以预设的最大控制量,得到对可移动设备的控制量。A proportional value is obtained by dividing the moving distance of the user's finger by the preset proportional threshold, and then the proportional value is multiplied by the preset maximum control amount to obtain the control amount for the movable device.

一较佳实施例中,步骤102中,确定用户手指的移动距离包括:In a preferred embodiment, in step 102, determining the moving distance of the user's finger includes:

若终端发现用户手指的移动距离小于预设最小移动距离,则认为用户手指的本次移动无效。If the terminal finds that the movement distance of the user's finger is less than the preset minimum movement distance, it considers that the movement of the user's finger is invalid.

一较佳实施例中,当可移动设备为无人机时,终端检测到用户双指抬起,则向无人机发送悬停命令。In a preferred embodiment, when the movable device is a drone, the terminal detects that the user lifts up two fingers, and then sends a hovering command to the drone.

一较佳实施例中,当可移动设备为无人机的云台时,当终端检测到用户单指抬起时,向云台发送静止命令。In a preferred embodiment, when the movable device is a pan/tilt of an unmanned aerial vehicle, when the terminal detects that the user lifts up a single finger, it sends a stationary command to the pan/tilt.

图2为本申请实施例提供的终端控制无人机的方法流程图,其具体步骤如下:Fig. 2 is the flow chart of the method for terminal control UAV provided by the embodiment of the present application, and its specific steps are as follows:

步骤201:终端检测到用户双指按住本终端的屏幕,则记录用户双指在屏幕上的初始位置。Step 201: The terminal detects that the user presses the screen of the terminal with two fingers, and records the initial position of the user's two fingers on the screen.

步骤202:终端周期性地检测用户双指在屏幕上的位置,根据用户双指在屏幕上的当前位置以及用户双指在屏幕上的初始位置,确定用户双指的移动方式和移动距离。Step 202: The terminal periodically detects the position of the user's two fingers on the screen, and determines the movement method and distance of the user's two fingers based on the current position of the user's two fingers on the screen and the initial position of the user's two fingers on the screen.

具体地,终端具有默认的像素坐标系,该坐标系的原点是屏幕的左上角的像素点,该坐标系的水平方向为终端的宽度方向,且向右的方向为水平正方向,该坐标系的垂直方向为终端的高度方向,且向下的方向为垂直正方向。Specifically, the terminal has a default pixel coordinate system. The origin of the coordinate system is the pixel point in the upper left corner of the screen. The horizontal direction of the coordinate system is the width direction of the terminal, and the right direction is the horizontal positive direction. The vertical direction of is the height direction of the terminal, and the downward direction is the vertical positive direction.

用户可在终端上设置一个向上移动、向下移动、向左移动、向右移动、双指合拢、双指分离的角度范围,以确定用户双指的移动方式。例如设置:The user can set an angle range on the terminal for upward movement, downward movement, leftward movement, rightward movement, two-finger close-up, and two-finger separation, so as to determine the movement mode of the user's two fingers. Example settings:

1)当用户双指的移动方向与像素坐标系的垂直负方向的夹角都在[-a°,a°]内时,则确定用户双指向上移动;1) When the included angle between the moving direction of the user's two fingers and the vertical negative direction of the pixel coordinate system is within [-a°, a°], it is determined that the user's two fingers move upward;

其中,a可根据经验确定,例如为30;另外,用户每个手指的移动方向,可根据用户手指在屏幕上的当前坐标与用户手指在屏幕上的初始坐标计算得到。Wherein, a can be determined empirically, for example, is 30; in addition, the moving direction of each finger of the user can be calculated according to the current coordinates of the user's finger on the screen and the initial coordinates of the user's finger on the screen.

2)当用户双指的移动方向与像素坐标系的垂直正方向的夹角都在[-a°,a°]内时,则确定用户双指向下移动;2) When the angle between the moving direction of the user's two fingers and the vertical positive direction of the pixel coordinate system is within [-a°, a°], it is determined that the user's two fingers are moving downward;

3)当用户双指的移动方向与像素坐标系的水平负方向的夹角都在[-b°,b°]内时,则确定用户双指向左移动;3) When the angle between the moving direction of the user's two fingers and the horizontal negative direction of the pixel coordinate system is within [-b°, b°], it is determined that the user's two fingers move to the left;

其中,b可根据经验确定,例如为30。Wherein, b can be determined empirically, for example, it is 30.

4)当用户双指的移动方向与像素坐标系的水平正方向的夹角都在[-b°,b°]内时,则确定用户双指向右移动;4) When the angle between the moving direction of the user's two fingers and the horizontal positive direction of the pixel coordinate system is within [-b°, b°], it is determined that the user's two fingers move to the right;

5)当用户左指的移动方向与像素坐标系的水平正方向的夹角在[-c°,c°]内,且用户右指的移动方向与像素坐标系的水平负方向的夹角在[-c°,c°]内时,则确定用户双指合拢;5) When the angle between the moving direction of the user's left finger and the horizontal positive direction of the pixel coordinate system is within [-c°, c°], and the angle between the moving direction of the user's right finger and the horizontal negative direction of the pixel coordinate system is within When it is within [-c°, c°], it is determined that the user pinches two fingers together;

其中,c可根据经验确定,例如为30。Wherein, c can be determined empirically, for example, it is 30.

6)当用户左指的移动方向与像素坐标系的水平负方向的夹角在[-c°,c°]内,且用户右指的移动方向与像素坐标系的水平正方向的夹角在[-c°,c°]内时,则确定用户双指分离。6) When the angle between the moving direction of the user's left finger and the horizontal negative direction of the pixel coordinate system is within [-c°, c°], and the angle between the moving direction of the user's right finger and the horizontal positive direction of the pixel coordinate system is within When it is within [-c°, c°], it is determined that the user's two fingers are separated.

用户双指的移动距离的计算过程如下:The calculation process of the moving distance of the user's two fingers is as follows:

分别根据用户每个手指在屏幕上的当前坐标和初始坐标,计算用户每个手指的移动距离,然后将两个手指中较小的移动距离作为用户双指的移动距离。Calculate the movement distance of each finger of the user according to the current coordinates and initial coordinates of each finger on the screen respectively, and then use the smaller movement distance of the two fingers as the movement distance of the user's two fingers.

优选地,若终端发现用户双指的移动距离小于预设最小移动距离,则认为用户双指本次移动无效。Preferably, if the terminal finds that the movement distance of the user's two fingers is less than the preset minimum movement distance, it considers that the movement of the user's two fingers is invalid.

步骤203:终端根据用户双指的移动方式,确定对无人机的控制方式;根据用户双指的移动距离,确定对无人机的控制量。Step 203: The terminal determines the control mode of the drone according to the movement mode of the user's two fingers; determines the control amount of the drone according to the movement distance of the user's two fingers.

具体地:specifically:

1)当用户双指向上移动时,确定对无人机的控制方式为:控制无人机上升;1) When the user moves up with two fingers, determine the control method for the UAV: control the UAV to rise;

2)当用户双指向下移动时,确定对无人机的控制方式为:控制无人机下降;2) When the user's two fingers move down, determine the control method for the UAV: control the UAV to descend;

3)当用户双指向左移动时,确定对无人机的控制方式为:控制无人机向左飞行;3) When the user moves two fingers to the left, determine the control method for the UAV: control the UAV to fly to the left;

4)当用户双指向右移动时,确定对无人机的控制方式为:控制无人机向右飞行;4) When the user moves two fingers to the right, determine the control method for the UAV: control the UAV to fly to the right;

5)当用户双指合拢时,确定对无人机的控制方式为:控制无人机后退;5) When the user pinches two fingers together, the control method for the drone is determined as: control the drone to retreat;

6)当用户双指分离时,确定对无人机的控制方式为:控制无人机前进。6) When the user separates the two fingers, determine the control method for the UAV: control the UAV to move forward.

根据用户双指的移动距离,确定对无人机的控制量的具体过程如下:According to the moving distance of the user's two fingers, the specific process of determining the control amount of the drone is as follows:

将用户双指的移动距离除以预设的比例阈值得到一个比例值,再将该比例值乘以预设的最大控制量,得到对无人机的控制量,该控制量通常为速度。Divide the moving distance of the user's two fingers by the preset proportional threshold to obtain a proportional value, and then multiply the proportional value by the preset maximum control amount to obtain the control amount of the drone, which is usually the speed.

其中,当用户双指向上、向下移动时,其对应的比例阈值相同,可以为终端的屏幕高度或者设定的其它值;当用户双指向左、向右移动以及合拢、分离时,其对应的比例阈值相同,可以为终端的屏幕宽度或者设定的其它值。Among them, when the user's two fingers move up and down, the corresponding ratio thresholds are the same, which can be the screen height of the terminal or other values set; The ratio threshold of , which can be the screen width of the terminal or other set values, is the same.

步骤204:终端根据确定的控制方式和控制量,向无人机发送控制命令。Step 204: The terminal sends a control command to the UAV according to the determined control method and control amount.

优选地,当终端检测到用户双指抬起时,向无人机发送悬停命令。Preferably, when the terminal detects that the user's two fingers are lifted, a hovering command is sent to the drone.

优选地,预先将用户双指的移动方式划分为三个集合:第一集合为向上和向下移动;第二集合为:向左和向右移动,第三集合为合拢和分离,步骤202中,终端确定用户双指的移动方式时,若确认本次移动为用户双指按住屏幕后到用户双指在屏幕上抬起前之间的第二次及之后的有效移动,则比较本次移动方式与记录的最近一次的有效移动方式是否属于同一集合,若是,确定本次移动有效,记录本次移动方式,并继续执行后续流程;否则,确定本次移动无效,忽略本次移动。且,当用户双指在屏幕上抬起时,删除已记录的用户手指的所有有效移动方式。Preferably, the movement modes of the user's two fingers are divided into three sets in advance: the first set is moving up and down; the second set is: moving left and right; the third set is closing and separating. In step 202 , when the terminal determines the movement mode of the user's two fingers, if it is confirmed that this movement is the second and subsequent effective movements between the time the user presses the two fingers on the screen and the time before the user lifts the two fingers on the screen, then compare this time Whether the movement method and the last valid movement method recorded belong to the same set. If so, determine that the movement is valid, record the movement method, and continue to execute the follow-up process; otherwise, determine that the movement is invalid and ignore the movement. And, when the user lifts two fingers on the screen, delete all valid movement modes of the user's fingers that have been recorded.

也就是说,当用户双指在屏幕上按下后到抬起前,若第一次移动方式为向上或向下移动,则此后只有向上或向下移动为有效移动,其它移动都为无效移动;That is to say, when the user presses two fingers on the screen and lifts them up, if the first movement is up or down, then only the up or down movement will be valid, and all other movements will be invalid. ;

当用户双指在屏幕上按下后到抬起前,若第一次移动方式为向左或向右移动,则此后只有向左或向右移动为有效移动,其它移动都为无效移动;When the user presses two fingers on the screen and lifts it up, if the first movement is to move left or right, then only the left or right movement is a valid movement, and other movements are invalid movements;

当用户双指在屏幕上按下后到抬起前,若第一次移动方式为合拢或分离,则此后只有合拢或分离为有效移动,其它移动都为无效移动;When the user presses two fingers on the screen and lifts them up, if the first movement method is to close or separate, then only close or separate is a valid movement, and other movements are invalid;

当终端检测到用户双指在屏幕上按下后到用户双指在屏幕上抬起时,此间为一轮控制过程;当用户双指重新在屏幕上按下后,新一轮的控制开始。When the terminal detects that the user's two fingers are pressed on the screen and the user's two fingers are lifted on the screen, there is a round of control process; when the user's two fingers are pressed again on the screen, a new round of control begins.

图3为本申请实施例提供的终端控制无人机的云台的方法流程图,其具体步骤如下:Fig. 3 is the flow chart of the method for the terminal to control the pan/tilt of the unmanned aerial vehicle provided by the embodiment of the present application, and its specific steps are as follows:

步骤301:终端检测到用户单指按住本终端的屏幕,则记录用户手指在屏幕上的初始位置。Step 301: The terminal detects that the user presses the screen of the terminal with a single finger, and records the initial position of the user's finger on the screen.

步骤302:终端以用户手指在屏幕上的初始位置为圆心,以预设半径值为半径在屏幕上画一个圆。Step 302: The terminal draws a circle on the screen with the initial position of the user's finger on the screen as the center and with a preset radius as the radius.

步骤303:终端周期性地检测用户手指在屏幕上的位置,根据用户手指在屏幕上的当前位置和初始位置,计算用户手指在屏幕上的移动方向和移动距离。Step 303: The terminal periodically detects the position of the user's finger on the screen, and calculates the moving direction and moving distance of the user's finger on the screen according to the current position and the initial position of the user's finger on the screen.

需要说明的是,与控制无人机只能单方向控制不同,控制云台时,不仅可以控制云台单方向移动,也可以同时控制云台向两个方向移动,例如:向左上、左下、右上、右下移动。It should be noted that, unlike controlling a drone that can only be controlled in one direction, when controlling the gimbal, you can not only control the gimbal to move in one direction, but also control the gimbal to move in two directions at the same time, for example: up left, down left, Move up and down right.

在计算用户手指在屏幕上的移动方向和移动距离时,可根据用户手指在屏幕上的水平方向(向左或向右)的移动,确定用户手指在水平方向上的移动距离,同时根据用户手指在屏幕上的垂直方向(向上或向下)的移动,确定用户手指在垂直方向上的移动距离。When calculating the movement direction and distance of the user's finger on the screen, the movement distance of the user's finger in the horizontal direction can be determined according to the movement of the user's finger in the horizontal direction (to the left or right) on the screen, and at the same time according to the movement distance of the user's finger on the screen. The movement in the vertical direction (up or down) on the screen determines the moving distance of the user's finger in the vertical direction.

优选地,当用户手指在水平方向和垂直方向上的移动距离大于圆的半径时,则将用户手指在水平方向和垂直方向上的移动距离强制为圆的半径。Preferably, when the moving distance of the user's finger in the horizontal direction and the vertical direction is greater than the radius of the circle, the moving distance of the user's finger in the horizontal direction and the vertical direction is forced to be the radius of the circle.

步骤304:终端根据用户手指在屏幕上的移动方向,确定对无人机的云台的控制方向;根据用户手指在屏幕上的移动距离,确定对无人机的云台的控制量。Step 304: The terminal determines the direction of controlling the pan/tilt of the drone according to the moving direction of the user's finger on the screen; determines the control amount of the pan/tilt of the drone according to the moving distance of the user's finger on the screen.

具体地,在根据用户手指在屏幕上的移动距离,确定对无人机的云台的控制量时,若用户手指在两个方向上进行了移动,则分别针对每个方向上的移动距离,计算每个方向上对无人机的控制量。Specifically, when determining the control amount of the gimbal of the drone according to the moving distance of the user's finger on the screen, if the user's finger moves in two directions, then for the moving distance in each direction, Calculate the amount of control for the drone in each direction.

具体地,将用户手指在某个方向上的移动距离除以预设的比例阈值,得到一个比例值,将该比例值乘以预设最大控制量,得到该方向上对云台的控制量。其中,预设的比例阈值可以为圆的半径。Specifically, the moving distance of the user's finger in a certain direction is divided by a preset ratio threshold value to obtain a ratio value, and the ratio value is multiplied by a preset maximum control amount to obtain the control amount of the pan/tilt in this direction. Wherein, the preset ratio threshold may be a radius of a circle.

控制量通常为速度。The controlled quantity is usually speed.

优选地,当用户手指的移动距离小于预设最小移动距离时,认为用户手指的本次移动无效。Preferably, when the moving distance of the user's finger is less than the preset minimum moving distance, the current movement of the user's finger is considered invalid.

步骤305:终端根据确定的对云台的控制方向和控制量,向云台发送控制命令。Step 305: The terminal sends a control command to the pan-tilt according to the determined control direction and control amount of the pan-tilt.

具体地,当用户手指在两个方向上进行了移动时,则需要在控制命令中同时携带针对该两个方向的控制量。Specifically, when the user's finger moves in two directions, it is necessary to simultaneously carry the control values for the two directions in the control command.

优选地,当用户手指抬起时,向云台发送静止命令,以命令云台停在当前位置。Preferably, when the user lifts the finger, a static command is sent to the pan/tilt to command the pan/tilt to stop at the current position.

图4为本申请实施例提供的终端控制无人机的相机的方法流程图,其具体步骤如下:FIG. 4 is a flowchart of a method for controlling a camera of a drone by a terminal provided in an embodiment of the present application, and the specific steps are as follows:

步骤401:终端检测到用户手指点击了本终端的相机应用,则打开相机界面。Step 401: The terminal detects that the user's finger clicks on the camera application of the terminal, and opens the camera interface.

步骤402:终端检测到用户手指点击了相机界面上的拍照按钮,则向无人机的相机发送拍照命令。Step 402: The terminal detects that the user's finger clicks the camera interface button, and then sends a camera command to the camera of the drone.

步骤403:终端检测到用户手指点击了相机界面上的切换工作模式按钮,且确认用户要切换到视频模式,则向无人机的相机发送进入视频模式命令;当检测到用户手指点击了开始录制按钮,则向无人机的相机发送开始录制视频命令,同时将开始录制按钮变成停止录制按钮;当检测到用户手指点击了停止录制按钮,则向无人机的相机发送停止录制视频命令。Step 403: The terminal detects that the user's finger clicks the switch working mode button on the camera interface, and confirms that the user wants to switch to the video mode, then sends a command to enter the video mode to the camera of the drone; when it detects that the user's finger clicks to start recording button, send a command to start recording video to the camera of the drone, and change the start recording button to a stop recording button at the same time; when it is detected that the user's finger clicks the stop recording button, a command to stop recording video is sent to the camera of the drone.

切换工作模式按钮默认为拍照模式,可在拍照模式和视频模式之间切换。The switch working mode button defaults to photo mode, which can be switched between photo mode and video mode.

优选地,终端向无人机的相机发送拍照命令后,在收到相机返回的响应时,可向用户显示“拍照中”,在收到相机发来的拍照结束通知时,可向用户显示“拍照结束”;同样地,在向相机发送开始录制视频命令后,在收到相机返回的响应时,可向用户显示“录制视频中”,在向相机发送停止录制视频命令后,在收到相机返回的响应时,可向用户显示“录制结束”。Preferably, after the terminal sends a photographing command to the camera of the drone, it may display "photographing" to the user when receiving a response from the camera, and may display "photographing" to the user when receiving a notification of the end of photographing from the camera. The end of taking pictures"; similarly, after sending the command to start recording video to the camera, when receiving the response returned by the camera, it can display "recording video" to the user, after sending the command to stop recording video to the camera, after receiving the camera When a response is returned, "recording ended" can be displayed to the user.

优选地,当使用遥控器控制无人机的相机时,相机接收到遥控器发来的控制命令时,会将该控制命令同步到终端显示。例如:相机接收到遥控器发来的开始录制视频命令时,会向终端发送开始录制视频通知,终端收到该通知时,在屏幕上向用户显示“录制视频中”,相机接收到遥控器发来的停止录制视频命令时,会向终端发送录制视频结束通知,终端收到该通知时,在屏幕上向用户显示“录制结束”。Preferably, when the remote control is used to control the camera of the drone, when the camera receives a control command from the remote control, the control command will be synchronized to the terminal for display. For example: when the camera receives the start video recording command from the remote control, it will send a video recording start notification to the terminal. When a command to stop video recording comes, a notification of the end of video recording will be sent to the terminal. When the terminal receives the notification, it will display "recording ended" to the user on the screen.

优选地,终端检测到用户设置了相机参数时,将该相机参数携带在设置命令中发送给相机,并在接收到相机返回的设置成功或失败指示后,向用户显示“设置成功或失败”。Preferably, when the terminal detects that the user has set the camera parameters, it sends the camera parameters in the setting command to the camera, and after receiving the setting success or failure indication returned by the camera, displays "setting success or failure" to the user.

本申请实施例中的终端为任何具备触摸屏的终端,包含:PC、手持终端等,手持终端如手机。The terminal in the embodiment of the present application is any terminal with a touch screen, including: PC, handheld terminal, etc., such as a mobile phone.

图5为本申请实施例提供的可移动设备的控制装置的组成示意图,该装置位于终端上,该装置主要包括:触摸检测及计算模块和控制模块,其中:Fig. 5 is a schematic diagram of the composition of the mobile device control device provided by the embodiment of the present application. The device is located on the terminal, and the device mainly includes: a touch detection and calculation module and a control module, wherein:

触摸检测及计算模块:检测到用户手指按住本终端的屏幕,则记录用户手指在屏幕上的初始位置,检测用户手指在屏幕上的位置,根据用户手指在屏幕上的当前位置以及用户手指在屏幕上的初始位置,确定用户手指的移动方式和移动距离。Touch detection and calculation module: detect the user's finger pressing the screen of the terminal, then record the initial position of the user's finger on the screen, detect the position of the user's finger on the screen, according to the current position of the user's finger on the screen and the position of the user's finger The initial position on the screen, which determines how and how far the user's finger moves.

控制模块:根据触摸检测及计算模块确定的用户手指的移动方式,确定对可移动设备的控制方式;根据触摸检测及计算模块确定的用户手指的移动距离,确定对可移动设备的控制量;根据确定的控制方式和控制量,向可移动设备发送控制命令。Control module: determine the control mode for the movable device according to the movement mode of the user's finger determined by the touch detection and calculation module; determine the control amount for the movable device according to the movement distance of the user's finger determined by the touch detection and calculation module; Determine the control method and control amount, and send control commands to the mobile device.

一较佳实施例中,当可移动设备为无人机时,触摸检测及计算模块检测到的用户手指为用户双指;In a preferred embodiment, when the mobile device is a drone, the user's finger detected by the touch detection and calculation module is the user's two fingers;

当可移动设备为无人机的云台时,触摸检测及计算模块检测到的用户手指为用户单指。When the movable device is the pan/tilt of the drone, the user's finger detected by the touch detection and calculation module is the user's single finger.

一较佳实施例中,当可移动设备为无人机时,In a preferred embodiment, when the mobile device is a drone,

触摸检测及计算模块确定用户手指的移动距离包括:The touch detection and calculation module determines the moving distance of the user's finger including:

分别根据用户每个手指在屏幕上的当前位置和初始位置,计算用户每个手指的移动距离,然后将两个手指中较小的移动距离作为用户双指的移动距离。Calculate the moving distance of each finger of the user according to the current position and the initial position of each finger on the screen, and then use the smaller moving distance of the two fingers as the moving distance of the user's two fingers.

一较佳实施例中,当可移动设备为无人机时,In a preferred embodiment, when the mobile device is an unmanned aerial vehicle,

控制模块根据触摸检测及计算模块确定的用户手指的移动方式,确定对无人机的控制方式包括:The control module determines the control mode of the drone according to the movement mode of the user's finger determined by the touch detection and calculation module, including:

当用户双指向上移动时,确定对无人机的控制方式为:控制无人机上升;When the user moves two fingers upwards, determine the control method for the drone as follows: control the drone to rise;

或/和,当用户双指向下移动时,确定对无人机的控制方式为:控制无人机下降;Or/and, when the user moves two fingers down, determine the control method for the drone as: control the drone to descend;

或/和,当用户双指向左移动时,确定对无人机的控制方式为:控制无人机向左飞行;Or/and, when the user moves two fingers to the left, determine the control method for the drone as: control the drone to fly to the left;

或/和,当用户双指向右移动时,确定对无人机的控制方式为:控制无人机向右飞行;Or/and, when the user moves two fingers to the right, determine the control method for the drone as: control the drone to fly to the right;

或/和,当用户双指合拢时,确定对无人机的控制方式为:控制无人机后退;Or/and, when the user pinches two fingers together, determine the control method for the drone as: control the drone to move backward;

或/和,当用户双指分离时,确定对无人机的控制方式为:控制无人机前进。Or/and, when the user separates the two fingers, it is determined that the control method for the drone is: control the drone to move forward.

一较佳实施例中,当可移动设备为无人机时,In a preferred embodiment, when the mobile device is a drone,

触摸检测及计算模块预先保存用户为用户双指的移动方式划分的三个集合:第一集合为向上和向下移动;第二集合为:向左和向右移动,第三集合为合拢和分离;The touch detection and calculation module pre-saves three sets divided by the user for the movement of the user's two fingers: the first set is moving up and down; the second set is: moving left and right; the third set is closing and separating ;

触摸检测及计算模块确定用户手指的移动方式包括:The touch detection and calculation module determines the movement mode of the user's finger including:

确认本次移动为用户双指按住本终端的屏幕后、用户双指在本终端屏幕上抬起前之间的第二次及之后的有效移动,则比较本次移动方式与最近一次的有效移动方式是否属于同一集合,若是,确定本次移动有效,记录本次移动方式;否则,确定本次移动无效。After confirming that this movement is the second and subsequent effective movement between the user holding down the screen of the terminal with two fingers and before lifting the user's two fingers on the screen of the terminal, compare this movement method with the latest effective movement. Whether the movement methods belong to the same set, if so, determine that this movement is valid, and record this movement method; otherwise, determine that this movement is invalid.

一较佳实施例中,当可移动设备为无人机的云台时,触摸检测及计算模块确定用户手指的移动距离包括:In a preferred embodiment, when the mobile device is a pan/tilt of an unmanned aerial vehicle, the touch detection and calculation module determines the movement distance of the user's finger including:

根据用户手指在屏幕上的向左或向右方向的移动,确定用户手指在向左或向右方向上的移动距离,同时根据用户手指在屏幕上的向上或向下方向上的移动,确定用户手指在向上或向下方向上的移动距离。According to the leftward or rightward movement of the user's finger on the screen, determine the moving distance of the user's finger in the leftward or rightward direction, and at the same time determine the user's fingertip according to the upward or downward movement of the user's finger on the screen The distance to move in the up or down direction.

一较佳实施例中,触摸检测及计算模块记录用户手指在屏幕上的初始位置进一步包括:In a preferred embodiment, recording the initial position of the user's finger on the screen by the touch detection and calculation module further includes:

以用户手指在屏幕上的初始位置为圆心,以预设半径值为半径在屏幕上画一个圆;Draw a circle on the screen with the initial position of the user's finger on the screen as the center and the preset radius as the radius;

触摸检测及计算模块确定用户手指的移动距离包括:The touch detection and calculation module determines the moving distance of the user's finger including:

当用户手指在一方向上的移动距离大于圆的半径时,则将用户手指在该方向上的移动距离强制为圆的半径。When the moving distance of the user's finger in a direction is greater than the radius of the circle, the moving distance of the user's finger in this direction is forced to be the radius of the circle.

一较佳实施例中,控制模块根据触摸检测及计算模块确定的用户手指的移动距离,确定对可移动设备的控制量包括:In a preferred embodiment, the control module determines the amount of control on the movable device according to the movement distance of the user's finger determined by the touch detection and calculation module:

将用户手指的移动距离除以预设的比例阈值得到一个比例值,再将该比例值乘以预设的最大控制量,得到对可移动设备的控制量。A proportional value is obtained by dividing the moving distance of the user's finger by the preset proportional threshold, and then the proportional value is multiplied by the preset maximum control amount to obtain the control amount for the movable device.

一较佳实施例中,控制模块进一步用于,In a preferred embodiment, the control module is further used to:

检测到用户手指点击了本终端的相机应用,则打开相机界面;When it is detected that the user's finger clicks on the camera application of the terminal, the camera interface is opened;

检测到用户手指点击了相机界面上的拍照按钮,则向无人机的相机发送拍照命令;Detect that the user's finger clicks the photo button on the camera interface, and then send a photo command to the drone's camera;

检测到用户手指点击了相机界面上的切换工作模式按钮,且确认用户要切换到视频模式,则向无人机的相机发送进入视频模式命令;当检测到用户手指点击了开始录制按钮,则向无人机的相机发送开始录制视频命令,同时将开始录制按钮变成停止录制按钮;当检测到用户手指点击了停止录制按钮,则向无人机的相机发送停止录制视频命令。When it is detected that the user's finger clicks the switch working mode button on the camera interface, and it is confirmed that the user wants to switch to the video mode, a command to enter the video mode is sent to the camera of the drone; when it is detected that the user's finger clicks the start recording button, the The drone's camera sends a command to start recording video, and at the same time changes the start recording button to a stop recording button; when it is detected that the user's finger clicks the stop recording button, a command to stop recording video is sent to the drone's camera.

一较佳实施例中,控制模块进一步用于,接收无人机的相机发来的遥控器对该相机的控制命令,将该控制命令显示给用户。In a preferred embodiment, the control module is further configured to receive a control command for the camera from a remote controller sent by the camera of the drone, and display the control command to the user.

以上所述仅为本申请的较佳实施例而已,并不用以限制本申请,凡在本申请的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本申请保护的范围之内。The above is only a preferred embodiment of the application, and is not intended to limit the application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the application should be included in the application. within the scope of protection.

Claims (20)

1.一种可移动设备的控制方法,其特征在于,该方法包括:1. A control method for a movable device, characterized in that the method comprises: 终端检测到用户手指按住本终端的屏幕,则记录用户手指在屏幕上的初始位置;The terminal detects that the user's finger is pressing the screen of the terminal, and records the initial position of the user's finger on the screen; 终端检测用户手指在屏幕上的位置,根据用户手指在屏幕上的当前位置以及用户手指在屏幕上的初始位置,确定用户手指的移动方式和移动距离;The terminal detects the position of the user's finger on the screen, and determines the movement mode and distance of the user's finger according to the current position of the user's finger on the screen and the initial position of the user's finger on the screen; 终端根据用户手指的移动方式,确定对可移动设备的控制方式;根据用户手指的移动距离,确定对可移动设备的控制量;The terminal determines the control mode of the movable device according to the movement mode of the user's finger; determines the control amount of the movable device according to the movement distance of the user's finger; 终端根据确定的控制方式和控制量,向可移动设备发送控制命令。The terminal sends a control command to the mobile device according to the determined control mode and control amount. 2.根据权利要求1所述的方法,其特征在于,当所述可移动设备为无人机时,所述用户手指为用户双指;2. The method according to claim 1, wherein when the movable device is a drone, the user's fingers are the user's two fingers; 当所述可移动设备为无人机的云台时,所述用户手指为用户单指。When the movable device is a pan-tilt of an unmanned aerial vehicle, the user's finger is a user's single finger. 3.根据权利要求2所述的方法,其特征在于,当所述可移动设备为无人机时,3. The method according to claim 2, wherein when the movable device is an unmanned aerial vehicle, 所述确定用户手指的移动距离包括:The determination of the moving distance of the user's finger includes: 终端分别根据用户每个手指在屏幕上的当前位置和初始位置,计算用户每个手指的移动距离,然后将两个手指中较小的移动距离作为用户双指的移动距离。The terminal calculates the movement distance of each finger of the user according to the current position and the initial position of each finger of the user on the screen, and then uses the smaller movement distance of the two fingers as the movement distance of the user's two fingers. 4.根据权利要求1所述的方法,其特征在于,当所述可移动设备为无人机时,4. The method according to claim 1, wherein when the movable device is an unmanned aerial vehicle, 所述终端根据用户手指的移动方式,确定对无人机的控制方式包括:According to the movement mode of the user's finger, the terminal determines the control mode of the drone including: 当用户双指向上移动时,确定对无人机的控制方式为:控制无人机上升;When the user moves two fingers upwards, determine the control method for the drone as follows: control the drone to rise; 或/和,当用户双指向下移动时,确定对无人机的控制方式为:控制无人机下降;Or/and, when the user moves two fingers down, determine the control method for the drone as: control the drone to descend; 或/和,当用户双指向左移动时,确定对无人机的控制方式为:控制无人机向左飞行;Or/and, when the user moves two fingers to the left, determine the control method for the drone as: control the drone to fly to the left; 或/和,当用户双指向右移动时,确定对无人机的控制方式为:控制无人机向右飞行;Or/and, when the user moves two fingers to the right, determine the control method for the drone as: control the drone to fly to the right; 或/和,当用户双指合拢时,确定对无人机的控制方式为:控制无人机后退;Or/and, when the user pinches two fingers together, determine the control method for the drone as: control the drone to move backward; 或/和,当用户双指分离时,确定对无人机的控制方式为:控制无人机前进。Or/and, when the user separates the two fingers, it is determined that the control method for the drone is: control the drone to move forward. 5.根据权利要求1所述的方法,其特征在于,当所述可移动设备为无人机时,5. The method according to claim 1, wherein when the movable device is an unmanned aerial vehicle, 预先将用户双指的移动方式划分为三个集合:第一集合为向上和向下移动;第二集合为:向左和向右移动,第三集合为合拢和分离;Divide the movement methods of the user's two fingers into three sets in advance: the first set is moving up and down; the second set is: moving left and right; the third set is closing and separating; 所述确定用户手指的移动方式包括:The method of determining the movement of the user's finger includes: 终端确认本次移动为用户双指按住本终端的屏幕后、用户双指在本终端屏幕上抬起前之间的第二次及之后的有效移动,则比较本次移动方式与最近一次的有效移动方式是否属于同一集合,若是,确定本次移动有效,记录本次移动方式;否则,确定本次移动无效。The terminal confirms that this movement is the second and subsequent valid movement between the time the user presses the screen of the terminal with two fingers and the time before the user lifts the two fingers on the screen of the terminal, and then compares this movement with the latest Whether the valid movement methods belong to the same set, if so, determine that this movement is valid, and record this movement method; otherwise, determine that this movement is invalid. 6.根据权利要求1所述的方法,其特征在于,当所述可移动设备为无人机的云台时,所述确定用户手指的移动距离包括:6. The method according to claim 1, wherein when the movable device is a pan/tilt of an unmanned aerial vehicle, determining the moving distance of the user's finger comprises: 根据用户手指在屏幕上的向左或向右方向的移动,确定用户手指在向左或向右方向上的移动距离,同时根据用户手指在屏幕上的向上或向下方向上的移动,确定用户手指在向上或向下方向上的移动距离。According to the leftward or rightward movement of the user's finger on the screen, determine the moving distance of the user's finger in the leftward or rightward direction, and at the same time determine the user's fingertip according to the upward or downward movement of the user's finger on the screen The distance to move in the up or down direction. 7.根据权利要求6所述的方法,其特征在于,所述记录用户手指在屏幕上的初始位置进一步包括:7. The method according to claim 6, wherein the recording the initial position of the user's finger on the screen further comprises: 终端以用户手指在屏幕上的初始位置为圆心,以预设半径值为半径在屏幕上画一个圆;The terminal takes the initial position of the user's finger on the screen as the center of the circle, and draws a circle on the screen with the preset radius as the radius; 所述确定用户手指的移动距离包括:The determination of the moving distance of the user's finger includes: 当用户手指在一方向上的移动距离大于圆的半径时,则将用户手指在该方向上的移动距离强制为圆的半径。When the moving distance of the user's finger in a direction is greater than the radius of the circle, the moving distance of the user's finger in this direction is forced to be the radius of the circle. 8.根据权利要求1所述的方法,其特征在于,所述根据用户手指的移动距离,确定对可移动设备的控制量包括:8. The method according to claim 1, wherein said determining the amount of control on the movable device according to the moving distance of the user's finger comprises: 将用户手指的移动距离除以预设的比例阈值得到一个比例值,再将该比例值乘以预设的最大控制量,得到对可移动设备的控制量。A proportional value is obtained by dividing the moving distance of the user's finger by the preset proportional threshold, and then the proportional value is multiplied by the preset maximum control amount to obtain the control amount for the movable device. 9.根据权利要求1所述的方法,其特征在于,所述方法进一步包括:9. The method of claim 1, further comprising: 终端检测到用户手指点击了本终端的相机应用,则打开相机界面;The terminal detects that the user's finger clicks on the camera application of the terminal, and then opens the camera interface; 终端检测到用户手指点击了相机界面上的拍照按钮,则向无人机的相机发送拍照命令;The terminal detects that the user's finger clicks the photo button on the camera interface, and then sends a photo command to the drone's camera; 终端检测到用户手指点击了相机界面上的切换工作模式按钮,且确认用户要切换到视频模式,则向无人机的相机发送进入视频模式命令;当检测到用户手指点击了开始录制按钮,则向无人机的相机发送开始录制视频命令,同时将开始录制按钮变成停止录制按钮;当检测到用户手指点击了停止录制按钮,则向无人机的相机发送停止录制视频命令。The terminal detects that the user's finger clicks the switch working mode button on the camera interface, and confirms that the user wants to switch to the video mode, then sends a command to enter the video mode to the camera of the drone; when it detects that the user's finger clicks the start recording button, then Send the start recording video command to the camera of the drone, and change the start recording button into a stop recording button at the same time; when it is detected that the user's finger clicks the stop recording button, send the stop recording video command to the drone's camera. 10.根据权利要求9所述的方法,其特征在于,所述方法进一步包括:10. The method of claim 9, further comprising: 终端接收无人机的相机发来的遥控器对该相机的控制命令,将该控制命令显示给用户。The terminal receives the control command of the camera from the remote controller sent by the camera of the drone, and displays the control command to the user. 11.一种可移动设备的控制装置,该装置位于终端上,其特征在于,该装置包括:11. A control device for a mobile device, the device is located on a terminal, characterized in that the device includes: 触摸检测及计算模块:检测到用户手指按住本终端的屏幕,则记录用户手指在屏幕上的初始位置,检测用户手指在屏幕上的位置,根据用户手指在屏幕上的当前位置以及用户手指在屏幕上的初始位置,确定用户手指的移动方式和移动距离;Touch detection and calculation module: detect the user's finger pressing the screen of the terminal, then record the initial position of the user's finger on the screen, detect the position of the user's finger on the screen, according to the current position of the user's finger on the screen and the position of the user's finger The initial position on the screen, which determines how and how far the user's finger moves; 控制模块:根据触摸检测及计算模块确定的用户手指的移动方式,确定对可移动设备的控制方式;根据触摸检测及计算模块确定的用户手指的移动距离,确定对可移动设备的控制量;根据确定的控制方式和控制量,向可移动设备发送控制命令。Control module: determine the control mode for the movable device according to the movement mode of the user's finger determined by the touch detection and calculation module; determine the control amount for the movable device according to the movement distance of the user's finger determined by the touch detection and calculation module; Determine the control method and control amount, and send control commands to the mobile device. 12.根据权利要求11所述的装置,其特征在于,当所述可移动设备为无人机时,所述触摸检测及计算模块检测到的用户手指为用户双指;12. The device according to claim 11, wherein when the movable device is a drone, the user's finger detected by the touch detection and calculation module is the user's two fingers; 当所述可移动设备为无人机的云台时,所述触摸检测及计算模块检测到的用户手指为用户单指。When the movable device is a pan/tilt of an unmanned aerial vehicle, the user's finger detected by the touch detection and calculation module is a user's single finger. 13.根据权利要求12所述的装置,其特征在于,当所述可移动设备为无人机时,13. The device according to claim 12, wherein when the movable device is a drone, 所述触摸检测及计算模块确定用户手指的移动距离包括:The touch detection and calculation module determines the movement distance of the user's finger including: 分别根据用户每个手指在屏幕上的当前位置和初始位置,计算用户每个手指的移动距离,然后将两个手指中较小的移动距离作为用户双指的移动距离。Calculate the moving distance of each finger of the user according to the current position and the initial position of each finger on the screen, and then use the smaller moving distance of the two fingers as the moving distance of the user's two fingers. 14.根据权利要求11所述的装置,其特征在于,当所述可移动设备为无人机时,14. The device according to claim 11, wherein when the movable device is a drone, 所述控制模块根据触摸检测及计算模块确定的用户手指的移动方式,确定对无人机的控制方式包括:The control module determines the control mode of the drone according to the movement mode of the user's finger determined by the touch detection and calculation module: 当用户双指向上移动时,确定对无人机的控制方式为:控制无人机上升;When the user moves two fingers upwards, determine the control method for the drone as follows: control the drone to rise; 或/和,当用户双指向下移动时,确定对无人机的控制方式为:控制无人机下降;Or/and, when the user moves two fingers down, determine the control method for the drone as: control the drone to descend; 或/和,当用户双指向左移动时,确定对无人机的控制方式为:控制无人机向左飞行;Or/and, when the user moves two fingers to the left, determine the control method for the drone as: control the drone to fly to the left; 或/和,当用户双指向右移动时,确定对无人机的控制方式为:控制无人机向右飞行;Or/and, when the user moves two fingers to the right, determine the control method for the drone as: control the drone to fly to the right; 或/和,当用户双指合拢时,确定对无人机的控制方式为:控制无人机后退;Or/and, when the user pinches two fingers together, determine the control method for the drone as: control the drone to move backward; 或/和,当用户双指分离时,确定对无人机的控制方式为:控制无人机前进。Or/and, when the user separates the two fingers, it is determined that the control method for the drone is: control the drone to move forward. 15.根据权利要求11所述的装置,其特征在于,当所述可移动设备为无人机时,15. The device according to claim 11, wherein when the movable device is a drone, 所述触摸检测及计算模块预先保存用户为用户双指的移动方式划分的三个集合:第一集合为向上和向下移动;第二集合为:向左和向右移动,第三集合为合拢和分离;The touch detection and calculation module pre-saves three sets divided by the user for the movement of the user's two fingers: the first set is moving up and down; the second set is: moving left and right, and the third set is closing and separation; 所述触摸检测及计算模块确定用户手指的移动方式包括:The touch detection and calculation module determines that the movement mode of the user's finger includes: 确认本次移动为用户双指按住本终端的屏幕后、用户双指在本终端屏幕上抬起前之间的第二次及之后的有效移动,则比较本次移动方式与最近一次的有效移动方式是否属于同一集合,若是,确定本次移动有效,记录本次移动方式;否则,确定本次移动无效。After confirming that this movement is the second and subsequent effective movement between the user holding down the screen of the terminal with two fingers and before lifting the user's two fingers on the screen of the terminal, compare this movement method with the latest effective movement. Whether the movement methods belong to the same set, if so, determine that this movement is valid, and record this movement method; otherwise, determine that this movement is invalid. 16.根据权利要求11所述的装置,其特征在于,当所述可移动设备为无人机的云台时,所述触摸检测及计算模块确定用户手指的移动距离包括:16. The device according to claim 11, wherein when the movable device is a pan/tilt of an unmanned aerial vehicle, determining the movement distance of the user's finger by the touch detection and calculation module includes: 根据用户手指在屏幕上的向左或向右方向的移动,确定用户手指在向左或向右方向上的移动距离,同时根据用户手指在屏幕上的向上或向下方向上的移动,确定用户手指在向上或向下方向上的移动距离。According to the leftward or rightward movement of the user's finger on the screen, determine the moving distance of the user's finger in the leftward or rightward direction, and at the same time determine the user's fingertip according to the upward or downward movement of the user's finger on the screen The distance to move in the up or down direction. 17.根据权利要求16所述的装置,其特征在于,所述触摸检测及计算模块记录用户手指在屏幕上的初始位置进一步包括:17. The device according to claim 16, wherein the recording of the initial position of the user's finger on the screen by the touch detection and calculation module further comprises: 以用户手指在屏幕上的初始位置为圆心,以预设半径值为半径在屏幕上画一个圆;Draw a circle on the screen with the initial position of the user's finger on the screen as the center and the preset radius as the radius; 所述触摸检测及计算模块确定用户手指的移动距离包括:The touch detection and calculation module determines the movement distance of the user's finger including: 当用户手指在一方向上的移动距离大于圆的半径时,则将用户手指在该方向上的移动距离强制为圆的半径。When the moving distance of the user's finger in a direction is greater than the radius of the circle, the moving distance of the user's finger in this direction is forced to be the radius of the circle. 18.根据权利要求11所述的装置,其特征在于,所述控制模块根据触摸检测及计算模块确定的用户手指的移动距离,确定对可移动设备的控制量包括:18. The device according to claim 11, wherein the control module determines the amount of control on the movable device according to the movement distance of the user's finger determined by the touch detection and calculation module: 将用户手指的移动距离除以预设的比例阈值得到一个比例值,再将该比例值乘以预设的最大控制量,得到对可移动设备的控制量。A proportional value is obtained by dividing the moving distance of the user's finger by the preset proportional threshold, and then the proportional value is multiplied by the preset maximum control amount to obtain the control amount for the movable device. 19.根据权利要求11所述的装置,其特征在于,所述控制模块进一步用于,19. The device according to claim 11, wherein the control module is further used for: 检测到用户手指点击了本终端的相机应用,则打开相机界面;When it is detected that the user's finger clicks on the camera application of the terminal, the camera interface is opened; 检测到用户手指点击了相机界面上的拍照按钮,则向无人机的相机发送拍照命令;Detect that the user's finger clicks the photo button on the camera interface, and then send a photo command to the drone's camera; 检测到用户手指点击了相机界面上的切换工作模式按钮,且确认用户要切换到视频模式,则向无人机的相机发送进入视频模式命令;当检测到用户手指点击了开始录制按钮,则向无人机的相机发送开始录制视频命令,同时将开始录制按钮变成停止录制按钮;当检测到用户手指点击了停止录制按钮,则向无人机的相机发送停止录制视频命令。When it is detected that the user's finger clicks the switch working mode button on the camera interface, and it is confirmed that the user wants to switch to the video mode, a command to enter the video mode is sent to the camera of the drone; when it is detected that the user's finger clicks the start recording button, the The drone's camera sends a command to start recording video, and at the same time changes the start recording button to a stop recording button; when it is detected that the user's finger clicks the stop recording button, a command to stop recording video is sent to the drone's camera. 20.根据权利要求19所述的装置,其特征在于,所述控制模块进一步用于,接收无人机的相机发来的遥控器对该相机的控制命令,将该控制命令显示给用户。20. The device according to claim 19, wherein the control module is further configured to receive a control command for the camera from a remote controller sent by the camera of the drone, and display the control command to the user.
CN201610109094.5A 2016-02-26 2016-02-26 The control method and device of movable equipment Expired - Fee Related CN105700812B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610109094.5A CN105700812B (en) 2016-02-26 2016-02-26 The control method and device of movable equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610109094.5A CN105700812B (en) 2016-02-26 2016-02-26 The control method and device of movable equipment

Publications (2)

Publication Number Publication Date
CN105700812A true CN105700812A (en) 2016-06-22
CN105700812B CN105700812B (en) 2018-11-23

Family

ID=56222436

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610109094.5A Expired - Fee Related CN105700812B (en) 2016-02-26 2016-02-26 The control method and device of movable equipment

Country Status (1)

Country Link
CN (1) CN105700812B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018081923A1 (en) * 2016-11-01 2018-05-11 深圳市道通智能航空技术有限公司 Aerial vehicle control method and apparatus
WO2018108162A1 (en) * 2016-12-15 2018-06-21 Powervision Robot Inc. Control system and method for drone with remote controller
WO2018150313A1 (en) * 2017-02-14 2018-08-23 Hangzhou Zero Zero Technology Co., Ltd. Aerial device and method for controlling the aerial device
CN108775685A (en) * 2018-05-31 2018-11-09 广东美的制冷设备有限公司 Remote control method, household appliance, remote control equipment and storage medium
CN109644233A (en) * 2017-02-24 2019-04-16 深圳市大疆创新科技有限公司 Many cloud platforms subassembly
CN109844709A (en) * 2016-08-26 2019-06-04 谷歌有限责任公司 Make image animation to indicate that image is translatable
CN111226181A (en) * 2019-03-29 2020-06-02 深圳市大疆创新科技有限公司 Control method and device for movable platform and movable platform
CN111447361A (en) * 2020-03-31 2020-07-24 安徽文香信息技术有限公司 Display switching method, device, equipment and storage medium
CN112203015A (en) * 2020-09-28 2021-01-08 北京小米松果电子有限公司 Camera control method, device and medium system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102346479A (en) * 2010-08-04 2012-02-08 鸿富锦精密工业(深圳)有限公司 Hand-hold apparatus and method for controlling unmanned aerial vehicle by utilizing hand-hold apparatus
CN103426282A (en) * 2013-07-31 2013-12-04 深圳市大疆创新科技有限公司 Remote control method and terminal
WO2014187027A1 (en) * 2013-05-22 2014-11-27 上海九鹰电子科技有限公司 Transmission device and method, and reception device and method of remote control signal
CN104598108A (en) * 2015-01-02 2015-05-06 北京时代沃林科技发展有限公司 Equipment and method for proportionally remote controlling vehicle and unmanned aerial vehicle by touching on intelligent terminal
CN105000170A (en) * 2015-07-15 2015-10-28 何春旺 Touch screen controller and control method of driving device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102346479A (en) * 2010-08-04 2012-02-08 鸿富锦精密工业(深圳)有限公司 Hand-hold apparatus and method for controlling unmanned aerial vehicle by utilizing hand-hold apparatus
WO2014187027A1 (en) * 2013-05-22 2014-11-27 上海九鹰电子科技有限公司 Transmission device and method, and reception device and method of remote control signal
CN103426282A (en) * 2013-07-31 2013-12-04 深圳市大疆创新科技有限公司 Remote control method and terminal
CN104598108A (en) * 2015-01-02 2015-05-06 北京时代沃林科技发展有限公司 Equipment and method for proportionally remote controlling vehicle and unmanned aerial vehicle by touching on intelligent terminal
CN105000170A (en) * 2015-07-15 2015-10-28 何春旺 Touch screen controller and control method of driving device

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109844709B (en) * 2016-08-26 2020-08-25 谷歌有限责任公司 Method and computerized system for presenting information
US10884601B2 (en) 2016-08-26 2021-01-05 Google Llc Animating an image to indicate that the image is pannable
CN109844709A (en) * 2016-08-26 2019-06-04 谷歌有限责任公司 Make image animation to indicate that image is translatable
CN110168462A (en) * 2016-11-01 2019-08-23 深圳市道通智能航空技术有限公司 The control method and device of aircraft
WO2018081923A1 (en) * 2016-11-01 2018-05-11 深圳市道通智能航空技术有限公司 Aerial vehicle control method and apparatus
WO2018108162A1 (en) * 2016-12-15 2018-06-21 Powervision Robot Inc. Control system and method for drone with remote controller
US11275390B2 (en) 2016-12-15 2022-03-15 Powervision Robot Inc. Control system and method for drone with remote controller
US10067504B1 (en) 2017-02-14 2018-09-04 Hangzhou Zero Zero Technology Co., Ltd. Aerial device and method for controlling the aerial device
CN110431505A (en) * 2017-02-14 2019-11-08 杭州零零科技有限公司 Aviation device and method for controlling aviation device
CN110431505B (en) * 2017-02-14 2022-03-29 杭州零零科技有限公司 Aircraft device and method for controlling an aircraft device
US12072704B2 (en) 2017-02-14 2024-08-27 Hangzhou Zero Zero Technology Co., Ltd. Aerial device and method for controlling the aerial device
WO2018150313A1 (en) * 2017-02-14 2018-08-23 Hangzhou Zero Zero Technology Co., Ltd. Aerial device and method for controlling the aerial device
US11003181B2 (en) 2017-02-14 2021-05-11 Hangzhou Zero Zero Technology Co., Ltd. Aerial device and method for controlling the aerial device
CN109644233A (en) * 2017-02-24 2019-04-16 深圳市大疆创新科技有限公司 Many cloud platforms subassembly
US11233943B2 (en) 2017-02-24 2022-01-25 SZ DJI Technology Co., Ltd. Multi-gimbal assembly
CN108775685A (en) * 2018-05-31 2018-11-09 广东美的制冷设备有限公司 Remote control method, household appliance, remote control equipment and storage medium
WO2020198998A1 (en) * 2019-03-29 2020-10-08 深圳市大疆创新科技有限公司 Control method and device for movable platform, and movable platform
CN111226181A (en) * 2019-03-29 2020-06-02 深圳市大疆创新科技有限公司 Control method and device for movable platform and movable platform
CN111447361A (en) * 2020-03-31 2020-07-24 安徽文香信息技术有限公司 Display switching method, device, equipment and storage medium
CN112203015A (en) * 2020-09-28 2021-01-08 北京小米松果电子有限公司 Camera control method, device and medium system
CN112203015B (en) * 2020-09-28 2022-03-25 北京小米松果电子有限公司 Camera control method, device and medium system

Also Published As

Publication number Publication date
CN105700812B (en) 2018-11-23

Similar Documents

Publication Publication Date Title
CN105700812B (en) The control method and device of movable equipment
EP3674899B1 (en) Method and device for sharing multimedia resource, and storage medium
WO2018224933A4 (en) System and method for providing easy-to-use release and auto-positioning for drone applications
KR102092571B1 (en) Apparatus and method for taking a picture of portrait portable terminal having a camera and camera device
WO2018133593A1 (en) Control method and device for intelligent terminal
CN104793884B (en) One kind touches screenshot method and device
US20220182551A1 (en) Display method, imaging method and related devices
JP2016053940A (en) Touch imaging method and touch terminal thereof
WO2018099258A1 (en) Method and device for flight control for unmanned aerial vehicle
CN107589691A (en) The filming control method and device of unmanned plane
CN107807772A (en) Image processing method, device and mobile terminal
CN107040716A (en) Method for controlling movement of equipment and control system thereof
CN109413333B (en) Display control method and terminal
CN107450824B (en) Object deleting method and terminal
WO2020220154A1 (en) Screen display switching method, display device, and movable platform
JP5229928B1 (en) Gaze position specifying device and gaze position specifying program
KR101233793B1 (en) Virtual mouse driving method using hand motion recognition
CN110312988A (en) Screen control method and device
CN106843479A (en) Method and device, the electronic equipment of control targe equipment switching state
CN108737731B (en) Focusing method and terminal equipment
US8866934B2 (en) Image pickup apparatus capable of deleting video effect superimposed on moving image, method of controlling the apparatus, and moving image-recording apparatus, as well as storage medium
CN105763786B (en) A kind of information processing method and electronic equipment
JP5907184B2 (en) Information processing apparatus, information processing method, and program
CN112672051A (en) Shooting method and device and electronic equipment
KR101530517B1 (en) User terminal performable shooting function and method for adjusting location of shooting icon of the user terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20160622

Assignee: SUZHOU ZHENDI INTELLIGENT TECHNOLOGY Co.,Ltd.

Assignor: POWERVISION ROBOT INC.

Contract record no.: 2019990000084

Denomination of invention: Control method and device for mobile equipment

Granted publication date: 20181123

License type: Exclusive License

Record date: 20190319

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20240415

Address after: 120 Robinson Road, Singapore # 13-01

Patentee after: Little Shark Intelligent Technology (Singapore) Ltd.

Country or region after: Singapore

Address before: 102200 no.2549, building 2, No.7, Chuangxin Road, science and Technology Park, Changping District, Beijing

Patentee before: PowerVision Robot Inc.

Country or region before: China

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20181123