WO2019104641A1 - Unmanned aerial vehicle, control method therefor and recording medium - Google Patents
Unmanned aerial vehicle, control method therefor and recording medium Download PDFInfo
- Publication number
- WO2019104641A1 WO2019104641A1 PCT/CN2017/113948 CN2017113948W WO2019104641A1 WO 2019104641 A1 WO2019104641 A1 WO 2019104641A1 CN 2017113948 W CN2017113948 W CN 2017113948W WO 2019104641 A1 WO2019104641 A1 WO 2019104641A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- drone
- adjusting
- target
- information
- photographing device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/12—Target-seeking control
Definitions
- Embodiments of the present invention relate to a drone, a control method thereof, and a recording medium, and more particularly to an industrial application field of a drone.
- the fixed-wing UAV with vertical take-off and landing has advantages over multi-axis UAVs in terms of battery life and flight speed, and is very suitable for application in the inspection industry, such as inspection highways. Inspection pipelines, etc.
- the inspection operation is generally performed by the following steps:
- the drone will fly according to the route, and the camera carried on the drone will collect the video of the lot where the drone passes.
- the vertical take-off and landing fixed-wing UAV when the vertical take-off and landing fixed-wing UAV is performing the waypoint mission, it will deviate from the preset route to a certain extent when the corner and wind speed are large.
- the camera mounted on the drone cannot capture. Go to the desired target (highway, oil pipeline), etc., or the content captured by the camera is not a preset target.
- the embodiment of the invention provides a drone, a control method thereof and a recording medium, which can dynamically control the drone so that the photographing device mounted on the drone can always shoot the target.
- a control method for a drone that is based on a predetermined route planned for a target and that is photographed by a photographing device provided on the drone is provided.
- the method includes the following steps: calculating flight information of the drone plan according to the predetermined route, acquiring current flight information of the drone, according to the current flight information and The planned flight information adjusts the drone such that the photographing device always photographs the target.
- a control method for a drone the drone flying according to a predetermined route planned for a target, and photographing the target by a photographing device provided on the drone,
- the method includes the following steps: recognizing the target in an image captured by the photographing device, and adjusting the drone according to a change in the image in the image, so that the photographing device always performs the target on the target Shooting.
- a third aspect of the present invention provides a drone that, according to a predetermined route planned for a target, includes: a photographing device that photographs the target; and one or more processors for individually or collectively Performing the following process: calculating flight information of the drone plan according to the predetermined route, acquiring current flight information of the drone, and the unmanned according to the current flight information and the planned flight information The machine performs adjustment so that the photographing device always shoots the target.
- a fourth aspect of the present invention relates to a drone that, according to a predetermined route planned for a target, includes: a photographing device that photographs the target; and one or more processors for performing separately or collectively Processing: identifying the target in an image captured by the camera, and adjusting the drone according to a change in the image in the image, so that the camera always shoots the target .
- a recording medium having recorded a program for executing a computer of a drone that photographs a target according to a predetermined route planned for a target and is photographed by a photographing device provided thereon Processing: calculating flight information of the drone plan according to the predetermined route, acquiring current flight information of the drone, and performing the drone on the drone according to the current flight information and the planned flight information.
- the adjustment is such that the photographing device always shoots the target.
- a recording medium having a program for causing a drone that is based on a predetermined route planned for a target and photographed by a photographing device provided thereon to perform the following processing : identifying the target in the image captured by the imaging device, and adjusting the drone according to a change in the image in the image, so that the imaging device always captures the target.
- FIG. 1 is a schematic view showing a drone 100 according to a first embodiment of the present invention and an application scenario thereof.
- FIG. 2 is a flowchart showing a method of controlling the drone 100 according to the first embodiment of the present invention.
- Fig. 3 is a flow chart showing a specific example of step S1003 in Fig. 2 .
- Fig. 4 is a view showing a specific example of Fig. 3 for explanation.
- Fig. 5 is a flow chart showing another specific example of step S1003 in Fig. 2 .
- Fig. 6 is a schematic view for explaining a specific example of Fig. 5.
- Fig. 7 is a schematic diagram showing a drone 200 according to a second embodiment of the present invention and an application scenario thereof.
- FIG. 8 is a flowchart showing a method of controlling the drone 200 according to the second embodiment of the present invention.
- Fig. 9 is a flowchart showing a specific example of step S2002 in Fig. 8.
- FIG. 10 are schematic views for explaining a flowchart of a specific example of FIG. 9.
- Fig. 11 is a flow chart showing another specific example of step S2002 in Fig. 8.
- FIG. 12 are schematic views for explaining a flowchart of a specific example of FIG. 11.
- a component when a component is called “fixed to” another component, it can be directly There may also be a centered component on another component. When a component is considered to "connect” another component, it can be directly connected to another component or possibly a central component.
- FIG. 1 is a schematic view showing a drone 100 according to a first embodiment of the present invention and an application scenario thereof.
- the configuration of the unmanned aerial vehicle 100 that is not closely related to the description of the embodiment is omitted.
- the drone 100 may be, for example, any of a multi-axis drone, a fixed-wing drone, or a vertical take-off drone, including a pan/tilt head 101 and a photographing device 102.
- the drone 100 flies according to a predetermined route planned in advance for the target 110, and the target device 110 is photographed by the imaging device 102 mounted on the drone 100, and the target 110 is photographed while flying, and the target inspection is completed. .
- the pan/tilt 101 is connected to the drone 100 and is used to mount the imaging device 102.
- the pan/tilt has a plurality of rotatable shafts that can be rotated in various directions to adjust the photographing direction of the photographing device 102.
- the imaging device 102 is mounted on the pan/tilt head 101 for imaging a target.
- the photographing device 102 may be various types of photographing devices such as a camera that can take high-definition images, a camera that shoots continuous video, a night vision device that takes infrared images, and the like.
- the imaging device 102 may also include a plurality of cameras that face different directions or have different functions.
- the target facility for target 110 drone inspection preferably a target line extending linearly, such as highways, oil pipelines, coastlines, transmission cables, etc.
- FIG. 2 is a flowchart showing a method of controlling the drone 100 according to the first embodiment of the present invention.
- step S1001 the drone 100 calculates a flight letter of the drone plan according to the predetermined route. interest.
- the predetermined route is a route planned in advance for the target inspection plan, and is composed of the route route and the height of each waypoint, and can be planned by a ground station for controlling the drone 100 not shown. It is also possible to plan by the drone 100 itself by operating the drone 100.
- the drone 100 calculates the flight information of the drone 100 based on the predetermined route described above.
- the flight information herein is information that the drone 100 controls the motion during the flight, including at least one of the position information of the drone, the flight attitude information, and the camera status information.
- the location information of the drone includes at least one of GPS information and altitude information.
- it is not limited to the location information under the GPS system, and may be location information determined by at least one system of GPS, Beidou, Galileo, and GLONASS.
- the flight attitude information includes the flight speed, yaw angle, roll angle, pitch angle, and the like of the current flight of the drone 100.
- the imaging device status information includes imaging parameter information of the imaging device 102 and posture information of the pan-tilt 101.
- the shooting parameter information of the photographing device 102 includes zoom magnification, shooting resolution, shutter speed, aperture, white balance, exposure compensation, and the like.
- the attitude information of the pan/tilt head 101 includes the angles of the respective rotation axes of the pan-tilt head 101 and the like.
- step S1001 the planned flight attitude information of the drone and the planned camera state information are determined, for example, based on the position information of the target 110 and the position information of the predetermined course.
- the planned flight attitude information of the drone and the planned shooting state information are preferably adjusted so that the target 110 can be captured clearly and completely by the camera 102.
- step S1002 the current flight information of the drone 100 is acquired.
- various types of flight information of the drone 100 are acquired by various sensors (not shown) provided in the drone 100.
- step S1003 the drone 100 is adjusted based on the current flight information and the planned flight information, so that the imaging device 102 always captures the target 110.
- Fig. 3 is a flow chart showing a specific example of step S1003 in Fig. 2 .
- the drone 100 is adjusted after confirming that the current flight information of the drone 100 deviates from the planned flight information.
- step S10031 the planned flight information of the current time is acquired.
- the height information Hj in the planned flight information at the current time is acquired.
- step S10032 a first difference between the current flight information and the planned flight information at the current time is calculated.
- Fig. 4 is a view showing a specific example of Fig. 3 for explanation. It is assumed that during the flight of the drone 100, its height becomes Hd due to a sudden change in the airflow so as to deviate from the height Hj in the planned flight information. As shown in the figure, if the drone 100 is not adjusted, the imaging range of the imaging device 102 of the drone 100 will deviate from the original area A (the range indicated by the wide broken line) capable of covering the target 110 to the area B ( The range indicated by the narrow dashed line), so that the target 110 cannot be captured.
- the original area A the range indicated by the wide broken line
- the area B The range indicated by the narrow dashed line
- the drone 100 is adjusted according to the first difference.
- the drone 100 is adjusted based on the difference ⁇ H so that the photographing range of the photographing device 102 of the drone 100 is maintained as the area A, so that the target 110 is always photographed.
- the imaging range of the device 102 is changed from the area B (the range indicated by the narrow broken line) to the area A (the range indicated by the solid line), that is, the imaging range is maintained as the area A.
- Fig. 5 is a flow chart showing another specific example of step S1003 in Fig. 2 .
- the flight information of the next time (a given time) of the unmanned aerial vehicle 100 is expected to change greatly, before the flight information is greatly changed, advance (or at the time when the change occurs) The drone 100 is adjusted.
- the planned flight information of the next time is acquired.
- the height information Hjn in the planned flight information at the next time is acquired.
- step S10032' a second difference between the current flight information and the planned flight information at the next moment is calculated.
- Fig. 6 is a schematic view for explaining a specific example of Fig. 5.
- the current height is Hd, but the height of the planned flight information at the next moment will become Hjn due to obstacles such as buildings and fixed facilities.
- the imaging range of the imaging device 102 of the drone 100 will deviate from the original region A (the range indicated by the wide broken line) capable of covering the target 110 at the next timing. Go to the area B (the range indicated by the narrow dotted line) so that the target 110 cannot be captured.
- step S10033' the drone is adjusted according to the second difference.
- the drone 100 is adjusted based on the difference ⁇ H so that the photographing range of the photographing device 102 of the drone 100 is maintained as the area A, so that the target 110 is always photographed.
- the imaging range of the device 102 is changed from the area B (the range indicated by the narrow broken line) to the area A (the range indicated by the solid line), that is, the imaging range is maintained as the area A.
- the next time in the specific example may be a predetermined time unit, and the time unit is greater than or equal to the time required for the drone to be adjusted, so that the foreseeable flight information will be greatly changed. Or the drone 100 is adjusted at the time when the change occurs.
- the present invention is not limited thereto, and the first difference value and the second difference value are not limited to the height change obtained based on the change in the height information, or may be further changed according to the GPS information, the flight attitude (flight speed, yaw angle, horizontal The amount of change in the overall flight state calculated, such as the change in the roll angle and the pitch angle.
- the adjustment of the drone 100 is not limited to the angle adjustment of the pan/tilt head 101, and includes adjustment of the flight state of the drone 100 and/or the photographing state of the photographing device 102.
- the adjustment of the flight state of the drone 100 includes: adjusting the position of the drone 100 and/or adjusting the flight attitude of the drone 100. Adjusting the position of the drone 100, including adjusting the GPS coordinates of the drone and/or adjusting the height of the drone; The flight attitude is adjusted, including adjusting at least one of a yaw angle, a roll angle, a pitch angle, and a speed of the drone.
- adjusting the photographing state of the photographing device 102 includes adjusting the photographing parameters of the photographing device and/or adjusting the posture of the pan/tilt head 101; wherein the photographing parameters of the photographing device include the zoom magnification.
- the imaging device 102 can always capture the target 110 by adjusting the flight state of the drone 100, and specifically adjusting which aspect or aspects of the flight state, the adjustment needs, the adjustment conditions, Other factors such as the characteristics of the drone and weather conditions are appropriate.
- the drone can be dynamically controlled so that the photographing device mounted on the drone can always photograph the target.
- Fig. 7 is a schematic diagram showing a drone 200 according to a second embodiment of the present invention and an application scenario thereof.
- the same portions as those in the first embodiment are denoted by the same reference numerals, and the detailed description is omitted.
- the drone 200 may be, for example, any of a multi-axis drone, a fixed-wing drone, or a vertical take-off drone, including a pan/tilt head 101 and a photographing device 102.
- the pan/tilt 101 is connected to the drone 100 and is used to mount the imaging device 102.
- the imaging device 102 is mounted on the pan/tilt head 101 for imaging a target.
- the target 110 is a target facility for the drone inspection, and the target 110 in the present embodiment is not limited to the target extending linearly.
- the drone 200 of the second embodiment differs from the drone 100 of the first embodiment in the control method thereof.
- the drone 200 of the second embodiment will be described in detail focusing on the difference.
- the drone 200 of the second embodiment is not limited to flying in accordance with a predetermined planned route, and the drone 200 of the second embodiment can be applied as long as it is a scene in which the target is photographed during the flight.
- FIG. 8 is a flowchart showing a method of controlling the drone 200 according to the second embodiment of the present invention.
- step S2001 the target 110 in the image captured by the imaging device 102 is identified.
- a recognition method based on the target feature point a recognition method based on the target shape, a template-based recognition method, a feature identification-based recognition method, artificial intelligence, machine learning, or a combination thereof may be used.
- step S2002 the drone 200 is adjusted in accordance with the change in the image of the target 110, so that the photographing device 102 always photographs the target 110.
- FIG. 9 is a flowchart showing a specific example of step S2002 in FIG. 8, and FIG. 10 is a schematic diagram for explaining a flowchart of a specific example of FIG. 9.
- FIG. 10(A) is a diagram showing a situation in which the target 110 is within the range of the predetermined position Py in the image.
- step S20021 the position of the target 110 at the current time in the image is acquired.
- the center of gravity, the center, the symmetry line, or the center of the circumscribed circle of the target, or the like can be used as the position of the target in the image.
- the position of the symmetry line of the target 110 is taken as the position of the target 110 in the image.
- Fig. 10(B) is a view showing a state in which the flying posture of the drone 200 is changed due to the airflow or the like, and the current position Pd of the target 110 in the image deviates from the range of the predetermined position Py.
- a third difference between the current position Pd and the preset position Py is calculated.
- the target can be tracked and the current position Pd can be confirmed and calculated by any one of a region-based tracking algorithm, a feature-based tracking algorithm, a contour-based tracking algorithm, a model-based tracking algorithm, and a detection-based tracking algorithm.
- step S20023 the drone 200 is adjusted based on the third difference.
- FIG. 11 is a flowchart showing another specific example of step S2002 in FIG. 8, and FIG. 12 is a schematic diagram for explaining a flowchart of a specific example of FIG. FIG. 12(A) is a diagram showing a situation when the size of the target 110 is a predetermined size Sy in the image.
- step S20021' the size of the target 110 at the current time in the image is acquired.
- the width, length, height, area, volume, etc. of the target can be targeted in the image. size.
- the size of the width of the target 110 is taken as the size of the target 110 in the image.
- Fig. 12(B) is a view showing a case where the flying height of the drone 200 rises due to an air flow or the like, and the current size Sd of the target 110 deviates from the predetermined size Sy (smaller).
- step S20022' the fourth difference between the current size Sd and the preset size Sy is calculated.
- the tracking target and the current size Sd can be tracked and calculated by any one of a region-based tracking algorithm, a feature-based tracking algorithm, a contour-based tracking algorithm, a model-based tracking algorithm, and a detection-based tracking algorithm.
- step S20023' the drone 200 is adjusted based on the fourth difference.
- the predetermined size Sy that is, the target 110 is always photographed.
- the adjustment of the drone 200 is not limited to the above specific examples, and includes adjustment of the flight state of the drone 200 and/or the photographing state of the photographing device 102.
- the adjustment of the flight state of the drone 200 includes: adjusting the position of the drone 200 and/or adjusting the flight attitude of the drone 200. Adjusting the position of the drone 200, including adjusting the GPS coordinates of the drone and/or adjusting the altitude of the drone; adjusting the flight attitude of the drone, including the yaw angle of the drone, At least one of a roll angle, a pitch angle, and a speed is adjusted.
- adjusting the photographing state of the photographing device 102 includes adjusting the photographing parameters of the photographing device and/or adjusting the posture of the pan/tilt head 101; wherein the photographing parameters of the photographing device include an optical zoom magnification and/or a digital zoom Magnification.
- the imaging device 102 can always capture the target 110 by adjusting the flight state of the drone 200, and specifically adjusting which aspect or aspects of the flight state, the adjustment needs, the adjustment conditions, UAV characteristics, weather conditions, etc. Other factors are appropriate to decide.
- the drone can be dynamically controlled so that the imaging device mounted on the drone can always capture the target.
- the disclosed apparatus and method may be implemented in other manners.
- the device embodiments described above are merely illustrative.
- the division of the unit is only a logical function division.
- there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
- the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
- each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
- the above-described integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium.
- the above software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform the methods of the various embodiments of the present invention. Part of the steps.
- the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
Description
本发明实施例涉及无人机、其控制方法以及记录介质,尤其涉及无人机的行业应用领域。Embodiments of the present invention relate to a drone, a control method thereof, and a recording medium, and more particularly to an industrial application field of a drone.
随着无人机应用领域的不断拓展,使用无人机对目标进行巡检的应用场景越来越普及。特别是垂直起降的固定翼无人机,由于其在续航时间、飞行速度方面相对于多轴无人机有优势,非常适合于应用在巡线类的行业应用中,比如巡检高速路,巡检管道等。With the continuous expansion of the application field of drones, application scenarios in which drones are used to patrol targets are becoming more and more popular. In particular, the fixed-wing UAV with vertical take-off and landing has advantages over multi-axis UAVs in terms of battery life and flight speed, and is very suitable for application in the inspection industry, such as inspection highways. Inspection pipelines, etc.
在现有的巡检方案中,一般通过如下步骤进行巡检操作:In the existing inspection plan, the inspection operation is generally performed by the following steps:
1、在地面站上根据目标线路的GPS位置规划好无人机的航线。1. Plan the route of the drone on the ground station according to the GPS position of the target line.
2、无人机根据航线进行飞行,同时无人机上搭载的相机将采集无人机经过的地段的视频。2. The drone will fly according to the route, and the camera carried on the drone will collect the video of the lot where the drone passes.
然而垂直起降固定翼无人机在执行航点任务的时候,在拐弯和风速较大的时候会一定程度上偏离预先设置的航线,在偏离航线的时候,无人机上搭载的相机就无法捕捉到想要的目标(高速路、石油管道)等,或者相机捕获到的内容不是预先设置好的目标。However, when the vertical take-off and landing fixed-wing UAV is performing the waypoint mission, it will deviate from the preset route to a certain extent when the corner and wind speed are large. When the route is deviated, the camera mounted on the drone cannot capture. Go to the desired target (highway, oil pipeline), etc., or the content captured by the camera is not a preset target.
发明内容Summary of the invention
本发明实施例提供一种无人机、其控制方法以及记录介质,能够动态地对无人机进行控制使得无人机上搭载的拍摄装置始终能对目标进行拍摄。The embodiment of the invention provides a drone, a control method thereof and a recording medium, which can dynamically control the drone so that the photographing device mounted on the drone can always shoot the target.
本发明的第一方面,提供一种无人机的控制方法,所述无人机根据针对目标预先规划的预定航线飞行,并由所述无人机上设置的拍摄装置对所述目标进行拍摄,包括如下步骤:根据所述预定航线计算出无人机计划的飞行信息,获取所述无人机当前的飞行信息,根据所述当前的飞行信息与 所述计划的飞行信息对所述无人机进行调整,使得所述拍摄装置始终对所述目标进行拍摄。According to a first aspect of the present invention, a control method for a drone that is based on a predetermined route planned for a target and that is photographed by a photographing device provided on the drone is provided. The method includes the following steps: calculating flight information of the drone plan according to the predetermined route, acquiring current flight information of the drone, according to the current flight information and The planned flight information adjusts the drone such that the photographing device always photographs the target.
本发明的第二方面,提供一种无人机的控制方法,所述无人机根据针对目标预先规划的预定航线飞行,并由所述无人机上设置的拍摄装置对所述目标进行拍摄,包括如下步骤:对所述拍摄装置拍摄到的图像中的所述目标进行识别,根据所述目标在图像中的变化对所述无人机进行调整,使得所述拍摄装置始终对所述目标进行拍摄。According to a second aspect of the present invention, there is provided a control method for a drone, the drone flying according to a predetermined route planned for a target, and photographing the target by a photographing device provided on the drone, The method includes the following steps: recognizing the target in an image captured by the photographing device, and adjusting the drone according to a change in the image in the image, so that the photographing device always performs the target on the target Shooting.
本发明的第三方面,提供一种无人机,根据针对目标预先规划的预定航线飞行,包括:拍摄装置,对所述目标进行拍摄;和一个或多个处理器,用于单独地或者共同地进行如下处理:根据所述预定航线计算出无人机计划的飞行信息,获取所述无人机当前的飞行信息,根据所述当前的飞行信息与所述计划的飞行信息对所述无人机进行调整,使得所述拍摄装置始终对所述目标进行拍摄。A third aspect of the present invention provides a drone that, according to a predetermined route planned for a target, includes: a photographing device that photographs the target; and one or more processors for individually or collectively Performing the following process: calculating flight information of the drone plan according to the predetermined route, acquiring current flight information of the drone, and the unmanned according to the current flight information and the planned flight information The machine performs adjustment so that the photographing device always shoots the target.
本发明的第四方面一种无人机,根据针对目标预先规划的预定航线飞行,包括:拍摄装置,对所述目标进行拍摄;和一个或多个处理器,用于单独地或者共同地进行如下处理:对所述拍摄装置拍摄到的图像中的所述目标进行识别,根据所述目标在图像中的变化对所述无人机进行调整,使得所述拍摄装置始终对所述目标进行拍摄。A fourth aspect of the present invention relates to a drone that, according to a predetermined route planned for a target, includes: a photographing device that photographs the target; and one or more processors for performing separately or collectively Processing: identifying the target in an image captured by the camera, and adjusting the drone according to a change in the image in the image, so that the camera always shoots the target .
本发明的第五方面,提供一种记录介质,记录有程序,该程序使根据针对目标预先规划的预定航线飞行并由其上设置的拍摄装置对所述目标进行拍摄的无人机的计算机执行如下处理:根据所述预定航线计算出无人机计划的飞行信息,获取所述无人机当前的飞行信息,根据所述当前的飞行信息与所述计划的飞行信息对所述无人机进行调整,使得所述拍摄装置始终对所述目标进行拍摄。According to a fifth aspect of the present invention, there is provided a recording medium having recorded a program for executing a computer of a drone that photographs a target according to a predetermined route planned for a target and is photographed by a photographing device provided thereon Processing: calculating flight information of the drone plan according to the predetermined route, acquiring current flight information of the drone, and performing the drone on the drone according to the current flight information and the planned flight information. The adjustment is such that the photographing device always shoots the target.
本发明的第六方面,提供一种记录介质,记录有程序,该程序使根据针对目标预先规划的预定航线飞行并由其上设置的拍摄装置对所述目标进行拍摄的无人机执行如下处理:对所述拍摄装置拍摄到的图像中的所述目标进行识别,根据所述目标在图像中的变化对所述无人机进行调整,使得所述拍摄装置始终对所述目标进行拍摄。 According to a sixth aspect of the invention, there is provided a recording medium having a program for causing a drone that is based on a predetermined route planned for a target and photographed by a photographing device provided thereon to perform the following processing : identifying the target in the image captured by the imaging device, and adjusting the drone according to a change in the image in the image, so that the imaging device always captures the target.
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图进行简单介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are some embodiments of the present invention. One of ordinary skill in the art can also obtain other drawings based on these drawings without paying for inventive labor.
图1是表示本发明的第一实施方式的无人机100及其应用场景的示意图。1 is a schematic view showing a
图2是表示本发明的第一实施方式的无人机100的控制方法的流程图。FIG. 2 is a flowchart showing a method of controlling the
图3是表示图2中的步骤S1003的一个具体例的流程图。Fig. 3 is a flow chart showing a specific example of step S1003 in Fig. 2 .
图4表示为了说明图3的具体例的示意图。Fig. 4 is a view showing a specific example of Fig. 3 for explanation.
图5是表示图2中的步骤S1003的另一个具体例的流程图。Fig. 5 is a flow chart showing another specific example of step S1003 in Fig. 2 .
图6表示为了说明图5的具体例的示意图。Fig. 6 is a schematic view for explaining a specific example of Fig. 5.
图7是表示本发明的第二实施方式的无人机200及其应用场景的示意图。Fig. 7 is a schematic diagram showing a
图8是表示本发明的第二实施方式的无人机200的控制方法的流程图。FIG. 8 is a flowchart showing a method of controlling the
图9是表示图8中的步骤S2002的一个具体例的流程图。Fig. 9 is a flowchart showing a specific example of step S2002 in Fig. 8.
图10的(A)、(B)、(C)是用于说明图9的具体例的流程图的示意图。(A), (B), and (C) of FIG. 10 are schematic views for explaining a flowchart of a specific example of FIG. 9.
图11是表示图8中的步骤S2002的另一个具体例的流程图。Fig. 11 is a flow chart showing another specific example of step S2002 in Fig. 8.
图12的(A)、(B)、(C)是用于说明图11的具体例的流程图的示意图。(A), (B), and (C) of FIG. 12 are schematic views for explaining a flowchart of a specific example of FIG. 11.
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly described with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
需要说明的是,当组件被称为“固定于”另一个组件,它可以直接在 另一个组件上或者也可以存在居中的组件。当一个组件被认为是“连接”另一个组件,它可以是直接连接到另一个组件或者可能同时存在居中组件。It should be noted that when a component is called "fixed to" another component, it can be directly There may also be a centered component on another component. When a component is considered to "connect" another component, it can be directly connected to another component or possibly a central component.
除非另有定义,本文所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。本文中在本发明的说明书中所使用的术语只是为了描述具体的实施例的目的,不是旨在于限制本发明。本文所使用的术语“及/或”包括一个或多个相关的所列项目的任意的和所有的组合。All technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. The terminology used in the description of the present invention is for the purpose of describing particular embodiments and is not intended to limit the invention. The term "and/or" used herein includes any and all combinations of one or more of the associated listed items.
下面结合附图,对本发明的一些实施方式作详细说明。在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。Some embodiments of the present invention are described in detail below with reference to the accompanying drawings. The features of the embodiments and examples described below can be combined with each other without conflict.
第一实施方式First embodiment
图1是表示本发明的第一实施方式的无人机100及其应用场景的示意图。在此,省略无人机100中与对实施方式的说明没有紧密关联的结构。1 is a schematic view showing a
无人机100例如可以是多轴无人机、固定翼无人机或者垂直起降式的无人机的任何一种,包括云台101和拍摄装置102。无人机100根据针对目标110预先规划的预定航线飞行,并由无人机100上搭载的拍摄装置102对目标110进行拍摄,通过一边飞行一边对目,110进行拍摄来完成对目标的巡检。The
云台101与无人机100相连,用于搭载拍摄装置102。云台具有多个能够转动的轴,可以在各个方向上转动,从而调整拍摄装置102的拍摄方向。The pan/
拍摄装置102搭载于云台101,用于对目标进行拍摄。拍摄装置102可以是各种类型的拍摄装置,例如可以拍摄高清图像的相机、拍摄连续视频的摄像机、拍摄红外图像的夜视仪等。拍摄装置102也可以具备多个朝向不同方向或者具备不同功能的摄像头。The
目标110无人机巡检的目标设施,优选是线状延伸的目标线路,例如高速公路、输油管线、海岸线、输电线缆等The target facility for
图2是表示本发明的第一实施方式的无人机100的控制方法的流程图。FIG. 2 is a flowchart showing a method of controlling the
在步骤S1001,无人机100根据预定航线计算出无人机计划的飞行信
息。In step S1001, the
这里,预定航线是针对目标的巡检计划而预先规划好的航线,由航线线路和各个航点的高度组成,可以通过未图示的用于对无人机100进行控制的地面站进行规划,也可以通过操作无人机100由无人机100自身进行规划。Here, the predetermined route is a route planned in advance for the target inspection plan, and is composed of the route route and the height of each waypoint, and can be planned by a ground station for controlling the
无人机100根据上述的预定航线计算出无人机100的飞行信息。这里的飞行信息,是无人机100对自身飞行过程中的动作进行控制的信息,包括无人机的位置信息、飞行姿态信息和拍摄装置状态信息中的至少一个。The
其中,无人机的位置信息,包括GPS信息和高度信息中的至少一种。这里,也并不限定为GPS系统下的位置信息,也可以是GPS、北斗、Galileo、GLONASS的至少一个系统确定的位置信息The location information of the drone includes at least one of GPS information and altitude information. Here, it is not limited to the location information under the GPS system, and may be location information determined by at least one system of GPS, Beidou, Galileo, and GLONASS.
再有,飞行姿态信息包括无人机100当前飞行的飞行速度、偏航角、横滚角、俯仰角等。Further, the flight attitude information includes the flight speed, yaw angle, roll angle, pitch angle, and the like of the current flight of the
另外,拍摄装置状态信息包括拍摄装置102的拍摄参数信息和云台101的姿态信息。In addition, the imaging device status information includes imaging parameter information of the
拍摄装置102的拍摄参数信息,包括变焦倍率、拍摄分辨率、快门速度、光圈、白平衡、曝光补偿等。The shooting parameter information of the photographing
云台101的姿态信息,包括云台101的各个转动轴的角度等。The attitude information of the pan/
在步骤S1001中,例如根据目标110的位置信息和预定航线的位置信息确定无人机的计划的飞行姿态信息和计划的拍摄装置状态信息。优选将无人机的计划飞行姿态信息和计划的拍摄状态信息调整为让目标110能够被拍摄装置102清晰、完整地拍摄到。In step S1001, the planned flight attitude information of the drone and the planned camera state information are determined, for example, based on the position information of the
在步骤S1002,获取无人机100当前的飞行信息。例如,通过无人机100所具备的未图示的各种传感器,来获取无人机100当前的各种飞行信息。In step S1002, the current flight information of the
在步骤S1003,根据当前的飞行信息与计划的飞行信息对无人机100进行调整,使得拍摄装置102始终对目标110进行拍摄。In step S1003, the
图3是表示图2中的步骤S1003的一个具体例的流程图。本具体例的方案中,是在确认到无人机100的当前的飞行信息偏离了计划的飞行信息之后,对无人机100进行调整。
Fig. 3 is a flow chart showing a specific example of step S1003 in Fig. 2 . In the solution of this specific example, the
在步骤S10031,获取当前时刻的计划的飞行信息。作为一例,获取当前时刻的计划的飞行信息中的高度信息Hj。In step S10031, the planned flight information of the current time is acquired. As an example, the height information Hj in the planned flight information at the current time is acquired.
在步骤S10032,计算当前的飞行信息与当前时刻的计划的飞行信息的第一差值。In step S10032, a first difference between the current flight information and the planned flight information at the current time is calculated.
图4表示为了说明图3的具体例的示意图。设无人机100在飞行的过程中,因为气流的突然改变导致其高度变为Hd从而偏离了计划的飞行信息中的高度Hj。如该图示意所示,若不对无人机100进行调整,无人机100的拍摄装置102的拍摄范围将从原来的能够覆盖目标110的区域A(宽虚线所示范围)偏离到区域B(窄虚线所示范围),从而无法拍摄到目标110。Fig. 4 is a view showing a specific example of Fig. 3 for explanation. It is assumed that during the flight of the
本具体例中,利用在步骤S1002中获取的无人机100当前的飞行信息中的高度信息Hd,作为第一差值求出高度信息Hd与Hj的差值ΔH=Hd-Hj。即,作为第一差值的差值ΔH表示无人机100当前时刻的高度信息与原计划的飞行信息中的高度信息的差异。In this specific example, the difference information ΔH=Hd-Hj of the height information Hd and Hj is obtained as the first difference using the height information Hd in the current flight information of the
然后,在步骤S10033,根据第一差值对所述无人机100进行调整。这里,例如根据差值ΔH对无人机100进行调整,使得无人机100的拍摄装置102的拍摄范围保持为区域A,从而始终对目标110进行拍摄。作为对无人机100调整的方式,例如可以通过使用预先计算的与高度变化ΔH对应的调整常数K计算出云台101的调整角度α=K*ΔH,通过调整云台101的角度来使得拍摄装置102的拍摄范围从区域B(窄虚线所示范围)变为区域A(实线所示范围),即将拍摄范围保持为区域A。Then, in step S10033, the
图5是表示图2中的步骤S1003的另一个具体例的流程图。本具体例的方案中,是在预见到无人机100的下一时刻(给定的时刻)的飞行信息将发生大幅变化时,在飞行信息大幅变化之前,提前(或者在变化发生的时刻)对无人机100进行调整。Fig. 5 is a flow chart showing another specific example of step S1003 in Fig. 2 . In the solution of this specific example, when the flight information of the next time (a given time) of the unmanned
在步骤S10031’,获取下一时刻的计划的飞行信息。作为一例,获取下一时刻的计划的飞行信息中的高度信息Hjn。At step S10031', the planned flight information of the next time is acquired. As an example, the height information Hjn in the planned flight information at the next time is acquired.
在步骤S10032’,计算当前的飞行信息与下一时刻的计划的飞行信息的第二差值。In step S10032', a second difference between the current flight information and the planned flight information at the next moment is calculated.
图6表示为了说明图5的具体例的示意图。设无人机100在飞行的过
程中,当前的高度为Hd,但因为存在建筑物、固定设施等障碍物等的原因,下一时刻的计划的飞行信息中的高度将变为Hjn。如该图示意所示,若不对无人机100进行调整,在下一个时刻,无人机100的拍摄装置102的拍摄范围将从原来的能够覆盖目标110的区域A(宽虚线所示范围)偏离到区域B(窄虚线所示范围),从而无法拍摄到目标110。Fig. 6 is a schematic view for explaining a specific example of Fig. 5. Set
本具体例中,利用在步骤S1002中获取的无人机100当前的飞行信息中的高度信息Hd,作为第二差值求出下一时刻的计划的高度Hjn与当前高度Hd的差值ΔH=Hjn-Hd。即,作为第二差值的差值ΔH表示无人机100在下一时刻的计划的飞行信息中的高度信息与当前的高度信息的差异。In this specific example, the height information Hd in the current flight information of the
然后,在步骤S10033’,根据第二差值对所述无人机进行调整。这里,例如根据差值ΔH对无人机100进行调整,使得无人机100的拍摄装置102的拍摄范围保持为区域A,从而始终对目标110进行拍摄。作为对无人机100调整的方式,例如可以通过使用预先计算的与高度变化ΔH对应的调整常数K计算出云台101的调整角度α=K*ΔH,通过调整云台101的角度来使得拍摄装置102的拍摄范围从区域B(窄虚线所示范围)变为区域A(实线所示范围),即将拍摄范围保持为区域A。Then, in step S10033', the drone is adjusted according to the second difference. Here, for example, the
该具体例中的下一时刻,可以是预先规定的下一个时间单位,通过让该时间单位大于或者等于对无人机进行调整所需的时间,从而能在预见飞行信息将大幅变化时,提前或者在变化发生的时刻对无人机100进行调整。The next time in the specific example may be a predetermined time unit, and the time unit is greater than or equal to the time required for the drone to be adjusted, so that the foreseeable flight information will be greatly changed. Or the
但是,本发明并非限定于此,第一差值和第二差值并非仅限于基于高度信息变化得到的高度变化,也可以是进一步根据GPS信息变化、飞行姿态(飞行速度、偏航角、横滚角、俯仰角)变化等计算出的飞行状态整体的变化量。However, the present invention is not limited thereto, and the first difference value and the second difference value are not limited to the height change obtained based on the change in the height information, or may be further changed according to the GPS information, the flight attitude (flight speed, yaw angle, horizontal The amount of change in the overall flight state calculated, such as the change in the roll angle and the pitch angle.
另外,对无人机100的调整也并非仅限于对云台101的角度调整,包括对无人机100的飞行状态和/或拍摄装置102的拍摄状态进行调整。In addition, the adjustment of the
其中,对无人机100的飞行状态进行调整,包括:对无人机100的位置和/或对无人机100的飞行姿态进行调整。对无人机100的位置进行调整,包括对无人机的GPS坐标和/或对无人机的高度进行调整;对无人机
的飞行姿态进行调整,包括对无人机的偏航角、横滚角、俯仰角以及速度中的至少一个进行调整。The adjustment of the flight state of the
再有,对拍摄装置102的拍摄状态进行调整,包括对拍摄装置的拍摄参数进行调整和/或对云台101的姿态进行调整;其中,拍摄装置的拍摄参数包括变焦倍率。Further, adjusting the photographing state of the photographing
即,只要通过对无人机100的飞行状态进行调整使得拍摄装置102能始终对目标110进行拍摄即可,具体调整飞行状态中的具体哪个或者哪些方面,可以根据调整的需要、调整的条件、无人机的特性、天气条件等其他因素适宜决定。That is, as long as the
根据本发明第一实施方式的无人机100及其控制方法,能够动态地对无人机进行控制使得无人机上搭载的拍摄装置始终能对目标进行拍摄。According to the
第二实施方式Second embodiment
图7是表示本发明的第二实施方式的无人机200及其应用场景的示意图。在此,对与第一实施方式相同的部分标注同样的标号,并省略详细的说明。Fig. 7 is a schematic diagram showing a
无人机200例如可以是多轴无人机、固定翼无人机或者垂直起降式的无人机的任何一种,包括云台101和拍摄装置102。The
云台101与无人机100相连,用于搭载拍摄装置102。The pan/
拍摄装置102搭载于云台101,用于对目标进行拍摄。The
目标110是无人机巡检的目标设施,本实施方式中的目标110不限定于线状延伸的目标。The
第二实施方式的无人机200与第一实施方式的无人机100的区别在于其控制方法,以下以该区别为重点对第二实施方式的无人机200进行详细说明。另外,第二实施方式的无人机200并不限定于按照预先规划的预定航线飞行,只要是在飞行过程中追踪目标进行拍摄的场景,即可应用第二实施方式的无人机200。The
图8是表示本发明的第二实施方式的无人机200的控制方法的流程图。FIG. 8 is a flowchart showing a method of controlling the
在步骤S2001,对拍摄装置102拍摄到的图像中的目标110进行识别。
这里,可以使用基于目标的特征点的识别方式、基于目标形状的识别方式、基于模板的识别方式、基于特征标识的识别方式、人工智能、机器学习的任意一种或者它们的组合的识别方式。In step S2001, the
在步骤S2002,根据目标110在图像中的变化对无人机200进行调整,使得拍摄装置102始终对目标110进行拍摄。In step S2002, the
图9是表示图8中的步骤S2002的一个具体例的流程图,图10是用于说明图9的具体例的流程图的示意图。图10(A)表示目标110处于图像中的预定位置Py的范围内的情形的图。FIG. 9 is a flowchart showing a specific example of step S2002 in FIG. 8, and FIG. 10 is a schematic diagram for explaining a flowchart of a specific example of FIG. 9. FIG. 10(A) is a diagram showing a situation in which the
在步骤S20021中,获取当前时刻的目标110在图像中的位置。这里,可以将目标的重心、中心、对称线、或者外接圆的中心等作为目标在图像中的位置。图10的示意图中,以目标110的对称线的位置作为目标110在图像中的位置。In step S20021, the position of the
图10(B)表示因为气流等的原因,无人机200的飞行姿态发生改变,目标110在图像中的当前位置Pd偏离了预定位置Py的范围的情形的图。Fig. 10(B) is a view showing a state in which the flying posture of the
在步骤S20022中,计算当前的位置Pd与预先设定的位置Py的第三差值。这里,可以通过基于区域的跟踪算法、基于特征的跟踪算法、基于轮廓的跟踪算法、基于模型的跟踪算法、基于检测的跟踪算法的任意一种,跟踪目标并确认其当前的位置Pd,并计算出变化后的目标110的当前位置Pd与预先设定的预定位置Py之间的差值ΔP=Pd-Py作为第三差值。In step S20022, a third difference between the current position Pd and the preset position Py is calculated. Here, the target can be tracked and the current position Pd can be confirmed and calculated by any one of a region-based tracking algorithm, a feature-based tracking algorithm, a contour-based tracking algorithm, a model-based tracking algorithm, and a detection-based tracking algorithm. The difference ΔP=Pd-Py between the current position Pd of the changed
在步骤S20023中,根据第三差值对无人机200进行调整。In step S20023, the
这里,例如根据差值ΔP对无人机200进行调整,使得ΔP=0或者小于规定的阈值,从而如图10(C)所示那样,让目标110在图像中位于或基本位于预定位置Py,即始终对目标110进行拍摄。作为对无人机200调整的方式,例如可以通过使用预先确定的调整步幅来调整云台101的角度,来使得ΔP=0或者小于规定的阈值。Here, for example, the
图11是表示图8中的步骤S2002的另一个具体例的流程图,图12是用于说明图11的具体例的流程图的示意图。图12(A)表示目标110的大小为图像中的预定大小Sy时的情形的图。FIG. 11 is a flowchart showing another specific example of step S2002 in FIG. 8, and FIG. 12 is a schematic diagram for explaining a flowchart of a specific example of FIG. FIG. 12(A) is a diagram showing a situation when the size of the
在步骤S20021’中,获取当前时刻的目标110在图像中的大小。这里,可以将目标的宽度、长度、高度、面积、体积等作为目标在图像中的
大小。图12的示意图中,以目标110的宽度的大小作为目标110在图像中的大小。In step S20021', the size of the
图12(B)表示因为气流等的原因,无人机200的飞行高度上升,目标110在图像中的当前大小Sd偏离了预定大小Sy的情形(变小)的图。Fig. 12(B) is a view showing a case where the flying height of the
在步骤S20022’中,计算当前的大小Sd与预先设定的大小Sy的第四差值。这里,可以通过基于区域的跟踪算法、基于特征的跟踪算法、基于轮廓的跟踪算法、基于模型的跟踪算法、基于检测的跟踪算法的任意一种,跟踪目标并确认其当前的大小Sd,并计算出变化后的目标110的当前大小Sd与预先设定的预定大小Sy之间的差值ΔS=Sd-Sy作为第四差值。In step S20022', the fourth difference between the current size Sd and the preset size Sy is calculated. Here, the tracking target and the current size Sd can be tracked and calculated by any one of a region-based tracking algorithm, a feature-based tracking algorithm, a contour-based tracking algorithm, a model-based tracking algorithm, and a detection-based tracking algorithm. The difference ΔS=Sd-Sy between the current size Sd of the changed
在步骤S20023’中,根据第四差值对无人机200进行调整。In step S20023', the
这里,例如根据差值ΔS对无人机200进行调整,使得ΔS=0或者小、于规定的阈值,从而如图12(C)所示那样,让目标110在图像中的大小等于或基本等于预定大小Sy,即始终对目标110进行拍摄。作为对无人机200调整的方式,例如可以通过使用预先确定的调整步幅来调整拍摄装置102的变焦倍率,来使得ΔS=0或者小于规定的阈值。Here, for example, the
但是,本发明并非限定于此,对无人机200的调整也并非仅限于上述的各个具体例,包括对无人机200的飞行状态和/或拍摄装置102的拍摄状态进行调整。However, the present invention is not limited thereto, and the adjustment of the
其中,对无人机200的飞行状态进行调整,包括:对无人机200的位置和/或对无人机200的飞行姿态进行调整。对无人机200的位置进行调整,包括对无人机的GPS坐标和/或对无人机的高度进行调整;对无人机的飞行姿态进行调整,包括对无人机的偏航角、横滚角、俯仰角以及速度中的至少一个进行调整。The adjustment of the flight state of the
再有,对拍摄装置102的拍摄状态进行调整,包括对拍摄装置的拍摄参数进行调整和/或对云台101的姿态进行调整;其中,拍摄装置的拍摄参数包括光学变焦倍率和/或数码变焦倍率。Further, adjusting the photographing state of the photographing
即,只要通过对无人机200的飞行状态进行调整使得拍摄装置102能始终对目标110进行拍摄即可,具体调整飞行状态中的具体哪个或者哪些方面,可以根据调整的需要、调整的条件、无人机的特性、天气条件等
其他因素适宜决定。That is, as long as the
根据本发明第二实施方式的无人机200及其控制方法,能够动态地对无人机进行控制使得无人机上搭载的拍摄装置始终能对目标进行拍摄。According to the unmanned
在本发明所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
上述以软件功能单元的形式实现的集成的单元,可以存储在一个计算机可读取存储介质中。上述软件功能单元存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器(processor)执行本发明各个实施例所述方法的部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The above-described integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium. The above software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform the methods of the various embodiments of the present invention. Part of the steps. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .
本领域技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的装置的具体工作过 程,可以参考前述方法实施例中的对应过程,在此不再赘述。A person skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of each functional module described above is exemplified. In practical applications, the above function assignment can be completed by different functional modules as needed, that is, the device is installed. The internal structure is divided into different functional modules to perform all or part of the functions described above. The specific work of the device described above For the process, reference may be made to the corresponding process in the foregoing method embodiments, and details are not described herein again.
最后应说明的是:以上各实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。 Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present invention. range.
Claims (42)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201780036299.8A CN109643131A (en) | 2017-11-30 | 2017-11-30 | Unmanned plane, its control method and recording medium |
| PCT/CN2017/113948 WO2019104641A1 (en) | 2017-11-30 | 2017-11-30 | Unmanned aerial vehicle, control method therefor and recording medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/113948 WO2019104641A1 (en) | 2017-11-30 | 2017-11-30 | Unmanned aerial vehicle, control method therefor and recording medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019104641A1 true WO2019104641A1 (en) | 2019-06-06 |
Family
ID=66053531
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/113948 Ceased WO2019104641A1 (en) | 2017-11-30 | 2017-11-30 | Unmanned aerial vehicle, control method therefor and recording medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109643131A (en) |
| WO (1) | WO2019104641A1 (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110347171B (en) * | 2019-07-12 | 2022-06-03 | 深圳市道通智能航空技术股份有限公司 | Aircraft control method and aircraft |
| CN111176307B (en) * | 2019-12-24 | 2023-09-01 | 广州极飞科技股份有限公司 | Method and device for controlling unmanned aerial vehicle, unmanned aerial vehicle and computer storage medium |
| CN111462229B (en) * | 2020-03-31 | 2023-06-30 | 普宙科技有限公司 | Unmanned aerial vehicle-based target shooting method, shooting device and unmanned aerial vehicle |
| CN113741413B (en) * | 2020-05-29 | 2022-11-08 | 广州极飞科技股份有限公司 | Operation method for unmanned equipment, unmanned equipment and storage medium |
| CN111785036B (en) * | 2020-06-23 | 2022-03-25 | 吉林大学 | Emergency traffic dispersion method for accident road section based on unmanned aerial vehicle projection |
| CN112362068B (en) * | 2020-12-04 | 2022-09-23 | 浙江煤炭测绘院有限公司 | Unmanned aerial vehicle surveying and mapping method, device and system |
| CN116745722A (en) * | 2021-04-01 | 2023-09-12 | 深圳市大疆创新科技有限公司 | Unmanned aerial vehicle control method and device, unmanned aerial vehicle and storage medium |
| CN114326771A (en) * | 2021-12-31 | 2022-04-12 | 国网湖北省电力有限公司超高压公司 | Unmanned aerial vehicle shooting route generation method and system based on image recognition |
| CN115755976A (en) * | 2022-12-02 | 2023-03-07 | 安徽送变电工程有限公司 | Patrol unmanned aerial vehicle route planning method and system, unmanned aerial vehicle and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102955478A (en) * | 2012-10-24 | 2013-03-06 | 深圳一电科技有限公司 | Unmanned aerial vehicle flying control method and unmanned aerial vehicle flying control system |
| US8718838B2 (en) * | 2007-12-14 | 2014-05-06 | The Boeing Company | System and methods for autonomous tracking and surveillance |
| CN104853104A (en) * | 2015-06-01 | 2015-08-19 | 深圳市微队信息技术有限公司 | Method and system for automatically tracking and shooting moving object |
| CN205910590U (en) * | 2016-07-27 | 2017-01-25 | 广州格赛智能电子科技有限公司 | Automatic unmanned aerial vehicle control terminal navigates back |
| CN106657781A (en) * | 2016-12-19 | 2017-05-10 | 北京小米移动软件有限公司 | Target object photographing method and target object photographing device |
| CN107087427A (en) * | 2016-11-30 | 2017-08-22 | 深圳市大疆创新科技有限公司 | Aircraft control method, device and equipment, and aircraft |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102032426B (en) * | 2010-12-24 | 2013-11-06 | 沈阳航天新光集团有限公司 | Single-spindle cradle head device for aerial photography unmanned plane |
| CN102589527A (en) * | 2012-01-17 | 2012-07-18 | 中测新图(北京)遥感技术有限责任公司 | Unmanned aerial vehicle aerial photographing system with rotary deviation correction, unmanned aerial vehicle and aerial photographing method |
| CN104360688A (en) * | 2014-11-19 | 2015-02-18 | 云南电网公司电力科学研究院 | Guide device of line-cruising unmanned aerial vehicle and control method of guide device |
| JP6412268B2 (en) * | 2015-03-31 | 2018-10-24 | エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd | Device for recording user operation data in remote controller, remote controller, vehicle operation data recorder, and system |
| CN105100728A (en) * | 2015-08-18 | 2015-11-25 | 零度智控(北京)智能科技有限公司 | Unmanned aerial vehicle video tracking shooting system and method |
| CN106094876A (en) * | 2016-07-04 | 2016-11-09 | 苏州光之翼智能科技有限公司 | A kind of unmanned plane target locking system and method thereof |
-
2017
- 2017-11-30 CN CN201780036299.8A patent/CN109643131A/en active Pending
- 2017-11-30 WO PCT/CN2017/113948 patent/WO2019104641A1/en not_active Ceased
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8718838B2 (en) * | 2007-12-14 | 2014-05-06 | The Boeing Company | System and methods for autonomous tracking and surveillance |
| CN102955478A (en) * | 2012-10-24 | 2013-03-06 | 深圳一电科技有限公司 | Unmanned aerial vehicle flying control method and unmanned aerial vehicle flying control system |
| CN104853104A (en) * | 2015-06-01 | 2015-08-19 | 深圳市微队信息技术有限公司 | Method and system for automatically tracking and shooting moving object |
| CN205910590U (en) * | 2016-07-27 | 2017-01-25 | 广州格赛智能电子科技有限公司 | Automatic unmanned aerial vehicle control terminal navigates back |
| CN107087427A (en) * | 2016-11-30 | 2017-08-22 | 深圳市大疆创新科技有限公司 | Aircraft control method, device and equipment, and aircraft |
| CN106657781A (en) * | 2016-12-19 | 2017-05-10 | 北京小米移动软件有限公司 | Target object photographing method and target object photographing device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109643131A (en) | 2019-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019104641A1 (en) | Unmanned aerial vehicle, control method therefor and recording medium | |
| CN112585554B (en) | UAV inspection method, device and UAV | |
| WO2018072657A1 (en) | Image processing method, image processing device, multi-camera photographing device, and aerial vehicle | |
| WO2020014909A1 (en) | Photographing method and device and unmanned aerial vehicle | |
| JP7136079B2 (en) | Information processing device, information processing method and information processing program | |
| CN205353774U (en) | Accompany unmanned aerial vehicle system of taking photo by plane of shooing aircraft | |
| CN106973221B (en) | Unmanned aerial vehicle camera shooting method and system based on aesthetic evaluation | |
| WO2021031159A1 (en) | Match photographing method, electronic device, unmanned aerial vehicle and storage medium | |
| US20230359204A1 (en) | Flight control method, video editing method, device, uav and storage medium | |
| WO2019041276A1 (en) | Image processing method, and unmanned aerial vehicle and system | |
| CN205015741U (en) | Companion flies unmanned aerial vehicle system of taking photo by plane and control cabinet and unmanned aerial vehicle thereof | |
| WO2021212445A1 (en) | Photographic method, movable platform, control device and storage medium | |
| CN103149788A (en) | Air 360-degree distant view photograph shooting device and method | |
| WO2019061295A1 (en) | Video processing method and device, unmanned aerial vehicle and system | |
| WO2020172800A1 (en) | Patrol control method for movable platform, and movable platform | |
| WO2019227441A1 (en) | Video control method and device of movable platform | |
| CN106094876A (en) | A kind of unmanned plane target locking system and method thereof | |
| CN110337806A (en) | Group picture image pickup method and device | |
| WO2021098453A1 (en) | Target tracking method and unmanned aerial vehicle | |
| CN112334853A (en) | Route adjustment method, ground terminal equipment, unmanned aerial vehicle, system and storage medium | |
| WO2019023914A1 (en) | Image processing method, unmanned aerial vehicle, ground console, and image processing system thereof | |
| CN110139038A (en) | It is a kind of independently to surround image pickup method, device and unmanned plane | |
| WO2020014953A1 (en) | Image processing method and device | |
| CN113391644A (en) | Unmanned aerial vehicle shooting distance semi-automatic optimization method based on image information entropy | |
| CN108419052B (en) | Panoramic imaging method for multiple unmanned aerial vehicles |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17933299 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17933299 Country of ref document: EP Kind code of ref document: A1 |