WO2018152783A1 - Image processing method and device, and aircraft - Google Patents

Abstract

Disclosed is an image processing method, applied in an aircraft (100). The aircraft (100) is provided with an imaging device (10). The processing method comprises the steps of: (S22) controlling the imaging device (10) to perform imaging to obtain an image; and (S24) synthesizing the system time of the aircraft (100) into the image when the imaging device (10) performs imaging. Also disclosed are an image processing device (20) and the aircraft (100).

Description

Image processing method, processing device and aircraft Technical field

The present invention relates to consumer electronics technology, and more particularly to an image processing method, a processing device, and an aircraft.

Background technique

In the related art, the video formed by the aircraft is generally post-processed plus a time stamp. However, such an operation mode may easily cause the time corresponding to the video to be inaccurate, and the reliability of the time display in the video is reduced.

Summary of the invention

Embodiments of the present invention provide an image processing method, a processing device, and an aircraft.

The invention provides an image processing method for an aircraft, wherein the aircraft is provided with an imaging device, and the processing method comprises the following steps:

Controlling the imaging device to image to obtain an image; and

The system time of the aircraft when imaging the imaging device is synthesized into the image.

The present invention provides an image processing apparatus for an aircraft, the aircraft being provided with an imaging device, the processing device comprising:

a control module for controlling imaging of the imaging device to obtain an image; and

a first processing module for synthesizing a system time of the aircraft when imaging the imaging device into the image.

An aircraft of an embodiment of the present invention includes an imaging device and the processing device.

The image processing method, the processing device, and the aircraft of the embodiment of the present invention synthesize the system time of the aircraft when the imaging device is imaged into the image in real time to ensure the accuracy and credibility of the time display in the image.

The additional aspects and advantages of the embodiments of the present invention will be set forth in part in the description which follows.

DRAWINGS

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from

1 is a schematic flow chart of a method for processing an image according to an embodiment of the present invention;

2 is a schematic diagram of functional modules of an aircraft according to an embodiment of the present invention;

3 is another schematic flowchart of a method for processing an image according to an embodiment of the present invention;

4 is a schematic diagram of functional modules of a first processing module according to an embodiment of the present invention;

FIG. 5 is still another schematic flowchart of a method for processing an image according to an embodiment of the present invention; FIG.

6 is a schematic diagram of another functional module of a first processing module according to an embodiment of the present invention;

FIG. 7 is still another schematic flowchart of a method for processing an image according to an embodiment of the present invention; FIG.

8 is a schematic diagram of another functional module of an aircraft according to an embodiment of the present invention;

9 is a schematic diagram of still another functional module of the first processing module according to the embodiment of the present invention;

FIG. 10 is still another schematic flowchart of a method for processing an image according to an embodiment of the present invention; FIG.

11 is a schematic diagram of functional blocks of a processing device according to an embodiment of the present invention;

FIG. 12 is still another schematic flowchart of a method for processing an image according to an embodiment of the present invention; FIG.

13 is a schematic diagram of communication between an aircraft and a terminal according to an embodiment of the present invention;

14 is a schematic diagram of another functional module of a processing device according to an embodiment of the present invention;

FIG. 15 is still another schematic flowchart of a method for processing an image according to an embodiment of the present invention; FIG.

16 is a schematic diagram of image transmission according to an embodiment of the present invention;

17 is a schematic diagram of still another functional module of the processing device according to an embodiment of the present invention;

FIG. 18 is still another schematic flowchart of a method for processing an image according to an embodiment of the present invention; FIG.

19 is another schematic diagram of image transmission in accordance with an embodiment of the present invention.

The main component symbol drawing description:

Aircraft 100, imaging device 10, processing device 20, control module 22, first processing module 24, first processing unit 242, second processing unit 244, third processing unit 246, processing subunit 2462, fourth processing unit 248, The second processing module 26, the third processing module 28, the fourth processing module 29, the positioning device 30, the remote controller 500, the relay terminal 600, the cloud server 700, the terminal 800, the display 80, and the monitoring terminal 900.

detailed description

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals indicate the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

In the description of the present invention, it is to be understood that the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" or "second" may include one or more of the described features either explicitly or implicitly. In the description of the present invention, the meaning of "a plurality" is two or more unless specifically and specifically defined otherwise.

In the description of the present invention, it should be noted that the terms "installation", "connected", and "connected" are to be understood broadly, and may be fixed or detachable, for example, unless otherwise explicitly defined and defined. Connected, or connected in one piece; Therefore, they may be mechanically connected, or may be electrically connected or may communicate with each other; they may be directly connected or indirectly connected through an intermediate medium, and may be internal communication of two elements or an interaction relationship of two elements. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood on a case-by-case basis.

The following disclosure provides many different embodiments or examples for implementing different structures of the present invention. In order to simplify the disclosure of the present invention, the components and arrangements of the specific examples are described below. Of course, they are merely examples and are not intended to limit the invention. In addition, the present invention may be repeated with reference to the numerals and/or reference numerals in the various examples, which are for the purpose of simplicity and clarity, and do not indicate the relationship between the various embodiments and/or arrangements discussed. Moreover, the present invention provides examples of various specific processes and materials, but one of ordinary skill in the art will recognize the use of other processes and/or the use of other materials.

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals indicate the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

Referring to FIG. 1 and FIG. 2 together, the image processing method of the embodiment of the present invention can be applied to the aircraft 100. The imaging device 10 is disposed on the aircraft 100. The image processing method includes the following steps:

S22: controlling the imaging device 10 to image to obtain an image; and

S24: The system time of the aircraft 100 when the imaging device 10 is imaged is synthesized into an image.

Referring again to FIG. 2, the image processing device 20 can be used with the aircraft 100. The imaging device 10 is disposed on the aircraft 100. Processing device 20 includes a control module 22 and a first processing module 24. The control module 22 is for controlling the imaging device 10 to image to obtain an image. The first processing module 24 is configured to synthesize the system time of the aircraft 100 when imaging the imaging device 10 into an image.

That is, the processing method of the embodiment of the present invention may be implemented by the processing device 20 of the embodiment of the present invention, wherein the step S22 may be implemented by the control module 22, and the step S24 may be implemented by the first processing module 24.

In some embodiments, the processing device 20 of the embodiments of the present invention may be applied to the aircraft 100 of the embodiment of the present invention, or the aircraft 100 of the embodiment of the present invention includes the processing device 20 of the embodiment of the present invention. Further, the aircraft 100 of the embodiment of the present invention further includes an imaging device 10 in which the imaging device 10 and the processing device 20 are electrically connected.

The image processing method, the processing device 20, and the aircraft 100 of the embodiment of the present invention synthesize the system time of the aircraft 100 when the imaging device 10 is imaged into the image in real time to ensure the accuracy and credibility of the time display in the image.

It can be understood that when the imaging device 10 is imaged, each frame of image has a corresponding imaging time, that is, the system time of the corresponding aircraft 100, and the imaging time corresponding to each frame of image is synthesized into the image, which can ensure that each frame can be accurately and quickly obtained. Imaging time of the frame image, in some cases where accurate image imaging time is required, such as live broadcast, real-time monitoring or exploration, etc., the processing method of the embodiment of the present invention, the processing device 20, and the image obtained by the aircraft 100 Time has greater accuracy and credibility.

In certain embodiments, aircraft 100 includes an unmanned aerial vehicle.

Referring to FIG. 3, in some embodiments, step S24 includes the following steps:

S242: Convert system time into a string; and

S244: Process the image to write a character string into the image.

Referring to FIG. 4, in some embodiments, the first processing module 24 includes a first processing unit 242 and a second processing unit 244. The first processing unit 242 is configured to convert the system time into a string. The second processing unit 244 is for processing the image to write a string into the image.

That is to say, step S242 can be implemented by the first processing unit 242, and step S244 can be implemented by the second processing unit 244.

In this way, the image and the corresponding system time can be more closely combined to avoid errors in the post-synthesis and prevent data from being tampered with.

Specifically, the processing device 20 converts the system time of each frame of image into a character string, and then directly writes the character string into the image data corresponding to the image, such as an image pixel, thereby synthesizing the corresponding system time when the image is imaged into the image.

Referring to FIG. 5, in some embodiments, step S24 includes the following steps:

S246: update system time to obtain updated system time; and

S248: Synthesize the updated system time into the image.

Referring to FIG. 6, in some embodiments, the first processing module 24 includes a third processing unit 246 and a fourth processing unit 248. The third processing unit 246 is configured to update the system time to obtain the updated system time. The fourth processing unit 248 is configured to synthesize the updated system time into the image.

That is to say, step S246 can be implemented by the third processing unit 246, and step S248 can be implemented by the fourth processing unit 248.

In this way, more accurate and authoritative time can be obtained as system time, thus ensuring the accuracy and credibility of the system time.

It can be understood that the system time of the aircraft 100 may have a large error with the passage of time. In order to ensure the accuracy of the system time, the system time needs to be updated, thereby reducing the error and improving the credibility of the system time.

Referring to Figures 7 and 8, together, in certain embodiments, aircraft 100 includes positioning device 30. Step S246 includes the following steps:

S2462: Processing the time acquired by the positioning device 30 as the updated system time.

Referring to Figures 8 and 9, together, in certain embodiments, the aircraft 100 includes a positioning device 30. The third processing unit 246 includes a processing sub-unit 2462. The processing sub-unit 2462 is configured to process the time acquired by the positioning device 30 as the updated system time.

That is to say, step S2462 can be implemented by the processing sub-unit 2462.

In this way, the system time can be updated by the time acquired by the positioning device 30, thereby improving the accuracy and credibility of the system time.

It can be understood that the timer inside the aircraft 100 has a certain error, the error is small in a short time, the system time is relatively accurate, and can be used normally, but the accumulation of time, the error variation causes the time to be inaccurate, so it needs to be positioned. A device 30, such as a GPS positioning device, obtains a more accurate time as system time. The GPS positioning device can transmit a request for acquisition time to the satellite communicating with the GPS positioning device, and receive the time transmitted by the satellite as the updated system time.

Referring to FIG. 10, in some embodiments, the processing method includes the following steps:

S26: Encoding an image with a system time is synthesized.

Referring to FIG. 11 , in some embodiments, processing device 20 includes a second processing module 26 . The second processing module 26 is for encoding the image synthesized with the system time.

That is to say, step S26 can be implemented by the second processing module 26.

In this way, the transmission efficiency of the image can be improved.

It can be understood that in the image transmission process, the image is generally not directly transmitted, but the image is first encoded to generate a smaller image file, thereby improving the image transmission efficiency. It is also possible to encrypt the image during the encoding process to ensure the security of the image data transmission.

Referring to Figures 12 and 13, together, in some embodiments, aircraft 100 is in communication with terminal 800. Terminal 800 includes display 80 and terminal time, and display 80 is used to display images that are synthesized with system time. The processing method includes the following steps:

S28: Compare terminal time and system time to obtain delay time.

Referring to Figures 13 and 14, together, in some embodiments, aircraft 100 is in communication with terminal 800, terminal 800 includes display 80 and terminal time, display 80 is used to display images synthesized with system time, and processing device 20 includes Three processing modules 28. The third processing module 28 is for comparing the terminal time and the system time to obtain a delay time.

That is to say, step S28 can be implemented by the third processing module 28.

In this way, the time difference between the system time and the terminal time can be obtained.

Specifically, by comparing the time difference between the system time and the terminal time, the delay time can be obtained as the video delay of the remote monitoring, thereby accurately grasping the monitoring time.

In some embodiments, the terminal 800 includes a terminal processor for comparing terminal time and system time to obtain a delay time, that is, step S28 can be implemented by the terminal processor without any limitation.

Further, the delay time can be displayed on the display 80.

In some embodiments, when an image is displayed, the system time is also displayed in the image. In one example, the format of the displayed system time is: year-month-day hour: minute: second.

Referring to Figures 15 and 16, together, in some embodiments, aircraft 100 is in communication with remote control 500, and remote control 500 is in communication with monitoring terminal 900. The processing method includes the following steps:

S29: The image is sequentially transmitted to the monitoring terminal 900 through the aircraft 100 and the remote controller 500.

Referring to Figures 16 and 17, together, in some embodiments, aircraft 100 is in communication with remote control 500, which is in communication with monitoring terminal 900. Processing device 20 includes a fourth processing processing module 29. The fourth processing module 29 is configured to send the image to the monitoring terminal 900 through the aircraft 100 and the remote controller 500 in sequence.

That is to say, step S29 can be implemented by the fourth processing module 29.

As such, the aircraft 100 can directly transmit images to the monitoring terminal 900 through the remote controller 500.

In some embodiments, the monitoring terminal 900 is in direct communication with the remote controller 500, and the aircraft 100 (such as an unmanned aerial vehicle) is generally in direct communication with the remote controller 500, so the aircraft 100 can transmit images to the monitoring terminal 900 via the remote controller 500. The monitoring terminal 900 can obtain the system time corresponding to each frame image and each frame image by decoding the image.

In one example, the monitoring terminal 900 is a client, that is, a display terminal that monitors the environment in which the aircraft 100 is located.

Referring to FIG. 18 and FIG. 19 together, in some embodiments, the remote controller 500 communicates with the monitoring terminal 900 through the relay terminal 600 and the cloud server 700. The processing method includes the following steps:

S31: The image is sent to the monitoring terminal 900 through the remote controller 500, the relay terminal 600, and the cloud server 700 in sequence.

Referring again to FIGS. 17 and 19, in some embodiments, the remote control 500 communicates with the monitoring terminal 900 via the relay terminal 600 and the cloud server 700. The fourth processing module 29 is further configured to send the image to the monitoring terminal 900 through the remote controller 500, the relay terminal 600, and the cloud server 700 in sequence.

That is to say, step S31 can also be implemented by the fourth processing module 29.

As such, the aircraft 100 can transmit images to the monitoring terminal 900 through the remote controller 500, the relay terminal 600, and the cloud server 700.

In some embodiments, the monitoring terminal 900 is remotely monitored and cannot communicate directly with the remote controller 500, and the aircraft 100 generally communicates directly with the remote controller 500, so the remote controller 500 can pass through the relay terminal 600 (such as a base station or an intelligent terminal). The smart terminal includes a mobile phone, a tablet computer, etc., and the cloud server transmits the image from the aircraft 100 to the monitoring terminal 900, that is, the image is transmitted according to the process of the aircraft 100→the remote controller 500→the relay terminal 600→the cloud server 700→the monitoring terminal 900. The monitoring terminal 900 can obtain the system time corresponding to each frame image and each frame image by decoding the image.

In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiment", "example", "specific example", or "some examples", etc. Particular features, structures, materials or features described in the embodiments or examples are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms does not necessarily mean the same embodiment or example. Moreover, the specific description Signs, structures, materials or features may be combined in any suitable manner in any one or more embodiments or examples.

Any process or method description in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for performing the steps of a particular logical function or process. And the scope of the preferred embodiments of the invention includes additional implementations, which may be performed in a substantially simultaneous manner or in the reverse order, depending on the functions involved, in the order shown or discussed, which should It will be understood by those skilled in the art to which the embodiments of the present invention pertain.

The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for performing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.

It should be understood that portions of the invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be performed by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if executed in hardware, as in another embodiment, it can be performed by any one of the following techniques or combinations thereof known in the art: having logic gates for performing logic functions on data signals Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

Those skilled in the art can understand that all or part of the steps carried in carrying out the above implementation method can be completed by a program to instruct related hardware, and the program can be stored in a computer readable storage medium, and the program is executed. Including one or a combination of the steps of the method embodiments.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above integrated modules can be executed in the form of hardware or in the form of software functional modules. The integrated modules, if executed in the form of software functional modules and sold or used as separate products, may also be stored in a computer readable storage medium.

The above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like. Although the embodiments of the present invention have been shown and described, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the invention. The embodiments are subject to variations, modifications, substitutions and variations.

Claims (17)

An image processing method for an aircraft, wherein the aircraft is provided with an imaging device, wherein the processing method comprises the following steps: Controlling the imaging device to image to obtain an image; and The system time of the aircraft when imaging the imaging device is synthesized into the image. The processing method according to claim 1, wherein said step of synthesizing said system time of said aircraft when imaging said imaging device into said image comprises the steps of: Converting the system time to a string; and The image is processed to write the string into the image. The processing method according to claim 1, wherein said step of synthesizing said system time of said aircraft when imaging said imaging device into said image comprises the steps of: Updating the system time to obtain the updated system time; and The updated system time is synthesized into the image. The processing method according to claim 3, wherein said aircraft includes positioning means, and said step of updating said system time to obtain said updated system time comprises the steps of: Processing the time acquired by the positioning device as the updated system time. The processing method according to claim 1, wherein the processing method comprises the following steps: The image synthesized with the system time is encoded. The processing method according to claim 1, wherein said aircraft communicates with a terminal, said terminal includes a display and a terminal time, said display is for displaying said image synthesized with said system time, said processing The method includes the following steps: The terminal time and the system time are compared to obtain a delay time. The processing method according to claim 1, wherein said aircraft communicates with a remote controller, said remote controller communicates with a monitoring terminal, and said processing method comprises the steps of: The image is sequentially transmitted to the monitoring terminal through the aircraft and the remote controller. The processing method according to claim 7, wherein the remote controller communicates with the monitoring terminal through a relay terminal and a cloud server, and the processing method comprises the following steps: And transmitting the image to the monitoring terminal through the remote controller, the relay terminal, and the cloud server in sequence. An image processing apparatus for an aircraft, wherein the aircraft is provided with an imaging device, wherein the processing device comprises: a control module for controlling imaging of the imaging device to obtain an image; and a first processing module, wherein the first processing module is configured to image the imaging device when the aircraft is in a system Synthesized into the image. The processing device of claim 9, wherein the first processing module comprises: a first processing unit, configured to convert the system time into a character string; and a second processing unit for processing the image to write the character string into the image. The processing device of claim 9, wherein the first processing module comprises: a third processing unit, configured to update the system time to obtain the updated system time; and And a fourth processing unit, configured to synthesize the updated system time into the image. The processing apparatus according to claim 11, wherein said aircraft comprises positioning means, and said third processing unit comprises: Processing a subunit, the processing subunit is configured to process the time acquired by the positioning device as the updated system time. The processing apparatus according to claim 9, wherein said processing means comprises: And a second processing module, configured to encode the image synthesized with the system time. A processing apparatus according to claim 9, wherein said aircraft communicates with a terminal, said terminal including a display and a terminal time, said display for displaying said image synthesized with said system time, said processing The device includes: And a third processing module, configured to compare the terminal time and the system time to obtain a delay time. The processing device of claim 9, wherein the aircraft is in communication with a remote controller, the remote controller is in communication with a monitoring terminal, the processing device comprising: And a fourth processing module, configured to send the image to the monitoring terminal through the aircraft and the remote controller in sequence. The processing device according to claim 15, wherein the remote controller communicates with the monitoring terminal through a relay terminal and a cloud server, and the fourth processing module is further configured to sequentially pass the image through the remote controller. The transit terminal and the cloud server are sent to the monitoring terminal. An aircraft characterized by comprising: Imaging device; and A processing apparatus according to any of claims 9-16.

Images