WO2019148996A1 - Image processing method and device, storage medium, and electronic apparatus - Google Patents

Abstract

Disclosed is an image processing method, comprising: acquiring a first image and a second image, the first image being captured by a wide-angle camera module, and the second image being captured by a long-focus camera module; performing preset first processing on the first image to obtain a first target image, wherein a quantity of pixels in the first target image is less than a quantity of pixels in the first image; acquiring depth of field information according to the first target image and the second image; and performing, according to the depth of field information, preset second processing on the first target image.

Description

Image processing method, device, storage medium and electronic device

The present application claims priority to Chinese Patent Application No. 201810097883.0, filed on Jan. 31, 2018, the entire disclosure of which is incorporated herein by reference. Combined in this application.

Technical field

The present application belongs to the field of image technologies, and in particular, to an image processing method, apparatus, storage medium, and electronic device.

Background technique

With the continuous development of hardware technology, the configuration of hardware installed on the terminal is also getting higher and higher. Currently, many terminals are equipped with dual camera modules. With the help of the dual camera module, the camera's camera level can be greatly improved. For example, a dual camera module with a color camera and a black and white camera can make the terminal capture more details when taking pictures. The dual camera module with two color cameras can make the terminal have double the amount of light entering when taking pictures.

Summary of the invention

Embodiments of the present application provide an image processing method, apparatus, storage medium, and electronic device, which can improve image quality of an image.

The embodiment of the present application provides an image processing method, which is applied to a terminal, where the terminal includes at least a wide-angle camera module and a telephoto camera module, and the method includes:

Acquiring the first image and the second image, the first image is an image captured by the wide-angle camera module, and the second image is an image captured by the telephoto camera module;

Performing a preset first process on the first image to obtain a first target image, wherein the number of pixels of the first target image is smaller than the number of pixels of the first image;

Obtaining depth information according to the first target image and the second image;

And performing preset second processing on the first target image according to the depth information.

An embodiment of the present application provides an image processing apparatus, which is applied to a terminal, where the terminal includes at least a wide-angle camera module and a telephoto camera module, and the device includes:

a first acquiring module, configured to acquire a first image and a second image, where the first image is an image captured by the wide-angle camera module, and the second image is an image captured by the telephoto camera module ;

a first processing module, configured to perform a preset first process on the first image, to obtain a first target image, where the number of pixels of the first target image is smaller than the number of pixels of the first image;

a second acquiring module, configured to acquire depth information according to the first target image and the second image;

The second processing module is configured to perform preset second processing on the first target image according to the depth information.

The embodiment of the present application provides a storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer is caused to execute the flow in the image processing method provided by the embodiment of the present application.

The embodiment of the present application further provides an electronic device, including a memory, a processor, where the electronic device includes at least a wide-angle camera module and a telephoto camera module, and the processor uses a computer program stored in the memory to use For execution:

Acquiring the first image and the second image, the first image is an image captured by the wide-angle camera module, and the second image is an image captured by the telephoto camera module;

Performing a preset first process on the first image to obtain a first target image, wherein the number of pixels of the first target image is smaller than the number of pixels of the first image;

Obtaining depth information according to the first target image and the second image;

And performing preset second processing on the first target image according to the depth information.

DRAWINGS

The technical solutions of the present application and the beneficial effects thereof will be apparent from the detailed description of the specific embodiments of the present application.

FIG. 1 is a schematic flowchart diagram of a method for processing an image provided by an embodiment of the present application.

FIG. 2 is another schematic flowchart of a method for processing an image according to an embodiment of the present disclosure.

FIG. 3 is still another schematic flowchart of a method for processing an image provided by an embodiment of the present application.

FIG. 4 is a schematic diagram of an execution process of a Skipping algorithm according to an embodiment of the present application.

FIG. 5 is a schematic diagram of another execution process of the Skipping algorithm provided by the embodiment of the present application.

FIG. 6 is a schematic diagram of an execution process of a Binning algorithm provided by an embodiment of the present application.

FIG. 7 is a schematic diagram of a scenario of an image processing method according to an embodiment of the present application.

FIG. 10 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application.

FIG. 11 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.

FIG. 12 is a schematic structural diagram of an image processing circuit of an electronic device according to an embodiment of the present application.

Detailed ways

Referring to the drawings, in which like reference numerals represent the same components, the principles of the present application are illustrated by way of example in a suitable computing environment. The following description is based on the specific embodiments of the present invention as illustrated, and should not be construed as limiting the specific embodiments that are not described herein.

It can be understood that the executive body of the embodiment of the present application may be a terminal such as a smart phone or a tablet computer.

The embodiment provides an image processing method, which is applied to a terminal, and the terminal may include at least a wide-angle camera module and a telephoto camera module, and the method includes:

Acquiring the first image and the second image, the first image is an image captured by the wide-angle camera module, and the second image is an image captured by the telephoto camera module;

Performing a preset first process on the first image to obtain a first target image, wherein the number of pixels of the first target image is smaller than the number of pixels of the first image;

Obtaining depth information according to the first target image and the second image;

And performing preset second processing on the first target image according to the depth information.

In an implementation manner, the performing the preset second processing on the first target image may include: performing background blurring processing on the first target image.

In an embodiment, after acquiring the second image, the method may further include: performing a preset third process on the second image to obtain a second target image, wherein the second target image The number of pixels is smaller than the number of pixels of the second image.

Then, the acquiring the depth information according to the first target image and the second image may include: acquiring depth information according to the first target image and the second target image.

In an embodiment, the performing a preset third processing on the second image to obtain a second target image, wherein the number of pixels of the second target image is smaller than the number of pixels of the second image, The method includes: performing a preset third process on the second image to obtain the second target image, wherein the number of pixels of the second target image is one quarter of the number of pixels of the second image.

In an embodiment, the performing the third processing on the second image to obtain the second target image may include: processing the second image by using a Binning algorithm to obtain the second target image. .

In an embodiment, the performing a preset first process on the first image to obtain a first target image, wherein the number of pixels of the first target image is smaller than the number of pixels of the first image, The method includes: performing a preset first process on the first image to obtain the first target image, wherein the number of pixels of the first target image is one-half of the number of pixels of the first image.

In an embodiment, the performing the first processing on the first image to obtain the first target image may include: performing a preset first processing on the first image to obtain the first target image, The preset first process is an image reduction process, or an image cropping process, or a combination of image reduction processing and image cropping processing.

Please refer to FIG. 1 and FIG. 2 . FIG. 1 is a schematic flowchart diagram of a method for processing an image according to an embodiment of the present application. The processing method of the image can be applied to the terminal. The terminal may be any terminal equipped with a dual camera module such as a smartphone or a tablet. The dual camera module can be a combination of a wide-angle camera module and a telephoto camera module. The flow of the image processing method may include:

In 101, a first image and a second image are acquired. The first image is an image captured by a wide-angle camera module, and the second image is an image captured by a telephoto camera module.

With the continuous development of hardware technology, the configuration of hardware installed on the terminal is also getting higher and higher. Currently, many terminals are equipped with dual camera modules. With the help of the dual camera module, the camera's camera level can be greatly improved. For example, a dual camera module with a color camera and a black and white camera can make the terminal capture more details when taking pictures. The dual camera module with two color cameras can make the terminal have double the amount of light entering when taking pictures. In the related art, when an image acquired by a telephoto lens is used for imaging, the imaging effect is poor.

In the 101 of the embodiment of the present application, the terminal may first acquire the first image and the second image. The terminal may be a terminal equipped with a wide-angle camera module and a telephoto camera module. The first image is captured by a wide-angle camera module on the terminal, and the second image is a telephoto camera module on the terminal. Collected by the group.

In 102, a preset first process is performed on the first image to obtain a first target image, wherein the number of pixels of the first target image is smaller than the number of pixels of the first image.

For example, after acquiring the first image collected by the wide-angle camera module, the terminal may perform a preset first process on the first image, thereby obtaining a first target image. The number of pixels of the first target image may be smaller than the number of pixels of the first image.

For example, if the wide-angle camera module on the terminal is a 16-megapixel camera module, the number of pixels of the first image collected by the wide-angle camera module is 16 million. Then, after acquiring the first image, the terminal may perform a preset first process on the first image, where the preset first process may reduce the number of pixels of the first image. For example, by presetting the first process, the terminal reduces the number of pixels of the first image from 16 million pixels to 8 million pixels, that is, the number of pixels of the first target image obtained is 8 million.

In 103, depth information is acquired based on the first target image and the second image.

For example, after obtaining the first target image, the terminal may acquire the depth information according to the first target image and the second image. It should be noted that the depth of field information is relative to the in-focus object in the image, and is the depth of field information acquired after the in-focus object is determined.

In 104, a preset second process is performed on the first target image according to the depth of field information.

For example, after acquiring the depth information, the terminal may perform a preset second processing on the first target image according to the depth information.

In some embodiments, the preset second process may be a 3D application process such as background blurring and images.

It can be understood that compared with the telephoto camera module, the image acquired by the wide-angle camera module is used for imaging, and the imaging effect is better, especially in a dark environment. In this embodiment, the first image is an image acquired by the wide-angle camera module, and the first target image is an image obtained by lowering the pixel point of the first image, so the imaging is performed according to the first target image, and the imaging effect is good. . Especially in a dim light environment, the imaging effect can be improved by using the technical solution in this embodiment.

In addition, since the first target image for imaging is obtained by reducing the number of pixels of the first image, imaging is performed using the first target image, and the image processing speed is faster.

At the same time, since the first target image and the second image are used to obtain the depth information, that is, the image acquired by the dual camera module is used to acquire the depth information, the depth information is more accurate. Therefore, using the depth of field information to process the first target image can make the processed image image better.

Please refer to FIG. 3. FIG. 3 is still another schematic flowchart of a method for processing an image according to an embodiment of the present disclosure. The processing method of the image can be applied to the terminal. The terminal may be any terminal equipped with a dual camera module such as a smartphone or a tablet. The dual camera module can be a combination of a wide-angle camera module and a telephoto camera module. The flow of the image processing method may include:

In 201, the terminal acquires the first image and the second image, the first image is an image captured by the wide-angle camera module, and the second image is an image captured by the telephoto camera module.

For example, the terminal may first acquire the first image and the second image. The terminal may be a terminal equipped with a wide-angle camera module and a telephoto camera module. The first image is captured by a wide-angle camera module on the terminal, and the second image is a telephoto camera module on the terminal. Collected by the group.

In 202, the terminal performs a preset first process on the first image to obtain a first target image, where the number of pixels of the first target image is one-half of the number of pixels of the first image.

For example, after acquiring the first image collected by the wide-angle camera module, the terminal may perform a preset first process on the first image, thereby obtaining a first target image. The number of pixels of the first target image is one-half of the number of pixels of the first image.

For example, if the wide-angle camera module on the terminal is a 16-megapixel camera module, the number of pixels of the first image collected by the wide-angle camera module is 16 million. Then, after acquiring the first image, the terminal may perform a preset first process on the first image, where the preset first process may reduce the number of pixels of the first image by half. For example, by preset the first process, the terminal reduces the number of pixels of the first image from 16 million pixels to 8 million pixels, that is, the obtained number of pixels of the first target image is 8 million.

In some embodiments, the process of the terminal performing the preset first processing on the first image in the 202 to obtain the first target image may include:

The terminal performs a preset first process on the first image to obtain a first target image, where the preset first process is image reduction process, or image cropping process, or a combination of image reduction process and image cropping process.

For example, the preset first process is image reduction processing. The terminal may perform image reduction processing on the first image by an image scaling algorithm, thereby reducing the resolution of the first image. For example, the image scaling algorithm may be a quadratic linear interpolation algorithm, a cubic linear interpolation algorithm, or a cubic convolution interpolation algorithm.

In another implementation manner, the terminal may perform pixel extraction processing on the first image by using a Skipping algorithm, thereby reducing the first image and reducing the resolution of the first image.

Referring to FIG. 4 and FIG. 5, the execution process of the Skipping algorithm in this embodiment may include the following two methods: row extraction (Row Skip 2X) and column extraction (Column Skip 2X). The Skipping algorithm extracts pixels in pairs. The mode shown in FIG. 4 is a row drawing (Row Skip 2X) method in which pixels with a background color are existing pixels, and pixels without a background color are pixels to be extracted. The mode shown in FIG. 5 is a column extraction (Column Skip 2X) in which pixels with a background color are existing pixels, and pixels without a background color are pixels to be extracted. 4 and FIG. 5, after performing pixel extraction on the first image according to row extraction (Row Skip 2X) or column extraction (Column Skip 2X), the number of pixels of the first target image obtained is the number of pixels of the first image. One-half.

For example, the preset first process is an image cropping process (crop). For example, when performing image cropping processing on the first image, the terminal may only retain the area of the preset size (preset size) in the first image, and the other areas are cropped. It can be understood that by cutting a partial area of the first image, the number of pixels can be reduced, thereby reducing the amount of data processed by the image.

In an embodiment, due to the image captured by the wide-angle camera module, there is a certain degree of distortion around the image, so the terminal can cut off the periphery of the first image, and retain the intermediate region with better imaging effect. The size is the above preset size. The preset size can be set according to actual usage requirements. For example, the preset size can be set or adjusted according to factors such as imaging parameters of the wide-angle camera module (such as the resolution of the camera module) and environmental parameters when the image is acquired.

For example, the preset first process may also be a combination of image reduction processing and image cropping processing. For example, the terminal may first reduce the first image, and then crop the area around the first image that is distorted. Alternatively, the terminal may first cut off the distorted area around the first image, and then reduce the cropped image to obtain the first target image.

Regardless of the above manner, the number of pixels of the first target image obtained in this embodiment may be one-half of the number of pixels of the first image.

In 203, the terminal processes the second image by using the Binning algorithm to obtain a second target image, wherein the number of pixels of the second target image is one quarter of the number of pixels of the second image.

For example, after acquiring the second image acquired by the telephoto camera module, the terminal may perform a preset third process on the second image to obtain a second target image. The number of pixels of the second target image may be smaller than the number of pixels of the second image. In an embodiment, the number of pixels of the second target image may be one quarter of the number of pixels of the second image.

In this embodiment, the terminal may process the second image by using a Binning algorithm to obtain a second target image.

For example, if the telephoto camera module on the terminal is a 20 megapixel camera module, the number of pixels of the second image captured by the telephoto camera module is 20 million. Then, after acquiring the second image, the terminal may process the second image by using a Binning algorithm to obtain a second target image, where the number of pixels of the second target image is 5 million.

It should be noted that the Binning algorithm adds charges corresponding to adjacent pixel units of the same color and reads them in a one-pixel mode. In this embodiment, charges corresponding to four adjacent pixel units of the same color may be added together and read out in a pattern of one pixel. That is, each of four adjacent pixel units of the same color is combined into one pixel unit. The process of pixel merging can be as shown in FIG. 6.

Wherein, in terms of the pixel value size, taking the pixel value of the green pixel as an example, Gr00'=(Gr00+Gr10+Gr01+Gr11)/4, Gr10'=(Gr20+Gr30+Gr21+Gr31)/4, Gr01' = (Gr02 + Gr12 + Gr03 + Gr13) / 4, Gr11' = (Gr22 + Gr32 + Gr23 + Gr33) / 4. Similarly, after the pixels are merged, the pixel values of the red and blue pixels are also the average of the pixel values of the adjacent pixel units of the same color.

It should be noted that reducing the number of pixels of the image by using the Binning algorithm can make the processed image have the advantage of high signal-to-noise ratio. Therefore, the Binning algorithm reduces the number of pixels of the second image to obtain the second target image. The imaging quality of the second target image is made better, so that the depth information acquired subsequently from the first target image and the second target image is more accurate.

In addition, the number of pixels of the second image can be reduced to one quarter of the number of original pixels by the Binning algorithm, so that the speed of image processing in the present embodiment can be accelerated.

In 204, the terminal acquires the depth information according to the first target image and the second target image.

For example, after obtaining the first target image and the second target image, the terminal may acquire the depth information according to the first target image and the second target image. It should be noted that the depth of field information is relative to the in-focus object in the image, and is the depth of field information acquired after the in-focus object is determined.

In 205, according to the depth of field information, the terminal performs background blurring processing on the first target image.

For example, after obtaining the corresponding depth of field information, the terminal may perform background blur processing on the first target image according to the depth information.

It can be understood that, in this embodiment, the first target image is obtained by reducing the number of pixels of the first image, and the second target image is obtained by reducing the number of pixels by the second image, thereby utilizing the first image. The target image and the second target image acquire the depth of field information faster, and when the first target image is used for imaging, the image processing speed of the terminal is also faster. In addition, the depth of field information acquired according to the first target image and the second target image is also more accurate, and the background blur is performed according to the depth information, and the blurring effect is better. In summary, the embodiment can improve the image quality of an image.

In an embodiment, after the terminal acquires the first image and the second image in 201, the embodiment may further include the following process:

The terminal obtains the total running memory capacity and the currently occupied running memory capacity;

The terminal obtains the proportion of the currently occupied running memory capacity in the total running memory capacity.

Then, the process of the terminal performing the first processing on the first image to obtain the first target image may include: if the ratio is detected to reach the preset threshold, the terminal performs the preset first processing on the first image, to obtain The first target image. For example, if it is detected that the ratio reaches a preset threshold, the terminal performs image reduction processing on the first image, thereby obtaining a first target image.

For example, when it is detected that the user opens the camera application, the terminal can acquire the total running memory (RAM) capacity of the terminal and the currently occupied running memory capacity. Then, the terminal can calculate the proportion of the currently occupied running memory capacity in the total running memory capacity. After that, the terminal can detect whether the ratio reaches a preset threshold.

If the terminal detects that the ratio does not reach the preset threshold, the terminal can perform other operations. For example, if the total running memory capacity of the terminal is 4 GB, and the currently occupied running memory capacity is 2 GB, the current occupied running memory capacity accounts for 50% of the total running memory capacity of the terminal. For example, the preset threshold is 80%. Then, the terminal can detect that the ratio is 50% less than the preset threshold of 80%. In this case, the terminal can perform other operations, such as the terminal collecting images according to a normal process.

If the terminal detects that the ratio reaches a preset threshold, for example, the total running memory capacity of the terminal is 4 GB, and the currently occupied running memory capacity is 3.4 GB, the currently occupied running memory capacity accounts for the total running memory capacity of the terminal. The ratio is 85%. For example, the preset threshold is 80%. Then, the terminal can detect that the ratio is 85% greater than the preset threshold of 80%. In this case, it can be considered that the remaining running memory of the current terminal is small. In order to prevent the image processing from occupying too much running memory resources, the terminal can adopt the image processing method provided in this embodiment, thereby improving the image processing speed. For example, the terminal may perform image reduction processing on the first image to reduce the number of pixels of the first image to obtain a first target image. Moreover, the terminal can reduce the number of pixels of the second image to obtain a second target image. Then, the terminal may acquire depth of field information according to the first target image and the second target image, and perform background blurring processing on the first target image according to the depth information.

In an embodiment, after the process of acquiring the first image and the second image by the terminal in 201, the embodiment may further include the following process:

The terminal obtains the remaining power value.

Then, the process of the terminal performing the first processing on the first image to obtain the first target image may include: if the remaining power value is lower than the preset power threshold, the terminal presets the first image. Upon processing, a first target image is obtained. For example, if it is detected that the remaining power value is lower than the preset power threshold, the terminal performs image reduction processing on the first image to reduce the number of pixels of the first image to obtain a first target image.

For example, when it is detected that the user opens the camera application, the terminal can obtain the current remaining power value of the terminal. After that, the terminal can detect whether the remaining power value is lower than the preset power threshold.

If the terminal detects that the remaining power value is not lower than the preset power threshold, the terminal can perform other operations. For example, the current remaining battery value of the terminal is 80%. The default power threshold is 30%. In this case, the terminal can perform other operations, such as the terminal collecting images according to a normal process.

If the terminal detects that the remaining power value is lower than the preset power threshold, for example, the remaining power value of the terminal is 29%, and the preset power threshold is 30%. In this case, it can be considered that the current remaining capacity of the terminal is low. In order to prevent the image processing from consuming too much power, the terminal can adopt the image processing method provided in this embodiment, thereby improving the image processing speed. For example, the terminal may perform image reduction processing on the first image to reduce the number of pixels of the first image to obtain a first target image. Moreover, the terminal can reduce the number of pixels of the second image to obtain a second target image. Then, the terminal may acquire depth of field information according to the first target image and the second target image, and perform background blurring processing on the first target image according to the depth information.

In other implementations, the terminal may further obtain a difference between the remaining power value and the preset power threshold after detecting that the remaining power value is not lower than the preset power threshold. If the difference is less than the preset difference, the terminal can acquire the number of applications currently camping in the background.

If the number does not reach the preset value, the terminal can perform other operations.

If the number reaches the preset value, then the power consumption of the terminal can be considered to be faster. At this time, the terminal can also adopt the image processing method provided in this embodiment, thereby improving image processing speed and lower power consumption. For example, the terminal may perform image reduction processing on the first image to reduce the number of pixels of the first image to obtain a first target image. Moreover, the terminal can reduce the number of pixels of the second image to obtain a second target image. Then, the terminal may acquire depth of field information according to the first target image and the second target image, and perform background blurring processing on the first target image according to the depth information.

Please refer to FIG. 7 to FIG. 9 , which are schematic diagrams of a scenario and a flow of an image processing method according to an embodiment of the present application.

For example, as shown in FIG. 7 , a dual camera module 10 is mounted on the terminal, and the dual camera module 10 includes a first camera module 11 and a second camera module 12 . In one embodiment, the two cameras in the dual camera module may be arranged side by side in a lateral direction (as shown in FIG. 7). In another embodiment, the two cameras in the dual camera module may also be arranged side by side in the longitudinal direction. For example, in the embodiment, the first camera module 11 is a wide-angle camera module, and the second camera module 12 is a telephoto camera module. The first camera module 11 and the second camera module 12 can simultaneously acquire images.

For example, the user opens the camera application and is ready to take a photo, at which point the terminal interface enters the image preview interface. An image for preview by the user will be displayed on the display screen of the terminal. It should be noted that, in an implementation manner, before the user clicks the camera button, the dual camera module of the terminal quickly collects the image, saves the image in a buffer queue of the memory, and displays the image on the screen for the user to preview. As shown in Figure 8. For example, the terminal buffer queue stores 6 frames of images recently acquired by the first camera module and 6 frames of images recently acquired by the second camera module.

After that, the user clicks on the camera button as shown in FIG. After detecting that the user clicks the camera button, the terminal can acquire the first image captured by the wide-angle camera module and acquire the second image captured by the telephoto camera module. In an embodiment, the first image may be an image collected before the user clicks the camera button, or may be an image collected after the user clicks the camera button. The second image may be an image acquired before the user clicks the camera button, or may be an image acquired after the user clicks the camera button. For example, in this embodiment, the first image and the second image are images that are synchronously acquired after the user clicks the photo button.

After acquiring the first image and the second image, the terminal may perform image reduction processing on the first image to reduce the number of pixels of the first image to obtain a first target image, where the pixel of the first target image The number is one-half the number of pixels of the first image. Moreover, the terminal can reduce the number of pixels of the second image by using a Binning algorithm to obtain a second target image. For example, the number of pixels of the first image is 16 million, and the number of pixels of the first target image obtained by performing image reduction processing on the first image is 8 million. The number of pixels of the second image is 20 million, and the number of pixels of the second target image obtained by processing the second image by the Binning algorithm is 5 million.

After obtaining the first target image and the second target image, the terminal may obtain the depth information according to the first target image and the second target image, and then the terminal may perform background blur processing on the first target image according to the depth information. An output image is obtained, and a schematic diagram of the flow can be seen in FIG.

The embodiment provides an image processing device, which is applied to a terminal, and the terminal includes at least a wide-angle camera module and a telephoto camera module, and the device includes:

a first acquiring module, configured to acquire a first image and a second image, where the first image is an image captured by the wide-angle camera module, and the second image is an image captured by the telephoto camera module ;

a first processing module, configured to perform a preset first process on the first image, to obtain a first target image, where the number of pixels of the first target image is smaller than the number of pixels of the first image;

a second acquiring module, configured to acquire depth information according to the first target image and the second image;

The second processing module is configured to perform preset second processing on the first target image according to the depth information.

In an embodiment, the second processing module may be configured to perform background blurring processing on the first target image.

In an embodiment, the first processing module may be further configured to perform a preset third process on the second image to obtain a second target image, where the number of pixels of the second target image is smaller than The number of pixels of the second image.

Then, the second acquiring module may be configured to: acquire depth information according to the first target image and the second target image.

In an embodiment, the first processing module may be configured to: perform a preset third process on the second image to obtain the second target image, where the number of pixels of the second target image is The fourth image has a quarter of the number of pixels.

In an embodiment, the first processing module may be configured to: process the second image by using a Binning algorithm to obtain the second target image.

In an embodiment, the first processing module may be configured to: perform a preset first process on the first image to obtain a first target image, where the number of pixels of the first target image is the first One-half the number of pixels in the image.

In an embodiment, the first processing module may be configured to: perform preset first processing on the first image to obtain a first target image, where the preset first processing is image reduction processing, or image cropping processing , or a combination of image reduction processing and image cropping processing.

Please refer to FIG. 10 , which is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure. The processing device of the image can be applied to the terminal. The terminal may be any electronic device such as a smartphone or tablet that is equipped with a dual camera module. The dual camera module can be a combination of a wide-angle camera module and a telephoto camera module. The image processing apparatus 300 may include: a first obtaining module 301, a first processing module 302, a second obtaining module 303, and a second processing module 304.

a first acquiring module 301, configured to acquire a first image and a second image, where the first image is an image captured by the wide-angle camera module, and the second image is collected by the telephoto camera module image.

For example, the first obtaining module 301 may first acquire the first image and the second image. The terminal may be a terminal equipped with a wide-angle camera module and a telephoto camera module. The first image is captured by a wide-angle camera module on the terminal, and the second image is a telephoto camera module on the terminal. Collected by the group.

The first processing module 302 is configured to perform a preset first process on the first image to obtain a first target image, where the number of pixels of the first target image is smaller than the number of pixels of the first image.

For example, after the first acquiring module 301 acquires the first image collected by the wide-angle camera module, the first processing module 302 may perform a preset first process on the first image, thereby obtaining a first target image. The number of pixels of the first target image may be smaller than the number of pixels of the first image. .

The second obtaining module 303 is configured to obtain depth information according to the first target image and the second image.

For example, after obtaining the first target image, the second obtaining module 303 can obtain the depth information according to the first target image and the second image. It should be noted that the depth of field information is relative to the in-focus object in the image, and is the depth of field information acquired after the in-focus object is determined.

The second processing module 304 is configured to perform a preset second process on the first target image according to the depth of field information.

For example, after the second acquisition module 303 obtains the depth information, the second processing module 304 may perform a preset second processing on the first target image according to the depth information.

In an embodiment, the second processing module 304 is configured to perform background blurring processing on the first target image.

In an embodiment, the first processing module 302 may be configured to perform a preset third process on the second image to obtain a second target image, where the number of pixels of the second target image is smaller than the first The number of pixels in the second image.

Then, the second obtaining module 303 can be configured to: acquire depth information according to the first target image and the second target image.

In an embodiment, the first processing module 302 may be configured to: perform a preset third process on the second image to obtain a second target image, where the number of pixels of the second target image is the The image has a quarter of the number of pixels.

In an embodiment, the first processing module 302 can be configured to: process the second image by using a Binning algorithm to obtain a second target image.

In an embodiment, the first processing module 302 may be configured to perform a preset first process on the first image to obtain a first target image, where the number of pixels of the first target image is the first One-fifth of the number of pixels in an image.

In an embodiment, the first processing module 302 may be configured to: perform preset first processing on the first image to obtain a first target image, where the preset first processing is image reduction processing, or image cropping Processing, or a combination of image reduction processing and image cropping processing.

With regard to the apparatus in this embodiment, the specific manner in which the respective modules perform the operations has been described in detail in the embodiment relating to the method, and will not be explained in detail herein.

The embodiment of the present application provides a computer readable storage medium having a computer program stored thereon, and when the computer program is executed on a computer, causing the computer to execute a process in the image processing method provided by the embodiment. .

The embodiment of the present application further provides an electronic device, including a memory, and a processor, by using a computer program stored in the memory, to execute a process in a method for processing an image provided by the embodiment.

For example, the above electronic device may be a mobile terminal such as a tablet or a smart phone. Please refer to FIG. 11. FIG. 11 is a schematic structural diagram of a mobile terminal according to an embodiment of the present disclosure.

The mobile terminal 400 can include components such as a camera module 401, a memory 402, a processor 403, and the like. It will be understood by those skilled in the art that the mobile terminal structure illustrated in Figure 11 does not constitute a limitation to the mobile terminal, and may include more or less components than those illustrated, or some components may be combined, or different component arrangements.

The camera module 401 can include a dual camera module, and the dual camera module can include a wide-angle camera module and a telephoto camera module.

Memory 402 can be used to store applications and data. The application stored in the memory 402 contains executable code. Applications can form various functional modules. The processor 403 executes various functional applications and data processing by running an application stored in the memory 402.

The processor 403 is a control center of the mobile terminal, connects various parts of the entire mobile mobile terminal using various interfaces and lines, performs operations by running or executing an application stored in the memory 402, and calling data stored in the memory 402. The various functions of the terminal and processing data to monitor the mobile terminal as a whole.

In this embodiment, the processor 403 in the mobile terminal loads the executable code corresponding to the process of one or more applications into the memory 402 according to the following instructions, and is stored in the memory by the processor 403. The application in 402, thus executing:

Obtaining a first image that is an image captured by the wide-angle camera module, the second image is an image captured by the telephoto camera module, and the first image Performing a preset first process to obtain a first target image, wherein the number of pixels of the first target image is smaller than the number of pixels of the first image; and acquiring according to the first target image and the second image Depth of field information; performing preset second processing on the first target image according to the depth of field information.

An embodiment of the present application further provides an electronic device. The above electronic device includes an image processing circuit that can be implemented using hardware and/or software components, and can include various processing units that define an Image Signal Processing pipeline. The image processing circuit may at least include: a camera, an image signal processor (ISP), a control logic, an image memory, a display, and the like. The camera may include at least one or more lenses and an image sensor.

The image sensor can include a color filter array (such as a Bayer filter). The image sensor can acquire light intensity and wavelength information captured with each imaging pixel of the image sensor and provide a set of raw image data that can be processed by the image signal processor.

The image signal processor can process the raw image data pixel by pixel in a variety of formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the image signal processor may perform one or more image processing operations on the raw image data, collecting statistical information about the image data. Among them, image processing operations can be performed with the same or different bit depth precision. The raw image data can be stored in the image memory after being processed by the image signal processor. The image signal processor can also receive image data from the image memory.

The image memory can be part of a memory device, a storage device, or a separate dedicated memory within an electronic device, and can include DMA (Direct Memory Access) features.

When image data from the image memory is received, the image signal processor can perform one or more image processing operations, such as time domain filtering. The processed image data can be sent to the image memory for additional processing before being displayed. The image signal processor can also receive processing data from the image memory and process the image data in the original domain and in the RGB and YCbCr color spaces. The processed image data can be output to a display for viewing by a user and/or further processed by a graphics engine or a GPU (Graphics Processing Unit). Additionally, the output of the image signal processor can also be sent to an image memory, and the display can read image data from the image memory. In one embodiment, the image memory can be configured to implement one or more frame buffers.

The statistics determined by the image signal processor can be sent to the control logic. For example, the statistics may include statistical information of image sensors such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, lens shading correction, and the like.

The control logic can include a processor and/or a microcontroller that executes one or more routines, such as firmware. One or more routines may determine the camera's control parameters and ISP control parameters based on the received statistics. For example, the camera's control parameters may include camera flash control parameters, lens control parameters (eg, focus or zoom focal length), or a combination of these parameters. The ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (eg, during RGB processing), and the like.

Please refer to FIG. 12. FIG. 12 is a schematic structural diagram of an image processing circuit in the embodiment. As shown in FIG. 12, for convenience of explanation, only various aspects of the image processing technique related to the embodiment of the present application are shown.

The image processing circuit may include a first camera 510, a second camera 520, a first image signal processor 530, a second image signal processor 540, a control logic 550, an image memory 560, and a display 570. The first camera 510 may include one or more first lenses 511 and a first image sensor 512. The second camera 520 can include one or more second lenses 521 and a second image sensor 522.

In some embodiments, the first camera can be any of a telephoto camera or a wide-angle camera. The second camera can be any of a telephoto camera or a wide-angle camera. For example, in this embodiment, the first camera is a wide-angle camera and the second camera is a telephoto camera.

The first image acquired by the first camera 510 is transmitted to the first image signal processor 530 for processing. After the first image signal processor 530 processes the first image, the statistical data of the first image (such as the brightness of the image, the contrast of the image, the color of the image, etc.) may be sent to the control logic 550. The control logic 550 can determine the control parameters of the first camera 510 according to the statistical data, so that the first camera 510 can perform operations such as auto focus, auto exposure, and the like according to the control parameters. The first image is processed by the first image signal processor 530 and stored in the image memory 560. The first image signal processor 530 can also read the image stored in the image memory 560 for processing. In addition, the first image is processed by the image signal processor 530 and sent directly to the display 570 for display. Display 570 can also read images in image memory 560 for display.

The second image acquired by the second camera 520 is transmitted to the second image signal processor 540 for processing. After the second image signal processor 540 processes the second image, the statistical data of the second image (such as the brightness of the image, the contrast of the image, the color of the image, etc.) may be sent to the control logic 550. The control logic 550 can determine the control parameters of the second camera 520 according to the statistical data, so that the second camera 520 can perform operations such as auto focus, automatic exposure, and the like according to the control parameters. The second image is processed by the second image signal processor 540 and stored in the image memory 560. The second image signal processor 540 can also read the image stored in the image memory 560 for processing. In addition, the second image is processed by the image signal processor 540 and sent directly to the display 570 for display. Display 570 can also read images in image memory 560 for display.

In other embodiments, the first image signal processor and the second image signal processor may also be synthesized into a unified image signal processor that processes data of the first image sensor and the second image sensor, respectively.

In addition, not shown in the figure, the electronic device may further include a CPU and a power supply module. The CPU and the logic controller, the first image signal processor, the second image signal processor, the image memory, and the display are all connected, and the CPU is used to implement global control. The power supply module is used to power each module.

In general, a mobile phone with a dual camera module works in both camera modes and dual camera modules. At this time, the CPU controls the power supply module to supply power to the first camera and the second camera. The image sensor in the first camera is powered on, and the image sensor in the second camera is powered up, so that image acquisition and conversion can be realized. In some camera modes, it can be a camera in a dual camera module. For example, only telephoto cameras work. In this case, the CPU controls the power supply module to supply power to the image sensor of the corresponding camera. In the embodiment of the present application, since the depth of field calculation and the blurring process are to be performed, it is required that the two camera dies work simultaneously.

In addition, the installation distance of the dual camera module in the terminal can be determined according to the size determination of the terminal and the shooting effect. In some embodiments, in order to make the objects captured by the first camera module and the second camera module have a high degree of overlap, the two camera modules may be mounted as close as possible, for example, within 10 mm.

The following is a flow of a method for processing an image provided by the embodiment in the image processing technology of FIG. 12, wherein the electronic device includes at least a wide-angle camera module and a telephoto camera module:

Obtaining a first image that is an image captured by the wide-angle camera module, the second image is an image captured by the telephoto camera module, and the first image Performing a preset first process to obtain a first target image, wherein the number of pixels of the first target image is smaller than the number of pixels of the first image; and acquiring according to the first target image and the second image Depth of field information; performing preset second processing on the first target image according to the depth of field information.

In an embodiment, when the electronic device performs the preset second processing on the first target image, performing: performing background blur processing on the first target image.

In an embodiment, after acquiring the second target image, the electronic device may further perform: performing a preset third process on the second image to obtain a second target image, where the pixels of the second target image The number of dots is smaller than the number of pixels of the second image.

Then, when the electronic device performs the acquiring the depth information according to the first target image and the second image, it may be performed to acquire the depth information according to the first target image and the second target image.

In an embodiment, the electronic device performs the preset third processing on the second image to obtain a second target image, wherein the number of pixels of the second target image is smaller than the pixel of the second image. The quantity may be performed by performing a preset third process on the second image to obtain a second target image, wherein the number of pixels of the second target image is four quarters of the number of pixels of the second image. One.

In an embodiment, when the electronic device performs the preset third processing on the second image to obtain the second target image, the electronic image may be processed by using the Binning algorithm to obtain the second image. Target image.

In an embodiment, the electronic device performs the preset first processing on the first image to obtain a first target image, where the number of pixels of the first target image is smaller than the pixel of the first image. The quantity may be performed by performing a preset first process on the first image to obtain a first target image, wherein the number of pixels of the first target image is two-half of the number of pixels of the first image. One.

In an embodiment, when the electronic device performs the preset first processing on the first image to obtain the first target image, performing: performing preset first processing on the first image to obtain the first target. An image, wherein the preset first process is an image reduction process, or an image cropping process, or a combination of image reduction processing and image cropping processing.

In the above-mentioned embodiments, the descriptions of the various embodiments are different. For details that are not detailed in an embodiment, reference may be made to the detailed description of the processing method for the image, and details are not described herein again.

The processing device of the image provided by the embodiment of the present application is the same as the processing method of the image in the above embodiment, and any one of the embodiments provided in the processing method of the image may be executed on the processing device of the image. The specific implementation process of the method is described in the embodiment of the image processing method, and details are not described herein again.

It should be noted that, in the processing method of the image in the embodiment of the present application, a person skilled in the art may understand all or part of the process for implementing the image processing method according to the embodiment of the present application, and the related program may be controlled by a computer program. The computer program can be stored in a computer readable storage medium, such as in a memory, and executed by at least one processor, and can include an implementation of a processing method such as the image during execution. The flow of the example. The storage medium may be a magnetic disk, an optical disk, a read only memory (ROM), a random access memory (RAM), or the like.

For the processing device of the image of the embodiment of the present application, each functional module may be integrated into one processing chip, or each module may exist physically separately, or two or more modules may be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. The integrated module, if implemented in the form of a software functional module and sold or used as a standalone product, may also be stored in a computer readable storage medium, such as a read only memory, a magnetic disk or an optical disk, etc. .

The method, the device, the storage medium, and the electronic device for processing an image provided by the embodiments of the present application are described in detail. The principles and implementation manners of the present application are described in the following, and the description of the above embodiments is described. It is only used to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. The contents of the description should not be construed as limiting the application.

Claims (20)

An image processing method is applied to a terminal, wherein the terminal includes at least a wide-angle camera module and a telephoto camera module, and the method includes: Acquiring the first image and the second image, the first image is an image captured by the wide-angle camera module, and the second image is an image captured by the telephoto camera module; Performing a preset first process on the first image to obtain a first target image, wherein the number of pixels of the first target image is smaller than the number of pixels of the first image; Obtaining depth information according to the first target image and the second image; And performing preset second processing on the first target image according to the depth information. The image processing method according to claim 1, wherein the performing the preset second processing on the first target image comprises: Performing background blurring processing on the first target image. The method of processing an image according to claim 1, wherein after the acquiring the second image, the method further comprises: Performing a third process on the second image to obtain a second target image, wherein the number of pixels of the second target image is smaller than the number of pixels of the second image; And obtaining the depth information according to the first target image and the second image, including: The depth of field information is acquired according to the first target image and the second target image. The image processing method according to claim 3, wherein the performing a third process on the second image to obtain a second target image, wherein the number of pixels of the second target image is smaller than the second image The number of pixels in the image, including: Performing a third processing on the second image to obtain the second target image, wherein the number of pixels of the second target image is one quarter of the number of pixels of the second image. The image processing method according to claim 4, wherein the performing the third processing on the second image to obtain the second target image comprises: The second image is processed by a Binning algorithm to obtain the second target image. The image processing method according to claim 1, wherein the performing a preset first process on the first image to obtain a first target image, wherein the number of pixels of the first target image is smaller than the first The number of pixels in the image, including: Performing a preset first process on the first image to obtain the first target image, wherein the number of pixels of the first target image is one-half of the number of pixels of the first image. The image processing method according to claim 1, wherein the performing the preset first processing on the first image to obtain the first target image comprises: Performing a preset first process on the first image to obtain the first target image, wherein the preset first process is an image reduction process, or an image cropping process, or a combination of image reduction processing and image cropping processing. An image processing device is applied to a terminal, wherein the terminal includes at least a wide-angle camera module and a telephoto camera module, and the device includes: a first acquiring module, configured to acquire a first image and a second image, where the first image is an image captured by the wide-angle camera module, and the second image is an image captured by the telephoto camera module ; a first processing module, configured to perform a preset first process on the first image, to obtain a first target image, where the number of pixels of the first target image is smaller than the number of pixels of the first image; a second acquiring module, configured to acquire depth information according to the first target image and the second image; The second processing module is configured to perform preset second processing on the first target image according to the depth information. The image processing apparatus according to claim 8, wherein said second processing module is configured to: Performing background blurring processing on the first target image. The image processing apparatus according to claim 8, wherein the first processing module is configured to: perform a preset third process on the second image to obtain a second target image, wherein the second target image The number of pixels is smaller than the number of pixels of the second image; The second acquiring module is configured to: acquire depth information according to the first target image and the second target image. The image processing apparatus according to claim 10, wherein said first processing module is configured to: Performing a third processing on the second image to obtain the second target image, wherein the number of pixels of the second target image is one quarter of the number of pixels of the second image. The image processing apparatus according to claim 11, wherein said first processing module is configured to: The second image is processed by a Binning algorithm to obtain the second target image. A storage medium having stored thereon a computer program, wherein when the computer program is executed on a computer, the computer is caused to perform the method of any one of claims 1 to 7. An electronic device includes a memory, a processor, wherein the electronic device includes at least a wide-angle camera module and a telephoto camera module, and the processor is configured to execute by calling a computer program stored in the memory: Acquiring the first image and the second image, the first image is an image captured by the wide-angle camera module, and the second image is an image captured by the telephoto camera module; Performing a preset first process on the first image to obtain a first target image, wherein the number of pixels of the first target image is smaller than the number of pixels of the first image; Obtaining depth information according to the first target image and the second image; And performing preset second processing on the first target image according to the depth information. The electronic device of claim 14, wherein the processor is operative to: Performing background blurring processing on the first target image. The electronic device of claim 14, wherein the processor is operative to: Performing a third process on the second image to obtain a second target image, wherein the number of pixels of the second target image is smaller than the number of pixels of the second image; The depth of field information is acquired according to the first target image and the second target image. The electronic device of claim 16 wherein said processor is operative to: Performing a third processing on the second image to obtain the second target image, wherein the number of pixels of the second target image is one quarter of the number of pixels of the second image. The electronic device of claim 17 wherein said processor is operative to: The second image is processed by a Binning algorithm to obtain the second target image. The electronic device of claim 14, wherein the processor is operative to: Performing a preset first process on the first image to obtain the first target image, wherein the number of pixels of the first target image is one-half of the number of pixels of the first image. The electronic device of claim 14, wherein the processor is operative to: Performing a preset first process on the first image to obtain the first target image, wherein the preset first process is an image reduction process, or an image cropping process, or a combination of image reduction processing and image cropping processing.

Images