WO2020082830A1 - Method and apparatus for processing images - Google Patents

Abstract

Disclosed in embodiments of the present application are a method and apparatus for processing images. An embodiment of the method comprises: acquiring an image to be processed; determining a region to be processed of the image to be processed, the region to be processed comprising a sub-region to be processed; for a pixel point in the region to be processed, determining the weight of a regional pixel point in the sub-region to be processed in which the pixel point is located relative to the pixel point; on the basis of the determined weight of the regional pixel point in the sub-region to be processed relative to the pixel point, determining the weighted sum of a color value of the regional pixel point in the sub-region to be processed; according to the weighted sum of the color values of the regional pixel point in the sub-region to be processed, determining new color values of the pixel point; and adjusting the color values of the pixel point to be the new color values.

Description

Method and device for processing images

This application requires the priority of the Chinese patent application with the application number 201811236252.9 filed by the China Patent Office on October 23, 2018. The entire contents of this application are incorporated by reference in this application.

Technical field

The embodiments of the present application relate to the field of computer technology, such as a method and an apparatus for processing images.

Background technique

Out-of-focus imaging is usually one of the image effects that users want. Generally, the out-of-focus imaging is related to the focal length, object distance, aperture and other parameters of the shooting device. Therefore, when the shooting equipment is fixed, how to better realize out-of-focus imaging is still a problem to be studied.

Summary of the invention

The embodiments of the present application propose a method and an apparatus for processing images.

In a first aspect, an embodiment of the present application provides a method for processing an image, the method includes: acquiring an image to be processed; determining a region to be processed of the image to be processed, the region to be processed includes a sub-region to be processed; Pixels in the area, determine the weight of the pixels in the sub-region to be processed relative to the pixels in the sub-region where the pixels are located; based on the pixels of the pixels in the sub-region to be processed relative to the pixels Weights, to determine the weighted sum of the color values of the pixels in the sub-region to be processed; according to the weighted sum of the color values of the pixels in the sub-region to be processed, to determine the new color value of the pixel ; Adjust the color value of the pixel to a new color value.

In a second aspect, an embodiment of the present application provides an apparatus for processing an image, the apparatus includes: an acquiring unit configured to acquire an image to be processed; a determining unit configured to determine an area to be processed of the image to be processed, the The to-be-processed area includes the to-be-processed sub-area; the adjustment unit is configured to determine the weight of the pixel in the to-be-processed sub-area where the pixel is located relative to the pixel for the pixel in the to-be-processed area; based on Determine the weighted sum of the color values of the area pixels in the sub-area to be processed according to the weight of the area pixels in the sub-area to be processed relative to the pixels; according to the area pixels in the sub-area to be processed The weighted sum of the color values of the points determines the new color values of the pixel points; the color values of the pixel points are adjusted to the new color values.

In a third aspect, an embodiment of the present application provides an electronic device including: at least one processor; a storage device configured to store at least one program; the at least one program is executed by the at least one processor, so that The at least one processor implements the method as described in any one implementation manner of the first aspect.

According to a fourth aspect, an embodiment of the present application provides a computer-readable medium on which a computer program is stored, and when the computer program is executed by a processor, the method described in any one of the implementation manners of the first aspect is implemented.

BRIEF DESCRIPTION

FIG. 1 is an exemplary system architecture diagram to which an embodiment of the present application can be applied;

2 is a flowchart of an embodiment of a method for processing an image according to the present application;

3 is a schematic diagram of an application scenario of the image processing method according to an embodiment of the present application;

4 is a flowchart of still another embodiment of the image processing method according to the present application;

5 is a schematic structural diagram of an embodiment of an image processing apparatus according to the present application;

6 is a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present application.

detailed description

The application will be described in detail below with reference to the drawings and embodiments. It can be understood that the example embodiments described herein are only used for explaining related applications, rather than limiting the present application. In addition, it should be noted that, for ease of description, only the parts related to the relevant applications are shown in the drawings.

It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other without conflict. The application will be described in detail below with reference to the drawings and in conjunction with the embodiments.

FIG. 1 shows an exemplary architecture 100 of an embodiment of an image processing method or an image processing apparatus of the present application to which the present application can be applied.

As shown in FIG. 1, the system architecture 100 may include terminal devices 101, 102, and 103, a network 104, and a server 105. The network 104 is a medium used to provide a communication link between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, and so on.

The terminal devices 101, 102, 103 interact with the server 105 through the network 104 to receive or send messages, and so on. Various client applications may be installed on the terminal devices 101, 102, and 103. For example, browser applications, camera applications, image processing applications, etc.

The terminal devices 101, 102, and 103 may be hardware or software. When the terminal devices 101, 102, and 103 are hardware, they may be various electronic devices that support image storage and image transmission, including but not limited to smart phones, tablet computers, e-book readers, laptop portable computers, and desktop computers, etc. Wait. When the terminal devices 101, 102, and 103 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, multiple software or software modules used to provide distributed services) or as a single software or software module. No limitation here.

The server 105 may be a server that provides various services, for example, an image processing server that processes a region to be processed among the images to be processed sent by the terminal devices 101, 102, and 103. The image processing server can also feed back the processing results to the terminal devices 101, 102, and 103.

It should be noted that the above-mentioned to-be-processed images can also be directly stored locally on the server 105, and the server 105 can directly extract and process the locally-stored to-be-processed images. At this time, the terminal devices 101, 102, 103 and the network may not exist 104.

It should be noted that the image processing method provided in the embodiments of the present application is generally executed by the server 105, and accordingly, the image processing device is generally provided in the server 105.

It should also be noted that image processing applications may also be installed in the terminal devices 101, 102, and 103. At this time, the terminal devices 101, 102, and 103 may also process the image to be processed based on the installed image processing application. At this time, the method for processing images may also be executed by the terminal devices 101, 102, and 103, and accordingly, the apparatus for processing images may also be provided in the terminal devices 101, 102, and 103. At this time, the exemplary system architecture 100 may not have the server 105 and the network 104.

It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster composed of multiple servers or as a single server. When the server is software, it may be implemented as multiple software or software modules (for example, multiple software or software modules used to provide distributed services), or as a single software or software module. No limitation here.

It should be understood that the numbers of terminal devices, networks, and servers in FIG. 1 are only schematic. According to the implementation needs, there can be any number of terminal devices, networks and servers.

Referring to FIG. 2, it shows a flow 200 of an embodiment of a method for processing an image according to the present application. The image processing method includes steps 201 to 203.

In step 201, an image to be processed is acquired.

In this embodiment, the execution subject of the image processing method (the server 105 shown in FIG. 1) can be connected from a local or other storage device (the terminal devices 101 and 102 shown in FIG. 1) through a wired connection or a wireless connection. , 103) Acquire the image to be processed. The image to be processed may be various types of images.

In step 202, a region to be processed of the image to be processed is determined, and the region to be processed includes a sub-region to be processed.

In this embodiment, the area to be processed may be an image area of the image to be processed. According to actual application requirements, a variety of ways can be used to determine the area to be processed of the image to be processed.

In an embodiment, the area to be processed may be an image area of the image to be processed that meets a preset condition. Among them, the preset conditions can be preset by relevant personnel. For example, the to-be-processed area may be an image area covered by a circle whose radius is one-third of the width of the to-be-processed image using the geometric center of the to-be-processed image as a starting point. For another example, the image area to be processed may also be an image area of the image to be processed and the displayed content is a non-person.

In an embodiment, the area to be processed may also be an image area of the image to be processed designated by a user or a technician. For example, the above-mentioned execution subject may receive the image area of the image to be processed selected by the user through frame selection. For example, the above-mentioned execution subject may further divide the image region to be processed into multiple image regions according to a certain classification method (eg, according to the content displayed by the image to be processed, according to the color of the image to be processed, etc.), and then may receive the image selected by the user The area is to be processed.

In some implementations of this embodiment, the depth value of the pixels in the image to be processed may also be determined first, and then the image area composed of the pixels within the target depth value interval may be determined as the area to be processed.

Among them, a variety of monocular image depth estimation algorithms (such as monocular image depth estimation based on fully convolutional neural network, monocular image depth estimation based on Markov random field, etc.) can be used to determine pixels in the image Depth value.

The target depth value interval may be a depth value interval preset by relevant personnel. The target depth value interval may also be determined according to the depth value of pixels in the image to be processed. For example, one third of the minimum value of the depth value of pixels in the image to be processed can be the lower bound of the depth value interval, and one third of the maximum value of the depth value of pixels in the image to be processed can be the depth The upper bound of the value interval, and use the determined depth value interval as the target depth value interval. The target depth value interval may also be a depth value interval determined by the upper and lower bounds specified by the user.

It should be understood that in different application scenarios, the area to be processed may be one image area of the image to be processed, or may be multiple image areas of the image to be processed.

In step 203, for pixels in the region to be processed, steps 2031 to 2034 are performed.

In step 2031, the weight of the area pixel in the sub-area to be processed where the pixel is located relative to the pixel is determined.

In this embodiment, the sub-region to be processed may be the surrounding area of the pixel in the region to be processed, which contains the pixel. The size of the sub-region to be processed can be specified by the user, or based on the relevant information of the pixel (such as the position of the pixel, the depth value corresponding to the pixel, the content displayed by the pixel, etc.) Determined by the preset calculation method. The area pixels may refer to pixels in the sub-area to be processed.

In some implementations of this embodiment, at least one of the size and shape of the sub-region to be processed may be specified in advance. Among them, the shape can be any shape, such as rectangle, square, circle, pentagon, love heart and so on. In an embodiment, the sub-regions to be processed in at least one of different sizes and shapes may be pre-specified according to actual application requirements, so as to achieve different processing effects of the image to be processed.

In this embodiment, for the area pixels in the sub-area to be processed where the pixel is located, the weight of each area pixel in the sub-area to be processed relative to the pixel can be determined separately. In an embodiment, different weight determination methods may be adopted to determine the weight of each pixel in the sub-region to be processed relative to the pixel according to actual processing effect requirements.

In an embodiment, each area pixel in the to-be-processed sub-area can be determined according to the difference between the color value of each area pixel in the sub-area to be processed and the color value of the pixel respectively The weight of pixels. For example, the weight of the regional pixel in the sub-region to be processed relative to the pixel may be inversely proportional to the difference between the color value of the regional pixel in the sub-region to be processed and the color value of the pixel. That is, the larger the difference between the corresponding color value and the color value of the pixel, the smaller the weight of the pixel in the area relative to the pixel.

In an embodiment, the weight of the regional pixel in the sub-region to be processed where the pixel is located relative to the pixel can be determined according to the distance between the regional pixel in the sub-region to be processed and the pixel. For example, the weight of the area pixel in the sub-region to be processed relative to the pixel may be inversely related to the distance between the area pixel in the sub-region to be processed and the pixel. That is, the area pixels farther away from the pixel point, the smaller the weight of the area pixel points relative to the pixel point.

Wherein, the above distance can be set to represent the positional relationship between two pixels. In an embodiment, the expression method of the distance can be determined according to actual application requirements. For example, the above distance may be Euclidean distance, block distance, chessboard distance, etc. It should be understood that the calculation method of the distance may also be specified by a technician.

In an embodiment, the area pixel in the sub-area to be processed where the pixel is located may be determined relative to the pixel according to the difference between the depth value of the area pixel in the sub-area to be processed and the depth value of the pixel The weight of the point. For example, the weight of the regional pixel in the sub-region to be processed relative to the pixel may be negatively related to the difference between the depth value of the regional pixel in the sub-region to be processed and the depth value of the pixel. That is, the larger the depth difference from the pixel, the smaller the weight of the pixel in the region relative to the pixel.

In an embodiment, the weight of the pixel of the region in the sub-region to be processed relative to the pixel can be comprehensively determined from multiple aspects. For example, according to the difference between the color value of the pixel in the sub-region to be processed and the color value of the pixel, the distance between the pixel in the sub-region to be processed and the pixel, the distance between the pixel in the sub-region to be processed Any combination of the difference between the depth value of the region pixel and the depth value of the pixel to comprehensively determine the weight of the region pixel in the sub-region to be processed relative to the pixel.

In step 2032, the weighted sum of the color values of the regional pixels in the sub-region to be processed is determined based on the weight of the regional pixels in the sub-region to be processed with respect to the pixels.

In this embodiment, after determining the weight of each pixel in the sub-region to be processed with respect to the pixel, the weighted sum of the color values of the pixels in the sub-region to be processed can be calculated. It should be understood that the sub-region to be processed where the pixel is located also naturally includes the pixel, that is, the pixel is also a region pixel in the sub-region to be processed.

As an example, for any pixel A in the region to be processed, in the sub-region to be processed where the pixel A is located, in addition to the regional pixel A (ie, pixel A), there are three regional pixels B, C, D. The weights of regional pixels A, B, C, and D relative to pixel A are WAA, WAB, WAC, and WAD, and the color values of regional pixels A, B, C, and D are CA, CB, CC, and CD, respectively. . Then, the weighted sum of the color values of the pixels in the area in the sub-area to be processed where the pixel A is located can be determined as:

CA * WAA + CB * WAB + CC * WAC + CD * WCD.

In step 2033, according to the weighted sum of the color values of the pixels of the area in the sub-region to be processed, a new color value of the pixel is determined.

In this embodiment, according to the result of the weighted sum obtained in the above step 2032, various methods may be used to determine the new color value of the pixel.

In an embodiment, the weighted sum of the color values of the pixels of the area in the sub-region to be processed can be directly determined as the new color values of the pixels.

In an embodiment, the weighted sum of the color values of the pixels of the region in the sub-region to be processed can be adjusted, so that the obtained processing result is convenient for subsequent calculations. For example, the product of the weighted sum of the color values of the pixels in the sub-region to be processed and the preset adjustment parameters may be determined as the new color value of the pixel. For another example, the quotient of the weighted sum of the color values of the regional pixels in the sub-region to be processed and the number of regional pixels in the sub-region to be processed may be determined as the new color value of the pixel.

In step 2034, the color value of the pixel is adjusted to a new color value.

In this embodiment, the color value of the pixel can be adjusted to a new color value, so as to realize the processing of the pixel.

Referring to FIG. 3, FIG. 3 is a schematic diagram of an application scenario of the image processing method according to this embodiment. In the application scenario of FIG. 3, the above-mentioned execution subject may first obtain the image to be processed 301. Then, the image area where the person is displayed is detected, and the image area other than the image area where the person is displayed is determined as the to-be-processed area 302 (as shown by hatched portions in the figure).

After that, the new pixel value of each pixel in the region to be processed 302 is determined separately. In one embodiment, as indicated by reference numeral 303 in the figure, taking the pixel area to be processed 302 as an example, and the N pixel points to be processed in the area to be processed are from left to right and from top to bottom. Numbered sequentially. The color values of the N pixels included in the to-be-processed area 302 are C1, C2, ..., CN, respectively, and the new color values correspond to C1`, C2`, ..., CN`.

In an embodiment, taking the first pixel in the to-be-processed area 302 with a color value of C1 as an example, the new color value of the pixel can be determined by the following steps (as indicated by reference number 304 in the figure): First determine that the pixel to be processed includes the pixel and the next pixel in the sub-region to be processed (in the order of numbering). Then it is determined that the weight of the pixel with respect to the pixel is W1, and the weight of the next pixel of the pixel with respect to the pixel is W2. After that, you can first calculate the weighted sum of the color values of the pixel and the next pixel of the pixel, and then the result of the calculated weighted sum is two (the number of pixels in the sub-region to be processed is two) The quotient of is the new pixel value for that pixel. Similarly, a new pixel value for each pixel in the area to be processed 302 can be obtained separately.

After that, the color value of each pixel in the region to be processed 302 can be adjusted to the corresponding new color value, so that the image to be processed 305 after the region to be processed 302 can be obtained.

The method provided by the above embodiments of the present application determines the weight of the pixels in the sub-region to be processed where the pixels in the region to be processed are located, and determines the area in the sub-region to be processed where the pixels in the region to be processed are located The weighted sum of the color values of the pixels, and then according to the determined weighted sum, determine and adjust the new color values of the pixels in the area to be processed, thereby realizing the color values of the pixels in the area to be processed of the image to be processed The effective processing of the area makes the area to be processed after processing appear blurred. In addition, according to the weight of each pixel in the sub-region to be processed in the sub-region where each pixel in the to-be-processed region is located relative to each pixel, the weight of each pixel is determined separately, which helps to improve the processed The smoothness of the blur effect presented by the area to be processed.

Referring to FIG. 4, it shows a flow 400 of yet another embodiment of a method of processing images. The flow 400 of the image processing method includes steps 401 to 403.

In step 401, an image to be processed is acquired.

In step 402, a region to be processed of the image to be processed is determined, and the region to be processed includes a sub-region to be processed.

For the specific execution process of the above steps 401 and 402, reference may be made to the relevant descriptions of steps 201 and 202 in the embodiment corresponding to FIG. 2, which will not be repeated here.

In step 403, for the pixels in the region to be processed, steps 4031 to 4033 are performed.

In step 4031, the weight of the area pixel in the to-be-processed sub-area where the pixel is located relative to the pixel is determined through steps 40311-40317.

In step 40311, the square of the Euclidean distance between the pixel in the sub-region to be processed and the pixel is taken as the distance.

In this step, taking any area pixel in the sub-region to be processed as an example, suppose the horizontal coordinate of the area pixel is X1, the vertical coordinate is Y1, the horizontal coordinate of the pixel is X0, and the vertical coordinate is Y0, Then, the square of the Euclidean distance between the pixel in the area and the pixel can be:

(X1-X0) ² + (Y1-Y0) ² .

In step 40312, the inverse of the quotient of the distance value and the preset distance adjustment value is used as the first index.

In this step, the distance adjustment value may be a value greater than zero preset by a technician.

In step 40313, the first exponential power of the natural constant is determined as the distance weight of the pixel in the sub-region to be processed relative to the pixel.

In this step, taking an area pixel in the to-be-processed sub-region as X1 and an ordinate in Y1 as an example, assuming that the distance adjustment value is S, the pixel's abscissa is X0 and the ordinate is Y0, Then the distance weight of pixels in this area relative to this pixel can be:

The value range of the distance adjustment value S may be any real number greater than zero. In an embodiment, the distance adjustment value S may be specified by a technician in advance.

In step 40314, the square of the difference between the depth value of the pixel in the sub-region to be processed and the depth value of the pixel is taken as the depth difference.

In this step, multiple monocular image depth estimation algorithms (such as monocular image depth estimation based on fully convolutional neural network, monocular image depth estimation based on Markov random field, etc.) can be used to determine the sub-region to be processed The depth value of the pixel in the area and the depth value of the pixel.

In step 40315, the inverse of the quotient of the depth difference value and the preset depth adjustment value is used as the second index.

In this step, the depth adjustment value may be a value greater than zero preset by a technician.

In step 40316, the second exponential power of the natural constant is determined as the depth weight of the pixel in the sub-region to be processed relative to the pixel.

In this step, taking any area pixel in the sub-region to be processed as an example, assuming that the depth value of the area pixel is D1, the depth value of the pixel is D0, and the depth adjustment value is D, then the area pixel The depth weight of a point relative to the pixel can be:

The range of the depth adjustment value D can be any real number greater than zero. In an embodiment, the depth adjustment value D may be specified by a technician in advance.

In step 40317, the product of the distance weight and the depth weight is determined as the weight of the regional pixel in the sub-region to be processed relative to the pixel.

In step 4032, the new color value of the pixel is determined according to the weighted sum of the color values of the pixels in the sub-region to be processed through steps 40321-40322.

In step 40321, the sum of the weights of the pixels in the sub-region to be processed is taken as the total weight.

In step 40322, the quotient of the weighted sum of the color values of the pixels in the sub-region to be processed and the total weight is determined as the new color value of the pixel.

In this step, taking a total of N regional pixels in the sub-region to be processed where the pixel is located as an example, the weight of the i-th regional pixel among the N regional pixels relative to the pixel is Wi, and N regions The color value of the i-th pixel in the pixel is Ci, where the value range of i can be an integer between 1 and N (including 1 and N). Then, the new color value of the pixel can be:

In step 4033, the color value of the pixel is adjusted to a new color value.

As can be seen from FIG. 4, compared with the embodiment corresponding to FIG. 2, the process 400 of the image processing method in this embodiment can be based on the area pixel in the sub-region to be processed where a pixel is located and the pixel The distance and the depth difference, determine the weight of each area pixel relative to the pixel, and determine the new color value of the pixel according to the determined weight, so that the processed area to be processed is rendered blurred The effect may have a corresponding level change according to the depth value corresponding to the pixel in the area to be processed.

Referring to FIG. 5, as an implementation of the method shown in the above figures, the present application provides an embodiment of an apparatus for processing images, which corresponds to the method embodiment shown in FIG. 2, and the apparatus can be applied to various Kinds of electronic equipment.

As shown in FIG. 5, the image processing apparatus 500 provided in this embodiment includes an acquisition unit 501, a determination unit 502 and an adjustment unit 503. Wherein, the obtaining unit 501 is configured to obtain an image to be processed; the determining unit 502 is configured to determine a to-be-processed area of the to-be-processed image, the to-be-processed area includes a to-be-processed sub-area; and the adjusting unit 503 is configured to target pixels in the to-be-processed area Point, determine the weight of the area pixel in the sub-area to be processed relative to the pixel; based on the determined weight of the area pixel in the sub-area to be processed relative to the pixel, determine the to-be-processed The weighted sum of the color values of the pixels in the sub-region; according to the weighted sum of the color values of the pixels in the sub-region to be processed, determine the new color value of the pixel; adjust the color value of the pixel to New color value.

In this embodiment, in the image processing apparatus 500: the processing procedures of the acquiring unit 501, the determining unit 502, and the adjusting unit 503 can refer to the relevant descriptions of step 201, step 202, and step 203 in the corresponding embodiment of FIG. This will not be repeated here.

In some implementations of this embodiment, the adjustment unit 503 is configured to determine the weight according to at least one of the following: the distance between the area pixel in the sub-region to be processed and the pixel, the area pixel in the sub-region to be processed The difference between the depth value of the point and the depth value of the pixel; where the weights are inversely related to the following two: the distance between the area pixel in the sub-region to be processed and the pixel, the area pixel in the sub-region to be processed The difference between the depth value of a point and the depth value of the pixel.

In some implementations of this embodiment, at least one of the size and shape of the sub-region to be processed is specified in advance.

In some implementations of this embodiment, the above determination unit 502 is configured to: determine the depth value of pixels in the image to be processed; and determine the image area composed of pixels within the target depth value interval as Area to be processed.

In some implementations of this embodiment, the above-mentioned adjustment unit 503 is configured to: take the square of the Euclidean distance between the pixel in the sub-region to be processed and the pixel as the distance; take the distance and the preset value The inverse number of the quotient of the distance adjustment value is taken as the first index; the first exponent of the natural constant is determined as the distance weight of the pixel in the sub-region to be processed relative to the pixel; the The square of the difference between the depth value of the regional pixel and the depth value of the pixel is taken as the depth difference; the inverse of the quotient of the depth difference and the preset depth adjustment value is taken as the second index; the second of the natural constant The exponential power is determined as the depth weight of the regional pixel in the sub-region to be processed relative to the pixel; the product of the distance weight and the depth weight is determined as the weight of the regional pixel in the sub-region to be processed relative to the pixel.

In some implementations of this embodiment, the adjustment unit 503 is configured to: use the sum of the weights of the pixels in the sub-region to be processed as the total weight; and use the color values of the pixels in the sub-region to be processed The quotient of the weighted sum and the total weight is determined as the new color value of the pixel.

The device provided in the above embodiment of the present application acquires the image to be processed through the acquisition unit; the determination unit determines the area to be processed of the image to be processed; and for the pixel in the area to be processed, the adjustment unit determines the sub-region to be processed where the pixel is located The weight of the pixels in the region relative to the pixel; based on the weight of the pixels in the sub-region to be processed relative to the pixel, determine the weighted sum of the color values of the pixels in the sub-region to be processed; Process the weighted sum of the color values of the pixels in the sub-region to determine the new color value of the pixel; adjust the color value of the pixel to the new color value, thereby realizing the area to be processed of the image to be processed The effective processing of the color value of the pixel point makes the processed area to be processed appear a blur effect.

6, which shows a schematic structural diagram of a computer system 600 suitable for implementing an electronic device according to an embodiment of the present application. The electronic device shown in FIG. 6 is only an example, and should not bring any limitation to the functions and use scope of the embodiments of the present application.

As shown in FIG. 6, the computer system 600 includes a central processing unit (Central Processing Unit, CPU) 601, which can be loaded into a random portion according to a program stored in a read-only memory (Read-Only Memory, ROM) 602 or from the storage section 608 The program in the memory (Random Access Memory) 603 is accessed to perform various appropriate actions and processes. In the RAM 603, various programs and data necessary for the operation of the system 600 are also stored. The CPU 601, ROM 602, and RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

The following components are connected to the I / O interface 605: an input section 606 including a keyboard, a mouse, etc .; an output section 607 including a cathode ray tube (Cathode Ray Tube, CRT), liquid crystal display (Liquid Crystal Display, LCD) etc. A storage section 608 including a hard disk, etc .; and a communication section 609 including a network interface card such as a local area network (Local Area Network, LAN) card, modem, etc. The communication section 609 performs communication processing via a network such as the Internet. The driver 610 is also connected to the I / O interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, is installed on the drive 610 as needed, so that the computer program read out therefrom is installed into the storage section 608 as needed.

In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product that includes a computer program carried on a computer-readable medium, the computer program containing program code for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network through the communication section 609, and / or installed from the removable medium 611. When the computer program is executed by the central processing unit (CPU) 601, the above-mentioned functions defined in the method of the present application are executed.

It should be noted that the computer-readable medium of the present application may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with at least one wire, portable computer disk, hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable only Read memory (Erasable Programmable Read-Only Memory, EPROM or flash memory), optical fiber, portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM), optical storage device, magnetic storage device, or any suitable combination. In this application, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In this application, the computer-readable signal medium may include a data signal propagated in the baseband or as part of the carrier wave, in which the computer-readable program code is carried. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable medium may send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. . The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the foregoing.

The flowcharts and block diagrams in the drawings illustrate the architecture, functions, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, the module, a program segment, or a part of the code contains at least one Execute instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession can actually be executed in parallel, and sometimes they can also be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented with dedicated hardware-based systems that perform specified functions or operations Or, it can be realized by a combination of dedicated hardware and computer instructions.

The units described in the embodiments of the present application may be implemented in software or hardware. The described unit may also be provided in the processor. For example, it may be described as: a processor including an acquisition unit, a determination unit, and an adjustment unit. In some cases, the names of these units do not constitute a limitation on the unit itself. For example, the acquisition unit may also be described as a “unit for acquiring an image to be processed”.

As another aspect, the present application also provides a computer-readable medium, which may be contained in the electronic device described in the foregoing embodiments; or may exist alone without being assembled into the electronic device in. The above computer readable medium carries at least one program, and when the above at least one program is executed by the electronic device, the electronic device is caused to: acquire an image to be processed; determine a region to be processed of the image to be processed, the region to be processed includes a sub-region to be processed ; For the pixels in the area to be processed, determine the weight of the pixel in the sub-region to be processed relative to the pixel; based on the weight of the pixel in the sub-region to be processed relative to the pixel , Determine the weighted sum of the color values of the pixels in the sub-region to be processed; determine the new color value of the pixel according to the weighted sum of the color values of the pixels in the sub-region to be processed; The color value is adjusted to the new color value.

Claims (14)

A method of processing images, including: Get the image to be processed; Determining a region to be processed of the image to be processed, the region to be processed includes a sub-region to be processed; For the pixels in the to-be-processed area, determine the weight of the pixels in the sub-area to be processed relative to the pixels in the sub-area to be processed; based on the pixels in the sub-area to be processed The weight of the pixels determines the weighted sum of the color values of the pixels in the sub-region to be processed; the pixel is determined according to the weighted sum of the color values of the pixels in the sub-region to be processed The new color value of the pixel; adjust the color value of the pixel to the new color value. The method according to claim 1, wherein the determining the weight of the regional pixel in the sub-region to be processed where the pixel is located relative to the pixel includes: The weight is determined according to at least one of the following: the distance between the area pixel in the sub-region to be processed and the pixel, the depth value of the area pixel in the sub-region to be processed and the depth of the pixel The difference between the values; wherein the weights are inversely related to the following two: the distance between the area pixel in the sub-region to be processed and the pixel, the depth of the area pixel in the sub-region to be processed The difference between the value and the depth value of the pixel. The method according to claim 1, wherein at least one of the size and shape of the sub-region to be processed is specified in advance. The method according to any one of claims 1 to 3, wherein the determining the area to be processed of the image to be processed includes: Determine the depth value of the pixel in the image to be processed; The image area composed of pixels within the target depth value interval is determined as the area to be processed. The method according to claim 1, wherein the determining the weight of the regional pixel in the sub-region to be processed where the pixel is located relative to the pixel includes: Taking the square of the Euclidean distance between the pixel in the sub-region to be processed and the pixel as the distance; Use the inverse of the quotient of the distance value and the preset distance adjustment value as the first index; Determining the first exponential power of the natural constant as the distance weight of the regional pixel in the sub-region to be processed relative to the pixel; Taking the square of the difference between the depth value of the pixel point of the region in the sub-region to be processed and the depth value of the pixel point as the depth difference value; Use the inverse number of the quotient of the depth difference value and the preset depth adjustment value as the second index; Determining the second exponential power of the natural constant as the depth weight of the regional pixel in the sub-region to be processed relative to the pixel; The product of the distance weight and the depth weight is determined as the weight of the pixels of the region in the sub-region to be processed relative to the pixels. The method according to claim 5, wherein the determining a new color value of the pixel according to the weighted sum of the color values of the pixels in the sub-region to be processed includes: Taking the sum of the weights of the pixels in the sub-regions to be processed as the total weights; The quotient of the weighted sum of the color values of the pixels in the region in the sub-region to be processed and the total weight is determined as the new color value of the pixel. An image processing device, including: An acquisition unit configured to acquire an image to be processed; A determining unit configured to determine a region to be processed of the image to be processed, the region to be processed includes a sub-region to be processed; The adjusting unit is configured to determine the weight of the pixel in the sub-region to be processed where the pixel is located relative to the pixel for the pixel in the region to be processed; based on the The weight of the pixels in the area relative to the pixels, to determine the weighted sum of the color values of the pixels in the sub-region to be processed; To determine the new color value of the pixel; adjust the color value of the pixel to the new color value. The apparatus according to claim 7, wherein the adjustment unit is configured to: The weight is determined according to at least one of the following: the distance between the area pixel in the sub-region to be processed and the pixel, the depth value of the area pixel in the sub-region to be processed and the depth of the pixel The difference between the values; wherein the weights are inversely related to the following two: the distance between the area pixel in the sub-region to be processed and the pixel, the depth of the area pixel in the sub-region to be processed The difference between the value and the depth value of the pixel. The apparatus according to claim 7, wherein at least one of the size and shape of the sub-region to be processed is specified in advance. The apparatus according to any one of claims 7-9, wherein the determination unit is configured to: Determine the depth value of the pixel in the image to be processed; The image area composed of pixels within the target depth value interval is determined as the area to be processed. The apparatus according to claim 7, wherein the adjustment unit is configured to: Taking the square of the Euclidean distance between the pixel in the sub-region to be processed and the pixel as the distance; Use the inverse of the quotient of the distance value and the preset distance adjustment value as the first index; Determining the first exponential power of the natural constant as the distance weight of the regional pixel in the sub-region to be processed relative to the pixel; Taking the square of the difference between the depth value of the pixel in the sub-region to be processed and the depth value of the pixel as the depth difference; Use the inverse number of the quotient of the depth difference value and the preset depth adjustment value as the second index; Determining the second exponential power of the natural constant as the depth weight of the regional pixel in the sub-region to be processed relative to the pixel; The product of the distance weight and the depth weight is determined as the weight of the regional pixel in the sub-region to be processed relative to the pixel. The apparatus according to claim 11, wherein the adjustment unit is configured to: Taking the sum of the weights of the pixels in the sub-regions to be processed as the total weights; The quotient of the weighted sum of the color values of the pixels in the region in the sub-region to be processed and the total weight is determined as the new color value of the pixel. An electronic device, including: At least one processor; A storage device on which at least one program is stored; The at least one program is executed by the at least one processor, so that the at least one processor implements the method according to any one of claims 1-6. A computer-readable medium on which a computer program is stored, wherein the program is executed by a processor to implement the method according to any one of claims 1-6.

Images