[go: up one dir, main page]

WO2016101883A1 - Procédé d'embellissement de visage dans une vidéo en temps réel et équipement électronique - Google Patents

Procédé d'embellissement de visage dans une vidéo en temps réel et équipement électronique Download PDF

Info

Publication number
WO2016101883A1
WO2016101883A1 PCT/CN2015/098355 CN2015098355W WO2016101883A1 WO 2016101883 A1 WO2016101883 A1 WO 2016101883A1 CN 2015098355 W CN2015098355 W CN 2015098355W WO 2016101883 A1 WO2016101883 A1 WO 2016101883A1
Authority
WO
WIPO (PCT)
Prior art keywords
face
image
image area
current picture
beautified
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/098355
Other languages
English (en)
Chinese (zh)
Inventor
武俊敏
冯加伟
薛涵凛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
PALMWIN INFORMATION TECHNOLOGY (SHANGHAI) Co Ltd
Original Assignee
PALMWIN INFORMATION TECHNOLOGY (SHANGHAI) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by PALMWIN INFORMATION TECHNOLOGY (SHANGHAI) Co Ltd filed Critical PALMWIN INFORMATION TECHNOLOGY (SHANGHAI) Co Ltd
Publication of WO2016101883A1 publication Critical patent/WO2016101883A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/77—Retouching; Inpainting; Scratch removal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Definitions

  • the present invention relates to the field of image processing, and in particular, to a face beautification method and an electronic device in an instant video.
  • the prior art provides a method for facial beautification in an instant video.
  • the method specifically includes: acquiring a current frame image in an instant video, beautifying a face in the current frame image, and replacing the original frame image with the beautification Some current frame images continue to perform the above steps on the next frame image of the current frame, thereby realizing face beautification in the instant video.
  • the method provided by the prior art is complicated, the hardware requirements of the device are high, and the hardware of the mobile terminal such as the smart phone and the tablet cannot meet the hardware requirements of the method, so that the mobile terminal cannot use the method provided by the prior art.
  • the face of the instant video is beautified, or when the mobile terminal uses the method provided by the prior art, the processing resources and storage resources of the device are occupied in a large amount, which affects the use of the device, thereby reducing the user experience.
  • the embodiment of the invention provides a method and device for facializing in the instant video.
  • the technical solution is as follows:
  • a method for beautifying a face in an instant video comprising:
  • the beautified face image area is merged with the face image area to generate a merged face image area, and a current picture including at least the merged face image area is displayed.
  • the acquiring a face image area from a current picture of the instant video includes:
  • the face image region in the current picture is acquired from the grayscale image according to the face frame size, the face pixel distance, and the search zoom factor.
  • the method before the acquiring the grayscale image of the face image region in the current picture, the method further includes:
  • the method further includes:
  • a histogram equalization process is performed on the grayscale image of the face image region.
  • the method further include:
  • the face image area is scaled, and the coordinates of the face image area in the uncompressed current picture are acquired.
  • the beautifying the face image area includes:
  • the face detail image includes at least an eye, a mouth, and a nose
  • the face mask image including at least an eye, a mouth And the face part outside the nose
  • the face mask image is beautified to obtain a beautified face mask image.
  • the beautifying the facial mask image includes:
  • the obtaining the beautified face image area includes:
  • an electronic device comprising:
  • An obtaining module configured to obtain a face image area from a current picture of the instant video
  • a beautification module configured to beautify the face image area, and obtain a beautified face image area
  • the beautified face image area is merged with the face image area to generate a merged face image area
  • a display module configured to display a current picture including at least the merged face image area
  • a storage module configured to store the face image area, the beautified face image area, and the merged face image area.
  • the acquiring module is specifically configured to:
  • the storage module is further configured to store the grayscale image.
  • the device further includes:
  • a compression module configured to compress the current picture, and after the compression is completed, trigger the acquiring module to perform the step of acquiring the gray image of the face image area in the current picture.
  • the device further includes:
  • a processing module configured to perform a histogram equalization process on the grayscale image of the face image region.
  • the compression module is further configured to:
  • the acquiring module is further configured to acquire coordinates of the face image area in an uncompressed current picture;
  • the storage module is further configured to store the coordinates.
  • the apparatus further includes a separation module for separating a face in the grayscale image into a face detail image and a face mask image, wherein the face detail image includes at least an eye, a mouth, and a nose, the person
  • the face mask image includes a face portion other than the eyes, mouth, and nose;
  • the beautification module is configured to beautify the face mask image to obtain a beautified face mask image.
  • the beautification module is specifically used to:
  • the fusion module is configured to fuse the low-pass filtered image, the face mask image, and the high-pass filtered image to obtain the beautified face mask image.
  • the merging module is used to:
  • the face detail image is merged with the beautified face mask image to obtain a beautified face image area.
  • an electronic device including a video input module, a video output module, a sending module, a receiving module, a memory, and the video input module, the video output module, the transmitting module, and the receiving, respectively And a processor coupled to the memory, wherein the memory stores a set of program code, the processor is configured to invoke program code stored in the memory, and perform the following operations:
  • the beautified face image area is merged with the face image area to generate a merged face image area, and a current picture including at least the merged face image area is displayed.
  • the processor is further configured to invoke program code stored in the memory, and perform the following operations:
  • the face image region in the current picture is acquired from the grayscale image according to the face frame size, the face pixel distance, and the search zoom factor.
  • the processor is further configured to invoke program code stored in the memory, and perform the following operations:
  • the processor is further configured to invoke the program code stored in the memory, and execute the following operating:
  • a histogram equalization process is performed on the grayscale image of the face image region.
  • the processor is further configured to invoke program code stored in the memory, Do the following:
  • the face image area is scaled, and the coordinates of the face image area in the uncompressed current picture are acquired.
  • the processor is further configured to invoke the program code stored in the memory, and perform the following operations:
  • the face detail image includes at least an eye, a mouth, and a nose
  • the face mask image including at least an eye, a mouth And the face part outside the nose
  • the face mask image is beautified to obtain a beautified face mask image.
  • the processor is further configured to invoke the program code stored in the memory, and perform the following operations:
  • the processor is further configured to invoke the program code stored in the memory, and perform the following operations:
  • the face detail image is merged with the beautified face mask image to obtain a beautified face image area.
  • Embodiments of the present invention provide a method and an electronic device for facial glazing in an instant video, the method comprising: obtaining a face image region from a current picture of an instant video; beautifying the face image region to obtain a beautified a face image area; merging the beautified face image area with the face image area to generate a merged face image area, and displaying a current picture including at least the merged face image area .
  • FIG. 1 is a schematic diagram of an interaction system according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of an interaction system according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of a face beautification method in an instant video according to an embodiment of the present invention.
  • FIG. 4 is a flowchart of a method for facializing a face in an instant video according to an embodiment of the present invention
  • FIG. 5 is a flowchart of a method for facializing a face in an instant video according to an embodiment of the present invention
  • FIG. 6 is a flowchart of a face beautification method in an instant video according to an embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
  • An embodiment of the present invention provides a method for facial landscaping in an instant video.
  • the method is applied to an interactive system including at least two mobile terminals and a server.
  • the interactive system may be as shown in FIG. 1 , wherein the mobile terminal 1 is an instant video sender, the mobile terminal 2 is an instant video receiver, and the instant video sent by the mobile terminal 1 is forwarded to the mobile terminal 2 via the server; wherein the mobile terminal can be a smart phone or a tablet (Tablet Personal Computer), which may also be other mobile terminals, and the specific mobile terminal is not limited in the embodiment of the present invention.
  • the mobile terminal includes at least a video input module and a video display module.
  • the video input module can include a camera.
  • the video display module can include a display screen, and at least one instant video program can be run in the mobile terminal, and the instant video program controls the video input module of the mobile terminal. Instant video with the video display module.
  • the execution body of the method provided by the embodiment of the present invention may be any one of the mobile terminal 1, the mobile terminal 2, and the server.
  • the execution subject of the method is the mobile terminal 1
  • the instant is The face in the video is beautified, and then the beautified instant video is sent to the server, and then sent by the server to the communication device 2, and the beautified instant video is displayed by the video display module in the communication device 2;
  • the mobile terminal 1 sends the instant video to the server after inputting the instant video through the video input module of the user, and the server visualizes the face in the instant video, and then sends the beautified face to the server.
  • the mobile terminal 2 displays the beautified instant video by the video display module in the communication device 2; if the execution subject of the method is the mobile terminal 2, the mobile terminal 1 inputs the instant video through its own video input module.
  • the video is sent to the server, and the server sends the instant video to the mobile terminal 2, and the mobile terminal 2 is in the live video. Face beautification, and through its own video display module to display real-time video after the landscaping.
  • the specific implementation body of the method in the interaction system is not limited in the embodiment of the present invention.
  • the method provided by the embodiment of the present invention can also be applied to a mobile terminal 1 only.
  • the interactive system can be referred to FIG. 2, wherein the mobile terminal 1 is an instant video sender, the mobile terminal 2 is an instant video receiver, and the mobile terminal includes at least a video input module and a video display.
  • the module, the video input module may include a camera, and the video display module may include a display screen, and at least one instant video program may be run in the mobile terminal, and the instant video program controls the video input module and the video display module of the mobile terminal to perform real-time video.
  • the execution body of the method provided by the embodiment of the present invention may be any one of the mobile terminal 1 and the mobile terminal 2.
  • the execution subject of the method is the mobile terminal 1
  • the mobile terminal 1 is After inputting the live video through the video input module of the user, the face in the instant video is beautified, and then the beautified instant video is sent to the communication device 2, and the beautified instant is displayed by the video display module in the communication device 2
  • the execution body of the method is the mobile terminal 2
  • the mobile terminal 1 sends the live video to the mobile terminal 2 after inputting the live video through its own video input module, and the mobile terminal 2 beautifies the face in the instant video. And then display the beautified instant video through its own video display module.
  • the specific implementation body of the method in the interaction system is not limited in the embodiment of the present invention.
  • An embodiment of the present invention provides a method for facial landscaping in an instant video.
  • the method is applied to any of the foregoing interaction systems. Referring to FIG. 3, the method includes:
  • the step may include:
  • the face image area in the current picture is acquired from the gray image according to the face frame size, the face pixel distance, and the search zoom factor.
  • the current picture before acquiring the grayscale image of the face image area in the current picture, the current picture may be compressed, and after the compression is completed, the step of acquiring the gray image of the face image area in the current picture is performed.
  • the face after obtaining the gray image of the face image area in the current picture, the face can also be The grayscale image of the image area is subjected to histogram equalization processing.
  • the face image area may also be scaled to obtain coordinates of the face image area in the uncompressed current picture.
  • the face in the grayscale image is separated into a face detail image and a face mask image, wherein the face detail image includes at least an eye, a mouth, and a nose, and the face mask image includes the eyes, the mouth, and the nose.
  • face detail image includes at least an eye, a mouth, and a nose
  • face mask image includes the eyes, the mouth, and the nose.
  • the beautification of the face mask image includes:
  • a low-pass filtered image, a face mask image, and a high-pass filtered image are combined to obtain a beautified face mask image.
  • the face detail image is merged with the beautified face mask image to obtain the beautified face image area.
  • the embodiment of the present invention provides a method for facial beautification in instant video by obtaining a face image region from a current picture of an instant video, beautifying the face image region, and obtaining a beautified face image region, and beautifying the face image region.
  • the subsequent face image area is merged with the face image area to generate a merged face image area, and the current picture including at least the merged face image area is displayed. Therefore, by landscaping the face in the instant video and merging with the previous face area, the picture quality of the instant video is improved, and the user experience is increased.
  • An embodiment of the present invention provides a method for facializing a face in an instant video. Referring to FIG. 4, the method includes:
  • the gray-scale channel of the current picture is obtained, and the gray-scale image of the face image area in the current picture is obtained by the gray-scale channel, and the gray-scale image is stored, where the embodiment of the present invention specifically acquires the current picture.
  • the manner in which the grayscale channel and the grayscale channel acquire the grayscale image of the face image region in the current screen is not limited.
  • the amount of data of the grayscale image is small compared to the color image, by acquiring the grayscale image of the face image region in the current image and beautifying, the amount of data processing during the face beautification process can be reduced, and the storage memory is saved. To improve the efficiency of face beautification.
  • the size of the face frame can be represented by min objectSize, and the min objectSize can be a matrix of at least length and width.
  • the matrix can be: [length, width] T , length and width can be positive rational numbers, respectively; face pixels
  • the distance can be represented by min neighbor, and the min neighbor can be a natural number;
  • the search scaling factor can be represented by ScaleFactor, and the ScaleFactor can be a positive rational number, wherein the face frame size is used to indicate the length and width of the grayscale image;
  • the face pixel distance is used to indicate the number of face images that are closest in the grayscale image. If there is only one face in the grayscale image, the face pixel distance is 1 if there are two faces in the grayscale image. , the face pixel distance is 2, and so on;
  • the search zoom factor is used to indicate the scaling of the grayscale image when performing face detection.
  • the face image area in the current picture is obtained from the gray image by the face frame size, the face pixel distance, and the search zoom factor, so that the acquired face image area includes at least the current user's face, and the face image area can be improved.
  • the accuracy of the acquisition thus achieving the reliability of face beautification.
  • the grayscale image is scaled by searching the zoom factor, which can reduce the data processing amount in the process of acquiring the face image region, and reduce the hardware requirement on the device, so that the mobile terminal can be
  • This method is used for face beautification in instant video, and the face beautification efficiency on the mobile terminal can be improved.
  • steps 401 to 402 are processes for acquiring a face image region from the current picture of the live video.
  • the face image region may be acquired from the current picture of the live video by other means.
  • the specific acquisition process is not limited in the embodiment of the present invention.
  • the grayscale image is scaled according to the scaling formula, and the scaling formula can be:
  • width represents the width of the face image area
  • height represents the height of the face image area
  • the coordinates of the face image area in the uncompressed picture image are obtained, denoted as [x, y], and [x, y] ⁇ R 2 , and the coordinates are stored.
  • the step may further include scaling the output face image area such that the face image area is within a rectangular range, wherein the rectangular range is to reduce the amount of calculation in the face beautification process.
  • the specific scaling process can be:
  • a1 represents the width
  • a2 represents the height
  • a1 and a2 are positive rational numbers, respectively.
  • the value of a1 can be set to 1.1, a2 The value is 1.05;
  • step 403 the grayscale image needs to be stored, and the specific storage process may be:
  • the face team The column refers to the number of faces.
  • the length of the queue is 1, and if there are n faces, the length of the queue is n.
  • a face in the grayscale image into a face detail image and a face mask image, wherein the face detail image includes at least an eye, a mouth, and a nose, and the face mask image includes the eyes, the mouth, and the nose.
  • the process can be:
  • the value of the eyebrow, the eyes, the nose, and the mouth of the face image in the histogram is obtained, and the value is taken to the left of the approximate valley of the histogram, and the skin of the face image is obtained in the histogram.
  • a value, which is to the right of the approximate valley point, through the approximate valley point of the histogram, the face details of the face image, the eye, the nose, and the face and the face skin can be classified.
  • the obtained facial details including the eyebrows, eyes, nose and mouth are required to retain the original image, and the skin obtained for the face is to beautify,
  • the face mask image includes a face portion other than the eyes, the mouth, and the nose.
  • the position corresponding to the face mask on the right side of the valley point is 0, and the corresponding position of the face mask on the left side of the valley point is 1 or Values different from 0 are not limited here;
  • the changing valley point is the selection point of the classification of details such as skin and eyes and mouth.
  • the process can be:
  • the three primary color channels include a red channel, a yellow channel, and a blue channel.
  • the blue channel and the yellow channel of the face mask are obtained, which are not limited.
  • the face mask can be Gaussian filtered by a blue channel to generate a contrast image.
  • the filter radius is set to [b1, b2] T , and Gaussian filtering is performed by the following formula:
  • the GaussianFilter is a Gaussian filtered image
  • Original is the original image
  • A1 is the displacement
  • A1 is a positive integer.
  • the Gaussian filter can be used to process the contrast image, the filter radius is [c1, c2] T , and c1 and c2 are positive integers respectively.
  • the original image is processed according to the contrast image, the contrast is large, and the original image is preserved, and the contrast is small, and the Gaussian filtered contrast image is retained.
  • Lagrange interpolation can also be used to adjust the brightness of the image.
  • the parameters are:
  • e1, e2, e3, and e4 are positive rational numbers, respectively.
  • the filtering method is not limited here, and other high-pass filtering methods such as canny may be used.
  • the high-pass filtered image, the face mask image, and the low-pass filtered image are fused, and the calculation formula is:
  • FaceArea is the face image area
  • Lowpass is the low-pass filter
  • Highpass is the high-pass filter
  • f1 is a positive integer.
  • Step 404 to step 405 are a process of beautifying the face image area.
  • the face image area can be beautified by other means.
  • the specific beautification mode is not limited in the embodiment of the present invention.
  • the face detail image is merged with the beautified face mask image, and the calculation formula is:
  • FaceArea is the face area obtained in the step
  • the deleted face is the image obtained in step S8
  • Output is the face image area after the beautification, with a rational number between 0 and 1, preferably, in practical applications, can be set
  • step 407 may also be performed, as shown in FIG. 5,
  • the face image area of the current picture is sampled, and the area is scaled, and the scaling calculation formula is:
  • width represents the width of the current picture and height represents the height of the face image area.
  • the manner of sampling in this step is direct downsampling of the image or using bilinear interpolation, or other means, which is not limited herein.
  • the face image area of the current picture is normalized, so that the complexity of the algorithm can be controlled so that it does not become larger because the resolution of the image becomes larger. Thereby, the amount of calculation is reduced, so that the face beautification in the instant video can be realized on the mobile terminal, thereby improving the efficiency of the face beautification.
  • step 408 may also be performed, as shown in FIG.
  • a histogram equalization process is performed on the grayscale image of the face image region, the histogram equalization process is acquired, and the histogram equalization data is stored.
  • the face beautification method in the instant video provided by the embodiment of the present invention, by scaling the face image in the instant video, the amount of data processing in the face beautification process is reduced, and the complexity of the algorithm is controlled, not only
  • the hardware of the mobile terminal can meet the hardware requirements of the face beautification, and also avoids a large occupation of the processing resources and storage resources of the device in the face beautification process, thereby improving the user experience.
  • the embodiment of the invention provides a method for facializing the face in the instant video, which realizes the facial effect beautification in the instant video on the mobile terminal, thereby increasing the user experience; and simultaneously performing the grayscale image of the face image region.
  • the histogram equalization processing improves the reliability of the face beautification on the mobile terminal, and improves the efficiency of the face beautification on the mobile terminal by controlling the complexity of the algorithm.
  • An embodiment of the present invention provides an electronic device 7.
  • the electronic device 7 includes:
  • An obtaining module 71 configured to acquire a face image area from a current picture of the instant video
  • the beautification module 72 is configured to beautify the face image area to obtain the beautified face image area;
  • the fusion module 73 fuses the beautified face image area and the face image area to generate a merged face image area;
  • the display module 74 is configured to display a current picture including at least the merged face image area
  • the storage module 75 is configured to store a face image area, a beautified face image area, and a merged face image area.
  • the obtaining module 71 is specifically configured to:
  • the storage module is also used to store grayscale images.
  • the electronic device 7 further includes:
  • the compression module is configured to compress the current picture, and after the compression is completed, trigger the acquiring module to perform the step of acquiring the gray image of the face image area in the current picture.
  • the electronic device 7 further includes:
  • the processing module is configured to perform histogram equalization processing on the grayscale image of the face image region.
  • the compression module is further configured to scale the face image area, and the obtaining module is further configured to acquire coordinates of the face image area in the uncompressed current picture;
  • the storage module is also used to store coordinates.
  • the electronic device 7 further includes a detecting module for detecting face details in the grayscale image
  • the electronic device 7 further includes a separation module for separating the face in the grayscale image into a face detail image and a face mask image, wherein the face detail image includes at least an eye, a mouth and a nose, and the face mask image includes an eye removal a face part other than the mouth and nose;
  • the beautification module 72 is used to beautify the face mask image and obtain the beautified face mask image.
  • the beautification module is specifically used to:
  • the fusion module 73 is configured to fuse the low-pass filtered image, the face mask image, and the high-pass filtered image to obtain the beautified face mask image.
  • the fusion module 73 is configured to:
  • the face detail image is merged with the beautified face mask image to obtain a beautified face image area.
  • the embodiment of the invention provides an electronic device, which enhances the user experience by realizing face beautification in the instant video on the mobile terminal.
  • the electronic device 8 includes a video input module 81 , a video output module 82 , a sending module 83 , a receiving module 84 , a memory 85 , and a video input module and a video output respectively.
  • the beautified face image area and the face image area are merged to generate a merged face image area, and the current picture including at least the merged face image area is displayed.
  • processor 86 is further configured to call the program code stored in the memory 85, and perform the following operations:
  • the face image area in the current picture is acquired from the gray image according to the face frame size, the face pixel distance, and the search zoom factor.
  • processor 86 is further configured to call the program code stored in the memory 85, and perform the following operations:
  • the current picture is compressed, and after the compression is completed, a step of acquiring a grayscale image of the face image area in the current picture is performed.
  • processor 86 is further configured to call the program code stored in the memory 85, and perform the following operations:
  • a histogram equalization process is performed on the grayscale image of the face image region.
  • the processor is further configured to call the program code stored in the memory, and perform the following operations:
  • the face image area is scaled to obtain the coordinates of the face image area in the uncompressed current picture.
  • processor 86 is further configured to call the program code stored in the memory 85, and perform the following operations:
  • the face detail image includes at least an eye, a mouth, and a nose
  • the face mask image includes a person other than at least including the eyes, the mouth, and the nose.
  • processor 86 is further configured to call the program code stored in the memory 85, and perform the following operations:
  • a low-pass filtered image, a face mask image, and a high-pass filtered image are combined to obtain a beautified face mask image.
  • processor 86 is further configured to call the program code stored in the memory 85, and perform the following operations:
  • the face detail image is merged with the beautified face mask image to obtain a beautified face image area.
  • the embodiment of the invention provides an electronic device, which enhances the user experience by realizing face beautification in the instant video on the mobile terminal.
  • a facial landscaping system in an instant video provided by an embodiment of the present invention, the system comprising:
  • the first communication terminal is configured to acquire an instant video, and the first communication terminal includes at least a video input module.
  • Obtaining a device configured to obtain a face image area from a current picture of the instant video
  • a fusion device configured to fuse the beautified face image area and the face image area to generate a merged face image area
  • the second communication terminal includes at least a display module, configured to display a current picture including at least the merged face image area;
  • the storage device is configured to store a face image area, a beautified face image area, and a merged face image area.
  • the acquiring device, the beautifying device, the beautifying device, and the storage device may be separate devices, or may be integrated into other devices, which are not limited in the embodiment of the present invention.
  • the embodiment of the invention provides a face beautification system in real-time video, which achieves the user's experience effect by realizing the face beautification in the instant video on the mobile terminal.
  • the device and the device for detecting the location of the terminal provided by the foregoing embodiment are only illustrated by the division of the foregoing functional modules when detecting the location of the terminal. In actual applications, the functions may be allocated differently according to requirements.
  • the function module is completed, that is, the internal structure of the device and the device are divided into different functional modules to complete all or part of the functions described above.
  • the device and the device for detecting the location of the terminal provided by the foregoing embodiment are the same as the method for detecting the location of the terminal. For the specific implementation process, refer to the method embodiment, and details are not described herein again.
  • a person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium.
  • the storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

La présente invention concerne un procédé d'embellissement de visage dans une vidéo en temps réel et un équipement électronique, qui appartiennent au domaine du traitement d'image. Le procédé comprend les étapes consistant à : acquérir une région d'image de visage à partir d'une image courante d'une vidéo en temps réel ; embellir la région d'image de visage pour acquérir une région d'image de visage embellie ; intégrer la région d'image de visage embellie dans la région d'image de visage pour générer une région d'image de visage intégrée, et afficher l'image courante en y incluant au moins la région d'image de visage intégrée. En embellissant un visage dans une vidéo en temps réel et en intégrant la région de visage embellie dans la région de visage précédente, on améliore la qualité d'image de la vidéo en temps réel et on améliore également l'expérience d'utilisation.
PCT/CN2015/098355 2014-12-24 2015-12-23 Procédé d'embellissement de visage dans une vidéo en temps réel et équipement électronique Ceased WO2016101883A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410840316.1A CN104574306A (zh) 2014-12-24 2014-12-24 一种即时视频中的人脸美化方法和电子设备
CN201410840316.1 2014-12-24

Publications (1)

Publication Number Publication Date
WO2016101883A1 true WO2016101883A1 (fr) 2016-06-30

Family

ID=53090287

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/098355 Ceased WO2016101883A1 (fr) 2014-12-24 2015-12-23 Procédé d'embellissement de visage dans une vidéo en temps réel et équipement électronique

Country Status (2)

Country Link
CN (1) CN104574306A (fr)
WO (1) WO2016101883A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107424130A (zh) * 2017-07-10 2017-12-01 北京小米移动软件有限公司 图片美颜方法和装置
CN111932442A (zh) * 2020-07-15 2020-11-13 厦门真景科技有限公司 一种基于人脸识别技术的视频美颜方法、装置、设备及计算机可读存储介质
CN112686818A (zh) * 2020-12-29 2021-04-20 维沃移动通信有限公司 人脸图像处理方法、装置及电子设备
CN113177526A (zh) * 2021-05-27 2021-07-27 中国平安人寿保险股份有限公司 基于人脸识别的图像处理方法、装置、设备及存储介质
US11210086B2 (en) 2014-07-18 2021-12-28 Ab Initio Technology Llc Managing parameter sets

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104574306A (zh) * 2014-12-24 2015-04-29 掌赢信息科技（上海）有限公司 一种即时视频中的人脸美化方法和电子设备
CN104469253A (zh) * 2015-01-05 2015-03-25 掌赢信息科技（上海）有限公司 一种即时视频中的人脸美化方法和电子设备
CN104915981A (zh) * 2015-05-08 2015-09-16 寇懿 基于体感传感器的三维立体发型设计方法
CN106170069A (zh) * 2015-05-21 2016-11-30 华硕电脑股份有限公司 电子装置及非瞬时计算机可读取记录媒体
CN105007446A (zh) * 2015-06-18 2015-10-28 美国掌赢信息科技有限公司 一种即时视频的显示方法和电子设备
CN104952036B (zh) * 2015-06-18 2018-11-06 福州瑞芯微电子股份有限公司 一种即时视频中的人脸美化方法和电子设备
CN106920212A (zh) * 2015-12-24 2017-07-04 掌赢信息科技（上海）有限公司 一种发送风格化视频的方法及电子设备
CN105631417B (zh) * 2015-12-24 2018-11-09 武汉鸿瑞达信息技术有限公司 应用于互联网视频直播的视频美化系统及方法
CN106920208A (zh) * 2015-12-24 2017-07-04 掌赢信息科技（上海）有限公司 一种基于图像处理的人脸风格化方法及电子设备
CN106921840B (zh) * 2015-12-25 2020-01-07 掌赢信息科技（上海）有限公司 一种即时视频中的人脸美化方法、设备及系统
CN106028138A (zh) * 2016-07-22 2016-10-12 乐视控股（北京）有限公司 一种直播视频的处理方法及装置
CN106231367B (zh) * 2016-09-23 2020-03-06 广州华多网络科技有限公司 美颜处理方法及装置
CN106341672A (zh) * 2016-09-30 2017-01-18 乐视控股（北京）有限公司 图像处理方法、装置以及终端
CN106612396B (zh) * 2016-11-15 2020-06-16 努比亚技术有限公司 一种拍照装置、终端及方法
CN106971165B (zh) * 2017-03-29 2018-08-10 武汉斗鱼网络科技有限公司 一种滤镜的实现方法及装置
CN107045714A (zh) * 2017-05-11 2017-08-15 杭州知聊信息技术有限公司 一种用于实时视频通信的人脸美化算法
CN107392110A (zh) * 2017-06-27 2017-11-24 五邑大学 基于互联网的人脸美化系统
CN108564633B (zh) * 2018-01-05 2022-03-22 珠海市杰理科技股份有限公司 灰度图像压缩方法、装置及计算机设备
CN108537155B (zh) * 2018-03-29 2021-01-26 Oppo广东移动通信有限公司 图像处理方法、装置、电子设备及计算机可读存储介质
CN108762829B (zh) * 2018-05-03 2021-07-09 北京奇虎科技有限公司 一种用于图像美化的方法、客户端及终端
JP2020136738A (ja) * 2019-02-13 2020-08-31 シャープ株式会社 画像処理装置、画像通信システムおよび画像処理方法
CN111028180B (zh) * 2019-12-23 2021-11-09 腾讯科技（深圳）有限公司 图像处理方法、视频处理方法以及对应的装置
CN111131744B (zh) * 2019-12-26 2021-04-20 杭州当虹科技股份有限公司 一种基于视频通讯隐私保护的方法
CN112533024A (zh) * 2020-11-26 2021-03-19 北京达佳互联信息技术有限公司 一种人脸视频处理方法、装置及存储介质
CN113763286A (zh) * 2021-09-27 2021-12-07 北京市商汤科技开发有限公司 图像处理方法及装置、电子设备和存储介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060115172A1 (en) * 2004-11-30 2006-06-01 Qian Lin Face enhancement in a digital video
US20070041640A1 (en) * 2003-03-20 2007-02-22 Omron Corporation Image processing device
CN101299267A (zh) * 2008-07-02 2008-11-05 北京中星微电子有限公司 一种人脸图像处理方法及装置
CN101916370A (zh) * 2010-08-31 2010-12-15 上海交通大学 人脸检测中非特征区域图像处理的方法
CN103927719A (zh) * 2014-04-04 2014-07-16 北京金山网络科技有限公司 图片处理方法及装置
CN104318262A (zh) * 2014-09-12 2015-01-28 上海明穆电子科技有限公司 通过人脸照片更换皮肤的方法及系统
CN104574306A (zh) * 2014-12-24 2015-04-29 掌赢信息科技（上海）有限公司 一种即时视频中的人脸美化方法和电子设备
CN104853134A (zh) * 2014-02-13 2015-08-19 腾讯科技（深圳）有限公司 一种视频通信方法及装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070041640A1 (en) * 2003-03-20 2007-02-22 Omron Corporation Image processing device
US20060115172A1 (en) * 2004-11-30 2006-06-01 Qian Lin Face enhancement in a digital video
CN101299267A (zh) * 2008-07-02 2008-11-05 北京中星微电子有限公司 一种人脸图像处理方法及装置
CN101916370A (zh) * 2010-08-31 2010-12-15 上海交通大学 人脸检测中非特征区域图像处理的方法
CN104853134A (zh) * 2014-02-13 2015-08-19 腾讯科技（深圳）有限公司 一种视频通信方法及装置
CN103927719A (zh) * 2014-04-04 2014-07-16 北京金山网络科技有限公司 图片处理方法及装置
CN104318262A (zh) * 2014-09-12 2015-01-28 上海明穆电子科技有限公司 通过人脸照片更换皮肤的方法及系统
CN104574306A (zh) * 2014-12-24 2015-04-29 掌赢信息科技（上海）有限公司 一种即时视频中的人脸美化方法和电子设备

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11210086B2 (en) 2014-07-18 2021-12-28 Ab Initio Technology Llc Managing parameter sets
CN107424130A (zh) * 2017-07-10 2017-12-01 北京小米移动软件有限公司 图片美颜方法和装置
CN111932442A (zh) * 2020-07-15 2020-11-13 厦门真景科技有限公司 一种基于人脸识别技术的视频美颜方法、装置、设备及计算机可读存储介质
CN112686818A (zh) * 2020-12-29 2021-04-20 维沃移动通信有限公司 人脸图像处理方法、装置及电子设备
CN113177526A (zh) * 2021-05-27 2021-07-27 中国平安人寿保险股份有限公司 基于人脸识别的图像处理方法、装置、设备及存储介质
CN113177526B (zh) * 2021-05-27 2023-10-03 中国平安人寿保险股份有限公司 基于人脸识别的图像处理方法、装置、设备及存储介质

Also Published As

Publication number Publication date
CN104574306A (zh) 2015-04-29

Similar Documents

Publication Publication Date Title
WO2016101883A1 (fr) Procédé d'embellissement de visage dans une vidéo en temps réel et équipement électronique
CN111669493B (zh) 一种拍摄方法、装置与设备
US10580140B2 (en) Method and system of real-time image segmentation for image processing
CN112712470B (zh) 一种图像增强方法及装置
KR102277048B1 (ko) 미리보기 사진 블러링 방법 및 장치 및 저장 매체
EP2889832B1 (fr) Appareil et procédé de traitement d'image
EP3644599B1 (fr) Procédé et appareil de traitement vidéo, dispositif électronique et support de stockage
US20110148868A1 (en) Apparatus and method for reconstructing three-dimensional face avatar through stereo vision and face detection
CN105049718A (zh) 一种图像处理方法及终端
US10440284B2 (en) Determination of exposure time for an image frame
US9342751B2 (en) User hand detecting device for detecting user's hand region and method thereof
CN108111749A (zh) 图像处理方法和装置
CN107742274A (zh) 图像处理方法、装置、计算机可读存储介质和电子设备
WO2016110188A1 (fr) Procédé et dispositif électronique permettant d'améliorer l'esthétique d'un visage dans une vidéo en temps réel
CN106683100A (zh) 一种图像分割去雾方法及终端
US20180314916A1 (en) Object detection with adaptive channel features
CN107690804B (zh) 一种图像处理方法及用户终端
CN110062157B (zh) 渲染图像的方法、装置、电子设备和计算机可读存储介质
KR20190096748A (ko) 외부 전자 장치를 이용한 이미지 보정 방법 및 전자 장치
CN115471413A (zh) 图像处理方法及装置、计算机可读存储介质和电子设备
EP4586616A1 (fr) Procédé et appareil de traitement de trame d'image de diffusion en continu en direct, et dispositif, support d'enregistrement lisible et produit
CN106067167A (zh) 图像处理方法及装置
CN112036209A (zh) 一种人像照片处理方法及终端
CN110047126B (zh) 渲染图像的方法、装置、电子设备和计算机可读存储介质
CN109981989B (zh) 渲染图像的方法、装置、电子设备和计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15871951

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 24.10.2017)

122 Ep: pct application non-entry in european phase

Ref document number: 15871951

Country of ref document: EP

Kind code of ref document: A1