RU2636668C2 - Method and device for displaying images - Google Patents

Abstract

FIELD: physics.SUBSTANCE: method contains: converting images in the group of images into halftone images; for each of the images in the group of images, determining the first number and the second number of pixels based on the halftone image corresponding to the original image, wherein the first number, in which each pixel has a brightness of less than the first brightness threshold, and the second number, in which every pixel has a brightness greater than the second brightness threshold, are present in the halftone image corresponding to the original image; defining the first relationship of the first number to the total number of pixels in the halftone image and the second relationship of the second number to the total number; defining a quality parameter of the tone characteristics of images based on the first and the second relationship, and choosing from the group of images, based on the characteristics of the tone quality of images in the group of images, each image that has a quality parameter of the tone characteristics less than the threshold of the tone characteristics to get the first set of images.EFFECT: increasing the speed of image processing.17 cl, 13 dwg

Description

Cross reference to related applications

[0001] This application is based on the patent application of China No. 201510452003.3, registered July 28, 2015, claims its priority and its full content is included in the text of this document by reference to the appropriate source.

Technical field

[0002] The present invention relates generally to the field of terminal technology, and more specifically to a method and apparatus for displaying images.

BACKGROUND OF THE INVENTION

[0003] With the rapid development of terminal technology, more and more terminals, such as mobile phones, tablet computers, computers and the like, are equipped with image display functions. These terminals can display numerous images stored in them. In the prior art, when a terminal displays stored multiple images, the terminal typically displays them as thumbnails in order of the date and time the images were stored. However, when some of the many images are similar to each other, or some of them are of poor quality, the image display effect will be unsatisfactory. Therefore, there is a request for a method for displaying images that provides an improved display effect.

SUMMARY OF THE INVENTION

[0004] In order to solve this problem of the prior art, the present invention provides a method and apparatus for displaying images.

[0005] According to a first aspect of the embodiments of the present invention, there is provided a method for displaying images, comprising:

[0006] upon receipt of a command to open an album, clustering similar images in an album to obtain a plurality of image groups;

[0007] selecting an image from each image group as a representative image of the image group; and

[0008] reproducing representative images of image groups.

[0009] In an embodiment of the present invention, when a terminal receives a command to open an album, the terminal clusters similar images in the album to obtain a plurality of image groups; the terminal selects an image from each image group as a representative image of the image group having the best image quality; and the terminal displays representative images of image groups that have the best image quality. Thus, the display effect of representative images of image groups can be improved.

[0010] In connection with the first aspect, in a first possible implementation of the first aspect described above, selecting an image from each image group as a representative image of the image group includes:

[0011] selecting, based on the quality parameters of the tonal characteristics of the images in the group of images from the group of images of each image, which has a quality parameter of the tonal characteristics less than the threshold of the tonal characteristics to obtain a first set of images.

[0012] In an embodiment of the present invention, the terminal may select based on the quality parameters of the tonal characteristics of the images in the group of images from the group of image images with better tonal qualities. Thus, it is possible to avoid displaying the first set of images as having too dark images or images with overexposure, thereby improving the image display effect.

[0013] In connection with a first possible implementation of the first aspect, in a second possible implementation of the first aspect described above, the method further includes:

[0014] selecting, based on the angles of rotation of the face in the images in the first set of images from the first set of images of each image, which has an angle of rotation of the face within a given range of angles, to obtain a second set of images.

[0015] In an embodiment of the present invention, based on the angles of rotation of the face in the images in the first set of images, the terminal may select from the first set of image images the correct face position. Thus, it is possible to avoid displaying in the second set of images that have less correct face positions, but to ensure that images selected to satisfy the visual requirements of the user are displayed, thereby achieving an improvement in the image display effect.

[0016] In connection with a second possible implementation of the first aspect, in a third possible implementation of the first aspect described above, the method further includes:

[0017] based on the characteristics of the eyes in the images in the second set of images, selecting from the second set of images of each image that does not have closed eyes to obtain a third set of images.

[0018] In an embodiment of the present invention, based on the features of the eyes in the images in the second set of images, the terminal may select from the second set of image images without closed eyes. In this way, the display of a third set of images with images that have closed eyes can be avoided, thereby improving the display effect of the selected images.

[0019] In connection with a third possible implementation of the first aspect, in a fourth possible implementation of the first aspect described above, the method further includes:

[0020] a selection based on the sharpness of the face in the images in the third set of images from the third set of images of each image that has a face sharpness equal to or greater than the specified sharpness to obtain a representative image of a group of images.

[0021] In an embodiment of the present invention, based on the sharpness of the face in the images in the third set of images, the terminal can select from the third set of images images with better face sharpness, thereby improving the sharpness of the representative images that will be displayed.

[0022] In connection with the first possible implementation of the first aspect, in the fifth possible implementation of the first aspect described above, before selecting, based on the image tonal quality characteristics of the images in the image group, each image that has the tone quality parameter less than the tone characteristic threshold so that get the first set of images, the method further includes:

[0023] converting the images in the group of images into grayscale images;

[0024] for each of the images in the image group, determining a first number and a second number of pixels based on a grayscale image corresponding to the original image, the first number in which each pixel has a brightness level lower than the first brightness threshold and a second number in which each pixel has a brightness level greater than the second brightness threshold, are present in the grayscale image corresponding to the original image;

[0025] determining a first ratio of the first number to the total number of pixels in the grayscale image and a second ratio of the second number to the total number; and

[0026] determining a quality parameter of the tonal characteristic of the image based on the first ratio and the second ratio.

[0027] In an embodiment of the present invention, the terminal may select images with better tonal characteristics from a group of images based on the quality parameters of the tonal characteristics, determining the quality parameters of the tonal characteristics of the images. In this way, it is possible to avoid displaying a first set of images having images that are too dark or overexposed, thereby achieving an improvement in the image display effect.

[0028] In connection with the second possible implementation of the first aspect, in the sixth possible implementation of the first aspect described above, before selecting based on the angles of rotation of the faces in the images in the first set of images, selecting from the first set of images of each image that has an angle of rotation of the face within a given range of angles, to obtain a second set of images, the method further includes:

[0029] obtaining characteristic points of the face in the images in the first sets of images;

[0030] for each of the images in the first sets of images, selecting from the image a first characteristic point and a second characteristic point, the first characteristic point and the second characteristic point being characteristic points that are mirror symmetrical about the nose;

[0031] determining a first distance between a first characteristic point and a predetermined characteristic point and a second distance between a second characteristic point and a predetermined characteristic point; and

[0032] determining the angle of rotation of the face in the image based on the first distance and the second distance.

[0033] In an embodiment of the present invention, the terminal may select images with the correct face position from the first set of images by determining the angles of rotation of the face in the images. Thus, it is possible to avoid displaying in the second set of images that have less correct face positions, but having in the second set of images satisfying the visual requirements of the user, thereby achieving an improvement in the image display effect.

[0034] In connection with the fourth possible implementation of the first aspect, in the seventh possible implementation of the first aspect described above, before choosing based on the sharpness of the face on the images in the third set of images, from the third set of images of each image that has a face sharpness equal to or greater than the specified sharpness to obtain a representative image of a group of images, the method further includes:

[0035] for each of the images in the third image set, obtaining a brightness value of each individual pixel contained in the face region of the image;

[0036] based on the brightness value of each individual pixel, determining a value of the total gradient of the face region; and

[0037] determining the value of the total gradient as an estimate of the sharpness of the face in the image.

[0038] In an embodiment of the present invention, the terminal may select from a third set of image images with better face sharpness, determining the sharpness of the face in the images, thereby improving the sharpness of the representative images to be displayed.

[0039] In connection with the first aspect in an eighth possible implementation of the first aspect described above, reproducing representative images of image groups includes:

[0040] rotation and alignment of representative images of image groups so that the orientations of the faces on the representative images are the same;

[0041] adjusting the sizes of the aligned representative images of the image groups so that the sizes of the areas of the face in the adjusted representative images are the same; and

[0042] reproducing tuned representative images in a predetermined dynamic manner.

[0043] In an embodiment of the present invention, the terminal rotates and aligns representative images of image groups and displays the adjusted representative images in a predetermined dynamic manner. In this way, display methods can be enriched and the display effect of representative images can be improved.

[0044] In connection with the eighth possible implementation of the first aspect, in the ninth possible implementation of the first aspect described above, when there is more than one representative image for a group of images, randomly selecting one or two representative images for display.

[0045] In an embodiment of the present invention, when there is more than one representative image for a group of images, the terminal randomly selects one or two representative images for display. Thus, the problem of monotonous viewing of displays of multiple representative images can be avoided.

[0046] According to a second aspect of the embodiments of the present invention, there is provided a device for displaying images, comprising:

[0047] a clustering module configured to, when a command to open an album is received, cluster similar images in an album to obtain a plurality of image groups;

[0048] a selection module configured to select an image from each image group as a representative image of the image group; and

[0049] a display module configured to display representative images of image groups.

[0050] In connection with the second aspect, in a first possible implementation of the second aspect described above, the selection module comprises:

[0051] a first selection unit, configured so that for each of the image groups based on the image quality characteristics of the image in the image group, select each image from the image group that has the image quality parameter less than the tone characteristic threshold to obtain a first image set .

[0052] In connection with the first possible implementation of the second aspect, in the second possible implementation of the second aspect, the selection module comprises:

[0053] a second selection unit, configured so as to obtain a second set of images based on the angles of rotation of the faces in the images in the first set of images, to select from the first set of images each image that has an angle of rotation of the face within a given range of angles.

[0054] In connection with a second possible implementation of the second aspect, in a third possible implementation of the second aspect described above, the selection module further comprises:

[0055] a third selection unit, configured to select, from the second set of images, each image that does not have closed eyes, based on the features of the eyes in the images in the second set of images, to obtain a third set of images.

[0056] In connection with a third possible implementation of the second aspect, in a fourth possible implementation of the second aspect described above, the selection module further comprises:

[0057] a fourth selection unit, configured to select images from a third set of images, each image that has a face sharpness equal to or greater than a specified sharpness, based on the sharpness of the face on the images in the third set, to obtain a representative image of the group of images.

[0058] In connection with a first possible implementation of the second aspect, in a fifth possible implementation of the second aspect described above, the selection module further comprises:

[0059] a conversion unit configured to convert images in a group of images into grayscale images;

[0060] a first determining unit configured to determine for each of the images in the image group a first number and a second number of pixels based on a grayscale image corresponding to the original image, the first number in which each pixel has a brightness level less than the first threshold brightness, and a second number in which each pixel has a brightness level greater than the second brightness threshold is present in a grayscale image corresponding to the original image;

[0061] a second determination unit configured to determine a first ratio of the first number to the total number of pixels in the grayscale image and a second ratio of the second number to the total number; and

[0062] a third determination unit, configured to determine a tone quality parameter of an image based on the first ratio and the second ratio.

[0063] In connection with the second possible implementation of the second aspect in the sixth possible implementation of the above-described second aspect, the selection module further comprises:

[0064] a first acquisition unit, configured to receive facial characteristic points on images in the first sets of images;

[0065] a fifth selection unit, configured to select, for each of the images in the first sets of images, the first characteristic point and the second characteristic point from the image, the first characteristic point and the second characteristic point being characteristic points that are mirror symmetrical about the nose;

[0066] a fourth determination unit configured to determine a first distance between a first characteristic point and a predetermined characteristic point and a second distance between a second characteristic point and a predetermined characteristic point; and

[0067] a fifth determining unit, configured to determine an angle of rotation of a face in an image based on a first distance and a second distance.

[0068] In connection with the fourth possible implementation of the second aspect in the seventh possible implementation of the above second aspect, the selection module further comprises:

[0069] a second acquisition unit, configured to receive, for each of the images in the third image set, the brightness value of each individual pixel contained in the face region of the image;

[0070] a sixth determination unit, configured to determine, based on the brightness value of each individual pixel, the value of the total gradient of the face region; and

[0071] the seventh determination unit, configured to determine the value of the total gradient as an estimate of the sharpness of the face in the image.

[0072] In connection with the second aspect, in an eighth possible implementation of the above second aspect, the display module comprises:

[0073] a rotation unit configured to rotate and align representative images of image groups so that the orientations of faces on the representative images are the same;

[0074] a tuning unit configured to adjust the sizes of the aligned representative images of the image groups so that the sizes of the areas of the face in the adjusted representative images are the same; and

[0075] a display unit configured to reproduce adjusted representative images in a predetermined dynamic manner.

[0076] In connection with the eighth possible implementation of the second aspect, in the ninth possible implementation of the second aspect described above, when there is more than one representative image for a group of images, one or two representative images are randomly selected for display.

[0077] according to a third aspect of the embodiments of the present invention, there is provided an image display apparatus comprising:

[0078] a processor; and

[0079] a storage device for storing instructions executed by the processor;

[0080] wherein the processor is configured to perform: [0081] upon receipt of a command to open an album, clustering

similar images in the album to get many groups

Images

[0082] selecting an image from each image group as a representative image of the image group; and

[0083] reproducing representative images of image groups.

[0084] A technical solution according to embodiments of the present invention may have the following beneficial effects. When the terminal receives a command to open an album, the terminal clusters similar images in the album to obtain a plurality of image groups; the terminal selects an image from each image group as a representative image of the image group having the best image quality; and the terminal displays representative images of image groups that have the best image quality. Thus, the display effect of representative images of image groups can be improved.

[0085] It should be understood that both the foregoing general description and the following detailed description are provided by way of example only and are for explanation only and do not limit the claimed invention.

Brief Description of the Drawings

[0086] The accompanying drawings, which are incorporated in and constitute a part of this specification, explain embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0087] FIG. 1 is a flowchart illustrating an image display method according to an embodiment.

[0088] FIG. 2 is a flowchart illustrating another method for displaying images according to an embodiment.

[0089] FIG. 3 is a diagram illustrating a distribution of characteristic points of a face according to an embodiment.

[0090] FIG. 4 is a block diagram of an image display apparatus according to an embodiment.

[0091] FIG. 5 shows a block diagram of a first selection module according to an embodiment.

[0092] FIG. 6 is a block diagram of a second selection module according to an embodiment.

[0093] FIG. 7 is a block diagram of a third selection module according to an embodiment.

[0094] FIG. 8 is a block diagram of a fourth selection module according to an embodiment.

[0095] FIG. 9 is a block diagram of a fifth selection module according to an embodiment.

[0096] FIG. 10 is a block diagram of a sixth selection module according to an embodiment.

[0097] FIG. 11 is a block diagram of a seventh selection module according to an embodiment.

[0098] FIG. 12 is a block diagram of a display module according to an embodiment.

[0099] FIG. 13 is a block diagram of another device for displaying images according to an embodiment.

Detailed description

[00100] Detailed references will be made below to exemplary embodiments that are shown in the accompanying drawings. The following description refers to the accompanying drawings, in which the same reference numbers in different drawings represent the same or similar elements, unless otherwise indicated. The implementations described in the following description of embodiments do not represent all implementations corresponding to this invention. On the contrary, they are merely examples of devices and methods corresponding to aspects related to the invention, as described in the attached claims.

[00101] In FIG. 1 is a flowchart illustrating a method for displaying images according to an embodiment. As shown in FIG. 1, the method is applied in the terminal and includes the following steps.

[00102] In step 101, when the command to open the album is received, similar images are clustered in the album to obtain a plurality of image groups.

[00103] In step 102, an image is selected from each image group as a representative image of the image group.

[00104] In step 103, representative images of image groups are displayed.

[00105] In an embodiment of the present invention, when a terminal receives a command to open an album, the terminal clusters similar images in the album to obtain a plurality of image groups; the terminal selects from each group of images, as a representative image of the group of images, an image having the best image quality; and the terminal displays representative images of image groups that have the best image quality. Thus, the display effect of representative images of image groups can be improved.

[00106] In another embodiment of the present invention, selecting an image from each image group as a representative image of the image group includes:

[00107] selecting, based on the tone quality parameters of the images in the image group from the image group, each image that has the tone quality parameter less than the tone characteristic threshold to obtain a first set of images.

[00108] In an embodiment of the present invention, based on the quality parameters of the tonal characteristics of the images in the image group, the terminal may select from the group of image images images with better tonal characteristics. Thus, he can avoid displaying the first set of images having images that are too dark or overexposed, thereby achieving an improvement in the image display effect.

[00109] In another embodiment of the present invention, the method also includes:

[00110] a selection based on the angles of rotation of the faces in the images in the first set of images from the first set of images of each image that has an angle of rotation of the face within a given range of angles to obtain a second set of images.

[00111] In an embodiment of the present invention, based on the angles of rotation of the face in the images in the first set of images, the terminal can select from the first set of image images the correct face position. Thus, it is possible to avoid displaying in the second set of images having less correct face positions, but to have images selected to satisfy the user's visual requirements, thereby achieving an improvement in the image display effect.

[00112] In another embodiment of the present invention, the method also includes:

[00113] based on the characteristics of the eyes in the images in the second set of images, selecting from the second set of images of each image that does not have closed eyes to obtain a third set of images.

[00114] In an embodiment of the present invention, based on the characteristics of the eyes in the images in the second image set, the terminal may select from the second set of image images without closed eyes. Thus, displaying images having closed eyes in the third set of images can be avoided, thereby improving the display effect of the selected images.

[00115] In another embodiment of the present invention, the method also includes:

[00116] selecting based on the sharpness of the face in the images in the third set of images from the third set of images of each image that has a face sharpness equal to or greater than the specified sharpness to obtain a representative image of a group of images.

[00117] In an embodiment of the present invention, based on the sharpness of the face in the images in the third set of images, the terminal can select from the third set of images images with better face sharpness, thereby improving the sharpness of the representative images to be displayed.

[00118] In another embodiment of the present invention, before selecting based on the tone quality parameters of the images in the image group of the image group of each image that has the tone quality parameter less than the tone characteristic threshold, to obtain a first set of images, the method also includes:

[00119] converting images in a group of images into grayscale images;

[00120] for each of the images in the image group, determining a first number and a second number of pixels based on a grayscale image corresponding to the original image, the first number of pixels in which each pixel has a brightness level less than the first brightness threshold and a second number in wherein each pixel has a brightness level greater than the second brightness threshold, are present in the grayscale image corresponding to the original image;

[00121] determining a first ratio of the first number to the total number of pixels in the grayscale image and a second ratio of the second number to the total number; and

[00122] determining a tonal quality characteristic of an image based on the first ratio and the second ratio.

[00123] In an embodiment of the present invention, based on the quality parameters of the tone characteristic, the terminal may select from the group of image images the best qualities of the tone characteristic, determining the quality parameters of the tone characteristic of the images. In this way, the display of the first set of images having too dark or overexposed images can be avoided, thereby achieving an improvement in the image display effect.

[00124] In another embodiment of the present invention, before selecting from the first set of images based on the angles of rotation of the faces in the images in the first set of images, each image that has an angle of rotation of the face within a given range of angles, to obtain a second set of images, the method also includes:

[00125] obtaining characteristic points of the face in the images in the first sets of images;

[00126] for each of the images in the first sets of images, selecting from the image a first characteristic point and a second characteristic point, the first characteristic point and the second characteristic point being characteristic points that are mirror symmetric about the nose;

[00127] determining a first distance between a first characteristic point and a predetermined characteristic point and a second distance between a second characteristic point and a predetermined characteristic point; and

[00128] determining the angle of rotation of the face in the image based on the first distance and the second distance.

[00129] In an embodiment of the present invention, the terminal may select images with the correct face position from the first set of images. Determining the rotation angles of the face in the images. Thus, it is possible to avoid displaying in the second set of images that have less correct face positions, but having in the second set of images satisfying the visual requirements of the user, thereby achieving an improvement in the image display effect.

[00130] In another embodiment of the present invention, before selecting, based on the sharpness of the face on the images in the third set of images, from a third set of images of each image that has a face sharpness equal to or greater than the specified sharpness to obtain a representative image of a group of images, the method also includes:

[00131] for each of the images in the third image set, obtaining a brightness value of each individual pixel contained in the face region of the image;

[00132] based on the brightness value of each individual pixel, determining a value of the total gradient of the face region; and

[00133] determining the value of the total gradient as an estimate of the sharpness of the face in the image.

[00134] In an embodiment of the present invention, the terminal can select from a third set of images images with better face sharpness, determining the sharpness of the face in the images, thereby improving the sharpness of the representative images to be displayed.

[00135] In another embodiment of the present invention, reproducing representative images of image groups includes:

[00136] rotating and aligning representative images of image groups so that the orientations of the faces on the representative images are the same;

[00137] adjusting the sizes of aligned representative images of the image groups so that the sizes of areas of the face in the adjusted representative images are the same; and

[00138] playing tuned representative images in a predetermined dynamic manner.

[00139] In an embodiment of the present invention, the terminal rotates and aligns representative images of image groups and displays the adjusted representative images in a predetermined dynamic manner. In this way, display methods can be enriched and the display effect of representative images can be improved.

[00140] In another embodiment of the present invention, when there is more than one representative image for a group of images, one or two representative images are randomly selected for display.

[00141] In an embodiment of the present invention, when there is more than one representative image for a group of images, the terminal randomly selects one or two representative images for display. Thus, the problem of monotonous viewing of displays of multiple representative images can be avoided.

[00142] the Additional technical solutions described above can be combined in any way to form additional forms of implementation of the present invention, which hereinafter will not be repeated one after another.

[00143] In FIG. 2 is a flowchart illustrating a method for displaying images according to an embodiment. As shown in FIG. 2, the method is applied in the terminal and includes the following steps.

[00144] In step 201, when the command to open the album is received, similar images are clustered in the album to obtain a plurality of image groups.

[00145] When the terminal receives the command to open the album, the terminal clusters all the images in the album into image groups. That is, the terminal collects a plurality of similar or identical images in an album into one group to obtain a plurality of groups from an album, i.e., a plurality of image groups.

[00146] It should be noted that the album opening command is configured to open the album, and the album opening command can be started by the user. A user may invoke a command of a given operation, such as a mouse click operation, a sliding operation, a sound operation, or the like. This is not specifically limited by the embodiment of the present invention.

[00147] In addition, terminal clustering of all images in an album into image groups can be implemented in particular by a technology such as similarity clustering, which will not be described in detail in the embodiment of the present invention.

[00148] In step 202, for images in each of the image groups, the terminal selects, based on the tone quality parameters of the plurality of images in the image group from the image group, each image that has a tone quality parameter less than the tone characteristic threshold to obtain a first set of images.

[00149] Since among the plurality of images included in the image group, there may be images with a darker or lighter tone characteristic, that is, among the plurality of images included in the image group, there may be too dark or overexposed images to select images with the best quality of the tone characteristic from the group of images, the terminal can select from the group of images based on the quality parameters of the tone characteristic of many images in the group of images Nij each image that has a tone quality parameter less than the threshold characteristics of tone characteristic to obtain a first set of images.

[00150] It should be noted that the tone characteristic threshold can be set in advance, and the tone characteristic threshold is greater than 0 and less than 1. For example, the tone characteristic threshold may be 0.8, 0.9, and so on. This is not specifically limited by the embodiment of the present invention.

[00151] For example, a group of images contains 5 images, respectively, Image 1, Image 2, Image 3, Image 4 and Image 5. Image 1 has a tone quality parameter of 0.26; Image 2 has a tone quality parameter of 0.4; Image 3 has a tone quality parameter of 0.7; Image 4 has a tone quality parameter of 0.3; Image 5 has a tone quality parameter of 0.9; and the tone characteristic threshold is 0.8. In this case, based on the quality parameters of the tone characteristic of a plurality of images in the image group, the terminal selects Image 1, Image 2, Image 3, and Image 4 from the group of images, each of which has a tone characteristic quality parameter less than the tone characteristic threshold of 0.8, and then the terminal decides that the images in the group of images that satisfy the tone quality parameter are Image 1, Image 2, Image 3, and Image 4 to obtain the first set of images.

[00152] Further, before the terminal, based on the tone quality parameters of the plurality of images in the image group, selects from the image group each image that has the tone quality parameter less than the tone characteristic threshold to obtain the first set of images, the terminal can also determine quality parameters of the tone characteristic of a plurality of images in a group of images. Determining the quality parameters of the tonal characteristic of a plurality of images in an image group may include: converting the images in the image group into grayscale images; for each of the images in the image group, the terminal determines the first number and the second number based on the grayscale image corresponding to the original image, the first number of pixels in which each pixel has a brightness level lower than the first brightness threshold and the second number in which each the pixel has a brightness level greater than the second brightness threshold, are present in the grayscale image corresponding to the original image; determining by the terminal the first ratio of the first number to the total number of pixels in the grayscale image and the second ratio of the second number to the total number; and determining, by the terminal, a quality parameter of a tonal image characteristic based on the first ratio and the second ratio.

[00153] Moreover, when the terminal determines the quality parameter of the tone characteristic of the image based on the first ratio and the second ratio, the terminal can determine at least one of the first ratio and the second ratio as the quality parameter of the tone characteristic of the image. However, the terminal may also select the maximum value from the first ratio and the second ratio, and determine the selected maximum value as a quality parameter of the tonal image characteristic. This is not specifically limited by the embodiment of the present invention.

[00154] It should be noted that the first brightness threshold and the second brightness threshold can be set in advance, and the second brightness threshold is larger than the first brightness threshold. For example, the first brightness threshold may be 30, and the second brightness threshold may be 200. This is not particularly limited to the embodiment of the present invention.

[00155] For example, the first brightness threshold is 30 and the second brightness threshold is 200. The terminal converts the images in the group of images into grayscale images. For Image 1 from images, the total number of pixels in the grayscale image of Image 1-1000. The terminal from the grayscale image corresponding to the original image 1 determines that the first number is 150 and the second number is 260, wherein in the first number each pixel has a brightness level lower than the first brightness threshold 30, and in the second number each pixel has a brightness level greater than the second brightness threshold of 200. Then the terminal determines that the first ratio of the first number 150 to the total number 1000 is 0.15, and decides that the second ratio of the second number 260 to the total number is 0.26. It is assumed that the terminal determines the maximum value from the first relationship and the second relationship as a quality parameter of the tonal image characteristic. Since the first ratio is less than the second ratio, the terminal can determine the second ratio of 0.26 as a quality parameter of the tone characteristic of Image 1.

[00156] In an embodiment of the present invention, based on the quality parameters of the tonal characteristics of the images in the image group, the terminal may select from the group of image images images with better tonal qualities. In this way, it is possible to avoid displaying a first set of images having images that are too dark or overexposed, thereby achieving an improvement in the image display effect.

[00157] In step 203, based on the angles of rotation of the face in the images in the first set of images, each image that has an angle of rotation of the face within a given range of angles is selected from the first set of images to obtain a second set of images.

[00158] Since among the images included in the first set of images, there may be images having less correct face positions, and when there are images having less correct face positions, when playing back images, this will adversely affect the image display effect. Whether the position of the face in the image is correct can be determined based on the angle of rotation of the face in the image. Accordingly, in order to select images having the correct face position from the first set of images, the terminal can, based on the angles of rotation of the faces in the images in the first set of images, select each image that has an angle of rotation of the face within a given range of angles from the first set of images to obtain a second set of images.

[00159] For example, Image 1 has a face angle of 5 °; Image 2 has a face angle of 30 °; Image 3 has a face angle of 20 °; Image 4 has a face angle of 60 °; and the set angle range is 0 ~ 45 ° degrees. Then, based on the angles of rotation of the face in the images in the first set of images, the terminal selects Image 1, Image 2 and Image 3, each of which has an angle of rotation of the face within a given range of angles 0 ~ 45 °, from the first set of images to obtain a second set of images.

[00160] Further, before the terminal, based on the angles of rotation of the faces in the images in the first image set, selects each image that has the angle of rotation of the face within a given range of angles from the first set of images to obtain a second set of images, the terminal can determine the angles face rotation on images in the first set of images. The determination of the angles of rotation of the face in the images in the first set of images may include: the terminal receiving the characteristic points of the face in the images in the first sets of images; for each of the images in the first sets of images, the selection from the image of the first characteristic point and the second characteristic point, the first characteristic point and the second characteristic point being characteristic points, mirror symmetrical about the nose; determining a first distance between a first characteristic point and a given characteristic point and a second distance between a second characteristic point and a given characteristic point; and determining the angle of rotation of the face in the image based on the first distance and the second distance.

[00161] Moreover, the specified characteristic points can be one characteristic point or also two characteristic points. When the predetermined characteristic point is one characteristic point, the predetermined characteristic point may be located on the center line of the face in a direction from left to right, that is, in a straight line where the nose is located. For example, as characteristic points of a face in the image shown in FIG. 3, the set characteristic points may be the characteristic point G14 corresponding to the tip of the nose, or the characteristic points B12 and B15 corresponding to the central positions of the lips, or the characteristic point A15 corresponding to the central position of the chin, and so on. When a given characteristic point includes two characteristic points, two characteristic points can be characteristic points that are mirror symmetrical about the nose. For example, the specified characteristic point may be characteristic point C12, corresponding to the central position of the lower half of the left eye, and characteristic point D12, corresponding to the central position of the lower half of the left eye, or may be characteristic point C15, corresponding to the central position of the upper half of the left eye, and a characteristic point D15 corresponding to the central position of the upper half of the right eye, and so on. This is not specifically limited by the embodiment of the present invention. In addition, since the first characteristic point and the second characteristic point are characteristic points that are mirror symmetrical about the nose, for ease of calculation, the first characteristic point and the second characteristic point can be defined as points on the face contour. For example, the first characteristic point is characteristic point A11 in FIG. 3, the second characteristic point is characteristic point A19 in FIG. 3. Also, this is not specifically limited to the embodiment of the present invention.

[00162] When the predetermined characteristic point is one characteristic point, the terminal determining the first distance and the second distance may include: determining by the terminal the distance between the first characteristic point and the specified characteristic point as the first distance, and the distance between the second characteristic point and the specified characteristic point as the second distance .

[00163] When predetermined characteristic points include two characteristic points, for simplicity of description, it is assumed that the first characteristic point is located on the left side of the nose and the second characteristic point is located on the right side of the nose. Then the terminal’s determination of the first distance and the second distance may include: the terminal’s determination of the distance between the given characteristic point on the left side of the nose and the first characteristic point as the first distance, and the distance between the specified characteristic point on the right side of the nose and the second characteristic point as the second distance.

[00164] Furthermore, when the terminal determines the angle of rotation of the face in the image based on the first distance and the second distance, the terminal can divide the first distance by a second distance to obtain a third ratio; based on the third relationship, the terminal can obtain the corresponding angle of rotation of the face from the stored corresponding relationship between the relations and angles of rotation of the face; and determine the obtained angle of rotation of the face as the angle of rotation of the face in the image.

[00165] For example, a given characteristic point is one characteristic point, and it is the characteristic point G14 corresponding to the tip of the nose. The terminal obtains the characteristic points of the face in Image 1 from the first set of images, as shown in FIG. 3; selects the characteristic point A11 on the contour of the left side of the face as the first characteristic point, and selects the characteristic point A19 on the contour of the right side of the face as the second characteristic point from the characteristic points of the face in Image 1. The first characteristic point A11 and the second characteristic point A19 are mirror symmetric relative to the nose. Then, the terminal determines that the first distance between the first characteristic point A11 and the predetermined characteristic point G14 is 36 mm, and determines that the second distance between the second characteristic point A19 and the predetermined characteristic point G14 is 40 mm. The terminal then divides the first distance of 36 mm into the second distance of 40 mm to obtain a third ratio of 0.9. Based on the third ratio of 0.9, the terminal receives the corresponding angle of rotation of the face equal to 5 ° degrees from the corresponding ratio between the relations and angles of rotation of the face, as shown in the table below. 1. The terminal determines the received angle of rotation of the face 5 ° degrees as the angle of rotation of the face in the image.

[00166] It should be noted that in the form of implementation of the present invention, the above table. 1 is only an example to illustrate the corresponding relationship between ratios and angles of rotation of the face, and table. 1 is not a limitation on the embodiment of the present invention.

[00167] In addition, when the terminal receives facial features on the images in the first image set, the terminal can receive facial features on the images using the Sparse Deforming Model (SDM) algorithm. However, in practical applications, the terminal can also obtain characteristic points of the face in images using other algorithms such as an active shape model (Active Shape Model (ASM)), an active appearance model (Active Appearance Model, AAM), etc. Obtaining characteristic points of a face in images by means of the algorithms described above can be implemented in particular using a technology such as recognition of characteristic points of a face, which will not be described in detail in the form of implementation of the present invention.

[00168] In an embodiment of the present invention, based on the angles of rotation of the face in the images in the first set of images, the terminal may select from the first set of image images the correct face position. Thus, it is possible to avoid displaying in the second set of images that have less correct face positions, but having in the second set of images satisfying the visual requirements of the user, thereby achieving an improvement in the image display effect.

[00169] In step 204, based on the characteristics of the eyes in the images in the second set of images, each image that does not have closed eyes is selected from the second set of images to obtain a third set of images.

[00170] Since the images in the second set of images may have the features of eyes of closed eyes or closed eyes, and when there are images having closed eyes, when playing back the image, they will adversely affect the image display effect. Accordingly, the terminal may, based on the characteristics of the eyes in the images in the second set of images, select from the second set of images each image that does not have closed eyes to obtain a third set of images.

[00171] Based on the features of the eyes in the images in the second set of images, the terminal selecting from the second set of images of each image that does not have closed eyes to obtain a third set of images may include: for each of the images, the terminal receiving characteristic eye points in the image; based on all the characteristic points of the eyes in the image, determining the classification result by means of a given classifier. When the classification is the first value, the terminal determines that the image has closed eyes; and when the classification result is the second value, the terminal decides that the image does not have closed eyes.

[00172] It should be noted that, the first value and the second value may be set in advance, and the first value may differ from the second value. For example, the first value may be 1, and the second value may be 0, and so on. This is not limited to the embodiment of the present invention.

[00173] Furthermore, the terminal's definition of an image as an image having closed eyes or not having closed eyes, with the help of a given classifier, can in particular be realized by means of an appropriate technology that will not be described in detail in the form of implementation of the present invention.

[00174] For example, the first value is 1, and the second value is 0. The terminal receives the characteristic eye points in Image 1, Image 2 and Image 3 in the second set of images, and based on all the characteristic eye points in Image 1 using the specified classifier determines that the result of the classification of Image 1 is 0. Then the terminal decides that Image 1 is an image that does not have closed eyes. Based on all the characteristic eye points in Image 2, using the specified classifier, the terminal determines that the classification result of Image 2 is 1. Then, the terminal determines that Image 2 is an image with eyes closed. Based on all the characteristic eye points in Image 3, using the specified classifier, the terminal determines that the classification result of Image 3 is 0. Then, the terminal determines that Image 3 is an image without eyes closed. In this case, the terminal selects Image 1 and Image 3 from the second set of images as images that have no eyes closed to obtain a third set of images.

[00175] In an embodiment of the present invention, based on the characteristics of the eyes in the images in the second set of images, the terminal may select from the second set of image images without closed eyes. In this way, displaying images having closed eyes in the third set of images can be avoided, thereby improving the display effect of the selected images.

[00176] In step 205, based on the sharpness of the face in the images in the third set of images, each image that has a face sharpness equal to or greater than the specified sharpness is selected from the third set of images to obtain a representative image of the group of images.

[00177] Since among the images in the third image set there may be images with blurry faces, and when there are images with blurry faces, when playing back images, they will adversely affect the image display effect. Accordingly, in order to select images with sharp faces from the third set of images, the terminal may, based on the sharpness of the faces of the images in the third set of images, select from the third set of images each image that has a face sharpness equal to or greater than the specified sharpness to obtain a representative image of the group of images .

[00178] It should be noted that the predetermined sharpness is configured to determine whether faces are cut in the images and the predetermined sharpness can be set in advance. For example, the specified sharpness may be 180, 200, and so on. It is not specifically limited to the embodiment of the present invention.

[00179] For example, the sharpness of the face in the image 1 is 80, the sharpness of the face in the image 2 is 200 and the specified sharpness is 180. Then, based on the sharpness of the face in the images in the third set of images, the terminal selects Image 1 from the third set of images as an image that has a sharpness of the face equal to or greater than the specified sharpness of 180 to obtain Image 1 as a representative image of a group of images.

[00180] Further, before the terminal, based on the sharpness of the face in the images in the third set of images, selects from the third set of images each image that has a face sharpness equal to or greater than the specified sharpness to obtain a representative image of the group of images, the terminal may also determine the sharpness of the face in the images in the third set of images. The determination of the sharpness of the face in the images in the third set of images may include: for each of the images in the third set of images, obtaining a brightness value of each individual pixel contained in the face area of the image; based on the brightness value of each individual pixel, determining the value of the total gradient of the face region; and determining the value of the total gradient as an estimate of the sharpness of the face in the image.

[00181] Moreover, for each of the images in the third image set, obtaining by the terminal the brightness value of each individual pixel contained in the region of the face in the image may include: for each of the images in the third image set, detection by the terminal of the face in the image; determining a detected face as a region of a face in an image; and based on the detected area of the face, the terminal receiving the brightness value of each individual pixel contained in the area of the face.

[00182] It should be noted that the detection by the terminal of a face in an image can be realized in particular by appropriate technology, such as face recognition, which will not be described in detail in the embodiment of the present invention.

[00183] Furthermore, based on the brightness value of each individual pixel, the terminal determining the value of the total gradient of the face region may include: calculating by the terminal the difference value between each pair of neighboring pixels in the horizontal direction in the face region to obtain the pixel difference value in the horizontal direction; determining the sum of the values of the pixel difference in the horizontal direction as the value of the first gradient; in the same way, the terminal calculates a difference value between each pair of neighboring pixels in a vertical direction in a face region to obtain a value of a pixel difference in a vertical direction; determining the sum of the values of the pixel difference in the vertical direction as the values of the second gradient; and determining by the terminal the sum of the value of the first gradient and the value of the second gradient as the value of the total gradient of the face region.

[00184] In an embodiment of the present invention, the terminal may select from a third set of images images with better face sharpness, determining the sharpness of the face in the images, thereby improving the sharpness of the representative images to be displayed.

[00185] Further, when the terminal selects from the images in each image group, the terminal can select through steps 202-205 described above to obtain a representative image of the image group. The terminal may also select through step 202 described above, either by steps 202-203 described above, or by steps 202-204 described above, to obtain a representative image of a group of images. However, in practical use, the terminal may also select through any step of steps 202-205 described above, or through any combination of these steps, to obtain a representative image of a group of images. This is not specifically limited by the embodiment of the present invention.

[00186] In addition, when the terminal selects from images in each group of images, the terminal can select from the quality parameters of the tone characteristic, the angles of rotation of the face, the features of the eyes and the sharpness of the face in the images mentioned in steps 202-205 described above. In addition, the terminal may also select according to other parameters, such as resolution, contrast ratio and color saturation of images. This is not specifically limited by the embodiment of the present invention.

[00187] In step 206, representative images of image groups are displayed.

[00188] Reproduction by the terminal of representative images of image groups may include: rotating and aligning by the terminal representative images of image groups so that the orientations of the faces on the representative images are the same; fine-tuning the sizes of aligned representative images of image groups so that the sizes of areas of the face in the adjusted representative images are the same; and reproducing rigged representative images in a predetermined dynamic manner.

[00189] Moreover, when the terminal rotates and aligns the representative images of the image groups so that the orientations of the faces on the representative images are the same, the terminal can rotate the representative images to the left, can also rotate the representative images to the right, either horizontally or vertically, or at any rotation angles . This is not specifically limited to the implementation of the embodiment of the present invention.

[00190] Furthermore, when the terminal adjusts the sizes of aligned representative images of the image group so that the sizes of the face regions in the adjusted representative images are the same, the terminal can, based on a given size, increase the sizes of each representative image with a smaller face area among the representative images, and reduce the sizes each representative image with a larger area of the face among the representative images, to make the area the same size her faces are aligned representative images of image groups.

[00191] It should be noted that the predetermined size can be set in advance, and can be set based on the screen size of the terminal when the predetermined size is set, or can be set based on any one of the representative images among the representative images. For example, if the terminal has a screen size of 4.5 inches (114.3 mm), then the specified size can be set to 2.5 inches (63.5 mm), 3 inches (76.2 mm), and so on. This is not specifically limited by the embodiment of the present invention.

[00192] In addition, for a terminal displaying adjusted representative images in a predetermined dynamic manner, the terminal may display representative images of image groups in a predetermined dynamic manner according to image storage times, or may also display them in a predetermined dynamic manner randomly. In this way, a user-oriented dynamic album can be created corresponding to representative images and being expressive and attractive. The dynamic display method is not specifically limited by the embodiment of the present invention. For example, the determined dynamic display method may be in the form of slides, or may also be in other forms. This is not specifically limited by the embodiment of the present invention.

[00193] Further, when there is more than one representative image for a group of images, the terminal may randomly select one or two representative images from similar representative images for display in order to prevent all similar representative images from being displayed. Thus, the problem of monotonous viewing of displays of multiple representative images can be avoided.

[00194] Even further, when the terminal receives a command to open an album and opens an album for displaying images, the terminal may present the user with numerous options for viewing methods for selecting one of them as a dynamic display method. When the terminal receives a command to reproduce dynamic images by one of a plurality of viewing methods, the terminal can reproduce images in the album in a predetermined dynamic manner according to the method of steps 201-206 described above. However, the terminal can also set the method for displaying the images of steps 201-206 described above as the default display method, and when the album is opened next time, the terminal can automatically display the images in a predetermined dynamic way of displaying to improve the image display effect and make it expressive and attractive . While the terminal displays the images in the album in a predetermined dynamic way of displaying, or after the terminal finishes displaying the images in the album, the terminal can exit the display mode of representative images of the album after receiving a command to stop displaying.

[00195] Moreover, when the terminal displays numerous options for viewing methods, after receiving a command to open an album, the terminal can directly display numerous options for viewing methods for the user so that he can choose from numerous options for viewing methods. However, the terminal can also present an assignable button, and when the user presses the assignable button, the terminal can display a drop-down menu containing numerous options for viewing methods for the user so that he can select from them. Thus, it is possible to avoid a situation where the user does not want to choose a viewing method, while not necessarily bothering the user by directly displaying numerous options for viewing methods.

[00196] It should be noted that the command for displaying dynamic images is configured to display images in the album in a dynamic manner, and is started by the user. The user can invoke the command by clicking on the assigned button. This is not specifically limited by the embodiment of the present invention. In addition, the display stop command is configured to stop displaying representative images, and can be triggered by a user through an operation such as a mouse click, move, slide, etc. This is not specifically limited by the embodiment of the present invention.

[00197] Further, the terminal may select representative images from the album to display according to the method of steps 201-206 described above. However, alternatively, before the terminal accepts the command to open the album, the terminal may first cluster the images in the album to obtain a plurality of image groups, and select from the images in each image group to obtain a representative image of the image group. Then, when the terminal receives the command to open the album, the terminal can display representative images of the image groups. Thus, it is possible to save time for displaying images and improve efficiency in reproducing images.

[00198] In addition, when the terminal displays representative images of the image groups, the terminal can display representative images of the image groups with an assignable dynamic display method after receiving the command to open the album. However, alternatively, before the terminal receives the command to open the album, the terminal may select a dynamic image display template from the library of dynamic image display templates, and populate representative images of the image groups into the dynamic image display template to form a dynamic image album. Then, when the terminal receives the command to open the album, the terminal can directly display the album of dynamic images. Thus, it is possible to improve the display effect of the image, make it expressive and attractive.

[00199] It should be noted that the library of dynamic image display patterns can be recorded in the terminal in advance, or can also be obtained from the server. This is not specifically limited by the embodiment of the present invention.

[00200] Further, before the terminal receives the command to open the album, the terminal can cluster similar images in the album, and select from each group of images. Since the images in the album can be updated at any time, that is, the user can delete images from the album or add images to the album in order to timely update representative images selected from the album, the terminal can periodically cluster similar images and select from each group of images. In this way, updates to selectable representative images can be achieved and image accuracy can be improved.

[00201] It should be noted that the terminal can update selected representative images of an album with an assignable period, such as 1 week, 2 weeks, 1 month, and so on. However, the terminal may also install an album update after a predetermined number of images, such as 10, 20, and so on, has been updated. This is not specifically limited by the embodiment of the present invention.

[00202] In an embodiment of the present invention, when a terminal receives a command to open an album, the terminal can cluster similar images in the album to obtain a plurality of image groups. For each group, select images from the group of images, respectively, based on the quality parameters of the tone characteristics, angles of rotation of the face, features of the eyes and sharpness of the face to obtain a representative image with the best quality from the group of images. The terminal then displays representative images of groups of images that have the best image quality specified by the dynamic display method. In this way, ways to display the album can be enriched, and the effect of displaying representative images can also be improved to make it expressive and attractive.

[00203] In FIG. 4 is a block diagram of an image display apparatus according to an embodiment. As shown in FIG. 4, the device comprises a clustering module 401, a selection module 402, and a display module 403.

[00204] The clustering module 401 is configured so that when a command to open an album is received, cluster similar images into an album to obtain a plurality of image groups;

[00205] the selection module 402 is configured to select an image from each image group as a representative image of the image group; and

[00206] the display module 403 is configured to display representative images of image groups.

[00207] In another embodiment of the present invention, as shown in FIG. 5, selection module 402 comprises a first selection block 4021.

[00208] The first selection block 4021 is configured so that for each of the image groups based on the image quality characteristics of the image in the image group, select each image from the image group that has the image quality parameter less than the tone characteristic threshold to obtain a first image set .

[00209] In another embodiment of the present invention, as shown in FIG. 6, selection module 402 also comprises a second selection block 4022.

[00210] The second selection unit 4022 is configured so that to obtain a second set of images based on the angles of rotation of the face (head) in the images in the first set of images, select from the first set of images each image that has an angle of rotation of the face within a given range of angles.

[00211] In another embodiment of the present invention, as shown in FIG. 7, selection module 402 also includes a third selection block 4023.

[00212] The third block 4023 selection is configured so that, based on the characteristics of the eyes in the images in the second set of images, to select from the second set of images each image that does not have closed eyes to obtain a third set of images.

[00213] In another embodiment of the present invention, as shown in FIG. 8, selection module 402 also includes a fourth selection block 4024.

[00214] The fourth selection block 4024 is configured so that based on the sharpness of the face in the images in the third set of images, each image that has a face sharpness equal to or greater than the specified sharpness is selected from the third set of images to obtain a representative image of the group of images.

[00215] In another embodiment of the present invention, as shown in FIG. 9, the selection module 402 also includes: a conversion unit 4025, a first determination unit 4026, a second determination unit 4027, and a third determination unit 4028.

[00216] The conversion unit 4025 is configured to convert images in a group of images into grayscale images;

[00217] the first determination unit 4026 is configured such that, for each of the images in the image group, determining a first number and a second number of pixels based on a grayscale image corresponding to the original image, the first number of pixels in which each pixel has a brightness level less than the first a brightness threshold, and a second number in which each pixel has a brightness level greater than the second brightness threshold is present in a grayscale image corresponding to the original image;

[00218] the second determination unit 4027 is configured to determine a first ratio of a first number to a total number of pixels in a grayscale image and a second ratio of a second number to a total number; and

[00219] the third determination unit 4028 is configured to determine a tone quality parameter of the image based on the first ratio and the second ratio.

[00220] In another embodiment of the present invention, as shown in FIG. 10, the selection module 402 also includes: a first acquisition unit 4029, a fifth selection unit 40210, a fourth determination unit 40211 and a fifth determination unit 40212.

[00221] the first acquiring unit 4029 is configured to obtain characteristic points of a face in images in the first sets of images;

[00222] the fifth selection block 40210 is configured to select, for each of the images in the first sets of images, the first characteristic point and the second characteristic point from the image, the first characteristic point and the second characteristic point being characteristic points that are mirror symmetrical about the nose;

[00223] the fourth determination unit 40211 is configured to determine a first distance between a first characteristic point and a predetermined characteristic point and a second distance between a second characteristic point and a predetermined characteristic point; and

[00224] the fifth determination unit 40212 is configured to determine the angle of rotation of the face in the image based on the first distance and the second distance.

[00225] In another embodiment of the present invention, as shown in FIG. 11, the selection module 402 also comprises: a second acquisition unit 40213, a sixth determination unit 40214 and a seventh determination unit 40215.

[00226] the second obtaining unit 40213 is configured to obtain, for each of the images in the third image set, the brightness value of each individual pixel contained in the face region of the image;

[00227] the sixth determination unit 40214 is configured to determine, based on a brightness value of each individual pixel, a value of a total gradient of a face region; and

[00228] The seventh determination unit 40215 is configured to determine the value of the total gradient as an estimate of the sharpness of the face in the image.

[00229] In another embodiment of the present invention, as shown in FIG. 12, the display unit 403 comprises: a rotation unit 4031, a tuning unit 4032, and a display unit 4033.

[00230] The rotation unit 4031 is configured to rotate and align representative images of image groups so that the orientations of faces on the representative images are the same;

[00231] the adjusting unit 4032 is configured to adjust the sizes of the aligned representative images of the image groups so that the sizes of the areas of the face in the adjusted representative images are the same; and

[00232] the display unit 4033 is configured to reproduce the adjusted representative images in a predetermined dynamic manner.

[00233] In another embodiment of the present invention, when there is more than one representative image for a group of images, one or two representative images are randomly selected for display.

[00234] In an embodiment of the present invention, when a terminal receives a command to open an album, the terminal clusters similar images in the album to obtain a plurality of image groups; the terminal selects an image from each image group as a representative image of the image group having the best image quality; and the terminal displays representative images of image groups that have the best image quality. Thus, the display effect of representative images of image groups can be improved.

[00235] With regard to the devices in the above described embodiments, specific methods for performing operations for individual modules have been described in detail in the embodiments regarding related methods, which will not be explained here.

[00236] In FIG. 13 is a block diagram of an image display apparatus 1300 according to an embodiment. For example, device 1300 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet computer, a medical device, a simulator, a personal digital assistant, and the like.

[00237] As shown in FIG. 13, device 1300 may comprise one or more of the following components: processing component 1302, memory 1304, power component 1306, multimedia component 1308, audio component 1310, I / O interface 1312, sensor component 1314 and communication component 1316.

[00238] The processing component 1302 typically controls all operations of the device 1300, such as operations related to display, telephone conversations, data transfer, camera operations, and recording operations. The processing component 1302 may comprise one or more processors 1320 to execute instructions for performing all or part of the steps in the above methods. In addition, the processing component 1302 may include one or more modules that provide interaction between the processing component 1302 and other components. For example, the processing component 1302 may comprise a multimedia module to allow interaction between the multimedia component 1308 and the processing component 1302.

[00239] A storage device 1304 is configured to store various kinds of data to support the operation of the device 1300. Examples of such data include commands for any applications or methods running on the device 1300, contact information, phone book data, messages, images, videos, etc. d. Storage device 1304 may be implemented using any kind of non-volatile or non-volatile storage devices or combinations thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory, and EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory its device (Read-Only Memory, ROM), magnetic memory, flash memory, magnetic or optical disk.

[00240] The power component 1306 supplies power to various components of the device 1300. The power component 1306 may include a power management system, one or more power sources, and other components associated with generating, controlling, and distributing energy in the device 1300.

[00241] The multimedia component 1308 includes a screen providing an output interface between the device 1300 and the user. In some embodiments, the screen may comprise a liquid crystal display (LCD) and a touch panel (TP). If the screen contains a touch panel, the screen can be implemented as a touch screen to receive input from the user. The touch panel contains one or more touch sensors to sense touch, slide, and gestures on the touch panel. Touch sensors can not only perceive the threshold of a touch or slip, but also perceive a period of time and pressure associated with the mechanism of action of a touch or slip. In some embodiments, the multimedia component 1308 comprises a front camera and / or a rear camera. The front camera and / or rear camera can receive external multimedia data, while the device 1300 is in an operating mode, such as a photographing mode or a video mode. Each of the front camera and the rear camera can have a fixed optical lens system or have the ability to focus and optically zoom.

[00242] The audio component 1310 is configured to output and / or input audio signals. For example, the audio component 1310 includes a microphone (MIC) configured to receive an external audio signal when the device 1300 is in an operating mode, such as a talk mode, a recording mode, and a speech recognition mode. The received audio signal may then be recorded to memory 1304 or transmitted through communication component 1316. In some forms of the invention, the audio component 1310 further comprises a speaker for outputting audio signals.

[00243] The I / O interface 1312 provides an interface between the processing component 1302 and peripheral interface modules such as a keyboard, Click Wheel touch wheel, buttons, and the like. The buttons may include, including the start position button, volume button, start button and lock button.

[00244] The sensor component 1314 contains one or more sensors to provide status estimates of various aspects of the device 1300. For example, the sensor component 1314 can detect the open / closed state of the device 1300, the relative positioning of components, such as the display and keyboard of the device 1300, a change in position device 1300 or component of device 1300, presence or absence of user contact with device 1300, orientation or acceleration / deceleration of device 1300, and change in temperature of device 1300. Co The sensor component 1314 may include a presence sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 1314 may also comprise a photosensitive member, such as a Complementary Metal-Oxide-Semiconductor (CMOS) imager or a Charge Coupled Device (CCD) for use in imaging applications. In some embodiments, the sensor component 1314 may also comprise an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[00245] The communication component 1316 is configured to provide communication, wired or wireless, between the device 1300 and other devices. The device 1300 can access a wireless network based on a communication standard such as WiFi (Wireless Fidelity, Wireless Second Generation (2G) or Third Generation (3G), or a combination thereof. In one embodiment, the communication component 1316 receives a broadcast signal or information related to a broadcast from an external broadcast control system via a broadcast channel. In one embodiment, the communication component 1316 further comprises a Near Field Communication (NFC) module to provide short-range communication. For example, the NFC module can be implemented on the basis of Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra-Wideband (UWB) technology, Bluetooth technology (BT ) and other technologies.

[00246] In embodiments, the device 1300 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), and Digital Signal Processing Devices (DSPDs). ), programmable logic devices (PLDs), user programmable gate arrays (Field Programmable Gate Arrays, FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform you eopisannyh ways.

[00247] In embodiments, a computer-readable storage medium is also provided comprising instructions, such as those contained in memory 1304, executed by processor 1320 in device 1300, to perform the above methods. For example, a computer-readable storage medium may be read only memory (ROM), random access memory (RAM), compact disk-read only memory (CD-ROM), magnetic tape, flexible disk, optical storage device, etc.

[00248] The computer-readable storage medium contains instructions that, when executed by a processor of a mobile terminal, cause the mobile terminal to execute a method for displaying images. The method includes:

[00249] upon receipt of a command to open an album, clustering similar images in an album to obtain a plurality of image groups;

[00250] selecting an image from each image group as a representative image of the image group; and

[00251] reproducing representative images of a group of images.

[00252] In another embodiment of the present invention, selecting an image from each image group as a representative image of the image group includes:

[00253] selecting, based on the tonal quality characteristics of the images in the image group of the image group, each image that has the tonal quality parameter smaller than the tonal threshold to obtain a first set of images.

[00254] In another embodiment of the present invention, the method further comprises:

[00255] selecting based on the angles of rotation of the face in the images in the first set of images from the first set of images of each image that has an angle of rotation of the face within a given range of angles, to obtain a second set of images.

[00256] In another embodiment of the present invention, the method further includes:

[00257] based on the features of the eyes in the images in the second image set, selecting from the second image set of each image that does not have closed eyes to obtain a third set of images.

[00258] In another embodiment of the present invention, the method further comprises:

[00259] a selection based on the sharpness of the face in the images in the third set of images from the third set of images of each image that has a face sharpness equal to or greater than the specified sharpness to obtain a representative image of a group of images.

[00260] In another embodiment of the present invention, prior to selecting, from the image group of each image, which has a tone quality parameter less than a tone characteristic threshold, in order to obtain a first set of images, the method further includes:

[00261] converting images in a group of images into grayscale images;

[00262] for each of the images in the image group, determining a first number and a second number of pixels based on a grayscale image corresponding to the original image, wherein in the first number, each pixel has a brightness level lower than the first brightness threshold, and in the second number, each pixel has a level brightness greater than the second brightness threshold is present in the grayscale image corresponding to the image;

[00263] determining a first ratio of the first number to the total number of pixels in the grayscale image and a second ratio of the second number to the total number; and

[00264] determining a quality parameter of the tonal characteristic of the image based on the first ratio and the second ratio.

[00265] In another embodiment of the present invention, before selecting based on the angles of rotation of the faces in the images in the first set of images, selecting from the first set of images of each image that has an angle of rotation of the face within a given range of angles to obtain a second set of images, the method further includes:

[00266] obtaining characteristic points of the face in the images in the first sets of images;

[00267] for each of the images in the first sets of images, selecting from the image a first characteristic point and a second characteristic point, the first characteristic point and the second characteristic point being characteristic points that are mirror symmetrical about the nose;

[00268] determining a first distance between a first characteristic point and a predetermined characteristic point and a second distance between a second characteristic point and a predetermined characteristic point; and

[00269] determining the angle of rotation of the face in the image based on the first distance and the second distance.

[00270] In another embodiment of the present invention, before choosing based on the sharpness of the face on the images in the third set of images, from the third set of images of each image that has a face sharpness equal to or greater than the specified sharpness, to obtain a representative image of a group of images, The method further includes:

[00271] for each of the images in the third image set, obtaining a brightness value of each individual pixel contained in the face region of the image;

[00272] based on the brightness value of each individual pixel, determining a value of the total gradient of the face region; and

[00273] determining the value of the total gradient as an estimate of the sharpness of the face in the image.

[00274] In another embodiment of the present invention, reproducing a representative image of a group of images includes:

[00275] rotating and aligning representative images of groups of images so that the orientations of the faces on the representative images are the same;

[00276] adjusting the sizes of aligned representative images of the image groups so that the sizes of areas of the face in the adjusted representative images are the same; and

[00277] reproducing rigged representative images in a predetermined dynamic manner.

[00278] In another embodiment of the present invention, when there is more than one representative image for a group of images, randomly selecting one or two representative images for display.

[00279] Other forms of carrying out the invention will be apparent to those skilled in the art based on the description and practice of the invention disclosed herein. This application is intended to cover any changes, uses or adaptations of the invention in accordance with its general principles and including such deviations from the present invention that are within the scope of known or accepted practice in the art. It is assumed that the description and examples are considered as given only as an example, with the true scope and essence of the invention defined by the attached claims.

[00280] It should be understood that the present invention is not limited to the precise construction that has been described above and shown in the accompanying drawings, and that various modifications and changes can be made without departing from its scope. It is intended that the scope of the invention be limited only by the appended claims.

Claims (17)

1. A method of displaying images, including: upon receipt of a command to open an album, clustering similar images in an album to obtain a plurality of image groups; selecting an image from each image group as a representative image of the image group; and reproducing representative images of the image group, wherein selecting an image from each image group as a representative image of the image group includes: converting the images in the image group into grayscale images; for each of the images in the image group, determining a first number and a second number of pixels based on a grayscale image corresponding to the original image, the first number in which each pixel has a brightness level lower than the first brightness threshold and the second number in which each pixel has a brightness level greater than the second brightness threshold is present in the grayscale image corresponding to the original image; determining a first ratio of the first number to the total number of pixels in the grayscale image and a second ratio of the second number to the total number; determining an image quality parameter of the image tonal characteristic based on the first relationship and the second ratio and selecting from the image group, based on the image quality parameters of the image tonal characteristics in the image group, each image that has a tone quality parameter less than the tone characteristic threshold to obtain a first set images. 2. The method according to p. 1, which further includes: selecting, based on the angles of rotation of the face on the images in the first set of images from the first set of images of each image, which has an angle of rotation of the face within a given range of angles, to obtain a second set of images. 3. The method according to claim 2, which further includes: based on the characteristics of the eyes in the images in the second set of images, selecting from the second set of images of each image that does not have closed eyes to obtain a third set of images. 4. The method according to claim 3, which further includes: selecting, based on the sharpness of the face in the images in the third set of images, from the third set of images of each image that has a sharpness of the face equal to or greater than the specified sharpness to obtain a representative image of a group of images. 5. The method according to p. 2, which before selecting based on the angles of rotation of the face on the images in the first set of images from the first set of images of each image, which has an angle of rotation of the face within a given range of angles, to obtain a second set of images, further includes: obtaining characteristic points of the face in the images in the first sets of images; for each of the images in the first sets of images, the selection from the image of the first characteristic point and the second characteristic point, the first characteristic point and the second characteristic point being characteristic points, mirror symmetrical about the nose; determining a first distance between a first characteristic point and a given characteristic point and a second distance between a second characteristic point and a given characteristic point; and determining the angle of rotation of the face in the image based on the first distance and the second distance. 6. The method according to claim 4, which before selecting based on the sharpness of the face in the images in the third set of images from the third set of images of each image, which has a sharpness of the face equal to or greater than the specified sharpness, to obtain a representative image of a group of images, further includes: for each of the images in the third set of images, obtaining a brightness value of each individual pixel contained in the face region of the image; based on the brightness value of each individual pixel, determining the value of the total gradient of the face area; and determining the value of the total gradient as an estimate of the sharpness of the face in the image. 7. The method of claim 1, wherein reproducing representative images of the image groups includes: rotating and aligning representative images of the image groups so that the orientations of the faces on the representative images are the same; fine-tuning the sizes of aligned representative images of image groups so that the sizes of areas of the face in the adjusted representative images are the same; and reproducing rigged representative images in a predetermined dynamic manner. 8. The method of claim 7, wherein when there is more than one representative image for a group of images, randomly selecting one or two representative images for display. 9. An apparatus for displaying images, comprising: a clustering module configured to, when a command to open an album is received, cluster similar images in an album to obtain a plurality of image groups; a selection module configured to select an image from each image group as a representative image of the image group; and a display module configured to display representative images of image groups, wherein the selection module comprises: a conversion unit configured to convert images in the image group to grayscale images; a first determining unit configured to determine for each of the images in the image group a first number and a second number of pixels based on a grayscale image corresponding to the original image, the first number in which each pixel has a brightness level lower than the first brightness threshold, and a second number in which each pixel has a brightness level greater than the second brightness threshold is present in a grayscale image corresponding to the original image; a second determining unit configured to determine a first ratio of the first number to the total number of pixels in the grayscale image and a second ratio of the second number to the total number; and a third determination unit, configured to determine an image quality characteristic of the image based on the first relationship and the second relationship, a first selection unit, configured so that for each image group, based on the image quality characteristics of the image characteristic in the image group, choose groups of images each image that has a tone quality parameter less than a tone characteristic threshold to obtain a first set of images. 10. The device according to p. 9, in which the selection module further comprises: a second selection unit, configured so that to obtain a second set of images based on the angles of rotation of the face on the images in the first set of images, select from the first set of images each image that has angle of rotation of the face within a given range of angles. 11. The device according to p. 10, in which the selection module further comprises: a third selection unit, configured so that, based on the characteristics of the eyes in the images in the second set of images, select from the second set of images each image that does not have closed eyes to obtain a third set of images. 12. The device according to claim 11, in which the selection module further comprises: a fourth selection unit, configured so that, based on the sharpness of the face in the images in the third set, select each image from the third set of images that has a face sharpness equal to or greater than a given sharpness to get a representative image of a group of images. 13. The device according to p. 10, in which the selection module further comprises: a first acquisition unit, configured to receive characteristic points of the face in the images in the first sets of images; a fifth selection unit, configured so that, for each of the images in the first sets of images, to select from the image a first characteristic point and a second characteristic point, the first characteristic point and the second characteristic point being characteristic points that are mirror symmetrical about the nose; a fourth determination unit configured to determine a first distance between a first characteristic point and a predetermined characteristic point and a second distance between a second characteristic point and a predetermined characteristic point; and a fifth determining unit, configured to determine an angle of rotation of the face in the image based on the first distance and the second distance. 14. The device according to p. 12, in which the selection module further comprises: a second acquisition unit, configured so that for each of the images in the third set of images to receive the brightness value of each individual pixel contained in the region of the face in the image; a sixth determination unit, configured to determine, based on a brightness value of each individual pixel, a value of a total gradient of a face region; and a seventh determination unit configured to determine the value of the total gradient as an estimate of the sharpness of the face in the image. 15. The device according to claim 9, in which the display module comprises: a rotation unit configured to rotate and align representative images of image groups so that the orientations of the faces on the representative images are the same; a fine tuning unit configured to adjust the sizes of aligned representative images of the image groups so that the sizes of areas of the face in the adjusted representative images are the same; and a display unit configured to reproduce the adjusted representative images in a predetermined dynamic manner. 16. The apparatus of claim 15, wherein when there is more than one representative image for a group of images, one or two representative images are randomly selected for display. 17. A device for displaying images, comprising: a processor; and a storage device for storing instructions executed by the processor; moreover, the processor is configured to perform: upon receipt of a command to open an album, clustering similar images in an album to obtain a plurality of image groups; selecting an image from each image group as a representative image of the image group; and reproducing representative images of the image groups, wherein selecting an image from each image group as a representative image of the image group includes: converting the images in the image group into grayscale images; for each of the images in the image group, determining a first number and a second number of pixels based on a grayscale image corresponding to the original image, the first number in which each pixel has a brightness level lower than the first brightness threshold and the second number in which each pixel has a brightness level greater than the second brightness threshold is present in the grayscale image corresponding to the original image; determining a first ratio of the first number to the total number of pixels in the grayscale image and a second ratio of the second number to the total number; determining an image quality parameter of the image tonal characteristic based on the first relationship and the second ratio and selecting from the image group, based on the image quality parameters of the image tonal characteristics in the image group, each image that has a tone quality parameter less than the tone characteristic threshold to obtain a first set images.

Images