WO2024169338A1 - Photographing method and electronic device - Google Patents

Abstract

A photographing method and an electronic device, applied to the technical field of image processing. The method comprises: in response to a first operation of a user, entering a photographing mode or a video filming mode; and upon recognizing a single registered subject or a plurality of registered subjects, displaying a first interface, wherein the first interface comprises a first registered subject and a first follow shot frame, the first follow shot frame is used for performing protagonist follow shot on the first registered subject, the first follow shot frame does not disappear after a preset duration, and the first follow shot frame being used for performing protagonist follow shot on the first registered subject refers to: when the first registered subject moves in a picture, the first follow shot frame moves along with the first registered subject, so as to achieve intelligent follow shot during a photographing process, thus improving the photographing experience of users.

Description

Shooting method and electronic device

This application claims the priority of the Chinese patent application filed with the State Intellectual Property Office on February 16, 2023, with application number 202310153109.8 and application name “A shooting method and electronic device”, all contents of which are incorporated by reference in this application.

Technical Field

The present application relates to the field of image processing technology, and in particular, to a photographing method and an electronic device.

Background Art

With the development of smart terminals, the shooting function has become an essential function of smart terminals. Users' demand and experience for shooting (photographing and/or shooting videos) of smart terminals are also increasing. At present, smart terminals can focus on faces when shooting. However, the current focusing method is relatively simple, and the focus frame will automatically disappear after a few seconds, which is not a good shooting experience.

Summary of the invention

In view of this, the present application provides a shooting method, an electronic device, a computer-readable storage medium and a computer program product, which can realize intelligent focus tracking and help improve the user's shooting experience.

In a first aspect, a shooting method is provided, the method being applied to an electronic device, the method comprising:

In response to a first operation by the user, a photographing mode or a video recording mode is entered.

When a single registered object or multiple registered objects are identified, a first interface is displayed, wherein the first interface includes the first registered object and a first focus tracking frame (for example, a protagonist focus tracking frame), wherein the first focus tracking frame is used to perform protagonist focus on the first registered object, and the first focus tracking frame does not disappear after a preset time period, wherein the first focus tracking frame is used to perform protagonist focus on the first registered object means that when the first registered object moves in the picture, the first focus tracking frame moves with the first registered object.

The above method can be executed by a terminal device or a chip in the terminal device. Based on the above scheme, it helps to improve the user's shooting experience. In an embodiment of the present application, when a single registered object or multiple registered objects are identified, the first focusing frame can be used to perform protagonist tracking (or continuous focusing) on the first focusing object. Moreover, in the process of continuous focusing, compared to the conventional focusing frame that automatically disappears after a preset time, the first focusing frame does not disappear after the preset time. The first focusing frame is used to perform protagonist tracking on the first registered object, which means that when the first registered object moves in the picture, the first focusing frame moves with the first registered object. By introducing the first focusing frame, intelligent focusing of the photographed object can be achieved, thereby improving the shooting experience.

Optionally, the above-mentioned registration object may be a registered face. It is understandable that the registration object is not limited to a face, but may also be other objects, such as a cat, a dog, etc., depending on the user's choice or setting.

Optionally, taking the registration object as a registered face as an example, the registered face can be determined through image data in the gallery APP.

Optionally, based on the portrait data in the gallery, a preset number of faces with the highest appearance frequency in the album are automatically selected as registered faces.

Optionally, taking the registration object as a registered face as an example, the registered face may be manually selected by a user.

Optionally, based on the user's own choice, a preset number of faces in the album are added as registered faces. Users can decide which faces to register based on their needs, making smart focus tracking more in line with user expectations.

In a possible implementation, when a single registered object is identified, the first registered object is the single registered object; or, when multiple registered objects are identified, the first registered object is a target object among the multiple registered objects that meets a preset condition. Whether it is a single-person shooting scene or a multi-person shooting scene, the embodiment of the present application can perform intelligent focus tracking when a registered object is identified.

In one possible implementation, in the case where multiple registered objects are identified, the first interface also includes multiple second focus frames, and the multiple second focus frames are used to focus on the multiple registered objects except the first registered object, wherein the second focus frames are different in color from the first focus frames.

Optionally, in the case where multiple registered objects are identified, the first registered object is the object with the highest face ratio in the first interface among the multiple registered objects.

In a possible implementation, when an unregistered object is identified, the first interface further includes a conventional focus frame, the conventional focus frame is used to focus on the unregistered object, and the conventional focus frame automatically disappears after the preset time period;

Among them, the difference between the first tracking focus frame and the conventional focus frame is reflected in one or more of the following factors: color, frame type, lines, and display duration.

Optionally, the first tracking focus frame is a double frame (i.e., including a main frame and a sub-frame). The conventional focus frame is a single frame. Compared with a single frame, a double frame can better highlight the registered face or the protagonist's face, making it easier for the user to intuitively see the tracking focus object.

The embodiments of the present application are applicable to both the photo mode and the video recording mode, that is, intelligent focus tracking can be achieved regardless of photo taking or video recording, thereby improving the user experience.

In a possible implementation, for the photo mode, the first interface is a photo preview interface, wherein the first operation is an operation of starting a camera application. Therefore, in the photo scene, intelligent focus tracking can be implemented.

In a possible implementation, for the video recording mode, the first interface is a video recording preview interface, wherein the first operation is an operation of switching to the video recording mode. Therefore, in the video recording scene, intelligent focus tracking can be implemented.

In a possible implementation, the method further includes:

In response to the user clicking the recording control, a video recording interface is displayed, and the video recording interface includes the first registered object and the first focus frame.

In a possible implementation, during the video recording process, the method further includes:

During the continuous tracking focus process of the first registered object, if it is recognized that the proportion of the face of the first registered object in the screen is less than a first threshold, the first tracking focus frame is switched from the face frame to the body frame;

If it is recognized that the proportion of the face of the first registered object in the screen is greater than or equal to a first threshold, the first focus frame is switched from a human body frame to a face frame.

Therefore, during the video recording process, the first registered object can be continuously focused, and the first focusing frame can be switched based on the proportion of the face of the first registered object in the screen to achieve intelligent focusing.

In a possible implementation, during the video recording process, the method further includes:

During the continuous tracking focus process of the first registered object, if the first registered object cannot be recognized, the first tracking focus frame also disappears in the video recording interface, and the actually recognized face is tracked or focused;

If it is recognized that the first registered object is restored, the first focus frame continues to be displayed in the video recording interface.

Therefore, when the first registered object disappears and then recovers, the first registered object can continue to be intelligently tracked.

In a possible implementation manner, before displaying the first interface, the method further includes:

Turn on the "Protagonist Focus" function.

The embodiment of the present application allows the user to choose whether to turn on the "main character tracking focus" function. It should be noted that when turning on the "main character tracking focus" function, the "intelligent tracking focus" function needs to be turned on. The "intelligent tracking focus" function and the "main character tracking focus" function are linked. Generally speaking, in the embodiment of the present application, the "intelligent tracking focus" function is turned on by default.

In some possible implementations, after the user opens the camera, when it is recognized that the gallery has generated available portrait data, a pop-up window can be used to prompt the user whether to turn on the "main character tracking focus". Since it is uncertain when the gallery can generate available portrait data, a pop-up window is set to prompt the user whether to turn on the "main character tracking focus" function, so that the user can know whether the "main character tracking focus" function can be turned on in a timely manner.

In a possible implementation, the “main character tracking focus” function is enabled, including:

In response to a user clicking on a "main character tracking focus" option in a camera setting interface, the "main character tracking focus" function is turned on, wherein when it is detected that portrait data in a gallery has been generated, the "main character tracking focus" option is in an available state.

In a possible implementation, when a camera application is opened, if it is detected that portrait data in the gallery has been generated, a first pop-up window is displayed on the camera preview interface, and the first pop-up window includes an option to turn on or off the "main character tracking focus" function;

Among them, turning on the "Protagonist Focus" function includes:

In response to the user clicking on the enable option in the first pop-up window, the "main character tracking" function is enabled.

In a possible implementation, when the “main character tracking focus” function is enabled for the first time, the method further includes:

A first prompt box is displayed in the first interface, and the first prompt box is used to prompt the user that the main character has been identified and the focus has been tracked. In other words, the main character label can be used to inform the user that the main character has been identified and the focus has been tracked.

Optionally, the first prompt frame may move along with the main character tracking focus frame. When the main character tracking focus frame moves along with the main character, the first prompt frame may also move along with the main character tracking focus frame.

Optionally, the first prompt box has a limited duration, for example, the first prompt box may automatically disappear after 3 seconds.

Optionally, when the previously recognized registered face is lost and cannot be recognized, for example, the registered face moves to the edge of the screen or loses focus (loss of focus can be understood as the inability to track the face), the first prompt box disappears immediately (or instantly).

Optionally, the first prompt box is displayed only once in one shooting.

In a possible implementation, the method further includes:

receiving a second operation of the user, where the second operation is used to select a target focus tracking object;

Displaying a second interface; when the target focus object is a recognizable target, the second interface includes a first focus control, the first focus control includes a third focus frame and a first icon, the first icon is used to adjust exposure, and the third focus frame is used to focus on the target focus object;

When the target focus object is an unrecognizable target, the second interface includes a second focus control, the second focus control includes a fourth focus frame and a second icon; the second icon is used to adjust the exposure, and the fourth focus frame is used to focus on the target focus object, wherein the fourth focus frame is different in color from the third focus frame, and the first icon is different in color from the second icon.

Therefore, users can independently select the target focus object for focus tracking, which improves the user's shooting experience.

In a possible implementation, when focusing on the target focus object, the method further includes:

Receive the user's screen sliding operation;

In response to the operation of sliding the screen, the exposure of the picture is adjusted accordingly.

For example, when tracking the target focus object, the exposure can be adjusted by sliding the screen up and down. section, making it more convenient for users to operate.

In a possible implementation, when the target focus tracking object is a recognizable target and the third focus tracking frame is used to track the target focus tracking object, the method further includes:

A second prompt box is displayed, where the second prompt box is used to prompt the user that the focus target has been locked.

Therefore, by introducing the second prompt box, the user can know whether the focus target is locked.

In a possible implementation, the target focus tracking object is a person, and in the process of continuously focusing on the target focus tracking object, the method further includes:

If the face of the target focus object cannot be recognized, the face frame is converted into a body frame;

When the face of the target focus object is re-identified, the human body frame is still displayed.

Therefore, when the face of the target object is re-identified, the human body frame is still used to focus on the target object, which can avoid the problem of switching back and forth between the face frame and the human body frame.

In a second aspect, an electronic device is provided, comprising a unit for executing the method in any implementation of the first aspect. The electronic device may be a terminal or a chip in a terminal. The electronic device comprises an input unit, a display unit and a processing unit.

When the electronic device is a terminal, the processing unit may be a processor, the input unit may be a communication interface, and the display unit may be a graphics processing module and a screen; the terminal may also include a memory for storing computer program code, and when the processor executes the computer program code stored in the memory, the terminal executes any one of the methods in the first aspect.

When the electronic device is a chip in a terminal, the processing unit may be a logic processing unit inside the chip, the input unit may be an input interface, a pin or a circuit, etc., and the display unit may be a graphics processing unit inside the chip; the chip may also include a memory, which may be a memory inside the chip (for example, a register, a cache, etc.) or a memory located outside the chip (for example, a read-only memory, a random access memory, etc.); the memory is used to store computer program code, and when the processor executes the computer program code stored in the memory, the chip executes any one of the methods of the first aspect.

According to a third aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program code. When the computer program code is executed by an electronic device, the electronic device executes any one of the methods according to the first aspect.

According to a fourth aspect, a computer program product is provided, the computer program product comprising: a computer program code, when the computer program code is executed by an electronic device, the electronic device executes any one of the methods according to the first aspect.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is an example diagram of an application scenario of an embodiment of the present application;

FIG2 is a schematic diagram of the structure of an electronic device applicable to the present application;

FIG3 is an example diagram of a graphical user interface for setting items of the “Smart Focus Tracking” function;

FIG4 is a schematic diagram of the interface for registering faces on the gallery discovery page;

FIG5 is a schematic diagram of an interface for a user to select a registered face;

FIG6 is a schematic diagram of an interface that prompts a user that the upper limit of registered faces has been exceeded;

FIG7 is an example diagram of an interface for camera settings;

FIG8 is an example of an interface that prompts the user whether to turn on “main character tracking focus” through a pop-up window;

FIG9 is an example diagram of an interface that prompts the user through a prompt box that the main character has been identified for focus tracking;

FIG10 is a sample image of the camera preview interface after the “intelligent focus tracking” function is turned on;

FIG11 is an example diagram of an interface for a multi-person shooting scene in a camera mode;

FIG12 is an example diagram of an interface in which multiple faces are recognized in a photo preview interface;

FIG13 is an example diagram of an interface for performing intelligent focus tracking in video recording mode;

FIG14 is an example diagram of an interface with human intervention in a single-person photo taking scenario;

FIG15 is an example of an interface diagram showing human intervention in a multi-person photo shooting scenario when there is no registered face;

FIG16 is an example diagram of an interface in a multi-person photo-taking scenario where human intervention occurs when a registered face is recognized;

FIG17 is an example of an interface diagram showing human intervention in the video recording mode;

FIG18 is another example of an interface in which human intervention occurs in the video recording mode;

FIG19 is an example diagram of the interface after the target focus object disappears;

FIG20 is an example diagram of an interface for clicking on an identifiable target in a video recording scene;

FIG21 is an example diagram of an interface for clicking on an unrecognizable target in a video recording scene;

FIG22 is an example diagram of an interface for long pressing an unrecognizable object in a video recording scene;

FIG23 is a schematic diagram of an interface for adjusting exposure by sliding the screen in a photo preview interface;

FIG24 is a schematic diagram of an interface for adjusting exposure by sliding the screen during video recording;

FIG25 is an example diagram of an interface showing changes in the focus frame when the face of the target focus object disappears;

FIG. 26 is an example of an interface showing the change of the focus frame when the focus target is switched between near and far;

FIG27 is a schematic diagram of a double frame of face tracking focus frames of different sizes;

FIG28 is a schematic diagram of a single frame of a face tracking focus frame of different sizes;

FIG29 is a schematic diagram of human body tracking focus frames of different sizes provided in an embodiment of the present application;

FIG30 is a schematic flow chart of a photographing method provided in an embodiment of the present application;

FIG31 is a schematic diagram of a software architecture of an electronic device applicable to the present application;

FIG32 is a schematic block diagram of a photographing device suitable for an embodiment of the present application.

DETAILED DESCRIPTION

The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.

In the embodiments of the present application, unless otherwise specified, “plurality” may mean two or more than two.

The embodiments of the present application are applicable to electronic devices, which may be mobile phones, smart screens, tablet computers, wearable electronic devices, vehicle-mounted electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), projectors, and the like.

The electronic device in the embodiment of the present application is equipped with an image collector (such as a camera).

The present application embodiment does not impose any restrictions on the specific type of electronic device. The following takes the electronic device being a mobile phone as an example to describe the shooting method of the present application embodiment.

In some embodiments, the key components of the mobile phone camera include an optical lens and an image sensor. After the camera is started, the sensor can output an image based on the image signal collected by the lens.

The following is an explanation in conjunction with the scenario example in Figure 1. Figure 1 is an example diagram of an application scenario of an embodiment of the present application.

In the mobile phone interface shown in (1) of Figure 1, the interface can display multiple applications: Application 1, Application 2, ..., Application 7 and the camera application. The user clicks the camera application and the mobile phone starts the camera. After the camera is running, the mobile phone interface displays the interface shown in (2) of Figure 1. This interface can be called the camera shooting interface. This shooting interface may include The viewfinder 11, zoom ratio 12 (default is 1x), album icon 13, shooting control 14 and camera rotation control etc. The user can take a photo by clicking the shooting control 14. In this interface, the album icon 13 displays thumbnails. The camera rotation control can be used to switch cameras.

The viewfinder 11 is used to obtain a preview image and can display the preview image in real time.

The phone supports digital zoom. When using the shooting function, users can select different zoom ratios by operating on the touch screen.

It should be understood that the photo-taking scene in FIG1 is only a schematic illustration of an application scenario of the present application, and does not limit the embodiments of the present application. In fact, the embodiments of the present application can also be applied to other scenes using cameras, such as video recording scenes, video call scenes, video live broadcast scenes, etc.

It should also be understood that (2) in FIG. 1 shows an interface diagram of a user taking a photo with the mobile phone in portrait mode, but the present application is not limited thereto. For example, the user can take a photo with the mobile phone in landscape mode.

The hardware architecture of the embodiment of the present application is described below in conjunction with FIG. 2 .

Refer to FIG. 2 , which shows a hardware system of an electronic device suitable for the present application.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

It should be noted that the structure shown in FIG2 does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in FIG2, or the electronic device 100 may include a combination of some of the components shown in FIG2, or the electronic device 100 may include sub-components of some of the components shown in FIG2. The components shown in FIG2 may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include at least one of the following processing units: an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and a neural-network processing unit (NPU). Different processing units may be independent devices or integrated devices.

The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. For example, the processor 110 may include at least one of the following interfaces: an inter-integrated circuit (I2C) interface, an inter-integrated circuit audio interface, a (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver/transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input/output (general-purpose input/output, GPIO) interface, SIM interface, USB interface. The connection relationship between the modules shown in Figure 2 is only a schematic illustration and does not constitute a limitation on the connection relationship between the modules of the electronic device 100. Optionally, the modules of the electronic device 100 can also adopt a combination of multiple connection methods in the above embodiments.

The electronic device 100 can realize the display function through the GPU, the display screen 194 and the application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

The display screen 194 can be used to display images or videos. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (Mini LED), a micro light-emitting diode (Micro LED), a micro OLED or a quantum dot light emitting diode (QLED). In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. As a possible implementation, when a user views photos of wonderful moments and selected short videos, the display screen 194 can be used to display photos of MM at wonderful moments and selected short videos.

The electronic device 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor.

The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can perform algorithm optimization on the noise, brightness and color of the image. The ISP can also optimize the exposure and color temperature of the shooting scene and other parameters. In some embodiments, the ISP can be set in the camera 193.

The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard red green blue (RGB), YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

In some embodiments, the processor 110 is configured to enter a photo taking mode or a video recording mode in response to a first operation of the user.

When a single registered object or multiple registered objects are identified, the display screen 194 is called to display a first interface, wherein the first interface includes the first registered object and a first focus tracking frame (for example, a protagonist focus tracking frame), wherein the first focus tracking frame is used to perform protagonist focus on the first registered object, and the first focus tracking frame does not disappear after a preset time period, wherein the first focus tracking frame is used to perform protagonist focus on the first registered object means that when the first registered object moves in the picture, the first focus tracking frame moves with the first registered object.

Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.

The video codec is used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in various coding formats, such as moving picture experts group (MPEG) 1, MPEG2, MPEG3 and MPEG4.

NPU is a processor that draws on the structure of biological neural networks, such as the transmission mode between neurons in the human brain to quickly process input information, and can also continuously self-learn. Through NPU, the electronic device 100 can realize intelligent cognition and other functions, such as image recognition, face recognition, voice recognition and text understanding.

The external memory interface 120 can be used to connect an external memory card, such as a secure digital (SD) card, to expand the storage capacity of the electronic device 100.

The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, and an application required for at least one function (for example, a sound playback function and an image playback function). The data storage area may store data created during the use of the electronic device 100 (for example, audio data and a phone book). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as: at least one disk storage device, a flash memory device, and a universal flash storage (UFS). The processor 110 executes various processing methods of the electronic device 100 by running instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The electronic device 100 can implement audio functions, such as music playing and recording, through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor.

The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, for example, in a shooting scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

The ambient light sensor 180L is used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to realize functions such as unlocking, accessing application locks, taking photos, and answering calls.

The touch sensor 180K is also called a touch control device. The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, which is also called a touch control screen. The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor 180K can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100 and set at a different position from the display screen 194.

The key 190 includes a power key and a volume key. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive a key input signal and implement a function related to the key input signal.

The technical solutions involved in the following embodiments can all be implemented in the electronic device 100 having the above hardware architecture.

For ease of understanding, the following embodiments of the present application will take an electronic device having the structure shown in FIG. 2 as an example, and will specifically describe the shooting method provided in the embodiments of the present application in combination with the accompanying drawings and application scenarios.

This application will take the electronic device as a mobile phone, and install a camera application in the mobile phone as an example to introduce in detail the shooting method provided by this application.

In some embodiments of the present application, the user can manually turn on or off the "intelligent focus tracking" provided in the embodiments of the present application. Optionally, the "intelligent focus tracking" can usually be turned on by default.

If "Smart Focus Tracking" is turned on, the electronic device can focus on the object recognized in the picture. If the subject in the picture is identified, the "focus tracking frame" will be displayed in the preview interface. The focus tracking frame will automatically track the subject in the picture, such as people, pets, etc., and will not disappear after a period of time. It should be noted that focus tracking can be understood as a dynamic process. For a certain subject in the picture, if the subject is the focus tracking object, then when the subject in the picture moves, the focus tracking frame will always follow the subject.

If "Smart Focus Tracking" is not turned on, the preview screen of the electronic device will show the regular focus frame. The regular focus frame can be understood as the focus frame in the current camera application, which only focuses on the face for a period of time and does not have the function of continuous focus tracking.

After enabling “intelligent focus tracking”, the embodiment of the present application can achieve continuous focus tracking on the subject in the picture.

FIG3 shows a graphical user interface (GUI) example of the “Smart Focus Tracking” function setting items.

For example, the user can instruct the phone to open the camera application by touching a specific control on the phone screen, pressing a specific physical button or button combination, inputting a voice, performing an air gesture, etc. In response to receiving the user's instruction to open the camera, the phone starts the camera and displays the shooting interface.

For example, as shown in (1) of FIG3 , the screen display system of the mobile phone displays the currently output interface content, and the interface content displays multiple applications (applications, Apps). In response to the user clicking the "camera" application icon 401 on the mobile phone desktop, the mobile phone displays the shooting interface shown in (2) of FIG3 .

For another example, when the mobile phone is in the lock screen state, the mobile phone responds to the user's gesture operation of sliding right (or left) on the mobile phone screen, and displays the shooting interface shown in (2) in Figure 3.

Alternatively, when the mobile phone is in the lock screen state, in response to the user clicking the shortcut icon of the "Camera" application on the lock screen interface, the shooting interface shown in (2) in Figure 3 is displayed.

For another example, when the mobile phone is running other applications, the mobile phone opens the camera application to take pictures in response to the user clicking the corresponding control. For example, when the user is using an instant messaging application (such as WeChat application), the mobile phone opens the camera application in response to the user selecting the control of the camera function in the messaging application to take pictures and/or record videos.

As shown in (2) of FIG3 , the camera shooting interface generally includes a viewfinder 402, a setting control 403, a photo control, a video control, and other functional controls (such as a portrait mode control, a night scene mode control, a movie mode control, or more other controls). It can be understood that in the photo mode, the viewfinder 402 can display a photo preview interface; in the video mode, the viewfinder 402 can display a video preview interface.

In response to the user clicking on the setting control 403, the mobile phone displays the interface shown in FIG3 (3). The interface shown in FIG3 (3) displays the option 404 of "Smart Focus Tracking". Option 404 is used to turn on or off the "Smart Focus Tracking" function. In the interface shown in FIG3 (3), option 404 is in the off state. When the user manually clicks option 404, the "Smart Focus Tracking" function is turned on, and the mobile phone displays the interface shown in FIG3 (4).

Optionally, FIG3 (3) also shows a brief introduction to the "intelligent focus tracking" function for the user to understand, specifically: in the photo and video recording modes, it supports automatic recognition of people, cats, and dogs for automatic focus tracking. Click to lock the focus on any object.

It can be understood that in addition to the "Smart Focus Tracking" setting option, other setting items can also be displayed in the interface shown in (3) of Figure 3. For example, the setting interface shown in (3) of Figure 3 can also display reference line setting items, level setting items, timer shooting switch controls, self-timer mirroring, automatic watermarking options, geographic location information recording options, shooting mute options, floating shutter button options, extended business controls, etc.

As shown in (4) of FIG3 , option 404 of “Smart Focus Tracking” is turned on. When the user turns on option 404 of “Smart Focus Tracking”, the mobile phone will automatically and continuously focus on the subject in the picture when taking photos or recording videos. Of course, the user can also manually turn off the “Smart Focus Tracking” function through option 404.

Furthermore, after the "intelligent focus tracking" function is turned on, the embodiment of the present application also provides a "main character focus tracking" function. As shown in FIG3 (4), after the "intelligent focus tracking" option 404 is turned on, the "main character focus tracking" option 405 and the "main character focus tracking" function introduction will appear in the interface, for example, the first five people who are frequently photographed in the "portraits" of the gallery will be identified and the focus tracking will be prioritized (effective when the portrait data meets the face recognition conditions).

It should be noted that whether "Main Character Tracking" is available depends on whether the portrait data in the gallery is generated. When the gallery data has been generated, "Main Character Tracking" is available; when the gallery data has not been generated, "Main Character Tracking" is not available. When "Main Character Tracking" is not available, it will be displayed in a grayed-out state in the interface. For example, option 405 of "Main Character Tracking" shown in (4) of FIG. 3 is in a grayed-out state, and the user cannot operate the option of "Main Character Tracking".

Among them, the portrait data in the gallery has been generated, which can be understood as multiple registered faces have been determined. The embodiment of the present application introduces "registered face" to describe the portrait data in the gallery. A registered face refers to a face that an electronic device automatically focuses on through a focus frame. The registered face can be predetermined. The embodiment of the present application does not specifically limit the method for determining the registered face.

It can be understood that the term "registered face" is used as an example for description here, but the term can also be replaced by other names or terms, such as "focusing face", "registered portrait", "focusing portrait", etc.

It can also be understood that the description here is based on "registering a face" as an implementation method, and the embodiments of the present application are not limited to this. For example, the registered face can also be other registered objects, such as cats, dogs, and other objects.

In some implementations, the registered face can be determined through image data in the gallery APP.

Optionally, based on the portrait data in the gallery, a preset number of faces with the highest appearance frequency in the album are selected as registered faces.

Exemplarily, by obtaining photo albums in a gallery, the top five portraits that appear most frequently in the photo albums are used as registered faces according to their appearance frequencies.

It is understood that here, 5 registered faces are used as an example for explanation, and the embodiment of the present application is not limited thereto. In fact, there may be a greater or lesser number of registered faces.

FIG4 shows a schematic diagram of the interface for registering a face on the gallery discovery page. For example, the user can instruct the mobile phone to open the gallery application by touching a specific control on the mobile phone screen, pressing a specific physical key or key combination, inputting a voice, performing an air gesture, etc. The gallery application is also called an album, photo, etc. In response to receiving the user's instruction to open the gallery, the mobile phone displays the photo interface.

For example, as shown in (1) of FIG4 , the screen display system of the mobile phone displays the currently output interface content, and the interface content displays multiple application programs APP. In response to the user clicking the "Gallery" application icon 301 on the mobile phone desktop, the mobile phone displays the interface shown in (2) of FIG4 .

As shown in (2) of FIG4 , the photo page is displayed in the gallery, where the photo page contains photos taken by the user (such as photos taken by the user today and photos taken by the user yesterday). The gallery interface also includes albums, moments, and a discovery control 302. In response to the user clicking the discovery control 302, the mobile phone displays the interface as shown in (3) of FIG4 . The interface shown in (3) of FIG4 is the discovery page of the gallery.

As shown in (3) in Figure 4, the discovery page includes a portrait area 303. In the dotted box shown in the portrait area 303, portrait data in the gallery is displayed. For example, Figure 4 (3) shows four portraits. Optionally, the four portraits shown in (3) in Figure 4 are sorted from large to small according to the number of portraits that appear in the photo. The dotted box shown in the portrait area 303 also includes a "more" control 304. In response to the user clicking the control 304, the mobile phone displays the interface shown in (4) in Figure 4. The interface shown in (4) in Figure 4 is an example of a portrait page. For example, the portrait page can display the person that the mobile phone focuses on by default.

Optionally, other items may be included as shown in (3) in FIG. 4 . For example, the search bar shown in (3) in FIG. 4 , One-click blockbuster control, free creation control, puzzle making control, micro-movie making control, honor editing control, community project, etc. Among them, the search bar is used to search for photos, people, places, etc. One-click blockbuster control is used to generate videos. Free creation control is used for users to make videos based on photos or edit and create photos. Puzzle making control is used to perform editing operations such as splicing photos. Micro-movie making control is used for users to make micro-movies. Honor editing is used for users to edit photos or videos in the gallery. Community project is used for users to enter the image community and share beautiful moments.

It should be understood that the other items included in the above example (3) in FIG. 4 are merely illustrative and do not constitute a limitation on the embodiments of the present application.

As shown in (4) of FIG4 , the dotted frame 306 is used to display the statistical data of the multiple portraits. Optionally, the statistical data of the multiple portraits displayed in the dotted frame 306 include the names of the portraits and the corresponding quantities. Optionally, the multiple portraits in the dotted frame 306 can be displayed in order from largest to smallest quantity.

For example, the dotted frame 306 includes: a portrait named Dad (the corresponding number is 58), a portrait named Mom (the corresponding number is 53), a portrait named Sister (the corresponding number is 46), a portrait named Brother (the corresponding number is 45), and a portrait named Friends (the corresponding numbers are 42 and 30, respectively). The name of each portrait is in the lower left corner of the portrait frame, and the number of times each portrait appears in the photo is in the lower right corner of the portrait frame. For example, taking the portrait 307 in the dotted frame 306 as an example, the name of the portrait 307 is "Dad", and the number of times it appears in the photo is 58.

For the interface shown in (4) of FIG4 , the first five registered faces automatically determined according to the number of photos (or the frequency of appearance of faces) may be: a portrait named Dad (corresponding to 58), a portrait named Mom (corresponding to 53), a portrait named Sister (corresponding to 46), a portrait named Brother (corresponding to 45), and a portrait named Friend (corresponding to 42). These five registered faces may be used as registered persons for automatic focus tracking by the mobile phone.

It can be understood that the dotted frame 303 and the dotted frame 306 shown in FIG. 4 are only introduced for ease of description and do not constitute a limitation to the embodiments of the present application.

It can be understood that the portrait statistics shown in (4) of FIG. 4 are illustrated by taking photos of the "personal" category as an example, and the embodiments of the present application are not limited thereto. For example, the portrait interface shown in (4) of FIG. 4 also includes a "group photo" category. When the user clicks on the "group photo" category, the portrait statistics under the group photo category can be displayed in the interface.

In other implementations, the registered faces may be manually selected by the user. Optionally, a preset number of faces in the album may be added as registered faces based on the user's autonomous selection. In other words, the user may decide which faces to register based on their needs, so that the smart focus tracking is more in line with the user's expectations.

For example, the user can select one or more faces as registered faces, or cancel one or more faces as registered faces, by clicking.

FIG5 shows a schematic diagram of the interface for users to select registered faces on their own initiative. As shown in FIG5 (1), the dotted box 306 shows the statistical data of each portrait. For example, the statistical data shown in FIG5 (1) is the same as the statistical data shown in FIG4 (4), and the relevant description can refer to the description at FIG4 (4). Taking the portrait 308 named "Sister" in FIG5 (1) as an example, when the user clicks on the portrait 308 named "Sister", it means that the portrait is selected as the registered face, and the interface is shown in FIG5 (2).

As shown in the interface of (2) in FIG. 5 , a focus frame icon 309 appears in the upper right corner of the portrait 308, and a prompt box 310 is displayed in the interface, and the content in the prompt box 310 is "This person has been added for automatic focus tracking". The focus frame icon 309 indicates that the portrait 308 has been selected as the registered face. The focus frame icon 309 of the portrait 308 is different from the focus frame icons in other portrait frames. For example, the color of the line of the focus frame icon 309 is darker than that of the focus frame icon in the portrait 307.

Similarly, the user can click on the portrait named Dad (the corresponding number is 58), the portrait named Mom (the corresponding number is 53), the portrait named Brother (the corresponding number is 45), the portrait named Friend (the corresponding number is 56), and the portrait named Friend (the corresponding number is 57). The selection process is the same as the previous method of selecting portrait 308. For example, FIG5 (3) shows an interface after selecting 5 portraits as registered faces. The selected 5 portraits are: father, mother, sister, brother, and friend (the corresponding number is 42).

Furthermore, the user can also cancel a selected portrait by clicking. For example, the user clicks on the portrait 311 named brother in Figure 5 (3), and the interface is displayed as shown in Figure 5 (4). As shown in Figure 5 (4), the focus frame icon in the upper right corner of the portrait 311 changes, and its color is lighter than the focus frame icon in the upper right corner of the portrait 311 shown in Figure 5 (3). In addition, a prompt box 312 will appear in the interface of Figure 5 (4), and the content of the prompt box 312 is "Automatic focus on this person has been canceled."

It is understood that no matter which implementation method is used to determine the registered faces, the present embodiment of the application does not specifically limit the value of the preset number. In other words, the number of registered faces can be set based on actual needs. The preset number can be understood as the upper limit of the registered faces.

Optionally, when the number of registered faces selected by the user exceeds a preset number, the electronic device will prompt the user through a pop-up window.

FIG6 shows a schematic diagram of an interface that prompts the user that the upper limit of the number of registered faces has been exceeded. As shown in FIG6 (1), the following portraits in the dotted box 306 have been selected as registered faces, namely: a portrait named Dad (the corresponding number is 58), a portrait named Mom (the corresponding number is 53), a portrait named Sister (the corresponding number is 46), a portrait named Brother (the corresponding number is 45), and a portrait named Friend (the corresponding number is 42), that is, there are 5 portraits as registered faces. When the user clicks on the portrait named Friend 313, the interface is displayed as shown in FIG6 (2). As shown in FIG6 (2), a prompt box 314 appears in the interface, and the prompt box 314 is used to inform the user that the number of registered faces has reached the upper limit (for example, the upper limit is 5). For example, the content of the prompt box 314 is "Focus on the person, the upper limit can only be selected up to 5, and the selected person will be automatically focused when shooting with the camera." Optionally, the prompt box 314 can also include an "OK" control, and when the user clicks the "OK" control, the prompt box 314 disappears.

It is understood that the prompt box 314 shown in FIG6 is illustrated by taking the upper limit of 5 as an example, and the embodiment of the present application is not limited thereto. For example, the upper limit may be a number greater than 5 or a number less than 5.

Regardless of the method used to determine the registered face, after the registered face data in the gallery takes effect, "Main Character Focus Tracking" is available. Users can click the "Main Character Focus Tracking" option in the settings interface to turn "Main Character Focus Tracking" on or off.

FIG7 is an example of an interface diagram for camera settings. FIG7 (1) shows an interface in which "Main Character Tracking" is unavailable, which is the same as the interface shown in FIG3 (4). When the registered face data in the gallery takes effect, the interface is displayed as shown in FIG7 (2), and option 405 of "Main Character Tracking" in the setting interface is available. The available state can also be understood as a non-grayed state, that is, the user can operate it.

Compared to the "main character tracking focus" option 405 shown in (4) of FIG. 3 or the "main character tracking focus" option 405 shown in (1) of FIG. 7 , the "main character tracking focus" option 405 shown in (2) of FIG. 7 can be clicked by the user. In response to the user clicking the "main character tracking focus" option 405, the mobile phone turns on the "main character tracking focus" function, for example, displays the interface shown in (3) of FIG. 7 . As shown in (3) of FIG. 7 , the "main character tracking focus" option 405 is turned on. Of course, after the "main character tracking focus" option is turned on, the user can click the "main character tracking focus" option to turn it off.

Furthermore, users can also click on the "Smart Focus Tracking" option to turn it off. Since "Smart Focus Tracking" and "Main Character Focus Tracking" are linked, and the premise of turning on "Main Character Focus Tracking" is that "Smart Focus Tracking" is turned on, when the "Smart Focus Tracking" option is turned off, the "Main Character Focus Tracking" option is also automatically turned off.

For example, the user clicks on the "Smart Focus Tracking" option 404 shown in FIG. 7 (3) to turn off the "Smart Focus Tracking", and the interface is shown in FIG. 7 (4). As shown in FIG. 7 (4), the "Smart Focus Tracking" option 404 is turned off, and the setting options There is no option for "main character tracking" either.

It should be understood that other relevant setting items in the setting interface in FIG. 7 are similar to those in FIG. 3 , and are not described again here for the sake of brevity.

Optionally, the electronic device can memorize the switch state of the "main character tracking focus" option operated by the user before. In this way, after the "smart tracking focus" option is turned on again, the "main character tracking focus" option can be automatically set using the memory operation. If the user previously set the "main character tracking focus" option to the on state, then the "main character tracking focus" option can be kept on; if the user previously set the "main character tracking focus" option to the off state, then the "main character tracking focus" option can be kept off.

However, whether "Main Character Tracking" is turned on or off, whether it is grayed out and disabled depends on whether the registered face data in the gallery is effective. If it is determined that the registered face data in the gallery is effective, or if it is determined that the gallery has generated usable portrait data, then the "Main Character Tracking" option is available. If the registered face data in the gallery is not effective, then the "Main Character Tracking" option is unavailable, for example, by graying it out and disabling it to inform the user that "Main Character Tracking" is unavailable.

In some possible implementations, after the user opens the camera, when it is recognized that the gallery has generated usable portrait data, a pop-up window can be used to prompt the user whether to turn on the "main character tracking focus". Since it is uncertain when the gallery can generate usable portrait data, a pop-up window is set to prompt the user whether to turn on the "main character tracking focus" function.

FIG8 shows an example of an interface that prompts the user whether to turn on the "main character tracking focus" function through a pop-up window. The interface shown in FIG8 (1) is the same as that shown in FIG3 (1), and the interface shown in FIG8 (2) is the same as that shown in FIG3 (2). For related descriptions, please refer to the previous text. When the mobile phone recognizes that the gallery has generated usable portrait data, the interface is displayed as shown in FIG8 (3), and window 801 is displayed in the photo preview interface. Window 801 is used to prompt the user whether to turn on the "main character tracking focus" function. For example, the content displayed in window 801 is: Do you want to turn on the "main character tracking focus" function? Identify the portraits that are often taken in the gallery and give priority to tracking focus.

Optionally, the window 801 includes an on option and a cancel option. When the user clicks the on option in the window 801, the "main character tracking focus" function is turned on, and the state of the "main character tracking focus" option 405 in the setting interface is turned on, such as the interface shown in (4) of the interface Figure 8. For how to enter the interface shown in (4) of Figure 8, please refer to the example of (2) in Figure 3 above, which will not be repeated here.

Of course, if the user clicks the cancel option in window 801, window 801 disappears and maintains the current state. The status of the "main character tracking focus" option 405 is available, and the user can subsequently choose to turn on or off the "main character tracking focus" option 405. There will be no more prompts during the use of the camera this time. In addition, for the case of selecting the cancel option in window 801 this time, when the user kills the process in the background and re-enters the camera, if it is recognized that available portrait data has been generated, it will still prompt again. Optionally, the upper limit of the prompt can be a preset number of times, for example, 3 times. It can be understood that the preset number of times can also be other numbers, and 3 is used as an example here for illustration.

Optionally, the window 801 also includes an option of "not prompting again". When the user clicks the cancel option in the window 801 and checks the option of "not prompting again", the window 801 disappears and no prompt is given thereafter.

In some possible implementations, after the "main character tracking focus" function is turned on for the first time, if the main character among the registered faces is identified, the main character tracking focus frame can be used for tracking focus, and the user is prompted through the first prompt frame that the main character tracking focus has been identified. Taking the identification of a single registered face as an example, the main character refers to the single registered face; taking the identification of multiple registered faces as an example, the main character refers to the face with the highest priority among the multiple registered faces, such as the face that appears most frequently or is closest to the camera.

The first prompt box may also have other names, for example, it may be called a protagonist label.

Optionally, the first prompt frame may move along with the main character tracking focus frame. When the main character tracking focus frame moves along with the main character, the first prompt frame may also move along with the main character tracking focus frame.

The first prompt box has a limited duration. Optionally, the first prompt box automatically disappears after a preset duration. For example, the first prompt box may automatically disappear after 3 seconds.

Optionally, when the previously recognized registered face is lost and cannot be recognized, for example, the registered face moves to the edge of the screen or loses focus (loss of focus can be understood as the inability to track the face), the first prompt box disappears immediately (or instantly).

Optionally, the first prompt box is displayed only once in a shooting. That is to say, for a certain shooting, when the first prompt box has appeared and automatically disappears after a preset time, the first prompt box will not appear again in this shooting. Only when the electronic device switches modes (for example, from photo mode to portrait mode) or the camera APP is switched to background operation, the first prompt box can be displayed again when the camera APP is entered next time and recognizes the protagonist again.

Optionally, there is an upper limit to the number of times the first prompt box is displayed. For example, when the camera APP is entered multiple times, the first prompt box is displayed at most 3 times.

The subject tracking focus frame in the embodiment of the present application is different from the conventional focus frame. In some embodiments, the subject tracking focus frame is different from the conventional focus frame in at least one or more of the following: (1) the subject tracking focus frame is different in color from the conventional focus frame; (2) the subject tracking focus frame is different in frame type from the conventional focus frame; (3) the subject tracking focus frame is different in frame line thickness from the conventional focus frame.

For example, the conventional focus frame is a white tracking focus frame; the main character tracking focus frame is a tracking focus frame of a color other than white, such as yellow. The conventional focus frame only includes a main frame, or the conventional focus frame is a single frame; the main character tracking focus frame includes a main frame and a sub-frame, or the main character tracking focus frame is a double frame.

FIG. 9 shows an example of an interface that prompts the user through a prompt box that the main character has been identified and the focus is being tracked. The interfaces shown in FIG. 9 (1) to FIG. 9 (3) are respectively the same as the interfaces shown in FIG. 8 (1) to FIG. 8 (3), and the relevant description can be referred to in the previous text. As shown in FIG. 9 (2), assuming that face A is identified in the viewfinder 402, since the "main character focus tracking" function has not been turned on at this time, the identified face A is focused using the conventional focus frame 901. In the interface shown in FIG. 9 (3), the mobile phone responds to the user clicking the turn-on option in window 801 and turns on the "main character focus tracking" function. At this time, the mobile phone will identify face A in the photo preview interface. If face A is identified as a registered face and is the main character, the mobile phone displays the interface shown in FIG. 9 (4).

As shown in (4) of FIG9 , the mobile phone uses the main character tracking focus frame 902 to track the face A, and prompts the user through the prompt box 802 that the main character tracking focus has been identified. For example, the content in the prompt box 802 is: "The main character tracking focus" has been identified. After a period of time, the prompt box 802 may disappear automatically. For example, as shown in (5) of FIG9 , the prompt box 802 is no longer displayed in the interface, and the main character tracking focus frame 902 continues to automatically track the face A.

It should be understood that (4) in FIG9 is illustrated by taking the recognition of a single registered face A as an example, and the present application embodiment is not limited thereto. For example, if multiple registered faces are recognized, one of the multiple registered faces will be selected as the protagonist for continuous tracking.

For example, the conventional tracking focus frame 901 shown in FIG. 9 (2) is conventionally displayed and includes only the main frame; while the protagonist tracking focus frame 902 shown in FIG. 9 (4) or FIG. 9 (5) can be highlighted and includes the main frame and the sub-frame. It should be understood that the protagonist tracking focus frame 902 shown in FIG. 9 (4) or FIG. 9 (5) can be yellow or other highlighted colors in a specific implementation to distinguish it from the conventional focus frame. Here, it is uniformly explained that the protagonist tracking focus frame shown in the embodiment of the present application is only an example.

The above describes the relevant introduction of "intelligent focus tracking" and "main character focus tracking". It should be understood that the above examples are only exemplary descriptions, and the embodiments of the present application are not limited thereto.

When "Smart Focus Tracking" and "Main Subject Focus Tracking" are turned on, when the user uses the camera to shoot, the electronic device will automatically identify whether the subject is a registered face. If a registered face is recognized, the electronic device will focus on the registered face.

The following will introduce in detail the implementation example of automatically tracking focus after recognizing a registered face in conjunction with various interfaces.

Figure 10 shows an example of the camera preview interface after turning on the "Smart Focus Tracking" and "Main Character Focus Tracking" functions. As shown in (1), face A is recognized in the camera preview interface, and face A is not a registered face. At this time, the tracking focus frame for face A is a regular focus frame 901. Regular focus frame 901 will automatically disappear after a period of time (for example, 5 seconds). Regular focus frame 901 is usually displayed in white in the preview interface.

As the lens moves, when face B appears in the photo preview interface and face B is recognized as a registered face, the focus frame for face B is the main focus frame (or first focus frame) proposed in this application. (2) in FIG. 10 is described by taking a photo scene of a single registered face as an example. As shown in (2) in FIG. 10 , the preview interface displays face B and main focus frame 902. Main focus frame 902 is used to perform main focus (or continuous focus) on face B.

In addition, when face B moves, the main character tracking focus frame 902 will also move with face B. For example, when face B moves, in the picture frame shown in (2) of FIG. 10 and the picture frame shown in (3) of FIG. 10 , the main character tracking focus frame 902 always moves with face B. Moreover, the size of the main character tracking focus frame will also change as face B moves.

For example, the conventional tracking focus frame shown in FIG. 10 (1) is a conventional display and includes only a main frame; while the main character tracking focus frame shown in FIG. 10 (2) or FIG. 10 (3) is highlighted and includes a main frame and a sub-frame. It should be understood that the main character tracking focus frame shown in FIG. 10 (2) or FIG. 10 (3) can be yellow or other highlighted colors in a specific implementation to distinguish it from the conventional focus frame. The main character tracking focus frame 902 shown in FIG. 10 (2) or FIG. 10 (3) is only an example.

The interface examples shown in (2) or (3) of FIG. 10 are all for shooting scenes with a single registered face. For shooting scenes with multiple people, the embodiments of the present application are still applicable.

A multi-person shooting scene means that there may be multiple subjects when shooting. For multiple subjects, if no registered face is recognized among the multiple subjects, that is, the multiple subjects are all non-registered faces, then the focus tracking frame for each non-registered face is a regular focus frame; if the multiple subjects are all registered faces, that is, there are multiple registered faces, then the multiple registered faces will be sorted according to priority, and the protagonist focus tracking frame will be used for the registered face with the highest priority, and the non-protagonist focus tracking frame (second focus tracking frame) will be used for the registered faces other than the registered face with the highest priority.

Among them, the main character tracking focus frame and the non-main character tracking focus frame can both be considered as registered tracking focus frames, that is, tracking focus frames for registered faces. The difference between the non-main character tracking focus frame and the main character tracking focus frame is that the two have different colors. Compared with the non-main character tracking focus frame, the main character tracking focus frame will be highlighted in the interface to highlight the main character portrait. For example, the main character tracking focus frame line is yellow, and the non-main character tracking focus frame is white.

In addition, the non-protagonist tracking focus frame has the same frame type as the protagonist tracking focus frame, that is, the non-protagonist tracking focus frame includes a main frame and a sub-frame. The conventional tracking focus frame is a single frame. Therefore, from the perspective of frame type, the non-protagonist tracking focus frame is different from the conventional tracking focus frame.

FIG. 11 shows an example interface diagram of a multi-person shooting scene in the photo mode. As shown in (1) of FIG. 11 , when face A, face B, face C, and face D appear in the photo preview interface, if the mobile phone recognizes that face A is an unregistered face, and faces B, face C, and face D are all registered faces, and face B is the face closest to the camera among multiple registered faces (such as face B, face C, and face D), then at this time, a conventional focus frame 901 is used for face A, and the tracking focus frame for face B is the protagonist tracking focus frame 902 (or the first tracking focus frame) proposed in this application, and the tracking focus frames for faces C and face D are the non-protagonist tracking focus frames 903 proposed in this application. For the relevant description of the conventional focus frame 901, please refer to the description in FIG. 10 . The protagonist frame 902 and the non-protagonist tracking focus frame 903 are both composed of a main frame and a sub-frame. The difference is that the protagonist frame 902 is highlighted compared to the non-protagonist tracking focus frame 903 to highlight the protagonist portrait.

After a period of time, the regular focus frame 901 for face A disappears automatically. For example, after 5 seconds, the interface is displayed as shown in (2) in Figure 11. The regular focus frame 901 for face A disappears, while the main character tracking focus frame 902 for face B and the non-main character tracking focus frames 903 for faces C and D do not disappear.

As the face or the camera moves, the order of faces approaching the camera in the picture changes, and face C becomes one of the multiple registered faces. For example, if the face closest to the camera among the faces (such as face B, face C, and face D) is the subject focus frame, then face C is used as the subject focus frame, and the tracking focus frame of face B is switched to the non-subject tracking focus frame. As shown in (3) of FIG. 11 , in the photo preview interface, the tracking focus frame for face C is the subject tracking focus frame 902 (or the first tracking focus frame) proposed in this application, and the tracking focus frames for faces B and D are the non-subject tracking focus frames 903.

As the shooting scenes change, shooting scenes with a large number of faces may be involved. When more shooting subjects are identified in the photo preview interface, a maximum of a first number of objects in the picture are automatically identified for focus and/or tracking, and a maximum of a second number of registered faces are identified for tracking. The first number is the sum of the number of faces tracked through the tracking focus frame and the number of objects focused through the regular focus frame. In other words, the upper limit of the sum of the number of faces tracked through the tracking focus frame and the number of objects focused through the regular focus frame is the first number, and the upper limit of the number of faces tracked through the tracking focus frame is the second number. The second number is less than or equal to the first number. For example, the first number is 10 and the second number is 5.

Exemplarily, as shown in FIG12 , when taking a photo, the photo preview interface includes face A, face B, face C, face D, face E, face F, pet K, pet H, face I, face G, and face J, and face F, face I, face G, pet K, and pet H are recognized as unregistered faces, so conventional focus frames are used for face F, face I, face G, pet G, and pet H; and, face A, face B, face C, face D, and face E are recognized as registered faces, and face B is the registered face closest to the lens among the five registered faces, so the protagonist tracking focus frame 902 is used for face B, and the non-protagonist tracking focus frame 903 is used for face A, face C, face D, and face E. Due to the limitation of quantity, face J is not focused on with a focus frame or a tracking focus frame.

It can be seen that in Figure 12, the objects focused on by the conventional focus frame 901 are: face F, face I, face G, pet K and pet H, and the objects focused on by the tracking focus frame (including the protagonist tracking focus frame 902 and the non-protagonist tracking focus frame 903) are: face A, face B, face C, face D and face E, that is, the total number (or the first number) is 10, and the second number is 5.

It should be understood that the example shown in FIG12 is only for ease of understanding, and the embodiments of the present application are not limited thereto. For example, FIG12 may include more human faces.

It should be noted that the embodiments of the present application are applicable to both photo shooting and video recording. The above-mentioned interface examples are described by taking the photo preview scene as an example. It is understandable that the above-mentioned interface examples are also applicable in the video preview scene or the video recording process.

FIG13 shows an example of an interface for performing intelligent focus tracking in the video recording mode. As shown in FIG13 (1), when face A is recognized and face A is not a registered face, a conventional focus frame 901 will be displayed in the photo preview interface to focus on face A. If the user clicks on the video recording mode, the camera switches to the video recording preview interface, and the interface is shown in FIG13 (2).

For example, as shown in (2) of FIG. 13 , in the video preview interface, if a single face B is recognized and face B is a registered face, then the main character tracking focus frame 902 is used to track the focus on face B. Optionally, if face A is also recognized in the video preview interface and face A is a non-registered face, then the conventional focus frame 901 is used to focus on the non-registered face. Optionally, if multiple registered faces are recognized and face B has the highest priority among the multiple registered faces, then the non-main character tracking focus frame 903 is used in the video preview interface to track the focus on other registered faces (such as face C and face D).

As shown in (2) of FIG. 13 , the interface also includes a control 1201 for starting video recording. When the user clicks the control 1201 , the mobile phone starts recording the video. For example, the interface is displayed as shown in (3) of FIG. 13 .

As shown in the interface (3) of FIG. 13 , after the video recording starts, the interface includes a photo control 1202, a stop control 1203, and a pause control 1204. If the user clicks the stop control 1203, the recording can be ended; if the user clicks the control 1202, a manual snapshot can be taken during the video recording; if the user clicks the pause control 1204, the recording can be paused.

For example, as shown in (3) of FIG. 13 , the interface displays the recording screen at the 5th second. In the video, a main character tracking focus frame 902 is displayed for the recognized registered face B. That is, when the video recording starts, the main character tracking focus frame 902 is displayed in the video preview interface, and the registered face B is continuously tracked. In addition, if a regular focus frame is displayed in the video preview interface, the regular focus frame 901 disappears immediately when the video recording starts; if a non-main character tracking focus frame 903 is displayed in the video preview interface, the non-main character tracking focus frames 903 for other registered faces (such as face C and face D) will also disappear immediately when the video recording starts.

When starting to record a video, if a single registered face is recognized, the single registered face will be continuously tracked in the recording screen. For example, as shown in (4) in FIG. 13 , the interface shows the recording screen at the 12th second. In the recording screen at the 12th second, the registered face B can still be recognized, so the main character tracking focus frame 902 is still used to continuously track the registered face B.

If the registered face B is lost or cannot be recognized during the recording process, the actual recognized face will be tracked or focused. For example, as shown in (5) in FIG. 13 , the interface shows the recording screen at the 20th second. In the recording screen at the 20th second, the registered face B is lost and the unregistered face A appears in the lens. At this time, the conventional focus frame 901 will still be used to focus on the unregistered face A.

Furthermore, after the registered face B is lost, if the registered face B is restored and reappears in the camera image within a preset time (for example, the preset time may be 30 seconds), the main character tracking focus frame is still used to continuously track the registered face B; if the preset time is exceeded, the main character tracking focus frame 902 will not be used to track the registered face B when the registered face B is restored. For example, as shown in (6) in FIG. 13 , the interface displays the recording image at the 24th second. In the recording image at the 24th second, the registered face B appears in the camera image again, and at this time, the main character tracking focus frame 902 is used to continuously track the registered face B.

In addition, after the registered face is lost, if within a preset time (for example, the preset time can be 30 seconds), another registered face (such as registered face D) appears at the same time as the registered face is restored, then the registered face will no longer be tracked based on the priority of the registered face, and the registered face will be tracked based on the priority of the registered face. For example, if registered face D is closer to the front than registered face B, registered face D will be tracked using the main character tracking focus frame.

The above describes the relevant embodiments of focusing when there is no human intervention in the photo or video mode. The following describes the relevant embodiments of focusing when there is human intervention. Human intervention refers to the user actively clicking on a certain area or object in the interface to select the object to be focused. The interface includes but is not limited to the photo preview interface, the video preview interface or the video recording interface (i.e., the screen during the video recording process).

When there is no human intervention in the interface, the electronic device automatically identifies the subject of the shooting and performs tracking focus. As mentioned above, if the registered face is not recognized, the conventional focus frame is used to track the face. If a registered face is recognized, the registered tracking focus frame is used for tracking focus, specifically including: if it is a single registered face, the protagonist tracking focus frame is used for tracking focus; if multiple registered faces are recognized, the protagonist tracking focus frame is used for tracking focus for the registered face with the highest priority, and the non-protagonist tracking focus frame is used for tracking focus for other registered faces except the registered face with the highest priority. However, when there is human intervention in the interface, for example, the user actively clicks on a face in the photo preview interface or the video preview interface, the electronic device will take the person or object selected by the user as the object to be focused, without considering the factor of the registered face.

In a possible implementation, the electronic device receives a second operation from the user, where the second operation is used to select a target focus object; when the target focus object is a recognizable target, a first focus control is displayed in the second interface (photo preview interface, video preview interface, or video recording interface), where the first focus control includes a third focus frame and a first icon, where the first icon is used to adjust exposure, and the third focus frame is used to focus on the target focus object; when the target focus object is an unrecognizable target, a second focus control is displayed in the second interface (photo preview interface, video preview interface, or video recording interface), where the second focus control includes a fourth focus frame and a second icon, and the second icon The icon is used to adjust the exposure, the fourth focus frame is used to focus on the target focus object, the fourth focus frame is different in color from the third focus frame, and the first icon is different in color from the second icon.

It should be noted that when the user selects the target focus object, only the first focus control for the target focus object will be displayed in the interface, and other frames will disappear. Other frames include focus frames and/or focus frames. In other words, no matter whether the main character focus frame, non-main character focus frame, or regular focus frame is displayed in the interface before the user selects the target focus object, it will disappear after the user selects the target focus object, and only the first focus control for the target focus object will be displayed.

It can be understood that the target focus object can be a person or an object, or a picture of a certain area, and the embodiments of the present application do not specifically limit this.

Optionally, the second operation may be a click operation or a long press operation.

Optionally, after receiving the second operation of the user, the method further includes: determining whether the target focus object is a recognizable target. That is, after receiving the second operation of the user, the electronic device may first determine whether the object selected by the user to focus is a recognizable target. If it is a recognizable target, the first focus control is displayed in the interface, that is, the recognizable target is locked using the first focus control; if it is an unrecognizable target, the second focus control is displayed in the interface.

Furthermore, when the target focus object is an unrecognizable target, or when the second focus control is displayed on the interface, the method also includes: receiving a third operation of the user; in response to the third operation of the user, not displaying the second focus control and continuing focus tracking.

Optionally, the first focus control and the second focus control have different colors.

Exemplarily, the target focus object may be a face selected by a user.

Exemplarily, the first icon is a small sun icon. It can be understood that the small sun icon is only an example description, and in fact it can be replaced by other icons indicating the exposure amount, and the embodiments of the present application are not limited thereto.

The above-mentioned embodiment regarding "whether there is no human intervention in the interface" is applicable not only to the photo-taking scene, but also to the video-recording scene.

The following describes an embodiment in which human intervention exists in a photo-taking scene in conjunction with the interface examples in FIG. 14 to FIG. 16 .

FIG14 shows an example of an interface with human intervention in a single-person photo scene. As shown in FIG14 (1), in the preview interface of the single-person photo scene, a conventional focus frame 901 is used to focus on the unregistered face A. The user can actively click on face A to set face A as the target focus object.

For example, when the user clicks on face A, the interface is displayed as shown in (2) in Figure 14. As shown in (2) in Figure 14, in the photo preview interface, a highlight focus frame 904 (corresponding to the third focus frame) and a small sun icon 905 (corresponding to the first icon) are displayed for face A. The highlight focus frame 904 and the small sun icon constitute the first focus control mentioned above.

FIG15 shows an example of an interface diagram of human intervention in a multi-person photo scene when there is no registered face. As shown in FIG15 (1), in the preview interface of the multi-person photo scene, the conventional focus frame 901 is used to focus on the unregistered face A, and the conventional focus frame 901 is used to focus on the unregistered face B. The user can actively click on face A to set face A as the target focus object.

For example, in response to the user clicking on face A, the mobile phone displays the interface as shown in FIG15 (2). As shown in FIG15 (2), in the photo preview interface, a highlight focus frame 904 (corresponding to the third focus frame) and a small sun icon 905 (corresponding to the first icon) are displayed for face A. The highlight focus frame 904 and the small sun icon constitute the first focus control mentioned above, and the regular focus frame 901 of face B disappears.

FIG16 shows an example of a human intervention interface in a multi-person photo scene when a registered face is recognized. As shown in FIG16 (1), in the preview interface of the multi-person photo scene, the non-registered face A is focused using the conventional focus frame 901, the registered face B is focused using the main focus frame 902, and the registered face C is focused using the non-main focus frame 903. Focus tracking. The user can actively click on face C to set face C as the target focus tracking object.

For example, when the user clicks on face C, the interface is shown in (2) of FIG16. As shown in (2) of FIG16, in the photo preview interface, a highlight focus frame 904 (corresponding to the third focus frame) and a small sun icon 905 (corresponding to the first icon) are displayed for face C. The highlight focus frame 904 and the small sun icon constitute the first focus control mentioned above, and the regular focus frame 901 of face A and the main focus frame 902 of face B both disappear.

FIG. 17 is an example of an interface diagram in which human intervention exists in the video recording mode. FIG. 17 (1) shows that the video recording preview interface includes an unregistered face A and a registered face B. The unregistered face A is focused using a conventional focus frame 901, and the registered face B is focused using a main character tracking focus frame 902. In response to the user manually clicking on the unregistered face A, the mobile phone will focus on the unregistered face A, that is, face A is the target tracking object. For example, the interface display is as shown in FIG. 17 (2). Only the highlighted tracking focus frame 904 (corresponding to the third tracking focus frame) and the small sun icon 905 (corresponding to the first icon) of the unregistered face A are displayed in the video recording preview interface, and other tracking focus frames disappear, that is, the main character tracking focus frame 902 of the registered face B disappears.

As shown in FIG. 17 (2), the video preview interface also includes a control 1601 for starting video recording. In response to the user clicking the control 1601 for starting video recording, the mobile phone displays a recording interface as shown in FIG. 17 (3). For example, in the 5th second screen, only the focus frame 904 of the non-registered face A is displayed, and the small sun icon 905 disappears. The non-registered face A is the focus lock target.

In some possible implementations, for a scenario in which a user manually clicks on a target focus object, when the target focus object is a identifiable target and a focus frame (such as a third focus frame) is used to focus on the identifiable target, the method further includes: displaying a second prompt frame, wherein the second prompt frame is used to prompt the user that the focus target has been locked.

Optionally, the second prompt box may automatically disappear after a preset time, for example, the second prompt box may automatically disappear after 3 seconds.

It should be noted that, whether it is a photo-taking scene or a video-recording scene, when the user manually clicks on the target focus object, the user can be prompted through the above-mentioned second prompt box.

Figure 18 shows another example of an interface with human intervention in the video recording mode. Figure 18 (1) shows that the video recording preview interface includes an unregistered face A and a registered face B. The unregistered face A is focused using a conventional focus frame 901, and the registered face B is focused using a main character tracking focus frame 902.

In response to the user's operation of adjusting the shooting angle, the mobile phone displays a video preview interface as shown in FIG18 (2). As shown in FIG18 (2), the video preview interface after adjusting the shooting angle includes an unregistered face C, wherein the unregistered face C is focused using a conventional focus frame 901. In response to the user's operation of manually clicking on the unregistered face C, the mobile phone will focus on the unregistered face C, and the unregistered face C is now the target focus object.

For example, the interface is shown in (3) of FIG. 18 , where the video preview interface displays a highlighted focus frame 904 (corresponding to the third focus frame) of the target focus object C, and a prompt frame 920 (corresponding to the second prompt frame). The content in prompt frame 920 is “Focus locked”. Prompt frame 920 may automatically disappear after 3 seconds. As shown in (3) of FIG. 18 , when the user clicks the video control 1601, the interface is shown in (4) of FIG. 18 .

As shown in the interface (4) of FIG. 18 , in the recording screen at the first second, assuming that the distance prompt box 920 has been displayed in the interface for more than 3 seconds, the prompt box 920 has disappeared from the interface, and the highlight tracking frame 904 will continue to follow the target tracking object C.

Optionally, as shown in the interface (4) of FIG. 18 , even if a face B appears in the interface (4) of FIG. 18 , the highlight tracking frame 904 will continue to move with the target tracking object C.

Optionally, when the user manually clicks on the non-registered face C, a small sun icon (not shown in the figure) may also be displayed simultaneously with the display of the highlight focus frame 904, and the small sun icon may automatically disappear after a period of time.

It should be understood that the interface in Figure 18 is described in the video recording mode as an example, and the embodiment of the present application is not limited thereto. For example, in the photo preview interface, a prompt can also be given through the second prompt box.

FIG19 shows an example of an interface after the target focus object (or locked target) disappears. As shown in FIG19 (1), the interface shows the 5th second of the video recording, and the target face A locked by the user is shown in the screen (for example, the target focus object A shown in FIG17 (3)), and the locked target A is focused using the focus frame 904.

After the locked target disappears, the focus tracking frame in the interface display also disappears accordingly. For example, FIG. 19 (2) shows the picture at the 12th second of the video recording, when the locked target A is lost, and the focus tracking frame for the locked target A in the interface also disappears accordingly.

Furthermore, after the target is lost, if the target is restored and reappears in the camera image within a preset time (for example, the preset time can be 30 seconds), the focus tracking frame is still used to lock and focus the registered face B; if the preset time is exceeded, the target will not be focused on when the target is restored. For example, FIG19 (3) shows the image at the 20th second of the video recording, and the target A appears again. The focus tracking frame 904 appears again in the interface to focus on the target A.

When a user chooses to lock a target or track a target, the user may click on a recognizable target or an unrecognizable target. The following will explain this in conjunction with the interface.

FIG20 is an example of an interface for clicking on a recognizable target in a video recording scene. As shown in FIG20 (1), the video preview interface includes an unregistered face A and a registered face B. The unregistered face A is focused using a conventional focus frame 901, and the registered face B is focused using a main character tracking focus frame 902. When the user clicks the start video recording control 1801, the mobile phone starts recording. For example, the interface is shown in FIG20 (2). In the 5th second recording screen, only the main character tracking focus frame 902 for the registered face B is displayed in the video recording interface.

As the object being filmed changes, other objects may appear in the video recording interface. For example, as shown in (3) of FIG. 20, in the 12th second recording screen, object C appears in the screen, and the user clicks on object C. If object C is a recognizable target (for example, object C is a ball), object C will be focused on as a locked target. For example, in response to the user clicking on object C, the mobile phone displays an interface as shown in (4) of FIG. 20. As shown in (4) of FIG. 20, a highlight focus frame 904 (corresponding to the third focus frame) and a small sun icon 905 (corresponding to the first icon) are used for object C, and other focus frames disappear, that is, the main focus frame 902 of the registered face B disappears. As object C moves, the highlight focus frame also moves accordingly. For example, the interface is shown in (5) of FIG. 20. In the 20th second screen, only the highlight focus frame 904 of object C is displayed, the small sun icon 905 disappears, and other focus frames also disappear, that is, object C is used as a locked focus target.

FIG. 21 is an example of the interface for clicking on an unrecognizable target in a video recording scene. As shown in (1) in FIG. 21 , in the 12th second recording screen, the registered face B is displayed in the interface, and the main character tracking focus frame 902 is used to track the registered face B. When the user clicks on the first area in the recording screen, the first area is a blank background of the screen (i.e., there is no object or person to be locked), and the mobile phone determines that the first area is an unrecognizable target, then the interface is displayed as shown in (2) in FIG. 21 . As shown in (2) in FIG. 21 , in the 12th second recording screen, the non-highlighted tracking focus frame 906 (corresponding to the fourth tracking focus frame) and the small sun icon 907 (corresponding to the second icon), and the other tracking focus frames disappear, that is, the main character tracking focus frame 902 of the registered face B disappears.

When the user clicks on the target person (such as registered face B) again, the focus can continue to be tracked on face B. For example, the interface display is shown in (3) of Figure 21. In the recording screen at the 15th second, the registered face B is displayed again in the interface. The main character focus frame 902 is used to track the registered face B, and the non-highlight focus frame 906 and the small sun icon 907 for the first area disappear.

It should be noted that the embodiment of the present application does not specifically limit the method of adjusting the exposure. In one implementation, the exposure can be adjusted by adjusting the small sun icon 907. In another implementation, the exposure can also be adjusted by sliding the screen up and down.

Figure 22 is an example of the interface for long pressing an unrecognizable target in a video recording scene. As shown in (1) in Figure 22, at the 5th second In the recorded screen, the interface displays the registered face B, and the main character tracking focus frame 902 is used to track the registered face B. When the user long presses the first area in the recorded screen, the first area is the screen background, and the mobile phone determines that the first area is an unrecognizable target, then the interface is displayed as shown in (2) in Figure 22.

As shown in (2) in Figure 22, in the recording screen at the 12th second, a non-highlighted focus frame 906 (corresponding to the fourth focus frame) and a small sun icon 907 (corresponding to the second icon) are displayed in the first area, and other focus frames disappear (that is, the focus frame 902 of the protagonist of the registered face B disappears), and “Exposure and focus are locked” is displayed on the screen.

When the user clicks on another area or the target person again, the focus lock state of the first area can be released. For example, as shown in the interface (3) of Figure 22, in the 13th second recording screen, the mobile phone responds to the user clicking on a certain area in the screen again, and focuses on the area clicked by the user again. For example, as shown in the screen (4) of Figure 22, in the 14th second recording screen, the highlighted focus frame 904 and the small sun icon 905 are displayed in the area clicked by the user, and the non-highlighted focus frame 906 and the small sun icon 907 for the first area disappear.

Optionally, if the user does not perform any operation after a period of time, the automatic focus tracking will be restored. For example, in the interface shown in (5) of FIG. 22 , in the recording screen at the 15th second, the automatic focus tracking is performed again on the registered face B in the recording screen.

It can be understood that the area of the screen that the user clicks or long presses may contain an object or a face, or it may be the background of the screen, and the background of the screen does not contain a recognizable object. The operation of the user clicking or long pressing the area of the screen can be understood as the object or person that the user wants to select for focus tracking.

Optionally, when focusing on the target focusing object, the method further includes: receiving an operation of sliding the screen by the user; and adjusting the exposure of the picture accordingly in response to the operation of sliding the screen.

Exemplarily, the user sliding the screen includes sliding the screen upward or downward. When the user slides the screen upward, the exposure of the picture is increased; when the user slides the screen downward, the exposure of the picture is reduced.

In the embodiment of the present application, the exposure of the picture can be adjusted by sliding the screen. The purpose of this setting is that during the focus tracking process, the first focus tracking control (including the third focus tracking frame and the first icon) will move with the target focus tracking object. At this time, it is inconvenient to click the first icon (such as the small sun icon) to adjust the exposure. Therefore, by introducing the operation of sliding the screen to adjust the exposure, the user's exposure adjustment operation experience can be effectively improved. For a moving focus tracking object, this adjustment method by sliding the screen will have a better experience than adjusting the exposure by adjusting the small sun icon.

Optionally, in some implementations, after the user locks on the target, a first guidance may be provided, prompting the user to slide the screen up and down to adjust the exposure. For example, when previewing a photo, when the user first clicks on the tracking target, a prompt may be provided, and the prompt content "Slide up and down to adjust the exposure" may be displayed in the interface. Optionally, the prompt content may disappear automatically after 3 seconds.

Optionally, when adjusting the exposure for the first time, the user can be guided by an exposure adjustment prompt box. For example, after the user selects the target tracking object and a small sun icon appears on the screen, the phone can also display an exposure adjustment prompt box on the screen to inform the user that they can slide the screen up and down to adjust the exposure.

Optionally, the exposure adjustment prompt box may automatically disappear after a period of time, for example, 3 seconds.

Figure 23 shows a schematic diagram of the interface for adjusting exposure by sliding the screen in the photo preview interface. As shown in (1) of Figure 23, in the photo preview interface, a highlighted focus frame 904 is used to focus on the object selected by the user, and a small sun icon 905 is also displayed for adjusting exposure.

Optionally, the content in the dotted box 2301 in the interface of (2) in FIG. 23 can be used to guide the user on how to adjust the exposure. The dotted box 2301 includes an upward or downward arrow and a prompt text "Slide up and down to adjust the exposure". For example, the content in the dotted box 2301 may automatically disappear after 3 seconds.

Optionally, the content in the dashed box 2301 can be highlighted for user viewing.

As shown in (3) of Figure 23, the user can slide the screen downward to adjust the exposure. The interface shown in FIG. 23 (4) is displayed, and an exposure bar 908 appears in the interface. For example, the exposure is adjusted to -0.5 by sliding the screen downward. After the adjustment is completed, the user releases the screen, the exposure bar 908 disappears, and the interface shown in FIG. 23 (5) is displayed. In the interface shown in FIG. 23 (5), the mobile phone continues to lock and focus on the object 904.

FIG. 24 is a schematic diagram showing an interface for adjusting exposure by sliding the screen during video recording.

As shown in (1) of FIG. 24 , in the 12th second recording screen, the object selected by the user (such as the sphere shown in the figure) is focused using a highlight focus frame 904, and a small sun icon 905 is also displayed for adjusting the exposure. Since the selected sphere will move during the recording process, the highlight focus frame 904 and the small sun icon 905 will also shift with the moving sphere. Therefore, it is not very convenient to adjust the exposure by clicking the small sun icon 905. For this reason, the embodiment of the present application can adjust the exposure by sliding the screen up and down.

When the user slides the screen downward, the interface is shown as shown in FIG24 (2). In the 18th second recording screen, an exposure bar 908 appears in the interface. For example, the exposure is adjusted to -0.5 by sliding the screen downward. After the adjustment, the user lets go of the screen, the exposure bar 908 disappears, and the interface is shown as shown in FIG24 (3). In the interface shown in FIG24 (3), the mobile phone continues to lock the object with a highlighted focus frame 904, and a small sun icon 905 is also displayed for adjusting the exposure.

It should be understood that the interface shown in FIG. 24 is merely an example description and the embodiments of the present application are not limited thereto.

The focus object actively selected by the user may move. In some possible implementations, when the target focus object is a person, if the face of the target focus object cannot be recognized during the continuous focus tracking of the target object selected by the user, the face frame (or face frame) is converted to a human frame; when the face of the target focus object is re-recognized, the human frame is still displayed.

When the face of the target object is re-identified, the human body frame is still used to track the target object, which can avoid the problem of switching back and forth between the face frame and the human body frame.

Figure 25 shows an example of an interface showing the focus frame changes when the face of the target focus object disappears. In the video preview interface shown in (1) of Figure 25, the main focus frame 902 is used for focus tracking on the registered face B, and the conventional focus frame 901 is used for focus tracking on the non-registered face A.

When the user clicks on face A, the interface is displayed as shown in FIG25 (2), and the mobile phone uses a highlight focus frame 2302 to track face A, that is, face A is taken as the target tracking object or locked target. In FIG25 (2), the highlight focus frame 2302 is a face tracking focus frame (referred to as face frame).

(2) in FIG. 25 also includes a video recording control 2301. After the user clicks the start video recording control 2301, the mobile phone starts recording, and the interface is displayed as shown in (3) in FIG. 25. For example, in the recording screen of the first second, a highlight focus frame 2302 is used to continuously focus on face A.

As the locked target moves or turns around, the mobile phone may not be able to recognize the face of the locked target, but can recognize the human body. At this time, the face frame can be converted to the human body frame to continue tracking. For example, as shown in the interface (4) in Figure 25, when the locked target turns around, the face tracking focus frame 2302 for face A will be converted to the human body tracking focus frame 2303 (referred to as the human body frame). Moreover, even after the face of face A is restored or re-recognized, the human body continues to be tracked and is no longer switched to the face frame. For example, as shown in the picture (5) in Figure 25, when the face of face A can be recognized, the human body frame 2303 is still used for tracking. The advantage of this is that it can avoid the problem of switching back and forth between the face frame and the human body frame, thereby reducing interference to the user and improving the shooting experience.

In some possible implementations, during continuous focusing on a focus target (the focus target may refer to the first registered object, or the protagonist), if it is recognized that the face of the focus target occupies a smaller proportion than a first threshold on the screen, the first focus frame is switched from a face frame to a body frame; if it is recognized that the face of the focus target occupies a greater proportion than or equal to the first threshold on the screen, the first focus frame is switched from a body frame to a face frame.

The embodiment of the present application does not specifically limit the value of the first threshold, and the first threshold can be set based on actual needs.

The embodiments of the present application do not specifically limit the algorithm for identifying a human body or a human face. For example, a facial recognition algorithm can be used to accurately identify the user's facial features. For another example, a skeleton algorithm can be used to accurately identify the user's torso.

Optionally, the switching between the face frame and the body frame may be enhanced with an animation effect so that the frame switching is smoother and the user's visual experience is enhanced.

Referring to Figure 26, Figure 26 shows an example of an interface in which the focus frame changes when the focus target switches between near and far. In the interface shown in (1) of Figure 26, during the recording process, the main character focus frame 2401 (or face focus frame, abbreviated as face frame) is used to automatically focus on the registered face B identified.

As shown in the interface (2) of FIG. 26 , when the focus target (or registered face B) moves too far to be recognized, the human body frame 2402 is used to automatically focus on the person.

As shown in the interface (3) of FIG. 26 , as the target moves from far to near, when the person approaches the camera sufficiently close to the camera, the focus is switched from the human body frame 2402 to the face frame 2401 to track the face B.

The embodiment of the present application does not specifically limit the size of the focus tracking frame. Here is a unified explanation, and the focus tracking frame mentioned here can be various types of focus tracking frames in the embodiment of the present application. For example, the first focus tracking frame, the second focus tracking frame, the third focus tracking frame, the fourth focus tracking frame, the protagonist focus tracking frame, the non-protagonist focus tracking frame, the face focus tracking frame, etc. Some focus tracking frames can be used interchangeably in different scenarios. For example, the protagonist focus tracking frame 2401 mentioned in (1) of Figure 26 can also be called a face focus tracking frame.

Optionally, the size of the tracking focus frame may depend on the proportion of the subject in the screen and the posture of the subject. For example, for the subject, the tracking focus frame may be a face tracking focus frame, a body tracking focus frame, or a torso tracking focus frame.

In some possible implementations, for a face tracking focus frame, the size of the face tracking focus frame may be related to the proportion of the face in the screen.

FIG27 shows a schematic diagram of a double frame of face tracking focus frames of different sizes. When tracking the focus of a registered face, the face tracking focus frame 2501 shown in FIG27 (1) and the face tracking focus frame 2502 shown in FIG27 (2) can be adjusted in real time based on the size of the registered face (or the proportion of the registered face in the screen). It can be seen that the face tracking focus frame 2501 and the face tracking focus frame 2502 are tracking focus frames of different sizes.

It should be understood that the interface shown in FIG. 27 is an example of the interface during the video recording process, and the embodiments of the present application are not limited to this.

It should also be understood that the face tracking focus frame shown in FIG. 27 is illustrated by taking a double frame as an example, and the embodiments of the present application are not limited to this. In fact, in the case where the face tracking focus frame is a single frame, the size of the face tracking focus frame may also be related to the proportion of the face in the screen. Optionally, the face tracking focus frame is a single frame, including: a tracking focus frame used when tracking the target tracking object selected by the user. For example, the third tracking focus frame mentioned above.

FIG28 shows a schematic diagram of a single frame of face tracking focus frames of different sizes. When tracking the focus of a registered face, the face tracking focus frame 2503 shown in FIG28 (1) and the face tracking focus frame 2504 shown in FIG28 (2) can be adjusted in real time based on the size of the registered face (or the proportion of the registered face in the screen). It can be seen that the face tracking focus frame 2503 and the face tracking focus frame 2504 are tracking focus frames of different sizes.

In some possible implementations, for the human body tracking focus frame, the size of the human body tracking focus frame may be related to the proportion of the human body (or the human body's torso) in the screen or the human body's posture. For different states of the human body, the human body tracking focus frame can identify and track the human body (or the human body's torso). For example, when the user is in postures such as yoga, exercise, and standing, the mobile phone can use a tracking focus frame of a suitable size to identify and track the human body (or the human body's torso).

FIG29 shows a schematic diagram of human body tracking focus frames of different sizes. As shown in FIG29 (1), human body tracking focus frame 2601, As shown in Figure 29 (2) human body tracking focus frame 2602, as shown in Figure 29 (3) human body tracking focus frame 2603, and as shown in Figure 29 (4) human body tracking focus frame 2604, when tracking the focus on the human body, the human body can be identified and the human body tracking focus frame can be adjusted in real time based on the identified human body (or the proportion of the torso in the screen). It can be seen that human body tracking focus frame 2601, human body tracking focus frame 2602, human body tracking focus frame 2603, and human body tracking focus frame 2604 are tracking focus frames of different sizes.

Please refer to Figure 30, which is a schematic flow chart of a shooting method provided in an embodiment of the present application. As shown in Figure 30, the method includes:

Step 1101, in response to a first operation of the user, entering a photo taking mode or a video recording mode.

For example, as shown in ( 1 ) of FIG. 3 , the first operation is an operation in which the user clicks the camera 401 .

For another example, as shown in (1) in FIG. 13 , the first operation is an operation in which the user clicks on the recording mode.

Step 1102, when a single registered object or multiple registered objects are identified, a first interface is displayed, wherein the first interface includes the first registered object and a first focus tracking frame (for example, a protagonist focus tracking frame), wherein the first focus tracking frame is used to perform protagonist focus on the first registered object, and the first focus tracking frame does not disappear after a preset time period, wherein the first focus tracking frame is used to perform protagonist focus on the first registered object means that when the first registered object moves in the picture, the first focus tracking frame moves with the first registered object.

In an embodiment of the present application, when a single registered object or multiple registered objects are identified, the first focusing frame can be used to perform protagonist tracking (or continuous focusing) on the first focusing object. Moreover, in the process of continuous focusing, compared to the conventional focusing frame that automatically disappears after a preset time period, the first focusing frame does not disappear after the preset time period. Of course, the premise that the first focusing frame does not disappear after the preset time period is that the first registered object can be identified, or the first registered object is always in the picture. In addition, the first focusing frame is used to perform protagonist tracking on the first registered object, which means that when the first registered object moves in the picture, the first focusing frame moves with the first registered object. By introducing the first focusing frame, intelligent focusing of the photographed object can be achieved, improving the shooting experience.

For example, the first focus frame is the protagonist focus frame 902 shown in FIG. 10 above, and the first registered object is the face B in FIG. 10 .

Optionally, as a possible implementation, in the case where a single registered object is identified, the first registered object is the single registered object. For example, the shooting scene shown in FIG10 is a case where a single registered object is identified.

Optionally, as a possible implementation manner, in the case where multiple registered objects are identified, the first registered object is a target object that meets a preset condition among the multiple registered objects.

Optionally, as a possible implementation, in the case where multiple registered objects are identified, the first registered object is the object with the highest proportion of faces in the first interface among the multiple registered objects. For example, in the case where the shooting scene shown in FIG11 is multiple registered objects, the first registered object is face B, that is, the face closest to the camera.

Optionally, as a possible implementation, in the case where multiple registered objects are identified, the first interface further includes multiple second focus tracking frames, and the multiple second focus tracking frames are used to focus on registered objects other than the first registered object among the multiple registered objects, wherein the second focus tracking frame has a different color from the first focus tracking frame. For example, the second focus tracking frame is the non-protagonist focus tracking frame 903 shown in (1) of FIG. 11 above.

Optionally, as a possible implementation method, when an unregistered object is identified, the first interface also includes a conventional focus frame, and the conventional focus frame is used to focus on the unregistered object, and the conventional focus frame automatically disappears after the preset time period; wherein, the difference between the first tracking focus frame and the conventional focus frame is reflected in one or more of the following factors: color, frame type, lines, and display duration. For example, the unregistered object is face A in Figure 11, and the conventional focus frame is conventional focus frame 901 in Figure 11. Therefore, the first tracking focus frame of the embodiment of the present application is significantly different from the conventional focus frame, and the first tracking focus frame can be used to achieve continuous tracking of the protagonist.

Optionally, as a possible implementation manner, the first focus tracking frame is a double frame.

Optionally, as a possible implementation, for the photo mode, the first interface is a photo preview interface, wherein the first operation is an operation of starting a camera application. For example, the interface shown in FIG10 or FIG11 is an interface in the photo mode.

Optionally, as a possible implementation, for the video recording mode, the first interface is a video recording preview interface, wherein the first operation is an operation of switching to the video recording mode. For example, the interface shown in FIG13 is an interface in the video recording mode.

Optionally, as a possible implementation manner, the method further includes:

In response to the user clicking the recording control, a video recording interface is displayed, and the video recording interface includes the first registered object and the first focus frame.

Optionally, as an embodiment, during the video recording process, the method further includes: during the continuous tracking of the first registered object, if it is recognized that the proportion of the face of the first registered object in the screen is less than a first threshold, the first tracking frame is switched from the face frame to the human frame; if it is recognized that the proportion of the face of the first registered object in the screen is greater than or equal to the first threshold, the first tracking frame is switched from the human frame to the face frame. For example, the change of the first tracking frame can refer to the interface shown in Figure 26, and the first registered object is the face B in Figure 26.

Optionally, as an embodiment, during the video recording process, the method further includes: during the continuous tracking of the first registered object, if the first registered object cannot be recognized, the first tracking frame disappears in the video recording interface, and the actually recognized face is tracked or focused; if the first registered object is recognized and restored, the first tracking frame continues to be displayed in the video recording interface. For example, Figure 13 (5) and Figure 13 (6) show examples of interfaces where registered face B disappears and is restored.

Optionally, before displaying the first interface, the method further includes: turning on a “protagonist tracking focus” function.

Optionally, as an embodiment, enabling the "main character tracking focus" function includes: in response to a user clicking on the "main character tracking focus" option in the camera setting interface, enabling the "main character tracking focus" function, wherein when it is detected that the portrait data in the gallery has been generated, the "main character tracking focus" option is in an available state. For example, as shown in FIG7 (2), the user clicks on the "main character tracking focus" option 405 to enable the "main character tracking focus" function.

Optionally, as an embodiment, when the camera application is opened, if it is detected that the portrait data in the gallery has been generated, a first pop-up window (for example, window 801 shown in (3) of FIG8 ) is displayed in the camera preview interface, and the first pop-up window includes an option to turn on or off the “main character tracking focus” function; wherein, turning on the “main character tracking focus” function includes: in response to the user clicking the turn-on option in the first pop-up window, turning on the “main character tracking focus” function. For example, as shown in (3) of FIG8 , when the user clicks the turn-on option in window 801, the “main character tracking focus” function is turned on.

Optionally, as an embodiment, when the "main character tracking focus" function is turned on for the first time, the method further includes: displaying a first prompt box in the first interface, the first prompt box being used to prompt the user that the main character tracking focus has been identified. For example, the first prompt box is prompt box 802 shown in (4) of FIG. 9 .

Optionally, as an embodiment, the method further includes:

receiving a second operation of the user, where the second operation is used to select a target focus tracking object;

Displaying a second interface; when the target focus object is a recognizable target, the second interface includes a first focus control, the first focus control includes a third focus frame and a first icon, the first icon is used to adjust exposure, and the third focus frame is used to focus on the target focus object;

When the target focus object is an unrecognizable target, the second interface includes a second focus control, the second focus control includes a fourth focus frame and a second icon; the second icon is used to adjust the exposure, and the fourth focus frame is used to focus on the target focus object, wherein the fourth focus frame is different in color from the third focus frame, and the fourth focus frame is different in color from the third focus frame. The first icon has a different color from the second icon.

It should be noted that, whether in photo mode or video mode, there may be human intervention in selecting the target focus object. For example, Figures 14 to 16 above show scenes with human intervention in photo mode; Figures 17 and 18 show scenes with human intervention in video mode.

Optionally, as an embodiment, when performing focus tracking on the target focus tracking object, the method further includes:

Receive the user's screen sliding operation;

In response to the operation of sliding the screen, the exposure of the picture is adjusted accordingly. For example, FIG23 shows an interface for adjusting exposure.

Optionally, as an embodiment, when the target focus object is a recognizable target and the target focus object is focused using the third focus frame, the method further includes: displaying a second prompt frame, the second prompt frame being used to prompt the user that the focus target has been locked. For example, the second prompt frame is the prompt frame 920 shown in (3) of FIG. 18 .

Optionally, as an embodiment, the target focus tracking object is a person, and in the process of continuously tracking the target focus tracking object, the method further includes: if the face of the target focus tracking object cannot be recognized, converting the face frame into a human frame; when the face of the target focus tracking object is re-recognized, still displaying the human frame. For example, FIG25 shows an interface of the focus tracking frame change when the face of the target focus tracking object disappears.

The software system of the electronic device 100 is described below in conjunction with Figure 31.

Figure 31 is a schematic diagram of the architecture (including software system and some hardware) of the application of the embodiment of the present application. As shown in Figure 31, the application architecture is divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the application architecture can be divided into five layers, from top to bottom, respectively, the application layer, the application framework layer, the hardware abstraction layer HAL, the kernel driver layer (kernel) and the hardware layer.

As shown in FIG31 , the application layer includes a camera. It is understood that FIG31 shows some applications. In fact, the application layer may also include other applications (including system applications and/or third-party applications), which is not limited in this application. For example, the application layer also includes applications such as gallery, information, alarm clock, weather, stopwatch, compass, timer, flashlight, calendar, and Alipay.

FIG31 is a schematic diagram of the architecture (including software system and some hardware) of the application of the embodiment of the present application. As shown in FIG31, the application architecture is divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the application architecture can be divided into five layers, from top to bottom, respectively, the application layer, the application framework layer, the hardware abstraction layer HAL, the driver layer (driver) and the hardware layer.

As shown in Figure 31, the application layer includes a camera APP and a gallery APP. In some embodiments, the gallery can transmit the image data to the camera application. In some embodiments, the registered face of the embodiment of the present application can be determined by the image data in the APP.

Optionally, based on the portrait data in the gallery, a preset number of faces with the highest appearance frequency in the album are selected as registered faces.

It is understandable that what is shown in FIG31 are some applications. In fact, the application layer may also include other applications, which is not limited in this application. For example, the application layer also includes information, alarm clock, weather, stopwatch, compass, timer, flashlight, calendar, Alipay and other applications.

As shown in FIG. 31 , the application framework layer includes a camera access interface. The camera access interface includes camera management and camera devices. The hardware abstraction layer includes a camera hardware abstraction layer and a camera algorithm library. The camera hardware abstraction layer includes multiple camera devices. The camera algorithm library includes an algorithm processing module.

The driver layer is used to drive hardware resources. The driver layer can include multiple driver modules. As shown in Figure 31, the driver layer includes Camera device drivers, digital signal processor drivers, and graphics processor drivers, etc.

The hardware layer includes sensors, image signal processors, digital signal processors, and graphics processors. The sensors include multiple sensors, TOF cameras, and multi-spectral sensors.

For example, a user may click on a camera application. When the user clicks on the camera to take a photo, the photo taking instruction may be sent to the camera hardware abstraction layer through the camera access interface. The camera hardware abstraction layer calls the camera device driver and calls the camera algorithm library. The camera algorithm library may send relevant processing parameters to the camera hardware abstraction layer. The camera hardware abstraction layer sends the parameters to the camera device driver. The camera device driver sends the parameters sent by the camera hardware abstraction layer to the hardware layer. The sensor outputs the image based on the sensor output mode. The image signal processor performs corresponding processing based on the parameter configuration of each ISP module. The camera algorithm library is also used to send digital signals to the digital signal processor driver in the driver layer so that the digital signal processor driver calls the digital signal processor in the hardware layer for digital signal processing. The digital signal processor may return the processed digital signal to the camera algorithm library through the digital signal processor driver. The camera algorithm library is also used to send digital signals to the graphics signal processor driver in the driver layer so that the graphics signal processor driver calls the graphics processor in the hardware layer for digital signal processing. The graphics processor may return the processed graphics data to the camera algorithm library through the graphics processor driver.

In addition, the image output by the image signal processor can be sent to the camera device driver. The camera device driver can send the image output by the image signal processor to the camera hardware abstraction layer. The camera hardware abstraction layer can send the image to the post-processing algorithm module for further processing, or send the image to the camera access interface. The camera access interface can send the image returned by the camera hardware abstraction layer to the camera.

The above text describes in detail the shooting method provided by the embodiment of the present application in conjunction with Figures 1 to 31. The following will describe the device embodiment of the present application in conjunction with Figure 32. It should be understood that the shooting device of the embodiment of the present application can execute the shooting method of the aforementioned embodiment of the present application, that is, the specific working process of the following various products can refer to the corresponding process in the aforementioned method embodiment.

Fig. 32 is a schematic block diagram of a photographing device 3200 according to an embodiment of the present application. It should be understood that the device 3200 can execute the photographing method shown above.

As shown in Fig. 32, the apparatus 3200 includes: an input unit 3210, a processing unit 3220, and a display unit 3230. The apparatus 3200 may be an electronic device.

Optionally, the input unit 3210 is used to receive a first operation of a user;

The processing unit 3220 is used to enter a photo taking mode or a video recording mode in response to a first operation of the user;

The display unit 3230 is used to display a first interface when a single registered object or multiple registered objects are identified. The first interface includes a first registered object and a first focus frame. The first focus frame is used to focus on the first registered object, and the first focus frame does not disappear after a preset time.

Optionally, as a possible embodiment, in the case where a single registered object is identified, the first registered object is the single registered object; or, in the case where multiple registered objects are identified, the first registered object is a target object among the multiple registered objects that meets a preset condition.

Optionally, as a possible embodiment, in the case where multiple registered objects are identified, the first interface also includes multiple second focus frames, and the multiple second focus frames are used to focus on the multiple registered objects except the first registered object, wherein the second focus frame is different in color from the first focus frame.

Optionally, as a possible embodiment, in the case where multiple registered objects are identified, the first registered object is the object with the highest face ratio in the first interface among the multiple registered objects.

Optionally, as a possible embodiment, taking the registration object as a registered face as an example, the registered face can be determined through image data in the gallery APP.

Optionally, as a possible embodiment, based on the portrait data of the gallery, the person who appears most frequently in the album is automatically selected. A preset number of faces are selected as registered faces.

Optionally, as a possible embodiment, according to the user's own choice, a preset number of faces in the album are added as registered faces.

Optionally, as a possible embodiment, when an unregistered object is identified, the first interface further includes displaying a conventional focus frame, the conventional focus frame is used to focus on the unregistered object, and the conventional focus frame automatically disappears after a preset time period;

Among them, the difference between the first tracking focus frame and the conventional focus frame is reflected in one or more of the following factors: color, frame type, lines, and display duration.

Optionally, as a possible embodiment, the first tracking focus frame is a double frame, and the conventional focus frame is a single frame.

Optionally, as a possible embodiment, for a photo taking mode, the first interface is a photo taking preview interface, wherein the first operation is an operation of starting a camera application.

Optionally, as a possible embodiment, for the video recording mode, the first interface is a video recording preview interface, wherein the first operation is an operation of switching to the video recording mode.

Optionally, as a possible embodiment, the display unit 3230 is also used to display a video recording interface in response to a user clicking a recording control, where the video recording interface includes the first registered object and the first focus frame.

Optionally, as a possible embodiment, during the video recording process, during the continuous tracking focus process of the first registered object, if it is recognized that the proportion of the face of the first registered object in the screen is less than a first threshold, the first tracking focus frame is switched from the face frame to the body frame;

If it is recognized that the proportion of the face of the first registered object in the screen is greater than or equal to a first threshold, the first focus frame is switched from a human body frame to a face frame.

Optionally, as a possible embodiment, during the video recording process, during the continuous tracking focus process of the first registered object, if the first registered object cannot be recognized, the first tracking focus frame also disappears in the video recording interface, and the actually recognized face is tracked or focused;

If it is recognized that the first registered object is restored, the first focus frame continues to be displayed in the video recording interface.

Optionally, as a possible embodiment, before displaying the first interface, the processing unit 3220 is also used to enable a “protagonist tracking focus” function.

Optionally, as a possible embodiment, the processing unit 3220 is used to enable the “main character tracking focus” function, including:

In response to a user clicking on a "main character tracking focus" option in a camera setting interface, the "main character tracking focus" function is turned on, wherein when it is detected that portrait data in a gallery has been generated, the "main character tracking focus" option is in an available state.

Optionally, as a possible embodiment, the display unit 3230 is further configured to display a first pop-up window on the camera preview interface when the camera application is opened and if it is detected that the portrait data in the gallery has been generated, the first pop-up window includes an option to turn on or off the "main character tracking focus" function;

The processing unit 3220 is used to enable the “main character tracking focus” function, including:

In response to the user clicking on the enable option in the first pop-up window, the "main character tracking" function is enabled.

Optionally, as a possible embodiment, when the “main character tracking focus” function is enabled for the first time, the method further includes:

The display unit 3230 is further configured to display a first prompt box in the first interface, wherein the first prompt box is configured to prompt the user that the focus on the protagonist has been identified.

Optionally, as a possible embodiment, the input unit 3210 is further used to receive a second operation of the user, where the second operation is used to select a target focus tracking object;

The display unit 3230 is also used to display a second interface; when the target focus object is a recognizable target, the second interface includes a first focus control, the first focus control includes a third focus frame and a first icon, the first icon is used to adjust the exposure, and the third focus frame is used to focus on the target focus object; when the target focus object is an unrecognizable target, the second interface includes a second focus control, the second focus control includes a fourth focus frame and a second icon; the second icon is used to adjust the exposure, and the fourth focus frame is used to focus on the target focus object, wherein the fourth focus frame is different in color from the third focus frame, and the first icon is different in color from the second icon.

Optionally, as a possible embodiment, when focusing on the target focusing object, the input unit 3210 is further used to receive an operation of sliding the screen by the user;

The processing unit 3220 is further configured to adjust the exposure of the picture accordingly in response to the operation of sliding the screen.

Optionally, as a possible embodiment, when the target focus object is a identifiable target and the third focus frame is used to focus on the target focus object, the display unit 3230 is also used to display a second prompt frame, and the second prompt frame is used to prompt the user that the focus target has been locked.

Optionally, as a possible embodiment, the target focus tracking object is a person, and in the process of continuously tracking the target focus tracking object, the processing unit 3220 is further configured to:

If the face of the target focus object cannot be recognized, the face frame is converted into a body frame;

When the face of the target focus object is re-identified, the human body frame is still displayed.

Optionally, as a possible embodiment, the processing unit 3220 is further configured to:

During the continuous tracking of the focus on the first registered object, if it is recognized that the face of the tracking target occupies less than a first threshold in the screen, the first tracking frame is switched from the face frame to the body frame;

If it is recognized that the face of the focus target occupies a proportion greater than or equal to a first threshold in the screen, the first focus frame is switched from a human body frame to a face frame.

In a possible example, the input unit 3210 and the processing unit 3220 may be implemented by a processor or a processing unit, and the display unit 3230 may be implemented by a display screen. It should be understood that the above-mentioned device 3200 is embodied in the form of a functional unit. The term "unit" here may be implemented in the form of software and/or hardware, and this embodiment of the application does not specifically limit this.

For example, a "unit" may be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor, etc.) and a memory that executes one or more software or firmware programs, an integrated logic circuit, and/or other suitable devices that can provide the above functions. In a simple embodiment, those skilled in the art can imagine that the device 3200 can take the form shown in Figure 2.

Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

The present application also provides a computer program product, which, when executed by a processor, implements the method described in any method embodiment of the present application.

The computer program product can be stored in a memory, and is finally converted into an executable target file that can be executed by a processor after preprocessing, compiling, assembling and linking.

The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a computer, the method described in any method embodiment of the present application is implemented. The computer program can be a high-level language program or an executable target program.

The computer readable storage medium may be a volatile memory or a nonvolatile memory, or may include both a volatile memory and a nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM).

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described devices and equipment and the technical effects produced can refer to the corresponding processes and technical effects in the aforementioned method embodiments, and will not be repeated here.

In several embodiments provided in the present application, the disclosed systems, devices and methods can be implemented in other ways. For example, some features of the method embodiments described above can be ignored or not executed. The device embodiments described above are merely schematic, and the division of units is only a logical function division. There may be other division methods in actual implementation, and multiple units or components may be combined or integrated into another system. In addition, the coupling between the units or the coupling between the components may be direct coupling or indirect coupling, and the above coupling includes electrical, mechanical or other forms of connection.

It should be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

In addition, the terms "system" and "network" are often used interchangeably in this article. The term "and/or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and/or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character "/" in this article generally indicates that the associated objects before and after are in an "or" relationship.

The terms (or numbers) "first", "second", ..., etc. that appear in the embodiments of the present application are only used for descriptive purposes, that is, only to distinguish different objects, such as different "operations", etc., and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first", "second", ..., etc. may explicitly or implicitly include one or more features. In the description of the embodiments of the present application, "at least one (item)" refers to one or more. "Multiple" means two or more. "At least one of the following (items)" or similar expressions thereof refers to any combination of these items, including any combination of a single (item) or a plurality of (items).

For example, the meaning of the expression similar to "the item includes at least one of the following: A, B, and C" in the embodiments of the present application, unless otherwise specified, generally means that the item can be any one of the following: A; B; C; A and B; A and C; B and C; A, B and C; A and A; A, A and A; A, A and B; A, A and C, A, B and B; A, C and C; B and B, B, B and B, B and C, C and C; C, C and C, and other combinations of A, B and C. The above is an example of three elements, A, B and C, to illustrate the optional items of the item. When it is expressed as "the item includes at least one of the following: A, B, ..., and X", that is, when there are more elements in the expression, the items that can be applied to the item can also be obtained according to the above rules.

In short, the above is only a preferred embodiment of the technical solution of this application, and is not intended to limit the protection scope of this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application should be included in the protection scope of this application.

Claims (22)

A shooting method, characterized in that the method is applied to an electronic device, and the method comprises: In response to a first operation by the user, entering a photo taking mode or a video recording mode; When a single registered object or multiple registered objects are identified, a first interface is displayed, wherein the first interface includes a first registered object and a first focus tracking frame, wherein the first focus tracking frame is used to focus on the first registered object, and the first focus tracking frame does not disappear after a preset time period, wherein the first focus tracking frame is used to focus on the first registered object, which means that when the first registered object moves in the picture, the first focus tracking frame moves with the first registered object. The method according to claim 1 is characterized in that, in the case where a single registered object is identified, the first registered object is the single registered object; or, in the case where multiple registered objects are identified, the first registered object is a target object among the multiple registered objects that meets a preset condition. The method according to claim 1 or 2 is characterized in that, in the case where multiple registered objects are identified, the first interface also includes multiple second focus frames, and the multiple second focus frames are used to focus on the registered objects among the multiple registered objects except the first registered object, wherein the second focus frame has a different color from the first focus frame. The method according to any one of claims 1 to 3 is characterized in that, in the case where multiple registered objects are identified, the first registered object is the object with the highest face ratio in the first interface among the multiple registered objects. The method according to any one of claims 1 to 4, characterized in that when an unregistered object is identified, the first interface further includes a conventional focus frame, the conventional focus frame is used to focus on the unregistered object, and the conventional focus frame automatically disappears after the preset time period; Among them, the difference between the first tracking focus frame and the conventional focus frame is reflected in one or more of the following factors: color, frame type, lines, and display duration. The method according to any one of claims 1 to 5 is characterized in that the first tracking focus frame is a double frame. The method according to any one of claims 1 to 6 is characterized in that, for a photo taking mode, the first interface is a photo taking preview interface, wherein the first operation is an operation of starting a camera application. The method according to any one of claims 1 to 6 is characterized in that, for the video recording mode, the first interface is a video recording preview interface, wherein the first operation is an operation of switching to the video recording mode. The method according to claim 8, characterized in that the method further comprises: In response to the user clicking the recording control, a video recording interface is displayed, and the video recording interface includes the first registered object and the first focus frame. The method according to claim 9, characterized in that, during the video recording process, the method further comprises: During the continuous tracking focus process of the first registered object, if it is recognized that the proportion of the face of the first registered object in the screen is less than a first threshold, the first tracking focus frame is switched from the face frame to the body frame; If it is recognized that the proportion of the face of the first registered object in the screen is greater than or equal to a first threshold, the first focus frame is switched from a human body frame to a face frame. The method according to claim 9, characterized in that, during the video recording process, the method further comprises: During the continuous tracking focus process of the first registered object, if the first registered object cannot be recognized, the first tracking focus frame also disappears in the video recording interface, and the actually recognized face is tracked or focused; If it is recognized that the first registered object is restored, the first focus frame continues to be displayed in the video recording interface. The method according to any one of claims 1 to 11, characterized in that before displaying the first interface, the method further comprises: Turn on the "Protagonist Focus" function. The method according to claim 12, characterized in that the enabling of the "main character tracking focus" function comprises: In response to a user clicking on a "main character tracking focus" option in a camera setting interface, the "main character tracking focus" function is turned on, wherein when it is detected that portrait data in a gallery has been generated, the "main character tracking focus" option is in an available state. The method according to claim 12, characterized in that the method further comprises: When the camera application is opened, if it is detected that the portrait data in the gallery has been generated, a first pop-up window is displayed on the camera preview interface, and the first pop-up window includes an option to turn on or off the "main character tracking focus" function; The enabling of the “main character tracking focus” function includes: In response to the user clicking on the enable option in the first pop-up window, the "main character tracking" function is enabled. The method according to any one of claims 12 to 14, characterized in that, when the "main character tracking focus" function is turned on for the first time, the method further comprises: A first prompt box is displayed in the first interface, and the first prompt box is used to prompt the user that the main character has been identified and the focus is tracked. The method according to any one of claims 1 to 15, characterized in that the method further comprises: receiving a second operation of the user, where the second operation is used to select a target focus tracking object; Displaying a second interface; when the target focus object is a recognizable target, the second interface includes a first focus control, the first focus control includes a third focus frame and a first icon, the first icon is used to adjust exposure, and the third focus frame is used to focus on the target focus object; When the target focus object is an unrecognizable target, the second interface includes a second focus control, the second focus control includes a fourth focus frame and a second icon; the second icon is used to adjust the exposure, and the fourth focus frame is used to focus on the target focus object, wherein the fourth focus frame is different in color from the third focus frame, and the first icon is different in color from the second icon. The method according to claim 16, characterized in that when performing focus tracking on the target focus tracking object, the method further comprises: Receive the user's screen sliding operation; In response to the operation of sliding the screen, the exposure of the picture is adjusted accordingly. The method according to claim 16 or 17, characterized in that, when the target focus tracking object is a recognizable target and the target focus tracking object is focused using the third focus tracking frame, the method further comprises: A second prompt box is displayed, where the second prompt box is used to prompt the user that the focus target has been locked. The method according to any one of claims 16 to 18, characterized in that the target focus tracking object is a person; and in the process of continuously focusing on the target focus tracking object, the method further comprises: If the face of the target focus object cannot be recognized, the face frame is converted into a body frame; When the face of the target focus object is re-identified, the human body frame is still displayed. An electronic device, characterized in that it comprises a processor and a memory, wherein the processor and the memory are coupled, and the memory is used to store a computer program, and when the computer program is executed by the processor, the electronic device executes the method described in any one of claims 1 to 19. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program The computer program, when executed by a processor, causes the processor to perform the method according to any one of claims 1 to 19. A chip, characterized in that it comprises a processor, and when the processor executes instructions, the processor executes the method as described in any one of claims 1 to 19.