[go: up one dir, main page]

WO2019006749A1 - 一种具有摄像头的终端和拍摄方法 - Google Patents

一种具有摄像头的终端和拍摄方法 Download PDF

Info

Publication number
WO2019006749A1
WO2019006749A1 PCT/CN2017/092250 CN2017092250W WO2019006749A1 WO 2019006749 A1 WO2019006749 A1 WO 2019006749A1 CN 2017092250 W CN2017092250 W CN 2017092250W WO 2019006749 A1 WO2019006749 A1 WO 2019006749A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
camera
region
display panel
transparent portion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/092250
Other languages
English (en)
French (fr)
Inventor
徐刚
孙拓
赵宏原
朱家庆
刘康仲
侯锨锠
李昕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to PCT/CN2017/092250 priority Critical patent/WO2019006749A1/zh
Priority to KR1020207000137A priority patent/KR102192809B1/ko
Priority to EP17917157.4A priority patent/EP3624434B1/en
Priority to JP2020500177A priority patent/JP6892549B2/ja
Priority to US16/629,237 priority patent/US11082547B2/en
Priority to CN201780074317.1A priority patent/CN110024366B/zh
Publication of WO2019006749A1 publication Critical patent/WO2019006749A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0264Details of the structure or mounting of specific components for a camera module assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0266Details of the structure or mounting of specific components for a display module assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/52Details of telephonic subscriber devices including functional features of a camera
    • HELECTRICITY
    • H10SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10KORGANIC ELECTRIC SOLID-STATE DEVICES
    • H10K59/00Integrated devices, or assemblies of multiple devices, comprising at least one organic light-emitting element covered by group H10K50/00
    • H10K59/10OLED displays
    • H10K59/12Active-matrix OLED [AMOLED] displays
    • H10K59/121Active-matrix OLED [AMOLED] displays characterised by the geometry or disposition of pixel elements

Definitions

  • the present application relates to the field of terminal technologies, and in particular, to a terminal having a camera and a photographing method.
  • the fingerprint/return function Home button has a scheme to transfer or merge into the screen, and in terms of the front camera, there is no better solution to integrate it with the display area of the screen.
  • One way to imagine this is to cut the screen, cut a portion of the screen, and use the space left by the screen to install components such as the camera.
  • the embodiment of the present application provides a terminal with a camera and a photographing method for integrating the front camera into the display area without affecting the industrial design effect and the overall display effect of the screen.
  • a first aspect of the present application provides a terminal having a camera, including: a processor, a memory, a display panel, and at least one camera; the at least one camera is located behind the display panel; the display panel An area corresponding to the at least one camera position is a first area, and an area outside the first area on the display panel is a second area, wherein each pixel unit of the first area includes a transparent part and a non-transparent portion, each of the pixel units of the second region including the transparent portion and the non-transparent portion, the proportion of the transparent portion in the first region being greater than the transparent portion in the second region proportion.
  • the transparent portion is a transparent glass or a transparent plastic film
  • the non-transparent portion comprises a film disposed in the pixel unit. Part of the transistor device and the metal line.
  • the composition of the transparent portion and the non-transparent portion is refined, so that the embodiment of the present application is more operable.
  • the terminal further includes: a micro motor; the micro motor includes a housing,
  • the terminal further includes: a micro motor; the camera is at least one camera;
  • the micro-motor is physically connected to the camera, and the micro-motor is used to drive the movement of the at least one camera.
  • the number of pixels per pixel possessed by the first region is 1/M of the PPI of the second region, and the M is Greater than 1.
  • the PPI of the first area is 1/M of the PPI of the second area, and M is greater than 1, so that the transparent proportion of the first area is greater than the second area.
  • a pixel circuit without internal compensation is used in the first region, and an internally compensated pixel is used in the second region. Circuit.
  • the pixel circuit without internal compensation is used to increase the transparency ratio, and the implementation manner of the embodiment of the present application is increased.
  • a second aspect of the embodiments of the present application provides a photographing method, which is applicable to a terminal having a camera, the terminal includes a display panel and at least one camera, and the at least one camera is located behind the display panel, An area corresponding to the at least one camera position on the display panel is a first area, and an area outside the first area on the display panel is a second area, wherein each pixel unit of the first area includes a transparent area a partial and non-transparent portion, each of the pixel units of the second region comprising the transparent portion and the non-transparent portion, the proportion of the transparent portion in the first region being greater than the transparency in the second region a part of the ratio, the photographing method includes: acquiring N pictures that are quickly photographed by the camera at different positions relative to the display panel, wherein the N pictures are all blocked by the non-transparent part of the first area.
  • the occlusion area the N is a positive integer greater than 1; the N pictures are processed by an image synthesis method, and the occlusion area is completely
  • the terminal further includes a micro motor, and the micro motor is used for physically connecting with the camera for driving Said at least one camera moves.
  • the N pictures that are captured by the camera at different positions relative to the display panel include: the micro motor drives the at least one camera to move when shooting; during the movement of the at least one camera, the control center The at least one camera quickly captures the N pictures at different positions relative to the display panel; the processing the N pictures by using an image synthesis method comprises: the camera and the moving according to the at least one camera The relative positions of the display panels process the N pictures.
  • multiple pictures can be taken for processing by moving at least one camera on the terminal, and the operation mode of the embodiment of the present application is refined.
  • the camera includes at least two cameras; and the processing the N pictures by using an image synthesis method includes: Pictures taken by at least two cameras complement the occlusion area to process the N pictures.
  • the N photos are processed by the photos captured by the camera, so that the embodiment of the present application is more operable.
  • the method when the picture in which the occlusion area is partially restored is obtained, the method further includes: processing the image by using an image processing algorithm.
  • the picture in which the occlusion area is partially restored is obtained as a picture in which the occlusion area is completely restored.
  • the occlusion area can also be restored by the image processing algorithm, and the implementation manner of the embodiment of the present application is added.
  • the processing, by using an image processing algorithm, the image that is partially restored by the occlusion region comprises: partially restoring the occlusion region
  • the occluded pixels in the picture are interpolated using the information of the neighboring pixels of the occluded pixels.
  • the interpolation operation is performed by using the information of the adjacent pixels to restore the occlusion region, so that the embodiment of the present application is more refined and operable.
  • the processing, by using an image processing algorithm, the partially restored image of the occlusion region includes: restoring the occlusion region to a portion Identifying the physical information of the occluded pixels in the picture; restoring the occlusion area according to the content of the identified physical information Information about occluded pixels in a partially restored picture.
  • the occlusion region is restored according to the physical information processing, and the implementation manner of the embodiment of the present application is added.
  • the PPI of the first area is 1/M of the PPI of the second area, and the M is greater than 1.
  • the method includes: displaying, in the first area, display data of adjacent M pixels into display data of one pixel for display. In this implementation manner, after the PPI is lowered, the display data of the first area is compressed to ensure the display effect.
  • the method further includes: increasing an overall brightness of the first area, such that the first area and the second area The similarity of the brightness curve is greater than the preset value.
  • a pixel circuit without internal compensation is used in the first area, the method further includes: facing the first The pixel unit of the area is externally compensated.
  • external compensation is required to eliminate chromatic aberration.
  • the method further includes: inserting a black frame in the display panel when shooting.
  • a black frame is inserted into the display panel to avoid illumination interference of the display panel in front of the camera.
  • inserting a black frame in the display panel includes: when receiving a shooting instruction, starting to insert black Frame operation; when it is confirmed that the insertion of the black frame operation is completed, the shooting is started; when the instruction to complete the shooting is received, the screen is restored.
  • the timing of adding a black frame is refined, so that the embodiment of the present application is more operable.
  • the black frame is a full-screen black frame; or the black frame is modified to modify the first area to be black.
  • the black frame may be full screen or only the first area, which increases the implementation manner of the embodiment of the present application.
  • a third aspect of embodiments of the present application provides a computer readable storage medium comprising instructions that, when executed on a computer, cause the computer to perform the methods described in the above aspects.
  • a fourth aspect of an embodiment of the present application provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method described in the above aspects.
  • the embodiment of the present application includes: placing the camera behind the pixel area of the screen, and the area in front of the camera is the first area of the pixel area of the display screen.
  • the camera is located behind the pixel area of the screen, ensuring the integrity and normal display of the screen, and the first area in front of the camera has a transparent portion, which ensures the normal shooting of the camera, and achieves the effect of not affecting the industrial design.
  • the front camera is integrated into the display area.
  • FIG. 1 is a block diagram showing a partial structure of a terminal with a camera provided in an embodiment of the present application
  • FIG. 2 is a schematic diagram of a positional relationship between a display panel and a camera in a terminal according to an embodiment of the present application
  • FIG. 3 is a schematic diagram of a pixel unit arrangement in a pixel area according to an embodiment of the present application.
  • FIG. 4 is a schematic diagram of a result of photographing an original picture in the embodiment of the present application.
  • FIG. 5 is a schematic diagram of a picture synthesizing process in an embodiment of the present application.
  • FIG. 6a is a schematic diagram of a camera taking a picture in the embodiment of the present application.
  • 6b is another schematic diagram of taking a picture by a camera in the embodiment of the present application.
  • FIG. 7 is a schematic diagram of an adjusting device for connecting a micro motor and a camera in the embodiment of the present application.
  • FIG. 8 is a schematic diagram of taking pictures by two cameras in the embodiment of the present application.
  • FIG. 9a is a schematic diagram of image processing in an embodiment of the present application.
  • FIG. 9b is another schematic diagram of image processing in the embodiment of the present application.
  • FIG. 10 is a schematic diagram of reducing the number of pixels per inch in the embodiment of the present application.
  • FIG. 11 is a schematic diagram of compressed display data in an embodiment of the present application.
  • FIG. 12 is a schematic structural diagram of a 7T1C circuit according to an embodiment of the present application.
  • FIG. 13 is a schematic structural diagram of a 2T1C circuit according to an embodiment of the present application.
  • FIG. 14 is a schematic flow chart of a photographing method in an embodiment of the present application.
  • FIG. 15 is another schematic flowchart of a photographing method in an embodiment of the present application.
  • the camera can be integrated into the display area to achieve the full screen effect, it is realized by cutting a part of the screen for placing the camera module, which leads to the area where the camera module is placed.
  • the screen display cannot be performed. When the screen is lit, a corner will appear, so the industrial design effect is not ideal, which affects the overall display effect of the screen.
  • the terminal is a user equipment having a display panel and a front camera, and the front camera is mainly placed behind the display panel as compared with the conventional terminal.
  • FIG. 1 is a block diagram of a partial structure of a terminal provided in an embodiment of the present application.
  • the terminal includes: a display panel 101 and at least one camera 102.
  • the terminal may further include: a processor 180 and a memory 120, a wireless fidelity (WIFI) module 170, a radio frequency (RF) circuit 110, an input unit 131, a display unit 140, an audio circuit 160, and a sensor 150. component.
  • WIFI wireless fidelity
  • RF radio frequency
  • the display unit 140 can be used to display an image.
  • the display unit 140 includes a display panel 101.
  • the touch panel 131 may cover the display panel 101, and when the touch panel 131 detects a touch operation on or near it, the touch panel 131 transmits to the processor 180 to determine the type of the touch event, and then the processing
  • the keeper 180 provides a corresponding visual output on the display panel 101 depending on the type of touch event.
  • the touch panel 131 and the same The display panel 101 is implemented as two independent components to implement the input and output functions of the terminal, but in some embodiments, the touch panel 131 can be integrated with the display panel 101 to implement input and output of the terminal.
  • the input unit 130 can be used by the user to perform selection of the target application, feedback for the prompt information, and the like on the setting interface.
  • the input unit 130 may include the touch panel 131 and other input devices 132.
  • the touch panel 131 also referred to as a touch screen, can collect touch operations on or near the user.
  • the touch panel 131 can include two parts: a touch detection device and a touch controller. Wherein the touch detection device detects a touch orientation of the user and detects a signal brought by the touch operation to transmit the signal to the touch controller; the touch controller receives the touch information from the touch detection device and converts the same
  • the contact coordinates are sent to the processor 180 and can receive commands from the processor 180 and execute them.
  • the touch panel 131 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the input unit 130 may further include other input devices 132.
  • the other input device 132 may include, but is not limited to, one or more of a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, a joystick, and the like.
  • WIFI is a short-range wireless transmission technology
  • the terminal can provide wireless broadband Internet access by sending and receiving e-mails, browsing web pages, and accessing streaming media through the WIFI module 170.
  • the RF circuit 110 is connected to the processor 180 via a bus, and is responsible for transmitting data to or receiving data from the Internet. It can also be used for receiving and transmitting information during the transmission or reception of information or during a call, in particular, after receiving downlink information of the base station. And processing to the processor 180; in addition, transmitting the designed uplink data to the base station.
  • the RF circuit 110 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like.
  • the RF circuit 110 can also communicate with the network and other devices via wireless communication.
  • the above wireless communication may use any communication standard or protocol, including but not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (code division) Multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), e-mail, short messaging service (SMS), and the like.
  • GSM global system of mobile communication
  • GPRS general packet radio service
  • CDMA code division multiple access
  • WCDMA wideband code division multiple access
  • LTE long term evolution
  • SMS short messaging service
  • the memory 120 can be used to store software programs and modules, and the processor 180 executes various functional applications and data processing of the terminals by running software programs and modules stored in the memory 120.
  • the memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be Stores data (such as audio data, phone book, etc.) created according to the use of the mobile terminal.
  • the memory 120 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the camera 102 is located behind the display panel 101; please refer to the positional relationship between the display panel and the camera shown in FIG. 2 to understand:
  • the display panel may include a glass cover 201, a package glass 202, a sealant 203, a pixel region 204, and a thin film transistor glass 205.
  • Pixel units are arranged on the pixel area 204 for displaying an image
  • a thin film transistor is integrated on the thin film transistor glass 205 for driving the pixel unit on the pixel region 204.
  • the area in front of the camera is the first area 206 in the pixel area 204 of the display panel.
  • Each of the pixel units of the first area 206 includes a transparent portion and a non-transparent portion, and the area outside the first area 206 is the second area.
  • Each pixel unit of the second region also includes a transparent portion and a non-transparent portion. The proportion of the transparent portion in the first region is greater than the ratio of the transparent portion in the second region. Please refer to the pixel unit arrangement of the pixel region 204 shown in FIG.
  • FIG. 3 a schematic diagram of the arrangement of the pixel units in the pixel region 204 is performed, wherein the pixel units 301 are uniformly arranged, and each of the pixel units 301 includes a transparent portion 302 and a non-transparent portion 303, wherein the transparent portion 302 is A transparent glass or transparent plastic film, the non-transparent portion 303 includes a portion provided in the pixel unit 301 with a thin film transistor device and a metal line.
  • the camera 102 can capture external scenery through these transparent portions.
  • FIG. 3 is only a schematic diagram of the arrangement of the pixel units in the pixel region 204, and does not limit the specific arrangement manner of the pixel units in the pixel region 204 and the size and shape of each pixel unit, which may be arranged in a common RGB arrangement.
  • the mode, the RGBB arrangement mode, the PenTile arrangement mode, or other arrangement modes are not limited herein.
  • the display panel only needs to have the above transparent portion.
  • an organic light-emitting diode (OLED) technology or a micro light-emitting diode (MICRO LED) can be used.
  • the display panel 101 is configured in the form of an active-matrix organic light emitting diode (AMOLED) or the like, which is not limited herein.
  • the camera 102 is placed behind the display panel 101 to ensure the integrity and normal display of the screen.
  • the area in front of the camera 102 is the first area of the pixel area 204 of the display panel 101, and the first area.
  • the transparent portion ensures the normal shooting of the camera 102, and realizes the effect of integrating the camera into the display area without affecting the industrial design effect and the overall display effect of the screen.
  • the polarizer on the surface of the display panel itself has a function of limiting the reflected light itself.
  • the non-transparent part obscures the camera. Similar to the effect of the blinds, the outline of the camera cannot be seen through the display panel, and the position where the camera is placed is inside the terminal. The light inside the whole machine is very dark, so the camera will not be found by the user. And affect the industrial design effect.
  • the non-transparent portion has an occlusion effect on the photographing of the camera 102. Therefore, the original photograph taken may be as shown in FIG. Includes occluded areas with alternating spacing. Then, the terminal can process the taken original photo to obtain the restored photo.
  • the first method of processing picture synthesis.
  • the processor 180 may perform the following operations:
  • the camera 102 When the camera 102 is called to capture, the camera 102 is instructed to quickly capture N pictures at different positions, wherein each picture has an occlusion area formed by the opaque portion, and the N is greater than 1 Integer
  • the N pictures are processed by an image synthesis method to obtain a picture in which the occlusion area is restored.
  • the two pictures taken have occlusion areas, but the occlusion areas of each picture are different. After combining the two pictures, a complete picture in which the occlusion area is restored is obtained.
  • the terminal may further include a micro motor, and the camera 102 may also include at least one camera;
  • the processor 180 when the processor 180 performs the foregoing step of instructing the camera 102 to quickly capture N pictures at different positions, the following steps may be specifically performed:
  • the processor 180 When the processor 180 performs the above steps of processing the N pictures by using an image synthesis method, the following steps may be specifically performed:
  • the N pictures are processed according to the relative positions of the camera and the display panel when the at least one camera moves.
  • the processor 180 drives the camera 102 to move by the micro-motor, and captures images of different angles during the movement. After the shooting is completed, the processor 180 can move the camera 102 and the display panel according to the camera 102. The relative position of 101 is combined for each picture, and a picture in which the occlusion area is restored is obtained. Please refer to Figures 6a, 6b for understanding.
  • FIG. 6a and FIG. 6b a schematic diagram of taking a picture during movement of a camera.
  • the object in the original picture captured by the camera is partially blocked and belongs to the occlusion area.
  • the camera moves under the action of the micro-motor.
  • the pixel unit is crossed, the relative angle of the camera and the actual panel is different, and the shooting angle is different.
  • the original image captured by the camera is also blocked by the previous image. If the occlusion area is different in the picture, the multiple pictures with different occlusion areas are obtained.
  • the structure size of the pixel unit that blocks the camera is on the order of several tens of micrometers, it is only necessary to push the camera to move by a micro-distance, and the distance corresponding to half a pixel can be passed, thereby obtaining multiple sheets. Pictures of different occlusion areas.
  • an example of an adjusting device for physically connecting a micro-motor to a camera includes: a housing 10; a vertical slider 30 connected to the camera, a vertical adjustment mechanism 40, and a level connected to the camera.
  • the slider 50, the horizontal adjustment mechanism 60, the horizontal slider 50, and the vertical slider 30 are sequentially placed in the hollow casing 10 from the bottom surface of the casing 10, the vertical adjustment mechanism 40 is connected to the vertical slider 30, and the horizontal adjustment mechanism 60 is horizontal.
  • the slider 50 is connected, and the two micro-motors 80 respectively control the vertical adjustment mechanism 40 and the horizontal adjustment mechanism 60.
  • the cover 20 encloses the housing 10, and an elongated limiting hole 24 is defined at a position at a corner thereof.
  • a lens mounting hole 26 that is adapted to the camera 102 is opened at a position intermediate the cover plate 20.
  • the camera 102 may also include at least two cameras; as shown in FIG. 8 , a schematic diagram of taking pictures of two cameras; the positions of the two cameras behind the display screen are different, so the camera angles are different, and the two cameras take a picture. The occlusion area of the captured picture is also different.
  • the processor 180 when the processor 180 performs the foregoing steps of processing the N pictures by using an image synthesis method, the following steps may be specifically performed:
  • the N pictures are processed according to the pictures taken by the at least two cameras to complement the occlusion area.
  • the second processing method image data processing.
  • the processor 180 may perform the following operations:
  • the image is processed by an image processing algorithm to obtain a picture in which the occlusion area is restored.
  • the occluded pixels in the picture are interpolated using information of adjacent pixels in the picture.
  • interpolation may be performed, and the pixel information calculated by the pixel information on the left and right sides of the pixel is integrated as the occluded pixel.
  • Information can also be performed by using information of other adjacent pixels, which is not limited herein.
  • the information of the occluded pixels in the picture is restored according to the content of the identified physical information.
  • FIG. 9a in order to capture a picture with an occlusion area, the terminal recognizes the physical information of the occluded pixel in the picture, and the occluded part is part of the eye on the face and part of the face, According to the general configuration of the eyes and the face, the information of the occluded pixels is restored, and finally the picture shown in Fig. 9b is obtained.
  • the third processing method first image synthesis, then image data processing.
  • the processor 180 may perform the following operations:
  • the camera 102 When the camera 102 is called to capture, the camera 102 is instructed to quickly capture N pictures at different positions, wherein each picture has an occlusion area formed by the opaque portion, and the N is greater than 1 Integer
  • the image is processed by an image processing algorithm to obtain a picture in which the occlusion area is restored.
  • the specific manner of obtaining a plurality of pictures with different occlusion areas and the specific manner of processing pictures by using an image processing algorithm are similar to those of the first processing method and the second processing method, and are not described herein.
  • the image processing may be performed on the image and then the image is synthesized to obtain a picture in which the occlusion area is restored.
  • Other combinations of the above various processing methods may be used, and are not limited herein.
  • the occlusion regions formed by the opaque portions of the photographed pictures can be restored in various different manners. Further, by changing the pixel structure or the pixel design, the proportion of the transparent portion in the first region 206 can be made higher than the proportion of the transparent portion in the second region, so that the occlusion region in the captured image is less or more small.
  • the first one reduce the number of pixels per inch (pixels per inch, PPI).
  • the PPI of the first region 206 is 1/M of the PPI of the second region, and the M is greater than 1.
  • the PPI of the first area is reduced to 1/2 of the PPI of the second area, that is, the pixel unit of the first area 206 is reduced by half, and thus the first area is The transparent portion between each pixel unit is greatly increased.
  • FIG. 10 is only a schematic diagram of reducing PPI. In practical applications, three adjacent RGB pixels are generally simultaneously reduced to ensure normal display of images.
  • the processor 180 may further perform the following steps:
  • the display data of adjacent M pixels is compressed into display data of one pixel in the first area 206 for display.
  • the proportion of the compressed display data is correspondingly changed.
  • the PPI of the first area 206 is taken as 1/2 of the other area PPI, and the image to be displayed needs to be displayed.
  • the display data of the six pixels is compressed into the corresponding three pixel units of the first region 206, wherein the display data of the R color in the six pixels of the image to be displayed is R1 and R2, respectively, and the display data of the G color is G1, respectively.
  • the display data of the corresponding three pixel units of the first area 206 is R3, G3, and B3.
  • the processor 180 may further perform the following steps:
  • the overall brightness of the first area 206 is increased such that the similarity of the brightness curves of the first area and the second area is greater than a preset value.
  • the processor 180 can instruct the display panel 101 to moderately adjust the aspect ratio of the DTFT (control Ipixel-Vdata curve) of the pixels of the first region 206, improve the output current of the pixel under the same Vdata, and proportionally increase the overall area of the first region.
  • the brightness is such that the similarity of the brightness curves of the first area 206 and the second area in the pixel area 204 is greater than a preset value.
  • the overall brightness of the first region 206 can also be increased in other ways, for example, by using external compensation means for more precise adjustment, or for correcting the brightness of the display data when performing display data compression. Etc., there is no limit here.
  • different pixel circuits are used in the first region 206 with respect to the second region. It can be understood that the components of the pixel circuit used in the first region 206 are smaller than the components of the pixel circuit used in the second region. Since the pixel circuit is simplified, the number of devices and wires is reduced, so more transparent portions are obtained for the camera.
  • a pixel circuit with internal compensation such as a 7T1C circuit or a circuit with more thin film transistors, is generally used.
  • the specific circuit structure of the 7T1C circuit is as shown in FIG. 12, that is, seven thin film transistors (TFTs) and one capacitor drive one pixel unit, wherein T1 to T7 are seven TFTs in the circuit.
  • the pixel circuit without internal compensation is generally a 2T1C circuit.
  • the specific circuit structure is shown in FIG. 13, that is, two thin film transistors and one capacitor drive one pixel unit, wherein the switching TFT and the driving TFT are two TFTs in the circuit.
  • the pixel circuit without internal compensation is used in the first region, for example, using a 2T1C circuit, the structure of the pixel circuit is simpler, and the number of devices and wiring is smaller, and the proportion of the transparent portion of the first region 206 is higher.
  • the processor 180 may be further configured to perform the following steps:
  • the pixel unit of the first region 206 is externally compensated.
  • the chromatic aberration of the first region and the second region is corrected, so that a better display effect can be obtained even with a simplified pixel circuit.
  • the proportion of the transparent portion in the first region 206 is increased in various different ways. Further, when the camera is photographed, the illumination of the display panel in front of the camera may interfere with the quality of the photographing, and therefore, the interference can be avoided by inserting a black frame at the time of photographing.
  • processor 180 is further configured to perform the following steps:
  • the processor 180 performs the step of calling the camera to capture the black frame inserted in the display panel, the following steps may be specifically performed:
  • the screen is restored when an instruction to complete shooting is received.
  • the black frame may be a black frame of a full screen, or may be a black frame that modifies the first area 206 to be a black picture, which is not limited herein.
  • the response time of the display panel is extremely short, on the order of microseconds, and the typical exposure time of the current camera is less than the time of one frame, only the synchronization of the image acquisition of the camera and the refresh of the black frame is required. It not only ensures the screen display, but also does not affect the shooting effect.
  • the terminal having the camera in the embodiment of the present application.
  • the following is a description of the shooting method in the embodiment of the present application. It can be understood that the shooting method is based on the above-mentioned terminal with a camera in the embodiment of the present application.
  • the terminal includes a display panel 101 and at least one camera 102.
  • the at least one camera 102 is located behind the display panel 101.
  • the area of the display panel 101 corresponding to the position of the at least one camera 102 is first.
  • the area 206, the area outside the first area 206 on the display panel 101 is a second area, wherein each pixel unit 301 of the first area 206 includes a transparent portion 302 and a non-transparent portion 303, the second Each of the pixel units of the region includes the transparent portion and the non-transparent portion, and a ratio of the transparent portion in the first region is greater than a ratio of the transparent portion in the second region.
  • a ratio of the transparent portion in the first region is greater than a ratio of the transparent portion in the second region.
  • the proportion of the transparent portion in the first region is greater than the transparent portion in the second region.
  • an embodiment of a photographing method in an embodiment of the present application is as follows:
  • N there is an occlusion area formed by the opaque portion in the first area, and the N is a positive integer greater than 1.
  • the terminal may include a micro motor.
  • the micro motor drives at least one camera to move, and the at least one camera moves.
  • the terminal may control the at least one camera to quickly capture the N pictures at different positions relative to the display panel; or if there are at least two cameras with different positions in the terminal, the at least two cameras may obtain the same when shooting N pictures.
  • the specific method for performing image synthesis processing on the N pictures may be different: if the N pictures are driven by the micro motor to move at least one camera The N picture is processed according to the relative position of the camera and the display panel when the at least one camera moves; if the N picture is taken by at least two cameras in different positions, Then, the occlusion area may be complemented according to the picture taken by the at least two cameras, and the N pictures are processed.
  • Processing by using an image processing algorithm, a picture that is partially restored by the occlusion area, and obtaining a picture in which the occlusion area is completely restored.
  • the picture can be processed by an image processing algorithm to obtain a picture in which the occlusion area is completely restored.
  • the occluded pixels in the picture whose occlusion area is partially restored may be interpolated using the information of the adjacent pixels of the occluded pixels. For example, if a pixel in the picture is occluded, the pixel on the left side of the pixel is red, and the pixel on the right side is blue, interpolation may be performed, and the pixel information calculated by the pixel information on the left and right sides of the pixel is integrated as the occluded pixel. Information. It can be understood that the interpolation operation can also be performed by using information of other adjacent pixels, which is not limited herein.
  • the physical information of the occluded pixel in the restored image of the occlusion region may be identified, and the information of the occluded pixel in the restored occlusion region is restored according to the content of the identified physical information.
  • the terminal recognizes the physical information of the occluded pixel in the picture, and the occluded part is a part of the eye of the person's face and a part of the face, according to the eye and The general structure of the face, the information of the occluded pixels is restored, and finally the picture shown in Fig. 9b is obtained.
  • steps 1401 to 1403 can be performed at the time of terminal shooting, wherein step 1403 is performed only when the picture obtained in step 1402 is a picture in which the occlusion area is partially restored, otherwise it may not be executed.
  • the pixel unit of the first region is reduced. If the PPI of the first region is reduced to 1/M of the PPI of the second region, the pixel unit of the first region is also reduced to 1/M. Referring to FIG. 10, as shown in FIG. 10, the PPI of the first area is reduced to 1/2 of the PPI of the second area, that is, the pixel unit of the first area 206 is reduced by half, and thus the first area is The transparent portion between each pixel unit is greatly increased. It should be noted that FIG. 10 is only a schematic diagram of reducing PPI. In practical applications, three adjacent RGB pixels are generally simultaneously reduced to ensure normal display of images.
  • the proportion of the compressed display data may be changed according to the ratio of the reduced PPI.
  • the PPI of the first area 206 is taken as 1/2 of the other area PPI, and needs to be treated.
  • the display data of the six pixels in the display image is compressed into the corresponding three pixel units of the first region 206, wherein the display data of the R color in the six pixels of the image to be displayed are respectively R1 and R2, and the display data of the G color are respectively
  • the display data of the corresponding three pixel units of the first region 206 is obtained as R3, G3, and B3.
  • the aspect ratio of the DTFT (control Ipixel-Vdata curve) of the pixels of the first region 206 can be appropriately adjusted, and the output current of the pixel under the same Vdata is improved.
  • the overall brightness of the first area is increased proportionally, so that the similarity between the brightness curves of the first area 206 and the second area in the pixel area 204 is greater than a preset value, and external compensation may be used for more precise regulation, or When the display data is compressed, the color of the display data is corrected for brightness, etc., and is not limited herein.
  • steps 1404 and 1405 can be performed when the terminal is powered on, or can be solidified in the system, which is not limited herein.
  • the time synchronization of shooting and inserting the black frame can be controlled, for example, the following steps can be performed: when the shooting instruction is received, the black frame operation is started; when the black insertion is confirmed When the frame operation is completed, shooting starts; when an instruction to complete shooting is received, the screen is restored.
  • the black frame may only be a black frame that modifies the first area as a black picture, or may be a full-screen black. Frame, not limited here.
  • the proportion of the transparent portion in the first region is greater than the transparent portion in the second region, thereby ensuring normal shooting of the camera, and achieving the overall effect of not affecting the industrial design effect and the screen image.
  • the front camera is integrated into the display area.
  • the image obtained by the image synthesis method is used to ensure the integrity of the captured image. If the synthesized image is a restored image of the occlusion region, the image processing algorithm can also be used to process the image, and the occlusion region is completely restored. The picture further guarantees the picture effect.
  • the proportion of the transparent portion in the first region is greater than the transparent portion in the second region.
  • the simplified pixel structure may use an internal compensation pixel circuit, such as a 2T1C circuit, in the first region, and an internally compensated pixel circuit, such as a 7T1C circuit, in the second region.
  • an internal compensation pixel circuit such as a 2T1C circuit
  • an internally compensated pixel circuit such as a 7T1C circuit
  • FIG. 15 another embodiment of the photographing method in the embodiment of the present application is as follows:
  • the picture that is partially restored by the occlusion area is processed by using an image processing algorithm to obtain a picture in which the occlusion area is restored.
  • Steps 1501 to 1503 are similar to steps 1401 to 1403 and are not described herein.
  • Step 1504 is similar to step 1406 and will not be described here.
  • the first region and the second region may have chromatic aberration due to different pixel circuit structures, and therefore, the pixel unit of the first region may be externally Compensation, the main steps of the specific external compensation operation are as follows:
  • the proportion of the transparent portion in the first region is larger than the transparent portion in the second region, thereby ensuring normal shooting of the camera, and realizing the effect of not affecting industrial design and screen.
  • the front camera is integrated into the display area.
  • the above two ways of making the proportion of the transparent portion in the first region larger than the proportion of the transparent portion in the second region are merely examples. In practical applications, other methods may be adopted to make the transparent portion in the first region.
  • the ratio of the ratio of the transparent portion is larger than the ratio of the transparent portion in the second region, for example, a combination of the above two methods, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Studio Devices (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

本申请实施例公开了一种具有摄像头的终端和拍摄方法,用于在不影响工业设计效果和屏幕画面的整体显示效果的情况下,将前置摄像头整合进显示区域中。所述终端包括:显示面板和至少一颗摄像头;所述至少一颗摄像头位于所述显示面板的背后,所述显示面板上与所述至少一颗摄像头位置对应的区域为第一区域,所述显示面板上第一区域之外的区域为第二区域,其中,所述第一区域的每个像素单元包括透明部分和非透明部分,所述第二区域的每个像素单元包括所述透明部分和所述非透明部分,所述第一区域中所述透明部分的比例大于所述第二区域中所述透明部分的比例。

Description

一种具有摄像头的终端和拍摄方法 技术领域
本申请涉及终端技术领域,特别涉及一种具有摄像头的终端和拍摄方法。
背景技术
随着市场对手机的屏幕占比的要求与日俱增,各大厂商纷纷推出全面屏概念的终端设备,如小米MIX、夏普Aquos Crystal等。目前终端设备发展的目标是屏幕占满整个终端前面板。
目前,指纹/返回功能Home键等都有方案进行转移或者合入屏幕中,而前置摄像头方面,还没有较好的方案将其与屏幕的显示区域进行整合。有一个设想的方式是对屏幕进行异形切割,切掉屏幕的一部分,使用屏幕切割留出的空间进行摄像头等组件的安装。
然而,若采用这种方式进行前置摄像头与屏幕的整合,被切割掉的部分将无法显示,在屏幕点亮状态下,会出现一个缺角或挖槽,导致工业设计(industrial design,ID)效果不理想,影响屏幕画面的整体显示效果,也增加显示屏的成本。
发明内容
本申请实施例提供了一种具有摄像头的终端和拍摄方法,用于在不影响工业设计效果和屏幕画面的整体显示效果的情况下,将前置摄像头整合进显示区域中。
本申请实施例的第一方面提供了一种具有摄像头的终端,包括:处理器、存储器、显示面板和至少一颗摄像头;所述至少一颗摄像头位于所述显示面板的背后;所述显示面板上与所述至少一颗摄像头位置对应的区域为第一区域,所述显示面板上第一区域之外的区域为第二区域,其中,所述第一区域的每个像素单元包括透明部分和非透明部分,所述第二区域的每个像素单元包括所述透明部分和所述非透明部分,所述第一区域中所述透明部分的比例大于所述第二区域中所述透明部分的比例。
在一种可能的设计中,在本申请实施例第一方面的第一种实现方式中,所述透明部分为透明玻璃或者透明塑料膜,所述非透明部分包括设置于像素单元中设有薄膜晶体管器件和金属线的部分。本实现方式中,细化了透明部分和非透明部分的组成,使本申请实施例更加具有可操作性。
在一种可能的设计中,在本申请实施例第一方面的第二种实现方式中,所述终端还包括:微动马达;所述微动马达包括壳体、
在一种可能的设计中,所述终端还包括:微动马达;所述摄像头为至少一颗摄像头;
所述微动马达与所述摄像头物理连接,所述微动马达用于带动所述至少一颗摄像头移动。
在一种可能的设计中,在本申请实施例第一方面的第三种实现方式中,第一区域的每英寸所拥有的像素数目PPI为第二区域的PPI的1/M,所述M大于1。本实现方式中,第一区域的PPI为第二区域的PPI的1/M,且M大于1,使得第一区域的透明占比大于第二区域, 增加了本申请实施例的实现方式。
在一种可能的设计中,在本申请实施例第一方面的第四种实现方式中,所述第一区域中采用无内部补偿的像素电路,所述第二区域中采用有内部补偿的像素电路。本实现方式中,细化了使用无内部补偿的像素电路来增加透明占比,增加了本申请实施例的实现方式。
本申请实施例的第二方面提供了一种拍摄方法,适用于具有摄像头的终端,所述终端包括显示面板和至少一颗摄像头,所述至少一颗摄像头位于所述显示面板的背后,所述显示面板上与所述至少一颗摄像头位置对应的区域为第一区域,所述显示面板上第一区域之外的区域为第二区域,其中,所述第一区域的每个像素单元包括透明部分和非透明部分,所述第二区域的每个像素单元包括所述透明部分和所述非透明部分,所述第一区域中所述透明部分的比例大于所述第二区域中所述透明部分的比例,所述拍摄方法包括:获取所述摄像头在相对于所述显示面板不同位置快速拍摄的N张图片,所述N张图片中均有被所述第一区域中非透明部分遮挡形成的遮挡区域,所述N为大于1的正整数;采用图像合成方法处理所述N张图片,得到所述遮挡区域完全被复原或部分被复原的图片。
在一种可能的设计中,在本申请实施例第二方面的第一种实现方式中,所述终端还包括微动马达,所述微动马达用于与所述摄像头物理连接用于带动所述至少一颗摄像头移动。所述获取摄像头在相对于显示面板不同位置快速拍摄的N张图片包括:拍摄时,所述微动马达带动所述至少一颗摄像头移动;在所述至少一颗摄像头移动的过程中,控制所述至少一颗摄像头在相对于所述显示面板的不同位置快速拍摄所述N张图片;所述采用图像合成方法处理所述N张图片包括:根据所述至少一颗摄像头移动时所述摄像头与所述显示面板的相对位置,处理所述N张图片。本实现方式中,可以通过移动所述终端上的至少一颗摄像头来拍摄多张图片以进行处理,细化了本申请实施例的操作方式。
在一种可能的设计中,在本申请实施例第二方面的第二种实现方式中,所述摄像头包括至少两个摄像头;所述采用图像合成方法处理所述N张图片包括:根据所述至少两个摄像头拍摄的图片对所述遮挡区域互补,处理所述N张图片。本实现方式中,当终端的摄像头至少有两个时,通过摄像头拍摄的照片互补来处理所述N张照片,使本申请实施例更具有可操作性。
在一种可能的设计中,在本申请实施例第二方面的第三种实现方式中,当得到所述遮挡区域部分被复原的图片时,所述方法还包括:采用图像处理算法处理所述遮挡区域部分被复原的图片,得到所述遮挡区域完全被复原的图片。本实现方式中,还可以通过图像处理算法来复原遮挡区域,增加了本申请实施例的实现方式。
在一种可能的设计中,在本申请实施例第二方面的第四种实现方式中,所述采用图像处理算法处理所述遮挡区域部分被复原的图片包括:对所述遮挡区域部分被复原的图片中被遮挡的像素采用所述被遮挡的像素的临近像素的信息进行插值运算。本实现方式中,采用临近像素的信息进行插值运算复原遮挡区域,使得本申请实施例更加细化具有可操作性。
在一种可能的设计中,在本申请实施例第二方面的第五种实现方式中,所述采用图像处理算法处理所述遮挡区域部分被复原的图片包括:对所述遮挡区域部分被复原的图片中被遮挡的像素的物理信息进行识别;依照识别出的所述物理信息的内容复原所述遮挡区域 部分被复原的图片中被遮挡的像素的信息。本实现方式中,根据物理信息处理复原遮挡区域,增加了本申请实施例的实现方式。
在一种可能的设计中,在本申请实施例第二方面的第六种实现方式中,第一区域的PPI为第二区域的PPI的1/M,所述M大于1,所述方法还包括:在所述第一区域将相邻M个像素的显示数据压缩为1个像素的显示数据进行显示。本实现方式中,降低PPI后,压缩第一区域的显示数据,保障显示效果。
在一种可能的设计中,在本申请实施例第二方面的第七种实现方式中,所述方法还包括:增加所述第一区域的整体亮度,使得所述第一区域与第二区域的亮度曲线的相似度大于预置数值。本实现方式中,降低PPI后,由于像素发光面占比减小,需要增强亮度,以保障显示效果。
在一种可能的设计中,在本申请实施例第二方面的第八种实现方式中,所述第一区域中采用了无内部补偿的像素电路,所述方法还包括:对所述第一区域的像素单元进行外部补偿。本实现方式中,当第一区域使用无内部补偿的像素电路时,为消除色差,需要进行外部补偿。
在一种可能的设计中,在本申请实施例第二方面的第九种实现方式中,所述方法还包括:拍摄时,在所述显示面板中插入黑帧。本实现方式中,在显示面板中插入黑帧,以避免摄像头前方的显示面板发光干扰。
在一种可能的设计中,在本申请实施例第二方面的第十种实现方式中,所述拍摄时,在所述显示面板中插入黑帧包括;当接收到拍摄指令时,开始插入黑帧操作;当确认所述插入黑帧操作完成时,开始拍摄;当接收到拍摄完成的指令时,恢复画面。本实现方式中,细化了加入黑帧的时序,使本申请实施例更加具有可操作性。
在一种可能的设计中,在本申请实施例第二方面的第十一种实现方式中,所述黑帧为全屏的黑帧;或,所述黑帧为修改所述第一区域为黑色画面的黑帧。本实现方式中,细化了黑帧可以是全屏的或者仅第一区域的,增加了本申请实施例的实现方式。
本申请实施例第三方面提供了一种计算机可读存储介质,包括指令,当其在计算机上运行时,使得计算机执行上述各方面所述的方法。
本申请实施例第四方面提供了一种包含指令的计算机程序产品,当其在计算机上运行时,使得计算机执行上述各方面所述的方法。
本申请实施例提供的技术方案中,本申请实施例包括:将摄像头置于屏幕像素区的背后,摄像头前方的区域为显示屏的像素区的第一区域。本申请实施例中,摄像头位于屏幕像素区的背后,保证了屏幕的完整性和正常显示,且摄像头前方的第一区域具有透明部分,保证了摄像头的正常拍摄,实现了在不影响工业设计效果和屏幕画面的整体显示效果的情况下,将前置摄像头整合进显示区域中。
附图说明
图1为本申请实施例中提供的具有摄像头的终端的部分结构的框图;
图2为本申请实施例中终端中显示面板与摄像头的位置关系示意图;
图3为本申请实施例中像素区中像素单元排布的一个示意图;
图4为本申请实施例中原始图片拍摄的一个结果示意图;
图5为本申请实施例中图片合成处理的一个示意图;
图6a为本申请实施例中一颗摄像头拍摄图片的一个示意图;
图6b为本申请实施例中一颗摄像头拍摄图片的另一个示意图;
图7为本申请实施例中连接微动马达与摄像头的调整装置一个示意图;
图8为本申请实施例中两颗摄像头拍摄图片的一个示意图;
图9a为本申请实施例中图像处理一个示意图;
图9b为本申请实施例中图像处理另一个示意图;
图10为本申请实施例中降低每英寸所拥有的像素数目一个示意图;
图11为本申请实施例中压缩显示数据一个示意图;
图12为本申请实施例中7T1C电路的一个结构示意图;
图13为本申请实施例中2T1C电路的一个结构示意图;
图14为本申请实施例中拍摄方法一个流程示意图;
图15为本申请实施例中拍摄方法另一个流程示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
在现有技术中,虽然可以将摄像头整合进显示区域中,达到全面屏的效果,但是其是通过切割掉屏幕的一部分用来放置摄像头模组从而实现的,这样会导致放置摄像头模组的区域无法进行画面显示,在屏幕点亮状态下,会出现一个缺角,因此工业设计效果不理想,影响屏幕画面的整体显示效果。
在本申请技术方案中,终端为具有显示面板和前置摄像头的用户设备,与传统的终端相比,主要是将前置摄像头置于显示面板的背后。
请参阅图1,为本申请实施例中提供的终端的部分结构的框图。
该终端包括:显示面板101、至少一颗摄像头102。
该终端还可以包括:处理器180和存储器120、无线保真(wireless fidelity,WIFI)模块170、射频(radio frequency,RF)电路110、输入单元131、显示单元140、音频电路160和传感器150等部件。本领域技术人员可以理解,图1中示出的终端结构并不构成对所述终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
所述显示单元140可用于显示图像。所述显示单元140包括显示面板101。进一步的,触控面板131可覆盖显示面板101,当所述触控面板131检测到在其上或附近的触摸操作后,传送给所述处理器180以确定触摸事件的类型,随后所述处理器180根据触摸事件的类型在所述显示面板101上提供相应的视觉输出。虽然在图1中,所述触控面板131与所 述显示面板101是作为两个独立的部件来实现终端的输入和输出功能,但是在某些实施例中,可以将所述触控面板131与所述显示面板101集成而实现终端的输入和输出功能。
所述输入单元130可用于所述用户在设置界面上进行所述目标应用的选择、针对所述提示信息的反馈等。具体地,所述输入单元130可包括所述触控面板131以及其他输入设备132。所述触控面板131,也称为触摸屏,可收集用户在其上或附近的触摸操作,可选的,所述触控面板131可包括触摸检测装置和触摸控制器两个部分。其中,所述触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将所述信号传送给触摸控制器;所述触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,发送给所述处理器180,并能接收所述处理器180发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现所述触控面板131。除了所述触控面板131,所述输入单元130还可以包括其他输入设备132。具体地,所述其他输入设备132可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
WIFI属于短距离无线传输技术,所述终端可以通过WIFI模块170收发电子邮件、浏览网页和访问流式媒体等,提供了无线的宽带互联网访问。
RF电路110通过总线与所述处理器180连接,负责向互联网发送数据或者从互联网接收数据,还可用于收发信息或通话过程中,信号的接收和发送,特别地,将基站的下行信息接收后,给所述处理器180处理;另外,将设计上行的数据发送给基站。通常,所述RF电路110包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(low noise amplifier,LNA)、双工器等。此外,所述RF电路110还可以通过无线通信与网络和其他设备通信。上述无线通信可以使用任一通信标准或协议,包括但不限于全球移动通讯系统(global system of mobile communication,GSM)、通用分组无线服务(general packet radio service,GPRS)、码分多址(code division multiple access,CDMA)、宽带码分多址(wideband code division multiple access,WCDMA)、长期演进(long term evolution,LTE)、电子邮件、短消息服务(short messaging service,SMS)等。
所述存储器120可用于存储软件程序以及模块,所述处理器180通过运行存储在所述存储器120的软件程序以及模块,从而执行终端的各种功能应用以及数据处理。所述存储器120可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据移动终端的使用所创建的数据(比如音频数据、电话本等)等。此外,所述存储器120可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
本申请实施例中,摄像头102位于显示面板101的背后;请参考图2所示的显示面板与摄像头的位置关系来理解:
其中,显示面板可以包括玻璃盖板201、封装玻璃202、密封剂203、像素区204和薄膜晶体管玻璃205。
像素区204上排布着像素单元,用于显示图像;
薄膜晶体管玻璃205上集成有薄膜晶体管,用于驱动像素区204上的像素单元。
摄像头前方的区域为显示面板的像素区204中的第一区域206,该第一区域206的每一个像素单元中包括透明部分和非透明部分,该第一区域206之外的区域为第二区域,所述第二区域的每个像素单元也包括透明部分和非透明部分。第一区域中所述透明部分的比例大于所述第二区域中所述透明部分的比例。请参考图3所示的像素区204的像素单元排布来理解。
如图3所示,为像素区204中像素单元的排布一个示意图,其中均匀排布的均为像素单元301,各像素单元301包括透明部分302和非透明部分303,其中,透明部分302为透明玻璃或者透明塑料膜,非透明部分303包括设置于像素单元301中设有薄膜晶体管器件和金属线的部分。摄像头102可以透过这些透明部分拍摄到外界景物。
需要说明的是,图3仅仅是像素区204中像素单元排布的一个示意,并不限定像素区204中像素单元的具体排布方式以及各像素单元的大小形状,其可以采用普通RGB排布方式,RGBB排布方式、PenTile排布方式或者其他的排布方式,此处不作限定。
可以理解的是,该显示面板只需要具有上述透明部分即可,可选的,可以采用有机发光二极管(organic light-emitting diode,OLED)技术,微型发光二极管(micro light-emitting diode,MICRO LED)技术,或有源矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED)等形式来配置显示面板101,此处不作限定。
在本申请实施例中,将摄像头102置于显示面板101的背后,保证了屏幕的完整性和正常显示,摄像头102前方的区域为显示面板101的像素区204的第一区域,该第一区域具有透明部分,保证了摄像头102的正常拍摄,实现了在不影响工业设计效果和屏幕画面的整体显示效果的情况下,将摄像头整合进显示区域中的效果。
可以理解的是,因为显示面板表面贴有偏光片,显示面板表面的偏光片本身就有限制本身反射光的功能。同时非透明部分遮挡了摄像头,类似于百叶窗的效果,通过显示面板无法看到摄像头的轮廓,且摄像头放置的位置在终端的内部,整机内部本身光很暗,因此摄像头不会因为被用户发现而影响工业设计效果。
进一步的,由于摄像头102前方的第一区域不仅具有透明部分,而且具有非透明部分,该非透明部分对摄像头102的拍摄具有遮挡效果,因此,拍摄出的原始照片可能会如图4所示,包括有交替间隔的遮挡区域。则终端可以对拍摄出的原始照片进行处理以得到复原后的照片。具体的处理方法有多种,下面选取其中几种进行描述:
第一种处理方法:图片合成。
可选的,通过调用该存储器120存储的操作指令,该处理器180可以执行如下操作:
在调用所述摄像头102拍摄时,指示所述摄像头102在不同位置快速拍摄N张图片,其中,各图片中均有被所述非透明部分遮挡形成的遮挡区域,所述N为大于1的正整数;
采用图像合成方法处理所述N张图片,得到遮挡区域被复原的图片。
可以理解的是,拍摄的多张图片中,遮挡区域并不完全相同,例如在第一张图片中A区域被遮挡,但是在第2张图片中A区域没有被遮挡,因此,对多张图片进行合成可以得到遮挡区域被复原的图片。请参考图5进行理解:
如图5所示,拍摄的两张图片,均有遮挡区域,然而每张图片的遮挡区域都不相同,将两张图片合成后,得到遮挡区域被复原的完整的图片。
具体的,得到该多张具有不同遮挡区域的图片的方式可以有多种:
方式一:终端中还可以包括微动马达,摄像头102也可以包括至少一颗摄像头;
可选的,该处理器180执行上述指示所述摄像头102在不同位置快速拍摄N张图片的步骤时,具体可以执行如下步骤:
指示所述微动马达推动所述至少一颗摄像头移动;
在所述至少一颗摄像头移动的过程中,指示所述至少一颗摄像头相对于屏幕快速在不同位置拍摄N张图片;
该处理器180执行上述采用图像合成方法处理所述N张图片的步骤时,具体可以执行如下步骤:
根据所述至少一颗摄像头移动时摄像头与显示面板的相对位置,处理所述N张图片。
可以理解的是,拍摄时,处理器180通过该微动马达带动摄像头102移动,在移动过程中拍摄不同角度的图片,拍摄完成之后,则处理器180可以根据摄像头102移动时摄像头102与显示面板101的相对位置对各照片进行合成,得到遮挡区域被复原的图片。请参考图6a、6b进行理解。
如图6a、6b所示,为一颗摄像头移动中拍摄图片的示意图,在图6a中,由于非透明部分的遮挡,摄像头拍摄出的原始图片中,物体有部分被遮挡,属于遮挡区域。摄像头在微动马达的带动下移动,当越过一个像素单元,由于摄像头与现实面板的相对位置不同,拍摄角度不同,此时摄像头拍摄出的原始图片中,物体被遮挡的区域也与之前拍摄的图片中遮挡区域不同,则得到该多张具有不同遮挡区域的图片。
采用这种方式,即使只有一颗摄像头也能通过对拍摄出的多张照片处理后,得到遮挡区域被复原的图片。
需要说明的是,由于遮挡摄像头的像素单元的结构尺寸在几十微米量级,因此,仅需要推动摄像头进行微距离的移动,即可穿过相当于半个像素的距离,从而得到多张具有不同遮挡区域的图片。
需要说明的是,带动摄像头移动的微动马达为一种镜头驱动马达,其可能的形态有很多种,该微动马达通过与摄像头物理连接,带动至少一个摄像头向各方向进行位移。如图7所示,为微动马达与摄像头进行物理连接的调整装置的一个示例,该调整装置包括:壳体10;与摄像头相连的垂直滑块30、垂直调整机构40、与摄像头相连的水平滑块50、水平调整机构60,水平滑块50、垂直滑块30由壳体10底面依次置于中空的壳体10中,垂直调整机构40与垂直滑块30连接,水平调整机构60与水平滑块50连接,两个微动马达80分别控制垂直调整机构40和水平调整机构60,此外,盖板20封闭壳体10,上位于其角落的位置开设有长条形的限位孔24,在盖板20中间位置开设有与摄像头102相适配的镜头安装孔26。
方式二:摄像头102也可以包括至少两颗摄像头;如图8所示,为两个摄像头拍摄图片的示意图;两个摄像头在显示屏后的位置不同,因此其拍摄角度不同,则两个摄像头拍 摄出的图片的遮挡区域也不同。
可选的,该处理器180执行上述采用图像合成方法处理所述N张图片的步骤时,具体可以执行如下步骤:
根据所述至少两个摄像头拍摄的图片对遮挡区域互补,处理所述N张图片。
采用这种方式,不需要对摄像头进行移动,也能得到多个遮挡区域不同的图片从而进行处理得到遮挡区域被复原的图片。
第二种处理方法:图片数据处理。
可选的,通过调用该存储器120存储的操作指令,该处理器180可以执行如下操作:
拍摄一张图片,图片中存在被所述非透明部分遮挡形成的遮挡区域;
采用图像处理算法处理该图片,得到遮挡区域被复原的图片。
其中,采用图像处理算法处理图片的具体方式有多种:
方式一:可选的,该处理器180执行该采用图像处理算法处理该图片的步骤时,具体可以执行如下步骤:
对该图片中被遮挡的像素采用该图片中临近像素的信息进行插值运算。
例如,图片中某个像素被遮挡,该像素左边的像素为红色,右边的像素为蓝色,则可以采用插值运算,综合该像素左右两边的像素信息计算得到的像素信息作为该被遮挡的像素的信息。可以理解的是,还可以采用其它临近像素的信息综合进行插值运算,此处不做限定。
方式二:可选的,该处理器180执行该采用图像处理算法处理该图片的步骤时,具体可以执行如下步骤:
对该图片中被遮挡像素的物理信息进行识别;
依照识别出的物理信息的内容复原该图片中被遮挡的像素的信息。
请参考图9a、9b进行理解。如图9a所示,为拍摄出的一张具有遮挡区域的图片,终端对该图片中被遮挡像素的物理信息识别得出,被遮挡的部分为人脸上眼睛的一部分以及脸的一部分,则可以依照眼睛和脸的一般构造,对该被遮挡像素的信息进行复原,最终得到如图9b所示的图片。
第三种处理方法:先图片合成,再图片数据处理。
可选的,通过调用该存储器120存储的操作指令,该处理器180可以执行如下操作:
在调用所述摄像头102拍摄时,指示所述摄像头102在不同位置快速拍摄N张图片,其中,各图片中均有被所述非透明部分遮挡形成的遮挡区域,所述N为大于1的正整数;
采用图像合成方法处理所述N张图片,得到遮挡区域被部分复原的图片;
获取图片,图片中存在被所述非透明部分遮挡形成的遮挡区域;
采用图像处理算法处理该图片,得到遮挡区域被复原的图片。
其中,得到多张具有不同遮挡区域的图片的具体方式以及采用图像处理算法处理图片的具体方式与第一种处理方法和第二种处理方法中类似,此处不做赘述。
可以理解的是,也可以先对图片进行数据处理再进行图片合成得到遮挡区域被复原的图片,还可以对上述各种处理方法进行其他的组合,此处不作限定。
上面实施例中,采用各种不同的方式,能复原拍摄的图片中由于非透明部分遮挡形成的遮挡区域。进一步的,通过对像素结构或像素设计进行改变,能使得该第一区域206中透明部分的占比高于第二区域中透明部分的占比,使得拍摄得到的图片中遮挡区域更少或更小。
下面描述其中两种提高第一区域206中透明部分占比的方法:
第一种:降低每英寸所拥有的像素数目(pixels per inch,PPI)。
可选的,通过改变像素设计,使得该第一区域206的PPI为第二区域的PPI的1/M,所述M大于1。
请参考图10理解,如图10所示,降低该第一区域的PPI为第二区域的PPI的1/2,即减少了该第一区域206中一半的像素单元,因此该第一区域中各像素单元之间的透明部分大大增加了。需要说明的是,图10仅为降低PPI的示意图,在实际应用中,一般同时减少相邻的RGB三个像素以保障图像的正常显示。
可选的,在第一区域206的PPI降低之后,相对于第二区域,其可显示数据的像素单元相应减少,则为了保证图像的显示效果,该处理器180还可以执行如下步骤:
在所述第一区域206将相邻M个像素的显示数据压缩为1个像素的显示数据进行显示。
可以理解的是,根据降低PPI的比例不同,压缩显示数据的比例相应改变,如图11所示,以第一区域206的PPI为其他区域PPI的1/2为例,需要将待显示图像中6个像素的显示数据压缩到该第一区域206相应的3个像素单元中,其中待显示图像的6个像素中R色的显示数据分别为R1、R2,G色的显示数据分别为G1、G2,B色的显示数据分别为B1、B2,则可以采用R3=(R1+R2)/2,G3=(G1+G2)/2,B3=(B1+B2)/2的计算方式,得到第一区域206相应的3个像素单元的显示数据为R3、G3、B3。
可选的,在第一区域206的PPI降低之后,相对于第二区域,该第一区域206整体会发暗,因此,为了提高图像的显示效果,该处理器180还可以执行如下步骤:
增加所述第一区域206的整体亮度,使得所述第一区域与第二区域的亮度曲线的相似度大于预置数值。
具体的,处理器180可以指示显示面板101适度调整第一区域206像素的DTFT(控制Ipixel-Vdata曲线)的宽长比,提高在相同Vdata下像素的输出电流,按比例增加第一区域的整体亮度,使像素区204中该第一区域206与第二区域的亮度曲线的相似度大于预置数值。
可以理解的是,还可以采用其他的方式增加该第一区域206的整体亮度,例如采用外部补偿的手段进行更精确的调控,或在进行显示数据压缩时对显示数据的颜色进行增加亮度的修正等,此处不做限定。
第二种:改变电路结构。
可选的,第一区域206中采用了相对于第二区域不同的像素电路,可以理解为第一区域206中采用的像素电路的元器件比第二区域采用的像素电路的元器件更少。由于像素电路简化,器件和连线数量减少,因此得到了更多的透明部分供摄像头使用。
具体的简化像素电路的方式有很多,下面以其中一种为例进行描述:在第一区域中采 用无内部补偿的像素电路。
需要说明的是,显示面板101的像素区204中一般采用的是有内部补偿的像素电路,例如7T1C电路或具有更多薄膜晶体管的电路。其中,7T1C电路的具体电路结构如图12所示,即7个薄膜晶体管(Thin Film Transistor,TFT)和1个电容驱动一个像素单元,其中T1至T7即为电路中的7个TFT。
而无内部补偿的像素电路一般为2T1C电路,具体电路结构如图13所示,即2个薄膜晶体管和1个电容驱动一个像素单元,其中开关TFT和驱动TFT即为电路中的2个TFT。
在第一区域中使用无内部补偿的像素电路,例如使用2T1C电路,像素电路的结构更简单,器件和连线数量更少,则第一区域206的透明部分的占比更高了。
可选的,由于在第一区域206使用了无内部补偿的像素电路,因此可能会与第二区域显示出色差,因此,该处理器180还可以用于执行如下步骤:
对所述第一区域206的像素单元进行外部补偿。
具体的进行外部补偿的操作主要步骤如下所示:
1、抓取显示面板显示不同灰阶不同颜色的状态下,2T1C区域的显示亮度和颜色;
2、通过计算得到每个小区域或者每个点显示的亮度与理想值的偏差;
3、根据这个偏差计算这个显示状态下需要对2T1C区域各像素点数据电压进行的修正;
4、将这个修正作为查找表写入集成电路(integrated circuit,IC)中,在实际显示中,由IC根据不同状况选取修正量,叠加入输出的Gamma电压中。
通过对第一区域206的像素单元进行外部补偿,修正了第一区域与第二区域的色差,使得即使采用简化的像素电路,也能得到较好的显示效果。
上面实施例中,采用各种不同的方式,提高了第一区域206中透明部分的占比。进一步的,在摄像头拍摄时,摄像头前方的显示面板的发光可能会干扰拍摄质量,因此,可以通过在拍摄时插入黑帧来避免此干扰。
可选的,所述处理器180还用于执行如下步骤:
调用所述摄像头拍摄时,在所述显示面板中插入黑帧。
进一步的,为保证插入黑帧的时机正确,所述处理器180执行所示调用所述摄像头拍摄时,在所述显示面板中插入黑帧的步骤时,具体可以执行如下步骤:
当接收到拍摄指令时,开始插入黑帧操作;
当确认所述插入黑帧操作完成时,指示所述摄像头开始拍摄;
当接收到拍摄完成的指令时,恢复画面。
可以理解的是,黑帧可以是全屏的黑帧,也可以是修改第一区域206为黑色画面的黑帧,此处不作限定。
需要说明的是,由于显示面板响应时间极短,在微秒量级,且目前摄像头的典型曝光时间小于一帧画面的时间,因此只需要做好摄像头图像采集和黑帧刷新的同步,即可既保证画面显示,又不影响拍摄效果。
上面对本申请实施例中具有摄像头的终端进行了描述,下面对本申请实施例中的拍摄方法进行描述,可以理解的是,该拍摄方法基于本申请实施例中的上述具有摄像头的终端, 该终端包括显示面板101和至少一颗摄像头102,所述至少一颗摄像头102位于所述显示面板101的背后,所述显示面板101上与所述至少一颗摄像头102位置对应的区域为第一区域206,所述显示面板101上第一区域206之外的区域为第二区域,其中,所述第一区域206的每个像素单元301包括透明部分302和非透明部分303,所述第二区域的每个像素单元包括所述透明部分和所述非透明部分,所述第一区域中所述透明部分的比例大于所述第二区域中所述透明部分的比例。可以理解的是,使第一区域中透明部分的比例大于第二区域中透明部分的比例的具体方式有两种,一种为降低第一区域的PPI,一种为简化第一区域的像素结构设计,下面分这两种情况分别对该拍摄方法进行描述:
1、通过降低第一区域的PPI使第一区域中透明部分的比例大于第二区域中透明部分。
请参阅图14,本申请实施例中拍摄方法一个实施例:
1401、获取所述摄像头在相对于所述显示面板不同位置快速拍摄的N张图片;
需要说明的是,所述N张图片中均有被所述第一区域中非透明部分遮挡形成的遮挡区域,所述N为大于1的正整数;
可以理解的是,获取该N张图片可以有多种不同的方式,例如,终端中可以包括微动马达,拍摄时,该微动马达带动至少一颗摄像头移动,在该至少一颗摄像头移动的过程中,终端可以控制该至少一颗摄像头在相对于显示面板的不同位置快速拍摄该N张图片;或者,终端中存在位置不同的至少两颗摄像头,则该至少两颗摄像头拍摄时可以得到该N张图片。
1402、采用图像合成方法处理所述N张图片,得到遮挡区域完全被复原或部分被复原的图片。
可以理解的是,根据得到的该N张图片的方式不同,对该N张图片进行图像合成处理的具体方法也可以不同:若该N张图片是由微动马达带动至少一颗摄像头移动时在移动过程中拍摄得到的,则可以根据该至少一颗摄像头移动时摄像头与显示面板的相对位置,处理该N张图片;若该N张图片是由在不同位置的至少两颗摄像头拍摄得到的,则可以根据该至少两个摄像头拍摄的图片对所述遮挡区域互补,处理该N张图片。
需要说明的是,通过图像合成方法处理得到的N张图片,可能得到遮挡区域被完全复原的图片,如图5所示。也可能处理后的图片中还存在部分遮挡区域,即得到的是遮挡区域部分被复原的图片。
1403、采用图像处理算法处理所述遮挡区域部分被复原的图片,得到遮挡区域完全被复原的图片。
对于得到的遮挡区域部分被复原的图片,可以采用图像处理算法处理该图片,得到遮挡区域被完全复原的图片。
具体的采用图像处理算法处理所述遮挡区域部分被复原的图片的方式有多种:
可以对遮挡区域部分被复原的图片中被遮挡的像素采用被遮挡的像素的临近像素的信息进行插值运算。例如,图片中某个像素被遮挡,该像素左边的像素为红色,右边的像素为蓝色,则可以采用插值运算,综合该像素左右两边的像素信息计算得到的像素信息作为该被遮挡的像素的信息。可以理解的是,还可以采用其它临近像素的信息综合进行插值运算,此处不做限定。
还可以对所述遮挡区域部分被复原的图片中被遮挡的像素的物理信息进行识别,依照识别出的所述物理信息的内容复原所述遮挡区域部分被复原的图片中被遮挡的像素的信息。例如图9a所示,为一张具有遮挡区域的图片,终端对该图片中被遮挡像素的物理信息识别得出,被遮挡的部分为人脸上眼睛的一部分以及脸的一部分,则可以依照眼睛和脸的一般构造,对该被遮挡像素的信息进行复原,最终得到如图9b所示的图片。
可以理解的是,步骤1401至1403可以在终端拍摄时执行,其中步骤1403仅在步骤1402中得到的图片为遮挡区域部分被复原的图片时执行,否则可以不执行。
1404、在所述第一区域将相邻M个像素的显示数据压缩为1个像素的显示数据进行显示。
需要说明的是,降低第一区域的PPI后,第一区域的像素单元减少。若降低第一区域的PPI为第二区域的PPI的1/M,则第一区域的像素单元也减少为1/M。请参考图10理解,如图10所示,降低该第一区域的PPI为第二区域的PPI的1/2,即减少了该第一区域206中一半的像素单元,因此该第一区域中各像素单元之间的透明部分大大增加了。需要说明的是,图10仅为降低PPI的示意图,在实际应用中,一般同时减少相邻的RGB三个像素以保障图像的正常显示。
因此,在降低PPI之后,可以根据降低PPI的比例不同,压缩显示数据的比例相应改变,如图11所示,以第一区域206的PPI为其他区域PPI的1/2为例,需要将待显示图像中6个像素的显示数据压缩到该第一区域206相应的3个像素单元中,其中待显示图像的6个像素中R色的显示数据分别为R1、R2,G色的显示数据分别为G1、G2,B色的显示数据分别为B1、B2,则可以采用R3=(R1+R2)/2,G3=(G1+G2)/2,B3=(B1+B2)/2的计算方式,得到第一区域206相应的3个像素单元的显示数据为R3、G3、B3。
1405、增加所述第一区域的整体亮度,使得所述第一区域与第二区域的亮度曲线的相似度大于预置数值。
需要说明的是,在第一区域206的PPI降低之后,由于发光的像素单元减少,相对于第二区域,该第一区域206整体会发暗,因此,为了提高图像的显示效果,可以执行改步骤1405。
具体的增加所述第一区域的整体亮度的方式有多种,例如可以适度调整第一区域206像素的DTFT(控制Ipixel-Vdata曲线)的宽长比,提高在相同Vdata下像素的输出电流,按比例增加第一区域的整体亮度,使像素区204中该第一区域206与第二区域的亮度曲线的相似度大于预置数值,也可以采用外部补偿的手段进行更精确的调控,或在进行显示数据压缩时对显示数据的颜色进行增加亮度的修正等,此处不做限定。
可以理解的是,步骤1404和1405可以在终端开机时执行,也可以固化在系统中,此处不作限定。
1406、拍摄时,在所述显示面板中插入黑帧。
可以理解的是,由于摄像头置于显示面板背后,通过显示面板上的透明部分获取外界光线感光拍摄,则位于摄像头前方的显示面板的第一区域的发光会对摄像头获取外界光线有一定得到影响,因此,为了得到更优质的拍摄效果,拍摄时可以在显示面板中插入黑帧。
为了保证插入黑帧的时机与拍摄的时机一致,可以控制拍摄和插入黑帧的时间同步,例如可以按如下步骤执行:当接收到拍摄指令时,开始插入黑帧操作;当确认所述插入黑帧操作完成时,开始拍摄;当接收到拍摄完成的指令时,恢复画面。
可以理解的是,由于此步骤是为了避免第一区域的发光影响拍摄时对外界光线的获取,因此,该黑帧可以仅为修改第一区域为黑色画面的黑帧,也可以为全屏的黑帧,此处不作限定。
本申请实施例中,通过降低第一区域的PPI使第一区域中透明部分的比例大于第二区域中透明部分,保证了摄像头的正常拍摄,实现了在不影响工业设计效果和屏幕画面的整体显示效果的情况下,将前置摄像头整合进显示区域中。采用图像合成方法处理得到的N张图片,保证了拍摄出的图片的完整性,若合成的图片为遮挡区域部分被复原的图片,还可以采用图像处理算法处理该图片,得到遮挡区域完全被复原的图片,进一步的保证了图片效果。且在第一区域将相邻M个像素的显示数据压缩为1个像素的显示数据进行显示,并增加所述第一区域的整体亮度,在保证拍摄的图片的效果的同时,使得显示面板能不受影响的显示图像,得到较好的显示效果。拍摄时,在显示面板中插入黑帧,避免了拍摄时第一区域的发光影响拍摄效果,提高了拍摄质量。
2、通过简化像素结构使第一区域中透明部分的比例大于第二区域中透明部分。
可以理解的是,简化像素结构可以在第一区域中使用无内部补偿像素电路,例如2T1C电路,在第二区域中使用有内部补偿的像素电路,例如7T1C电路。
请参阅图15,本申请实施例中拍摄方法另一个实施例:
1501、获取所述摄像头在相对于所述显示面板不同位置快速拍摄的N张图片;
1502、采用图像合成方法处理所述N张图片,得到所述遮挡区域完全被复原或部分被复原的图片。
1503、采用图像处理算法处理所述遮挡区域部分被复原的图片,得到所述遮挡区域被复原的图片。
步骤1501至1503与步骤1401至1403类似,此处不作赘述。
1504、拍摄时,在所述显示面板中插入黑帧。
步骤1504与步骤1406类似,此处不作赘述。
1505、对所述第一区域的像素单元进行外部补偿。
可以理解的是,在第一区域采用无内部补偿的像素电路后,由于像素电路结构不同,可能会是的第一区域和第二区域产生色差,因此,可以对第一区域的像素单元进行外部补偿,具体的进行外部补偿的操作主要步骤如下所示:
1、抓取显示面板显示不同灰阶不同颜色的状态下,2T1C区域的显示亮度和颜色;
2、通过计算得到每个小区域或者每个点显示的亮度与理想值的偏差;
3、根据这个偏差计算这个显示状态下需要对2T1C区域各像素点数据电压进行的修正;
4、将这个修正作为查找表写入集成电路(integrated circuit,IC)中,在实际显示中,由IC根据不同状况选取修正量,叠加入输出的Gamma电压中。
通过对第一区域206的像素单元进行外部补偿,修正了第一区域与第二区域的色差, 使得即使采用简化的像素电路,也能得到较好的显示效果。
本申请实施例中,通过简化第一区域像素单元的结构使第一区域中透明部分的比例大于第二区域中透明部分,保证了摄像头的正常拍摄,实现了在不影响工业设计效果和屏幕画面的整体显示效果的情况下,将前置摄像头整合进显示区域中。
可以理解的是,上述两种使第一区域中透明部分的比例大于第二区域中透明部分的比例的方式仅是示例,在实际应用中,也可以采用其他的方式使得第一区域中透明部分的比例大于第二区域中透明部分的比例的方式,例如上述两种方式的组合等,此处不作限定。
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。

Claims (17)

  1. 一种具有摄像头的终端,其特征在于,包括:
    显示面板和至少一颗摄像头;
    所述至少一颗摄像头位于所述显示面板的背后,所述显示面板上与所述至少一颗摄像头位置对应的区域为第一区域,所述显示面板上第一区域之外的区域为第二区域,其中,所述第一区域的每个像素单元包括透明部分和非透明部分,所述第二区域的每个像素单元包括所述透明部分和所述非透明部分,所述第一区域中所述透明部分的比例大于所述第二区域中所述透明部分的比例。
  2. 根据权利要求1所述的终端,其特征在于,所述透明部分为透明玻璃或者透明塑料膜,所述非透明部分包括设置于像素单元中设有薄膜晶体管器件和金属线的部分。
  3. 根据权利要求1所述的终端,其特征在于,所述终端还包括:微动马达;所述摄像头为至少一颗摄像头;
    所述微动马达与所述摄像头物理连接,所述微动马达用于带动所述至少一颗摄像头移动。
  4. 根据权利要求1至3中任一项所述的终端,其特征在于,第一区域的每英寸所拥有的像素数目PPI为第二区域的PPI的1/M,所述M大于1。
  5. 根据权利要求1至4中任一项所述的终端,其特征在于,所述第一区域中采用无内部补偿的像素电路,所述第二区域中采用有内部补偿的像素电路。
  6. 一种拍摄方法,适用于具有摄像头的终端,其特征在于,所述终端包括显示面板和至少一颗摄像头,所述至少一颗摄像头位于所述显示面板的背后,所述显示面板上与所述至少一颗摄像头位置对应的区域为第一区域,所述显示面板上第一区域之外的区域为第二区域,其中,所述第一区域的每个像素单元包括透明部分和非透明部分,所述第二区域的每个像素单元包括所述透明部分和所述非透明部分,所述第一区域中所述透明部分的比例大于所述第二区域中所述透明部分的比例,所述方法包括:
    获取所述摄像头在相对于所述显示面板不同位置快速拍摄的N张图片,所述N张图片中均有被所述第一区域中非透明部分遮挡形成的遮挡区域,所述N为大于1的正整数;
    采用图像合成方法处理所述N张图片,得到所述遮挡区域完全被复原或部分被复原的图片。
  7. 根据权利要求6所述的方法,其特征在于,所述摄像头包括至少一颗摄像头;所述终端还包括微动马达;
    所述获取摄像头在相对于显示面板不同位置快速拍摄的N张图片包括:
    拍摄时,所述微动马达带动所述至少一颗摄像头移动;
    在所述至少一颗摄像头移动的过程中,控制所述至少一颗摄像头在相对于所述显示面板的不同位置快速拍摄所述N张图片;
    所述采用图像合成方法处理所述N张图片包括:
    根据所述至少一颗摄像头移动时所述摄像头与所述显示面板的相对位置,处理所述N张图片。
  8. 根据权利要求6所述的方法,其特征在于,所述摄像头包括至少两个摄像头;
    所述采用图像合成方法处理所述N张图片包括:
    根据所述至少两个摄像头拍摄的图片对所述遮挡区域互补,处理所述N张图片。
  9. 根据权利要求6至8中任一项所述的方法,其特征在于,当得到所述遮挡区域部分被复原的图片时,所述方法还包括:
    采用图像处理算法处理所述遮挡区域部分被复原的图片,得到所述遮挡区域完全被复原的图片。
  10. 根据权利要求9所述的方法,其特征在于,所述采用图像处理算法处理所述遮挡区域部分被复原的图片包括:
    对所述遮挡区域部分被复原的图片中被遮挡的像素采用所述被遮挡的像素的临近像素的信息进行插值运算。
  11. 根据权利要求9所述的方法,其特征在于,所述采用图像处理算法处理所述遮挡区域部分被复原的图片包括:
    对所述遮挡区域部分被复原的图片中被遮挡的像素的物理信息进行识别;
    依照识别出的所述物理信息的内容复原所述遮挡区域部分被复原的图片中被遮挡的像素的信息。
  12. 根据权利要求6至11中任一项所述的方法,其特征在于,第一区域的PPI为第二区域的PPI的1/M,所述M大于1,所述方法还包括:
    在所述第一区域将相邻M个像素的显示数据压缩为1个像素的显示数据进行显示。
  13. 根据权利要求12所述的方法,其特征在于,所述方法还包括:
    增加所述第一区域的整体亮度,使得所述第一区域与第二区域的亮度曲线的相似度大于预置数值。
  14. 根据权利要求6至13中任一项所述的方法,其特征在于,所述第一区域中采用了无内部补偿的像素电路,所述方法还包括:
    对所述第一区域的像素单元进行外部补偿。
  15. 根据权利要求6至14中任一项所述的方法,其特征在于,所述方法还包括:
    拍摄时,在所述显示面板中插入黑帧。
  16. 一种计算机可读存储介质,包括指令,当其在计算机上运行时,使得计算机执行如权利要求6-15任意一项所述的方法。
  17. 一种包含指令的计算机程序产品,当其在计算机上运行时,使得计算机执行如权利要求6-15任意一项所述的方法。
PCT/CN2017/092250 2017-07-07 2017-07-07 一种具有摄像头的终端和拍摄方法 Ceased WO2019006749A1 (zh)

Priority Applications (6)

Application Number Priority Date Filing Date Title
PCT/CN2017/092250 WO2019006749A1 (zh) 2017-07-07 2017-07-07 一种具有摄像头的终端和拍摄方法
KR1020207000137A KR102192809B1 (ko) 2017-07-07 2017-07-07 카메라가 제공된 단말 및 그의 촬영 방법
EP17917157.4A EP3624434B1 (en) 2017-07-07 2017-07-07 Terminal provided with camera, and photographing method
JP2020500177A JP6892549B2 (ja) 2017-07-07 2017-07-07 カメラを備えた端末および撮影方法
US16/629,237 US11082547B2 (en) 2017-07-07 2017-07-07 Terminal provided with camera and shooting method
CN201780074317.1A CN110024366B (zh) 2017-07-07 2017-07-07 一种具有摄像头的终端和拍摄方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/092250 WO2019006749A1 (zh) 2017-07-07 2017-07-07 一种具有摄像头的终端和拍摄方法

Publications (1)

Publication Number Publication Date
WO2019006749A1 true WO2019006749A1 (zh) 2019-01-10

Family

ID=64950530

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/092250 Ceased WO2019006749A1 (zh) 2017-07-07 2017-07-07 一种具有摄像头的终端和拍摄方法

Country Status (6)

Country Link
US (1) US11082547B2 (zh)
EP (1) EP3624434B1 (zh)
JP (1) JP6892549B2 (zh)
KR (1) KR102192809B1 (zh)
CN (1) CN110024366B (zh)
WO (1) WO2019006749A1 (zh)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110769155A (zh) * 2019-10-31 2020-02-07 维沃移动通信(杭州)有限公司 一种摄像头控制方法及电子设备
CN111078170A (zh) * 2019-11-29 2020-04-28 北京小米移动软件有限公司 显示控制方法、显示控制装置及计算机可读存储介质
CN111711748A (zh) * 2020-05-27 2020-09-25 维沃移动通信(杭州)有限公司 屏幕刷新率的控制方法、装置、电子设备及可读存储介质
CN111756914A (zh) * 2019-03-28 2020-10-09 比亚迪股份有限公司 显示屏的控制方法、装置、终端及可读存储介质
CN111773683A (zh) * 2020-07-03 2020-10-16 珠海金山网络游戏科技有限公司 一种基于移动终端的文字显示方法及装置
US11043636B2 (en) 2017-05-17 2021-06-22 Oti Lumionics Inc. Method for selectively depositing a conductive coating over a patterning coating and device including a conductive coating
CN113055561A (zh) * 2019-12-27 2021-06-29 三星电机株式会社 图像捕获装置、具有相机模块的电子设备以及相机模块控制方法
US11088327B2 (en) 2015-10-26 2021-08-10 Oti Lumionics Inc. Method for patterning a coating on a surface and device including a patterned coating
WO2021157906A1 (ko) * 2020-02-05 2021-08-12 삼성전자 주식회사 이미지 센서를 포함하는 전자 장치
CN111182197B (zh) * 2018-11-13 2022-03-22 荷兰移动驱动器公司 相片拍摄方法、计算机程序、可读存储介质及电子装置
US11581487B2 (en) 2017-04-26 2023-02-14 Oti Lumionics Inc. Patterned conductive coating for surface of an opto-electronic device
GB2614446A (en) * 2019-12-31 2023-07-05 Lg Display Co Ltd Display device
US11700747B2 (en) 2019-06-26 2023-07-11 Oti Lumionics Inc. Optoelectronic device including light transmissive regions, with light diffraction characteristics
US11730012B2 (en) 2019-03-07 2023-08-15 Oti Lumionics Inc. Materials for forming a nucleation-inhibiting coating and devices incorporating same
US11744101B2 (en) 2019-08-09 2023-08-29 Oti Lumionics Inc. Opto-electronic device including an auxiliary electrode and a partition
US11751415B2 (en) 2018-02-02 2023-09-05 Oti Lumionics Inc. Materials for forming a nucleation-inhibiting coating and devices incorporating same
US11832473B2 (en) 2019-06-26 2023-11-28 Oti Lumionics Inc. Optoelectronic device including light transmissive regions, with light diffraction characteristics
US12069938B2 (en) 2019-05-08 2024-08-20 Oti Lumionics Inc. Materials for forming a nucleation-inhibiting coating and devices incorporating same
US12101987B2 (en) 2019-04-18 2024-09-24 Oti Lumionics Inc. Materials for forming a nucleation-inhibiting coating and devices incorporating same
US12101954B2 (en) 2016-12-02 2024-09-24 Oti Lumionics Inc. Device including a conductive coating disposed over emissive regions and method therefore
US12113279B2 (en) 2020-09-22 2024-10-08 Oti Lumionics Inc. Device incorporating an IR signal transmissive region
US12167634B2 (en) 2018-11-23 2024-12-10 Oti Lumionics Inc. Optoelectronic device including a light transmissive region
US12389742B2 (en) 2019-12-24 2025-08-12 Oti Lumionics Inc. Light emitting device including capping layers on respective emissive regions

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN207264695U (zh) * 2017-09-30 2018-04-20 云谷(固安)科技有限公司 终端及显示屏
CN108810201B (zh) * 2018-06-04 2020-07-17 Oppo广东移动通信有限公司 电子装置及利用电子装置拍摄照片的方法
US20220116520A1 (en) * 2019-03-05 2022-04-14 Hewlett-Packard Development Company, L.P. Image capture by image-capture device positioned behind display device
US11516374B2 (en) 2019-06-05 2022-11-29 Synaptics Incorporated Under-display image sensor
US11056081B2 (en) * 2019-08-09 2021-07-06 Wuhan China Star Optoelectronics Semiconductor Display Technology Co., Ltd. Display panel and display device
US11153513B2 (en) 2019-08-19 2021-10-19 Synaptics Incorporated Light source for camera
CN110430300A (zh) * 2019-09-16 2019-11-08 北京小米移动软件有限公司 终端屏幕及终端
CN110661972B (zh) * 2019-09-27 2021-02-23 维沃移动通信有限公司 图像处理方法、装置、电子设备和介质
US11076080B2 (en) * 2019-12-05 2021-07-27 Synaptics Incorporated Under-display image sensor for eye tracking
KR20210150903A (ko) * 2020-06-04 2021-12-13 삼성전자주식회사 디스플레이를 포함하는 전자 장치
CN111951192A (zh) * 2020-08-18 2020-11-17 义乌清越光电科技有限公司 一种拍摄图像的处理方法及拍摄设备
KR102790284B1 (ko) 2020-09-28 2025-04-03 엘지디스플레이 주식회사 표시패널과 이를 이용한 표시장치
KR102733540B1 (ko) 2020-11-19 2024-11-27 삼성디스플레이 주식회사 표시 장치
KR102406921B1 (ko) * 2020-12-04 2022-06-10 (주)딥인사이트 모놀리식 아키텍처를 가지는 광학 장치 및 그 제조 방법
KR20220141139A (ko) * 2021-04-12 2022-10-19 삼성전자주식회사 카메라를 포함하는 전자 장치, 그 전자 장치에서의 동작 방법
KR102842890B1 (ko) * 2021-04-14 2025-08-07 삼성전자주식회사 카메라를 포함하는 전자 장치, 그 전자 장치에서의 동작 방법
KR102876081B1 (ko) * 2021-04-16 2025-10-24 삼성전자 주식회사 전자 장치 및 전자 장치의 이미지 촬영 방법
EP4307652B1 (en) 2021-04-16 2025-10-01 Samsung Electronics Co., Ltd. Electronic device and image capturing method thereof
WO2022270870A1 (ko) * 2021-06-21 2022-12-29 삼성전자 주식회사 하나의 카메라를 통해 다방향으로 촬영을 수행하는 방법 및 그 전자 장치
KR20230052041A (ko) 2021-10-12 2023-04-19 삼성전자주식회사 이미지를 제공하는 방법 및 이를 지원하는 전자 장치
US12003866B2 (en) 2021-10-20 2024-06-04 Samsung Electronics Co., Ltd. Method for providing image and electronic device supporting the same
WO2023068607A1 (ko) * 2021-10-20 2023-04-27 삼성전자 주식회사 이미지를 제공하는 방법 및 이를 지원하는 전자 장치
CN116096152A (zh) * 2021-10-29 2023-05-09 乐金显示有限公司 显示装置和合成图像的方法
KR102846588B1 (ko) * 2021-12-30 2025-08-13 엘지디스플레이 주식회사 표시 장치
CN117554932B (zh) * 2022-08-04 2025-07-04 荣耀终端股份有限公司 Tof相机的遮挡检测方法及终端设备

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104079811A (zh) * 2014-07-24 2014-10-01 广东欧珀移动通信有限公司 一种拍照时滤除障碍物的方法及装置
CN104580882A (zh) * 2014-11-03 2015-04-29 宇龙计算机通信科技(深圳)有限公司 拍照的方法及其装置
CN105208255A (zh) * 2015-10-27 2015-12-30 合肥联宝信息技术有限公司 摄像头组件
US20170084231A1 (en) * 2015-09-23 2017-03-23 Intel Corporation Imaging system management for camera mounted behind transparent display
CN106603772A (zh) * 2017-01-26 2017-04-26 广东欧珀移动通信有限公司 电子装置及图像获取方法
CN106920470A (zh) * 2017-04-27 2017-07-04 武汉华星光电技术有限公司 一种纯屏幕无边框显示装置及显示方法
CN106921767A (zh) * 2017-03-07 2017-07-04 捷开通讯(深圳)有限公司 一种高屏占比的移动终端

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0818857B2 (ja) 1988-03-04 1996-02-28 株式会社アスク 珪酸カルシウム・ポリマー複合板の製造方法
JP3192875B2 (ja) 1994-06-30 2001-07-30 キヤノン株式会社 画像合成方法および画像合成装置
JP4886162B2 (ja) * 2003-06-18 2012-02-29 キヤノン株式会社 撮像装置付き表示装置
JP4411059B2 (ja) 2003-12-12 2010-02-10 キヤノン株式会社 カメラ付きディスプレイ装置、通信装置および通信システム
US20110285891A1 (en) 2010-05-21 2011-11-24 Maglaque Chad L Integrated Display Camera Using Masked Display Elements
JP5569156B2 (ja) * 2010-06-07 2014-08-13 ソニー株式会社 画像表示装置、電子機器、画像表示システム、画像取得方法、プログラム
US9099021B2 (en) * 2010-07-30 2015-08-04 Beijing Lenovo Software Ltd. Display screen and terminal device using same
KR101781533B1 (ko) 2010-12-23 2017-09-27 삼성디스플레이 주식회사 영상 촬영 장치 및 이의 영상 촬영 방법
US9437132B2 (en) * 2011-11-30 2016-09-06 Apple Inc. Devices and methods for providing access to internal component
CN104021759A (zh) * 2014-05-30 2014-09-03 京东方科技集团股份有限公司 一种显示器件的亮度补偿方法、亮度补偿装置及显示器件
KR102418520B1 (ko) 2015-09-04 2022-07-08 삼성디스플레이 주식회사 표시 장치
CN107426471B (zh) * 2017-05-03 2021-02-05 Oppo广东移动通信有限公司 相机模组和电子装置
CN107589600B (zh) * 2017-09-22 2021-03-02 京东方科技集团股份有限公司 一种像素结构、显示面板及显示装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104079811A (zh) * 2014-07-24 2014-10-01 广东欧珀移动通信有限公司 一种拍照时滤除障碍物的方法及装置
CN104580882A (zh) * 2014-11-03 2015-04-29 宇龙计算机通信科技(深圳)有限公司 拍照的方法及其装置
US20170084231A1 (en) * 2015-09-23 2017-03-23 Intel Corporation Imaging system management for camera mounted behind transparent display
CN105208255A (zh) * 2015-10-27 2015-12-30 合肥联宝信息技术有限公司 摄像头组件
CN106603772A (zh) * 2017-01-26 2017-04-26 广东欧珀移动通信有限公司 电子装置及图像获取方法
CN106921767A (zh) * 2017-03-07 2017-07-04 捷开通讯(深圳)有限公司 一种高屏占比的移动终端
CN106920470A (zh) * 2017-04-27 2017-07-04 武汉华星光电技术有限公司 一种纯屏幕无边框显示装置及显示方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3624434A4 *

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11158803B2 (en) 2015-10-26 2021-10-26 Oti Lumionics Inc. Method for patterning a coating on a surface and device including a patterned coating
US12150374B2 (en) 2015-10-26 2024-11-19 Oti Lumionics Inc. Method for patterning a coating on a surface and device including a patterned coating
US11785831B2 (en) 2015-10-26 2023-10-10 Oti Lumionics Inc. Method for patterning a coating on a surface and device including a patterned coating
US11706969B2 (en) 2015-10-26 2023-07-18 Oti Lumionics Inc. Method for patterning a coating on a surface and device including a patterned coating
US11335855B2 (en) 2015-10-26 2022-05-17 Oti Lumionics Inc. Method for patterning a coating on a surface and device including a patterned coating
US11088327B2 (en) 2015-10-26 2021-08-10 Oti Lumionics Inc. Method for patterning a coating on a surface and device including a patterned coating
US11158802B2 (en) 2015-10-26 2021-10-26 Oti Lumionics Inc. Method for patterning a coating on a surface and device including a patterned coating
US12101954B2 (en) 2016-12-02 2024-09-24 Oti Lumionics Inc. Device including a conductive coating disposed over emissive regions and method therefore
US12069939B2 (en) 2017-04-26 2024-08-20 Oti Lumionics Inc. Method for patterning a coating on a surface and device including a patterned coating
US11581487B2 (en) 2017-04-26 2023-02-14 Oti Lumionics Inc. Patterned conductive coating for surface of an opto-electronic device
US11730048B2 (en) 2017-05-17 2023-08-15 OTI Lumionic Inc. Method for selectively depositing a conductive coating over a patterning coating and device including a conductive coating
US12464940B2 (en) 2017-05-17 2025-11-04 Oti Lumionics Inc. Method for selectively depositing a conductive coating over a patterning coating and device including a conductive coating
US11043636B2 (en) 2017-05-17 2021-06-22 Oti Lumionics Inc. Method for selectively depositing a conductive coating over a patterning coating and device including a conductive coating
US11751415B2 (en) 2018-02-02 2023-09-05 Oti Lumionics Inc. Materials for forming a nucleation-inhibiting coating and devices incorporating same
US12178064B2 (en) 2018-02-02 2024-12-24 Oti Lumionics Inc. Materials for forming a nucleation-inhibiting coating and devices incorporating same
CN111182197B (zh) * 2018-11-13 2022-03-22 荷兰移动驱动器公司 相片拍摄方法、计算机程序、可读存储介质及电子装置
US12167634B2 (en) 2018-11-23 2024-12-10 Oti Lumionics Inc. Optoelectronic device including a light transmissive region
US12492313B2 (en) 2019-03-07 2025-12-09 Oti Lumionics Inc. Materials for forming a nucleation-inhibiting coating and devices incorporating same
US11730012B2 (en) 2019-03-07 2023-08-15 Oti Lumionics Inc. Materials for forming a nucleation-inhibiting coating and devices incorporating same
CN111756914A (zh) * 2019-03-28 2020-10-09 比亚迪股份有限公司 显示屏的控制方法、装置、终端及可读存储介质
US12101987B2 (en) 2019-04-18 2024-09-24 Oti Lumionics Inc. Materials for forming a nucleation-inhibiting coating and devices incorporating same
US12069938B2 (en) 2019-05-08 2024-08-20 Oti Lumionics Inc. Materials for forming a nucleation-inhibiting coating and devices incorporating same
US11700747B2 (en) 2019-06-26 2023-07-11 Oti Lumionics Inc. Optoelectronic device including light transmissive regions, with light diffraction characteristics
US11832473B2 (en) 2019-06-26 2023-11-28 Oti Lumionics Inc. Optoelectronic device including light transmissive regions, with light diffraction characteristics
US12004383B2 (en) 2019-06-26 2024-06-04 Oti Lumionics Inc. Optoelectronic device including light transmissive regions, with light diffraction characteristics
US11744101B2 (en) 2019-08-09 2023-08-29 Oti Lumionics Inc. Opto-electronic device including an auxiliary electrode and a partition
US12302691B2 (en) 2019-08-09 2025-05-13 Oti Lumionics Inc. Opto-electronic device including an auxiliary electrode and a partition
CN110769155A (zh) * 2019-10-31 2020-02-07 维沃移动通信(杭州)有限公司 一种摄像头控制方法及电子设备
CN110769155B (zh) * 2019-10-31 2021-11-23 维沃移动通信(杭州)有限公司 一种摄像头控制方法及电子设备
CN111078170B (zh) * 2019-11-29 2023-11-28 北京小米移动软件有限公司 显示控制方法、显示控制装置及计算机可读存储介质
EP3828832A1 (en) * 2019-11-29 2021-06-02 Beijing Xiaomi Mobile Software Co., Ltd. Display control method, display control device and computer-readable storage medium
US11503207B2 (en) 2019-11-29 2022-11-15 Beijing Xiaomi Mobile Software Co., Ltd. Display control method, display control device and computer-readable storage medium
CN111078170A (zh) * 2019-11-29 2020-04-28 北京小米移动软件有限公司 显示控制方法、显示控制装置及计算机可读存储介质
US12389742B2 (en) 2019-12-24 2025-08-12 Oti Lumionics Inc. Light emitting device including capping layers on respective emissive regions
CN113055561A (zh) * 2019-12-27 2021-06-29 三星电机株式会社 图像捕获装置、具有相机模块的电子设备以及相机模块控制方法
GB2614446B (en) * 2019-12-31 2024-07-24 Lg Display Co Ltd Display device
GB2614446A (en) * 2019-12-31 2023-07-05 Lg Display Co Ltd Display device
KR102794862B1 (ko) * 2020-02-05 2025-04-14 삼성전자주식회사 이미지 센서를 포함하는 전자 장치
KR20210099822A (ko) * 2020-02-05 2021-08-13 삼성전자주식회사 이미지 센서를 포함하는 전자 장치
WO2021157906A1 (ko) * 2020-02-05 2021-08-12 삼성전자 주식회사 이미지 센서를 포함하는 전자 장치
CN111711748A (zh) * 2020-05-27 2020-09-25 维沃移动通信(杭州)有限公司 屏幕刷新率的控制方法、装置、电子设备及可读存储介质
CN111773683A (zh) * 2020-07-03 2020-10-16 珠海金山网络游戏科技有限公司 一种基于移动终端的文字显示方法及装置
CN111773683B (zh) * 2020-07-03 2024-06-04 珠海金山数字网络科技有限公司 一种基于移动终端的文字显示方法及装置
US12113279B2 (en) 2020-09-22 2024-10-08 Oti Lumionics Inc. Device incorporating an IR signal transmissive region

Also Published As

Publication number Publication date
EP3624434B1 (en) 2021-06-02
JP2020526972A (ja) 2020-08-31
KR102192809B1 (ko) 2020-12-18
CN110024366B (zh) 2020-08-14
EP3624434A4 (en) 2020-04-15
CN110024366A (zh) 2019-07-16
JP6892549B2 (ja) 2021-06-23
EP3624434A1 (en) 2020-03-18
KR20200014408A (ko) 2020-02-10
US11082547B2 (en) 2021-08-03
US20200195764A1 (en) 2020-06-18

Similar Documents

Publication Publication Date Title
WO2019006749A1 (zh) 一种具有摄像头的终端和拍摄方法
US20170084231A1 (en) Imaging system management for camera mounted behind transparent display
US11120769B2 (en) Brightness compensation method and related product
CN108111717B (zh) 配置为照明源的显示器装置
JP6342499B2 (ja) 表示輝度を下げる方法および装置
US9214111B2 (en) Image display apparatus and method
CN102469265B (zh) 摄像装置及摄像方法
CN108605096A (zh) 一种电子设备拍摄方法和装置
US20230164426A1 (en) Under-display camera systems and methods
CN113593480A (zh) 显示屏的亮度补偿方法及装置、存储介质
US20200098837A1 (en) Display structure, display panel using the same and display device using the same
CN108924316A (zh) 屏下光感检测方法、装置、移动终端和计算机存储介质
CN106548751A (zh) 显示面板的显示方法和装置
CN116844472A (zh) 像素数据处理方法、装置、显示设备和存储介质
CN115798394A (zh) 亮度调整方法、装置及存储介质
CN113140153B (zh) 电子设备及其显示控制方法、计算机可读存储介质
US20170124963A1 (en) Display adjustment method and electronic device thereof
CN107644620A (zh) 显示面板的控制方法、显示装置和存储介质
CN118101865A (zh) 图像处理装置、方法和电子设备
KR102640015B1 (ko) 표시 장치 및 그 구동 방법
JP2014085356A (ja) ディスプレイシステム
CN116978311A (zh) 图像显示方法、装置、电子设备及存储介质
CN108206012A (zh) 伽马校正方法及装置
TWI854634B (zh) 觸控顯示裝置的頻率調整方法
KR20140077071A (ko) 영상처리장치 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17917157

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 20207000137

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2020500177

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017917157

Country of ref document: EP

Effective date: 20191210