[go: up one dir, main page]

CN106713777A - Method and device for realizing light painting photography, and photographic equipment - Google Patents

Method and device for realizing light painting photography, and photographic equipment Download PDF

Info

Publication number
CN106713777A
CN106713777A CN201611065720.1A CN201611065720A CN106713777A CN 106713777 A CN106713777 A CN 106713777A CN 201611065720 A CN201611065720 A CN 201611065720A CN 106713777 A CN106713777 A CN 106713777A
Authority
CN
China
Prior art keywords
pixel
light source
source point
value
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611065720.1A
Other languages
Chinese (zh)
Inventor
戴向东
王猛
陈鹏飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to CN201611065720.1A priority Critical patent/CN106713777A/en
Publication of CN106713777A publication Critical patent/CN106713777A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B41/00Special techniques not covered by groups G03B31/00 - G03B39/00; Apparatus therefor
    • G03B41/02Special techniques not covered by groups G03B31/00 - G03B39/00; Apparatus therefor using non-intermittently running film
    • G03B41/04Special techniques not covered by groups G03B31/00 - G03B39/00; Apparatus therefor using non-intermittently running film with optical compensator

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a method and a device for realizing light painting photography, and photographic equipment. The method comprises the steps of: preprocessing multiple frames of photographed images; acquiring a pixel value of each pixel of each frame of processed image; calculating a pixel value difference of each pixel point between the adjacent frames of images; determining the pixel points to be light source points or background pixel points according to the obtained pixel value differences and a preset light source point threshold value; and eliminating the weak light source points within a preset distance searching range of each light source point, and reducing the pixel value of each background pixel point, wherein the distance searching range is determined through counting the radiation decelerating tendency of different light sources along with real 3D physical space distances. Through distinguishing the light source points from the background pixel points and reducing the pixel values of the background pixel points, the comparison effect of light track and the background is improved, the background brightness of the image is dimmed, the night light painting effect is realized in a daylight scene with high light intensity, the application occasions of light painting photography are expanded, and the photographic experience of the user is enhanced.

Description

It is a kind of to realize method, device and capture apparatus that light paints photography
Technical field
The present invention relates to field camera work, more particularly to a kind of realize method, device and capture apparatus that light paints photography.
Background technology
It is a kind of simple again full of intention, surprising Techniques for Photography that light paints photography.Light paints photography needs at least two People cooperates and could complete, therefore also more changeable, more interesting.Mainly use the motion of light source and set off environment or master by contrast The photography art mode of body.Light source is the motion within a period of time, and the photo-sensitive cell of camera, it is uniformly to record per unit The light at moment, so as to record out the lamp motion track of whole picture.Light paint photography can indoors, night, more even Carried out the dim lights that cannot be taken pictures at all in the environment of.
In order to protrude the track expressive ability of light, at present, light is painted photography needs and is carried out in the scene of dark, in light More bright scene is that the track that cannot take light contrasts clearly demarcated effect.That is, at present, light paints the application of photography Scene is confined to night or rather dark scene, if the shooting that so scene of the user on daytime or bright light finds Scene, is that the light that cannot be recorded at that time paints effect, undoubtedly reduces user and shoots experience.
The content of the invention
It is a primary object of the present invention to propose a kind of to realize method, device and capture apparatus that light paints photography, Neng Goukuo The application scenarios of Zhan Guanghui photographies, lifting user shoots experience.
To achieve the above object, the embodiment of the invention provides it is a kind of realize the method that light paints photography, including:
Multiple image to photographing is pre-processed;
The pixel value of each pixel of the every two field picture after acquisition treatment;
For each pixel, the pixel value difference between adjacent two field picture is calculated respectively;
According to the pixel value difference for obtaining and the light source point threshold value for pre-setting, each pixel is defined as light source point or background Pixel;
The dim light source point in the predeterminable range hunting zone of each light source point is eliminated, the pixel value of background pixel point is reduced, Wherein, determine the distance with the trend that the distance radiation of real 3D physical spaces is slowed down by counting different light source to search Rope scope.
Alternatively, it is described each pixel is defined as light source point or background pixel point to include:
The pixel value difference is defined as light source point more than the pixel of the light source point threshold value;The pixel value difference is less than Or equal to the pixel of light source point threshold value, it is defined as background pixel point.
Alternatively, the pixel value for reducing background pixel point includes:The brightness value of the background pixel point is set to 0。
Alternatively, for the pixel for being defined as light source point, when it is described calculate more than the light source point threshold value Pixel value difference include two or more when, also include:
The brightness value of maximum in the pixel value difference is chosen as the brightness value of the pixel, or, by multiple pictures The average value of the brightness value of plain difference as the pixel brightness value.
Alternatively, the dim light source point in the predeterminable range hunting zone for eliminating each light source point includes:
Centered on the space length of light source point each described, according to each pixel correspondence locus being previously obtained Space object distance, other light source points are looked in the range of the range search for pre-setting, the light source point that will be looked for The light source point that brightness is less than the luminance threshold for pre-setting is set to background pixel point.
The device that light paints photography is realized present invention also offers a kind of, including:Pretreatment module, acquisition module, treatment mould Block, determining module, wherein,
Pretreatment module, for being pre-processed to the multiple image for photographing;
Acquisition module, the pixel value of each pixel of the every two field picture after being processed for acquisition;
Processing module, for for each pixel, the pixel value difference between adjacent two field picture being calculated respectively;
Determining module, for according to the pixel value difference for obtaining and the light source point threshold value for pre-setting, each pixel being determined It is light source point or background pixel point;The dim light source point in the predeterminable range hunting zone of each light source point is eliminated, and reduces background The pixel value of pixel, wherein, by counting the trend that different light sources slows down with the distance radiation of real 3D physical spaces To determine the range search scope.
Alternatively, the determining module specifically for:
Pixel by the pixel value difference more than the light source point threshold value, is defined as light source point, eliminates each light source point Predeterminable range hunting zone in dim light source point;Pixel by the pixel value difference less than or equal to the light source point threshold value Point, is defined as background pixel point, and reduce the pixel value of background pixel point.
Alternatively, the dim light source point in the predeterminable range hunting zone for eliminating each light source point includes:
Centered on the space length of light source point each described, according to each pixel correspondence locus being previously obtained Space object distance, other light source points are looked in the range of the range search for pre-setting, the light source point that will be looked for The light source point that brightness is less than the luminance threshold for pre-setting is set to background pixel point.
Alternatively, when the pixel value difference more than the light source point threshold value for calculating includes two or more When, the processing module is additionally operable to:
The brightness value of maximum in the pixel value difference is chosen as the brightness value of the pixel, or, by multiple pictures The average value of the brightness value of plain difference as the pixel brightness value.
Present invention also offers a kind of capture apparatus, including realizing described in any of the above-described light paints the device of photography.
Technical scheme proposed by the present invention includes:Multiple image to photographing is pre-processed;It is every after acquisition treatment The pixel value of each pixel of two field picture;For each pixel, the pixel value difference between adjacent two field picture is calculated respectively; According to the pixel value difference for obtaining and the light source point threshold value for pre-setting, each pixel is defined as light source point or background pixel point; The dim light source point in the predeterminable range hunting zone of each light source point is eliminated, the pixel value of background pixel point is reduced, wherein, pass through The different light source of statistics determines the range search scope with the trend that the distance radiation of real 3D physical spaces is slowed down.This Invention increases track and the back of the body of light by the difference to light source point and background pixel point and the pixel value of reduction background pixel point The contrast effect of scape so that the background luminance of image is dimmed, the effect that light strong Scene realization night light is painted is crossed on daytime, The application scenarios that light paints photography are extended, user is improved and is shot experience.
Brief description of the drawings
Fig. 1 is the hardware architecture diagram for realizing each optional mobile terminal of embodiment one of the invention;
Fig. 2 is that the present invention realizes that light paints the flow chart of the method for photography;
Fig. 3 is do not occur the curve of cyclical fluctuations of the brightness value of certain pixel of light source point between different frame in the present invention to illustrate Figure;
Fig. 4 is occur the curve of cyclical fluctuations of the brightness value of certain pixel of light source point between different frame in the present invention to illustrate Figure;
Fig. 5 is occur the curve of cyclical fluctuations of two brightness values of certain pixel of light source point between different frame in the present invention to show It is intended to;
Fig. 6 is that the present invention realizes that light paints the schematic flow sheet of the embodiment of the method for photography;
Fig. 7 is that the present invention realizes that light paints the composition structural representation of the device of photography.
The realization of the object of the invention, functional characteristics and advantage will be described further referring to the drawings in conjunction with the embodiments.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The mobile terminal of each embodiment of the invention is realized referring now to Description of Drawings.In follow-up description, use For represent element such as " module ", " part " or " unit " suffix only for being conducive to explanation of the invention, itself Not specific meaning.Therefore, " module " can be used mixedly with " part ".
Mobile terminal can be implemented in a variety of manners.For example, the terminal described in the present invention can include such as moving Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP The mobile terminal of (portable media player), guider etc. and such as numeral TV, desktop computer etc. are consolidated Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for movement Outside the element of purpose, construction according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 is that the hardware configuration for realizing each optional mobile terminal of embodiment one of the invention is illustrated.
Mobile terminal 1 00 can include wireless communication unit 110, A/V (audio/video) input block 120, user input Unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180 and power subsystem 190 Etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that being not required for implementing all groups for showing Part.More or less component can alternatively be implemented.The element of mobile terminal will be discussed in more detail below.
Wireless communication unit 110 generally includes one or more assemblies, and it allows mobile terminal 1 00 and wireless communication system Or the radio communication between network.For example, wireless communication unit can include broadcasting reception module 111, mobile communication module 112nd, at least one of wireless Internet module 113, short range communication module 114 and location information module 115.
Broadcasting reception module 111 receives broadcast singal and/or broadcast via broadcast channel from external broadcast management server Relevant information.Broadcast channel can include satellite channel and/or terrestrial channel.Broadcast management server can be generated and sent The broadcast singal and/or broadcast related information generated before the server or reception of broadcast singal and/or broadcast related information And send it to the server of terminal.Broadcast singal can include TV broadcast singals, radio signals, data broadcasting Signal etc..And, broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast phase Pass information can also be provided via mobile communications network, and in this case, broadcast related information can be by mobile communication mould Block 112 is received.Broadcast singal can exist in a variety of manners, for example, it can be with the electronics of DMB (DMB) The form of program guide (EPG), the electronic service guidebooks (ESG) of digital video broadcast-handheld (DVB-H) etc. and exist.Broadcast Receiver module 111 can receive signal and broadcast by using various types of broadcast systems.Especially, broadcasting reception module 111 Can be wide by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video Broadcast-hand-held (DVB-H), forward link media (MediaFLO@) Radio Data System, received terrestrial digital broadcasting integrated service Etc. (ISDB-T) digit broadcasting system receives digital broadcasting.Broadcasting reception module 111 may be constructed such that and be adapted to provide for extensively Broadcast the various broadcast systems and above-mentioned digit broadcasting system of signal.Via broadcasting reception module 111 receive broadcast singal and/ Or broadcast related information can be stored in memory 160 (or other types of storage medium).
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal And at least one of server and/or receive from it radio signal.Such radio signal can be logical including voice Words signal, video calling signal or the various types of data for sending and/or receiving according to text and/or Multimedia Message.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.The module can be internally or externally It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by the module can include WLAN (WLAN) (Wi-Fi), Wibro (WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting junction service.Some examples of short-range communication technology include indigo plant ToothTM, radio frequency identification (RFID), Infrared Data Association (IrDA), ultra wide band (UWB), purple honeybeeTMEtc..
Location information module 115 is the module for checking or obtaining the positional information of mobile terminal.Location information module Typical case be GPS (global positioning system).According to current technology, GPS module 115 is calculated and comes from three or more satellites Range information and correct time information and the Information application triangulation for calculating, so as to according to longitude, latitude Highly accurately calculate three-dimensional current location information.Currently, defended using three for calculating the method for position and temporal information Star and the position that is calculated by using other satellite correction and the error of temporal information.Additionally, GPS module 115 Can be by Continuous plus current location information in real time come calculating speed information.
A/V input blocks 120 are used to receive audio or video signal.A/V input blocks 120 can include the He of camera 121 Microphone 1220, the static map that 121 pairs, camera is obtained in Video Capture pattern or image capture mode by image capture apparatus The view data of piece or video is processed.Picture frame after treatment may be displayed on display unit 151.At camera 121 Picture frame after reason can be stored in memory 160 (or other storage mediums) or carried out via wireless communication unit 110 Send, two or more cameras 1210 can be provided according to the construction of mobile terminal.Microphone 122 can be in telephone relation mould Sound (voice data) is received via microphone in formula, logging mode, speech recognition mode etc. operational mode, and can be by Such acoustic processing is voice data.Audio (voice) data after treatment can be changed in the case of telephone calling model For the form that can be sent to mobile communication base station via mobile communication module 112 is exported.Microphone 122 can implement all kinds Noise eliminate (or suppress) algorithm eliminating (or suppression) in the noise for receiving and producing during sending audio signal or Person disturbs.
User input unit 130 can generate key input data to control each of mobile terminal according to the order of user input Plant operation.User input unit 130 allows the various types of information of user input, and can include keyboard, metal dome, touch Plate (for example, detection due to being touched caused by resistance, pressure, electric capacity etc. change sensitive component), roller, rocking bar etc. Deng.Especially, when touch pad is superimposed upon on display unit 151 in the form of layer, touch-screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 1 00, (for example, mobile terminal 1 00 opens or closes shape State), the presence or absence of the contact (that is, touch input) of the position of mobile terminal 1 00, user for mobile terminal 1 00, mobile terminal The acceleration or deceleration movement of 100 orientation, mobile terminal 1 00 and direction etc., and generate for controlling mobile terminal 1 00 The order of operation or signal.For example, when mobile terminal 1 00 is embodied as sliding-type mobile phone, sensing unit 140 can be sensed The sliding-type phone is opened or closed.In addition, sensing unit 140 can detect power subsystem 190 whether provide electric power or Whether person's interface unit 170 couples with external device (ED).Sensing unit 140 can will be combined below including proximity transducer 1410 Touch-screen is described to this.
Interface unit 170 is connected the interface that can pass through with mobile terminal 1 00 as at least one external device (ED).For example, External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing Line FPDP, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end Mouth, video i/o port, ear port etc..Identification module can be that storage uses each of mobile terminal 1 00 for verifying user Kind of information and subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) can be included Etc..In addition, the device (hereinafter referred to as " identifying device ") with identification module can take the form of smart card, therefore, know Other device can be connected via port or other attachment means with mobile terminal 1 00.Interface unit 170 can be used for reception and come from The input (for example, data message, electric power etc.) of the external device (ED) and input that will be received is transferred in mobile terminal 1 00 One or more elements can be used for transmitting data between mobile terminal and external device (ED).
In addition, when mobile terminal 1 00 is connected with external base, interface unit 170 can serve as allowing by it by electricity Power provides to the path of mobile terminal 1 00 from base or can serve as allowing the various command signals being input into from base to pass through it It is transferred to the path of mobile terminal.Be can serve as recognizing that mobile terminal is from the various command signals or electric power of base input The no signal being accurately fitted within base.Output unit 150 is configured to provide defeated with vision, audio and/or tactile manner Go out signal (for example, audio signal, vision signal, alarm signal, vibration signal etc.).Output unit 150 can include display Unit 151, dio Output Modules 152, alarm unit 153 etc..
Display unit 151 may be displayed on the information processed in mobile terminal 1 00.For example, when mobile terminal 1 00 is in electricity During words call mode, display unit 151 can show and converse or other communicate (for example, text messaging, multimedia file Download etc.) related user interface (UI) or graphic user interface (GUI).When mobile terminal 1 00 is in video calling pattern Or during image capture mode, display unit 151 can show the image of capture and/or the image of reception, show video or figure UI or GUI of picture and correlation function etc..
Meanwhile, when display unit 151 and touch pad in the form of layer it is superposed on one another to form touch-screen when, display unit 151 can serve as input unit and output device.Display unit 151 can include liquid crystal display (LCD), thin film transistor (TFT) In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least It is a kind of.Some in these displays may be constructed such that transparence to allow user to be watched from outside, and this is properly termed as transparent Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific Desired implementation method, mobile terminal 1 00 can include two or more display units (or other display devices), for example, moving Dynamic terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used to detect touch Input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal be in call signal reception pattern, call mode, logging mode, It is that wireless communication unit 110 is received or in memory 160 when under the isotypes such as speech recognition mode, broadcast reception mode The voice data transducing audio signal of middle storage and it is output as sound.And, dio Output Modules 152 can be provided and movement The audio output (for example, call signal receives sound, message sink sound etc.) of the specific function correlation that terminal 100 is performed. Dio Output Modules 152 can include loudspeaker, buzzer etc..
Alarm unit 153 can provide output and be notified to mobile terminal 1 00 with by event.Typical event can be with Including calling reception, message sink, key signals input, touch input etc..In addition to audio or video is exported, alarm unit 153 can in a different manner provide output with the generation of notification event.For example, alarm unit 153 can be in the form of vibrating Output is provided, when calling, message or some other entrance communication (incomingcommunication) are received, alarm list Unit 153 can provide tactile output (that is, vibrating) to notify to user.Exported by providing such tactile, even if When in pocket of the mobile phone of user in user, user also can recognize that the generation of various events.Alarm unit 153 The output of the generation of notification event can be provided via display unit 151 or dio Output Modules 152.
Memory 160 can store software program for the treatment and control operation performed by controller 180 etc., Huo Zheke Temporarily to store oneself data (for example, telephone directory, message, still image, video etc.) through exporting or will export.And And, memory 160 can store the vibration of various modes on being exported when touching and being applied to touch-screen and audio signal Data.
Memory 160 can include the storage medium of at least one type, and the storage medium includes flash memory, hard disk, many Media card, card-type memory (for example, SD or DX memories etc.), random access storage device (RAM), static random-access storage Device (SRAM), read-only storage (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc..And, mobile terminal 1 00 can perform memory with by network connection The network storage device cooperation of 160 store function.
The overall operation of the generally control mobile terminal of controller 180.For example, controller 180 is performed and voice call, data Communication, video calling etc. related control and treatment.In addition, controller 180 can be included for reproducing (or playback) many matchmakers The multi-media module 1810 of volume data, multi-media module 1810 can be constructed in controller 180, or can be structured as and control Device processed 180 is separated.Controller 180 can be with execution pattern identifying processing, the handwriting input that will be performed on the touchscreen or figure Piece draws input and is identified as character or image.
Power subsystem 190 receives external power or internal power under the control of controller 180 and provides operation each unit Appropriate electric power needed for part and component.
Various implementation methods described herein can be with use such as computer software, hardware or its any combination of calculating Machine computer-readable recording medium is implemented.Implement for hardware, implementation method described herein can be by using application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can Programming gate array (FPGA), processor, controller, microcontroller, microprocessor, it is designed to perform function described herein At least one in electronic unit is implemented, and in some cases, such implementation method can be implemented in controller 180. For software implementation, the implementation method of such as process or function can with allow to perform the single of at least one function or operation Software module is implemented.Software code can be come by the software application (or program) write with any appropriate programming language Implement, software code can be stored in memory 160 and performed by controller 180.
So far, oneself according to its function through describing mobile terminal.Below, for the sake of brevity, will description such as folded form, Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc. is used as showing Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.
Mobile terminal 1 00 as shown in Figure 1 may be constructed such that using via frame or packet transmission data it is all if any Line and wireless communication system and satellite-based communication system are operated.
Based on above-mentioned mobile terminal hardware configuration and communication system, the inventive method each embodiment is proposed.
Fig. 2 is that the present invention realizes that light paints the flow chart of the method for photography, for the capture apparatus with shadow camera function, Such as camera, mobile terminal, when pressing shooting button or triggering virtual shooting button, as shown in Fig. 2 including:
Step 200:Multiple image to photographing is pre-processed.
Pretreatment in this step includes but is not limited to the treatment such as registration.
Also include before this step:
The hand-held capture apparatus with shadow camera function;
Mobile light source point, presses shooting button or triggers virtual shooting button, is continuously shot the multiframe of recording light source track Image.
In this step, for that can cause during filming apparatus such as camera shake, such as handheld camera carries out light and paints shooting, Image registration treatment is added, so, the pixel of two width or multiple image can be alignd.Meanwhile, based on registering flow Hand-held screening-mode reduces the constraint for fixing device such as tripod, also improves the convenience of application.
Wherein, registration process can be generally comprised:
Feature extraction:Extract the obvious characteristic point of image, such as enclosed region, edge, profile, angle point.These are special Levying a little can be as the reference point of image registration;
Characteristic matching:The correspondence pass for describing algorithm and similarity measurement by feature to set up between extracted feature System, looks for the pixel corresponding to different images;
Transformation model is estimated:According to the situation of the geometric distortion between image subject to registration and reference picture, selection can be optimal The geometric transformation model changed between fitting two images, common transformation model includes affine transformation, perspective transform, multinomial Conversion etc., most common of which is affine transformation and polynomial transformation.
Coordinate transform and interpolation:Image subject to registration is carried out into corresponding parameter transformation, makes image subject to registration and reference picture Under same coordinate system.Because the coordinate points after image conversion are not necessarily integer, therefore, can contemplate here certain Interpolation processing operation.Conventional interpolation method includes:Arest neighbors interpolation, bilinear interpolation, bicubic interpolation, B-spline interpolation, height This interpolation.
Step 201:The pixel value of each pixel of the every two field picture after acquisition treatment.
Pixel value in this step can be brightness value P.Brightness value P in the application is equal to gray value.If light is painted What photography was carried out is color camera, then need that color-values first are converted into gray value, recycles the method for the present invention to realize that light is painted Photography.Here, how color-values are converted into the conventional techniques that gray value belongs to those skilled in the art, are implemented simultaneously It is not intended to limit the scope of the invention, repeats no more here.
Step 202:For each pixel, the pixel value difference between adjacent two field picture is calculated respectively.
Fig. 3 is do not occur the curve of cyclical fluctuations of the brightness value of certain pixel of light source point between different frame in the present invention to illustrate Figure, Fig. 4 is curve of cyclical fluctuations schematic diagram of the brightness value of certain pixel of light source point between different frame occur in the present invention.In reality In the application of border, present inventor has found, is background dot for the non-light source point in image, and the brightness of its brightness ratio light source point will It is low, if as shown in figure 3, there is not light source point in whole light paints shooting in certain pixel, then, at the pixel position Pixel value of the brightness value in each two field picture be that brightness value is typically become up and down in an a small range on the basis of brightness value P0 Change, be the image due to when the capture apparatus with shadow camera function are imaged the reason for the brightness small range of image pixel changes The amount of pixels brought for the treatment of changes caused by cause not of uniform size, and this excursion is smaller, will not be erroneously interpreted as due to The fluctuation that light source point brings;
And when light paints shooting, if occurring light source point in image, then, the brightness value P of the light source point corresponding pixel points It is typically higher, as shown in Figure 4, it is shown that the pixel value such as brightness value P of certain pixel per two field picture are between different frame Fluctuating change curve, during being continuously shot, there is light source point in a certain moment t1, the pixel position, in the pixel The pixel curve of cyclical fluctuations of point can see an obvious pulse ripple, i.e. pixel brightness value and jump to brightness value by brightness value P0 P1;
In this step, exactly by calculating the situation of change of each pixel in consecutive frame respectively, as judging each pixel Whether be light source point foundation.
For certain pixel, its pixel value difference between adjacent two field picture is:The pixel value of latter two field picture is for example bright Angle value P (t+1) subtracts pixel value difference d (t) that pixel value such as brightness value P (t) of previous frame image is obtained.
Step 203:According to the pixel value difference for obtaining and the light source point threshold value for pre-setting, each pixel is defined as light source Point or background pixel point.
Pixel for pixel value difference d (t) more than light source point threshold value Threshold, is defined as light source point, and for picture Plain difference is defined as background pixel point less than or equal to the pixel of light source point threshold value.
Light source point threshold value Threshold to be arranged at light source relevant with background difference situation.Typically, the light source pixel of image After occurring in the scene, the brightness of light source pixel can be variant with the brightness of background pixel, is kept not in filming apparatus such as camera Dynamic, variation of the background pixel between each frame is smaller, and typically near 0 value, light source point threshold value Threshold is at least needed 0 is greater than, by counting each middle different light source, present inventor has found, light source is stronger, and background is darker, light source and background Difference d it is bigger, light source point threshold value Threshold can set larger, otherwise light source point threshold value Threshold will set small Some.
Difference value d of the image slices vegetarian refreshments between each frame, can be by counting the light of varying strength between [0,255] Source and the difference value d of background, obtain the minimum value dmin of the difference value d of statistics, then, light source point threshold value Threshold's takes Value may range from (0, dmin).
In order to the track for obtaining light contrasts clearly demarcated effect, the brightness value setting of the background pixel point that will can be determined It is very low, as long as the light track that light source point is formed can be embodied clearly, such as can be by the brightness of background pixel point Value is set to 0.So, the background luminance of image is dimmed, and the effect that light strong Scene realization night light is painted is crossed on daytime.
Alternatively, for certain pixel, if in step 202. calculate pixel value difference, occur two or two with On pixel value difference d (t) more than light source point threshold value Threshold pixel when, Fig. 5 is to be more than in the presence of two pixel difference values The schematic diagram of the situation of light source point threshold value Threshold, as shown in figure 5, in moment t1, there is light source point in the pixel position, Obvious pulse ripple, i.e. a pixel brightness value are can see in the pixel curve of cyclical fluctuations of the pixel to be jumped to by brightness value P0 Brightness value P1;In moment t2, there is light source point in the pixel position, and one is can see in the pixel curve of cyclical fluctuations of the pixel Obvious pulse ripple, i.e. pixel brightness value jump to brightness value P2 by brightness value P0.At this point it is possible to choose maximum of which brightness Be worth as the brightness value of the pixel, it is also possible to using the average value of this multiple brightness value as the pixel brightness value, etc., As long as ensureing that the track for obtaining light contrasts clearly demarcated effect.There is two or more pixel value difference d (t) more than light source point threshold value The situation of the pixel of Threshold is similar to, and repeats no more here.
Step 204:The dim light source point in the predeterminable range hunting zone of each light source point is eliminated, background pixel point is reduced Pixel value.
If centered on light source point, then, the distance apart from light source center is more remote, and the influence of radiation of light source is smaller.Cause This, this step is specifically included:Centered on the space length of each light source point, (binocular platform is such as utilized according to what is be previously obtained Calculate) each pixel correspondence locus space object distance, looked in the range of the range search for pre-setting Other light source points, the brightness of the light source point that will be looked for is set to background picture less than the light source point of the luminance threshold for pre-setting Vegetarian refreshments, such as be set to 0 by its brightness value.The influence of radiating light source can so be eliminated.
Wherein, range search scope can be subtracted by counting different light sources as real 3D physical spaces distance is radiated The trend of speed determines, so, hunting zone space is preferably determined.
Wherein, so, just can be determined as the numerical value that distance weakens can be what is come out due to light-source brightness Luminance threshold.
Present inventor has found that centered on light source point, the distance apart from light source center is more remote, the influence of radiation of light source Smaller, the brightness of light source is weaker, and the pixel of these dim light source points is synthesized to final image, the whole structure that light can be influenceed to paint. Therefore, in this step, using binocular platform can calculate image scene each pixel correspondence locus physics away from From eliminating these dim light source points by the treatment of this step, it is to avoid the influence of the image to final synthesis of radiating light source, carry Light high paints the whole structure of photography.
As long as it should be noted that the treatment for eliminating the dim light source point in the predeterminable range hunting zone of each light source point exists After determining light source point, without strict sequencing, this is sequentially for the treatment with the pixel value for reducing background pixel point It is not intended to limit the scope of the invention.
In the technical scheme that the present invention is provided, on the one hand, space length is real physical space distance, is by binocular The space physics distance that platform is calculated;On the other hand, by count different light source with real 3D physical spaces away from From the trend that radiation is slowed down, hunting zone space is preferably determined, in general, more than certain hunting zone, light source spoke The influence penetrated very little, at this moment, it is possible to it is determined that hunting zone substantially;Meanwhile, in the hunting zone, light source is bright Spend as the numerical value that distance weakens can also easily come out, with the luminance threshold for determining to pre-set.
Fig. 6 is that the present invention realizes that light paints the schematic flow sheet of the embodiment of the method for photography, in the present embodiment, it is assumed that hand-held The camera of photography, mobile light source point are painted with light, and is pressed shooting button or is triggered virtual shooting button, be continuously shot recording light The multiple image of source track, including:
Step 600:Multiple image to photographing is pre-processed.
Pretreatment in this step includes but is not limited to the treatment such as registration, and/or alignment.
Step 601:The pixel value of each pixel of the every two field picture after acquisition treatment.
Pixel value in this step is brightness value P, and brightness value P is equal to gray value.
If it should be noted that light paints photography, and carry out is color camera, needing that color-values first are converted into gray scale Value, recycles the method for the present invention to realize that light paints photography.Here, how color-values are converted into gray value and belong to art technology The conventional techniques of personnel, implement the protection domain being not intended to limit the present invention, and repeat no more here.
Step 602:For each pixel, the pixel value difference between adjacent two field picture is calculated respectively.
For example, it is assumed that including m pixel per two field picture:Pixel 1, pixel 2, pixel 3 ... pixel n, pixel Point n+1 ... pixels m.For pixel n, it is assumed that at the t2 moment, brightness value P is brightness value P1, at t2+1 moment, brightness value P It is P0, brightness value P1>Brightness value P0, then, pixel value difference d (the t)=P1-P0 of the pixel.If it should be noted that T2 moment, brightness value P is brightness value P0, and at the t2+1 moment, brightness value P is P1, brightness value P1>Brightness value P0, then, the pixel The difference that pixel value difference d (the t)=P1-P0 of point is obtained takes absolute value again.
Step 603:For each pixel, the pixel value difference for comparing acquisition and the light source point threshold value for pre-setting, if The pixel value difference of acquisition is more than light source point threshold value, then into step 6041;If the pixel value difference for obtaining is less than or equal to light source Point threshold value, then into step 6042.
Light source point threshold value Threshold to be arranged at light source relevant with background difference situation.Typically, the light source pixel of image After occurring in the scene, the brightness of light source pixel can be variant with the brightness of background pixel, is kept not in filming apparatus such as camera Dynamic, variation of the background pixel between each frame is smaller, and typically near 0 value, light source point threshold value Threshold is at least needed 0 is greater than, by counting each middle different light source, present inventor has found, light source is stronger, and background is darker, light source and background Difference d it is bigger, light source point threshold value Threshold can set larger, otherwise light source point threshold value Threshold will set small Some.
Difference value d of the image slices vegetarian refreshments between each frame, can be by counting the light of varying strength between [0,255] Source and the difference value d of background, obtain the minimum value dmin of the difference value d of statistics, then, light source point threshold value Threshold's takes Value may range from (0, dmin).
Step 6041:The pixel is determined for light source point, return to step 603, until whole pixels compare completion, is entered Enter step 605.
Step 6042:The pixel is determined for background pixel point, return to step 603, until whole pixels are completeer Into eliminating and enter step 605 after the dim light source point in the predeterminable range hunting zone of each light source point.
In this step, the dim light source point eliminated in the predeterminable range hunting zone of each light source point includes:With each light source Centered on the space length of point, the space object distance of each pixel correspondence locus calculated according to binocular platform, Other light source points are looked in the range of the range search for pre-setting, the brightness of the light source point that will be looked for is less than and pre-sets The light source point of luminance threshold be set to background pixel point, such as its brightness value is set to 0.Radiating light source can so be eliminated Influence.
Step 605:The brightness value of the light source point that will be determined is set to the brightness value of maximum, the background pixel that will be determined The brightness value of point is set to 0.
Fig. 7 is that the present invention realizes that light paints the composition structural representation of the device of photography, as shown in fig. 7, at least including:Pre- place Reason module, acquisition module, processing module, determining module, wherein,
Pretreatment module, for being pre-processed to the multiple image for photographing.
Pretreatment in this step includes but is not limited to the treatment such as registration, and/or alignment.
Acquisition module, the pixel value of each pixel of the every two field picture after being processed for acquisition.
Processing module, for for each pixel, the pixel value difference between adjacent two field picture being calculated respectively.
Determining module, for according to the pixel value difference for obtaining and the light source point threshold value for pre-setting, each pixel being determined It is light source point or background pixel point;The dim light source point in the predeterminable range hunting zone of each light source point is eliminated, and reduces background The pixel value of pixel.
Alternatively,
Processing module specifically for:
For certain pixel, its pixel value difference between adjacent two field picture is:The pixel value of latter two field picture is for example bright Angle value P (t+1) subtracts pixel value difference d (t) that pixel value such as brightness value P (t) of previous frame image is obtained.
Determining module specifically for:
Pixel for pixel value difference d (t) more than light source point threshold value Threshold, is defined as light source point, eliminates each Dim light source point in the predeterminable range hunting zone of light source point;Pixel for pixel value difference less than or equal to light source point threshold value Point, is defined as background pixel point, and reduce the pixel value of background pixel point.
Wherein, the dim light source point eliminated in the predeterminable range hunting zone of each light source point includes:With each light source point Centered on space length, the space object distance of each pixel correspondence locus calculated according to binocular platform, pre- Other light source points are looked in the range of the range search for first setting, the brightness of the light source point that will be looked for is bright less than what is pre-set The light source point for spending threshold value is set to background pixel point, such as its brightness value is set into 0.The shadow of radiating light source can so be eliminated Ring.
Wherein, light source point threshold value Threshold to be arranged at light source relevant with background difference situation.Typically, the light of image After source pixel occurs in the scene, the brightness of light source pixel can be variant with the brightness of background pixel, in filming apparatus such as camera Remain stationary as, variation of the background pixel between each frame is smaller, typically near 0 value, light source point threshold value Threshold At least need more than 0, by counting each middle different light source, present inventor has found that light source is stronger, and background is darker, light source Difference d with background is bigger, and light source point threshold value Threshold can set larger, otherwise light source point threshold value Threshold will Set smaller.
Difference value d of the image slices vegetarian refreshments between each frame, can be by counting the light of varying strength between [0,255] Source and the difference value d of background, obtain the minimum value dmin of the difference value d of statistics, then, light source point threshold value Threshold's takes Value may range from (0, dmin).
Alternatively,
When there is pixel of two or more pixel value differences d (t) more than light source point threshold value Threshold, Brightness value of the maximum of which brightness value as the pixel is chosen, or, using the average value of multiple brightness values as the pixel The brightness value of point.
The present invention also provides a kind of capture apparatus, and light paints the device of photography to include realizing described in any of the above-described.
It should be noted that herein, term " including ", "comprising" or its any other variant be intended to non-row His property is included, so that process, method, article or device including a series of key elements not only include those key elements, and And also include other key elements being not expressly set out, or also include for this process, method, article or device institute are intrinsic Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this Also there is other identical element in the process of key element, method, article or device.
The embodiments of the present invention are for illustration only, and the quality of embodiment is not represented.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases The former is more preferably implementation method.Based on such understanding, technical scheme is substantially done to prior art in other words The part for going out contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium In (such as ROM/RAM, magnetic disc, CD), including some instructions are used to so that a station terminal (can be mobile phone, computer, service Device, air-conditioner, or network equipment etc.) perform method described in each embodiment of the invention.
The preferred embodiments of the present invention are these are only, the scope of the claims of the invention is not thereby limited, it is every to utilize this hair Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills Art field, is included within the scope of the present invention.

Claims (10)

1. it is a kind of to realize the method that light paints photography, it is characterised in that including:
Multiple image to photographing is pre-processed;
The pixel value of each pixel of the every two field picture after acquisition treatment;
For each pixel, the pixel value difference between adjacent two field picture is calculated respectively;
According to the pixel value difference for obtaining and the light source point threshold value for pre-setting, each pixel is defined as light source point or background pixel Point;
The dim light source point in the predeterminable range hunting zone of each light source point is eliminated, the pixel value of background pixel point is reduced, wherein, The range search model is determined with the trend that the distance radiation of real 3D physical spaces is slowed down by the light source for counting different Enclose.
2. method according to claim 1, it is characterised in that described that each pixel is defined as light source point or background pixel Point includes:
The pixel value difference is defined as light source point more than the pixel of the light source point threshold value;The pixel value difference is less than or waits In the pixel of light source point threshold value, it is defined as background pixel point.
3. method according to claim 1, it is characterised in that the pixel value of the reduction background pixel point includes:Will be described The brightness value of background pixel point is set to 0.
4. method according to claim 2, it is characterised in that for the pixel for being defined as light source point, when described When the pixel value difference more than the light source point threshold value for calculating includes two or more, also include:
The brightness value of maximum in the pixel value difference is chosen as the brightness value of the pixel, or, by multiple pixel differences The average value of the brightness value of value as the pixel brightness value.
5. method according to claim 1, it is characterised in that the predeterminable range hunting zone of each light source point of elimination Interior dim light source point includes:
Centered on the space length of light source point each described, according to the sky of each pixel correspondence locus being previously obtained Between object distance, other light source points are looked in the range of the range search for pre-setting, the brightness of the light source point that will be looked for Background pixel point is set to less than the light source point of the luminance threshold for pre-setting.
6. it is a kind of to realize the device that light paints photography, it is characterised in that including:Pretreatment module, acquisition module, processing module, really Cover half block, wherein,
Pretreatment module, for being pre-processed to the multiple image for photographing;
Acquisition module, the pixel value of each pixel of the every two field picture after being processed for acquisition;
Processing module, for for each pixel, the pixel value difference between adjacent two field picture being calculated respectively;
Determining module, for according to the pixel value difference for obtaining and the light source point threshold value for pre-setting, each pixel being defined as into light Source point or background pixel point;The dim light source point in the predeterminable range hunting zone of each light source point is eliminated, and reduces background pixel The pixel value of point, wherein, by counting different light source as the trend that the distance radiation of real 3D physical spaces is slowed down comes true The fixed range search scope.
7. device according to claim 6, it is characterised in that the determining module specifically for:
Pixel by the pixel value difference more than the light source point threshold value, is defined as light source point, eliminates the pre- of each light source point If the dim light source point in the range of range search;Pixel by the pixel value difference less than or equal to the light source point threshold value, really It is set to background pixel point, and reduces the pixel value of background pixel point.
8. device according to claim 7, it is characterised in that the predeterminable range hunting zone of each light source point of elimination Interior dim light source point includes:
Centered on the space length of light source point each described, according to the sky of each pixel correspondence locus being previously obtained Between object distance, other light source points are looked in the range of the range search for pre-setting, the brightness of the light source point that will be looked for Background pixel point is set to less than the light source point of the luminance threshold for pre-setting.
9. device according to claim 7, it is characterised in that when the picture more than the light source point threshold value for calculating When plain difference includes two or more, the processing module is additionally operable to:
The brightness value of maximum in the pixel value difference is chosen as the brightness value of the pixel, or, by multiple pixel differences The average value of the brightness value of value as the pixel brightness value.
10. a kind of capture apparatus, it is characterised in that light is painted takes the photograph including realizing described in claim any one of 6~claim 9 The device of shadow.
CN201611065720.1A 2016-11-28 2016-11-28 Method and device for realizing light painting photography, and photographic equipment Pending CN106713777A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611065720.1A CN106713777A (en) 2016-11-28 2016-11-28 Method and device for realizing light painting photography, and photographic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611065720.1A CN106713777A (en) 2016-11-28 2016-11-28 Method and device for realizing light painting photography, and photographic equipment

Publications (1)

Publication Number Publication Date
CN106713777A true CN106713777A (en) 2017-05-24

Family

ID=58934815

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611065720.1A Pending CN106713777A (en) 2016-11-28 2016-11-28 Method and device for realizing light painting photography, and photographic equipment

Country Status (1)

Country Link
CN (1) CN106713777A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110412828A (en) * 2018-09-07 2019-11-05 广东优世联合控股集团股份有限公司 Printing method and system of three-dimensional light track image

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103105977A (en) * 2012-12-11 2013-05-15 武汉智慧城市研究院股份有限公司 Method, device and system of contact identification resisting infrared noise
CN103810695A (en) * 2012-11-15 2014-05-21 浙江大华技术股份有限公司 Light source positioning method and device
CN103888683A (en) * 2014-03-24 2014-06-25 深圳市中兴移动通信有限公司 Mobile terminal and shooting method thereof
CN103973984A (en) * 2014-05-29 2014-08-06 深圳市中兴移动通信有限公司 Shooting method and device
CN104104798A (en) * 2014-07-23 2014-10-15 深圳市中兴移动通信有限公司 Method for shooting light painting video and mobile terminal
CN104159040A (en) * 2014-08-28 2014-11-19 深圳市中兴移动通信有限公司 Photographing method and photographing device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103810695A (en) * 2012-11-15 2014-05-21 浙江大华技术股份有限公司 Light source positioning method and device
CN103105977A (en) * 2012-12-11 2013-05-15 武汉智慧城市研究院股份有限公司 Method, device and system of contact identification resisting infrared noise
CN103888683A (en) * 2014-03-24 2014-06-25 深圳市中兴移动通信有限公司 Mobile terminal and shooting method thereof
CN103973984A (en) * 2014-05-29 2014-08-06 深圳市中兴移动通信有限公司 Shooting method and device
CN104104798A (en) * 2014-07-23 2014-10-15 深圳市中兴移动通信有限公司 Method for shooting light painting video and mobile terminal
CN104159040A (en) * 2014-08-28 2014-11-19 深圳市中兴移动通信有限公司 Photographing method and photographing device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110412828A (en) * 2018-09-07 2019-11-05 广东优世联合控股集团股份有限公司 Printing method and system of three-dimensional light track image

Similar Documents

Publication Publication Date Title
CN106791472B (en) A kind of exposure method and terminal
CN106502693B (en) A kind of image display method and device
CN104835165B (en) Image processing method and image processing device
CN106454121A (en) Double-camera shooting method and device
CN106603856A (en) Screen brightness adjusting method and terminal
CN106686301A (en) Picture shooting method and device
CN106851063A (en) A kind of exposure regulation terminal and method based on dual camera
CN106909274A (en) A kind of method for displaying image and device
CN106601189A (en) Display method and terminal
CN106713744A (en) Method and apparatus for realizing light painting photography, and shooting device
KR20160127606A (en) Mobile terminal and the control method thereof
CN106973227A (en) Intelligent photographing method and device based on dual camera
CN106850941A (en) Method, photo taking and device
CN108810422B (en) Lighting method, device and computer-readable storage medium for shooting environment
CN106686212A (en) Automatic brightness adjusting method and terminal
CN106534590A (en) Photo processing method and apparatus, and terminal
CN106534552B (en) Mobile terminal and its photographic method
CN105242483B (en) The method and apparatus that a kind of method and apparatus for realizing focusing, realization are taken pictures
CN106713718A (en) Dual camera-based focusing method and mobile terminal
CN106506963A (en) A kind of photographic method and terminal based on dual camera
CN106851125A (en) A kind of mobile terminal and multiple-exposure image pickup method
CN104935822A (en) Method and device for processing images
CN106791016A (en) A kind of photographic method and terminal
CN106651773A (en) Picture processing method and device
CN106534557B (en) A kind of the wallpaper switching system and method for display terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170524

RJ01 Rejection of invention patent application after publication