[go: up one dir, main page]

WO2016024680A1 - Boîte noire de véhicule permettant de reconnaître en temps réel une plaque d'immatriculation de véhicule en mouvement - Google Patents

Boîte noire de véhicule permettant de reconnaître en temps réel une plaque d'immatriculation de véhicule en mouvement Download PDF

Info

Publication number
WO2016024680A1
WO2016024680A1 PCT/KR2015/001760 KR2015001760W WO2016024680A1 WO 2016024680 A1 WO2016024680 A1 WO 2016024680A1 KR 2015001760 W KR2015001760 W KR 2015001760W WO 2016024680 A1 WO2016024680 A1 WO 2016024680A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
license plate
image
information
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2015/001760
Other languages
English (en)
Korean (ko)
Inventor
이감연
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mbrain Inc
Original Assignee
Mbrain Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mbrain Inc filed Critical Mbrain Inc
Publication of WO2016024680A1 publication Critical patent/WO2016024680A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62D—MOTOR VEHICLES; TRAILERS
    • B62D41/00—Fittings for identifying vehicles in case of collision; Fittings for marking or recording collision areas
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/02—Rear-view mirror arrangements
    • B60R1/04—Rear-view mirror arrangements mounted inside vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/40—Analysis of texture

Definitions

  • the present invention relates to a vehicle black box capable of real-time license plate recognition of a driving vehicle, and more particularly, to digital video using high-resolution digital video uncompressed data generated in real time when the license plate of a driving vehicle traveling on a road is photographed.
  • the present invention relates to a vehicle black box capable of real-time license plate recognition of a driving vehicle that improves the license plate recognition efficiency of a driving vehicle by extracting license plate information of the driving vehicle before compressing the file format.
  • Such a vehicle black box can record information before and after a crash in case of a traffic accident and provide information necessary to understand the situation. Also, it is equipped with a recording image storage function, a high pass function, and an emergency rescue signal function for convenience in real life. Providing.
  • the communication module is mounted on the vehicle black box, and the vehicle license plate information is extracted by using the digital video compressed data acquired from the vehicle black box and the license plate recognition technology of the parking control system, and the extracted license plate information is controlled. Efforts have been made to implement a technique for transmitting to the center.
  • the license plate photographed image of a running vehicle photographed in a black box has a problem that it is difficult to recognize a license plate of a criminal vehicle because the resolution is significantly lower than that of a stationary vehicle photographed by a parking control system.
  • a lens distortion phenomenon occurs as the lens frame goes closer to the frame of the captured image, and the resolution decreases.
  • a compressed image frame that is compressed and preserved in a digital video file format In the case of I-frame, the peripheral image of the frame, which has relatively more change than the frame center image, has a large amount of information of image data. Therefore, the loss of information amount of image data increases rapidly when compressing the image. There is a problem that it is difficult to recognize the license plate of the driving vehicle because the information amount of the image data necessary for the license plate recognition of the driving vehicle is insufficient.
  • the present invention has been made to solve the above problems, the present invention, by using the high-resolution digital video uncompressed data generated in real time by photographing the license plate of the vehicle, the vehicle of the driving vehicle before compression to a digital video file format It is an object of the present invention to provide a vehicle black box capable of real-time license plate recognition, which improves the license plate recognition efficiency of a running vehicle, compared to a technology of extracting license plate information by using digital video compressed data by extracting license plate information.
  • a vehicle black box capable of real-time license plate recognition of a driving vehicle is a vehicle black box attached to a specific vehicle having a camera lens and photographing a specific vehicle periphery, photographed through the camera lens.
  • An image sensor converting one image information into an electrical signal to generate a digital image signal;
  • An image processor which processes the digital image signal generated by the image sensor to generate digital video uncompressed data having an information amount corresponding to the image information around a specific vehicle;
  • a vehicle license plate information generating device for analyzing the digital video uncompressed data generated by the image processor to generate vehicle license plate information of a non-specified vehicle traveling around a specific vehicle; Combining driving information of a specific vehicle including vehicle license plate information of an unspecified vehicle generated by the vehicle license plate information generating device with the digital video uncompressed data generated by the image processor to generate driving video data of a specific vehicle, and the vehicle black
  • a controller for controlling the overall operation of the box;
  • An encoder for compressing the driving video data generated by the controller into a digital video file format
  • the apparatus for generating license plate information corresponds to a region of interest for extracting license plate information from each uncompressed image frame constituting the digital video uncompressed data generated by the image processor, and includes a color image image and a binary image image.
  • a ROI data selection unit for selecting one or more ROI data; And sequentially extracting a vehicle area, a license plate area, and a text area corresponding to the license plate information from the one or more ROI data selected by the ROI data selection unit, and then applying a character recognition algorithm to the text area and applying the characters constituting the license plate. It may include; ROI data processing unit for recognizing and generating license plate information consisting of text data.
  • the ROI data selection unit increases the license plate recognition speed by removing ROI data that is not necessary to generate vehicle license plate information when selecting one or more ROI data from each uncompressed image frame constituting the digital video uncompressed data. You can.
  • ROI data that is not necessary to generate the license plate information includes ROI data arranged above the horizon consisting of horizontal lines of vanishing points where lanes meet on each uncompressed image frame; ROI data including a text area having a text size of less than 15 pixels; And ROI data including a text area corresponding to the license plate information generated in the previous frame.
  • the ROI data processing unit compares the color image image constituting the ROI data selected by the ROI data selection unit with the feature points of the pre-analyzed vehicle and selects a vehicle region on each uncompressed image frame constituting the digital video uncompressed data.
  • a vehicle region extraction unit for extracting;
  • a license plate area extraction unit for extracting a license plate area using a binary image image constituting ROI data in the vehicle area extracted by the vehicle area extraction unit;
  • a character area recognition unit for separating a character area using a histogram from the number plate area extracted by the license plate area extraction unit;
  • a character code generator for generating a character code for text data corresponding to the license plate information by applying a character recognition algorithm to the character region extracted by the character region recognition unit.
  • the license plate area recognition unit compares the feature points of the binary image image with the pre-analyzed license plate, and the aspect ratio of the computed image and the pre-analyzed license plate obtained by sequentially performing a morphology operation and a BLOB operation on the binary image image.
  • the license plate area may be extracted by any of the methods of comparing the two.
  • the ROI data processor may further include a vehicle number tracking unit that tracks ROI data corresponding to the license plate information by using feature points of a previous frame and a current frame.
  • the ROI data processor may further include a character area restoration unit capable of restoring a character area including license plate information by applying a super resolution technique to a plurality of uncompressed image frames that are difficult to identify.
  • the control unit transmits the license plate information generated by the vehicle license plate information generating apparatus to the control center located at a remote location through the communication module or the crime vehicle information received from the control center and the unspecified vehicle generated by the vehicle license plate information generating apparatus. By comparing the license plate information of the crime can lookup the vehicle in real time.
  • a vehicle black box capable of real-time license plate recognition of a driving vehicle includes a memory for storing driving video digital compression data generated by the encoder;
  • a GPS module which communicates with a GPS satellite to obtain location information, time information, and route information included in driving information of the specific vehicle;
  • a touch panel unit which displays a driving screen of the specific vehicle and a playback screen of the driving video digital compression data stored in the memory, and an input menu for inputting emergency signals in case of a hit-off vehicle or emergency;
  • a shock detection signal is transmitted to the control unit so that the control unit stores driving information for a predetermined time and driving video digital compression data corresponding to the driving information in real time in the memory. part;
  • a calibration unit which checks and adjusts a horizontal state by using the acceleration sensor when the vehicle is attached.
  • the present invention provides a license plate information generating apparatus for extracting license plate information by using high-resolution digital video uncompressed data generated at the time of shooting. It is possible to prevent the lack of information of the lost image data, thereby improving the license plate recognition efficiency of the driving vehicle, and it is effective to provide a vehicle black box that can easily extract the vehicle number information using the photographed image while driving. .
  • the present invention has an effect of easily extracting the vehicle number information from the image taken while driving at high speed with an image processing unit for correcting the high-resolution digital video uncompressed data generated at the time of shooting to an optimal image.
  • the present invention provides a vehicle license plate by providing a ROI data selection unit inside the vehicle number generation device for selecting ROI data excluding the unnecessary area for recognizing the vehicle license plate of the driving vehicle among the frame areas constituting the high-resolution digital video uncompressed data Since it is possible to reduce the size of the ROI data required to recognize the license plate, it is possible to reduce the time required to recognize the license plate, thereby enabling the license plate recognition of the driving vehicle in real time.
  • the present invention by combining a plurality of frames difficult to identify by using a super resolution technique, a character area restoring unit capable of restoring a character corresponding to the vehicle number is provided inside the ROI data processing unit constituting the vehicle number generation device. It is effective to improve the license plate recognition efficiency.
  • the present invention includes a vehicle number tracking unit that tracks the frame coordinates of the ROI data from which the license plate information is recognized, each time the frame changes, to the ROI data processing unit constituting the vehicle license plate information generating apparatus. Since the specific area can be deleted from the ROI data selection target, the size of the ROI data selected by the ROI data selection unit can be reduced, thereby improving the license plate recognition speed of the driving vehicle.
  • the present invention is equipped with a communication module that can be connected to the mobile communication network, when the crime vehicle is inquired or hit by a short-distance accident in the near-by, when the immediate response is necessary to transmit the vehicle number information in real time to the control center It works.
  • FIG. 1 is a view showing the overall configuration of a vehicle black box capable of real-time license plate recognition of the driving vehicle according to an embodiment of the present invention.
  • FIG. 2 is a detailed configuration diagram of a vehicle license plate information generating device constituting the vehicle black box shown in FIG. 1.
  • FIG. 3 is a view for explaining ROI data removed by the ROI data selecting unit constituting the vehicle license plate information generating apparatus shown in FIG. 2.
  • FIG. 4 is a diagram illustrating separating a character area using a histogram in a character area recognition unit of the ROI data processor of the vehicle license plate information generating device shown in FIG. 2.
  • first and second are intended to distinguish one component from another component, and the scope of rights should not be limited by these terms.
  • first component may be named a second component, and similarly, the second component may also be named a first component.
  • an identification code (e.g., a, b, c, etc.) is used for convenience of description, and the identification code does not describe the order of the steps, and each step clearly indicates a specific order in context. Unless stated otherwise, they may occur out of the order noted. That is, each step may occur in the same order as specified, may be performed substantially simultaneously, or may be performed in the reverse order.
  • a vehicle black box capable of real-time license plate recognition of a driving vehicle relates to a vehicle black box attached to a specific vehicle with a camera lens and photographing the vicinity of the specific vehicle.
  • the license plate recognition efficiency of the driving vehicle can be improved by extracting the license plate information of the driving vehicle before compressing it into a digital video file format by using the high resolution digital video uncompressed data generated in real time during shooting.
  • the vehicle black foil capable of real-time license plate recognition of the driving vehicle according to the present invention because it can send and receive vehicle license plate information and criminal vehicle information in real time with the control centers such as police station, fire department and security company in real-time crime vehicle inquiry or emergency Can respond in real time in situations.
  • the region of interest described in the specification according to the present invention indicates a region necessary for image processing, and the data of the region corresponding to the region of interest is referred to as ROI data (region of interest).
  • the ROI is used when image processing is performed only on a specific area of the required part without applying image processing to the whole image, and a desired result can be obtained.In this case, only the partial area is processed instead of the whole area of the image. The time taken for image processing can be shortened.
  • the ROI is mainly extracted from the uncompressed image frame constituting the digital video uncompressed data.
  • the region of interest is specifically limited to the rectangular shape using the XY coordinate range.
  • various types of information may be additionally extracted and used as necessary.
  • FIG. 1 is a view showing the overall configuration of a vehicle black box capable of real-time license plate recognition of the driving vehicle according to an embodiment of the present invention.
  • the vehicle black box capable of real-time license plate recognition of the driving vehicle according to an embodiment of the present invention
  • the image sensor 10 the image processing unit 20, the vehicle number determination generating apparatus 100, the control unit 30, the encoder 40, and the communication module 50 may be included.
  • the image sensor 10 may generate a digital image signal by converting image information around the vehicle photographed through a camera lens of a vehicle black box into an electrical signal.
  • the image sensor 10 applied to the embodiment of the present invention serves to photograph a high-resolution image of the surroundings of the vehicle while driving, and can capture 20 frames or more per second at a HD level of 900,000 pixels or more.
  • the image sensor 10 used in the embodiment of the present invention may be a CMOS image sensor.
  • the CMOS image sensor is characterized in that the generation of electrical noise is reduced by reading the light-converted electrical signal, and the CCD image having a high voltage analog circuit is possible because it can be mass-produced compared to the CCD image sensor.
  • the manufacturing cost is low and the device size is small, so the power consumption is low.
  • a logic circuit can be manufactured in the same process so that the image processing circuit can be turned on-chip.
  • CMOS image sensor In the embodiment of the present invention, a CMOS image sensor is used, but a CMOS camera, a Charged Coupled Device (CCD) camera, or other imaging apparatus may be used depending on the purpose of use.
  • CCD Charged Coupled Device
  • the image processing unit 20 is a place for correcting and sharply processing an image captured in a high speed driving state by using an image processing technique, and processing a digital image signal generated by the image sensor 10 while driving.
  • the digital video uncompressed data having a relatively high resolution compared to the compressed state having an information amount corresponding to the image information around the specific vehicle.
  • the image processor 20 may use various image processing techniques as follows to overcome a phenomenon in which an image shakes when a moving object is photographed at a high speed in a driving vehicle.
  • the image processing unit 20 includes a camera control function for controlling the setting of the image sensor 10 and the aperture and the filter, and includes a function for controlling the automatic exposure to perform camera exposure according to the amount of light. It can be optimally controlled, and it can be adjusted to look the same regardless of the light source even if the color of the object is affected by the light source, including automatic color adjustment function.
  • the color of the license plate can be an important factor in determining the license plate area to be described later, it is possible to improve the license plate recognition rate by preventing the color change according to the light source with the automatic color control function.
  • the image processing unit 20 has a sensor dynamic range amplifier function, and when the relatively dark and bright areas exist simultaneously in the captured image, the dark areas are lighter and the bright areas are slightly darker. The area can be clearly seen at the same time, and this can be image processing to make the relatively dark portion of the license plate brighter because the license plate of the vehicle running in front of the backlight can be shaded and the recognition rate can be reduced.
  • the image processing unit 20 may have a noise suppression function.
  • the analog signal of the image sensor 10 may be amplified and used in order to secure a clear image in a low light environment, and since the unwanted noise is also amplified together, the quality of the acquired image may be significantly degraded.
  • a digital signal processing technology for suppressing noise may be used.
  • the image processing unit 20 may include a sharpness improving function to emphasize the outline of the photographed object. In general, if the noise is removed for noise suppression, the contour may disappear together.
  • the camera lens used in the vehicle black box as in the embodiment of the present invention uses a wide-angle lens having an angle of view of 100 degrees or more, when using a wide-angle lens, the geometric distortion occurs as the distance from the center of the lens becomes difficult to recognize the image. can do.
  • the amount of light passing through the lens center portion and the lens outer portion may be darker than the lens center.
  • the image processor 20 includes a function of correcting lens distortion, and may correct brightness according to distance toward the outside of the lens from the center of the lens.
  • the image processing unit 20 applied to the embodiment of the present invention has a function of automatically setting various parameters to automatically obtain an optimal image by automatically recognizing an environment such as backlight, nighttime, and rainy weather, and performing the automatic operation. It may be formed of an ISP (Image Signal Proceesor).
  • ISP Image Signal Proceesor
  • the vehicle black box according to the embodiment of the present invention includes an image processing unit for correcting high-resolution digital video uncompressed data generated during shooting to an optimal image, thereby easily obtaining vehicle number information from an image taken while driving at high speed. Can be extracted.
  • the vehicle license plate information generating apparatus 100 analyzes the digital video uncompressed data generated by the image processing unit 20 to drive around a specific vehicle or vehicle license plate information of an adjacent unspecified vehicle. Can be generated.
  • the vehicle license plate information generating apparatus 100 may recognize the vehicle number using a specific uncompressed image frame constituting the digital video uncompressed data generated by the image processor 20. Compared to image analysis based on I-frames (JPEG) constituting the compressed image frame, the vehicle number can be easily recognized because of the relatively high resolution and a large amount of information of the image information.
  • JPEG I-frames
  • the control unit 30 serves to control the overall operation of the vehicle black box according to an embodiment of the present invention, and generates the license plate information in the digital video uncompressed data generated by the image processing unit 20.
  • the driving video data of the specific vehicle may be generated by combining driving information of the specific vehicle including the license plate information of the unspecified vehicle generated by the apparatus 100.
  • control unit 30 transmits the license plate information generated by the vehicle license plate information generating apparatus 100 to the control center located at a remote location through the communication module 50 or the crime vehicle information received from the control center and the criminal vehicle search can be performed in real time by comparing the license plate information of the unspecified vehicle generated by the license plate information generating device.
  • the encoder 40 may generate driving video digital compression data by compressing the driving video data generated by the control unit 30 into a digital video file format.
  • the communication module 50 transmits the driving moving picture digital compression data generated by the encoder 40 to a remote control center or receives crime vehicle information from the remote control center under the control of the controller 30. can do.
  • the communication module 50 may transmit the license plate information to the remote control center, and can receive and receive various control signal information from the remote control center, wired communication module and One or more of the wireless communication modules can be implemented to communicate with the control center.
  • the communication module 50 may be implemented as a communication module for mobile communication supporting the LTE modem method or the CDMA method.
  • the black box for a vehicle includes a communication module that can be connected to a mobile communication network, and when a crime vehicle is inquired or a hit-and-shoot accident occurs in a short distance, an immediate response is required in a control center. Vehicle number information can be transmitted.
  • the vehicle black box capable of real-time license plate recognition of the driving vehicle according to an embodiment of the present invention
  • the unit 90 may further include a calibration unit 200.
  • the memory 60 may store driving video digital compression data generated by the encoder 40, and the GPS module 70 communicates with a GPS satellite to include in driving information of a specific vehicle.
  • the location information, time information, and route information can be obtained.
  • the memory 60 may serve as a storage space for storing various data and a control program for controlling the vehicle black box as well as a moving video.
  • the touch panel unit 80 may display a driving screen of a specific vehicle, a playback screen of the moving video digital compression data stored in the memory, and an input menu for inputting an emergency signal in case of an emergency vehicle or an emergency vehicle.
  • the touch panel unit 80 may display a vehicle number recognized as a crime vehicle under the control of the controller 30, and may be implemented as an LCD display device and an LED display screen interlocked with a separate input device. have.
  • the shock detection unit 90 includes an impact sensor to generate an event when it detects a shock greater than a predetermined reference value and transmits an impact detection signal to the control unit 30 to cause the control unit 30 to perform a memory 60 in real time. ) May store the driving information for a predetermined time and the driving video digital compression data corresponding to the driving information.
  • the calibration unit 200 may check the horizontal state by using the acceleration sensor when the vehicle is attached.
  • the calibration unit 200 may serve to inform the user of a horizontal state by using an acceleration sensor so that license plate recognition can be performed at an optimal state when the camera is installed.
  • the calibration unit 200 extracts camera parameters inside and outside the camera and outputs them to the touch panel by using lane intervals or vehicle widths of the driving video digital compression data stored in the memory.
  • the character can be adjusted in a state where it can be recognized.
  • FIG. 2 is a detailed configuration diagram of a vehicle license plate information generating device constituting the vehicle black box shown in FIG. 1.
  • the vehicle license plate information generating device 100 constituting a vehicle black box capable of real-time license plate recognition of the driving vehicle according to an embodiment of the present invention
  • ROI data selection unit 110 and ROI data processing unit 120 may be provided.
  • the ROI data selector 110 may include one or more ROI data shown in FIG. 3 described below in each uncompressed image frame constituting the digital video uncompressed data generated by the image processor 20. You can choose.
  • the ROI data which indicates a region of interest for extracting the license plate information, includes a color image image and a binary image image and may be extracted from each uncompressed image frame.
  • the RO data selection unit 110 may perform various operations for improving the accuracy in reducing the amount of calculation and extracting and recognizing license plate information in the ROI data processing unit 120 to be described later.
  • the ROI data selection unit 110 may change the size of the captured image, change the color image into a GRAY image as necessary, perform image binarization, and extract the outline. It may serve to perform preprocessing on ROI data obtained from uncompressed data.
  • the ROI data selector 110 may additionally extract lanes from the ROI data obtained from the uncompressed video data, track license plate information identified in a previous image, extract vanishing points, and configure an image.
  • the non-road area can be removed from the background area.
  • the ROI data selection unit 110 an optical element required for the camera lens and the image sensor to calculate the coordinate position and size in the image in order to correct the installation position corresponding to the lens of various angles of view and ensure the camera vision Can be extracted or calculated.
  • the ROI data that is not necessary to generate the license plate information in the ROI data selection unit 110 may be removed, and a detailed description thereof will be described later with reference to FIG. 3.
  • the ROI data processor 120 may sequentially extract a vehicle area, a license plate area, and a character area corresponding to the vehicle license plate information from one or more ROI data selected by the ROI data selector 110.
  • the ROI data processor 120 may recognize a character constituting the license plate by applying a character recognition algorithm to the character region sequentially extracted, and may generate vehicle license plate information consisting of text data.
  • the ROI data processing unit 120 as shown in the figure, vehicle area extraction unit 121, license plate area extraction unit 122, character area recognition unit 123, character code generation unit 124, The vehicle number tracking unit 125 and the character area restoration unit 126 may be included.
  • the vehicle region extraction unit 121 compares the color image image constituting the ROI data selected by the ROI data selection unit 110 with the feature points of the pre-analyzed vehicle and compares the digital video uncompressed data.
  • a vehicle region corresponding to reference numeral ROI-1 of FIG. 3 may be extracted on each of the uncompressed image frames.
  • the vehicle region extracting unit 121 may extract only a vehicle region as an XY coordinate range of a frame by judging only whether a vehicle is present and extract only a single vehicle region as a representative vehicle when the vehicle region is repeatedly extracted at an adjacent point. have.
  • the license plate area extraction unit 122 uses a binary image image constituting the ROI data in the vehicle area extracted by the vehicle area extraction unit 121 and corresponds to the reference plate ROI-2 of FIG. 3. The area can be extracted.
  • the license plate area recognition unit 122 a method for comparing the feature points of the binary image image and the pre-analyzed license plate, and the operation image and pre-analyzed license plate obtained by sequentially performing a morphology operation and a BLOB operation on the binary image image
  • the license plate area may be extracted by any of the methods of comparing the aspect ratios of.
  • the license plate area recognition unit 122 may use an algorithm for extracting whether the license plate is recognized using a pedestrian recognition (HOG), a face recognition (HAAR), or a slope.
  • HOG pedestrian recognition
  • HAAR face recognition
  • slope a slope
  • the character area recognition unit 123 may separate the character area from the license plate area extracted by the license plate area recognition unit 122 using a histogram, which will be described in detail later with reference to FIG. 4.
  • the character code generation unit 124 may generate a character code for text data corresponding to the vehicle license plate information by applying a character recognition algorithm to the character area extracted by the character area recognition unit 123.
  • the vehicle number tracking unit 125 shown in the drawing is configured to reduce ROI data required for license plate recognition, and uses CAM SHIFT and OPTICAL FLOWER algorithms using reference points of previous and current frames constituting an uncompressed image frame. Can be used to track the ROI data corresponding to the license plate information.
  • the vehicle number tracking unit 125 tracks the ROI data by calculating the amount of movement information of the license plate area in the previous frame and the current frame, and checks the movement amount of each pixel constituting the frame after inspecting the movement area of the reference point. Can be calculated.
  • the character area restoring unit 126 may restore a character area including license plate information by applying a super resolution technique to a plurality of uncompressed image frames that are difficult to identify.
  • the vehicle black box according to the embodiment of the present invention can extract the license plate information by using the digital video uncompressed data, thereby preventing the lack of information of the missing image data and easily extracting the vehicle number information.
  • a character area restoring unit capable of restoring a character corresponding to the vehicle number may be provided inside the ROI data processing unit constituting the vehicle number generation device to improve license plate recognition efficiency.
  • FIG. 2 The apparatus for generating license plate information shown in FIG. 2 will be described in more detail with reference to FIGS. 3 to 4 as follows.
  • FIG. 3 is a view for explaining ROI data removed by the ROI data selecting unit constituting the vehicle license plate information generating apparatus shown in FIG. 2.
  • a plurality of ROIs may be present in each of the uncompressed image frames constituting the digital video uncompressed data generated by the image processor 20 of FIG. 1. have.
  • the ROI may be recognized only if the ROI is located within a specific range due to the characteristics of the vehicle black box having the wide-angle camera lens.
  • the ROI data selection unit 110 selects the ROI data from each uncompressed image frame constituting the digital video uncompressed data, if the ROI data that is not necessary to generate the license plate information can be removed, the license plate recognition is performed. You can increase the speed.
  • a region of interest ROI which is not necessary for generating license plate information, is disposed in the vehicle number tracking unit 125 of FIG.
  • the vehicle number tracking unit 125 of FIG. By tracking to the region of interest already recognized in the previous frame, and located in a position outside the limit line that can be identified by the license plate has a size of less than 15 pixels difficult to recognize as a character code in the character code generation unit 124 of FIG. to be.
  • the ROI data which is not necessary for generating the license plate information in the ROI data selection unit 110, is disposed above the horizon line consisting of horizontal lines of vanishing points where the lanes meet on each uncompressed image frame.
  • the ROI data may include ROI data, a ROI data including a character area having a character size of less than 15 pixels, and ROI data including a character area corresponding to vehicle license plate information generated in a previous frame.
  • the vehicle black box capable of real-time license plate recognition of the driving vehicle includes ROI data necessary for recognizing the license plate except for unnecessary areas among frame regions constituting high-resolution digital video uncompressed data.
  • the size of the ROI data selected by the ROI data selection unit can be reduced by tracking the frame coordinates of the ROI data in which the license plate information is recognized, and changing the frame. Can be.
  • FIG. 4 is a diagram illustrating separating a character area using a histogram in a character area recognition unit of the ROI data processor of the vehicle license plate information generating device shown in FIG. 2.
  • the character area recognition unit 123 of FIG. 2 may separate a character area using a histogram from the license plate area ROI-2 of FIG. 3 extracted by the license plate area extraction unit 122. Can be.
  • the upper and lower character areas of the license plate area can be separated by the reference numeral Yb, and then the individual character areas for each number can be separated by the reference numerals a to m.
  • the character code generation unit 124 of FIG. 2 may generate a character code for text data corresponding to the license plate information by applying a character recognition algorithm to the character area extracted by the character area recognition unit 123. .
  • the character code generation unit 124 generates a character code corresponding to the license plate information by using a conventional character recognition method used in the parking control system, or the separated character area neural network, SVM, HMM, etc. Character recognition can be performed using the algorithm of, and can be provided with a function to check whether the recognized character meets the character standard of the license plate.
  • the present invention is provided by a vehicle license plate information generating apparatus for extracting license plate information by using high-resolution digital video uncompressed data generated at the time of shooting, which is lost when the captured image is compressed into a digital movie file format.
  • the lack of information amount of the image data can be prevented, thereby improving the license plate recognition efficiency of the driving vehicle, thereby providing a vehicle black box that can easily extract the vehicle number information using the photographed image of the driving state.
  • the present invention has an effect of easily extracting the vehicle number information from the image taken while driving at high speed with an image processing unit for correcting the high-resolution digital video uncompressed data generated at the time of shooting to an optimal image.
  • the present invention provides a vehicle license plate by providing a ROI data selection unit inside the vehicle number generation device for selecting ROI data excluding the unnecessary area for recognizing the vehicle license plate of the driving vehicle among the frame areas constituting the high-resolution digital video uncompressed data Since it is possible to reduce the size of the ROI data required to recognize the license plate, it is possible to reduce the time required to recognize the license plate, thereby enabling the license plate recognition of the driving vehicle in real time.
  • the present invention by combining a plurality of frames difficult to identify by using a super resolution technique, a character area restoring unit capable of restoring a character corresponding to the vehicle number is provided inside the ROI data processing unit constituting the vehicle number generation device. It is effective to improve the license plate recognition efficiency.
  • the present invention includes a vehicle number tracking unit that tracks the frame coordinates of the ROI data from which the license plate information is recognized, each time the frame changes, to the ROI data processing unit constituting the vehicle license plate information generating apparatus. Since the specific area can be deleted from the ROI data selection target, the size of the ROI data selected by the ROI data selection unit can be reduced, thereby improving the license plate recognition speed of the driving vehicle.
  • the present invention is equipped with a communication module that can be connected to the mobile communication network, when the crime vehicle is inquired or hit by a short-distance accident in the near-by, when the immediate response is necessary to transmit the vehicle number information in real time to the control center It works.
  • the present invention can be used in the field of manufacturing a vehicle black box.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Multimedia (AREA)
  • Traffic Control Systems (AREA)

Abstract

L'invention concerne une boîte noire de véhicule permettant de reconnaître en temps réel une plaque d'immatriculation de véhicule en mouvement et, plus particulièrement, une boîte noire de véhicule permettant de reconnaître en temps réel une plaque d'immatriculation de véhicule en mouvement. La boîte noire comprend : une unité de traitement d'image pour traiter un signal d'image numérique généré par un capteur d'images afin de générer ainsi des données vidéo numériques non comprimées possédant une quantité d'informations correspondant à des informations d'image sur l'environnement d'un véhicule spécifique; un dispositif de génération d'informations de plaque d'immatriculation de véhicule pour analyser les données vidéo numériques non comprimées générées par l'unité de traitement d'image afin de générer ainsi des informations de plaque d'immatriculation d'un véhicule non-spécifique qui est conduit dans l'environnement du véhicule spécifique ou est adjacent à ce dernier; et une unité de commande pour combiner les données vidéo numériques non comprimées générées par l'unité de traitement d'image avec des informations de conduite du véhicule spécifique comprenant les informations de plaque d'immatriculation du véhicule non spécifique générées par le dispositif de génération d'informations de plaque d'immatriculation de véhicule afin de générer ainsi des données vidéo de conduite du véhicule spécifique. La boîte noire de véhicule extrait des informations de plaque d'immatriculation de véhicule en mouvement, avant compression en un format de fichier vidéo numérique, à l'aide de données vidéo numériques non comprimées haute résolution, générées en temps réel lors de la photographie d'une plaque d'immatriculation d'un véhicule en mouvement se déplaçant sur la route, ce qui permet d'augmenter l'efficacité de reconnaissance d'une plaque d'immatriculation de véhicule en mouvement.
PCT/KR2015/001760 2014-08-11 2015-02-24 Boîte noire de véhicule permettant de reconnaître en temps réel une plaque d'immatriculation de véhicule en mouvement Ceased WO2016024680A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2014-0103384 2014-08-11
KR1020140103384A KR101561626B1 (ko) 2014-08-11 2014-08-11 주행차량의 번호판 인식이 실시간으로 가능한 차량용 블랙박스

Publications (1)

Publication Number Publication Date
WO2016024680A1 true WO2016024680A1 (fr) 2016-02-18

Family

ID=54431049

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/001760 Ceased WO2016024680A1 (fr) 2014-08-11 2015-02-24 Boîte noire de véhicule permettant de reconnaître en temps réel une plaque d'immatriculation de véhicule en mouvement

Country Status (2)

Country Link
KR (1) KR101561626B1 (fr)
WO (1) WO2016024680A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111126397A (zh) * 2019-12-27 2020-05-08 上海眼控科技股份有限公司 车辆底盘的动态检验方法、系统、终端及介质
CN112802355A (zh) * 2020-12-29 2021-05-14 北京万集科技股份有限公司 一种实时获取实景路况的方法、系统及存储介质

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101836088B1 (ko) * 2016-11-30 2018-03-08 충북보건과학대학교 산학협력단 영상 처리 장치
KR101979654B1 (ko) * 2018-01-15 2019-05-17 주식회사 비엔인더스트리 차량번호 인식 장치 및 그 방법
KR102054061B1 (ko) * 2018-01-19 2019-12-09 한국기술교육대학교 산학협력단 차량번호판 자동인식 방법
CN111191481B (zh) * 2018-11-14 2023-08-25 杭州海康威视数字技术股份有限公司 车辆识别方法及系统
KR102189299B1 (ko) * 2019-09-11 2020-12-11 한국도로공사 차량 번호판 인식 기반의 차로 검출 장치 및 방법
KR102768736B1 (ko) * 2024-09-30 2025-02-18 대한민국 차량용 블랙박스 영상의 텍스트 정보를 활용한 교통사고 분석 장치 및 그 동작 방법

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004536410A (ja) * 2001-07-18 2004-12-02 ヒュンジャエ テック カンパニー リミテッド 監視車両を利用した被監視車両の車両番号の自動認識システム及び方法
KR20100134206A (ko) * 2009-06-15 2010-12-23 (주) 알티솔루션 영상기반의 비검지식 차량 인식 시스템 및 차량 인식방법
KR20120077455A (ko) * 2010-12-30 2012-07-10 (주)세미솔루션 아이피 카메라 겸용 다안식 차량용 영상저장 장치
KR101399309B1 (ko) * 2013-03-14 2014-05-28 임경묵 차량용 블랙박스 장치 및 이의 제어 방법

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004536410A (ja) * 2001-07-18 2004-12-02 ヒュンジャエ テック カンパニー リミテッド 監視車両を利用した被監視車両の車両番号の自動認識システム及び方法
KR20100134206A (ko) * 2009-06-15 2010-12-23 (주) 알티솔루션 영상기반의 비검지식 차량 인식 시스템 및 차량 인식방법
KR20120077455A (ko) * 2010-12-30 2012-07-10 (주)세미솔루션 아이피 카메라 겸용 다안식 차량용 영상저장 장치
KR101399309B1 (ko) * 2013-03-14 2014-05-28 임경묵 차량용 블랙박스 장치 및 이의 제어 방법

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111126397A (zh) * 2019-12-27 2020-05-08 上海眼控科技股份有限公司 车辆底盘的动态检验方法、系统、终端及介质
CN112802355A (zh) * 2020-12-29 2021-05-14 北京万集科技股份有限公司 一种实时获取实景路况的方法、系统及存储介质
CN112802355B (zh) * 2020-12-29 2022-09-09 北京万集科技股份有限公司 一种实时获取实景路况的方法、系统及存储介质

Also Published As

Publication number Publication date
KR101561626B1 (ko) 2015-10-30

Similar Documents

Publication Publication Date Title
WO2016024680A1 (fr) Boîte noire de véhicule permettant de reconnaître en temps réel une plaque d'immatriculation de véhicule en mouvement
CN100507970C (zh) 基于数字摄像机的闯红灯检测系统及方法
US20210183041A1 (en) Monitoring Method and Apparatus
WO2017030259A1 (fr) Véhicule aérien sans pilote à fonction de suivi automatique et son procédé de commande
US8208022B2 (en) Apparatus and method for removing blooming of camera image
CN101388146B (zh) 图像获取和处理装置及方法、车辆监测和记录系统
KR101492473B1 (ko) 사용자 기반 상황 인지형 씨씨티비 통합관제시스템
WO2016072625A1 (fr) Système de contrôle d'emplacement de véhicule pour parc de stationnement utilisant une technique d'imagerie, et son procédé de commande
KR100948382B1 (ko) 방범 서비스 방법 및 시스템
WO2017195965A1 (fr) Appareil et procédé de traitement d'image en fonction de la vitesse d'un véhicule
KR101621822B1 (ko) 하이브리드 이미지 전송 기반의 방범겸용 차량번호 인식 장치, 그리고 이를 이용한 차량번호 인식 및 제공 방법
CN201726494U (zh) 利用图像色彩信息执行图像比对的装置与系统
US8229170B2 (en) Method and system for detecting a signal structure from a moving video platform
KR101911239B1 (ko) 불법 주정차 단속을 위한 채널 확대 운영 시스템
KR101360244B1 (ko) Cctv 투시에 의한 객체 움직임 감시시스템
WO2016072627A1 (fr) Système et procédé de gestion de parc de stationnement à plans multiples à l'aide d'une caméra omnidirectionnelle
KR102220643B1 (ko) 딥러닝을 기반으로 차량번호를 인식할 수 있는 cctv
CN110070724A (zh) 一种视频监控方法、装置、摄像机及图像信息监管系统
CN113206994A (zh) 摄像机自动工勘方法、装置、电子设备、芯片及存储介质
WO2025135266A1 (fr) Procédé et système de mesure de poussière fine sur la base d'une image
WO2019088595A1 (fr) Système de surveillance de vue panoramique
JP2006202000A (ja) 車両監視方法及び特定文字パターン認識装置及び車両監視システム
WO2023248663A1 (fr) Dispositif embarqué, procédé d'enregistrement d'opération, et système d'enregistrement d'opération
KR101649593B1 (ko) 연기의 칼라특성과 히스토그램 분석으로 이루어진 하이브리드형 이동차량 연기검출장치 및 방법
KR101547239B1 (ko) 배경영상 추출 기반 카메라 영상밝기 조절 시스템 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15832408

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 28.07.17)

122 Ep: pct application non-entry in european phase

Ref document number: 15832408

Country of ref document: EP

Kind code of ref document: A1