KR20180084952A - 다중 카메라 차량 시스템들을 위한 동적 이미지 혼합 - Google Patents
다중 카메라 차량 시스템들을 위한 동적 이미지 혼합 Download PDFInfo
- Publication number
- KR20180084952A KR20180084952A KR1020187017408A KR20187017408A KR20180084952A KR 20180084952 A KR20180084952 A KR 20180084952A KR 1020187017408 A KR1020187017408 A KR 1020187017408A KR 20187017408 A KR20187017408 A KR 20187017408A KR 20180084952 A KR20180084952 A KR 20180084952A
- Authority
- KR
- South Korea
- Prior art keywords
- dynamic image
- vehicle systems
- image blending
- camera vehicle
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/77—Retouching; Inpainting; Scratch removal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/001—Texturing; Colouring; Generation of texture or colour
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G06T5/005—
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H04N5/2257—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
- B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
- B60R2300/303—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using joined images, e.g. multiple camera images
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
- G06T2207/30261—Obstacle
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Mechanical Engineering (AREA)
- Image Processing (AREA)
- Closed-Circuit Television Systems (AREA)
- Traffic Control Systems (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201562270445P | 2015-12-21 | 2015-12-21 | |
| US62/270,445 | 2015-12-21 | ||
| PCT/EP2016/074401 WO2017108221A1 (en) | 2015-12-21 | 2016-10-12 | Dynamic image blending for multiple-camera vehicle systems |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| KR20180084952A true KR20180084952A (ko) | 2018-07-25 |
Family
ID=57184412
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020187017408A Ceased KR20180084952A (ko) | 2015-12-21 | 2016-10-12 | 다중 카메라 차량 시스템들을 위한 동적 이미지 혼합 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US11184531B2 (ko) |
| EP (1) | EP3394833B1 (ko) |
| KR (1) | KR20180084952A (ko) |
| CN (1) | CN108369746A (ko) |
| WO (1) | WO2017108221A1 (ko) |
Families Citing this family (37)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102016224905A1 (de) * | 2016-12-14 | 2018-06-14 | Conti Temic Microelectronic Gmbh | Vorrichtung und Verfahren zum Fusionieren von Bilddaten von einem Multikamerasystem für ein Kraftfahrzeug |
| US10678244B2 (en) | 2017-03-23 | 2020-06-09 | Tesla, Inc. | Data synthesis for autonomous control systems |
| JP7121470B2 (ja) * | 2017-05-12 | 2022-08-18 | キヤノン株式会社 | 画像処理システム、制御方法、及び、プログラム |
| US11409692B2 (en) | 2017-07-24 | 2022-08-09 | Tesla, Inc. | Vector computational unit |
| US10671349B2 (en) | 2017-07-24 | 2020-06-02 | Tesla, Inc. | Accelerated mathematical engine |
| US11157441B2 (en) | 2017-07-24 | 2021-10-26 | Tesla, Inc. | Computational array microprocessor system using non-consecutive data formatting |
| US11893393B2 (en) | 2017-07-24 | 2024-02-06 | Tesla, Inc. | Computational array microprocessor system with hardware arbiter managing memory requests |
| US11370490B2 (en) * | 2017-09-13 | 2022-06-28 | Robert Bosch Gmbh | User interface for reversing a trailer with automated steering system |
| US12307350B2 (en) | 2018-01-04 | 2025-05-20 | Tesla, Inc. | Systems and methods for hardware-based pooling |
| US11561791B2 (en) | 2018-02-01 | 2023-01-24 | Tesla, Inc. | Vector computational unit receiving data elements in parallel from a last row of a computational array |
| WO2019186860A1 (ja) * | 2018-03-29 | 2019-10-03 | 三菱電機株式会社 | 画像処理装置、画像処理方法、及び監視システム |
| US11215999B2 (en) | 2018-06-20 | 2022-01-04 | Tesla, Inc. | Data pipeline and deep learning system for autonomous driving |
| US11361457B2 (en) | 2018-07-20 | 2022-06-14 | Tesla, Inc. | Annotation cross-labeling for autonomous control systems |
| US11636333B2 (en) | 2018-07-26 | 2023-04-25 | Tesla, Inc. | Optimizing neural network structures for embedded systems |
| DE102018214874B3 (de) | 2018-08-31 | 2019-12-19 | Audi Ag | Verfahren und Anordnung zum Erzeugen einer mit Bildinformationen texturierten Umfeldkarte eines Fahrzeugs und Fahrzeug umfassend eine solche Anordnung |
| US11562231B2 (en) | 2018-09-03 | 2023-01-24 | Tesla, Inc. | Neural networks for embedded devices |
| IL305330B2 (en) | 2018-10-11 | 2025-03-01 | Tesla Inc | Systems and methods for training machine models with enhanced data |
| US11196678B2 (en) | 2018-10-25 | 2021-12-07 | Tesla, Inc. | QOS manager for system on a chip communications |
| US11816585B2 (en) | 2018-12-03 | 2023-11-14 | Tesla, Inc. | Machine learning models operating at different frequencies for autonomous vehicles |
| US11537811B2 (en) | 2018-12-04 | 2022-12-27 | Tesla, Inc. | Enhanced object detection for autonomous vehicles based on field view |
| US11610117B2 (en) | 2018-12-27 | 2023-03-21 | Tesla, Inc. | System and method for adapting a neural network model on a hardware platform |
| US10997461B2 (en) | 2019-02-01 | 2021-05-04 | Tesla, Inc. | Generating ground truth for machine learning from time series elements |
| US11150664B2 (en) | 2019-02-01 | 2021-10-19 | Tesla, Inc. | Predicting three-dimensional features for autonomous driving |
| US11567514B2 (en) | 2019-02-11 | 2023-01-31 | Tesla, Inc. | Autonomous and user controlled vehicle summon to a target |
| US10956755B2 (en) | 2019-02-19 | 2021-03-23 | Tesla, Inc. | Estimating object properties using visual image data |
| CN111746796B (zh) * | 2019-03-29 | 2024-04-26 | B/E航空公司 | 提供用于交通工具乘客的姿态参考的装置和方法 |
| CA3064413A1 (en) * | 2019-03-29 | 2020-09-29 | B/E Aerospace, Inc. | Apparatus and method for providing attitude reference for vehicle passengers |
| US11153010B2 (en) | 2019-07-02 | 2021-10-19 | Waymo Llc | Lidar based communication |
| US11076102B2 (en) | 2019-09-24 | 2021-07-27 | Seek Thermal, Inc. | Thermal imaging system with multiple selectable viewing angles and fields of view for vehicle applications |
| US11891057B2 (en) | 2019-09-24 | 2024-02-06 | Seek Thermal, Inc. | Thermal imaging system with multiple selectable viewing angles and fields of view for vehicle applications |
| US11481884B2 (en) | 2020-06-04 | 2022-10-25 | Nuro, Inc. | Image quality enhancement for autonomous vehicle remote operations |
| JP7708572B2 (ja) * | 2021-03-30 | 2025-07-15 | 本田技研工業株式会社 | 移動体の制御装置、制御方法及びプログラム |
| US12462575B2 (en) | 2021-08-19 | 2025-11-04 | Tesla, Inc. | Vision-based machine learning model for autonomous driving with adjustable virtual camera |
| DE102022204313A1 (de) | 2022-05-02 | 2023-11-02 | Volkswagen Aktiengesellschaft | Verfahren und Vorrichtung zum Erzeugen eines Umfeldabbildes für einen Parkassistenten eines Fahrzeugs |
| US12125225B1 (en) * | 2023-04-04 | 2024-10-22 | GM Global Technology Operations LLC | Monocular camera system performing depth estimation of objects surrounding a vehicle |
| CN116935354A (zh) * | 2023-07-18 | 2023-10-24 | 奇瑞新能源汽车股份有限公司 | 一种路肩影像显示系统、方法及汽车 |
| US20250058712A1 (en) * | 2023-08-18 | 2025-02-20 | Robert Bosch Gmbh | Augmented vehicle blind spot detection with transparent trailer |
Family Cites Families (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5670935A (en) | 1993-02-26 | 1997-09-23 | Donnelly Corporation | Rearview vision system for vehicle including panoramic view |
| US6891563B2 (en) | 1996-05-22 | 2005-05-10 | Donnelly Corporation | Vehicular vision system |
| US6429789B1 (en) * | 1999-08-09 | 2002-08-06 | Ford Global Technologies, Inc. | Vehicle information acquisition and display assembly |
| DE102006052779A1 (de) | 2006-11-09 | 2008-05-15 | Bayerische Motoren Werke Ag | Verfahren zur Erzeugung eines Gesamtbilds der Umgebung eines Kraftfahrzeugs |
| EP2142883B1 (en) * | 2007-04-22 | 2017-10-18 | Ilookabout INC. | Method of obtaining geographically related images using a vehicle |
| US7688229B2 (en) * | 2007-04-30 | 2010-03-30 | Navteq North America, Llc | System and method for stitching of video for routes |
| NO327577B1 (no) | 2007-07-31 | 2009-08-24 | Kongsberg Defence & Aerospace | Naerobservasjonssensor med folgestyring og malbestemmelse for vapenstasjon |
| JP5132249B2 (ja) | 2007-10-23 | 2013-01-30 | アルパイン株式会社 | 車載用撮像装置 |
| US8086071B2 (en) * | 2007-10-30 | 2011-12-27 | Navteq North America, Llc | System and method for revealing occluded objects in an image dataset |
| IL189251A0 (en) | 2008-02-05 | 2008-11-03 | Ehud Gal | A manned mobile platforms interactive virtual window vision system |
| US8160391B1 (en) * | 2008-06-04 | 2012-04-17 | Google Inc. | Panoramic image fill |
| JP5439890B2 (ja) | 2009-03-25 | 2014-03-12 | 富士通株式会社 | 画像処理方法、画像処理装置及びプログラム |
| JP5165631B2 (ja) * | 2009-04-14 | 2013-03-21 | 現代自動車株式会社 | 車両周囲画像表示システム |
| CN102577372B (zh) | 2009-09-24 | 2015-06-10 | 松下电器产业株式会社 | 驾驶辅助显示装置 |
| TWI408339B (zh) | 2010-03-22 | 2013-09-11 | Inst Information Industry | 即時擴增實境裝置、即時擴增實境方法及其電腦程式產品 |
| CN102045546B (zh) | 2010-12-15 | 2013-07-31 | 广州致远电子股份有限公司 | 一种全景泊车辅助系统 |
| US9762880B2 (en) | 2011-12-09 | 2017-09-12 | Magna Electronics Inc. | Vehicle vision system with customized display |
| US9538144B2 (en) | 2012-05-02 | 2017-01-03 | GM Global Technology Operations LLC | Full speed lane sensing using multiple cameras |
| US8633970B1 (en) | 2012-08-30 | 2014-01-21 | Google Inc. | Augmented reality with earth data |
| US9743002B2 (en) * | 2012-11-19 | 2017-08-22 | Magna Electronics Inc. | Vehicle vision system with enhanced display functions |
| EP2936847B1 (en) | 2012-12-21 | 2019-11-20 | Harman Becker Automotive Systems GmbH | System for a vehicle and communication method |
| US10179543B2 (en) | 2013-02-27 | 2019-01-15 | Magna Electronics Inc. | Multi-camera dynamic top view vision system |
| JP5865547B2 (ja) * | 2013-03-19 | 2016-02-17 | 株式会社日立国際電気 | 画像表示装置および画像表示方法 |
| US9639984B2 (en) | 2013-06-03 | 2017-05-02 | Daqri, Llc | Data manipulation based on real world object manipulation |
| US20150042678A1 (en) | 2013-08-09 | 2015-02-12 | Metaio Gmbh | Method for visually augmenting a real object with a computer-generated image |
| US9902322B2 (en) * | 2015-10-30 | 2018-02-27 | Bendix Commercial Vehicle Systems Llc | Filling in surround view areas blocked by mirrors or other vehicle parts |
-
2016
- 2016-10-12 EP EP16784815.9A patent/EP3394833B1/en active Active
- 2016-10-12 WO PCT/EP2016/074401 patent/WO2017108221A1/en not_active Ceased
- 2016-10-12 KR KR1020187017408A patent/KR20180084952A/ko not_active Ceased
- 2016-10-12 CN CN201680074727.1A patent/CN108369746A/zh active Pending
- 2016-10-12 US US16/325,171 patent/US11184531B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| EP3394833B1 (en) | 2020-01-29 |
| EP3394833A1 (en) | 2018-10-31 |
| US20190230282A1 (en) | 2019-07-25 |
| CN108369746A (zh) | 2018-08-03 |
| US11184531B2 (en) | 2021-11-23 |
| WO2017108221A1 (en) | 2017-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR20180084952A (ko) | 다중 카메라 차량 시스템들을 위한 동적 이미지 혼합 | |
| GB2568647B (en) | Multi-camera imaging systems | |
| IL270744A (en) | Image projection system | |
| IL239129A0 (en) | Image improvements in car imaging systems | |
| IL242895A0 (en) | Image projection system | |
| IL263876B (en) | Extended dynamic range image capture system with beam splitting | |
| IL239191A0 (en) | Image sorting system | |
| GB201507255D0 (en) | Shared vehicle camera | |
| KR102364593B9 (ko) | 차량용 레이더 시스템 | |
| EP3788961C0 (en) | IMPROVED TOMOGRAPHY IMAGING SYSTEMS | |
| EP3538877A4 (en) | HYPERSPECTRAL IMAGING SYSTEM | |
| EP3380352C0 (en) | VEHICLE DRIVE SHAFT LINE SYSTEM | |
| EP3158728A4 (en) | Imaging system | |
| EP3714426A4 (en) | MULTIPLE CAMERA IMAGING FOR INTRAVENOUS MIXING | |
| ZA201802786B (en) | Vehicle inspection system | |
| EP3638583A4 (en) | VEHICLE SYSTEM | |
| FR3032182B1 (fr) | Systeme de desorbitation de satellite | |
| GB2558505B (en) | High dynamic range radiographic imaging system | |
| EP3397108A4 (en) | LOAD-LOADING SYSTEMS | |
| GB2529932B (en) | Vehicle camera system | |
| EP3508382A4 (en) | VEHICLE SYSTEM | |
| AU201713120S (en) | An imaging system | |
| BR112015015755A2 (pt) | sistemas de imageamento de varredura | |
| EP3147012A4 (en) | Circulating dynamic vehicle viewing system | |
| EP3608638A4 (en) | VEHICLE INSPECTION SYSTEM |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A201 | Request for examination | ||
| PA0105 | International application |
Patent event date: 20180619 Patent event code: PA01051R01D Comment text: International Patent Application |
|
| PA0201 | Request for examination | ||
| PG1501 | Laying open of application | ||
| E902 | Notification of reason for refusal | ||
| PE0902 | Notice of grounds for rejection |
Comment text: Notification of reason for refusal Patent event date: 20190718 Patent event code: PE09021S01D |
|
| E601 | Decision to refuse application | ||
| PE0601 | Decision on rejection of patent |
Patent event date: 20200129 Comment text: Decision to Refuse Application Patent event code: PE06012S01D Patent event date: 20190718 Comment text: Notification of reason for refusal Patent event code: PE06011S01I |
|
| J201 | Request for trial against refusal decision | ||
| PJ0201 | Trial against decision of rejection |
Patent event date: 20200330 Comment text: Request for Trial against Decision on Refusal Patent event code: PJ02012R01D Patent event date: 20200129 Comment text: Decision to Refuse Application Patent event code: PJ02011S01I Appeal kind category: Appeal against decision to decline refusal Appeal identifier: 2020101000934 Request date: 20200330 |
|
| J301 | Trial decision |
Free format text: TRIAL NUMBER: 2020101000934; TRIAL DECISION FOR APPEAL AGAINST DECISION TO DECLINE REFUSAL REQUESTED 20200330 Effective date: 20210226 |
|
| PJ1301 | Trial decision |
Patent event code: PJ13011S01D Patent event date: 20210226 Comment text: Trial Decision on Objection to Decision on Refusal Appeal kind category: Appeal against decision to decline refusal Request date: 20200330 Decision date: 20210226 Appeal identifier: 2020101000934 |