[go: up one dir, main page]

KR20180084952A - 다중 카메라 차량 시스템들을 위한 동적 이미지 혼합 - Google Patents

다중 카메라 차량 시스템들을 위한 동적 이미지 혼합 Download PDF

Info

Publication number
KR20180084952A
KR20180084952A KR1020187017408A KR20187017408A KR20180084952A KR 20180084952 A KR20180084952 A KR 20180084952A KR 1020187017408 A KR1020187017408 A KR 1020187017408A KR 20187017408 A KR20187017408 A KR 20187017408A KR 20180084952 A KR20180084952 A KR 20180084952A
Authority
KR
South Korea
Prior art keywords
dynamic image
vehicle systems
image blending
camera vehicle
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
KR1020187017408A
Other languages
English (en)
Inventor
그레그 시피트코프스키
스티븐 밀러
패트릭 그라프
Original Assignee
로베르트 보쉬 게엠베하
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 로베르트 보쉬 게엠베하 filed Critical 로베르트 보쉬 게엠베하
Publication of KR20180084952A publication Critical patent/KR20180084952A/ko
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/77Retouching; Inpainting; Scratch removal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/001Texturing; Colouring; Generation of texture or colour
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images
    • G06T5/005
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • H04N5/2257
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/105Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/303Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using joined images, e.g. multiple camera images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle
    • G06T2207/30261Obstacle

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)
KR1020187017408A 2015-12-21 2016-10-12 다중 카메라 차량 시스템들을 위한 동적 이미지 혼합 Ceased KR20180084952A (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562270445P 2015-12-21 2015-12-21
US62/270,445 2015-12-21
PCT/EP2016/074401 WO2017108221A1 (en) 2015-12-21 2016-10-12 Dynamic image blending for multiple-camera vehicle systems

Publications (1)

Publication Number Publication Date
KR20180084952A true KR20180084952A (ko) 2018-07-25

Family

ID=57184412

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020187017408A Ceased KR20180084952A (ko) 2015-12-21 2016-10-12 다중 카메라 차량 시스템들을 위한 동적 이미지 혼합

Country Status (5)

Country Link
US (1) US11184531B2 (ko)
EP (1) EP3394833B1 (ko)
KR (1) KR20180084952A (ko)
CN (1) CN108369746A (ko)
WO (1) WO2017108221A1 (ko)

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016224905A1 (de) * 2016-12-14 2018-06-14 Conti Temic Microelectronic Gmbh Vorrichtung und Verfahren zum Fusionieren von Bilddaten von einem Multikamerasystem für ein Kraftfahrzeug
US10678244B2 (en) 2017-03-23 2020-06-09 Tesla, Inc. Data synthesis for autonomous control systems
JP7121470B2 (ja) * 2017-05-12 2022-08-18 キヤノン株式会社 画像処理システム、制御方法、及び、プログラム
US11409692B2 (en) 2017-07-24 2022-08-09 Tesla, Inc. Vector computational unit
US10671349B2 (en) 2017-07-24 2020-06-02 Tesla, Inc. Accelerated mathematical engine
US11157441B2 (en) 2017-07-24 2021-10-26 Tesla, Inc. Computational array microprocessor system using non-consecutive data formatting
US11893393B2 (en) 2017-07-24 2024-02-06 Tesla, Inc. Computational array microprocessor system with hardware arbiter managing memory requests
US11370490B2 (en) * 2017-09-13 2022-06-28 Robert Bosch Gmbh User interface for reversing a trailer with automated steering system
US12307350B2 (en) 2018-01-04 2025-05-20 Tesla, Inc. Systems and methods for hardware-based pooling
US11561791B2 (en) 2018-02-01 2023-01-24 Tesla, Inc. Vector computational unit receiving data elements in parallel from a last row of a computational array
WO2019186860A1 (ja) * 2018-03-29 2019-10-03 三菱電機株式会社 画像処理装置、画像処理方法、及び監視システム
US11215999B2 (en) 2018-06-20 2022-01-04 Tesla, Inc. Data pipeline and deep learning system for autonomous driving
US11361457B2 (en) 2018-07-20 2022-06-14 Tesla, Inc. Annotation cross-labeling for autonomous control systems
US11636333B2 (en) 2018-07-26 2023-04-25 Tesla, Inc. Optimizing neural network structures for embedded systems
DE102018214874B3 (de) 2018-08-31 2019-12-19 Audi Ag Verfahren und Anordnung zum Erzeugen einer mit Bildinformationen texturierten Umfeldkarte eines Fahrzeugs und Fahrzeug umfassend eine solche Anordnung
US11562231B2 (en) 2018-09-03 2023-01-24 Tesla, Inc. Neural networks for embedded devices
IL305330B2 (en) 2018-10-11 2025-03-01 Tesla Inc Systems and methods for training machine models with enhanced data
US11196678B2 (en) 2018-10-25 2021-12-07 Tesla, Inc. QOS manager for system on a chip communications
US11816585B2 (en) 2018-12-03 2023-11-14 Tesla, Inc. Machine learning models operating at different frequencies for autonomous vehicles
US11537811B2 (en) 2018-12-04 2022-12-27 Tesla, Inc. Enhanced object detection for autonomous vehicles based on field view
US11610117B2 (en) 2018-12-27 2023-03-21 Tesla, Inc. System and method for adapting a neural network model on a hardware platform
US10997461B2 (en) 2019-02-01 2021-05-04 Tesla, Inc. Generating ground truth for machine learning from time series elements
US11150664B2 (en) 2019-02-01 2021-10-19 Tesla, Inc. Predicting three-dimensional features for autonomous driving
US11567514B2 (en) 2019-02-11 2023-01-31 Tesla, Inc. Autonomous and user controlled vehicle summon to a target
US10956755B2 (en) 2019-02-19 2021-03-23 Tesla, Inc. Estimating object properties using visual image data
CN111746796B (zh) * 2019-03-29 2024-04-26 B/E航空公司 提供用于交通工具乘客的姿态参考的装置和方法
CA3064413A1 (en) * 2019-03-29 2020-09-29 B/E Aerospace, Inc. Apparatus and method for providing attitude reference for vehicle passengers
US11153010B2 (en) 2019-07-02 2021-10-19 Waymo Llc Lidar based communication
US11076102B2 (en) 2019-09-24 2021-07-27 Seek Thermal, Inc. Thermal imaging system with multiple selectable viewing angles and fields of view for vehicle applications
US11891057B2 (en) 2019-09-24 2024-02-06 Seek Thermal, Inc. Thermal imaging system with multiple selectable viewing angles and fields of view for vehicle applications
US11481884B2 (en) 2020-06-04 2022-10-25 Nuro, Inc. Image quality enhancement for autonomous vehicle remote operations
JP7708572B2 (ja) * 2021-03-30 2025-07-15 本田技研工業株式会社 移動体の制御装置、制御方法及びプログラム
US12462575B2 (en) 2021-08-19 2025-11-04 Tesla, Inc. Vision-based machine learning model for autonomous driving with adjustable virtual camera
DE102022204313A1 (de) 2022-05-02 2023-11-02 Volkswagen Aktiengesellschaft Verfahren und Vorrichtung zum Erzeugen eines Umfeldabbildes für einen Parkassistenten eines Fahrzeugs
US12125225B1 (en) * 2023-04-04 2024-10-22 GM Global Technology Operations LLC Monocular camera system performing depth estimation of objects surrounding a vehicle
CN116935354A (zh) * 2023-07-18 2023-10-24 奇瑞新能源汽车股份有限公司 一种路肩影像显示系统、方法及汽车
US20250058712A1 (en) * 2023-08-18 2025-02-20 Robert Bosch Gmbh Augmented vehicle blind spot detection with transparent trailer

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5670935A (en) 1993-02-26 1997-09-23 Donnelly Corporation Rearview vision system for vehicle including panoramic view
US6891563B2 (en) 1996-05-22 2005-05-10 Donnelly Corporation Vehicular vision system
US6429789B1 (en) * 1999-08-09 2002-08-06 Ford Global Technologies, Inc. Vehicle information acquisition and display assembly
DE102006052779A1 (de) 2006-11-09 2008-05-15 Bayerische Motoren Werke Ag Verfahren zur Erzeugung eines Gesamtbilds der Umgebung eines Kraftfahrzeugs
EP2142883B1 (en) * 2007-04-22 2017-10-18 Ilookabout INC. Method of obtaining geographically related images using a vehicle
US7688229B2 (en) * 2007-04-30 2010-03-30 Navteq North America, Llc System and method for stitching of video for routes
NO327577B1 (no) 2007-07-31 2009-08-24 Kongsberg Defence & Aerospace Naerobservasjonssensor med folgestyring og malbestemmelse for vapenstasjon
JP5132249B2 (ja) 2007-10-23 2013-01-30 アルパイン株式会社 車載用撮像装置
US8086071B2 (en) * 2007-10-30 2011-12-27 Navteq North America, Llc System and method for revealing occluded objects in an image dataset
IL189251A0 (en) 2008-02-05 2008-11-03 Ehud Gal A manned mobile platforms interactive virtual window vision system
US8160391B1 (en) * 2008-06-04 2012-04-17 Google Inc. Panoramic image fill
JP5439890B2 (ja) 2009-03-25 2014-03-12 富士通株式会社 画像処理方法、画像処理装置及びプログラム
JP5165631B2 (ja) * 2009-04-14 2013-03-21 現代自動車株式会社 車両周囲画像表示システム
CN102577372B (zh) 2009-09-24 2015-06-10 松下电器产业株式会社 驾驶辅助显示装置
TWI408339B (zh) 2010-03-22 2013-09-11 Inst Information Industry 即時擴增實境裝置、即時擴增實境方法及其電腦程式產品
CN102045546B (zh) 2010-12-15 2013-07-31 广州致远电子股份有限公司 一种全景泊车辅助系统
US9762880B2 (en) 2011-12-09 2017-09-12 Magna Electronics Inc. Vehicle vision system with customized display
US9538144B2 (en) 2012-05-02 2017-01-03 GM Global Technology Operations LLC Full speed lane sensing using multiple cameras
US8633970B1 (en) 2012-08-30 2014-01-21 Google Inc. Augmented reality with earth data
US9743002B2 (en) * 2012-11-19 2017-08-22 Magna Electronics Inc. Vehicle vision system with enhanced display functions
EP2936847B1 (en) 2012-12-21 2019-11-20 Harman Becker Automotive Systems GmbH System for a vehicle and communication method
US10179543B2 (en) 2013-02-27 2019-01-15 Magna Electronics Inc. Multi-camera dynamic top view vision system
JP5865547B2 (ja) * 2013-03-19 2016-02-17 株式会社日立国際電気 画像表示装置および画像表示方法
US9639984B2 (en) 2013-06-03 2017-05-02 Daqri, Llc Data manipulation based on real world object manipulation
US20150042678A1 (en) 2013-08-09 2015-02-12 Metaio Gmbh Method for visually augmenting a real object with a computer-generated image
US9902322B2 (en) * 2015-10-30 2018-02-27 Bendix Commercial Vehicle Systems Llc Filling in surround view areas blocked by mirrors or other vehicle parts

Also Published As

Publication number Publication date
EP3394833B1 (en) 2020-01-29
EP3394833A1 (en) 2018-10-31
US20190230282A1 (en) 2019-07-25
CN108369746A (zh) 2018-08-03
US11184531B2 (en) 2021-11-23
WO2017108221A1 (en) 2017-06-29

Similar Documents

Publication Publication Date Title
KR20180084952A (ko) 다중 카메라 차량 시스템들을 위한 동적 이미지 혼합
GB2568647B (en) Multi-camera imaging systems
IL270744A (en) Image projection system
IL239129A0 (en) Image improvements in car imaging systems
IL242895A0 (en) Image projection system
IL263876B (en) Extended dynamic range image capture system with beam splitting
IL239191A0 (en) Image sorting system
GB201507255D0 (en) Shared vehicle camera
KR102364593B9 (ko) 차량용 레이더 시스템
EP3788961C0 (en) IMPROVED TOMOGRAPHY IMAGING SYSTEMS
EP3538877A4 (en) HYPERSPECTRAL IMAGING SYSTEM
EP3380352C0 (en) VEHICLE DRIVE SHAFT LINE SYSTEM
EP3158728A4 (en) Imaging system
EP3714426A4 (en) MULTIPLE CAMERA IMAGING FOR INTRAVENOUS MIXING
ZA201802786B (en) Vehicle inspection system
EP3638583A4 (en) VEHICLE SYSTEM
FR3032182B1 (fr) Systeme de desorbitation de satellite
GB2558505B (en) High dynamic range radiographic imaging system
EP3397108A4 (en) LOAD-LOADING SYSTEMS
GB2529932B (en) Vehicle camera system
EP3508382A4 (en) VEHICLE SYSTEM
AU201713120S (en) An imaging system
BR112015015755A2 (pt) sistemas de imageamento de varredura
EP3147012A4 (en) Circulating dynamic vehicle viewing system
EP3608638A4 (en) VEHICLE INSPECTION SYSTEM

Legal Events

Date Code Title Description
A201 Request for examination
PA0105 International application

Patent event date: 20180619

Patent event code: PA01051R01D

Comment text: International Patent Application

PA0201 Request for examination
PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20190718

Patent event code: PE09021S01D

E601 Decision to refuse application
PE0601 Decision on rejection of patent

Patent event date: 20200129

Comment text: Decision to Refuse Application

Patent event code: PE06012S01D

Patent event date: 20190718

Comment text: Notification of reason for refusal

Patent event code: PE06011S01I

J201 Request for trial against refusal decision
PJ0201 Trial against decision of rejection

Patent event date: 20200330

Comment text: Request for Trial against Decision on Refusal

Patent event code: PJ02012R01D

Patent event date: 20200129

Comment text: Decision to Refuse Application

Patent event code: PJ02011S01I

Appeal kind category: Appeal against decision to decline refusal

Appeal identifier: 2020101000934

Request date: 20200330

J301 Trial decision

Free format text: TRIAL NUMBER: 2020101000934; TRIAL DECISION FOR APPEAL AGAINST DECISION TO DECLINE REFUSAL REQUESTED 20200330

Effective date: 20210226

PJ1301 Trial decision

Patent event code: PJ13011S01D

Patent event date: 20210226

Comment text: Trial Decision on Objection to Decision on Refusal

Appeal kind category: Appeal against decision to decline refusal

Request date: 20200330

Decision date: 20210226

Appeal identifier: 2020101000934