EP3266195A4 - Appareil de traitement d'image, appareil de capture d'image, procédé de traitement d'image, programme et support d'enregistrement - Google Patents

Appareil de traitement d'image, appareil de capture d'image, procédé de traitement d'image, programme et support d'enregistrement Download PDF

Info

Publication number: EP3266195A4
Authority: EP; European Patent Office
Prior art keywords: image processing; program; storage medium; image; processing method
Prior art date: 2015-03-03
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.): Granted

Application number

EP16758596.7A

Other languages

German (de)

English (en)

Other versions

EP3266195A1 (fr

EP3266195B1 (fr

Inventor

Koichi Fukuda

Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)

Canon Inc

Original Assignee

Canon Inc

Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)

2015-03-03

Filing date

2016-02-10

Publication date

2018-10-03

2016-02-10 Application filed by Canon Inc filed Critical Canon Inc

2018-01-10 Publication of EP3266195A1 publication Critical patent/EP3266195A1/fr

2018-10-03 Publication of EP3266195A4 publication Critical patent/EP3266195A4/fr

2021-04-07 Application granted granted Critical

2021-04-07 Publication of EP3266195B1 publication Critical patent/EP3266195B1/fr

Status Active legal-status Critical Current

2036-02-10 Anticipated expiration legal-status Critical

Classifications

- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
- G02B7/34—Systems for automatic generation of focusing signals using different areas in a pupil plane
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/663—Remote control of cameras or camera parts, e.g. by remote control devices for controlling interchangeable camera parts based on electronic image sensor signals
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
- H04N23/673—Focus control based on electronic image sensor signals based on contrast or high frequency components of image signals, e.g. hill climbing method
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/703—SSIS architectures incorporating pixels for producing signals other than image signals
- H04N25/704—Pixels specially adapted for focusing, e.g. phase difference pixel sets
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/10—Integrated devices
- H10F39/12—Image sensors
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/80—Constructional details of image sensors
- H10F39/806—Optical elements or arrangements associated with the image sensors
- H10F39/8063—Microlenses

Landscapes

Engineering & Computer Science (AREA)
Multimedia (AREA)
Signal Processing (AREA)
Physics & Mathematics (AREA)
Computing Systems (AREA)
Theoretical Computer Science (AREA)
Spectroscopy & Molecular Physics (AREA)
General Physics & Mathematics (AREA)
Optics & Photonics (AREA)
Studio Devices (AREA)
Image Processing (AREA)
Automatic Focus Adjustment (AREA)

EP16758596.7A 2015-03-03 2016-02-10 Appareil de traitement d'image, appareil de capture d'image, procédé de traitement d'image, programme et support d'enregistrement Active EP3266195B1 (fr)

Applications Claiming Priority (2)

Application Number	Priority Date	Filing Date	Title
JP2015041326A JP6486149B2 (ja)	2015-03-03	2015-03-03	画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
PCT/JP2016/000700 WO2016139895A1 (fr)	2015-03-03	2016-02-10	Appareil de traitement d'image, appareil de capture d'image, procédé de traitement d'image, programme et support d'enregistrement

Publications (3)

Publication Number	Publication Date
EP3266195A1 EP3266195A1 (fr)	2018-01-10
EP3266195A4 true EP3266195A4 (fr)	2018-10-03
EP3266195B1 EP3266195B1 (fr)	2021-04-07

Family

ID=56847432

Family Applications (1)

Application Number	Title	Priority Date	Filing Date
EP16758596.7A Active EP3266195B1 (fr)	2015-03-03	2016-02-10	Appareil de traitement d'image, appareil de capture d'image, procédé de traitement d'image, programme et support d'enregistrement

Country Status (6)

Country	Link
US (2)	US10171732B2 (fr)
EP (1)	EP3266195B1 (fr)
JP (1)	JP6486149B2 (fr)
KR (1)	KR101950689B1 (fr)
CN (1)	CN107431755B (fr)
WO (1)	WO2016139895A1 (fr)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
JP6486149B2 (ja) *	2015-03-03	2019-03-20	キヤノン株式会社	画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
EP4386659A1 (fr)	2015-03-10	2024-06-19	Canon Kabushiki Kaisha	Procédé de traitement d'image, dispositif de traitement d'image et appareil de capture d'image
JP6746359B2 (ja)	2015-05-08	2020-08-26	キヤノン株式会社	画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
EP3595288B1 (fr) *	2017-03-08	2021-07-21	Sony Corporation	Dispositif d'imagerie et procédé d'imagerie
US11195257B2 (en) *	2018-08-24	2021-12-07	Canon Kabushiki Kaisha	Image processing method, image processing apparatus, imaging apparatus, lens apparatus, storage medium, and image processing system
JP2019092215A (ja) *	2019-02-21	2019-06-13	キヤノン株式会社	画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
EP3980830A4 (fr) *	2019-06-06	2023-06-07	Applied Materials, Inc.	Système d'imagerie et procédé de création d'images composites
JP7646300B2 (ja) *	2020-05-15	2025-03-17	キヤノン株式会社	画像処理装置、画像処理方法及び撮像装置

Citations (1)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
WO2013105383A1 (fr) *	2012-01-13	2013-07-18	Canon Kabushiki Kaisha	Procédé de génération d'image, appareil de génération d'image, programme, et support de stockage

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
US4410804A (en)	1981-07-13	1983-10-18	Honeywell Inc.	Two dimensional image panel with range measurement capability
JP3774597B2 (ja)	1999-09-13	2006-05-17	キヤノン株式会社	撮像装置
JP5499778B2 (ja) *	2010-03-03	2014-05-21	株式会社ニコン	撮像装置
JP5699609B2 (ja) *	2011-01-06	2015-04-15	ソニー株式会社	画像処理装置および画像処理方法
JP5820257B2 (ja) *	2011-02-18	2015-11-24	キヤノン株式会社	画像処理装置、撮像装置、画像処理方法、及びプログラム
JP5822613B2 (ja) *	2011-09-12	2015-11-24	キヤノン株式会社	画像処理装置および画像処理方法
JP5917125B2 (ja)	2011-12-16	2016-05-11	キヤノン株式会社	画像処理装置、画像処理方法、撮像装置および表示装置
JP5459337B2 (ja) *	2012-03-21	2014-04-02	カシオ計算機株式会社	撮像装置、画像処理方法及びプログラム
JP6230239B2 (ja) *	2013-02-14	2017-11-15	キヤノン株式会社	画像処理装置、撮像装置、画像処理方法、画像処理プログラム、および、記憶媒体
JP6239862B2 (ja)	2013-05-20	2017-11-29	キヤノン株式会社	焦点調節装置、焦点調節方法およびプログラム、並びに撮像装置
JP6486149B2 (ja) *	2015-03-03	2019-03-20	キヤノン株式会社	画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
JP6275174B2 (ja)	2015-03-10	2018-02-07	キヤノン株式会社	画像処理方法、画像処理装置、および、撮像装置
US10325356B2 (en)	2015-11-30	2019-06-18	Canon Kabushiki Kaisha	Image processing device, image processing method, imaging device, and recording medium for exclusively performing adjustment processing or viewpoint change processing

2015
- 2015-03-03 JP JP2015041326A patent/JP6486149B2/ja active Active
2016
- 2016-02-10 KR KR1020177024142A patent/KR101950689B1/ko active Active
- 2016-02-10 EP EP16758596.7A patent/EP3266195B1/fr active Active
- 2016-02-10 CN CN201680013334.XA patent/CN107431755B/zh active Active
- 2016-02-10 US US15/539,318 patent/US10171732B2/en not_active Expired - Fee Related
- 2016-02-10 WO PCT/JP2016/000700 patent/WO2016139895A1/fr not_active Ceased
2018
- 2018-11-30 US US16/206,217 patent/US10674074B2/en active Active

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
WO2013105383A1 (fr) *	2012-01-13	2013-07-18	Canon Kabushiki Kaisha	Procédé de génération d'image, appareil de génération d'image, programme, et support de stockage

Also Published As

Publication number	Publication date
JP6486149B2 (ja)	2019-03-20
EP3266195A1 (fr)	2018-01-10
EP3266195B1 (fr)	2021-04-07
US10171732B2 (en)	2019-01-01
KR101950689B1 (ko)	2019-02-21
WO2016139895A1 (fr)	2016-09-09
US10674074B2 (en)	2020-06-02
JP2016163220A (ja)	2016-09-05
KR20170110108A (ko)	2017-10-10
CN107431755A (zh)	2017-12-01
US20190098210A1 (en)	2019-03-28
US20180013951A1 (en)	2018-01-11
CN107431755B (zh)	2020-10-30

Publication	Publication Date	Title
GB2595371B (en)	2022-03-02	Image processing apparatus, image pickup apparatus, image processing method, and storage medium
EP3213290A4 (fr)	2018-07-04	Appareil de traitement de données, appareil d'imagerie et procédé de traitement de données
EP3149931A4 (fr)	2017-07-12	Appareil de traitement d'image, appareil d'imagerie, procédé de traitement d'image, et support de stockage lisible par ordinateur
EP3186954A4 (fr)	2017-08-09	Appareil de traitement d'image, procédé de traitement d'image, support d'enregistrement, et programme
GB2533237B (en)	2017-03-08	Image processing apparatus, method for controlling the same, and storage medium
GB201708403D0 (en)	2017-07-12	Image processing device and method, image pickup device, program, and recording medium
EP3266195A4 (fr)	2018-10-03	Appareil de traitement d'image, appareil de capture d'image, procédé de traitement d'image, programme et support d'enregistrement
EP3315999A4 (fr)	2018-06-20	Dispositif de traitement d'image de distance, procédé de traitement d'image de distance, programme de traitement d'image de distance, et support d'enregistrement
EP3358847A4 (fr)	2018-08-08	Dispositif de traitement d'images animées, procédé de traitement et support d'informations lisible par ordinateur
EP3684062A4 (fr)	2021-01-27	Procédé et appareil de traitement vidéo et support de stockage
EP3090539A4 (fr)	2017-09-13	Appareil de traitement d'images, procédé de traitement d'images, et support d'enregistrement lisible par ordinateur
EP3293697A4 (fr)	2019-01-23	Dispositif de traitement d'images, dispositif d'imagerie, procédé de traitement d'images et support de stockage stockant un programme de traitement d'images pour un dispositif de traitement d'images
EP3269135A4 (fr)	2019-02-27	Procédé de traitement d'image, dispositif de traitement d'image et appareil de capture d'image
EP3105915A4 (fr)	2017-02-22	Appareil de traitement d'images, système de traitement d'images, procédé de traitement d'images et support d'enregistrement
EP3185544A4 (fr)	2018-03-14	Appareil de traitement d'informations, support d'enregistrement d'informations, procédé de traitement d'informations, et programme
GB201617760D0 (en)	2016-12-07	Video processing apparatus, video processing method, program, and medium
EP3131281A4 (fr)	2018-04-18	Appareil et procédé de traitement d'images, support d'enregistrement sur lequel a été stocké temporairement un programme de traitement d'images lisible par ordinatuer, et appareil de capture d'images
EP3268892A4 (fr)	2018-03-28	Dispositif de traitement d'images, procédé d'authentification et support de stockage non transitoire stockant un programme d'authentification
EP3243329A4 (fr)	2018-10-10	Appareil de décodage d'images, procédé de décodage d'images, et support d'informations
EP3296789A4 (fr)	2018-12-19	Dispositif de traitement d'images, dispositif d'imagerie, procédé de traitement d'images, programme et support de stockage
GB2549642B (en)	2021-02-03	Image processing device and method, program, and record medium
EP3258681A4 (fr)	2018-03-28	Appareil de lecture d'image, procédé de lecture d'image, et programme de lecture d'image
EP3094259A4 (fr)	2017-08-23	Appareil de traitement d'image, système de diagnostic d'image, procédé de traitement d'image, et support de stockage
GB2543127B (en)	2018-11-21	Control apparatus, image pickup apparatus, control method, program, and storage medium
EP3094261A4 (fr)	2017-09-13	Appareil de traitement d'image, procédé de traitement d'image, et support d'informations

Legal Events

Date	Code	Title	Description
2017-06-07	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE
2017-12-08	PUAI	Public reference made under article 153(3) epc to a published international application that has entered the european phase	Free format text: ORIGINAL CODE: 0009012
2017-12-08	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE
2018-01-10	17P	Request for examination filed	Effective date: 20171004
2018-01-10	AK	Designated contracting states	Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
2018-01-10	AX	Request for extension of the european patent	Extension state: BA ME
2018-06-06	DAV	Request for validation of the european patent (deleted)
2018-06-06	DAX	Request for extension of the european patent (deleted)
2018-10-03	A4	Supplementary search report drawn up and despatched	Effective date: 20180904
2018-10-03	RIC1	Information provided on ipc code assigned before grant	Ipc: H04N 5/225 20060101ALI20180829BHEP Ipc: G06T 5/50 20060101ALI20180829BHEP Ipc: H04N 5/369 20110101ALI20180829BHEP Ipc: H04N 5/232 20060101AFI20180829BHEP Ipc: G02B 7/34 20060101ALI20180829BHEP Ipc: G02B 7/28 20060101ALI20180829BHEP
2020-04-10	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: EXAMINATION IS IN PROGRESS
2020-05-13	17Q	First examination report despatched	Effective date: 20200416
2020-10-20	GRAP	Despatch of communication of intention to grant a patent	Free format text: ORIGINAL CODE: EPIDOSNIGR1
2020-10-20	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: GRANT OF PATENT IS INTENDED
2020-11-18	INTG	Intention to grant announced	Effective date: 20201021
2021-02-25	GRAS	Grant fee paid	Free format text: ORIGINAL CODE: EPIDOSNIGR3
2021-03-05	GRAA	(expected) grant	Free format text: ORIGINAL CODE: 0009210
2021-03-05	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: THE PATENT HAS BEEN GRANTED
2021-04-07	AK	Designated contracting states	Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
2021-04-07	REG	Reference to a national code	Ref country code: GB Ref legal event code: FG4D
2021-04-15	REG	Reference to a national code	Ref country code: AT Ref legal event code: REF Ref document number: 1381199 Country of ref document: AT Kind code of ref document: T Effective date: 20210415 Ref country code: CH Ref legal event code: EP
2021-04-29	REG	Reference to a national code	Ref country code: DE Ref legal event code: R096 Ref document number: 602016055684 Country of ref document: DE
2021-05-12	REG	Reference to a national code	Ref country code: IE Ref legal event code: FG4D
2021-07-26	REG	Reference to a national code	Ref country code: LT Ref legal event code: MG9D
2021-09-15	REG	Reference to a national code	Ref country code: NL Ref legal event code: MP Effective date: 20210407 Ref country code: AT Ref legal event code: MK05 Ref document number: 1381199 Country of ref document: AT Kind code of ref document: T Effective date: 20210407
2021-10-29	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707
2021-11-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210708 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210807 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210809 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407
2022-01-10	REG	Reference to a national code	Ref country code: DE Ref legal event code: R097 Ref document number: 602016055684 Country of ref document: DE
2022-01-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407
2022-02-11	PLBE	No opposition filed within time limit	Free format text: ORIGINAL CODE: 0009261
2022-02-11	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT
2022-03-16	26N	No opposition filed	Effective date: 20220110
2022-06-01	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210807 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407
2022-07-29	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407
2022-09-01	REG	Reference to a national code	Ref country code: DE Ref legal event code: R119 Ref document number: 602016055684 Country of ref document: DE
2022-09-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407
2022-10-14	REG	Reference to a national code	Ref country code: CH Ref legal event code: PL
2022-10-24	REG	Reference to a national code	Ref country code: BE Ref legal event code: MM Effective date: 20220228
2022-10-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220210
2022-12-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220228
2023-01-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220228 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220210 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220901 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220228
2023-02-28	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220228
2024-03-29	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20160210
2024-04-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407
2024-09-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210407
2025-04-28	PGFP	Annual fee paid to national office [announced via postgrant information from national office to epo]	Ref country code: GB Payment date: 20250123 Year of fee payment: 10