EP2381220A3 - Navigation sur des images - Google Patents

Navigation sur des images Download PDF

Info

Publication number: EP2381220A3
Authority: EP; European Patent Office
Prior art keywords: navigating; images; image; origin; initial image
Prior art date: 2010-03-04
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.): Granted

Application number

EP10196998.8A

Other languages

German (de)

English (en)

Other versions

EP2381220A2 (fr

EP2381220B1 (fr

Inventor

Joseph P Mays

Jeffrey R Bach

Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)

Here Global BV

Original Assignee

Here Global BV

Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)

2010-03-04

Filing date

2010-12-24

Publication date

2014-11-12

2010-12-24 Application filed by Here Global BV filed Critical Here Global BV

2011-10-26 Publication of EP2381220A2 publication Critical patent/EP2381220A2/fr

2014-11-12 Publication of EP2381220A3 publication Critical patent/EP2381220A3/fr

2017-03-29 Application granted granted Critical

2017-03-29 Publication of EP2381220B1 publication Critical patent/EP2381220B1/fr

Status Active legal-status Critical Current

2030-12-24 Anticipated expiration legal-status Critical

Classifications

- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/3446—Details of route searching algorithms, e.g. Dijkstra, A*, arc-flags or using precalculated routes
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/20—Instruments for performing navigational calculations
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3602—Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/3647—Guidance involving output of stored or live camera images or video streams
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
- G01C21/3804—Creation or updating of map data
- G01C21/3833—Creation or updating of map data characterised by the source of data
- G01C21/3848—Data obtained from both position sensors and additional sensors
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
- G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries

Landscapes

Engineering & Computer Science (AREA)
Remote Sensing (AREA)
Radar, Positioning & Navigation (AREA)
Physics & Mathematics (AREA)
General Physics & Mathematics (AREA)
Automation & Control Theory (AREA)
Computer Vision & Pattern Recognition (AREA)
Multimedia (AREA)
Theoretical Computer Science (AREA)
Computing Systems (AREA)
Artificial Intelligence (AREA)
Databases & Information Systems (AREA)
Evolutionary Computation (AREA)
General Health & Medical Sciences (AREA)
Medical Informatics (AREA)
Software Systems (AREA)
Health & Medical Sciences (AREA)
Navigation (AREA)
Instructional Devices (AREA)
Apparatus For Radiation Diagnosis (AREA)

EP10196998.8A 2010-03-04 2010-12-24 Navigation sur des images Active EP2381220B1 (fr)

Applications Claiming Priority (1)

Application Number	Priority Date	Filing Date	Title
US12/717,190 US8660316B2 (en)	2010-03-04	2010-03-04	Navigating on images

Publications (3)

Publication Number	Publication Date
EP2381220A2 EP2381220A2 (fr)	2011-10-26
EP2381220A3 true EP2381220A3 (fr)	2014-11-12
EP2381220B1 EP2381220B1 (fr)	2017-03-29

Family

ID=44189029

Family Applications (1)

Application Number	Title	Priority Date	Filing Date
EP10196998.8A Active EP2381220B1 (fr)	2010-03-04	2010-12-24	Navigation sur des images

Country Status (2)

Country	Link
US (2)	US8660316B2 (fr)
EP (1)	EP2381220B1 (fr)

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
CN102918358A (zh) *	2010-04-09	2013-02-06	通腾北美有限公司	从表示位置的数据解析位置的方法
EP2567360A4 (fr) *	2010-05-27	2017-04-26	Landmark Graphics Corporation	Procédé et système de rendu de valeurs de diagraphie
US20130061147A1 (en) *	2011-09-07	2013-03-07	Nokia Corporation	Method and apparatus for determining directions and navigating to geo-referenced places within images and videos
WO2013058678A1 (fr)	2011-10-19	2013-04-25	Ikonomov Artashes Valer Evich	Dispositif destiné à la recherche de données d'un utilisateur réseau
US9047688B2 (en)	2011-10-21	2015-06-02	Here Global B.V.	Depth cursor and depth measurement in images
US9116011B2 (en) *	2011-10-21	2015-08-25	Here Global B.V.	Three dimensional routing
US8553942B2 (en)	2011-10-21	2013-10-08	Navteq B.V.	Reimaging based on depthmap information
US20140236932A1 (en) *	2011-11-22	2014-08-21	Artashes Valeryevich Ikonomov	Information search device
FR2983607B1 (fr) *	2011-12-02	2014-01-17	Morpho	Procede et dispositif de suivi d'un objet dans une sequence d'au moins deux images
US9024970B2 (en)	2011-12-30	2015-05-05	Here Global B.V.	Path side image on map overlay
US9404764B2 (en)	2011-12-30	2016-08-02	Here Global B.V.	Path side imagery
US9173069B2 (en)	2012-01-12	2015-10-27	Google Inc.	Navigating using an indoor map representation
WO2013104127A1 (fr) *	2012-01-12	2013-07-18	Google Inc.	Génération d'un modèle de carte d'intérieur
US10345108B2 (en) *	2012-05-16	2019-07-09	Polaris Industries Inc.	System and method for multi-plane routing
JP2013250141A (ja) *	2012-05-31	2013-12-12	Toshiba Corp	経路探索装置および経路探索方法
US10115084B2 (en)	2012-10-10	2018-10-30	Artashes Valeryevich Ikonomov	Electronic payment system
US9343043B2 (en) *	2013-08-01	2016-05-17	Google Inc.	Methods and apparatus for generating composite images
FR3011923B1 (fr) *	2013-10-14	2017-05-26	Renault Sas	Procede de guidage d'un utilisateur d'un vehicule automobile, systeme correspondant et vehicule automobile
KR20150078881A (ko) *	2013-12-31	2015-07-08	현대자동차주식회사	클라우드 컴퓨팅을 통한 차량 위치 측정방법
US9405770B2 (en) *	2014-03-10	2016-08-02	Google Inc.	Three dimensional navigation among photos
RU2640298C1 (ru) *	2015-10-12	2017-12-27	Общество С Ограниченной Ответственностью "Яндекс"	Способ обработки и хранения изображений
US9892318B2 (en)	2015-12-22	2018-02-13	Here Global B.V.	Method and apparatus for updating road map geometry based on received probe data
CN106969779B (zh) *	2017-03-17	2020-05-12	重庆邮电大学	基于dsrc的智能车辆地图融合系统及方法
US10621725B2 (en)	2017-04-12	2020-04-14	Here Global B.V.	Small object detection from a large image
US10788831B2 (en) *	2017-10-06	2020-09-29	Wipro Limited	Method and device for identifying center of a path for navigation of autonomous vehicles
US10712168B2 (en) *	2017-12-28	2020-07-14	Uatc, Llc	Submap geographic projections
US11448518B2 (en) *	2018-09-27	2022-09-20	Phiar Technologies, Inc.	Augmented reality navigational overlay
US10495476B1 (en)	2018-09-27	2019-12-03	Phiar Technologies, Inc.	Augmented reality navigation systems and methods
US10949707B2 (en) *	2019-02-27	2021-03-16	Here Global B.V.	Method, apparatus, and system for generating feature correspondence from camera geometry
CN109974729A (zh) *	2019-03-07	2019-07-05	百度在线网络技术（北京）有限公司	街景图像的更新方法、装置和系统
CN111750888B (zh) *	2020-06-17	2021-05-04	北京嘀嘀无限科技发展有限公司	信息交互方法、装置、电子设备和计算机可读存储介质
US11907522B2 (en)	2020-06-24	2024-02-20	Bank Of America Corporation	System for dynamic allocation of navigation tools based on learned user interaction
US11698849B2 (en) *	2021-03-15	2023-07-11	Micro Focus Llc	Automated application testing of mutable interfaces

Citations (2)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
US7260474B1 (en) *	2005-02-08	2007-08-21	Cellco Partnership	GIS point-to-point routing for directions
EP2148167A2 (fr) *	2008-07-25	2010-01-27	Navteq North America, LLC	Cartes de zones ouvertes

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
US6208934B1 (en) *	1999-01-19	2001-03-27	Navigation Technologies Corp.	Method and system for providing walking instructions with route guidance in a navigation program
US6711293B1 (en) *	1999-03-08	2004-03-23	The University Of British Columbia	Method and apparatus for identifying scale invariant features in an image and use of same for locating an object in an image
US6895126B2 (en) *	2000-10-06	2005-05-17	Enrico Di Bernardo	System and method for creating, storing, and utilizing composite images of a geographic location
US7827507B2 (en) *	2002-05-03	2010-11-02	Pixearth Corporation	System to navigate within images spatially referenced to a computed space
US8700308B2 (en) *	2006-03-31	2014-04-15	Volkswagen Ag	Navigation system for a motor vehicle
US20080082264A1 (en) *	2006-09-11	2008-04-03	Broadcom Corporation, A California Corporation	GPS route creation, photograph association, and data collection
US7990394B2 (en) *	2007-05-25	2011-08-02	Google Inc.	Viewing and navigating within panoramic images, and applications thereof
US8364397B2 (en) *	2007-08-23	2013-01-29	International Business Machines Corporation	Pictorial navigation
US20100023251A1 (en) *	2008-07-25	2010-01-28	Gale William N	Cost based open area maps
US8339417B2 (en) *	2008-07-25	2012-12-25	Navteq B.V.	Open area maps based on vector graphics format images
US20100021013A1 (en) *	2008-07-25	2010-01-28	Gale William N	Open area maps with guidance
US8229176B2 (en) *	2008-07-25	2012-07-24	Navteq B.V.	End user image open area maps
US8825387B2 (en) *	2008-07-25	2014-09-02	Navteq B.V.	Positioning open area maps
US8374780B2 (en) *	2008-07-25	2013-02-12	Navteq B.V.	Open area maps with restriction content
US8504285B2 (en) *	2009-05-15	2013-08-06	Nokia Corporation	Method and apparatus of route determination
US8953838B2 (en) *	2009-06-24	2015-02-10	Here Global B.V.	Detecting ground geographic features in images based on invariant components

2010
- 2010-03-04 US US12/717,190 patent/US8660316B2/en active Active
- 2010-12-24 EP EP10196998.8A patent/EP2381220B1/fr active Active
2014
- 2014-01-23 US US14/162,092 patent/US9404753B2/en active Active

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
US7260474B1 (en) *	2005-02-08	2007-08-21	Cellco Partnership	GIS point-to-point routing for directions
EP2148167A2 (fr) *	2008-07-25	2010-01-27	Navteq North America, LLC	Cartes de zones ouvertes

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
FERNANDO LYARDET ET AL: "CoINS: Context Sensitive Indoor Navigation System", PROCEEDINGS / ISM 2006, EIGHTH IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA : 11 - 13 DECEMBER 2006, SAN DIEGO, CA, IEEE COMPUTER SOCIETY, LOS ALAMITOS, CALIF. [U.A.], 1 December 2006 (2006-12-01), pages 209 - 218, XP031041784, ISBN: 978-0-7695-2746-8 *

Also Published As

Publication number	Publication date
US20110216935A1 (en)	2011-09-08
US9404753B2 (en)	2016-08-02
US20140136108A1 (en)	2014-05-15
US8660316B2 (en)	2014-02-25
EP2381220A2 (fr)	2011-10-26
EP2381220B1 (fr)	2017-03-29

Publication	Publication Date	Title
EP2381220A3 (fr)	2014-11-12	Navigation sur des images
EP2688295A3 (fr)	2014-03-19	Système et procédé permettant de fournir une image
EP2541201A3 (fr)	2015-04-29	Vue cartographique
EP3101625A3 (fr)	2016-12-14	Procédé et système de sélection d'une vue à partir d'une pluralité de caméras
EP3246664A3 (fr)	2018-02-14	Système de traitement d'informations et appareil d'affichage d'informations
EP3125158A3 (fr)	2017-03-08	Procede et dispositif d'affichage d'images
EP2339296A3 (fr)	2016-07-27	Procédé permettant de déterminer une plage
EP2736018A3 (fr)	2017-01-25	Détermination de la direction de report
EP2394717A3 (fr)	2014-01-22	Système de génération d'images, procédé de génération d'images et support de stockage d'informations pour jeux vidéo
WO2014186420A3 (fr)	2015-04-23	Capture et lecture de la réalité augmentée (ar)
WO2014032020A3 (fr)	2014-05-08	Estimation de mouvement en haute résolution basée sur des éléments à partir d'images en basse résolution capturées à l'aide d'une source matricielle
WO2015134840A3 (fr)	2015-11-26	Système et procédé d'informations visuelles pour un véhicule
EP2768214A3 (fr)	2016-03-16	Procédé de suivi d'objet utilisant une caméra et système de caméra de suivi d'objet
EP2698704A3 (fr)	2014-05-21	Dispositif et procédé d'affichage d'images
EP2634749A3 (fr)	2017-12-06	Alignement automatique d'images
EP2509046A3 (fr)	2013-10-23	Procédé et dispositif pour afficher une indication de la qualité des données tridimensionnelles de la surface d'un objet visualisé
EP3270207A3 (fr)	2018-03-28	Scanner à laser à caméras multiples
EP2937815A3 (fr)	2016-01-06	Procédé et système de détection d'objet utilisant des nuages de points laser
EP2339295A3 (fr)	2016-07-13	Système de navigation relative et procédé associé
EP2767932A3 (fr)	2015-04-08	Méthode et système de détection de contours
CA2916849C (fr)	2021-06-01	Procede et systeme de georeferencement
EP2731348A3 (fr)	2014-06-25	Appareil et procédé de fourniture de service de réseau social utilisant une réalité augmentée
EP3565241A3 (fr)	2019-12-04	Animation de photos et/ou de vidéos basée sur des métadonnées
EP2489984A3 (fr)	2014-04-30	Système de navigation doté d'un mécanisme de contrôle d'accessoires et méthode de fonctionnement
EP2166375A3 (fr)	2011-10-05	Système et procédé d'extraction de fonctions planes

Legal Events

Date	Code	Title	Description
2011-10-26	AK	Designated contracting states	Kind code of ref document: A2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
2011-10-26	AX	Request for extension of the european patent	Extension state: BA ME
2011-11-23	PUAI	Public reference made under article 153(3) epc to a published international application that has entered the european phase	Free format text: ORIGINAL CODE: 0009012
2013-02-27	RAP1	Party data changed (applicant data changed or rights of an application transferred)	Owner name: NAVTEQ B.V.
2013-07-31	RAP1	Party data changed (applicant data changed or rights of an application transferred)	Owner name: HERE GLOBAL B.V.
2014-10-10	PUAL	Search report despatched	Free format text: ORIGINAL CODE: 0009013
2014-11-12	AK	Designated contracting states	Kind code of ref document: A3 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
2014-11-12	AX	Request for extension of the european patent	Extension state: BA ME
2014-11-12	RIC1	Information provided on ipc code assigned before grant	Ipc: G01C 21/34 20060101AFI20141007BHEP Ipc: G06K 9/64 20060101ALI20141007BHEP Ipc: G01C 21/20 20060101ALI20141007BHEP Ipc: G06K 9/46 20060101ALI20141007BHEP
2015-06-17	17P	Request for examination filed	Effective date: 20150511
2015-06-17	RBV	Designated contracting states (corrected)	Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
2015-12-23	17Q	First examination report despatched	Effective date: 20151120
2016-04-20	RIC1	Information provided on ipc code assigned before grant	Ipc: G06K 9/64 20060101ALI20160311BHEP Ipc: G01C 21/20 20060101ALI20160311BHEP Ipc: G01C 21/34 20060101AFI20160311BHEP Ipc: G01C 21/36 20060101ALI20160311BHEP Ipc: G06K 9/46 20060101ALI20160311BHEP
2016-05-26	GRAP	Despatch of communication of intention to grant a patent	Free format text: ORIGINAL CODE: EPIDOSNIGR1
2016-06-22	INTG	Intention to grant announced	Effective date: 20160527
2016-06-22	RAP1	Party data changed (applicant data changed or rights of an application transferred)	Owner name: HERE GLOBAL B.V.
2016-10-03	GRAJ	Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted	Free format text: ORIGINAL CODE: EPIDOSDIGR1
2016-10-17	GRAP	Despatch of communication of intention to grant a patent	Free format text: ORIGINAL CODE: EPIDOSNIGR1
2016-11-09	INTC	Intention to grant announced (deleted)
2016-11-16	INTG	Intention to grant announced	Effective date: 20161018
2017-02-20	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: GRANT OF PATENT IS INTENDED
2017-02-21	GRAS	Grant fee paid	Free format text: ORIGINAL CODE: EPIDOSNIGR3
2017-02-24	GRAA	(expected) grant	Free format text: ORIGINAL CODE: 0009210
2017-02-24	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: THE PATENT HAS BEEN GRANTED
2017-03-29	AK	Designated contracting states	Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
2017-03-29	REG	Reference to a national code	Ref country code: GB Ref legal event code: FG4D
2017-03-31	REG	Reference to a national code	Ref country code: CH Ref legal event code: EP
2017-04-15	REG	Reference to a national code	Ref country code: AT Ref legal event code: REF Ref document number: 880200 Country of ref document: AT Kind code of ref document: T Effective date: 20170415
2017-04-19	REG	Reference to a national code	Ref country code: IE Ref legal event code: FG4D
2017-05-11	REG	Reference to a national code	Ref country code: DE Ref legal event code: R096 Ref document number: 602010041080 Country of ref document: DE
2017-07-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170629 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170630
2017-08-02	REG	Reference to a national code	Ref country code: NL Ref legal event code: MP Effective date: 20170329
2017-08-15	REG	Reference to a national code	Ref country code: AT Ref legal event code: MK05 Ref document number: 880200 Country of ref document: AT Kind code of ref document: T Effective date: 20170329
2017-08-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170629
2017-09-29	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329
2017-10-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329
2017-11-13	REG	Reference to a national code	Ref country code: FR Ref legal event code: PLFP Year of fee payment: 8
2017-11-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170729 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170731
2018-01-03	REG	Reference to a national code	Ref country code: DE Ref legal event code: R097 Ref document number: 602010041080 Country of ref document: DE
2018-01-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329
2018-02-02	PLBE	No opposition filed within time limit	Free format text: ORIGINAL CODE: 0009261
2018-02-02	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT
2018-03-07	26N	No opposition filed	Effective date: 20180103
2018-05-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329
2018-07-31	REG	Reference to a national code	Ref country code: CH Ref legal event code: PL
2018-09-19	REG	Reference to a national code	Ref country code: IE Ref legal event code: MM4A
2018-09-28	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171224 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171224
2018-10-18	REG	Reference to a national code	Ref country code: BE Ref legal event code: MM Effective date: 20171231
2018-10-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171224
2018-11-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171231 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171231 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171231
2019-06-28	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20101224 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329
2019-10-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: CY Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170329
2019-11-29	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329
2020-03-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329
2020-07-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170329
2023-01-31	PGFP	Annual fee paid to national office [announced via postgrant information from national office to epo]	Ref country code: GB Payment date: 20221103 Year of fee payment: 13 Ref country code: FR Payment date: 20221110 Year of fee payment: 13
2023-06-21	P01	Opt-out of the competence of the unified patent court (upc) registered	Effective date: 20230517
2024-08-28	GBPC	Gb: european patent ceased through non-payment of renewal fee	Effective date: 20231224
2024-10-14	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20231224
2024-10-16	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20231231
2024-10-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20231224 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20231231
2025-01-10	PGFP	Annual fee paid to national office [announced via postgrant information from national office to epo]	Ref country code: DE Payment date: 20241029 Year of fee payment: 15