[go: up one dir, main page]

EP3577629A4 - CALIBRATION ITEM FOR A ROBOTIC 3D VISION SYSTEM - Google Patents

CALIBRATION ITEM FOR A ROBOTIC 3D VISION SYSTEM Download PDF

Info

Publication number
EP3577629A4
EP3577629A4 EP18747394.7A EP18747394A EP3577629A4 EP 3577629 A4 EP3577629 A4 EP 3577629A4 EP 18747394 A EP18747394 A EP 18747394A EP 3577629 A4 EP3577629 A4 EP 3577629A4
Authority
EP
European Patent Office
Prior art keywords
robotic
vision system
calibration item
calibration
item
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP18747394.7A
Other languages
German (de)
French (fr)
Other versions
EP3577629B1 (en
EP3577629A1 (en
Inventor
Jianjun Wang
Remus Boca
Biao Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ABB Schweiz AG
Original Assignee
ABB Schweiz AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ABB Schweiz AG filed Critical ABB Schweiz AG
Publication of EP3577629A1 publication Critical patent/EP3577629A1/en
Publication of EP3577629A4 publication Critical patent/EP3577629A4/en
Application granted granted Critical
Publication of EP3577629B1 publication Critical patent/EP3577629B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1679Programme controls characterised by the tasks executed
    • B25J9/1692Calibration of manipulator
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697Vision controlled systems
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/39Robotics, robotics to robotics hand
    • G05B2219/39016Simultaneous calibration of manipulator and camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Manipulator (AREA)
EP18747394.7A 2017-02-03 2018-02-05 Calibration article for a 3d vision robotic system Active EP3577629B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/424,058 US10661442B2 (en) 2017-02-03 2017-02-03 Calibration article for a 3D vision robotic system
PCT/US2018/016898 WO2018145025A1 (en) 2017-02-03 2018-02-05 Calibration article for a 3d vision robotic system

Publications (3)

Publication Number Publication Date
EP3577629A1 EP3577629A1 (en) 2019-12-11
EP3577629A4 true EP3577629A4 (en) 2020-12-09
EP3577629B1 EP3577629B1 (en) 2022-10-12

Family

ID=63039019

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18747394.7A Active EP3577629B1 (en) 2017-02-03 2018-02-05 Calibration article for a 3d vision robotic system

Country Status (4)

Country Link
US (1) US10661442B2 (en)
EP (1) EP3577629B1 (en)
CN (1) CN111278608B (en)
WO (1) WO2018145025A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11679507B2 (en) * 2017-04-26 2023-06-20 Hewlett-Packard Development Company, L.P. Robotic structure calibrations
CN111127553B (en) * 2018-10-31 2023-04-28 南京埃斯顿机器人工程有限公司 A multi-camera-based positioning method for photovoltaic cell strings
WO2021012122A1 (en) * 2019-07-19 2021-01-28 西门子(中国)有限公司 Robot hand-eye calibration method and apparatus, computing device, medium and product
CN110906863B (en) * 2019-10-30 2022-01-28 成都绝影智能科技有限公司 Hand-eye calibration system and calibration method for line-structured light sensor
CN110930442B (en) * 2019-11-26 2020-07-31 广东技术师范大学 Method and device for determining positions of key points in robot hand-eye calibration based on calibration block
SE543841C2 (en) * 2019-12-19 2021-08-10 Husqvarna Ab A calibration device for a floor surfacing system
US12125242B2 (en) 2022-01-06 2024-10-22 Liberty Robotics Inc. Method and system for registering a 3D sensor with an autonomous manipulator
CN112683568B (en) * 2021-01-21 2025-09-02 南京航空航天大学 A standard block and attitude adjustment method for AC turntable posture adjustment in multi-axis machining
JP7650597B2 (en) * 2021-06-15 2025-03-25 株式会社ディスコ Measurement tool, operation accuracy measurement system, and operation accuracy measurement method
CN113524147B (en) * 2021-08-02 2022-05-24 北京深度奇点科技有限公司 Industrial robot teaching system and method based on 3D camera

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090096790A1 (en) * 2007-10-11 2009-04-16 Mvtec Software Gmbh System and method for 3d object recognition
US20120078418A1 (en) * 2009-06-08 2012-03-29 Jin Hwan Borm Robot calibration apparatus and method for same
US20140018957A1 (en) * 2012-07-11 2014-01-16 Seiko Epson Corporation Robot system, robot, robot control device, robot control method, and robot control program

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005017450A1 (en) * 2003-08-11 2005-02-24 Multi-Dimension Technology, Llc Calibration block and calibration system for 3d scanner
US7164128B2 (en) * 2003-11-25 2007-01-16 Hitachi High-Technologies Corporation Method and apparatus for observing a specimen
US20080252248A1 (en) 2005-01-26 2008-10-16 Abb Ab Device and Method for Calibrating the Center Point of a Tool Mounted on a Robot by Means of a Camera
JP2007187538A (en) * 2006-01-13 2007-07-26 Hitachi High-Technologies Corp Charged particle beam apparatus and image acquisition method using the same
CA2733774A1 (en) 2008-08-18 2010-02-25 Shalabh Kumar Rastogi Composite calibration/verification gauge and method of its manufacture
US9393694B2 (en) * 2010-05-14 2016-07-19 Cognex Corporation System and method for robust calibration between a machine vision system and a robot
EP2608938B1 (en) * 2010-08-27 2014-07-02 ABB Research LTD Vision-guided alignment system and method
US8582117B2 (en) * 2011-04-08 2013-11-12 Schmitt Industries, Inc. Systems and methods for calibrating an optical non-contact surface roughness measurement device
JP5383836B2 (en) * 2012-02-03 2014-01-08 ファナック株式会社 An image processing apparatus having a function of automatically adjusting a search window
EP2979938B1 (en) * 2013-03-29 2019-08-07 Autoliv Nissin Brake Systems Japan Co., Ltd. Vehicle brake fluid pressure control device
US9641830B2 (en) 2014-04-08 2017-05-02 Lucasfilm Entertainment Company Ltd. Automated camera calibration methods and systems
US9889565B2 (en) 2014-06-23 2018-02-13 Abb Schweiz Ag Method for calibrating a robot and a robot system
WO2016094840A2 (en) 2014-12-11 2016-06-16 Ghosh Sudeep System, method & computer readable medium for software protection via composable process-level virtual machines
US9952044B2 (en) 2015-02-02 2018-04-24 Rolls-Royce North American Technologies, Inc. Multi-axis calibration block
JP2017155683A (en) * 2016-03-03 2017-09-07 マツダ株式会社 Control device for engine, and brake applying force estimation method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090096790A1 (en) * 2007-10-11 2009-04-16 Mvtec Software Gmbh System and method for 3d object recognition
US20120078418A1 (en) * 2009-06-08 2012-03-29 Jin Hwan Borm Robot calibration apparatus and method for same
US20140018957A1 (en) * 2012-07-11 2014-01-16 Seiko Epson Corporation Robot system, robot, robot control device, robot control method, and robot control program

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
BESS R: "REGISTERING DEPTH MAPS FROM MULTIPLE VIEWS RECORDED BY COLOR IMAGE SEQUENCES", PATTERN RECOGNITION. IMAGE ANALYSIS, ALLEN PRESS, LAWRENCE, KS, US, vol. 7, no. 3, 1 July 1997 (1997-07-01), pages 291 - 300, XP008026757, ISSN: 1054-6618 *
See also references of WO2018145025A1 *

Also Published As

Publication number Publication date
EP3577629B1 (en) 2022-10-12
CN111278608B (en) 2023-03-28
EP3577629A1 (en) 2019-12-11
US10661442B2 (en) 2020-05-26
US20180222055A1 (en) 2018-08-09
CN111278608A (en) 2020-06-12
WO2018145025A1 (en) 2018-08-09

Similar Documents

Publication Publication Date Title
EP3577629A4 (en) CALIBRATION ITEM FOR A ROBOTIC 3D VISION SYSTEM
EP3495094C0 (en) RESISTANCE BASED JOINT LIMITATION FOR A MASTER ROBOT SYSTEM
IL258995B (en) A robotic cooperation system
GB201715454D0 (en) System for determining a physical metric such as position
DE112015001856A5 (en) Camera system for a vehicle
EP4279312C0 (en) AXLE ARRANGEMENT FOR A VEHICLE
SG11201710180SA (en) Agv comb-type transfer robot
DE112017006397A5 (en) System for a vehicle
DE102015119964A8 (en) Control system for a vehicle
EP3674163A4 (en) ITEM DISPENSING ROBOTS
GB201719823D0 (en) A Retroeflectivity measurement system
EP3548230A4 (en) SEAL ARRANGEMENT FOR A ROBOT JOINT
GB2576164B (en) Multi-axis position sensing system
EP3533034A4 (en) ARRANGEMENT FOR MANUFACTURED 3D PARTS
SG11202003077XA (en) Offline sales execution system
DE112017004888T8 (en) Monitor interior mirror for a vehicle
EP3465330A4 (en) HEADUP DISPLAY FOR A VEHICLE
GB2561301B (en) Calibrating a display for a vehicle
IL261451B (en) A layered metrology system on every surface
GB201810511D0 (en) Display For A Vehicle
EP3515762A4 (en) DISPLAY UNIT FOR A VEHICLE
ZA201905158B (en) A robot
GB2573947B (en) Automated shelf sensing system
EP3620277A4 (en) ROBOT SYSTEM
GB2551323B (en) System providing a shared environment

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190903

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIN1 Information on inventor provided before grant (corrected)

Inventor name: BOCA, REMUS

Inventor name: ZHANG, BIAO

Inventor name: WANG, JIANJUN

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20201111

RIC1 Information provided on ipc code assigned before grant

Ipc: G01B 11/24 20060101ALI20201105BHEP

Ipc: B23Q 17/00 20060101ALI20201105BHEP

Ipc: G06T 7/00 20170101AFI20201105BHEP

Ipc: H04N 17/00 20060101ALI20201105BHEP

Ipc: G01B 3/30 20060101ALI20201105BHEP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602018041694

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G06T0007000000

Ipc: B25J0009160000

RIC1 Information provided on ipc code assigned before grant

Ipc: B25J 9/16 20060101ALI20220407BHEP

Ipc: H04N 17/00 20060101ALI20220407BHEP

Ipc: G01B 11/24 20060101ALI20220407BHEP

Ipc: G01B 3/30 20060101ALI20220407BHEP

Ipc: B23Q 17/00 20060101ALI20220407BHEP

Ipc: G06T 7/00 20170101AFI20220407BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20220519

RIC1 Information provided on ipc code assigned before grant

Ipc: B25J 9/16 20060101AFI20220509BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018041694

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1523880

Country of ref document: AT

Kind code of ref document: T

Effective date: 20221115

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20221012

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1523880

Country of ref document: AT

Kind code of ref document: T

Effective date: 20221012

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230213

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230112

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230212

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230113

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602018041694

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

26N No opposition filed

Effective date: 20230713

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230228

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230205

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230228

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230205

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230205

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250218

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20180205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20180205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20221012