[go: up one dir, main page]

WO2023074995A1 - Système pour détecter et exprimer une température anormale au niveau d'un site industriel à l'aide d'un appareil de prise de vues d'imagerie thermique et générer une alarme pour informer celui-ci, et son procédé de fonctionnement - Google Patents

Système pour détecter et exprimer une température anormale au niveau d'un site industriel à l'aide d'un appareil de prise de vues d'imagerie thermique et générer une alarme pour informer celui-ci, et son procédé de fonctionnement Download PDF

Info

Publication number
WO2023074995A1
WO2023074995A1 PCT/KR2021/017279 KR2021017279W WO2023074995A1 WO 2023074995 A1 WO2023074995 A1 WO 2023074995A1 KR 2021017279 W KR2021017279 W KR 2021017279W WO 2023074995 A1 WO2023074995 A1 WO 2023074995A1
Authority
WO
WIPO (PCT)
Prior art keywords
temperature
abnormal
facility
industrial site
alarm
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2021/017279
Other languages
English (en)
Korean (ko)
Inventor
이동훈
이기춘
주용택
정종문
정동준
고윤영
김혜리
백정석
하선철
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
United Safety Consulting Co Ltd
Industry Academic Cooperation Foundation of Yonsei University
Original Assignee
United Safety Consulting Co Ltd
Industry Academic Cooperation Foundation of Yonsei University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by United Safety Consulting Co Ltd, Industry Academic Cooperation Foundation of Yonsei University filed Critical United Safety Consulting Co Ltd
Publication of WO2023074995A1 publication Critical patent/WO2023074995A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00Fire alarms; Alarms responsive to explosion
    • G08B17/12Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
    • G08B17/125Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/48Thermography; Techniques using wholly visual means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/182Level alarms, e.g. alarms responsive to variables exceeding a threshold
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/14Central alarm receiver or annunciator arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to a system that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera and generates an alarm to notify the user, and an operating method thereof.
  • CCTV surveillance camera systems
  • Patent Document 1 KR 10-2015-0050752 A
  • An object according to an embodiment of the present invention is a thermal imaging camera that analyzes a thermal image received from a camera photographing an industrial site and determines that an abnormal event has occurred when a temperature outside the normal range is measured. It provides a system and its operation method for detecting and expressing and alerting by generating an alarm.
  • a system for detecting and expressing an abnormal temperature at an industrial site and generating an alarm using a thermal imaging camera includes a camera module for generating a thermal image by photographing an industrial site, and a thermal image received from the camera module. It may include a server that analyzes the thermal image and determines whether an abnormal temperature exists in the facility.
  • the server analyzes the storage unit for storing the optical image and the thermal image received from the camera module, determines whether a temperature outside the normal temperature is detected, and if a temperature outside the normal temperature is detected, a facility abnormality is detected.
  • a facility abnormality determination unit outputting the occurrence of an event, and a notification unit notifying a manager of the occurrence of the abnormal event when the equipment abnormality determination unit outputs the occurrence of the equipment abnormality event.
  • the equipment abnormality determination unit extracts gray scale values for each pixel from the frame of the thermal image to create a gray scale matrix, and uses the minimum and maximum temperatures of the thermal imaging camera matched to the minimum and maximum values of the gray scale values. Then, the gray scale value is converted into temperature, and the temperature of the pixel is compared with the normal temperature. If there is a difference greater than the standard deviation, a facility failure event can be output.
  • the normal temperature may be determined as an average of temperatures collected during the steady-state adaptation period for each pixel.
  • the facility abnormality determination unit may not output an equipment abnormality event when the temperature of the pixel determined to be out of the normal temperature corresponds to the body temperature range.
  • the facility abnormality determination unit may apply the normal temperature differently according to the operating state of the facility.
  • the facility abnormality determination unit may divide the frame into one or more zones, and set a standard deviation, a high temperature limit value, a low temperature limit value, a normal temperature, a judgment reference time, and a steady state adaptation period differently for each of the zones.
  • the notification unit extracts an image in which the color of a pixel determined to be out of the normal temperature in the frame of the thermal image is displayed as a first color and an optical image image taken in the same direction as the frame of the thermal image from the optical image can be provided to the manager.
  • a method of operating a system for detecting and expressing an abnormal temperature at an industrial site and generating an alarm with a thermal imaging camera the camera module photographs the industrial site, generates a thermal image, and transmits the thermal image to a server.
  • the notification unit of the server may include a notification step of notifying an administrator of the occurrence of an abnormal event.
  • the equipment abnormality determination step includes a temperature calculation step of converting the gray scale value of each pixel of the thermal image frame into the current temperature, and calculating and calculating the deviation between the normal temperature and the current temperature, which is calculated as an average of accumulated temperatures in a normal state.
  • a deviation determination step of determining that an abnormal temperature exists when the measured deviation is greater than the standard deviation may be included.
  • the facility abnormality determination step may further include a body temperature determination step of determining that an abnormal temperature has not occurred when the current temperature is within the body temperature range after the temperature calculation step.
  • the facility abnormality determination step may further include a limit determination step of determining that an abnormal temperature exists when the current temperature is not included between the low temperature limit value and the high temperature limit value after the temperature calculation step.
  • the current temperature is accumulated and stored as a normal temperature in the storage unit, and the normal temperature is calculated by averaging the accumulated normal temperatures.
  • a normal temperature generating step may be further included.
  • the operating method of the system for detecting and expressing an abnormal temperature in an industrial field and generating an alarm using a thermal imaging camera is performed before the image generation step, and the region of the frame and the standard deviation , a high temperature limit value, a low temperature limit value, a normal temperature, a judgment standard time, and a variable setting step of setting one or more of the steady state adaptation period.
  • an event determination step of counting frames or times in which the abnormal temperature exists using a timer and determining that an equipment abnormality event has occurred when the cumulative value of the timer reaches the determination reference time is further performed.
  • the notification step transmits a facility abnormality event through e-mail, includes information on the area where the abnormal temperature occurs in the body of the e-mail, and includes an image displaying pixels where the abnormal temperature occurs in the frame image of the thermal image.
  • a temperature outside the normal range is measured at an industrial site, it is determined that an abnormal event has occurred, and the occurrence of the abnormal event is automatically notified to a manager so as to quickly prevent or respond to accidents.
  • FIG. 1 is a diagram illustrating an industrial site and a system for detecting and expressing an abnormal temperature in an industrial site and generating an alarm using a thermal imaging camera according to an embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating a system for detecting and expressing an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and generating an alarm to notify the user.
  • 3A is a flowchart illustrating an operation method of a system that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and generates and informs an alarm.
  • FIG. 3B is a flowchart specifically illustrating a facility abnormality determination step of an operation method of a system for detecting and expressing an abnormal temperature in an industrial site and generating an alarm to notify an abnormal temperature using a thermal imaging camera according to an embodiment of the present invention.
  • FIG. 4 is a diagram illustrating a process of recognizing a temperature by a system that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and issues an alarm.
  • FIG. 5 is a diagram illustrating a process of recognizing a normal temperature by a system that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and issues an alarm.
  • FIG. 6 is a diagram illustrating a process of comparing a normal temperature and a current temperature in a system for detecting and expressing an abnormal temperature at an industrial site and generating an alarm using a thermal imaging camera according to an embodiment of the present invention.
  • FIG. 7 is a view showing an alarm generated by a system for detecting and expressing an abnormal temperature in an industrial site and generating an alarm using a thermal imaging camera according to an embodiment of the present invention and displaying an area where an abnormal temperature occurs.
  • FIG. 8 is a diagram illustrating a thermal image frame and an optical frame in which an abnormal temperature is generated, provided to a manager by a notification unit.
  • 9 is a diagram showing the structure of mail used by the notification unit.
  • FIG. 1 is a diagram showing a system 10 and an industrial site 1 that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and issues an alarm.
  • the industrial site (1) may include various indoor facilities such as factories, research institutes, laboratories, chemical plants, oil refineries, automation facilities, and smart factories, as well as outdoor facilities such as ports, ports, logistics hubs, and loading docks.
  • various facilities (2) such as motors, heaters, air conditioners, pipes, distillers, etc. may be installed.
  • there may be various people (3) such as workers, managers, or visitors who work using the facility (2). An accident that occurs at an industrial site (1) may injure a person (3) or damage a facility (2).
  • a system 10 that detects and expresses an abnormal temperature at an industrial site using a thermal imaging camera according to an embodiment of the present invention and generates an alarm to notify the user of an accident that may occur at the industrial site 1 in advance, or when an accident occurs
  • an abnormal event occurring in the facility 2 may be detected and the occurrence of the abnormal event may be notified to a manager.
  • the manager may include a safety manager, a worker, and the like of the industrial site (1), and may include public officials such as a fire station, an ambulance, and a district office.
  • the abnormal event may include a facility abnormal event.
  • Abnormal events include cases in which the person (3) falls due to accidents such as leakage of toxic gas or electric shock, or the person (3) falls down due to a disease such as heart attack or stroke, and the person (3) lies on the floor. You may.
  • the facility abnormality event may include the detection of a temperature outside of the normal temperature within the industrial site 1 . For example, when an abnormal temperature occurs, such as a rise in temperature due to overheating of a motor or a pump, a rise in temperature due to a fire, or a drop in temperature due to leakage of cooling water, a facility abnormality event has occurred.
  • the ideal temperature is a temperature out of the normal temperature, and may include a temperature higher than the normal temperature or a temperature lower than the normal temperature.
  • FIG. 2 is a block diagram showing a system 10 that detects and expresses an abnormal temperature at an industrial site using a thermal imaging camera according to an embodiment of the present invention and generates and informs an alarm. See Figures 1 and 2 together.
  • a system 10 for detecting and expressing an abnormal temperature in an industrial site and generating an alarm with a thermal imaging camera according to an embodiment of the present invention, a camera module 100 for generating a thermal image by photographing an industrial site 1 ), and a server 200 that analyzes the thermal image received from the camera module 100 to determine whether an abnormal temperature exists in the facility 2.
  • the camera module 100 may be disposed in the industrial site 1 to photograph a space where facilities 2 or people 3 exist. A plurality of camera modules 100 may be disposed in the industrial site 1 . The camera module 100 may change a photographing direction according to a control signal received from the server 200 . The camera module 100 may include one or more thermal imaging cameras 120 . The camera module 100 may include an optical camera 110 and a thermal imaging camera 120 together in one module.
  • the optical camera 110 may include a general digital camera of the RGB method.
  • the optical camera 110 may generate an optical image recognizable by the eyes of a person 3 by photographing the industrial site 1 in the visible ray region.
  • the infrared camera (IR camera) 120 may include a digital camera that captures an infrared region.
  • the thermal imaging camera 120 may capture the industrial site 1 in the infrared region and generate a grayscale thermal image.
  • Server 200 may be installed in the industrial site (1).
  • the server 200 may be connected to the camera module 100 through a wired or wireless network, receive an image generated by the camera module 100, and control the camera module 100.
  • the server 200 is a computer device having an information processing function.
  • the camera module 100 and the server 200 may be connected through a closed circuit or through an encrypted network using an IP address.
  • the server 200 analyzes the storage unit 210 for storing the optical image and thermal image received from the camera module 100, the thermal image, determines whether a temperature outside the normal temperature is detected, and detects a temperature outside the normal temperature. If the equipment failure event occurs, the equipment failure determination unit 240 outputs the occurrence of the equipment failure event, and when the equipment failure determination unit 240 outputs the occurrence of the equipment failure event, the notification unit 250 notifies the manager of the occurrence of the abnormal event.
  • the server 200 may further include a communication unit 220 connected to a wired or wireless network to transmit and receive data, and an interface unit 230 to receive a manager's command or provide data or information to the manager.
  • the storage unit 210 detects and expresses an abnormal temperature in an industrial field using an optical image, a thermal image, or a thermal image camera according to an embodiment of the present invention, and generates an alarm to inform the operating method of the system 10 implemented in software. stored program code and other necessary data.
  • the storage unit 210 may include a hard disk, a memory, a cloud storage device, a database, and the like.
  • the communication unit 220 may be connected to a wired or wireless network to transmit and receive data between the camera module 100 , the manager terminal 300 , and the server 200 .
  • the communication unit 220 may use known communication methods such as the World Wide Web (www), Ethernet, IPv4, IPv6, LAN, and WAN.
  • the communication unit 220 may use a known short-range communication method such as wi-fi, bluetooth, zigbee, or the like.
  • the interface unit 230 may include input devices such as a keyboard, mouse, touch panel, and switch capable of receiving commands from a manager, and output devices such as a display, speaker, and printer capable of providing information to the manager.
  • input devices such as a keyboard, mouse, touch panel, and switch capable of receiving commands from a manager
  • output devices such as a display, speaker, and printer capable of providing information to the manager.
  • the facility abnormality determining unit 240 and the notifying unit 250 may be written in program codes and implemented in a manner that runs on the processor or graphics processing unit (GPU) of the server 200, or may be implemented within the server 200. It may be implemented as an independent computer device included.
  • GPU graphics processing unit
  • the equipment abnormality determining unit 240 determines whether an abnormal temperature is captured in the thermal image of the industrial site 1 based on the normal temperature.
  • the presence of an abnormal temperature higher or lower than the normal temperature in the thermal image means that there is a problem in the facility (2). For example, if the temperature of the facility 2 rises or falls below the normal temperature, it indicates that there is a possibility of an accident. If a fire or leak occurs due to an accident in the facility 2, a temperature change may occur in an area other than the facility 2, which may indicate the occurrence of an accident.
  • the facility abnormality determination unit 240 may output information about a pixel having an abnormal temperature along with a facility abnormality event.
  • the notification unit 250 When the facility abnormality determining unit 240 outputs the occurrence of a facility abnormality event, the notification unit 250 notifies the manager of the occurrence of the abnormal event and informs the contents of the abnormal event.
  • the contents of the abnormal event include the location of the camera module 100 that captured the abnormal event, the occurrence time of the abnormal event, the frame of the optical image or thermal image in which the abnormal event occurred, guidelines for responding to the abnormal event, and other necessary information. can include
  • the notification unit 250 may automatically transmit a phone call, text message, e-mail, etc. to the administrator terminal 300, display the occurrence of an abnormal event on a display, or notify the occurrence of an abnormal event through a speaker.
  • the notification unit 250 may provide a manager with an image displaying a pixel having an abnormal temperature in a frame of a thermal image in which an abnormal temperature is detected based on information on a pixel having an abnormal temperature. .
  • the notification unit 250 may automatically generate an e-mail including an image in which an abnormal temperature is detected as a highlight or an arrow, and send the e-mail to the administrator's e-mail address.
  • FIGS. 2 and 3A is a flowchart illustrating an operation method of a system that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and generates and informs an alarm. See FIGS. 2 and 3A together.
  • an operating method of a system 10 that detects and expresses an abnormal temperature in an industrial site and generates and informs an alarm with a thermal imaging camera, the optical camera 110 of the camera module 100 (1) is photographed to generate an optical image and transmitted to the server 200, and the thermal image camera 120 of the camera module 100 photographs the industrial site 1 to generate a thermal image and the server 200 image generation step (S21), equipment abnormality determination step (S22) of determining that a facility abnormality event has occurred when the temperature recognized from the thermal image by the equipment abnormality determination unit 240 of the server 200 is out of the normal temperature; and a notification step ( S23 ) in which the notification unit 250 of the server 200 notifies the manager of the occurrence of the abnormal event when the facility abnormality determination unit 240 outputs the occurrence of the facility abnormality event.
  • the image generation step (S21) and facility abnormality determination step (S22) may be included in the monitoring step (S20).
  • the monitoring step (S20) is repeatedly performed in real time while the operating method of the system 10, which detects and expresses the abnormal temperature of the industrial site and generates and informs an alarm with the thermal imaging camera according to an embodiment of the present invention, is performed.
  • the equipment abnormality determination step (S22) may be performed by the equipment abnormality determination unit 240.
  • the notification unit 250 performs a notification step (S23) when an abnormal event is output from the equipment abnormality determination unit 240.
  • the operation method of the system that detects and expresses the abnormal temperature of the industrial site with a thermal imaging camera and generates an alarm to inform the operation method is performed before the image generation step, and the area of the frame, standard deviation, high temperature limit value, low temperature limit value, normal A variable setting step (S10) of setting one or more of the temperature, the judgment reference time, and the steady state adaptation period may be further included.
  • the variable setting step (S10) may be performed by the facility abnormality determination unit 240 before the monitoring step (S20) is performed.
  • the variable setting step (S10) may be performed according to a manager's input or a predetermined algorithm.
  • the variable setting step (S10) may be performed at any moment according to the manager's command.
  • FIG. 3B is a flowchart specifically illustrating a facility abnormality determination step (S22) of a method of operating a system for detecting and expressing an abnormal temperature at an industrial site and generating an alarm to notify an abnormal temperature using a thermal imaging camera according to an embodiment of the present invention.
  • the facility abnormality determination step ( S22 ) may include a temperature calculation step ( S110 ) of converting a gray scale value for each pixel of a thermal image frame into a current temperature. Then, in the equipment abnormality determination step (S22), after the temperature calculation step (S110), if the current time is before the steady state adaptation period, the current temperature is accumulated and stored in the storage unit 210 as the normal temperature, and the accumulated normal temperature
  • a normal temperature generation step (S120) is performed to recognize the temperature of the facility 2 in a normal state, and a body temperature determination step (S130), a limit determination step (S140), and a deviation determination step It is possible to determine whether an abnormal temperature exists by performing (S150) in order. If it is determined that the abnormal temperature exists (S160), the event determination step (S170) is performed, and if it is determined that the abnormal temperature is maintained longer than the determination reference time, it is determined that a facility abnormality event exists (S180), and the equipment abnormality determination unit 240 may output the presence of an abnormal event.
  • the temperature calculation step (S110) will be described with reference to FIGS. 2, 3B and 4.
  • FIG. 4 is a diagram illustrating a process of recognizing the temperature of the system 10, which detects and expresses an abnormal temperature in an industrial site with a thermal imaging camera according to an embodiment of the present invention, and generates and informs an alarm.
  • the thermal imaging camera 120 of the camera module 100 captures the industrial site 1 in the infrared region and generates a thermal image.
  • the generated thermal image is stored in the storage unit 210 of the server 200 .
  • Thermal images are created in grayscale.
  • a frame shown in FIG. 4 is a frame arbitrarily extracted from a thermal image for explanation of an embodiment of the present invention.
  • a frame has a gray scale value for each pixel.
  • the equipment abnormality determination unit 240 performs the equipment abnormality determination step (S22).
  • the facility abnormality determining unit 240 extracts gray scale values for each pixel from the frame of the thermal image to create a gray scale matrix, and matches the minimum and maximum values of the gray scale values of the thermal imaging camera.
  • a gray scale value is converted into a temperature using the minimum temperature and maximum temperature of (120), and the temperature of the pixel is compared with the normal temperature, and if there is a difference of more than a standard deviation, a facility failure event can be output.
  • the equipment abnormality determination unit 240 performs a temperature calculation step (S110).
  • a gray scale matrix is generated by extracting the gray scale value of each pixel of the frame.
  • the number of rows and columns of the grayscale matrix may be determined according to the number of horizontal and vertical pixels of the frame.
  • the grayscale matrix may correspond 1:1 to the frame.
  • the grayscale matrix may be formed in the form of a matrix of (m by n).
  • the grayscale matrix may be stored in the storage unit 210 .
  • the gray scale matrix can represent values from 0 to 255, and can represent white when 0 and black when 255.
  • a maximum measurable temperature (Tmax) and a minimum temperature (Tmin) that can be measured are determined.
  • the thermal imaging camera 120 generates a gray scale thermal image by calculating a gray scale value according to a set ratio of the highest temperature to the lowest temperature. Accordingly, the gray scale value can be converted into an actual temperature according to the ratio of the maximum temperature and the minimum temperature. Converting a gray scale value into a temperature uses Equation 1 below.
  • T i,j (t) current temperature of (i,j) pixel in frame at time t
  • T max maximum temperature set in the thermal imaging camera
  • T min minimum temperature set in the thermal imaging camera
  • G i,j ( t) Grayscale value of pixel (i,j) in the frame at time t. 255: number of lowest and highest grayscale values
  • the temperature calculation step (S110) When the temperature calculation step (S110) is performed, the temperature of each pixel in the thermal image frame at the current time (t) can be calculated.
  • FIG. 5 is a diagram illustrating a process of recognizing a normal temperature by a system 10 that detects and expresses an abnormal temperature in an industrial site using a thermal imaging camera according to an embodiment of the present invention and issues an alarm. 3B and 5 are also referred to.
  • the facility abnormality determination step (S22) of the operating method of the system for detecting and expressing the abnormal temperature of the industrial site and generating an alarm to notify the abnormal temperature of the industrial site with a thermal imaging camera is after the temperature calculation step (S110), the current
  • a normal temperature generating step (S120) of accumulating and storing the current temperature as the normal temperature in the storage unit and calculating the normal temperature by averaging the accumulated normal temperatures may be further included.
  • the normal temperature generating step (S120) is a process of generating a normal temperature by collecting and averaging temperatures in a steady state.
  • the normal temperature may be determined as an average of temperatures collected during the steady-state adaptation period for each pixel.
  • the normal temperature may be set as a range.
  • the steady-state adaptation period is a period for accumulating steady-state temperature data.
  • the steady-state adaptation period may be determined by time or the number of frames.
  • a step of comparing the current time (t) of the thermal image frame and the steady-state adaptation period (t set ) (S121) is performed. If the current time (t) exceeds the steady-state adaptation period (t set ) (Y1), since the period of obtaining the normal temperature has already passed, the body temperature determination step (S130), the limit determination step (S140), and the deviation determination step (S150) one of them can be done. If the current time (t) of the thermal image frame does not exceed the steady state adaptation period (t set ) (N1), it corresponds to the period for accumulating the temperature in the steady state.
  • a steady-state temperature accumulation step (S122) of storing the temperature of each pixel generated in the temperature calculation step (S110) in the storage unit 210 as a steady-state temperature is performed.
  • the steady-state temperature is calculated by averaging the accumulated steady-state temperatures.
  • the steady state temperature can be obtained by averaging the temperature of each pixel during the steady state adaptation period in the thermal image generated by photographing the industrial site 1 in the steady state.
  • the process of calculating the steady-state temperature by accumulating and averaging the steady-state temperatures may be repeated.
  • the deviation determination step (S150) may be performed using the finally calculated normal temperature.
  • the facility abnormality determining unit 240 may obtain a plurality of frames according to time t from the thermal image and average the temperature of each pixel of the frame to generate an average temperature matrix.
  • the normal temperature of pixel 1 (P2) can be obtained by obtaining and averaging the temperatures of six pixels 1 (P1) in six frames from Frame 1 to Frame 6, and In this way, the normal temperatures of the pixels 2 (P2) and 3 (P3) can be obtained.
  • the normal temperature for each pixel can be calculated using Equation 2 below.
  • Ta i,j (t) average temperature of (i,j) pixel in frame during steady-state adaptation period
  • T i,j (x) temperature of (i,j) pixel in frame at time x
  • t set Steady-state adaptation period
  • Normal temperatures can be stored in the form of an average temperature matrix.
  • the facility abnormality determination unit 240 may obtain a normal temperature for each pixel and generate a normal temperature matrix.
  • the normal temperature matrix may vary depending on the industrial site, the work environment, and the stage of the work process.
  • the body temperature determination step (S130) may be performed.
  • the body temperature determination step (S130) it is determined whether the temperature of the pixel is out of the body temperature range by comparing the temperature of the pixel with the range of the body temperature. If the temperature of the pixel does not deviate from the body temperature range (N2), it is not determined that an abnormal temperature has occurred. When the temperature of the pixel is out of the body temperature range (Y2), a limit determination step (S140) or a deviation determination step (S150) may be performed. If the current temperature is out of the body temperature range, another judgment step is performed to determine whether an abnormality has occurred in the facility 2.
  • the limit determination step (S140) can be performed. .
  • the facility abnormality determination unit 240 determines that an abnormal temperature exists (S160) when the current temperature of any pixel is not included between the low temperature limit value and the high temperature limit value (N3).
  • the high temperature threshold is a reference value for detecting a temperature higher than a predetermined temperature. When the current temperature of an arbitrary pixel exceeds the high temperature threshold (N3), it may be determined that an abnormal temperature has occurred.
  • the low temperature threshold is a reference value for detecting a temperature below a predetermined temperature. When the current temperature of an arbitrary pixel is less than the low temperature threshold (N3), it may be determined that an abnormal temperature has occurred. If the current temperature of any pixel is equal to or higher than the low temperature threshold and equal to or lower than the high temperature threshold (Y3), since the temperature is not excessively low or high, a deviation determination step (S150) is performed to determine whether an abnormal temperature exists.
  • FIG. 6 is a diagram illustrating a process of comparing a normal temperature and a current temperature in a system 10 that detects and expresses an abnormal temperature in an industrial field and issues an alarm using a thermal imaging camera according to an embodiment of the present invention.
  • the deviation calculation step of calculating the deviation between the normal temperature and the current temperature, and comparing the calculated deviation with the standard deviation, and when the calculated deviation is greater than the standard deviation (Y4), it is determined that an abnormal temperature exists. and a comparison step of determining that no abnormal temperature exists when the calculated deviation is smaller than the standard deviation (N4).
  • the standard deviation is a reference value of a temperature deviation for detecting an abnormal temperature.
  • the normal temperature is a value determined by the equipment abnormality determining unit 240 and stored in the storage unit 210 . As described with reference to FIG. 5 , it is possible to generate a normal temperature matrix (also referred to as an average temperature matrix in this specification) by averaging the temperature of each pixel in a plurality of frames.
  • a normal temperature matrix also referred to as an average temperature matrix in this specification
  • the facility abnormality determination unit 240 compares the current temperature and normal temperature values of the corresponding frame for each pixel of the frame of the thermal image generated in real time. At this time, the temperature difference between the normal temperature and the current temperature is calculated. When the temperature deviation obtained by comparing the temperature of a certain pixel with the normal temperature is greater than the reference deviation, it can be determined that an abnormal temperature has occurred. In other words, a temperature matrix is generated for each frame of a thermal image generated in real time, and the temperature matrix is compared with a normal temperature matrix (average temperature matrix), and a pixel having a temperature deviation greater than or equal to a standard deviation is determined to have an abnormal temperature.
  • the temperature deviation for each pixel can be calculated using Equation 3 below.
  • Ta i,j (t) Average temperature of (i,j) pixels in a frame during the steady-state adaptation period
  • the facility abnormality determining unit 240 may apply different normal temperatures depending on the operating state of the facility 2 in the facility abnormality determining step (S22).
  • the operating state of the facility 2 may vary depending on the stage of the process.
  • the normal temperature is a high temperature
  • the room temperature of the industrial site 1 may be the normal temperature.
  • the facility abnormality determination unit 240 may recognize a plurality of normal temperatures for each operating state of the facility 2 based on information about the operating state of the facility 2 and store them in the storage unit 210 . And, when the facility 2 enters a predetermined operating state, the equipment abnormality determination unit 240 may determine whether the facility 2 has an abnormal temperature according to the normal temperature of the entered operating state.
  • an abnormal temperature exists through the body temperature determination step (S130), limit determination step (S140), and deviation determination step (S150) (S160), it is determined that an abnormal temperature exists in the frame of the current time (t) will be. Abnormal temperatures may appear temporarily in thermal images due to various causes. It is preferable to determine that an abnormality has occurred in the facility 2 when the occurrence of an abnormal temperature is maintained for a meaningful period of time. Therefore, an event determination step (S170) for determining how long the abnormal temperature lasts is performed.
  • the equipment abnormality determination unit 240 determines whether abnormal temperature has occurred for each set frame or for each set time. It can be output (S180).
  • the judgment reference time is the time for which the temperature should be maintained in order to be judged as an abnormal temperature.
  • the facility abnormality determining unit 240 checks whether the timer is activated (S171), and activates the timer when the timer is in an inactive state (N5) (S172). ).
  • the timer counter is increased by 1 (S173).
  • the timer is activated (S172), a value of 1 is given to the timer counter.
  • the counter continues to increase (173). After incrementing the counter, it is determined whether the counter value has reached the reference time (S174). When the counter value reaches the judgment standard time (Y6), since the abnormal temperature has been maintained for a predetermined time, the equipment abnormality determination unit 240 outputs a facility abnormality event. If the counter value does not reach the judgment standard time (N6), since the abnormal temperature has not been maintained for a set time, it is determined whether there is an abnormal temperature in the next frame.
  • the timer is initialized (S175).
  • the facility abnormality determining unit 240 may repeatedly output a facility abnormal event if the abnormal temperature is continuously maintained for longer than a predetermined determination reference time even after outputting the equipment abnormal event once. If a facility failure event is repeatedly output, the notification unit 250 may repeatedly transmit a notification.
  • the equipment abnormality determination unit 240 divides the frame into one or more zones, and may differently set a standard deviation, a high temperature limit value, a low temperature limit value, a normal temperature, a judgment reference time, and a steady state adaptation period for each zone.
  • the facility abnormality determination unit 240 may divide zones in the frame. For example, 4 zones can be set by dividing the frame into 4 equal parts. Alternatively, nine zones can be set by equally dividing the frame into nine equal parts. Alternatively, a plurality of zones may be set by dividing an area where the first facility is photographed and an area where the second facility is photographed in the frame. A number may be assigned to each zone in a plurality of zones.
  • the facility abnormality determination unit 240 may set the standard deviation, high temperature threshold value, low temperature threshold value, normal temperature, determination reference time, and steady state adaptation period differently for each zone.
  • the high temperature threshold and the low temperature threshold of the first zone may be set higher than those of the second zone.
  • the standard deviation of the third zone may be set larger than that of the fourth zone.
  • Zone setting, standard deviation, high temperature threshold, low temperature threshold, normal temperature setting, determination reference time, and steady state adaptation period may be set differently for each camera module.
  • Various facilities 2 may be installed in the industrial site 1, and the normal temperature may be different for each facility 2. Therefore, appropriate monitoring can be performed according to the industrial site (1) by setting the zone and setting the standard deviation, high temperature threshold value, low temperature threshold value, normal temperature, judgment standard time, and steady state adaptation period differently for each zone.
  • FIG. 7 is a diagram illustrating an alarm generated by displaying an area where an abnormal temperature occurs in a system 10 that detects and expresses an abnormal temperature at an industrial site and generates and informs an alarm using a thermal imaging camera according to an embodiment of the present invention.
  • the equipment abnormality determining unit 240 When an abnormal temperature occurs in the thermal image, the equipment abnormality determining unit 240 outputs an equipment abnormality event, and the alarm unit notifies the manager of the occurrence of abnormal temperature based on the equipment abnormality event.
  • the notification unit 250 When a facility abnormality event is output, the notification unit 250 outputs the coordinates of the pixel where the abnormal temperature occurred, the number of the zone including the pixel where the abnormal temperature occurred, the frame where the abnormal temperature occurred, the time of the frame, and the camera that captured the abnormal temperature.
  • Information related to a facility abnormality event such as the location of the module 100 and the optical image taken by the optical camera 110 of the camera module 100 that captured the abnormal temperature, at the same time frame, etc., can be collected, processed, and provided to the manager. .
  • the notification unit 250 displays the position of the pixel where the abnormal temperature occurred in a first color in a frame, and mails the coordinates of the pixel where the abnormal temperature occurred and the coordinates of the industrial site 1 corresponding to the pixel where the abnormal temperature occurred. can be automatically generated and provided to the administrator.
  • the storage unit 210 stores information capable of matching the position of the industrial site 1 and the coordinates of the frame of the image captured by the camera module 100 according to the direction in which the camera module 100 captures.
  • the notification unit 250 calculates the actual coordinates of the industrial site 1 corresponding to the frame based on the position of the camera module 100 where the abnormal temperature occurred, the direction of the camera module 100, and the pixel coordinates where the abnormal temperature occurred. can do.
  • the first color indicating the position of the pixel where the abnormal temperature has occurred may use chromatic color instead of gray scale. For example, when a high temperature abnormality occurs, red color may be used, and when a low temperature abnormal temperature occurs, blue color may be used. Alternatively, an arrow may be displayed at a corresponding position in the gray scale frame, or an area where an abnormal temperature occurs may be displayed by hatching. An achromatic or chromatic box may be displayed centered on the part where the abnormal temperature occurs.
  • the manager can easily recognize the location where the abnormality occurred in the industrial site 1, and can immediately take necessary measures.
  • FIG. 8 is a diagram illustrating a thermal image frame and an optical frame in which an abnormal temperature is generated, which are provided to a manager by the notification unit 250.
  • the notification unit 250 extracts an image in which the color of a pixel determined to be out of the normal temperature in the frame of the thermal image is displayed as a first color and an optical image image taken in the same direction as the frame of the thermal image from the optical image, and manages them together. can be provided to
  • a frame of a thermal image is a gray scale image, and is an image whose gray scale value varies according to temperature. Therefore, since the image is generated by the temperature regardless of the shape of the object, it may be difficult for a manager to immediately recognize the corresponding location of the industrial site 1 by looking at only the gray-scale image.
  • the notification unit 250 displays pixels in the thermal image frame where the abnormal temperature occurs in a first color, arrows, circles, etc., and displays pixels in the optical image frame where the abnormal temperature occurs in the same direction at the same time. It may be displayed in a first color, an arrow, a circle, or the like, and provided to a manager. The administrator can easily recognize the point where the abnormal temperature occurs by checking the optical image frame and the thermal image frame together.
  • the first color may be a chromatic color.
  • FIG. 9 is a diagram showing the structure of mail used by the notification unit 250. Referring to FIG.
  • a facility abnormality event is transmitted via e-mail, information on the area where the abnormal temperature occurs is included in the body of the e-mail, and an image displaying pixels where the abnormal temperature occurs is included in the frame image of the thermal image.
  • a message structure provided using e-mail may be composed of a mail header (Mail Header, 910) and a mail body (Mail Body, 920).
  • the mail header 910 includes a sender mail address (911), a receiver mail address (912), a camera IP address (913), an event flag (914), a port ( Port, 915) and timestamp (Timestamp, 916).
  • the sender mail address 911 and the receiver mail address 912 indicate the mail addresses of the sender and receiver of the alarm alarm mail, respectively, and the camera IP address 913 is the camera 100 that detects the abnormal temperature change corresponding to the alarm.
  • the event flag 914 may be used to indicate the cause of the abnormal temperature change, such as the occurrence of a facility abnormality event, exceeding a temperature deviation, high temperature or low temperature.
  • a port 915 represents a port number of an e-mail transmission channel, and a timestamp 916 represents a time when a corresponding alert occurred.
  • the mail body 920 includes a mail title (Title, 921), sector information (Sector Information, 922), and image (Image, 923).
  • the mail title 921 indicates the title of the abnormal temperature change alert mail
  • the zone information 922 indicates the zone where the abnormal temperature change is detected in the frame of the camera
  • the image 923 shows the abnormal temperature change detected in the thermal image frame. It may include an image displaying a designated area, pixel, coordinates, etc., and an optical image taken in the same direction.

Landscapes

  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Emergency Management (AREA)
  • Engineering & Computer Science (AREA)
  • Tourism & Hospitality (AREA)
  • Multimedia (AREA)
  • Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Educational Administration (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Development Economics (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Emergency Alarm Devices (AREA)

Abstract

La présente invention concerne, selon un mode de réalisation de la présente invention, un système pour détecter et exprimer une température anormale au niveau d'un site industriel à l'aide d'un appareil de prise de vues d'imagerie thermique et générer une alarme pour informer celui-ci, et un procédé de fonctionnement de celui-ci, le système comprenant : un module d'appareil de prise de vues qui crée une image thermique par photographie d'un site industriel ; et un serveur qui analyse l'image thermique reçue en provenance du module d'appareil de prise de vues et détermine si une température anormale existe dans l'installation, si une température anormale apparaît dans l'image thermique, elle notifie un gestionnaire d'un événement d'installation anormal, de telle sorte qu'un accident peut être empêché à l'avance ou un accident peut être traité rapidement.
PCT/KR2021/017279 2021-10-29 2021-11-23 Système pour détecter et exprimer une température anormale au niveau d'un site industriel à l'aide d'un appareil de prise de vues d'imagerie thermique et générer une alarme pour informer celui-ci, et son procédé de fonctionnement Ceased WO2023074995A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020210147174A KR102650169B1 (ko) 2021-10-29 2021-10-29 열화상 카메라로 산업현장의 이상 온도를 감지 및 표현하고 경보를 발생시켜 알리는 시스템 및 이의 동작 방법
KR10-2021-0147174 2021-10-29

Publications (1)

Publication Number Publication Date
WO2023074995A1 true WO2023074995A1 (fr) 2023-05-04

Family

ID=86160038

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/017279 Ceased WO2023074995A1 (fr) 2021-10-29 2021-11-23 Système pour détecter et exprimer une température anormale au niveau d'un site industriel à l'aide d'un appareil de prise de vues d'imagerie thermique et générer une alarme pour informer celui-ci, et son procédé de fonctionnement

Country Status (2)

Country Link
KR (1) KR102650169B1 (fr)
WO (1) WO2023074995A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118274977A (zh) * 2024-05-31 2024-07-02 成都格理特电子技术有限公司 一种基于视频分析异常温度检测预警方法及系统、介质
CN118609296A (zh) * 2024-06-26 2024-09-06 海南大学 地下管廊仓段火灾预警分析方法及系统
CN118654766A (zh) * 2024-08-20 2024-09-17 宁波欧熠乐科技有限公司 一种智能监测低温储罐温度异常的方法
CN119007126A (zh) * 2024-10-25 2024-11-22 江阴市洪腾机械有限公司 一种基于图像处理的液压穿轴器运行状态监测方法
CN119197777A (zh) * 2024-09-20 2024-12-27 广州市星飞达电子科技有限公司 一种基于红外温度分布技术的工业设备运行监测预警系统

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102737345B1 (ko) * 2024-02-07 2024-12-03 주식회사 한국몰드 열화상 이미지 변환 방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100844961B1 (ko) * 2006-11-14 2008-07-09 주식회사 케이디파워 열화상 패턴 인식을 이용한 전기설비 자동 감시 진단 방법및 시스템
KR101417765B1 (ko) * 2014-02-07 2014-07-14 (주)지디일렉스 2차원 서모파일 어레이 적외선 열화상을 이용한 수배전반의 설비 영역별 열화 진단 시스템 및 그 방법
KR101570640B1 (ko) * 2015-02-03 2015-11-20 주식회사 주왕산업 열화상 카메라를 이용한 고압배전반, 저압배전반, 분전반, 모터제어반의 원격 감시 시스템
KR20160141273A (ko) * 2015-05-29 2016-12-08 주식회사 효성 원격 열화상 모니터링 시스템 및 방법
KR20210063715A (ko) * 2019-11-25 2021-06-02 세메스 주식회사 물류 저장 장치의 온도 모니터링 시스템 및 방법

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104040311B (zh) * 2011-12-21 2017-06-06 意大利电信股份公司 用于房间内温度监视的系统及方法
KR20150050752A (ko) 2013-10-31 2015-05-11 한국기계연구원 열화상 카메라를 갖는 현장 감시 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100844961B1 (ko) * 2006-11-14 2008-07-09 주식회사 케이디파워 열화상 패턴 인식을 이용한 전기설비 자동 감시 진단 방법및 시스템
KR101417765B1 (ko) * 2014-02-07 2014-07-14 (주)지디일렉스 2차원 서모파일 어레이 적외선 열화상을 이용한 수배전반의 설비 영역별 열화 진단 시스템 및 그 방법
KR101570640B1 (ko) * 2015-02-03 2015-11-20 주식회사 주왕산업 열화상 카메라를 이용한 고압배전반, 저압배전반, 분전반, 모터제어반의 원격 감시 시스템
KR20160141273A (ko) * 2015-05-29 2016-12-08 주식회사 효성 원격 열화상 모니터링 시스템 및 방법
KR20210063715A (ko) * 2019-11-25 2021-06-02 세메스 주식회사 물류 저장 장치의 온도 모니터링 시스템 및 방법

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118274977A (zh) * 2024-05-31 2024-07-02 成都格理特电子技术有限公司 一种基于视频分析异常温度检测预警方法及系统、介质
CN118609296A (zh) * 2024-06-26 2024-09-06 海南大学 地下管廊仓段火灾预警分析方法及系统
CN118654766A (zh) * 2024-08-20 2024-09-17 宁波欧熠乐科技有限公司 一种智能监测低温储罐温度异常的方法
CN119197777A (zh) * 2024-09-20 2024-12-27 广州市星飞达电子科技有限公司 一种基于红外温度分布技术的工业设备运行监测预警系统
CN119007126A (zh) * 2024-10-25 2024-11-22 江阴市洪腾机械有限公司 一种基于图像处理的液压穿轴器运行状态监测方法

Also Published As

Publication number Publication date
KR102650169B1 (ko) 2024-03-22
KR20230062176A (ko) 2023-05-09

Similar Documents

Publication Publication Date Title
WO2023074995A1 (fr) Système pour détecter et exprimer une température anormale au niveau d'un site industriel à l'aide d'un appareil de prise de vues d'imagerie thermique et générer une alarme pour informer celui-ci, et son procédé de fonctionnement
WO2020235819A1 (fr) Procédé de détection d'intrusion en temps réel à base d'image et caméra de surveillance utilisant une intelligence artificielle
KR102233679B1 (ko) Ess 침입자 및 화재 감지 장치 및 방법
WO2022071760A1 (fr) Procédé de protection incendie et système de protection incendie
WO2018135906A1 (fr) Caméra et procédé de traitement d'image d'une caméra
WO2012064115A9 (fr) Système de surveillance d'incendie en temps réel utilisant une caméra de télévision en circuit fermé, et procédé correspondant
WO2012046899A1 (fr) Dispositif de surveillance d'image et procédé pour détecter des événements en rapport avec le dispositif
WO2014061964A1 (fr) Procédé et appareil de détection d'incendie
WO2022071756A1 (fr) Procédé de protection incendie et système de protection incendie
WO2015190744A1 (fr) Dispositif d'imagerie thermique et système de détection d'intrusion l'utilisant
WO2012124852A1 (fr) Dispositif de caméra stéréo capable de suivre le trajet d'un objet dans une zone surveillée, et système de surveillance et procédé l'utilisant
WO2016099084A1 (fr) Système de fourniture de service de sécurité et procédé utilisant un signal de balise
WO2021261656A1 (fr) Appareil et système de fourniture d'un service de surveillance de sécurité sur la base de l'informatique en périphérie de réseau, et son procédé de fonctionnement
WO2022102812A1 (fr) Système de prévention d'incendie ess et procédé associé
WO2023210839A1 (fr) Appareil d'analyse d'image utilisant une caméra multiple et une caméra mobile
WO2025042041A1 (fr) Système de commande de lutte contre l'incendie à distance
WO2017090892A1 (fr) Caméra de génération d'informations d'affichage à l'écran, terminal de synthèse d'informations d'affichage à l'écran (20) et système de partage d'informations d'affichage à l'écran le comprenant
WO2024090880A1 (fr) Système et procédé de prévention d'incendie à l'aide d'une caméra d'imagerie thermique
GB2535728A (en) Information system and method
WO2024219741A1 (fr) Système et procédé de reconnaissance d'objet dangereux au niveau d'un chantier à l'aide d'un robot ia
WO2018097384A1 (fr) Appareil et procédé de notification de fréquentation
WO2012050244A1 (fr) Dispositif de surveillance d'image et son procédé de recherche d'objets
WO2020111353A1 (fr) Procédé et appareil pour détecter un équipement d'invasion de confidentialité et système associé
WO2023074994A1 (fr) Système d'appareil de prise de vues de surveillance de détection d'évanouissement au niveau d'un site industriel, et son procédé de fonctionnement
CN115601797A (zh) 一种智能设备监控方法、装置、智能设备和存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21962618

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21962618

Country of ref document: EP

Kind code of ref document: A1