WO2025243065A1 - Smart helmet for monitoring industrial environment - Google Patents

Abstract

The Invention of system and structure of online monitoring, espying and communication using mechanism of smart helmet of safety officer relates to systems of monitoring and espying for risks, compliance or non-compliance with safety principles, environmental conditions. This invention is specifically for the use of the safety officer, which is equipped with image processing algorithms and artificial intelligence and all kinds of electronic and communication equipment to identify unsafe and unusual cases in industrial environments. In particular, this invention contains a smart helmet as well as a safety belt. According to this invention the safety officer can check the conditions of the environment, people and equipment, and detect the things that endanger the safety of people and the site or abnormal conditions that occur in the work environment and give the necessary warnings to the person using the helmet.

Description

SMART HELMET FOR MONITORING INDUSTRIAL ENVIRONMENT

TECHNICAL FIELD OF THE INVENTION

The present invention relates to systems of monitoring and espying for risks, compliance or non compliance with safety principles, environmental conditions and wok problems and it is related to the system and method for the integrated monitoring of the work environment by the safety officer using artificial intelligence and the devices on the helmet and it is also related to the structure and display system of processed information on the helmet, and it is also related to the connection of the tools defined on the helmet, and it is also related to the system equipped with intelligent software to manage the workplace and environmental safety system. And the organization also relates to a smart helmet equipped with advanced electronic and communication equipment that can be used specifically for a safety officer.

PRIOR ARTS

In the industrial environments, environments under construction, disaster sites and many other situations using the personal protective equipment such as helmet, gloves and etc. is essential and very important. In many of these cases, it is necessary to use a helmet to protect the head and face from falling objects and unexpected events. Today by improvement of technology, the helmet can have more applications and in most cases can help the user to perform tasks. Given to the large number of individuals and equipments, complexity and extent of industrial sites like pertrochemistry and refinery, the responsibility to monitor these sites is very difficult and has many challenges and problems and using the novel and smart methods of monitoring, can help improving the safety and preventing from happening disasters. The safety officer, as one of the organizational people in the workshop and industrial structures, is always obliged to check the compliance of the existing protocols and procedures by the executive staff and match the compatibility of the performance of people, machines or equipment in the site or factory with the predefined definitions. Therefore, human error in the performance process of the safety officer can always cause executive errors or the occurrence of risks due to non-compliance with the rules. In this sense, the use of systems that increase accuracy or reduce the time required to check the mentioned cases can be Increase the efficiency of the safety officer. So different designs and inventions are done in this field which can mention to the below cases.

In an Japanese invention with publication number JP2019073810A which is filed dated 12/10/2017 titled “helmet” provide a helmet capable of accurately determining a physical condition of a wearer, while extending the time for detecting wearer's biological information. A helmet 1 includes: a first sensor 20 that detects biological information of a wearer 100; a second sensor 30 that detects environmental information around the wearer 100; and a control unit 10 that acquires the biological information and the environmental information from the first sensor 20 and the second sensor 30, respectively. The control unit 10 determines a cycle in which at least one of the first sensor 20 and the second sensor 30 performs detection, based on the biological information and the environmental information. In a Korean Invention with patent number KR101050710B1 which was granted dated 20/07/2011 titled “Smart helmet for fireman” is a smart wear for firefighting work is provided to control field work smoothly and to deal with emergency situations quickly with instructions of the center. A helmet body is worn to protect a head and a face of an operator. A camera part includes a first camera filming the front of the operator and a second camera filming the rearward of the operator, and creates video information by filming the operator or surroundings of the operator. A sound input part creates sound information with inputted operator voice or sound of the operator surroundings. A first control module transmits the video information and the sound information to a central control center through a smart belt, and receives predetermined control signals for safety of operators from the central control center. An image input and output section is installed in one side of a visor bottom plane of the helmet body, and indicates the information processed at a smart wear or the control signals received from the central control center according to a control of a control module.

In another Korean invention with patent number KR101270132B1 which was granted dated 31/005/2013 titled “Smart helmet device and its operating methods” provides a helmet worn by a worker at an industrial site or a disaster site, the helmet provided with a removable airbag at a predetermined position; A smart module provided in the helmet and wirelessly transmitting the photographed and detected situation information to a central control center by photographing the surrounding situation of the worker or by detecting by predetermined sensors; An airbag control module controlling an airbag operated by an operator's operation in an emergency; And a central control center that receives the information of the smart module through a network module and infers the industrial site situation and the worker's surrounding safety situation based on the received information and instructs the corresponding helmet to a control signal according to the result of the inference.

Also another Korean invention with patent number KR101340008B1 which was granted dated 10/12/2013 titled “Removable Smart Module for Helmet” relates to equipment or equipment worn by workers in an industrial site or a disaster site, and more particularly, to a smart module detachable to a helmet equipped with advanced electronic equipment and communication functions. In the smart module that can be detachable to the front of the helmet worn by the worker in the industrial site or disaster site, to take the situation around the worker or to detect as a predetermined sensor and wirelessly transmit the detected information to the central control center, a camera unit for photographing the surroundings of the worker; a light source unit shining around a worker; Sensing unit for detecting the temperature, illuminance, humidity, gas, position, impact of the surroundings of the worker or the inclination of the helmet worn by the worker; Collecting device unit for collecting information transmitted from the helmet; a database unit for storing information transmitted from the network module; a monitoring unit for monitoring information stored in the database unit; In addition, the present invention is equipped with a radio and a mobile terminal, and a camera, a battery, various sensors for communication with the remote workers (or central control center a) in the helmet a worn by the worker, the industrial site.

And another Korean invention with patent number KR101581353B1 which was granted dated 11/01/2016 titled “Safety helmet” relates to a safety helmet, wherein the safety helmet, which is worn on a user in an industrial site or a disaster site, senses a working environment of the user and displays the environment to the user in real time, and when a danger is sensed, the safety helmet apprises the danger of an external administrator through intercommunication, thereby transmitting, to an external administrator, the location, environment, and health state of the user. In the present invention, provide is a safety helmet, which is worn to protect the head of a user in an industrial site or a disaster site, and comprises an air suction port formed in one surface of the front side and a transmissive goggle part at the front side facing both eyes of the user, wherein a first sensor module is installed inside the suction port of the safety helmet and senses the temperature, brightness, humidity, gas, and shock around the user to generate a sensing signal; a signal processing module and a control module are installed inside the rear side of the helmet, wherein the signal processing module receives a measurement signal sensed by the first sensor module, amplifies and filters the measurement signal, and then converts the measurement signal into digital data, and the control module receives the measurement data through the signal processing module, displays the measurement data based on previously stored data display algorithm and analysis algorithm, and controls alarm and display through comparative analysis; a display part is provided on the goggle part, wherein the display part displays the measurement data and analysis data of the surrounding environment, which are analyzed by the control module such that the user can see the measurement data and the analysis data; an alarm part is installed outside of the helmet, wherein the alarm part receives signals from a controller to apprise the signals of the user through voice; and a power unit, for supplying necessary power to the first sensor module, the control module, the display part, and the alarm part, is installed

In another Korean invention with patent number KR101951119B1 which was granted dated 21/02/2019 titled “Danger warning apparatus of construction site” relates to a danger notifying apparatus of a construction site comprising: a danger warning unit including a chamber which is detachably installed near a structure of a dangerous area of a construction site or on construction equipment and can adjust a direction to change an installed position, and a first controller to transmit a danger signal directly to a worker of the construction site in a preset distance and direction to propagate the danger signal to the worker (hereafter, the corresponding worker) and other workers farther than the corresponding worker; and a personal terminal unit including a casing detachably attached to safety helmets, X-shaped bands, wrist bands, or working clothes of the corresponding worker and the other workers, and a second controller to receive signals including the danger signal from the danger warning unit to notify the corresponding worker and the other workers of a danger by a sound, vibration, or a signal of a different form preset for each stage or each situation. The danger notifying apparatus is mounted on a place of a construction site where a danger can occur and safety gear, safety helmets, and clothes of workers to prevent accidents and analyze danger occurrence prediction.

Also another Korean invention with patent number KR102140830B1 which was granted dated 04/08/2020 titled “System for monitoring a emergent situation using a working schedule and a smart helmet and the method thereof’ is a dangerous situation monitoring system using a work schedule and a smart helmet, which comprises: a helmet protecting the head of a worker from dangerous situations; a smart device carried by the worker, connected by communication with the helmet, and analyzing whether a dangerous situation has occurred in the worker; and a control server collecting and managing danger detection situations analyzed from the smart device. A work time generation module for generating work time information of each worker by checking work schedule information of each worker in the field in the work schedule information DB; a first-stage risk situation determination module that determines that a first- stage risk situation has occurred to a corresponding worker when a motion detection signal is not detected from a motion detection sensor of a corresponding worker for a predetermined time or more during the working time of each worker generated in the working time generation module; a risk situation question voice signal generating module generating a risk situation question for asking whether the risk situation actually occurred to the worker when it is determined from the first step risk situation determination module that the first phase risk situation has occurred to the worker; If the answer to the danger situation is not recognized by the operator through the voice recognition sensor within a predetermined time after the danger situation question delivery module delivers the danger situation question to the helmet, the second stage danger situation is judged to have occurred to the worker.

In another Korean invention with patent number KR102294266B1 which was granted dated 27/08/2021 titled “Intelligent safety helmet user safety protection and assistance device in the industrial field through edge-based hard hat Al platform module” relates to an industrial field intelligent safety helmet user safety protection/helper device through an edge -based safety helmet Al platform module which is composed of a safety helmet main body, a three selection communication module, a cap type live speaker part, a mask type automatic face shield (mask face shield: MFS) module, an air flow generation module, a smart sensor module, a battery module, and an edge-based safety helmet Al platform module. According to the present invention, communication sensitivity and data communication speed can be improved regardless of place, safety helmet users can be rapidly escaped and rescued, shielding and sealing can be improved, and a death rate due to industrial field accidents can be lowered, the user's body temperature, blood pressure, oxygen concentration, harmful gas, industrial site surrounding image By generating industrial site safety management data related to industrial site safety management data, one-to-one customized safety helmet user safety protection to users according to industrial site safety management data. Another Korean invention with patent number KR20100074574 A which was granted dated 23/03/2012 titled “Helmet kit for risk dector” a helmet kit for detecting danger is provided, which can be installed in a safety helmet and is easy to bed attached and detached. CONSTITUTION: A helmet kit for detecting danger comprises: a body equipped with a chamber; first and second cylinders which are installed in both ends of the chamber; first and second cylinder heads which partition the space within the chamber into a fixing unit and two variable parts; a micro channel communicating with two variable parts; and a switch projection for fixing the second cylinder. If one side of the variable part is swelled by the piston motion of the second cylinder, the space of the other side of variable part is shrunk, the fluid moves to one side of the variable part, the first cylinder of the other side is moved, and an adsorption plate is fixed to the helmet. Side variable portion is expanded by the piston movement of the second cylinder, the fluid is moved to the one side variable while the space of the other variable portion is contracted, and at the same time the first cylinder of the other side is moved so that the suction plate is fixed to the helmet Hazard detection helmet kit. This invention is a risk detection helmet kit, characterized in that it comprises a plurality of bridge mounts extending to the upper side of the helmet. This invention has a risk detection helmet kit, characterized in that the internal space is partitioned to facilitate the mounting of a plurality of sensors.

Another Korean invention with publication number KR20170018747 A which was filed dated 10/08/2015 titled “Smart Helmet, Worker Safety Management System Using the Same” provides a smart helmet and an operator safety management system using the smart helmet. This allows the management center to monitor the work situation in real time by sharing the on-site information between the worker on the job site and the manager and the worker, thereby effectively managing and controlling the work site in a large number of workers and a wide work space. The present invention can prevent a safety accident by providing the manager with biometric information of the worker and providing the worker with information on the risk factors at the worksite. A bio-signal collector for collecting bio-signals of a worker and determining a safety state of the worker; a general wireless communication unit for transmitting or receiving the biometric information of the worker collected by the bio-signal collecting unit to the smart device via a wireless link, and an LED-based visible light communication unit for collecting the position information of the worker and transmitting the information to the smart device Wireless telecommunication.

And in another Korean invention with patent number KR20190040605 A which was granted dated 01/06/2020 titled “LPWA network based worker hazard detection system” relates to a low power wide area (LPWA) network-based worker hazard detection system capable of sending a relief signal to a control server through the LPWA network so that the worker can be aware of a situation when it is determined that a hazard situation is likely to occur or an occurrence possibility of the hazard situation is high by using various sensors that can measure environmental factors around the worker, and an LPWA network, and sending a request signal to the control server to prevent accidents or to take prompt action if necessary.

Also another Korean invention with patent number KR20200135039A which was granted dated 12/01/2021 titled “A head mounted display apparatus having an emergency situation sharing function in an emergency” relates to a head-mounted display device having an emergency situation sharing function in an emergency situation. According to the present invention, the head-mounted display device having the emergency situation sharing function in the emergency situation comprises: an HMD frame for which a user can wear on his/her head; an optical system; a display; an environment sensor unit installed on one side of the HMD frame; and a control unit. According to the present invention, an emergency situation can be quickly shared. An environmental sensor unit installed on one side of the HMD frame and configured to detect information on environmentally harmful gases generated at a hazardous work site Includes a control unit for generating emergency event image information including AR risk indication information to be transmitted to the display so that the currently working user can recognize the danger based on the environmental harmful gas information detected by the environmental sensor unit. This invention includes a control unit for generating emergency event image information including AR risk indication information to be transmitted to the display so that the currently working user can recognize the danger.

In an American invention with patent number US6798392B2 which was granted dated 28/09/2004 titled “Smart helmet” provides a smart helmet included integrated electronics providing safety and convenience features. Helmet features includes a global locating system, an environmental interaction sensor, a mobile communications network device, a small display panel, a microphone and at least one speaker. The helmet is aware of the user's location and interactions with the environment. The helmet can provide data to a user, monitor the user's actions and condition, and send information to others about user's location and condition. The module further includes an environmental interaction sensor, global locating system, a mobile communications network, a small display panel, a microphone and speakers. The environmental interaction sensor is preferably an accelerometer or gyroscope. The global locating system is a global positioning system (GPS). The mobile communications is a cellular phone, and the small display panel is a LCD dot-matrix screen which allows the user to interact with the device using a touch screen.

In another American invention with publication number US20150179050A1 which was granted dated 14/03/2017 titled “Wearable device assisting smart media application and vice versa” is a system includes a wearable device connected to a user and a smart media in remote communication with the wearable device. The wearable device is operable to track movement of the user and transmit the track movement information to the smart media. The smart media is operable to receive the track movement information and to use the received track movement information in an independent application. A system includes a wearable device connected to a user and a smart media in remote communication with the wearable device. The wearable device is operable to track movement of the user and transmit the track movement information to the smart media. The smart media is operable to receive the track movement information and to use the received track movement information to enable or enhance the functionality of an independent application running on the smart media conversely, intelligence available in the smart media can be passed on to the wearable device to improve its operation.

And an invention with publication number WO2019093548A1 which was filed in WIPO dated 10/11/2017 titled “Control system using modular protection device and method thereof’ relates to a control system using a modular protection device and a method thereof, and to a control system using a modular protection device which can acquire biometric data for each user to detect whether or not there is an accident and respond to this, and a method thereof. This invention is a control system using a modular protection device which allows rescue or the evacuation of surrounding workers to be prioritized according to the type of accident, thereby enabling the prevention of additional accidents, and a method thereof. The protection unit receives work data including positional information, biometric information, and a work image for a specific protector determined to have an accident from the on-site management server, and is disposed in a pocket of a module fixing band located outside the protector wherein the illumination module unit is turned on or off at all times and a warning sound is generated through the earphone module unit disposed in the pocket of the module fixing band.

DESCRIPTION OF THE INVENTION

The purpose of the present invention is to provide a smart helmet, especially for the use of the safety officer, who can check the conditions of the environment, people and equipment, and detect the things that endanger the safety of people and the site or abnormal conditions that occur in the work environment and give the necessary warnings to the person using the helmet.

For this purpose, several toxic and dangerous gas detection sensors, dust detection sensors, temperature detection sensors along with humidity sensors have been used to check the air quality of the site. By using these sensors, gases that endanger the health of people in the industrial environment, as well as gases that can cause accidents such as fire and explosion, are detected, and the necessary warnings are given to the safety officer according to the position and concentration. In this way, by quickly detecting these gases and announcing the warning, it is possible to take people out of that situation in the first stage, and then take necessary measures to solve the problem to prevent possible accidents. Also, using a dust detection sensor, the air quality of the environment and different parts of the site is checked. Temperature and humidity sensors are also used to extract temperature and humidity at all hours and in different parts of the site. The information obtained using each of these sensors is compared with the normal predetermined values for that situation and is processed according to the obtained location, and if necessary, warnings are given to the safety officer through the display and warning unit.

In order to monitor the people on the site using the cameras mounted on the helmet and processing its output using the processing storing unit places in the crisis management room, the image processing algorithms and artificial intelligence, each person is identified in the working site and then in case of not using proper safety equipment, risky and unauthorized behavior, presence in places where he does not have permission to travel, use of equipment that he does not have permission to use, and other cases that are mentioned following will be detected and necessary warnings will be given to the safety officer and the guilty person through loudspeaker, display and other determined methods. Also the images obtained by cameras used to check the safety conditions of the environment and equipment, and many frequent and high-risk cases are detected using image processing and artificial intelligence algorithms, especially deep learning.

By using the positioning unit placed on the helmet, the location is known at any moment and based on the location and using the wireless communication unit, the information obtained by the equipment which are mounted on the helmet is sent to the information processing and storage unit placed in the crisis management room to be processed, displayed and stored. Collecting and analyzing this information can lead to better decision making and planning in the future.

To avoid increasing the weight of the safety officer's helmet and better access, a power supply unit that includes a rechargeable and replaceable battery and related circuits is placed on the safety officer's belt and connect the power and information to the helmet and other parts by using a cable and is responsible for supplying power to the electronic devices placed on the safety officer's smart helmet.

Also, several control keys are placed on the safety officer's belt for better access, and performs tasks such as turning on and off the helmet, disabling the camera, display or other equipment based on the importance in certain situations and to save power and sends an alert to the crisis management room. Also, by using the smart mobile phone of the safety officer and the application designed for it, tasks such as controlling the helmet, viewing the output information of the devices placed on the helmet, the results of information processing and the created warnings can be viewed and managed.

In the present invention, an air suction fan with adjustable speed is also used. By creating an air flow, the air suction fan makes the sensors for determining the air quality of the site environment and temperature and humidity sensors work better. Also, in this way, the cooling of the electronic devices placed on the helmet is also

Figure 1 shows the block diagram of the present invention and the manner of connection of its components. As it is known, the symbol (100) is related to the smart wearable equipment, the symbol (200) is related to the safety officer's belt and the symbol (300) is related to the smart helmet of the safety officer. The safety officer's belt includes the power supply unit with symbol (210) and control keys with symbol (220).

Figure 3 shows an example of a safety officer's smart helmet and the manner of placement of electronic tools on it according to the present invention.

As shown in the diagram of Figure 1 and Figure 3, the smart helmet includes a processing and power allocation unit (310), a positioning unit (320), a wireless communication unit (360), which is placed in a separate compartment on top of the helmet. Ambient air quality detection sensors with symbol 330, which include toxic and dangerous gas detection sensors (330A), dust detection sensor (330B), temperature sensor (330C), humidity sensor (330D), camera (340), display unit and alarm (350), which includes a display with the symbol (350A), several colored LEDs with the symbol (350B) and a speaker and microphone with the symbol (350C), the ambient air suction fan (370), the ambient light detection sensor (380) and the distance determination laser transmitter and receiver module (390) which following, each block will be reviewed in detailed.

All electronic devices are connected to the processing and power allocation unit (310) through a power and data cable or by using a wireless communication unit, and in this way they send and receive data and also receive the required power.

The positioning unit (320) is used to determine the position of the safety officer at any moment, and the information and results obtained are analyzed and stored according to the relevant location. In the positioning unit, according to the conditions of industrial environments, there is a need for methods that have proper accuracy for indoor places with many obstacles, and using only methods such as Global Positioning System (GPS) may have low accuracy and in many points and there will be the problem of not having access to the signal. For this purpose, in the present invention, Ultra-Wide Band (UWB) technology is used, which provides the location with good accuracy. In addition, to determine the location at any moment, it is possible to use other methods such as Inertial Measurement Unit (IMU) (to obtain movement information such as direction of rotation), Global Positioning System (GPS), Wi-Fi, Bluetooth, Zigbee and LoRa and or a combination of several methods should be used according to the conditions and environment. In other separate container top of the officer's smart helmet, there are ambient air quality detection sensors (330), which include a sensor for detecting dust (330B), several sensors for detecting toxic and dangerous gases (330A), a temperature detection sensor (330C) and humidity sensor (330D). By using these sensors, the temperature and humidity of the environment are measured at any moment and compared with the normal and proportional values predefined for each location of the site.

Toxic and dangerous gas detection sensors include several sensors that are selected according to the type of activity of each company and based on the investigation of accidents and risks that occurred in that industry and activity. For example, sensors for detecting sulfuric products (H2S, SO2), hydrogen, ethylene, LPG, natural gas (ethane, methane and LNG) and carbon dioxide (CO2) have been used for petrochemical and refinery industries. The selection of these sensors is considered based on the research and studies done in the field of accidents and their causes for these industries. The dust detection sensor also measures the amount of dust present in each part of the industrial environment and by comparing it with usual conditions, if necessary, it sends the necessary warnings to the safety officer and the crisis management room.

Using the cameras (340) placed around the helmet, the surrounding environment can be photographed at any moment, and these images are sent to the processing and power allocation unit for initial processing. If the vertical view in the upper direction of the safety officer is required, a camera can also be used in the upper part of the helmet. Also, a laser transmitter and receiver module (390) has been used to determine the distance, parallel to the camera placed in the front of the helmet. After the initial processing and using the wireless communication unit (360), the information obtained through the devices placed on the helmet is sent to the processing and storage unit placed in the crisis management room, and image processing algorithms and artificial intelligence are applied on the obtained images and the safety of people, equipment and the environment is checked at every moment. Safety monitoring is based on predetermined guidelines for each person, equipment, and location. Also, if there are fixed cameras in the site environment, their output images are also processed and in this way and through the combination of results, it is possible to extract an accurate three-dimensional model of the site space, to eliminate blind spots such as the comers of walls, behind objects and small spaces and inaccessibility is completed by the interaction of these cameras and the cameras placed on the safety officer's helmet.

The display and warning unit (350) is used through communication with the processing unit (310) and receiving information and processing results in order to announce conditions and warnings to the safety officer and includes a display, several colored LEDs (350B) and loudspeaker and microphone module (350C). The display (350A) is used for things like displaying the output results of processes, warnings and the type of warning, some sensor output information such as temperature and humidity information, and information related to the amount of battery charge. Several colored LEDs are also used to indicate conditions and warnings, and green LEDs are used to indicate normal conditions and other colors to indicate other conditions and warnings. Voice messages and warnings are also transmitted using the speaker and microphone module. Audio warnings are given to the safety officer through the speaker placed in this module. It is also possible to receive the voice of the safety officer and the environment by using the microphones placed on this module. In this way, the voice interaction of the officer with other safety officers present at the site and the crisis management room will also be possible. The wireless communication unit (360) may be a relatively long-range communication module or a relatively short-range communication module. In the communication unit, based on the conditions and needs, one of the methods of WiFi, Bluetooth and Zigbee may be used, which is able to communicate and send and receive data with other devices. Also, the communication unit uses methods such as LoRa technology, which have a long range and low power consumption.

The wireless communication unit is used to send and receive information to/from the information storage unit. In addition, the wireless communication unit is used to receive information from other devices and sensors placed in the site environment (such as sensor information, devices and processing results related to other safety officers and workers on the site) and information related to sensors and devices embedded in the various parts of sites (such as sensors for temperature, humidity, detection of toxic and dangerous gases, etc.). Also, the wireless communication unit may be all or part of it with the processing unit integrally and communicate with the processing unit through the VO interface.

Also, the wireless communication unit has the ability to connect to the security officer's smart cell phone. By using the program designed and installed on the smart mobile phone of the safety officer, the warnings, smart helmet information and the results of the processes can be seen. Another advantage of this program is the ability to control the smart helmet, activate and deactivate the devices placed on it if needed. Furthermore, if needed, it is possible to use some features of the safety officer's smartphone, such as camera, speaker, microphone, memory and GPS.

Temperature sensor and humidity sensors are used to detect the temperature and humidity in different parts of the environment and the ambient light detection sensor (380) is used to detect the amount of light in different parts based on the movement path of the safety officer. The output information of these sensors is compared with the predetermined values and standards for each section, and if needed, the necessary warnings are sent to the safety officer.

The connection between the safety officer's belt and the smart helmet will be through the communication cable and connection provided on the back of the smart helmet. The power supply unit includes a rechargeable and replaceable battery and related electronic circuits and is placed on the safety officer's belt to prevent the increase in weight of the smart helmet and increase safety. The control keys include several keys with specific tasks, such as turning on and off the smart helmet of the safety officer or disabling some of its equipment. Control keys are placed on the belt for better access of the safety officer.

Figure 2 shows the different parts of the processing and power allocation unit and how it interacts with other equipment. For example, the controller is responsible for tasks such as allocating power for other integrated components, collecting data related to each of the sensors and other components used, receiving information about the battery, receiving information about other devices and sensors placed in different parts of the site and on the smart helmet of other safety officers and workers on site, for processing the collected data and transmitting the collected data. The controller used in the present invention is described in three general parts including processor, memory and input/output interfaces (I/O Interface).

The processor may be any suitable processor capable of executing instructions and algorithms. The processor includes a Central Processing Unit (CPU), at least one Graphics Processing Unit (GPU) or at least one Tensor Processing Units (TPU). The GPU and TPU units may also not be integrated with the processing unit and communicate with the processing and power allocation unit through the I/O Interface unit. Each of these sections is used to perform arithmetic and logical operations, applying pre-processing on images obtained using cameras and prepare them for sending.

Depending on the need, memory may include non-volatile memory (such as flash memory, read-only memory (ROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), and volatile memory (e.g. Random Access Memory (RAM), Static RAM (SRAM), storage memory (for example, hard drives) or others. Among the applications of memory, we can mention the storage of program rules, trained models and neural network weights, pre-recorded sounds and warnings. Also, another important use of the memory section is for times when the connection with the information storage and processing unit placed in the crisis room is interrupted for any reason, in which case by using the memory until the connection is reestablished, it is responsible to store the achieved information and the results obtained from the processes.

The I/O interface provides an interface for connecting one or more input and output devices to the controller. In the input-output interface, several methods have been used to get inputs and give outputs. For example, several General-purpose input/output (GPIO) pins are used. Also, based on the need, one or more wireless communication devices may be used. The I/O interface may include integrated I/O components (such as the internal temperature sensor of the processing unit) and separate (external) devices and sensors. Also, the power required for other devices placed on the helmet is provided by connecting these devices to the VO interface. The processing and power allocation unit (310) according to the facilities and processing power considered for it, can be used in situations where it is not possible to communicate with the processing and information storing unit placed in the crisis management room or disconnect for any reason, act independently and perform some processes that are of higher importance and priority. In this way that it collects the data collected through sensors, cameras and other devices and components and analyzes the data by applying instructions and algorithms of artificial intelligence and image processing.

As shown in Figure 4, an air suction fan (370) is used which makes the environmental quality detection sensors perform detection operations with higher speed and accuracy in the presence of dust or toxic and dangerous gases. It also causes the temperature and humidity sensors to record the temperature and humidity of the environment with higher accuracy. The air sucked through this fan, after passing through the sensors, flows into the chamber where the processing unit and power allocation (310) is located, which prevents from increasing the temperature of the processing and power allocation unit (310) and finally increases the temperature of the safety officer's helmet.

Several cameras are placed around the helmet and one camera in the upper part as shown in Figure 3, which completely covers the space around and above the safety officer. A laser transmitter and receiver module is used parallel to the camera placed in front of the helmet, which is effective for determining the distance with high accuracy. An ambient light detection sensor (380) placed next to the camera on the back of the helmet is used to detect the amount of light in any location and compare it with the standard and predetermined value for that location. A display is placed on the front side of the helmet in such a way that it is visible to the safety officer and does not block the officer's view. Several colored LEDs are placed on the front and left side of the helmet and indicate certain warnings and priority information to the safety officer at any moment. The speaker and microphone module is placed on the right edge of the helmet, and in this way, voice messages are received for the safety officer, as well as the sound of the environment and the safety officer.

In Figure 4, the interior view of the smart helmet based on the present invention is shown. The communication paths between the devices placed on the helmet and the processing and power allocation unit are shown in this figure.

Figure 5 shows the security officer's belt (200) and how to place the power supply unit (210) and control keys (220) on it. Control keys (220) performs tasks such as turning on and off the helmet, disabling one or more cameras, display, laser pointer or other equipment based on the importance in certain situations and to save power, imaging specific areas if needed and sending alarms to the room crisis management. The control keys are placed on the safety officer's belt for better access and the power supply unit to reduce the weight of the smart helmet and increase safety. The battery placed in the power supply unit is considered chargeable and replaceable, and the electronic circuit related to connecting the battery to other electronic devices is designed in such a way that there is no need to turn off the other devices when replacing the battery and the rest of the items should perform their duties without disturbance.

The power supply unit (210) is connected to the processing and power allocation unit using the power and data cable through the part considered behind the smart helmet of the safety officer and in this way the necessary power is provided for all devices placed on the safety officer's smart helmet. Also, the information related to the battery charge amount is sent to the safety officer at any time using the display and warning unit and necessary warnings will be sent if the battery charge amount is less than a certain amount.

Figure 6 shows the flowchart of the algorithm used in the present invention to receive and process the information of the air quality detection unit (330), the ambient light detection sensor (380) in general. The information of each of the mentioned items along with the location information obtained by using the positioning unit (320) are entered into the processor and power allocation unit (310) for checking and processing through the VO interface.

The information of each part is processed using pre-written instructions and stored in the memory, and compared with the values related to normal conditions corresponding to each location. Then the obtained results are sent to the I/O interface. Following, if needed, necessary warnings are sent to the safety officer. This is done using the display and warning unit. At this stage, if there is any danger and warning, using several colored LEDs, according to the type of danger and warning, the corresponding LED will light up. Then the type of warning and danger is displayed on the display unit. Also, by using the speaker and microphone module according to the type of risk and its level and by using pre-recorded sounds and stored in the memory, the appropriate voice message is sent to the safety officer, as well as appropriate actions to the safety officer based on the situation and the type of risk is suggested based on pre- written instructions and scenarios. In addition, if necessary, warnings are sent to other safety officers. Finally, by using the wireless communication unit, the results are sent to the information storage and processing unit placed in the crisis management room along with the exact location for future storage and processing. Figure 7 shows the flowchart used to process the images obtained through the cameras placed on the helmet according to the present invention. The output images of each of the cameras along with the location obtained using the positioning unit and the output of the laser transmitter and receiver module are sent to the processing and power allocation unit which is done using the input-output unit placed on this board. Following, pre-processing is done on the incoming images, which includes preparing the images to be sent to the processing and storage unit placed in the crisis management room, for example, compressing the images or preparing the images to apply image processing algorithms and artificial intelligence, such as changing the dimensions of the images. After this step, the images along with the obtained location and distance are sent through the laser transmitter and receiver module to the processing and storage unit placed in the crisis management room, which is done using the wireless communication unit. Also, images are sent to apply pre-trained artificial intelligence algorithms and predesigned image processing algorithms placed in the memory of the processing and power allocation unit.

In the processing and storage unit placed in the crisis management room, a variety of image processing and artificial intelligence algorithms are applied to images, which include algorithms such as people recognition, facial recognition, facial detection, safety recognition of people and equipment, animal recognition, action recognition and unauthorized behaviors for each person and location, checking the ergonomics of people's bodies and identifying people with inappropriate ergonomics, identifying vehicles, their types and number plates, identifying predefined prohibited tools and goods for each section, extracting a detailed three- dimensional model of the site environment and identification of the changes and the progress of the project is extracted through the 3D model. Using the output of the distance determination laser transmitter and receiver makes some diagnoses based on the estimated volume, and also determines the distance of objects and people placed in front of the officer. Also, based on the location of the officer and the distance of objects and people to the safety officer, their exact position in the environment of the site is determined. Finally, the result of the processing is sent to the safety officer through the wireless communication unit and the corresponding warnings are notified to him through the display and warning unit. Also, images and results are saved for future processing and decision making.

Image processing algorithms and artificial intelligence placed on the memory of the power allocation and processing unit are responsible for detecting things that need to be quickly detected and notified to the safety officer. For example, things like fire detection, smoke detection and leak detection in liquid and gas transmission pipes can be of this category. In all cases, the results corresponding to the location will be checked through the positioning unit and the necessary warnings will be given to the safety officer through the display and warning unit. Alarm notification is done through colored LEDs and display of the type of warning on the display. Also, according to the type of warning, using pre-recorded and stored sounds in the memory, the appropriate voice message is played for the safety officer. In addition, if necessary, warnings and their location are sent to other security officers in the environment using the wireless communication unit so that the necessary actions can be taken quickly.

It should be noted that the processes and methods described herein are exemplary embodiments of the processes and methods that may be employed in accordance with the techniques described herein. Processes and methods may undergo changes and modifications to facilitate or based on the conditions and location of use. Also, the order of processes and methods and operations presented therein may change, and new elements and equipment may be added, combined, deleted, modified, etc. Parts of the processes and methods may be implemented in software, hardware, or a combination of both.

BRIEF DESCRIPTION OF FIGURES

Figure 1: The block diagram shows how the components of the intelligent safety equipment related to this invention are connected.

Figure 2: The block diagram shows the different parts of the processing and power allocation unit.

Figure 3 : It shows a picture of the safety officer's smart helmet and the placement of the tools used according to the present invention.

Figure 4: The interior view of the safety officer's smart helmet according to the present invention is shown.

Figure 5: shows the manner of placing the power supply unit and control keys on the safety officer's belt according to the present invention.

Figure 6: The flowchart of the algorithm used in the present invention, which shows the receiving and processing of information from the air quality detection unit, the positioning unit, the ambient light detection sensor, and sending the processed results to the alarm and wireless communication system.

Figure 7: shows the flowchart used to process the images obtained through the camera according to the present invention.

Figure 8: Shows the left view of the officer’s safety smart helmet according to this invention. Figure 9: shows the front view of the officer’s safety smart helmet according to this invention.

Figure 10: Shows the right view of the officer’s safety smart helmet according to this invention. Figure 11: Shows the backside view of the officer’s safety smart helmet according to this invention.

Figure 12: Shows the total view of the officer’s safety smart helmet according to this invention.

Figure 13: Shows the exploded view of the officer’s safety smart helmet according to this invention.

Figure 14: Shows the power allocation and processing unit, positioning unit and wireless communication unit of the invention.

Figure 15: Shows the ambient air quality detection sensors of the invention.

Figure 16: Shows the total view of the camera of the invention. Figure 17: Shows the distance determination laser transmitter and receiver module of the invention.

Figure 18: Shows the total view of the fan of invention.

Figure 19: Shows the display of the invention.

Claims

What is claimed is:

1. The invention of system and structure of online monitoring, espying and communication using mechanism of smart helmet of safety officer is specifically for the use of the safety officer, which is equipped with image processing algorithms and artificial intelligence and all kinds of electronic and communication equipment to identify unsafe and unusual cases in industrial environments that the smart helmet includes the body of the helmet for the safety officer to wear, ambient air quality detection sensors such as at least one temperature sensor and at least one humidity sensor and at least one dust detection sensor and at least one toxic and dangerous gas detection sensor and at least one ambient light detection sensor and at least one air suction fan and at least 5 cameras and at least one distance determining laser transmitter and receiver module and at least one positioning unit and at least one processing and storage unit and at least one processing and power allocation unit and at least one wireless communication unit and at least one display and warning unit that includes at least one display and several colored LEDs and at least one speaker and at least one microphone and at least one application that can be connected to the smartphone of the safety officer and also includes a safety belt that this belt has at least one controller unit that includes at least one processor and at least one memory and at least several input/output interfaces and at least one power supply unit and at least several control keys that are installed on the safety officer's belt.

2. The system and structure of claim 1, in which several sensors are used to detect toxic and dangerous gases according to the type of activity of the company and according to the concentration and level of danger of each gas and according to the location and predetermined standards, the necessary warnings are given to the safety officer using the display and warning unit.

3. The system and structure of claim 1, by using a sensor to detect the amount of ambient light, and by comparing the output of this sensor with predetermined normal conditions, the amount of brightness and darkness in each part of the environment is determined, and if needed, the necessary warnings will be sent to the safety officer.

4. The system and structure of claim 1, in which the dust detection sensor is used to detect contaminated areas and, if needed, warnings will be sent to the safety officer.

5. The system and structure of claim 1, in which a wireless communication unit is placed on the helmet and is responsible for exchanging information with the information processing and storage unit placed in the crisis management room, exchanging information with other safety officers, connecting and exchanging information with the smart cell phone of the safety officer and receiving information from sensors embedded in the environment.

6. The system and structure of claim 1, in which the wireless communication unit receives information about the location of each person on the site according to the positioning unit and the wireless communication unit placed on that person's helmet.

7. The system and structure of claim 1, in which if any person or vehicle is present in a place other than the authorized and predefined places for that person and vehicle, the wireless communication unit sends the necessary warnings to the safety officer and the person and the driver of the vehicle.

8. The system and structure of claim 1, in which if an area is recognized for any reason as an area with dangerous or unauthorized conditions for traffic and the presence of people and machines, in case of entering the people and machines to that area, the wireless communication unit will send the necessary warnings for the safety officer and the wrongdoing people.

9. The system and structure of claim 1, in which, if any person on the site has an accident or is in a dangerous or abnormal condition in terms of health, the wireless communication unit will send necessary warnings relevant to the situation of that person to the safety officer according to the sensors placed to check the health and movement information of that person.

10. The system and structure of claim 1, in which a positioning unit is placed on top of the helmet and obtains the location of the safety officer and the routes taken by the safety officer at any moment.

11. The system and structure of claim 1, in which several cameras are placed around the helmet and one camera in the upper part of the helmet in such a way that the space around the officer is completely covered and which are responsible for taking pictures of the environment, people and equipment.

12. The system and structure of claim 1, in which the images taken by the cameras are sent to the processing and power allocation unit on the helmet as well as the processing and storage unit located in the crisis management room for processing.

13. The system and structure of claim 1, in which the processing and storage unit by processing images taken by cameras and using image processing algorithms and the latest methods of artificial intelligence and deep learning in the crisis management room to investigate, identify and record the conditions and safety requirements of people (such as helmets, gloves, work clothes, safety shoes, etc.).

14. The system and structure of claim 1, in which the processing and storage unit located in the crisis management room by using image processing algorithms and artificial intelligence identify the people on the site based on their face or based on the number on their clothes, then specific safety conditions and requirements for each identified person and registration as well as unknown and unauthorized people present in the environment are identified.

15. The system and structure of claim 1, in which the processing and storage unit is located in the crisis management room, using image processing algorithms and artificial intelligence, to identify, warn and record some of the most frequent and dangerous cases based on the type of company activity and the history of incidents.

16. The system and structure of claim 1, in which the processing and storage unit located in the crisis management room, using image processing algorithms and artificial intelligence, identify pre-defined unauthorized actions according to the work area and the identified person.

17. The system and structure of claim 1, in which the processing and storage unit located in the crisis management room, using image processing and artificial intelligence algorithms, identify and register the necessary tools and equipment for each department using image processing and artificial intelligence.

18. The system and structure of claim 1, in which the processing and storage unit is located in the crisis management room, using image processing algorithms and artificial intelligence to record and store images of situations that the safety officer detects as unsafe.

19. The system and structure of claim 1, in which the processing and storage unit located in the crisis management room, using image processing algorithms and artificial intelligence, detects unauthorized vehicles in a specific company or region based on reading license plates and using image processing and artificial intelligence.

20. The system and structure of claim 1, in which processing and storage unit located in the crisis management room, using image processing algorithms and artificial intelligence, detect prohibited and dangerous goods according to the location and based on the laws of each region and section of the site.

21. The system and structure of claim 1, in which the processing and storage unit located in the crisis management room, using image processing algorithms and artificial intelligence, checks the insulation of the equipment according to the predetermined standards and in case of inappropriate insulation or lack of insulation and the necessary warnings are given to the safety officer.

22. The system and structure of claim 1, in which the processing and storage unit located in the crisis management room, using image processing algorithms and artificial intelligence to detect the animal and its type if there are animals in the site environment.

23. The system and structure of claim 1, in which the processing and storage unit is located in the crisis management room, using image processing algorithms and artificial intelligence, in some cases can require quick detection and action, including the presence of leaks in liquid and gas transmission pipes, fire and smoke detection.

24. The system and structure of claim 1, in which the processing and storage unit located in the crisis management room, using image processing algorithms and artificial intelligence and by using the obtained images, accurately extracts the 3D map of the site, which is continuously updated based on new images.

25. The system and structure of claim 1, in which the processing and storage unit located in the crisis management room, using image processing algorithms and artificial intelligence, detects and records the changes made on the site and the progress of the project in the site environment in every 3D map update.

26. The system and structure of claim 1, in which a laser transmitter and receiver module is used in the front of the helmet, which obtains the distance of objects and people in front of the safety officer with high accuracy.

27. The system and structure of claim 1, in which the laser transmitter and receiver module, based on the distance obtained from each person and object to the safety officer and by combining them with the image of the front camera of the helmet, can accurately identify the volume and dimensions for that person and object.

28. The system and structure of claim 1, in which the laser transmitter and receiver module, based on the distance of each person and object from the safety officer, as well as the location of the safety officer, can identify the location of that person and object with high accuracy.

29. The system and structure of claim 1, in which the unsafe and dangerous areas detected by the officer will be recorded using control keys and corresponding to the location on the map and warning will be given if other people approach these areas.

30. The system and structure of claim 1, in which, based on the analysis of the history of accidents and unsafe behaviors that have occurred and stored on the information storage unit, accident-prone areas are recorded on the map.

31. The system and structure of claim 1, in which, in case of dangerous accidents according to the site map, the area where the accident occurred, possible areas for the expansion and progression of the accident, and predetermined instructions and scenarios, the best route to guide people to leave the area are displayed on the safety officer's screen.

32. The system and structure of claim 1, in which the ambient temperature and humidity are measured at any moment using temperature and humidity sensors, and by comparing the measured values with the standard values for that location, necessary warnings are given to the safety officer in case of dangerous conditions.

33. The system and structure of claim 1, in which a speaker and microphone module is used to transmit warnings to the safety officer and also to receive the sound of the environment and the safety officer.

34. The system and structure of claim 1, in which the safety officer is notified from warnings according to the type and degree of danger and by using prerecorded sounds and stored in the memory.

35. The system and structure of claim 1, in which several colored LEDs are used on the hat, which will light up according to the type of warning.

36. The system and structure of claim 1, in which an air suction fan with adjustable speed is used on the smart helmet of the safety officer.

37. The system and structure of claim 1, in which the use of an air suction fan makes the ambient air quality detection sensors perform detection operations with higher speed and accuracy.

38. The system and structure of claim 1, in which the use of an air suction fan makes the temperature and humidity sensors perform detection operations with higher accuracy and based on the actual conditions of the environment.

39. The system and structure of claim 1, in which the use of an air suction fan prevents the increase in the temperature of the processing unit and power allocation, which, as a result, prevents the increase in the temperature of the smart helmet.

40. The system and structure of claim 1, in which it is possible to connect the smart helmet using the wireless communication unit to the smart mobile phone of the safety officer and the mobile application designed for this purpose.

41. The system and structure of claim 1, in which, it is possible to view the features, the status of the helmet and battery, the results of the output processing of the sensors and other devices placed on the helmet, and the control of the equipment used through the designed mobile application.

42. The system and structure of claim 1, in which, by connecting the smart helmet to the safety officer's smart cell phone, it is possible to use some smart cell phone features if needed and with the safety officer's permission, such as camera, speaker, microphone, memory and GPS, and using these items is placed next to the facilities on the helmet.

43. The system and structure of claim 1, in which the power supply unit connects the power and information to the processing and power allocation unit through the part considered behind the smart helmet of the safety officer, and in this way, the necessary power is provided for all the devices placed on the safety officer's smart helmet.

44. The system and structure of claim 1, in which the power supply unit will send the information related to the battery charge amount at any moment using the display unit and if the battery charge amount falls below a certain value, it will send the necessary warnings to the safety officer.

45. The system and structure of claim 1, in which the processing and power allocation unit operates independently in situations where it is not possible to communicate with the processing and information storage unit and executes some processes that are of higher importance and priority.

46. The system and structure of claim 1, in which the processor performs preprocessing on the obtained images using the instructions and algorithms.

47. The system and structure of claim 1, in which the memory operates independently in situations where it is not possible to communicate with the processing unit and stores the obtained information and the results of the processes.

48. The system and structure of claim 1, where the I/O interface is an interface for connecting one or more input and output devices such as the internal temperature sensor of the processing unit and separate external devices and sensors to the controller.

49. The system and structure of claim 1, in which the power required for other devices placed on the helmet is provided by connecting these devices to the I/O interface.