WO2024084073A1 - Procédé de délimitation de zone d'intérêt dans une image thermique - Google Patents
Procédé de délimitation de zone d'intérêt dans une image thermique Download PDFInfo
- Publication number
- WO2024084073A1 WO2024084073A1 PCT/EP2023/079352 EP2023079352W WO2024084073A1 WO 2024084073 A1 WO2024084073 A1 WO 2024084073A1 EP 2023079352 W EP2023079352 W EP 2023079352W WO 2024084073 A1 WO2024084073 A1 WO 2024084073A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- target
- thermal
- coordinates
- management device
- space management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/105—Controlling the light source in response to determined parameters
- H05B47/115—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/105—Controlling the light source in response to determined parameters
- H05B47/115—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings
- H05B47/13—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by using passive infrared detectors
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/175—Controlling the light source by remote control
- H05B47/19—Controlling the light source by remote control via wireless transmission
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/175—Controlling the light source by remote control
- H05B47/198—Grouping of control procedures or address assignation to light sources
- H05B47/1985—Creation of lighting zones or scenes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
Definitions
- TITLE Method for delimiting the area of interest in a thermal image
- the technical field of the invention is that of space management using a thermal imager, in particular in the field of tertiary type buildings.
- Space management consists of controlling home automation electrical devices, for example lighting fixtures, independently depending on the presence of occupants, the aim being to optimize energy consumption without penalizing user comfort.
- the present invention relates to a method for delimiting a zone of interest from a thermal imager of a space management device from a user device, as well as a space management device configured to configure an area of interest delimitation according to this method.
- Space management devices are known for controlling different electrical home automation devices, for example, shutters, a heating or/and air conditioning device, electric door locks or suction cups, lighting fixtures or light sources, electrical outlets, in particular autonomously and independently depending on the user's needs in a space.
- These management devices make it possible in particular to save electricity by only controlling electrical devices based on the presence of a person, for example by ordering luminaires lighting only the areas requiring lighting where a user is located.
- an instruction which can be a temperature, a brightness etc.
- light sources are positioned to illuminate the entire open space, but if only one person is located in the large space, the user's need may be to have only one or two or three lighting fixtures illuminating the area where the person is located. It is the same with heating devices, for example electric radiators or Connected radiator valves are positioned to heat the entire open-plan space, but if only one person is located in the large space, the user's need may be to have only one or two radiators heating the area where the person is located.
- heating devices for example electric radiators or Connected radiator valves are positioned to heat the entire open-plan space, but if only one person is located in the large space, the user's need may be to have only one or two radiators heating the area where the person is located.
- such a management system requires detecting the person in demarcated areas and therefore configuring the delimitation of these areas.
- the best-known type of space management device uses an imager in the visible domain (CMOS, a video camera) with a human recognition device (computer unit and software) to make it possible to detect the human when he is in the camera's field of view.
- CMOS visible domain
- human recognition device computer unit and software
- the space management device further comprises a motion sensor to turn on the imager when it detects movement and the imager detects the immobile presence in order to reduce electrical consumption while detecting a stationary person.
- a motion sensor to turn on the imager when it detects movement and the imager detects the immobile presence in order to reduce electrical consumption while detecting a stationary person.
- such a device is very expensive due to the two sensors and is intrusive and energy-consuming when the imager and the digital processing device operate to detect a stationary presence.
- imaging sensors are intrusive, in particular if the human recognition device is remote from the CMOS imager, or even may be illegal in the event of an image transmitted to a remote device or may even provide cybersecurity, confidentiality and integrity problems, particularly in places of defense or industrial secrecy.
- the problem of management systems comprising an imager in the visible domain (a video camera) with a human recognition device (computer unit and software), is that in the event of an individual passing behind a window or reflection on a window or a mirror or even in the case of a hologram, the human recognition device (computer unit and software) can detect a presence in an area even though it is not located in this area.
- Management systems comprising a motion detector with an imager in the visible domain, of the CMOS type.
- the detector motion allows the imager to be turned on when movement is detected by the motion detector and the CMOS type imager identifies whether the person is in a useful area.
- the problem of pyroelectric type detectors is that the detector is activated when the infrared to which a pyroelectric module is subjected in the pyroelectric type detectors varies. If the individual is perfectly still (even if he emits infrared waves) in front of the detector, he will not be detected. It is the same with ultrasonic wave or microwave motion detectors, in fact it only detects in the event of movement. In other words, the problem with ultrasonic or microwave type wave motion detectors is that it does not detect a presence when the person is still, and the space management device no longer detecting the person can order, after a delay, to turn off while a person is still in the detection zone.
- space management devices devoid of video image in the visible domain but comprising several motion detectors without delimitation of zone of interest, that is to say it turns on or off the associated lamps to the motion detector having detected a movement.
- these devices are difficult to implement due to the number of motion sensor installations to be installed.
- One of the solutions is to propose identifying the zones of interest blindly by proposing a grid in which the user can define the zones of interest. This solution is tedious for the user who requires him to check whether the defined zones in the grid correspond to those desired in the sensor detection space.
- a space management device having the capacity to be able to delimit exclusion zones, which can be located between two zones of interest, to avoid detecting a person in an unwanted zone. by the user. For example, in the event of detection of a person passing in a corridor located between two areas of interest, the management device will not control a device.
- the invention offers a solution to the problems mentioned above, by making it possible to configure a delimitation of a zone in a thermal image of a thermal imager of a space management device by an identification in a thermal image, a target and displaying the target in a map representing the field of view of the thermal imager.
- One aspect of the invention relates to a method for delimiting an area in a thermal image of an imager of a space management device, comprising the steps: requesting configuration of a delimitation of the type zone interest comprising displaying on a screen of a user device an input form for configuring a delimitation of at least one type of zone interest, and acquiring an entry by the user in the form, resulting in the configuration of a delimitation of a type of area to be delimited in a thermal image of the imager, capture by the imager of thermal images regularly, coordination of a map with the thermal image comprising the display on the screen of a map comprising at least one layer of coordinates, transmitting from the space management device to the user device information about a target or thermal images comprising a target, the target having a thermal value in a predetermined temperature range, displaying each piece of information 'a target or thermal image in the displayed map, the information of the target having coordinates, recording of coordinates of the points of a shape delimiting the demarcated
- the method makes it possible to configure the delimitation of zones in which it is necessary to detect or not detect a presence in an image of a field of view of a thermal imager.
- the space management device can use a thermal imager as a presence detector with demarcation zones.
- the map and/or field of view of the thermal imager each comprises at least one coordinate layer (abscissa and ordinate) corresponding to each other, and the location of the target is based on this coordinate layer.
- the method also makes it possible to simplify the configuration of the delimitation of zones. Indeed, using a target displayed in a map grid allows the user to configure the delimitation by locating and moving the target in the environment.
- the detected target can be the user who is moving in the environment of the field of vision of the thermal imager or even an object having a temperature different from the other temperatures of the environment, the object can either be automobile which can be autonomous be moved by the user.
- the user can see on the screen target information, which may be an image representing a target or a human or other, moving (by moving or moving the object) in the grid.
- the user can easily configure a delimitation by validating either the coordinates of points forming the corners of a shape or the coordinates of points forming a path of the target, for example by recording and moving in the environment to form the shape of the area to be delimited.
- the recorded coordinates of each point therefore make it possible to form the outline of the shape corresponding to the delimitation of the type of zone.
- the type of zone can be a zone in which the user wishes detection of human presence to control electrical home automation devices, called zone of interest in the following or an exclusion zone in which the user wishes not to have any search for detection in the image or not to command in case of presence detect in this zone, called exclusion zone in the following.
- thermal imager as a presence detector in a space management device making it possible to be non-intrusive, without confidentiality problems, while having zone delimitations .
- the method of delimiting a zone in a thermal image of a thermal imager of a space management device can present a or several complementary characteristics among those described in the following paragraphs, considered individually or in all technically possible combinations:
- the step of recording coordinates of the points of a shape delimiting the delimited area to be configured comprising displaying on the screen a form for entering a coordinate validation and acquisition of entry by the user in the form of coordinates of points of a delimitation of the area to be delimited corresponding to the different positions of the identified target displayed on the map during the acquisition, resulting in the recording of the coordinates of the points, is carried out by: the display on the screen of an entry form of a validation of coordinates of a Nth point, at least one Nth acquisition of entry by the user in the displayed form resulting in: the recording of a Nth point of coordinates corresponding to the position of the target, the display on the screen of a form for entering a validation of coordinates of an N+1 th point for the production of the shape with the Nth point.
- This embodiment allows the user to form the desired shape quickly by only validating replacement of the target to make its shape.
- the number of N is greater than 4, in particular 5.
- the screen further comprises the form for entering a validation of coordinates of an N point, a form of the form of connection between the two points, for example a straight line, or a curve.
- a form of the form of connection between the two points for example a straight line, or a curve.
- the user can modify the radius of the curve between the shape delineation step and the validation step, by deforming the proposed radius of curvature.
- the step of acquiring an end of delimitation being carried out when the target displayed on the map is again at the first recorded position or by displaying on the screen a form of entry of a validation of the end of delimitation, acquisition of the validated entry, and causing the formation of the outline of the shape by connecting the points recorded in chronological order and by connecting the last point recorded with the first point recorded.
- the imager is a thermal imager, the method further comprising the steps of: transmitting the thermal image to the user device, selecting a target in the thermal image comprising the display on the screen of a form for entering a validation of the coordinates of a target and acquisition of user entry into the form of point coordinates and recording of the position of the thermally identified target as well as thermal values corresponding to a thermal fingerprint of the selected target.
- This allows the operator to be used to determine the thermally identified target.
- the method of delimiting an area in a thermal image of an imager of a space management device can be carried out while different people are present in the field of vision of the imager. The operator can recognize the moving target (which may be itself or another person or a heat emitting device) in the thermal image for configuring the zoning and select it to configure the zoning.
- the imager is a thermal imager, the method further comprising the steps: analyzing thermal images for the identification of a target in each analyzed image, having the thermal value in the predetermined temperature range, and extracting a position of the thermally identified target in each thermal image, the coordinates of extracting the position of the extracted target being the information of the target displayed in the coordinate form of points of a delimitation of the area to be delimited.
- the operator can thus enter, for example by clicking to start the delimitation of a zone corresponding to the position of the target on the screen forming a vertex of the shape to be entered , then to section again when the operator considers that the target is at a vertex of the shape to be delimited until entering an end of delimitation resulting in the production of the shape from the different positions entered.
- the space management device carries out the thermal image analysis and extraction steps and in that the target information transmitted to the transmission step from the space management device to the user device are the coordinates of the target position thermally identified and extracted. This allows for a space management device that can never send an image from the imager to another device (so there is less risk of intrusion).
- the step of analyzing thermal images may comprise the sub-steps of: identifying a target in a plurality of images captured in a predetermined time, by the thermal imager, d extraction of the coordinates of each position of the target identified in the different images,
- the step of displaying information about a target in the displayed map (E3) may include the sub-steps of reception by the user device and display of the coordinates extracted from the target on the screen map.
- the space management device can carry out the step of transmitting the coordinates of the target at regular intervals. This makes it possible to send only the position of the extracted target and thus reduce the throughput (therefore the bandwidth) of the means of communication used between the space management device and the user device.
- the means of communication can be a less expensive and less energy-consuming communication technology, for example by using a home automation wireless communication standard (zigbee etc.) with very low consumption compared to a means of communication where the communication device space management transmits a succession of images to the user device.
- the space management device transmits to the user device each thermal image at the request of the user on the user device or regularly and in that the user device carries out the thermal image analysis and extraction steps. This makes it possible to use the power of the user device for target recognition and extraction which may have greater computing power than the space management device. Thus, the target recognition time can be faster when setting up zoning.
- the method comprises, prior to the step of transmitting from the space management device to the user device information about a target: an initialization step carried out by the user device: displaying on the screen a form for entering a request for contact details, acquiring input by the user in the request form, and transmitting to the space management device a request for identification of a target and these coordinates, and in which the step of the space management device to the user device of information of a target comprises transmitting the coordinates of the target upon receipt of an identification request by the space management device.
- the operator can thus enter confirmation of the start of the desire to acquire display of a target on the screen in order to avoid transmitting data while the operator is not ready (for example it knows that no target is in the imager's field of view).
- the step of requesting configuration of a delimitation of the type of zones to be delimited comprises the display of different input forms on the screen forming a list of zone types, in particular zone d interest and exclusion zone and in that the acquisition includes a selection of the type of zone to be delimited. This allows you to choose the type of zones to be defined by the operator.
- the step of coordinating a map with the thermal image further comprises a sub-step of displaying on the screen a form for entering height information. installation of the thermal imager and a sub-step of acquiring inputs by the user of the installation height information of the thermal imager resulting in the calculation of a card size to be displayed according to the chosen height .
- the step of coordinating a map with the thermal image further comprises a sub-step of modifying a circular image of the thermal imager as a function of the characteristics of the lens to improve the thermal image displayed on the screen of the user's equipment.
- the thermal image includes deformations compared to reality. This step allows you to correct these deformations.
- the step of coordinating a map with the thermal image further comprises a sub-step of displaying on the screen a form for entering grid size information of the map, a sub-step of acquiring an entry by the user of the grid size and resulting in the step of displaying the map, a grid according to the chosen size. This allows the operator to configure the precision of the area delimitation to be delimited.
- the method comprises a pairing step between the management device and the user device.
- each data packet exchanged between the space management device and the user device has a size smaller than a data packet encoding the thermal image having the smallest resolution in the storage device.
- space management This makes it possible to use a non-energy-consuming, low-consumption means of communication and in addition it can improve confidentiality and avoid being intrusive (even in the event of hacking of the management device.
- the management device may be physically unable to transmit a data packet encoding the thermal image or may have software blocking transmission in case of higher data packets data packet encoding the thermal image having the lowest resolution of the imager.
- the step of recording coordinates of the points of a shape delimiting the delimited zone to be configured comprises the validation of coordinates of different points each corresponding to the coordinates of the moving target information displayed on the map and in that the shape is a polygon of which each coordinate of a point forms a corner of the polygon.
- the method of delimiting a zone in a thermal image of an imager of a space management device is carried out during an operating mode of the space management device, to modify the perimeter of a demarcated area or add a delimited area to other delimited areas.
- the target is a target of a thermal device having a predetermined temperature outside a range comprising a value of a human temperature and a value of a temperature of the environment.
- the step of acquiring an end of delimitation is carried out when the target displayed on the map is again at the first recorded position.
- the step of acquiring an end of delimitation is carried out by displaying on the screen of an entry form a validation of the end of delimitation, acquisition of the entry validated, and resulting in the formation of the outline of the shape by connecting the recorded points in chronological order and connecting the last recorded point with the first recorded point.
- the method comprises the configuration of delimitation of several zones according to the steps of the method.
- the method comprises the configuration of a first and second areas of interest in which the detection of a human target is to be monitored and in that the method further comprises the steps: displaying on the screen of control logic entry forms, acquisition of inputs by the user in the control logic entry forms, resulting in a control order for a home automation electrical device according to the identification of a presence in the first zone, and control logic comprising a power control order for at least one other electrical device based on the identification of a presence in the second zone.
- the space management device is electrically connected to a power supply of the building comprising a converter (AC/DC or/and DC/DC or/and AC/AC) to power the elements of the device space management.
- the space management device comprises a battery and a converter (AC/DC or/and DC/DC or/and AC/AC) connected to the battery to power the elements of the space management device.
- a space management device comprising: a thermal imager comprising a sensor in the non-visible or near infrared region used to capture thermal images of a scene, a control unit comprising an output for controlling home automation electrical devices and an input connected to the thermal imager to detect the thermal presence of a person in pre-defined areas of the detection field of the imager, and a memory storing user parameters and data calibration, a configuration unit configured to memorize the pre-delimited zones by carrying out the following steps of a method of delimiting a zone from a thermal imager: the capture by the thermal imager of thermal images regularly, the analysis of thermal images, transmission of coordinates of the detected target to the user device by the communication means, reception by the communication means of data comprising the recorded coordinates or/and the form of delimitation of an area to delimit, recording the coordinates of the shape as a delimited area of the thermal image.
- the thermal imager further comprises a sensor in the visible domain and a processing unit
- the space management device comprises: a visible image analysis and processing unit configured to receive the image from the sensor in the visible domain and identify a target such as a human presence, different and independent of the configuration unit, in which the configuration unit is configured to transmit to the analysis unit and visible image processing of zone boundary coordinates, in which the visible image analysis and processing unit and the configuration unit are each configured to transmit presence or presence number data by area delimited to the control unit, the device being configured so that the communication means transmits and receives data only by the configuration unit and the control unit.
- FIG. 1 shows a schematic representation of a space management device in an environment with a user using a user device pairing with the space management device.
- FIG. 2 shows a schematic representation of several displays on a screen of the user device representing different stages of the method of delimiting an area from a thermal imager of the space management device of the figure 1, according to a first embodiment of the invention.
- FIG. 3 shows a schematic representation of several displays on a screen of the user device representing different stages of the method of delimiting an area from a thermal imager of the space management device of FIG. 1, according to a second embodiment of the invention.
- FIG. 4 shows a schematic representation of several displays on a screen of the user device representing different stages of the method of delimiting an area from a thermal imager of the space management device of the figure 1, according to a third embodiment of the invention.
- FIG. 1 schematically represents a user comprising a user device 1 paired with a space management device 2 comprising a thermal imager 21.
- the thermal imager 21 captures thermal images in its field of vision C1.
- the space management device 2 only includes as a presence sensor one or more thermal imagers 21 which are not in the visible range.
- the user device 1 is a computer, for example a pocket computer such as a smartphone (smart mobile phone), a tablet, a connected watch or can be a laptop or desktop computer or any other electronic devices .
- a pocket computer such as a smartphone (smart mobile phone), a tablet, a connected watch or can be a laptop or desktop computer or any other electronic devices .
- user device 1 is a smartphone represented by an enlargement according to a schematic diagram.
- the user device 1 comprises a means of communication 10 for communicating with a means of communication 20 of the space management device 2.
- the communication can be wireless, for example using the “Wifi” or “Bluetooth” standard. ".
- the user device 1 comprises a screen 11, a man-machine interface, in this case the screen 11 is a touch screen providing the man-machine interface.
- the user device 1 comprises a control unit 12 comprising at least one microcontroller or processor or microprocessor and a memory making it possible to carry out a configuration program for the space management device 2.
- each data packet exchanged between the space management device 2 and the user device 1 has a size smaller than the data packet of the thermal image having the smallest resolution in the device space management 2.
- the space management device 2 also comprises a control unit 22 comprising at least one microcontroller or processor or microprocessor and a memory making it possible to analyze captured thermal images to thermally identify a human presence in the thermal image and to control according to a control law for home automation electrical devices, for example light sources and/or heating and/or air conditioning, and/or openings such as shutters or doors or even door locks, etc. ., in particular depending on the identification of a human presence.
- the management device may include other types of sensors, for example a brightness sensor to detect the brightness of the environment.
- the user wishes to delimit a zone, which could be a zone of interest or exclusion.
- the zone of interest allows the space management device to control, according to a control law, home automation electrical devices based on thermal identification in this zone of interest of the thermal image of a human presence .
- the exclusion zone allows the space management device to control, according to a control law, home automation electrical devices based on a thermal identification in the thermal image of a human presence without those identified in the zone d exclusion or without seeking to identify a presence in the exclusion zone.
- FIG. 2 shows a schematic representation of several displays on the screen 11 of the user device 1 according to different stages of a process for delimiting an area from a thermal imager 21 of the space management device 2, according to a first embodiment of the invention.
- the method can configure several zone type delimitations.
- the method therefore comprises a first step, not shown, of pairing (pairing or pairing) between the space management device 2 and the user device 1.
- the method may further comprise, during this pairing, a transmission of characteristics of the imager of the space management device to the user device, such as its field of vision size as a function of height, etc. . and other characteristics, for example presence of sensor etc... this makes it possible to adapt the application of the user device to different types of space management device.
- these characteristics can be, according to another example, in an external database or stored in the user device and the space management device transmits identification information allowing the user device to obtain in the base these characteristics.
- the method comprises a step of requesting configuration of a delimitation of the type of interest of zones E1, subsequently called step E1, comprising the display on the screen 11 of an input form E1.
- Step E1 further comprises the acquisition of an entry in the form made by the user, resulting in a configuration of a delimitation of the type of interest of zones.
- the screen displays two input forms to select the type of zone to be delimited, either an exclusion zone mentioned on the “exclusion” screen, or an exclusion zone. interest mentioned on the “NORMAL AREA” screen. the user can thus validate the configuration he wishes to make by selecting either “exclusion” or “NORMAL AREA”.
- the user selects the delimitation of an area of interest.
- the term “entry form” means a selection or an entry or a request by the user in a form comprising an entry control.
- the input control can be of any type among at least: button, check box, drop-down list, text entry zone, ... the list is not exhaustive.
- the method can only offer one type of zone to configure, for example only an exclusion zone or only a zone of interest. In this case, the display only offers an input form to validate the configuration intention.
- the method of delimiting an area further comprises a step of coordinating a map with the thermal image called coordination step E2.
- This coordination step E2 includes the display on the screen 11 of a map comprising at least one layer of coordinates (abscissa and ordinate).
- the map displayed is a grid, in this case 8X8.
- this coordination step E2 further comprises a sub-step of displaying on the screen 11 a form for entering information on the installation height of the thermal imager H and acquisition of an entry by the user of the installation height information of the thermal imager resulting in either the calculation of a card size by the application of the user device 1 having received information on the size of fields of vision (for example during pairing as explained above), or the transmission to the space management device 2 of the height and the calculation of a card size by this last and transmission to user device 1 of this card size.
- the map size here is in this case a grid comprising more or less boxes (abscissa and ordinate) to be displayed depending on the chosen height.
- the input form is an “H” button.
- the map displayed next will remain an 8X8 grid, but could very well be 10X10. If the user does not choose a height, the size of the map to display is predetermined, for example the 8X8 grid.
- This step may include a sub-step of modifying a circular image of the thermal imager as a function of the characteristics of the lens to improve the thermal image displayed on the screen of the user's equipment. Indeed, as the lens distorts the reality captured by the imager, the thermal image includes deformations compared to reality. Thus when configuring the boundaries of the zones, the space management device 2 (by the control unit for example) or the equipment 1 can modify the circular image according to the characteristics of the lens to improve the thermal image displayed on the screen of the user's equipment.
- the method may further comprise a step of displaying on the screen a form for entering grid size information of the card, of acquiring the user's entry of the size of the card. grid and resulting in the map display step, a grid according to the chosen size.
- the method comprises, in this example, a step of transmitting from the user device 1 to the space management device 2 of the size of the card.
- the method includes a step of capturing thermal images regularly by the thermal imager 21. This step can be carried out before or after the coordination step E2.
- the method comprises, in this example, for each thermal image captured, a thermal image analysis step consisting of a search for identification of a target in the captured images.
- the method can according to another example, depending on the computing power, once the identification has been carried out on an image, analyze the last image captured even if other images have been captured in the meantime.
- the analysis of the identification is carried out in this example by the control unit 22 of the space management device 2 by searching for a thermal value in the image which is in a predetermined temperature range.
- the method includes extracting a position of the thermally identified target in each analyzed thermal image.
- the analysis includes the addition of a layer of coordinates (abscissa and ordinate) to the analyzed image.
- the coordinate layer corresponds to that of the displayed map.
- the method further comprises a step of transmitting by the space management device 2 the coordinates of the target and of receiving the coordinates of the target by the user device 1.
- the management device Space 2 carries out the step of transmitting the coordinates of the target at regular intervals.
- the method further comprises a step of displaying information about a target in the displayed map E3, comprising information about the target having the coordinates corresponding to the position extracted from at least one of the last images captured.
- the method moves to a step of recording coordinates of the points of a shape delimiting the delimited area to be configured E4, called recording step E4, comprising the display on the screen 1 1 of a form for entering a validation of coordinates 40.
- the target is the user.
- the user thus sees on the screen 11 his position in relation to the map and therefore in relation to the image captured in the field of vision of the thermal imager 21.
- the target can be a thermal device (the heat or cooling of which can be carried out electrically or chemically) having a predetermined temperature outside the range between a human temperature and an environmental temperature so as to clearly identify it in the environment.
- the method therefore comprises a sub-step of acquiring several entries (at least three) in the recording step E4 by the user, in the form of coordinates of points of a delimitation of the area to be delimited corresponding to the different positions of the identified target displayed on the map during the acquisition, resulting in the recording of the coordinates of the points.
- each recorded point remains displayed on the screen 1 1.
- the method further comprises a step of acquiring an end of delimitation E5, resulting in the production and display of a shape on the map from the different coordinates recorded in the chronological order of recording.
- the end of delimitation is achieved when the target displayed on the map is again at the first recorded position.
- the shape includes the recorded points but these recorded points can also according to another example not displayed.
- the coordinates of each point are recorded in the memory of the control unit 12 of the user device 1 and the shape of the delimited area is produced by the control unit 12 of user device 1 (configured to perform this step).
- the control unit 22 of the space management device 2 can also be configured to achieve the shape of the demarcated area which would require the user device 1 to transmit each point coordinate entered by the user (by the press button 30 in this example).
- the method further comprises a step of delimiting the area in the thermal image E6, hereinafter called delimitation step E6.
- This delimitation step E6 comprises a sub-step of displaying on the screen 11 a form for entering a validation of form 60 as the type of configured zone, a sub-step of acquiring the validated entry by the user resulting in the recording of the delimited area of the thermal image according to the coordinates of the points of the shape.
- the delimitation step E6 further comprises, in this embodiment, a sub-step of transmitting the shape by the user device 1 to the space management device 2 between the sub-step of acquiring the entry validated and recording of the shape of the delimited area of the thermal image in the memory of the control unit 22 of the space management device 2.
- the shape is a polygon, in this case in the example displayed, the shape is a rectangle, each angle of which is a circle corresponding to the coordinates of points of a recorded boundary. According to another example, the angles can be displayed in a salient manner.
- control unit 22 of the management device 2 can, during the analysis, thermally identify in the thermal image a human presence only in the delimited area of the thermal image corresponding to the shape on the displayed map , since the image and the map each include at least one layer of abscissa and ordinate coordinates corresponding to each other.
- the control unit 22 of the management device 2 can thus be configured to control home automation electrical devices according to a control law, depending on the identification of a human presence in this area of interest.
- FIG. 3 shows a schematic representation of several displays on the screen 1 1 of the user device 1 representing different stages of the process of delimiting an area from the thermal imager 21 of the space management device 2 of the Figure 1, according to a second embodiment of the invention.
- the delimitation method is identical to the first embodiment except in that the step of coordinating a card with the thermal image, referenced P1, is carried out before the step of requesting configuration of a delimitation of the type of interest of zones P2, called in the following configuration step type of interest P2.
- the interest type configuration step P2 here includes the display of several icons, each representing an input form for configuring a delimitation of either the type of interest or the type of exclusion.
- the areas of interest are of different categories, i.e. offices, a telephone booth, a meeting room, a meeting room with a video projector. This allows, in the case of using several space management devices, to be able to bring together the same control laws according to the category of an area of interest, to simplify the operator's configuration. In addition, this can make it possible to transmit to a server presence information on different categories of area of interest, to allow a user to obtain the availability of an area of interest.
- the exclusion zones are either a corridor or a terrace.
- the space management device is configured to only count the number of individuals leaving or/entering the zone which can also be depending on the location of the entry and/or exit, i.e. i.e. the location of the perimeter forming the exclusion zone.
- the method therefore comprises a second step of recording coordinates of the points of a shape delimiting the demarcated area to be configured, hereinafter called second recording step E4' and a second step of acquiring an end of delimitation E5 '.
- the method comprises in the recording step E4 and the second recording step E4', furthermore, after entering the form for entering a coordinate validation 40, the form of entry of an end of validation 50.
- the step and the second step of acquiring an end of delimitation E5, E5' which can be carried out before the user returns to his initial position, includes the entry by the user of an end of validation 50 resulting in the formation of the outline of the shape by connecting the points recorded in chronological order and by connecting the last point recorded with the first point recorded.
- the recording step E4 and the second recording step E4' comprise the transmission by the user device to the space management device of the coordinates of each point entered by the The user in the form and the recording of the coordinates of each point is carried out in the memory of the control unit 22 of the space management device 2.
- the shape of the demarcated area is produced by the control unit 22 of the space management device 2 (configured to carry out this step) which transmits to the user device 1 the coordinates of the shape to display it on the map.
- the form can also be produced by the user device 1 independently (in parallel) but requires recording as in the first embodiment.
- FIG. 4 shows a schematic representation of several displays on the screen 1 1 of the user device 1 representing different stages of the process of delimiting an area from the thermal imager 21 of the space management device 2 of the Figure 1, according to a third embodiment of the invention.
- the delimitation method is identical to the first embodiment except in that, the recording step E4 comprises, after the acquisition of an entry of the entry form, a validation of coordinates 40 (here a button ), recording all coordinates of the target, the coordinates of each position of the target forming the perimeter of the shape.
- a validation of coordinates 40 here a button
- the user moves in the field of vision 1 by showing on the map the route of his movement, during the movement , all points are saved.
- the recording step 4 can either, as in this example, include the display of a form for entering a validation of the form 50 to move on to the step of acquiring an end of delimitation E5 when entered, either end as in the first embodiment by repositioning the target at the position comprising the first recorded coordinates.
- the shape is displayed (step of acquiring an end of delimitation E5) and the process moves to the step of delimiting the area in the thermal image E6 .
- the shape can be more precise because it is not a polygon (visually) since the operator can move in a circular or curved manner and thus avoid areas in a more precise.
- the space management device 2 comprises a step of transmitting the thermal image to the user device.
- This embodiment is less interesting than the first, second and third explained previously since it requires communications means and sufficient bandwidth to transmit the thermal image.
- the application of the user device 1 makes it possible to carry out the thermal image analysis steps for the identification of a target in each analyzed image, having the value thermal in the predetermined temperature range, and extracting a position of the thermally identified target in each thermal image.
- the space management device continues to transmit the thermal images (with a target at different locations on the image) and the user device 1 allows validation by input by the user on the card or by an input form displayed or the space management device only subsequently transmits the information on the position of the target.
- the user device comprises a form for entering coordinate validation on the map allowing the user to select and validate the location of the coordinates of each point entered by the user to achieve the shape.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Radiation Pyrometers (AREA)
- User Interface Of Digital Computer (AREA)
- Image Processing (AREA)
- Investigating Or Analyzing Materials Using Thermal Means (AREA)
Abstract
Description
Claims
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23790362.0A EP4606178A1 (fr) | 2022-10-21 | 2023-10-20 | Procédé de délimitation de zone d'intérêt dans une image thermique |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FRFR2210936 | 2022-10-21 | ||
| FR2210936A FR3141269B1 (fr) | 2022-10-21 | 2022-10-21 | Procédé de délimitation de zone d’intérêt dans une image thermique |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024084073A1 true WO2024084073A1 (fr) | 2024-04-25 |
Family
ID=86007340
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2023/079352 Ceased WO2024084073A1 (fr) | 2022-10-21 | 2023-10-20 | Procédé de délimitation de zone d'intérêt dans une image thermique |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4606178A1 (fr) |
| FR (1) | FR3141269B1 (fr) |
| WO (1) | WO2024084073A1 (fr) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180341816A1 (en) * | 2017-05-26 | 2018-11-29 | MP High Tech Solutions Pty Ltd | Apparatus and Method of Location Determination in a Thermal Imaging System |
| US20200037417A1 (en) * | 2016-09-29 | 2020-01-30 | Signify Holding B.V. | Depth queue by thermal sensing |
-
2022
- 2022-10-21 FR FR2210936A patent/FR3141269B1/fr active Active
-
2023
- 2023-10-20 EP EP23790362.0A patent/EP4606178A1/fr active Pending
- 2023-10-20 WO PCT/EP2023/079352 patent/WO2024084073A1/fr not_active Ceased
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200037417A1 (en) * | 2016-09-29 | 2020-01-30 | Signify Holding B.V. | Depth queue by thermal sensing |
| US20180341816A1 (en) * | 2017-05-26 | 2018-11-29 | MP High Tech Solutions Pty Ltd | Apparatus and Method of Location Determination in a Thermal Imaging System |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4606178A1 (fr) | 2025-08-27 |
| FR3141269B1 (fr) | 2025-10-24 |
| FR3141269A1 (fr) | 2024-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10869003B2 (en) | Using a scene illuminating infrared emitter array in a video monitoring camera for depth determination | |
| US12096156B2 (en) | Customizable intrusion zones associated with security systems | |
| US10008003B2 (en) | Simulating an infrared emitter array in a video monitoring camera to construct a lookup table for depth determination | |
| US10306157B2 (en) | Using images of a monitored scene to identify windows | |
| US10891839B2 (en) | Customizable intrusion zones associated with security systems | |
| US9554064B2 (en) | Using a depth map of a monitored scene to identify floors, walls, and ceilings | |
| US9626849B2 (en) | Using scene information from a security camera to reduce false security alerts | |
| US11195408B1 (en) | Sending signals for help during an emergency event | |
| US10511810B2 (en) | Accessing cameras of audio/video recording and communication devices based on location | |
| US20180035085A1 (en) | Incentivizing activation of audio/video recording and communication devices | |
| US9886620B2 (en) | Using a scene illuminating infrared emitter array in a video monitoring camera to estimate the position of the camera | |
| US10930126B1 (en) | Motion sensing for electronic devices | |
| US20180308328A1 (en) | Automatic adjusting of day-night sensitivity for motion detection in audio/video recording and communication devices | |
| US20180151039A1 (en) | Neighborhood Security Cameras | |
| US11659144B1 (en) | Security video data processing systems and methods | |
| US11302156B1 (en) | User interfaces associated with device applications | |
| US10914811B1 (en) | Locating a source of a sound using microphones and radio frequency communication | |
| WO2016201357A1 (fr) | Utilisation des images infrarouge d'un lieu surveillé pour identifier de fausses zones d'alerte | |
| EP4606178A1 (fr) | Procédé de délimitation de zone d'intérêt dans une image thermique | |
| US10582130B1 (en) | System and method for connecting a network camera | |
| EP4083855A1 (fr) | Procédé de configuration de zones d'intérêts dans une image et son détecteur de présence | |
| EP3308365B1 (fr) | Utilisation des images infrarouge d'un lieu surveillé pour identifier de fausses zones d'alerte | |
| EP4266253B1 (fr) | Utilisation des images infrarouge d'un lieu surveillé pour identifier de fausses zones d'alerte |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23790362 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023790362 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2023790362 Country of ref document: EP Effective date: 20250521 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2023790362 Country of ref document: EP |