[go: up one dir, main page]

WO2021236089A1 - Système et procédé d'identification d'emplacements de salariés utilisant une rfid et une caméra - Google Patents

Système et procédé d'identification d'emplacements de salariés utilisant une rfid et une caméra Download PDF

Info

Publication number
WO2021236089A1
WO2021236089A1 PCT/US2020/034056 US2020034056W WO2021236089A1 WO 2021236089 A1 WO2021236089 A1 WO 2021236089A1 US 2020034056 W US2020034056 W US 2020034056W WO 2021236089 A1 WO2021236089 A1 WO 2021236089A1
Authority
WO
WIPO (PCT)
Prior art keywords
rfid
image
scanners
reference images
same
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2020/034056
Other languages
English (en)
Inventor
Shoji Yunoki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi America Ltd
Original Assignee
Hitachi America Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi America Ltd filed Critical Hitachi America Ltd
Priority to PCT/US2020/034056 priority Critical patent/WO2021236089A1/fr
Publication of WO2021236089A1 publication Critical patent/WO2021236089A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06398—Performance of employee with respect to a job function
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/04—Manufacturing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30—Services specially adapted for particular environments, situations or purposes
    • H04W4/33—Services specially adapted for particular environments, situations or purposes for indoor environments, e.g. buildings
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30—Computing systems specially adapted for manufacturing

Definitions

  • the present disclosure relates generally to factory and manufacturing floors, and more specifically, to worker location identification through using a system involving Radio Frequency Identification (RFID) and one or more cameras.
  • RFID Radio Frequency Identification
  • RFIDs are used to track objects.
  • a RFID scanner scans a RFID
  • the RFID is considered to be around or in proximity to the RFID scanner. If the worker wears a RFID and RFID scanners are associated with the specific process, such related art implementations can thereby determine how much time someone spends operating a given process.
  • aspects of the present disclosure involve a method for a system involving a camera and a plurality of Radio Frequency Identifier (RFID) scanners, the method involving, taking an image with the camera.
  • RFID Radio Frequency Identifier
  • the method involves executing image recognition on the image against reference images associated with a pair of the more than one of the plurality of RFID scanners and the same RFID to score the reference images against the image, and selecting a highest scored reference images from the reference images scored by the image recognition to identify the RFID scanner from the more than one of the plurality of RFID scanners to associate with the same RFID.
  • aspects of the present disclosure can involve a computer program, storing instructions for a system involving a camera and a plurality of Radio Frequency Identifier (RFID) scanners, the computer instructions involving, taking an image with the camera.
  • the instructions further involve executing image recognition on the image against reference images associated with a pair of the more than one of the plurality of RFID scanners and the same RFID to score the reference images against the image, and selecting a highest scored reference images from the reference images scored by the image recognition to identify the RFID scanner from the more than one of the plurality of RFID scanners to associate with the same RFID.
  • the instructions for the computer program can be stored in a non-transitory computer readable medium and executed by one or more processors.
  • aspects of the present disclosure involve a system involving a camera and a plurality of Radio Frequency Identifier (RFID) scanners, means for taking an image with the camera; and for more than one of the plurality of RFID scanners detecting a same RFID, means for executing image recognition on the image against reference images associated with a pair of the more than one of the plurality of RFID scanners and the same RFID to score the reference images against the image, and means for selecting a highest scored reference images from the reference images scored by the image recognition to identify the RFID scanner from the more than one of the plurality of RFID scanners to associate with the same RFID.
  • RFID Radio Frequency Identifier
  • aspects of the present disclosure can involve a server managing a system involving a camera and a plurality of Radio Frequency Identifier (RFID) scanners, the server involving a processor, configured to, take an image with the camera.
  • the processor can be configured to execute image recognition on the image against reference images associated with a pair of the more than one of the plurality of RFID scanners and the same RFID to score the reference images against the image; and select a highest scored reference images from the reference images scored by the image recognition to identify the RFID scanner from the more than one of the plurality of RFID scanners to associate with the same RFID.
  • FIG. 1 illustrates the system architecture of the worker location identification system, in accordance with an example implementation.
  • FIG. 2 illustrates an example physical placement of RFID scanners and RFIDs, in accordance with an example implementation.
  • FIG. 3 illustrates an example structure of the worker process image database, in accordance with an example implementation.
  • FIG. 4 illustrates an RFID coverage table, in accordance with an example implementation.
  • FIG. 5 illustrates an example image captured by the camera the coverage of each RFID scanner as indicated by the RFID scanners coverage in the image captured by camera.
  • FIG. 6 illustrates an example operational flow of RFID based worker process identifier, in accordance with an example implementation.
  • FIG. 7 illustrates an example operational flow of the image based worker identifier, in accordance with an example implementation.
  • FIG. 8 illustrates another example of the worker process identification server, in accordance with an example implementation.
  • FIG. 9 illustrates an RFID scanner relation table, in accordance with an example implementation.
  • FIG. 10 illustrates an example operational flow of RFID based worker process identifier, in accordance with an example implementation.
  • FIG. 11 illustrates an operational flow of image based worker identifier, in accordance with an example implementation.
  • FIG. 12 illustrates an example computing environment with an example computer device suitable for use in some example implementations.
  • DETAILED DESCRIPTION
  • Example implementations described herein involve a location identification system which involves not only RFID scanners, but also images captured by one or more cameras installed on a factory shop floor.
  • each RFID is associated with each worker.
  • the example implementations described herein use image recognition as follows.
  • the example implementations use both reference images stored in a database (DB) and real-time images captured by one or more cameras.
  • the DB stores the images for each pair of each RFID(worker) and each RFID scanner(process area) in advance.
  • the example implementations pull each reference image which is associated with the RFID(worker) and the RFID scanner(process area).
  • the example implementations For each pair of the RFID and each RFID scanner, the example implementations pull the real-time image from the camera and extract the portions that are associated with the RFID and the RFID scanner. Then, the example implementations calculate the similarity of the reference image and the real-time extracted image applying an image recognition algorithm. The example implementations select an RFID and RFID scanner pair having a highest similarity. The example implementations then recognize that the worker who wears the RFID is working around the RFID scanner and the process associated therewith. [0025] Described herein is a first example implementation.
  • FIG. 1 illustrates the system architecture of the worker location identification system, in accordance with an example implementation.
  • RFIDs (101,102, etc.) are worn by workers on the factory shop floor.
  • the RFIDs (101,102, etc.) are scanned by RFID scanners (111, 112, etc.) when the RFIDs are within the scanning range.
  • the RFID scanners 111, 112, the camera 141, and the worker process identification server 131 are connected to the communication network 121.
  • the RFID information scanned by the RFID scanners 111, 112 is sent to the worker process identification server 131.
  • the real-time captured images are sent to the worker process identification server 131.
  • Worker process identification server 131 can include RFID based worker identifier 132, Image based worker identifier 133, worker process image database 134 and RFID coverage table 135. The functions of the work process identification server are described later with their operational flow chart.
  • FIG. 2 illustrates an example physical placement of RFID scanners and RFIDs, in accordance with an example implementation.
  • Each worker wears an RFID which is encoded with the worker of the ID.
  • worker 1 wears RFID 1
  • worker 2 wears RFID 2.
  • RFID scanners 111, 112, 113, 114, 115, 116, 117 are installed around the area, wherein each ID of the scanner is associated with a process being conducted.
  • the worker 1 who wears RFID 1 (101) is working around process 5 area
  • the worker 2 wearing RFID 2 (102) is working around process 4 area.
  • FIG. 3 illustrates an example structure of the worker process image database 134, in accordance with an example implementation.
  • the worker process image database 134 stores one or more reference images for each RFID scanner ID and a RFID ID.
  • Each worker process image is a reference image of a worker who wears the RFID corresponding to the worker ID and is working on the process corresponding of a process ID for a RFID scanner.
  • image 3-2 is the reference image which shows the worker 3 who wear RFID 3 is working on process 2 (which is associated with RFID scanner 2).
  • the reference images are taken and stored in advance.
  • FIG. 4 illustrates an RFID coverage table, in accordance with an example implementation.
  • This table stores the relationship of each RFID scanner and the coverage area within the image captured by the one or more cameras 141.
  • RFID scanner ID 401 indicates the RFID scanner ID corresponding to the process ID.
  • Selected area of image 402 indicates coordinates to extract a specific part out of the image captured by the camera. Referring to the table regarding RFID scanner ID 1, the top left coordinate, bottom right coordinate, top right coordinate, and bottom right coordinate of the part to be extracted out of the image are (xll,yll), (x21,y21), (x31,y31), (x41,y41).
  • FIG. 5 illustrates an example image captured by the camera the coverage of each RFID scanner as indicated by the RFID scanners coverage in the image captured by camera.
  • FIG. 6 illustrates an example operational flow of RFID based worker process identifier, in accordance with an example implementation.
  • the worker process identification server 131 pulls all of RFID information scanned by RFID scanners (111 — 117).
  • the worker process identification server 131 identifies each of the corresponding RFID scanner that scanned each RFID.
  • the worker process identification server 131 inputs pairs of RFID and scanner IDs[] to the Image based worker identifier 133.
  • [] means array to store multiple values.
  • FIG. 7 illustrates an example operational flow of the image based worker identifier 133, in accordance with an example implementation.
  • the server checks if there are any pairs of RFID and scanner IDs being input. If the output of 701 is YES, the server proceeds to 702. In the output of 701 is NO, the server proceeds to 701 again.
  • the system assigns 1 to variable “i”, then proceeds to 703.
  • the server gets a reference image by searching worker process image database using RFID i and scanner ID[j] as keys, and then proceeds to 707.
  • the server gets a current image from the camera 141 and extracts the related portion out of the image according to scanner ID[j] coverage are as acquired by searching RFID cover area table using scanner ID[j] as a key.
  • the server calculates the similarity of the reference image and the extracted current image, stores it in the array of similarity!]], then proceeds to 709.
  • the server increments] by 1 and then proceeds to 705.
  • the server increments I by 1, and then proceeds to 703.
  • the server pulls all of the RFID information scanned by RFID scanner and identifies which scanner each RFID is scanned by at 601, 602. In this case, assume that RFID 1 is scanned by RFID scanner 4, 5, 7 and RFID 2 is scanned by RFID scanner 1, 4, 5. In 303, the server inputs pairs of RFID and RFID scanner IDs as follows, to the image based worker identifier 133.
  • the server checks if there are any RFID and scanner IDs being input, at 701. In this case, the output at 701 is YES, therefore, the server proceeds to 702. At 702, the server assigns 1 to variable i, then proceeds to 703. At 703, the server checks if RFID i is scanned and i ⁇ N.
  • N is defined as the maximum number of workers, wherein N is 7 in this example.
  • i equals to 1, therefore, the server proceeds to 704.
  • the server assigns 0 to j and proceeds to 705.
  • the server checks if a value is stored in RFID scanner IDs[]]. Now, RFID scanner IDs[0] has 1 as a value, therefore, the output of 705 is YES, and then the server proceeds to 706.
  • the server gets reference image by searching worker process image database using RFID I and scanner ID [j] as keys. Now, RFID i is RFID 0, and RFID scanner ID[j] is 4, therefore reference image 1-4 is pulled by referring to worker process image database, and then the server proceeds to 707.
  • the server gets a current image from the camera and extracts the related part out of the image according to the coverage area of RFID[j] as acquired by searching the RFID coverage table using RFID scanner ⁇ D[j] as a key.
  • RFID scanner ID[j] is 4. Therefore, referring to the RFID scanner coverage table, the part defined by coordinates (xl4,yl4), (x24,y24), (x34,y34), (x44, y44) is extracted from the image captured by camera. Then the server proceeds to 708.
  • the server calculates the similarity of the reference image and the extracted current image and stores it in similarity!]] by applying any desired image recognition algorithm as known in the art, such as perceptual hash.
  • the calculated similarity [0] 0.5.
  • the server increments] by 1 and then the server proceeds to 705, again.
  • output is NO, so then the server proceeds to 710.
  • RFID i is RFID 1
  • similarity [1] 0.7
  • RFID scanner ID[1] is RFID scanner 4 is stored as a correct scanner for RFID 1.
  • the work process identification server can also include a RFID scanner relation table.
  • the RFID scanner relation table indicates the physical locational relations between the RFID scanners. When a RFID is scanned by multiple RFID scanners, the server weighs the similarity of the images according to the RFID scanner relation table.
  • FIG. 8 illustrates another example of the worker process identification server, in accordance with an example implementation.
  • the worker process identification server 131 additionally includes an RFID scanner relation table 801.
  • FIG. 9 illustrates an RFID scanner relation table, in accordance with an example implementation.
  • the RFID scanner relation table shows the physical locational relation between RFID scanners. This table involves RFID scanner ID and Neighbor RFID scanner IDs. Based on the example of FIG. 2 which shows the physical location of each RFID scanner, the neighboring RFID scanner of RFID scanner 1 is RFID scanner 4, and neighboring RFID scanners of RFID scanner 4 is RFID scanner 1 and 5. As illustrated in FIG. 9, the weights are determined between RFID scanners, wherein the weight is based on a value regarding how many times the RFIDs were triggered together when it is supposed to be a particular RFID scanner for a particular RFID.
  • RFID scanner 4 has detected an RFID together with neighboring RFID scanners 1 and 5.
  • RFID scanners 4, 5 and 7 detect the same RFID.
  • RFID scanner 4 has an extra weight value (e.g., +1) based on historically detecting together with RFID scanner 5.
  • RFID scanner 5 will have an extra weight value (e.g., +2) based on historically being detected together with RFID scanners 4 and 7.
  • FIG. 10 illustrates an example operational flow of RFID based worker process identifier, in accordance with an example implementation.
  • the server input pairs of RFID, scanner IDs[] and scanner ID weights[] calculated by referring to RFID scanner relation table, to the Image based worker identifier.
  • the RFID ID and RFID scanner IDs to be input to the image based worker identifier are as follows.
  • RFID scanner ID weights[] are calculated by referring to the RFID scanner relation table as shown in FIG. 9.
  • the server refers to the columns whose RFID scanner ID is stored in RFID scanner IDs[] and counts how many times each of those RFID scanner IDs[] appears in the columns.
  • the count of 4, 5 and 7 are 2, 3 and 2 respectively.
  • the server converts counts into weights.
  • an example conversion rule is as follows.
  • FIG. 11 illustrates an operational flow of image based worker identifier, in accordance with an example implementation.
  • the server calculates weighted similarity of the reference image and the extracted current image referring to scanner ID weights[] and store it in similarity!]].
  • the calculated similarity for RFID:1, RFID scanner ID:4 is 0.5.
  • FIG. 12 illustrates an example computing environment with an example computer device suitable for use in some example implementations, such as the server 131 managing the system involving a camera and a plurality of Radio Frequency Identifier (RFID) scanners as illustrated in FIG. 1 and FIG. 2.
  • Computer device 1205 in computing environment 1200 can include one or more processing units, cores, or processors 1210, memory 1215 (e.g., RAM, ROM, and/or the like), internal storage 1220 (e.g., magnetic, optical, solid state storage, and/or organic), and/or IO interface 1225, any of which can be coupled on a communication mechanism or bus 1230 for communicating information or embedded in the computer device 1205.
  • IO interface 1225 is also configured to receive images from cameras or provide images to projectors or displays, depending on the desired implementation.
  • Computer device 1205 can be communicatively coupled to input/user interface 1235 and output device/interface 1240. Either one or both of input/user interface 1235 and output device/interface 1240 can be a wired or wireless interface and can be detachable.
  • Input/user interface 1235 may include any device, component, sensor, or interface, physical or virtual, that can be used to provide input (e.g., buttons, touch-screen interface, keyboard, a pointing/cursor control, microphone, camera, braille, motion sensor, optical reader, and/or the like).
  • Output device/interface 1240 may include a display, television, monitor, printer, speaker, braille, or the like.
  • input/user interface 1235 and output device/interface 1240 can be embedded with or physically coupled to the computer device 1205.
  • other computer devices may function as or provide the functions of input/user interface 1235 and output device/interface 1240 for a computer device 1205.
  • Examples of computer device 1205 may include, but are not limited to, highly mobile devices (e.g., smartphones, devices in vehicles and other machines, devices carried by humans and animals, and the like), mobile devices (e.g., tablets, notebooks, laptops, personal computers, portable televisions, radios, and the like), and devices not designed for mobility (e.g., desktop computers, other computers, information kiosks, televisions with one or more processors embedded therein and/or coupled thereto, radios, and the like).
  • highly mobile devices e.g., smartphones, devices in vehicles and other machines, devices carried by humans and animals, and the like
  • mobile devices e.g., tablets, notebooks, laptops, personal computers, portable televisions, radios, and the like
  • devices not designed for mobility e.g., desktop computers, other computers, information kiosks, televisions with one or more processors embedded therein and/or coupled thereto, radios, and the like.
  • Computer device 1205 can be communicatively coupled (e.g., via IO interface 1225) to external storage 1245 and network 1250 for communicating with any number of networked components, devices, and systems, including one or more computer devices of the same or different configuration.
  • Computer device 1205 or any connected computer device can be functioning as, providing services of, or referred to as a server, client, thin server, general machine, special-purpose machine, or another label.
  • IO interface 1225 can include, but is not limited to, wired and/or wireless interfaces using any communication or IO protocols or standards (e.g., Ethernet, 802.1 lx, Universal System Bus, WiMax, modem, a cellular network protocol, and the like) for communicating information to and/or from at least all the connected components, devices, and network in computing environment 1200.
  • Network 1250 can be any network or combination of networks (e.g., the Internet, local area network, wide area network, a telephonic network, a cellular network, satellite network, and the like).
  • Computer device 1205 can use and/or communicate using computer-usable or computer-readable media, including transitory media and non-transitory media.
  • Transitory media include transmission media (e.g., metal cables, fiber optics), signals, carrier waves, and the like.
  • Non-transitory media include magnetic media (e.g., disks and tapes), optical media (e.g., CD ROM, digital video disks, Blu-ray disks), solid state media (e.g., RAM, ROM, flash memory, solid-state storage), and other non-volatile storage or memory.
  • Computer device 1205 can be used to implement techniques, methods, applications, processes, or computer-executable instructions in some example computing environments.
  • Computer-executable instructions can be retrieved from transitory media, and stored on and retrieved from non-transitory media.
  • the executable instructions can originate from one or more of any programming, scripting, and machine languages (e.g., C, C++, C#, Java, Visual Basic, Python, Perl, JavaScript, and others).
  • Processor(s) 1210 can execute under any operating system (OS) (not shown), in a native or virtual environment.
  • OS operating system
  • One or more applications can be deployed that include logic unit 1260, application programming interface (API) unit 1265, input unit 1270, output unit 1275, and inter-unit communication mechanism 1295 for the different units to communicate with each other, with the OS, and with other applications (not shown).
  • API application programming interface
  • Processor(s) 1210 can be in the form of hardware processors such as central processing units (CPUs) or in a combination of hardware and software units.
  • API unit 1265 when information or an execution instruction is received by API unit 1265, it may be communicated to one or more other units (e.g., logic unit 1260, input unit 1270, output unit 1275).
  • logic unit 1260 may be configured to control the information flow among the units and direct the services provided by API unit 1265, input unit 1270, output unit 1275, in some example implementations described above.
  • the flow of one or more processes or implementations may be controlled by logic unit 1260 alone or in conjunction with API unit 1265.
  • the input unit 1270 may be configured to obtain input for the calculations described in the example implementations
  • the output unit 1275 may be configured to provide output based on the calculations described in example implementations.
  • processor(s) 1210 can be configured to, take an image with the camera. For more than one of the plurality of RFID scanners detecting a same RFID, processor(s) 1210 can be configured to execute image recognition on the image against reference images associated with a pair of the more than one of the plurality of RFID scanners and the same RFID to score the reference images against the image, and select a highest scored reference images from the reference images scored by the image recognition to identify the RFID scanner from the more than one of the plurality of RFID scanners to associate with the same RFID.
  • the image recognition is conducted only when the same RFID is detected by more than one of the RFID scanners to eliminate the need to conduct image recognition continuously, thereby reducing the number or reference images needed to be used for the recognition to save processing power, and also narrowing the image recognition of the reference images to those associated with the corresponding RFID scanners, thereby improving the image recognition accuracy and efficiency.
  • the taking the image with the camera can occur continuously, or can also be triggered such that the camera only takes images when the same RFID is detected by more than one of the RFID scanners.
  • each of the plurality of RFID scanners can be associated with a manufacturing process, and wherein each RFID in the database is associated with a worker.
  • memory 1215 and processor(s) 1210 can be configured to manage a database configured to store reference images for pairs involving an RFID and an RFID scanner from the plurality of RFID scanners.
  • the score on the reference images can be weighted based on a how often each of the more than one of the plurality of RFID scanners detected RFIDs together with other ones of the more than one of the plurality of RFID scanners.
  • the system can determine which worker is working on which process in a real time manner with RFID scanners, while resolving duplicate detections from RFID scanners.
  • Processor(s) 1210 can be configured to execute the image recognition on the image against the reference images associated with the pair of the more than one of the plurality of RFID scanners and the same RFID to score the reference images against the image by extracting a portion of the image associated with each of the more than one of the plurality of RFID scanners based on a location of a physical coverage area of the each of the more than one of the plurality of RFID scanners; and executing the image recognition on the portion of the image against ones of the reference images associated with the pair of the each of the more than one of the plurality of RFID scanners and the same RFID as illustrated at FIGS. 4, 5, 7, and 11.
  • Example implementations may also relate to an apparatus for performing the operations herein.
  • This apparatus may be specially constructed for the required purposes, or it may include one or more general-purpose computers selectively activated or reconfigured by one or more computer programs.
  • Such computer programs may be stored in a computer readable medium, such as a computer-readable storage medium or a computer-readable signal medium.
  • a computer-readable storage medium may involve tangible mediums such as, but not limited to optical disks, magnetic disks, read-only memories, random access memories, solid state devices and drives, or any other types of tangible or non-transitory media suitable for storing electronic information.
  • a computer readable signal medium may include mediums such as carrier waves.
  • the algorithms and displays presented herein are not inherently related to any particular computer or other apparatus.
  • Computer programs can involve pure software implementations that involve instructions that perform the operations of the desired implementation.
  • the operations described above can be performed by hardware, software, or some combination of software and hardware.
  • Various aspects of the example implementations may be implemented using circuits and logic devices (hardware), while other aspects may be implemented using instructions stored on a machine-readable medium (software), which if executed by a processor, would cause the processor to perform a method to carry out implementations of the present application.
  • some example implementations of the present application may be performed solely in hardware, whereas other example implementations may be performed solely in software.
  • the various functions described can be performed in a single unit, or can be spread across a number of components in any number of ways.
  • the methods may be executed by a processor, such as a general purpose computer, based on instructions stored on a computer-readable medium. If desired, the instructions can be stored on the medium in a compressed and/or encrypted format.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Multimedia (AREA)
  • Educational Administration (AREA)
  • Development Economics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • General Health & Medical Sciences (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Quality & Reliability (AREA)
  • Medical Informatics (AREA)
  • Game Theory and Decision Science (AREA)
  • Operations Research (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Manufacturing & Machinery (AREA)
  • Primary Health Care (AREA)
  • Studio Devices (AREA)

Abstract

La présente invention a pour objet, dans des modes de réalisation décrits à titre d'exemple, d'apporter une résolution pour des cas où de multiples lecteurs d'identification par radiofréquence (RFID) détectent physiquement le même RFID dans un environnement tel qu'un atelier de fabrication. De tels modes de réalisation peuvent par exemple faire intervenir les étapes consistant, pour de multiples lecteurs de la pluralité de lecteurs RFID détectant un même RFID, à prendre une image avec la caméra; à exécuter une reconnaissance d'image sur l'image vis-à-vis d'images de référence associées à une paire des multiples lecteurs parmi la pluralité de lecteurs RFID et au même RFID pour noter les images de référence vis-à-vis de l'image; et à sélectionner une image de référence présentant la note la plus élevée parmi les images de référence notées par la reconnaissance d'image pour identifier le lecteur RFID, parmi les multiples lecteurs de la pluralité de lecteurs RFID, à associer au même RFID.
PCT/US2020/034056 2020-05-21 2020-05-21 Système et procédé d'identification d'emplacements de salariés utilisant une rfid et une caméra Ceased WO2021236089A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2020/034056 WO2021236089A1 (fr) 2020-05-21 2020-05-21 Système et procédé d'identification d'emplacements de salariés utilisant une rfid et une caméra

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2020/034056 WO2021236089A1 (fr) 2020-05-21 2020-05-21 Système et procédé d'identification d'emplacements de salariés utilisant une rfid et une caméra

Publications (1)

Publication Number Publication Date
WO2021236089A1 true WO2021236089A1 (fr) 2021-11-25

Family

ID=78707464

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2020/034056 Ceased WO2021236089A1 (fr) 2020-05-21 2020-05-21 Système et procédé d'identification d'emplacements de salariés utilisant une rfid et une caméra

Country Status (1)

Country Link
WO (1) WO2021236089A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060022800A1 (en) * 2004-07-30 2006-02-02 Reva Systems Corporation Scheduling in an RFID system having a coordinated RFID tag reader array
US20070001813A1 (en) * 2005-07-01 2007-01-04 Thingmagic, Inc. Multi-reader coordination in RFID system
US20120019399A1 (en) * 2010-07-22 2012-01-26 Rob Vargo Method and system for correctly identifying specific rfid tags
US20120161968A1 (en) * 2010-12-24 2012-06-28 Sujatha Bodapati Systems and methods to detect cross reads in RFID tags
US20130307988A1 (en) * 2011-01-20 2013-11-21 Innovative Timing Systems, Llc Rfid tag read triggered image and video capture event timing method
US20140052555A1 (en) * 2011-08-30 2014-02-20 Digimarc Corporation Methods and arrangements for identifying objects
US20160026834A1 (en) * 2013-03-15 2016-01-28 Wal-Mart Stores, Inc. Rfid reader location self-discovery

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060022800A1 (en) * 2004-07-30 2006-02-02 Reva Systems Corporation Scheduling in an RFID system having a coordinated RFID tag reader array
US20070001813A1 (en) * 2005-07-01 2007-01-04 Thingmagic, Inc. Multi-reader coordination in RFID system
US20120019399A1 (en) * 2010-07-22 2012-01-26 Rob Vargo Method and system for correctly identifying specific rfid tags
US20120161968A1 (en) * 2010-12-24 2012-06-28 Sujatha Bodapati Systems and methods to detect cross reads in RFID tags
US20130307988A1 (en) * 2011-01-20 2013-11-21 Innovative Timing Systems, Llc Rfid tag read triggered image and video capture event timing method
US20140052555A1 (en) * 2011-08-30 2014-02-20 Digimarc Corporation Methods and arrangements for identifying objects
US20160026834A1 (en) * 2013-03-15 2016-01-28 Wal-Mart Stores, Inc. Rfid reader location self-discovery

Similar Documents

Publication Publication Date Title
US11222239B2 (en) Information processing apparatus, information processing method, and non-transitory computer-readable storage medium
US8908911B2 (en) Redundant detection filtering
US9418319B2 (en) Object detection using cascaded convolutional neural networks
US10580206B2 (en) Method and apparatus for constructing three-dimensional map
KR101385599B1 (ko) 몽타주 추론 방법 및 장치
KR20200098875A (ko) 3ｄ 얼굴인식 시스템 및 방법
CN110598559B (zh) 检测运动方向的方法、装置、计算机设备和存储介质
US10984249B2 (en) Information processing apparatus, system, control method for information processing apparatus, and non-transitory computer readable storage medium
US20140126819A1 (en) Region of Interest Based Image Registration
JP7483095B2 (ja) 産業システムのための多目的異常検出システム
US20180295273A1 (en) Device and method for detecting regions in an image
US20190215562A1 (en) Using wifi-signal based, device-free human presence detection technology to identify humans consuming media content
JP6305856B2 (ja) 画像処理装置、画像処理方法、およびプログラム
US10339412B2 (en) Image processing apparatus, image processing method, and storage medium
US11617024B2 (en) Dual camera regions of interest display
US20170344820A1 (en) Method and system of identifying fillable fields of an electronic form
CN108353210A (zh) 处理方法与终端
CN109871249B (zh) 一种远程桌面操作方法、装置、可读存储介质及终端设备
US20180197000A1 (en) Image processing device and image processing system
WO2021236089A1 (fr) Système et procédé d'identification d'emplacements de salariés utilisant une rfid et une caméra
US20140231523A1 (en) Electronic device capable of recognizing object
CN114630102A (zh) 检测数据采集设备角度变化的方法、装置和计算机设备
KR20220002626A (ko) 픽쳐 기반의 다차원 정보 통합 방법 및 관련 기기
US11663752B1 (en) Augmented reality processing device and method
EP3644627B1 (fr) Système et procédé de détection holistique

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20937119

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20937119

Country of ref document: EP

Kind code of ref document: A1