[go: up one dir, main page]

WO2007127556A1 - Methods and apparatus for visual tracking of rf elements - Google Patents

Methods and apparatus for visual tracking of rf elements Download PDF

Info

Publication number
WO2007127556A1
WO2007127556A1 PCT/US2007/064768 US2007064768W WO2007127556A1 WO 2007127556 A1 WO2007127556 A1 WO 2007127556A1 US 2007064768 W US2007064768 W US 2007064768W WO 2007127556 A1 WO2007127556 A1 WO 2007127556A1
Authority
WO
WIPO (PCT)
Prior art keywords
network
field
camera element
view
wireless devices
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2007/064768
Other languages
French (fr)
Inventor
Anthony Frank Bartolo
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Symbol Technologies LLC
Original Assignee
Symbol Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Symbol Technologies LLC filed Critical Symbol Technologies LLC
Publication of WO2007127556A1 publication Critical patent/WO2007127556A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19678User interface
    • G08B13/19682Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19697Arrangements wherein non-video detectors generate an alarm themselves
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/22Electrical actuation
    • G08B13/24Electrical actuation by interference with electromagnetic field distribution
    • G08B13/2402Electronic Article Surveillance [EAS], i.e. systems using tags for detecting removal of a tagged item from a secure area, e.g. tags for detecting shoplifting
    • G08B13/2451Specific applications combined with EAS
    • G08B13/2462Asset location systems combined with EAS
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/22Electrical actuation
    • G08B13/24Electrical actuation by interference with electromagnetic field distribution
    • G08B13/2402Electronic Article Surveillance [EAS], i.e. systems using tags for detecting removal of a tagged item from a secure area, e.g. tags for detecting shoplifting
    • G08B13/2465Aspects related to the EAS system, e.g. system components other than tags
    • G08B13/248EAS system combined with another detection technology, e.g. dual EAS and video or other presence detection system

Definitions

  • the present invention relates generally to radio frequency identification (RFID) systems, wireless local area networks (WLANs), and any other network incorporating RF elements, and, more particularly, to visual tracking of RF elements.
  • RFID radio frequency identification
  • WLANs wireless local area networks
  • Radio frequency identification (RFID) systems have achieved wide popularity in a number of applications, as they provide a cost-effective way to track the location of a large number of assets in real time.
  • RFID tags may exist in the environment.
  • multiple RFID readers are typically distributed throughout the space in the form of entryway readers, conveyer-belt readers, mobile readers, etc., and may be linked by network controller switches and the like.
  • WLANs wireless local area networks
  • a graphical management system comprises: a web browser application communicatively coupled to a web service and a graphical management module over a network; a plurality of wireless devices coupled to the network and having one or more associated antennae, the wireless devices configured to process data received from a plurality of RF elements within range of the antennae; an RF switch coupled to the network and configured to receive the data and transmit the data to the graphical management module; and a camera element coupled to the network and having a field of view that includes at least one of the RF elements, the camera element configured to provide a real-time video image of the field of view to the web browser.
  • FIG. 1 is a conceptual overview of a system in accordance with an exemplary embodiment of the present invention
  • FIG. 2 is a conceptual overview of an exemplary RF switch in accordance with one embodiment
  • FIG. 3 depicts various functional domains of the present invention.
  • FIG. 4 depicts various components of an exemplary system in accordance with the present invention.
  • FIG. 5 depicts an exemplary display in the context of a web browser showing the position of networked sites
  • FIG. 6 depicts an exemplary display in the context of a web browser showing live mapping of network objects at a site
  • FIG. 7 depicts an exemplary display in the context of a web browser showing information for a particular object at a site
  • FIG. 8 depicts an exemplary display in the context of a web browser showing the location of particular mobile units or RFID tags at a site;
  • FIG. 9 depicts an exemplary display in the context of a web browser showing a camera image at a particular location within a site
  • FIG. 10 depicts an exemplary display in the context of a web browser showing the relationship between various access ports within a self-healing group
  • FIG. 11 depicts an exemplary display in the context of a web browser showing device information
  • FIG. 12 depicts an exemplary display in the context of a web browser showing wireless statistics
  • FIG. 13 depicts an exemplary display in the context of a web browser showing
  • FIG. 14 depicts an exemplary display in the context of a web browser showing intrusion detection at a site
  • FIGS. 15A-15C depict various configurations of camera elements associated with wireless devices.
  • the invention may be described herein in terms of functional and/or logical block components and various processing steps. It should be appreciated that such block components may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions.
  • an embodiment of the invention may employ various integrated circuit components, e.g., radio-frequency (RF) devices, memory elements, digital signal processing elements, logic elements, lookup tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices.
  • RF radio-frequency
  • a traditional access point e.g., network management, wireless configuration, etc.
  • traditional RFID readers e.g., data collection, RFID processing, etc.
  • the present invention relates to an improved user interface for real-time location determination, configuration, and coordination of RFID as well as WLAN components.
  • the system provides user-friendly methods of determining the location of objects, such as RFID tags and mobile units, and provides various health monitoring information (self-healing status, "heat maps" for associated antennae, redundancy group status, intrusion detection, and health statistics).
  • a switching device 110 (alternatively referred to as an "RF switch” or simply “switch”) is coupled to a networks 101 and 104 (e.g., an Ethernet network coupled to one or more other networks or devices) which communicates with one or more enterprise applications 105.
  • One or more wireless access ports 120 (alternatively referred to as “access ports” or “APs”) are configured to wirelessly connect to one or more mobile units 130 (or “MUs").
  • APs 120 suitably communicate with switch 110 via appropriate communication lines 106 (e.g., conventional Ethernet lines, or the like). Any number of additional and/or intervening switches, routers, servers and other network components may also be present in the system.
  • a number of RFID tags (or simply “tags”) 104 are distributed throughout the environment. These tags are read by a number of RFID readers (or simply “readers”) 108 having one or more associated antennas 106 provided within the environment.
  • the term “tag” refers, in general, to any RF element that can be communicated with and has a ID that can be read by another component. Readers 108, each of which may be stationary or mobile, are suitably connective via wired or wireless data links to a RF switch 110.
  • a particular AP 120 may have a number of associated MUs 130.
  • MUs 130(a) and 130(b) are associated with AP 120(a), while MU 130(c) is associated with AP 120(b).
  • One or more APs 120 may be coupled to a single switch 110, as illustrated.
  • RF Switch 110 determines the destination of packets it receives over network 104 and 101 and routes those packets to the appropriate AP 120 if the destination is an MU 130 with which the AP is associated.
  • Each WS 1 10 therefore maintains a routing list of MUs 130 and their associated APs 130. These lists are generated using a suitable packet handling process as is known in the art.
  • each AP 120 acts primarily as a conduit, sending/receiving RF transmissions via MUs 130, and sending/receiving packets via a network protocol with WS 110.
  • AP 120 is typically capable of communicating with one or more MUs 130 through multiple RF channels. This distribution of channels varies greatly by device, as well as country of operation. For example, in one U.S. embodiment (in accordance with 802.1 l(b)) there are fourteen overlapping, staggered channels, each centered 5 MHz apart in the RF band.
  • a particular RFID reader 108 may have multiple associated antennas 106.
  • reader 108(a) is coupled to one antenna 106(a)
  • reader 108(b) is coupled to two antennas 106(b) and 106(c).
  • Reader 108 may incorporate additional functionality, such as filtering, cyclic-redundancy checks (CRC), and tag writing, as is known in the art.
  • CRC cyclic-redundancy checks
  • RFID tags may be classified as either active or passive.
  • Active tags are devices that incorporate some form of power source (e.g., batteries, capacitors, or the like), while passive tags are tags that are energized via an RF energy source received from a nearby antenna. While active tags are more powerful, and exhibit a greater range than passive tags, they also have a shorter lifetime and are significantly more expensive. Such tags are well known in the art, and need not be described in detail herein.
  • Each antenna 106 has an associated RF range (or "read point") 116, which depends upon, among other things, the strength of the respective antenna 106.
  • the read point 116 corresponds to the area around the antenna in which a tag 104 may be read by that antenna, and may be defined by a variety of shapes, depending upon the nature of the antenna (i.e., the RF range need not be circular or spherical as illustrated in FIG. 1).
  • switch 102 includes hardware, software, and/or firmware capable of carrying out the functions described herein.
  • switch 102 may comprise one or more processors accompanied by storage units, displays, input/output devices, an operating system, database management software, networking software, and the like.
  • Switch 102 may be configured as a general purpose computer, a network switch, or any other such network host.
  • controller 102 is modeled on a network switch architecture but includes RF network controller software (or "module") whose capabilities include, among other things, the ability to allow configure and monitor readers 108 and antennas 106.
  • RF switch 1 10 allows multiple read points 116 to be logically combined, via controller 102, within a single read point zone (or simply "zone").
  • a read point zone 120 may be defined by the logical union of read points 116(a), 116(b), and 116(c). Note that the read points need not overlap in physical space, and that disjoint read points (e.g., read point 116(d)) may also be included in the read point zone if desired.
  • antennas i.e., read points defined by the antennas
  • Controller 102 receives all tag data from readers 108 via respective data links 103 (e.g., wired communication links, 802.1 1 connections, or the like), then aggregates and filters this data based on zone information.
  • the read point zones are suitably preconfigured by a user or administrator. That is, the user is allowed to access controller 110 and, through a configuration mode, specify a set of read points that are to be included in a particular zone.
  • FIG. 2 depicts a conceptual block diagram of an RF switch 110.
  • switch 110 includes a cell controller (CC) 202, and a RFID network controller (RNC)
  • CC cell controller
  • RNC RFID network controller
  • RNC 204 includes hardware and software configured to handle RFID data communication and administration of the RFID network components
  • CC 202 includes hardware and software configured to handle wireless data (e.g., in accordance with IEEE 802.11) from the mobile units and access ports within wireless cells.
  • RF switch 110 includes a single unit with an enclosure containing the various hardware and software components necessary to perform the various functions of
  • Switch 110 also includes suitable input/output hardware interfaces to networks 101 and 104.
  • FIG. 3 illustrates, conceptually, the four major domains of an exemplary RF switch network - i.e., tag domain 302, reader domain 304, reader controller domain 306, and RFID-aware application domain 308.
  • Tag domain 302 comprises tags, tagged assets, and objects that require tracking and/or monitoring (e.g., tags 104 in FIG. 1). As mentioned previously, these tags may be active, passive, or a combination thereof.
  • Reader domain 304 includes, inter alia, physical antennas 106, readers 108, and APs 120. Objects in reader domain 304 acquire information from objects in tag domain 302 and pass associated data to reader controller domain 306.
  • Reader controller domain 306 comprises RNC objects.
  • RNC objects e.g., RNC objects
  • RNC 204 in FIG. 2 act as an integration point for RFID readers/antennae and include the functionality of filtering and aggregating volumes of data provided by readers 108, supporting the analysis of data and applying local decision making and intelligence.
  • RFID-aware application domain 308 includes one or more standalone applications and/or middleware applications that function as intermediaries between enterprise applications 105 and the RNC.
  • the applications within this domain rely on events on a higher level - i.e., events that are important in the context of a business operation or process.
  • FIG. 4 is a block diagram showing the components of an exemplary system corresponding to the various domains illustrated in FIG. 3.
  • system 400 generally includes an RFID reader 108, an RNC 204, and an application 105 communicating as shown.
  • Reader 108 includes one or more reader agents 306, an application programming interface (API) 304, and some core functionality 302. Reader 108, as mentioned above, is responsible for reading RFID tags (embodied within core functionality 302). For active tags read by an AP, switch 110 acts as an RFID reader and communicates the tag info to RNC 204. Reader agents 306 includes the interfaces through which RNC 204 communicates. This may include, for example, a proprietary interface, an SLRRP interface, other any other interface, such as dynamically-loadable modules for other protocols. In one embodiment, RFID reader 108 provides a C# API 304 for core RFID reader functionality 302, and reader agents 306 make use of this API. [0049] Reader 108 implements a suitable RNC discovery procedure.
  • API application programming interface
  • the reader first makes use of IP subnet broadcast. If no response is received, reader 108 refers to a list of statically configured RNCs 204 (which is preferably stored across reboots in the reader). If no response is received using this method, then reader 108 consults a discovered list of RNCE controllers (also stored across reboots in the reader). This list includes a list of RNCs 204 to which the reader had prior success in joining. If no response is received, Reader 108 uses a list of RNCs received in a DHCP offer (using option 43, known in the art).
  • RNC 204 includes one or more RFID reader managers 316, a data plane 312, a control plane 312, one or more RFID application agents 310, and a RNC configuration database 314.
  • RNC includes a set of processes, shared libraries, and the like running under Linux and a local operating system.
  • RFID reader managers 316 communicates with RFID reader 108 using any suitable interface, such as a proprietary interface, SLRRP, or the like.
  • RFID application agents 310 provide suitable interfaces, such as ALE, MQTT, JMS, SQL, IBM Premises Server Interface, or any other suitable interface.
  • Applications 105 includes an RFID-aware business application core 320 and an RFID application manager 318.
  • a user is provided a display and user interface (e.g., through a conventional web browser) that allows multiple sites and multiple RF elements to be monitored and managed remotely over a network.
  • Suitable software, hardware, and network services are provided in any appropriate host within the network (e.g., at RF switch 110) such that a user and/or administrator may establish a connection with that host via a client program (e.g., web browser) located on a computer system located elsewhere in the network.
  • a web browser application is communicatively coupled to a web service and a graphical management module over a network
  • the location of the graphical management module software may be within a networked component (e.g., the RF switch) or may be on a stand-alone computer provided somewhere within the network.
  • a networked component e.g., the RF switch
  • the nature of web services, browsers, and the like are well known in the art, and thus need not be described herein.
  • the various graphical elements and user interface details may be implemented using a variety of methods, protocols, and software tools (e.g., AJAX, CSS, etc.) but that the present invention is not so limited.
  • FIG. 5 depicts an exemplary display in the context of a web browser showing the position of networked sites within a geographical region.
  • a browser region 502 includes a map 506 of a geographical region (in this case, a map of a portion of North America) with sites indicated by site indicators (518, 510, 512, etc.) using any convenient graphical element.
  • a series of tabs 504 may be employed to allow navigation through the various images.
  • the tabs 504 are labeled “Live”, “Heat Map”, “Intrusion Detection”, “Self healing”, “Location”, and “All Sites.”
  • the illustrated image corresponds to the "All Sites” tab, wherein a plurality of network sites (each having one or more RF elements, switches, etc.) are superimposed over a two-dimensional map.
  • a standard zooming tool 514 and key 516 may also be provided.
  • the site indicators include visual cues that relate to the status of that site. For example, in the illustrated embodiment, one color or level of shading is used for sites at which a critical alarm/event has occurred (which may defined in any convenient fashion), while another color is used for sites at which no critical event has occurred. Additional information bubbles, mouse-over events, or other such visual indicators may be used to designate the location of the user (as with a "You are Here" bubble), or any other spatial feature of the network or user. In this way, the administrator may manage multiple sites and move from one site to another using this "master view".
  • a number of mapping tools may be used to create this image, including, for example, the Google and Yahoo brands of mapping tools.
  • FIG. 6 depicts an exemplary display in the context of a web browser showing live mapping of network objects at a site.
  • the display includes a site map 602 with various component indicators and other visual cues superimposed thereon.
  • Site map 602 preferably includes some structural details that allow the position of the various objects in space to be intuited. Such structural details might include, for example, rooms (e.g., room 603), walls (e.g., wall 604), windows, doors, shelving, etc.
  • Visual indicators are used to note the position of various network elements.
  • network switches 610, RF reader 608, and APs 606s are shown.
  • the invention is not so limited, however.
  • the visual indicators might include detailed representations of the actual units, stylized graphics, simple geometrical shapes, or any other suitable graphic.
  • the position of the various components may be determined in any convenient manner. Suitable techniques include, for example, trilateration (such as used with GPS systems), triangulation, zone aggregation, using information from multiple APs, RFID readers communicated over the network. RFID tags may be located based on business logic applied to the readers.
  • FIG. 7 depicts an exemplary display in the context of a web browser showing information for a particular object at a site, when a user clicks on or otherwise selects an indicator under the "Live" tab.
  • a pop-up window 702 may be displayed.
  • An assortment of information for a particular component may be included within the window, including, for example, the MAC address, number of associated MUs, Tx and Rx transmission history of an AP, or the like.
  • FIG. 8 depicts an exemplary display in the context of a web browser showing the location of particular RF elements (e.g., mobile units, RFID tags, or any other component that communicates via RF) within a site.
  • a series of concentric circles e.g., circles 802 may be displayed around particular antennas (associated with APs, readers, etc.).
  • the location of the RF element may not be known precisely, and the certainty of its position may be indicated by circles of different diameters.
  • the location of an MU is indicated by a circle 806, and in another embodiment (when the MU is perhaps of a different manufacture, or has other wireless characteristics) the location of the MU is indicated by a larger circle 804.
  • RFID tags and other RF elements may be similarly designated.
  • the user may search, select, or otherwise select the RF element whose position is to be displayed. This search may be based on MAC, IP address, RFID tag, or the like.
  • FIG. 9 depicts an exemplary display in the context of a web browser showing a camera image at a particular location within a site. That is, in the event that a camera is located at the site (e.g., attached to an AP, an MU, a reader, or standing alone) and attached to the network, a live streaming video of that cameras field of view may be called up into a separate window 902. Suitable camera controls may also be provided, allowing various object to be located visually in addition to the mapping provided by the web page.
  • FIG. 10 depicts an exemplary display in the context of a web browser showing the relationship between various access ports within a self-healing group under the "Self healing" tab. That is, various connectors (displayed using different colors for different neighborhood) may be superimposed on the map so that the administrator can check whether APs and antennae are configured as self-healing neighbors and whether they are acting in a normal mode or "healing" mode.
  • FIG. 11 depicts an exemplary display in the context of a web browser showing device information.
  • FIG. 12 depicts an exemplary display in the context of a web browser showing wireless statistics.
  • tabs for the current device (1102) and the redundancy group (1104) provide respective sets of graphics describing the state of the system. In this illustration, the switches and corresponding IP address are displayed (1108) along with bar charts showing the number of associated components (1110).
  • a hierarchical menu 1 106 may be provided for selecting the type of network and components within the network.
  • a "Statistics" tab 1 120 provides suitable graphics 1122 and 1124 showing statistics detailing traffic, number of retries, etc., for various antennas, MUs, etc.
  • FIG. 13 depicts an exemplary display in the context of a web browser showing "heat maps" for access ports at a site.
  • the heat map shows the range of the antennae, AP, or reader as a gradient (e.g., a gradient of various intensities of the color red), such that areas that are better covered by antennae are brighter (or darker) than other areas. This allows the administrator to determine areas of coverage and configure the system appropriately.
  • FIG. 14 depicts an exemplary display in the context of a web browser showing intrusion detection at a site under the "Intrusion Detection" tag. That is, the display designates areas 1404 where excessive retries (as determined by some predetermined criterion) have occurred, as well as areas where "rogue" APs or other components have been detected.
  • one or more camera elements are physically attached to a wireless device or are configured as stand-alone elements and are communicatively coupled to the network such that they can be displayed by the administrator in a browser format.
  • the camera elements (which may be standard webcams, CUI cams, etc.) may be configured in a number of ways. As shown conceptually in FIG. 15A, for example, a camera 1304 may be physically fixed to a wireless device (e.g., RFID reader, AP, etc.) such that it has a constant field of view 1306.
  • camera 1304 is configured to rotate with respect to device 1302 such that its field of view 1306(a) can be changed (e.g., field of view 1306(b)).
  • This movement may be accomplished manually or through the use of various rotational actuators known in the art that allow the rotation of the camera to be specified remotely (e.g., via suitable controls provided within the browser).
  • the graphical management module determines the location of the RF element to the best of its ability (as described above), and the system automatically moves the camera to an orientation wherein the suspected location is most likely within its field of view.
  • FIG. 15B depicts planar rotation
  • the movement may be along any number of axes, providing fields of view within three- dimensional space as may be necessary.
  • cameras 1304 are attached to device 1302 and have wide angle (e.g., close to 180 degrees) views to provide the necessary fields of view.
  • cameras 1304 may be standalone units placed strategically within the site. In another, cameras are provided within the RF elements (or assets tracked by the RF elements) themselves.
  • Cameras 1304 may receive power through device 1302, through a power supply, via a battery, solar power, or any other suitable power source. The manner in which webcams communicate and stream video is well known in the art, and need not be described herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Electromagnetism (AREA)
  • Human Computer Interaction (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

One or more networked camera elements (e.g., webcams) are used to track RF elements within an environment. A graphical management system includes: a web browser application communicatively coupled to a web service and a graphical management module over a network; a plurality of wireless devices coupled to the network and having one or more associated antennae, the wireless devices configured to process data received from a plurality of RF elements within range of the antennae; an RF switch coupled to the network and configured to receive the data and transmit the data to the graphical management module; and a camera element coupled to the network and having a field of view that includes at least one of the RF elements, the camera element configured to provide a real-time video image of the field of view to the web browser.

Description

METHODS AND APPARATUS FOR VISUAL TRACKING OF RF ELEMENTS
CROSS REFERENCE TO RELATED APPLICATIONS
[0001] This application claims priority to U.S. Patent Application Serial Number 11/413,978 filed on April 28, 2006 and its contents are incorporated herein by reference.
TECHNICAL FIELD
[0002] The present invention relates generally to radio frequency identification (RFID) systems, wireless local area networks (WLANs), and any other network incorporating RF elements, and, more particularly, to visual tracking of RF elements.
BACKGROUND
[0003] Radio frequency identification (RFID) systems have achieved wide popularity in a number of applications, as they provide a cost-effective way to track the location of a large number of assets in real time. In large-scale application such as warehouses, retail spaces, and the like, many RFID tags may exist in the environment. Likewise, multiple RFID readers are typically distributed throughout the space in the form of entryway readers, conveyer-belt readers, mobile readers, etc., and may be linked by network controller switches and the like.
[0004] Similarly, there has been a dramatic increase in demand for mobile connectivity solutions utilizing various wireless components and wireless local area networks (WLANs). This generally involves the use of wireless access points that communicate with mobile devices using one or more RF channels (e.g., in accordance with one or more of the IEEE 802.11 standards).
[0005] The number of mobile units and associated access ports, as well as the number of RFID readers and associated antennae, can be very large in an enterprise. As the number of components increases, the tracking of those components becomes difficult. This problem is exacerbated by the presence of handheld, wireless RFID readers and active RFID tags that communicate with access ports rather than standard RFID readers. [0006] Currently, RFID systems can generally determine a spherical region where an RFID tag is located, but it is difficult to visualize the exact location and context of that region. In some cases, the diameter of this region is about twenty feet. [0007] Accordingly, it is desirable to provide an efficient method of visualizing the location of diverse types of RF elements in an RF network incorporating, for example, RFID and WLAN systems. Furthermore, other desirable features and characteristics of the present invention will become apparent from the subsequent detailed description and the appended claims, taken in conjunction with the accompanying drawings and the foregoing technical field and background.
BRIEF SUMMARY
[0008] In general, one or more networked camera elements (e.g., webcams) are used to track RF elements within an environment. In one embodiment, a graphical management system comprises: a web browser application communicatively coupled to a web service and a graphical management module over a network; a plurality of wireless devices coupled to the network and having one or more associated antennae, the wireless devices configured to process data received from a plurality of RF elements within range of the antennae; an RF switch coupled to the network and configured to receive the data and transmit the data to the graphical management module; and a camera element coupled to the network and having a field of view that includes at least one of the RF elements, the camera element configured to provide a real-time video image of the field of view to the web browser.
BRIEF DESCRIPTION OF THE DRAWINGS
[0009] A more complete understanding of the present invention may be derived by referring to the detailed description and claims when considered in conjunction with the following figures, wherein like reference numbers refer to similar elements throughout the figures.
[0010] FIG. 1 is a conceptual overview of a system in accordance with an exemplary embodiment of the present invention;
[0011] FIG. 2 is a conceptual overview of an exemplary RF switch in accordance with one embodiment;
[0012] FIG. 3 depicts various functional domains of the present invention; and [0013] FIG. 4 depicts various components of an exemplary system in accordance with the present invention;
[0014] FIG. 5 depicts an exemplary display in the context of a web browser showing the position of networked sites; [0015] FIG. 6 depicts an exemplary display in the context of a web browser showing live mapping of network objects at a site;
[0016] FIG. 7 depicts an exemplary display in the context of a web browser showing information for a particular object at a site;
[0017] FIG. 8 depicts an exemplary display in the context of a web browser showing the location of particular mobile units or RFID tags at a site;
[0018] FIG. 9 depicts an exemplary display in the context of a web browser showing a camera image at a particular location within a site;
[0019] FIG. 10 depicts an exemplary display in the context of a web browser showing the relationship between various access ports within a self-healing group;
[0020] FIG. 11 depicts an exemplary display in the context of a web browser showing device information;
[0021] FIG. 12 depicts an exemplary display in the context of a web browser showing wireless statistics;
[0022] FIG. 13 depicts an exemplary display in the context of a web browser showing
"heat maps" for access ports at a site;
[0023] FIG. 14 depicts an exemplary display in the context of a web browser showing intrusion detection at a site;
[0024] FIGS. 15A-15C depict various configurations of camera elements associated with wireless devices.
[0025]
DETAILED DESCRIPTION
[0026] The following detailed description is merely illustrative in nature and is not intended to limit the invention or the application and uses of the invention. Furthermore, there is no intention to be bound by any express or implied theory presented in the preceding technical field, background, brief summary or the following detailed description.
[0027] The invention may be described herein in terms of functional and/or logical block components and various processing steps. It should be appreciated that such block components may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions. For example, an embodiment of the invention may employ various integrated circuit components, e.g., radio-frequency (RF) devices, memory elements, digital signal processing elements, logic elements, lookup tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices. In addition, those skilled in the art will appreciate that the present invention may be practiced in conjunction with any number of data transmission protocols and that the system described herein is merely one exemplary application for the invention.
[0028] For the sake of brevity, conventional techniques related to signal processing, data transmission, signaling, network control, the 802.11 family of specifications, wireless networks, RFID systems and specifications, and other functional aspects of the system (and the individual operating components of the system) may not be described in detail herein. Furthermore, the connecting lines shown in the various figures contained herein are intended to represent example functional relationships and/or physical couplings between the various elements. Many alternative or additional functional relationships or physical connections may be present in a practical embodiment. [0029] Without loss of generality, in the illustrated embodiment, many of the functions usually provided by a traditional access point (e.g., network management, wireless configuration, etc.) and/or traditional RFID readers (e.g., data collection, RFID processing, etc.) are concentrated in a corresponding RF switch. It will be appreciated that the present invention is not so limited, and that the methods and systems described herein may be used in conjunction with traditional access points and RFID readers or any other device that communicates via RF channels.
[0030] The present invention relates to an improved user interface for real-time location determination, configuration, and coordination of RFID as well as WLAN components. The system provides user-friendly methods of determining the location of objects, such as RFID tags and mobile units, and provides various health monitoring information (self-healing status, "heat maps" for associated antennae, redundancy group status, intrusion detection, and health statistics).
[0031] Referring to FIG. 1, in an example system useful in describing the present invention, a switching device 110 (alternatively referred to as an "RF switch" or simply "switch") is coupled to a networks 101 and 104 (e.g., an Ethernet network coupled to one or more other networks or devices) which communicates with one or more enterprise applications 105. One or more wireless access ports 120 (alternatively referred to as "access ports" or "APs") are configured to wirelessly connect to one or more mobile units 130 (or "MUs"). APs 120 suitably communicate with switch 110 via appropriate communication lines 106 (e.g., conventional Ethernet lines, or the like). Any number of additional and/or intervening switches, routers, servers and other network components may also be present in the system.
[0032] A number of RFID tags (or simply "tags") 104 are distributed throughout the environment. These tags are read by a number of RFID readers (or simply "readers") 108 having one or more associated antennas 106 provided within the environment. The term "tag" refers, in general, to any RF element that can be communicated with and has a ID that can be read by another component. Readers 108, each of which may be stationary or mobile, are suitably connective via wired or wireless data links to a RF switch 110. [0033] A particular AP 120 may have a number of associated MUs 130. For example, in the illustrated topology, MUs 130(a) and 130(b) are associated with AP 120(a), while MU 130(c) is associated with AP 120(b). One or more APs 120 may be coupled to a single switch 110, as illustrated.
[0034] RF Switch 110 determines the destination of packets it receives over network 104 and 101 and routes those packets to the appropriate AP 120 if the destination is an MU 130 with which the AP is associated. Each WS 1 10 therefore maintains a routing list of MUs 130 and their associated APs 130. These lists are generated using a suitable packet handling process as is known in the art. Thus, each AP 120 acts primarily as a conduit, sending/receiving RF transmissions via MUs 130, and sending/receiving packets via a network protocol with WS 110. AP 120 is typically capable of communicating with one or more MUs 130 through multiple RF channels. This distribution of channels varies greatly by device, as well as country of operation. For example, in one U.S. embodiment (in accordance with 802.1 l(b)) there are fourteen overlapping, staggered channels, each centered 5 MHz apart in the RF band.
[0035] A particular RFID reader 108 may have multiple associated antennas 106. For example, as shown in FIG. 1, reader 108(a) is coupled to one antenna 106(a), and reader 108(b) is coupled to two antennas 106(b) and 106(c). Reader 108 may incorporate additional functionality, such as filtering, cyclic-redundancy checks (CRC), and tag writing, as is known in the art.
[0036] In general, RFID tags (sometimes referred to as "transponders") may be classified as either active or passive. Active tags are devices that incorporate some form of power source (e.g., batteries, capacitors, or the like), while passive tags are tags that are energized via an RF energy source received from a nearby antenna. While active tags are more powerful, and exhibit a greater range than passive tags, they also have a shorter lifetime and are significantly more expensive. Such tags are well known in the art, and need not be described in detail herein.
[0037] Each antenna 106 has an associated RF range (or "read point") 116, which depends upon, among other things, the strength of the respective antenna 106. The read point 116 corresponds to the area around the antenna in which a tag 104 may be read by that antenna, and may be defined by a variety of shapes, depending upon the nature of the antenna (i.e., the RF range need not be circular or spherical as illustrated in FIG. 1). [0038] It is not uncommon for the RF ranges or read points to overlap in real-world applications (e.g., doorways, small rooms, etc.). Thus, as shown in FIG. 1, read point 116(a) overlaps with read point 116(b), which itself overlaps with read point 116(c). Accordingly, it is possible for a tag to exist within the range of two or more readers simultaneously. For example, tag 104(c) falls within read points 116(a) and 116(b), and tag 104(f) falls within read points 116(b) and 116(c). Because of this, two readers (108(a) and 108(b)) may sense the presence of (or other event associated with) tag 104(c). [0039] As described in further detail below, switch 102 includes hardware, software, and/or firmware capable of carrying out the functions described herein. Thus, switch 102 may comprise one or more processors accompanied by storage units, displays, input/output devices, an operating system, database management software, networking software, and the like. Such systems are well known in the art, and need not be described in detail. Switch 102 may be configured as a general purpose computer, a network switch, or any other such network host. In a preferred embodiment, controller 102 is modeled on a network switch architecture but includes RF network controller software (or "module") whose capabilities include, among other things, the ability to allow configure and monitor readers 108 and antennas 106.
[0040] RF switch 1 10 allows multiple read points 116 to be logically combined, via controller 102, within a single read point zone (or simply "zone"). For example, referring to FIG. 1, a read point zone 120 may be defined by the logical union of read points 116(a), 116(b), and 116(c). Note that the read points need not overlap in physical space, and that disjoint read points (e.g., read point 116(d)) may also be included in the read point zone if desired. In a preferred embodiment, antennas (i.e., read points defined by the antennas) can be arbitrarily assigned to zones, regardless of whether they are associated with the same reader. That is, referring to FIG. 1 , antennas 106(b) and 106(c), while both associated with reader 108(b), may be part of different zones. Controller 102 then receives all tag data from readers 108 via respective data links 103 (e.g., wired communication links, 802.1 1 connections, or the like), then aggregates and filters this data based on zone information. The read point zones are suitably preconfigured by a user or administrator. That is, the user is allowed to access controller 110 and, through a configuration mode, specify a set of read points that are to be included in a particular zone.
[0041] FIG. 2 depicts a conceptual block diagram of an RF switch 110. A shown, switch 110 includes a cell controller (CC) 202, and a RFID network controller (RNC)
204. In general, RNC 204 includes hardware and software configured to handle RFID data communication and administration of the RFID network components, while CC 202 includes hardware and software configured to handle wireless data (e.g., in accordance with IEEE 802.11) from the mobile units and access ports within wireless cells. In one embodiment, RF switch 110 includes a single unit with an enclosure containing the various hardware and software components necessary to perform the various functions of
CC 202 and RNC 204. Switch 110 also includes suitable input/output hardware interfaces to networks 101 and 104.
[0042] FIG. 3 illustrates, conceptually, the four major domains of an exemplary RF switch network - i.e., tag domain 302, reader domain 304, reader controller domain 306, and RFID-aware application domain 308.
[0043] Tag domain 302 comprises tags, tagged assets, and objects that require tracking and/or monitoring (e.g., tags 104 in FIG. 1). As mentioned previously, these tags may be active, passive, or a combination thereof.
[0044] Reader domain 304 includes, inter alia, physical antennas 106, readers 108, and APs 120. Objects in reader domain 304 acquire information from objects in tag domain 302 and pass associated data to reader controller domain 306.
[0045] Reader controller domain 306 comprises RNC objects. RNC objects (e.g.,
RNC 204 in FIG. 2) act as an integration point for RFID readers/antennae and include the functionality of filtering and aggregating volumes of data provided by readers 108, supporting the analysis of data and applying local decision making and intelligence. The
RNC is preferably compatible with readers from multiple vendors and effectively hide individual reader and tag interface idiosyncrasies from RFID aware application domain
308.
[0046] RFID-aware application domain 308 includes one or more standalone applications and/or middleware applications that function as intermediaries between enterprise applications 105 and the RNC. In this regard, the applications within this domain rely on events on a higher level - i.e., events that are important in the context of a business operation or process.
[0047] FIG. 4 is a block diagram showing the components of an exemplary system corresponding to the various domains illustrated in FIG. 3. As shown, system 400 generally includes an RFID reader 108, an RNC 204, and an application 105 communicating as shown.
[0048] Reader 108 includes one or more reader agents 306, an application programming interface (API) 304, and some core functionality 302. Reader 108, as mentioned above, is responsible for reading RFID tags (embodied within core functionality 302). For active tags read by an AP, switch 110 acts as an RFID reader and communicates the tag info to RNC 204. Reader agents 306 includes the interfaces through which RNC 204 communicates. This may include, for example, a proprietary interface, an SLRRP interface, other any other interface, such as dynamically-loadable modules for other protocols. In one embodiment, RFID reader 108 provides a C# API 304 for core RFID reader functionality 302, and reader agents 306 make use of this API. [0049] Reader 108 implements a suitable RNC discovery procedure. In one embodiment, the reader first makes use of IP subnet broadcast. If no response is received, reader 108 refers to a list of statically configured RNCs 204 (which is preferably stored across reboots in the reader). If no response is received using this method, then reader 108 consults a discovered list of RNCE controllers (also stored across reboots in the reader). This list includes a list of RNCs 204 to which the reader had prior success in joining. If no response is received, Reader 108 uses a list of RNCs received in a DHCP offer (using option 43, known in the art).
[0050] RNC 204 includes one or more RFID reader managers 316, a data plane 312, a control plane 312, one or more RFID application agents 310, and a RNC configuration database 314. In one embodiment, RNC includes a set of processes, shared libraries, and the like running under Linux and a local operating system. RFID reader managers 316 communicates with RFID reader 108 using any suitable interface, such as a proprietary interface, SLRRP, or the like. RFID application agents 310 provide suitable interfaces, such as ALE, MQTT, JMS, SQL, IBM Premises Server Interface, or any other suitable interface. Applications 105 includes an RFID-aware business application core 320 and an RFID application manager 318. [0051J Having thus given an overview of an RF network in which the present invention may be deployed, a description of an exemplary RF graphical management system will now be described.
[0052] In general, a user is provided a display and user interface (e.g., through a conventional web browser) that allows multiple sites and multiple RF elements to be monitored and managed remotely over a network. Suitable software, hardware, and network services are provided in any appropriate host within the network (e.g., at RF switch 110) such that a user and/or administrator may establish a connection with that host via a client program (e.g., web browser) located on a computer system located elsewhere in the network. That is, a web browser application is communicatively coupled to a web service and a graphical management module over a network The location of the graphical management module software may be within a networked component (e.g., the RF switch) or may be on a stand-alone computer provided somewhere within the network. The nature of web services, browsers, and the like are well known in the art, and thus need not be described herein. Furthermore, it will be appreciated that the various graphical elements and user interface details may be implemented using a variety of methods, protocols, and software tools (e.g., AJAX, CSS, etc.) but that the present invention is not so limited.
[0053] In this regard, FIG. 5 depicts an exemplary display in the context of a web browser showing the position of networked sites within a geographical region. In this display, which is not intended to be limiting with respect to content or layout, a browser region 502 includes a map 506 of a geographical region (in this case, a map of a portion of North America) with sites indicated by site indicators (518, 510, 512, etc.) using any convenient graphical element.
[0054] A series of tabs 504 may be employed to allow navigation through the various images. In the illustrated embodiment (and as described further below), the tabs 504 are labeled "Live", "Heat Map", "Intrusion Detection", "Self Healing", "Location", and "All Sites." The illustrated image corresponds to the "All Sites" tab, wherein a plurality of network sites (each having one or more RF elements, switches, etc.) are superimposed over a two-dimensional map.
[0055] A standard zooming tool 514 and key 516 may also be provided. In this embodiment, the site indicators include visual cues that relate to the status of that site. For example, in the illustrated embodiment, one color or level of shading is used for sites at which a critical alarm/event has occurred (which may defined in any convenient fashion), while another color is used for sites at which no critical event has occurred. Additional information bubbles, mouse-over events, or other such visual indicators may be used to designate the location of the user (as with a "You are Here" bubble), or any other spatial feature of the network or user. In this way, the administrator may manage multiple sites and move from one site to another using this "master view". A number of mapping tools may be used to create this image, including, for example, the Google and Yahoo brands of mapping tools.
[0056] The user is allowed to click on or otherwise select the site indicators shown in FIG. 5 to get a close-up view of that site. In this regard, FIG. 6 depicts an exemplary display in the context of a web browser showing live mapping of network objects at a site. As shown, the display includes a site map 602 with various component indicators and other visual cues superimposed thereon. Site map 602 preferably includes some structural details that allow the position of the various objects in space to be intuited. Such structural details might include, for example, rooms (e.g., room 603), walls (e.g., wall 604), windows, doors, shelving, etc.
[0057] Visual indicators are used to note the position of various network elements. In the illustrated embodiments, network switches 610, RF reader 608, and APs 606s are shown. The invention is not so limited, however. The visual indicators might include detailed representations of the actual units, stylized graphics, simple geometrical shapes, or any other suitable graphic.
[0058] The position of the various components may be determined in any convenient manner. Suitable techniques include, for example, trilateration (such as used with GPS systems), triangulation, zone aggregation, using information from multiple APs, RFID readers communicated over the network. RFID tags may be located based on business logic applied to the readers.
[0059] FIG. 7 depicts an exemplary display in the context of a web browser showing information for a particular object at a site, when a user clicks on or otherwise selects an indicator under the "Live" tab. As shown, a pop-up window 702 may be displayed. An assortment of information for a particular component may be included within the window, including, for example, the MAC address, number of associated MUs, Tx and Rx transmission history of an AP, or the like.
[0060] FIG. 8 depicts an exemplary display in the context of a web browser showing the location of particular RF elements (e.g., mobile units, RFID tags, or any other component that communicates via RF) within a site. A series of concentric circles (e.g., circles 802) may be displayed around particular antennas (associated with APs, readers, etc.). In one embodiment, the location of the RF element may not be known precisely, and the certainty of its position may be indicated by circles of different diameters. For example, in one embodiment, the location of an MU is indicated by a circle 806, and in another embodiment (when the MU is perhaps of a different manufacture, or has other wireless characteristics) the location of the MU is indicated by a larger circle 804. RFID tags and other RF elements may be similarly designated. The user may search, select, or otherwise select the RF element whose position is to be displayed. This search may be based on MAC, IP address, RFID tag, or the like.
[0061] FIG. 9 depicts an exemplary display in the context of a web browser showing a camera image at a particular location within a site. That is, in the event that a camera is located at the site (e.g., attached to an AP, an MU, a reader, or standing alone) and attached to the network, a live streaming video of that cameras field of view may be called up into a separate window 902. Suitable camera controls may also be provided, allowing various object to be located visually in addition to the mapping provided by the web page.
[0062] FIG. 10 depicts an exemplary display in the context of a web browser showing the relationship between various access ports within a self-healing group under the "Self Healing" tab. That is, various connectors (displayed using different colors for different neighborhood) may be superimposed on the map so that the administrator can check whether APs and antennae are configured as self-healing neighbors and whether they are acting in a normal mode or "healing" mode.
[0063] FIG. 11 depicts an exemplary display in the context of a web browser showing device information. Similarly, FIG. 12 depicts an exemplary display in the context of a web browser showing wireless statistics. In FIG. 11, tabs for the current device (1102) and the redundancy group (1104) provide respective sets of graphics describing the state of the system. In this illustration, the switches and corresponding IP address are displayed (1108) along with bar charts showing the number of associated components (1110). A hierarchical menu 1 106 may be provided for selecting the type of network and components within the network. Similarly, in FIG. 12, a "Statistics" tab 1 120 provides suitable graphics 1122 and 1124 showing statistics detailing traffic, number of retries, etc., for various antennas, MUs, etc.
[0064] FIG. 13 depicts an exemplary display in the context of a web browser showing "heat maps" for access ports at a site. The heat map shows the range of the antennae, AP, or reader as a gradient (e.g., a gradient of various intensities of the color red), such that areas that are better covered by antennae are brighter (or darker) than other areas. This allows the administrator to determine areas of coverage and configure the system appropriately.
[0065] FIG. 14 depicts an exemplary display in the context of a web browser showing intrusion detection at a site under the "Intrusion Detection" tag. That is, the display designates areas 1404 where excessive retries (as determined by some predetermined criterion) have occurred, as well as areas where "rogue" APs or other components have been detected.
[0066] As mentioned previously, it is desirable (as shown in FIG. 9) to show a visual representation of the area where an RF element is located. Therefore, in accordance with the present invention, one or more camera elements are physically attached to a wireless device or are configured as stand-alone elements and are communicatively coupled to the network such that they can be displayed by the administrator in a browser format. [0067] The camera elements (which may be standard webcams, CUI cams, etc.) may be configured in a number of ways. As shown conceptually in FIG. 15A, for example, a camera 1304 may be physically fixed to a wireless device (e.g., RFID reader, AP, etc.) such that it has a constant field of view 1306.
[0068] In another embodiment, shown in FIG. 15B, camera 1304 is configured to rotate with respect to device 1302 such that its field of view 1306(a) can be changed (e.g., field of view 1306(b)). This movement may be accomplished manually or through the use of various rotational actuators known in the art that allow the rotation of the camera to be specified remotely (e.g., via suitable controls provided within the browser). In a particular embodiment, for example, the graphical management module determines the location of the RF element to the best of its ability (as described above), and the system automatically moves the camera to an orientation wherein the suspected location is most likely within its field of view.
[0069] It will be appreciated that while FIG. 15B depicts planar rotation, the movement may be along any number of axes, providing fields of view within three- dimensional space as may be necessary.
[0070] In an alternate embodiment, shown in FIG. 15C, multiple fixed cameras 1304 are attached to device 1302 and have wide angle (e.g., close to 180 degrees) views to provide the necessary fields of view. [0071] In yet another embodiment, as mentioned above, cameras 1304 may be standalone units placed strategically within the site. In another, cameras are provided within the RF elements (or assets tracked by the RF elements) themselves. [0072] Cameras 1304 may receive power through device 1302, through a power supply, via a battery, solar power, or any other suitable power source. The manner in which webcams communicate and stream video is well known in the art, and need not be described herein.
[0073] It should be appreciated that the example embodiment or embodiments described herein are not intended to limit the scope, applicability, or configuration of the invention in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the described embodiment or embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope of the invention as set forth in the appended claims and the legal equivalents thereof.

Claims

CLAIMSWhat is claimed is:
1. A graphical management system comprising: a web browser application communicatively coupled to a web service and a graphical management module over a network; a plurality of wireless devices coupled to the network and having one or more associated antennae, the wireless devices configured to process data received from a plurality of RF elements within range of the antennae; an RF switch coupled to the network and configured to receive the data and transmit the data to the graphical management module; a camera element coupled to the network and having a field of view that includes at least one of the RF elements, the camera element configured to provide a real-time video image of the field of view to the web browser.
2. The system of claim 1, wherein the camera element is mechanically fixed to a selected one of the wireless devices.
3. The system of claim 2, wherein at least one additional camera is mechanically fixed to the selected one of the wireless devices.
4. The system of claim 1 , wherein the camera element is rotateably attached to a selected one of the wireless devices.
5. The system of claim 4, wherein the camera element has a field of view specified remotely by a user via the browser.
6. The system of claim 4, wherein the camera element has a field of view specified automatically by the graphical management system.
7. The system of claim 4, wherein the camera element is rotateable along at least two axes.
8. The system of claim 4, wherein the graphical management system determines a location of a subject RF element and automatically specifies the field of view to include the determined location.
9. The system of claim 1, wherein the camera element is a stand-alone unit.
10. The system of claim 1, wherein the field of view is greater than about 160 degrees.
11. A method for asset visualization comprising: providing a web browser application communicatively coupled to a web service and a graphical management module over a network; providing a plurality of wireless devices coupled to the network and having one or more associated antennae, receiving data from a plurality of RF elements within range of the antennae; receiving, at an RF switch, the data and transmitting the data to a graphical management module; providing a camera element coupled to the network and having a field of view; providing a real-time video image of the field of view to the web browser.
12. The method of claim 11, wherein the camera element is mechanically fixed to a selected one of the wireless devices.
13. The method of claim 12, wherein at least one additional camera is mechanically fixed to the selected one of the wireless devices.
14. The method of claim 11, wherein the camera element is rotateably attached to a selected one of the wireless devices.
15. The method of claim 14, wherein the camera element has a field of view specified remotely by a user via the browser.
16. The method of claim 14, wherein the camera element has a field of view specified automatically by the graphical management system.
17. The method of claim 14, wherein the camera element is rotateable along at least two axes.
18. The method of claim 14, wherein the graphical management system determines a location of a subject RF element and automatically specifies the field of view to include the determined location.
19. The method of claim 11, wherein the camera element is a stand-alone unit.
20. The method of claim 11 , wherein the field of view is greater than about 160 degrees.
PCT/US2007/064768 2006-04-28 2007-03-23 Methods and apparatus for visual tracking of rf elements Ceased WO2007127556A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US41397806A 2006-04-28 2006-04-28
US11/413,978 2006-04-28

Publications (1)

Publication Number Publication Date
WO2007127556A1 true WO2007127556A1 (en) 2007-11-08

Family

ID=38372302

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/064768 Ceased WO2007127556A1 (en) 2006-04-28 2007-03-23 Methods and apparatus for visual tracking of rf elements

Country Status (1)

Country Link
WO (1) WO2007127556A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090125981A1 (en) * 2007-11-13 2009-05-14 Cisco Technology, Inc. System and method for wireless network and physical system integration
US8126098B2 (en) * 2006-09-12 2012-02-28 Marvell World Trade Ltd. Multi-rake receiver

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001046923A1 (en) * 1999-12-22 2001-06-28 Axcess Inc. Method and system for providing integrated remote monitoring services
US20020174367A1 (en) * 1999-09-01 2002-11-21 Kimmel David E. Method and apparatus for remotely monitoring a site
EP1564700A1 (en) * 2004-02-11 2005-08-17 Sensormatic Electronics Corporation System and method for remote access to security event information
US20060001537A1 (en) * 2003-11-20 2006-01-05 Blake Wilbert L System and method for remote access to security event information
US20060095539A1 (en) * 2004-10-29 2006-05-04 Martin Renkis Wireless video surveillance system and method for mesh networking
WO2007002763A2 (en) * 2005-06-28 2007-01-04 Objectvideo, Inc. Video surveillance system employing video primitives

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020174367A1 (en) * 1999-09-01 2002-11-21 Kimmel David E. Method and apparatus for remotely monitoring a site
WO2001046923A1 (en) * 1999-12-22 2001-06-28 Axcess Inc. Method and system for providing integrated remote monitoring services
US20060001537A1 (en) * 2003-11-20 2006-01-05 Blake Wilbert L System and method for remote access to security event information
EP1564700A1 (en) * 2004-02-11 2005-08-17 Sensormatic Electronics Corporation System and method for remote access to security event information
US20060095539A1 (en) * 2004-10-29 2006-05-04 Martin Renkis Wireless video surveillance system and method for mesh networking
WO2007002763A2 (en) * 2005-06-28 2007-01-04 Objectvideo, Inc. Video surveillance system employing video primitives

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8126098B2 (en) * 2006-09-12 2012-02-28 Marvell World Trade Ltd. Multi-rake receiver
US9143191B2 (en) 2006-09-12 2015-09-22 Marvell World Trade Ltd. Method and apparatus for filtering and combining multipath components of a signal received at multiple antennas according to a wireless communication protocol standard designed for a receiver having only a single receive antenna
US20090125981A1 (en) * 2007-11-13 2009-05-14 Cisco Technology, Inc. System and method for wireless network and physical system integration
WO2009064638A1 (en) * 2007-11-13 2009-05-22 Cisco Technology, Inc. System and method for wireless network and physical system integration
US8627470B2 (en) 2007-11-13 2014-01-07 Cisco Technology, Inc. System and method for wireless network and physical system integration

Similar Documents

Publication Publication Date Title
CN111868546B (en) Asset localization using direction finding features
EP4032327B1 (en) Automated access point mapping systems and methods
US8258953B2 (en) Displaying radio frequency identification (RFID) read range of an RFID reader based on feedback from fixed RFID beacon tags
US7825804B2 (en) Methods and apparatus for opportunistic locationing of RF tags using location triggers
US20080081632A1 (en) Methods and apparatus for defining, storing, and identifying key performance indicators associated with an RF network
US20120092134A1 (en) Determining item location within a space based on feedback from radio frequency identification (rfid) readers and tags
US9918190B2 (en) Augmenting network device management
WO2008063946A2 (en) Method and system for automatically estimating the spatial positions of cameras in a camera network
WO2010138560A1 (en) System and method for locating a target wireless device
WO2007127555A1 (en) Method and apparatus for managing rf elements over a network
CN101911138B (en) Real time location tracking system of store shoppers using a communication multi-network
US20090085743A1 (en) Methods and systems for controlling operations of a mobile radio frequency reader based on its location
WO2007133851A1 (en) Methods and apparatus for a consolidated switch for use with networked rf components
US20080079577A1 (en) Methods and apparatus for opportunistic locationing of RF tags
JP6787481B2 (en) Search support program, search support method and search support device
US20080068130A1 (en) Methods and apparatus for location-dependent disabling of mobile devices
WO2007127556A1 (en) Methods and apparatus for visual tracking of rf elements
EP2196816A1 (en) Real time location system with ZigBee technology
US20090034493A1 (en) Methods and apparatus for locationing based nat access in wireless networks
RU2439812C1 (en) Method for deploying sensor network and self-configured sensor network
US20230316561A1 (en) Precise positioning system for indoor gps and rf compromised environment mapping
US20240119146A1 (en) Sensor fusion in security systems
US12432525B2 (en) Active information for user devices for improved service delivery
US20080026713A1 (en) Methods and apparatus for a wireless surveillance system
US20080068136A1 (en) Methods and apparatus for autoconfiguration of RFID readers

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07759229

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07759229

Country of ref document: EP

Kind code of ref document: A1