WO2012030629A2 - Appareil et procédé permettant de gérer la capacité de puissance dans des centres de données à l'aide d'un réseau de capteurs sans fil - Google Patents
Appareil et procédé permettant de gérer la capacité de puissance dans des centres de données à l'aide d'un réseau de capteurs sans fil Download PDFInfo
- Publication number
- WO2012030629A2 WO2012030629A2 PCT/US2011/049235 US2011049235W WO2012030629A2 WO 2012030629 A2 WO2012030629 A2 WO 2012030629A2 US 2011049235 W US2011049235 W US 2011049235W WO 2012030629 A2 WO2012030629 A2 WO 2012030629A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electrical
- power
- data
- devices
- wireless sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/3287—Power saving characterised by the action undertaken by switching off individual functional units in the computer system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W84/00—Network topologies
- H04W84/18—Self-organising networks, e.g. ad-hoc networks or sensor networks
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S40/00—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them
- Y04S40/18—Network protocols supporting networked applications, e.g. including control of end-device applications over a network
Definitions
- the disclosed subject matter relates to the field of device monitoring and control, and more particularly to power management of electronic devices.
- a data center can be modeled as rows of racks that house electronic systems, such as computing systems or other types of electrical devices.
- the computing systems (such as computers, storage devices, servers, routers, networking devices, etc.) consume power for their operation.
- the computing systems of the data center may reside in these racks.
- RPDUs Rack Power Distribution Units
- IP Internet Protocol
- UPS Power Systems
- PDUs Power Distribution Units
- the panel boards contain individual electrical circuits of various current or amperage capacities. These electrical power circuits are connected to power distribution strips containing electrical outlets in equipment racks placed on the data center floor to plug the individual servers to meet their power needs.
- the power distribution topology provided in the data center may be single path or non-redundant with only one set of UPS.
- PDUs are installed to provide power to the servers with a single power supply and one plug connection.
- the topology may also be dual path or redundant whereby multiple UPS systems and two sets of PDUs are installed to provide power from two different electrical systems to each server, which is designed with redundant power supplies that are powered independently from two rack power distribution units or strips (RPDUs).
- RPDUs rack power distribution units or strips
- a primary UPS of a redundant set of UPS systems feeds single PDUs through static transfer switches (STS). If the primary UPS fails, the STS automatically switches the PDU to the alternate backup source UPS of the redundant set of UPS systems.
- STS static transfer switches
- Each server's maximum power requirement at full load is required to be provided to the outlet plug in either a single or dual path topology.
- each power distribution strip is fed from a PDU electrical circuit that may vary in voltage and power capacity as required by the information technology (IT) equipment to be housed in each equipment rack.
- IT information technology
- circuit capacity typically is between 20-100 amps per circuit.
- Power is fed from the PDU through the power distribution panel and through a circuit breaker, which is a device that enables a safe means of turning off power being fed from the PDU to the rack power strips for installation and maintenance purposes and to protect the electrical power distribution system from overloading and damage if the server load connected to the circuit exceeds its rated maximum capacity.
- New servers are typically assigned to specific racks and circuits based upon the estimated maximum server power requirement and the installed provisioned maximum rated capacity of the circuit breaker.
- Faceplate ratings are based upon the maximum power draw of the server with its maximum resource configuration including central processing units (CPUs) or cores, memory and storage. This maximum power draw is much higher than the typical configuration used in the data center.
- the commonly used safety cushion of 20-30% may also be too high or too low depending upon actual peak utilization that is based upon varying application work load demand and diversity factors depending upon what workloads are assigned to the servers housed in the rack,
- Figure 1 illustrates a mesh network envhOnment in which various embodiments can operate
- Figure 2 illustrates an example embodiment of a node that can operate in a mesh network
- Figures 3 and 4 illustrate sample data center configurations of particular embodiments that include a set of racks that support stacked sets of electronic equipment, the power consumption of the electronic equipment being monitored by RPDUs, which communicate with a wireless bridge device via a wired data connection, the wireless bridge device being in wireless mesh network communication with a communication gateway;
- Figure 5 illustrates a layout of an example data center in which an array of RPDUs and wireless bridge devices have been deployed
- Figure 6 illustrates an example embodiment of a wireless bridge device that can operate in a mesh network of various embodiments
- Figure 7 illustrates a wireless bridge device in an example embodiment
- Figures 8 and 9 illustrate sample data center configurations of particular embodiments that include a set of racks that support stacked sets of electronic equipment, the power consumption of the electronic equipment being monitored and controlled by power monitors in mesh network communication with cornmunication hubs and a communication gateway;
- Figure 10 illustrates a layout of an example data center in which an array of power monitors has been deployed
- FIG 11 illustrates an example embodiment of a wireless smart plug (WSP) device that can operate in a wireless mesh network of various embodiments;
- WSP wireless smart plug
- FIG. 12 illustrates a sample data center configurations of particular embodiment that includes a set of racks that support stacked sets of electronic equipment, the power consumption of the electronic equipment being monitored by wireless smart plug (WSP) devices, which communicate with a communication gateway and analysis processor via a wireless sensor network;
- WSP wireless smart plug
- Figure 13 illustrates a layout of an example data center in which an array of WSPs have been deployed.
- Figure 14 is a flow diagram illustrating the basic processing flow for a particular embodiment. DETAILED DESCRIPTION
- a particular embodiment relates to a network of radio frequency (RF) devices (wireless nodes) that can include one or more sensing devices capable of sensing various system and environmental conditions.
- the wireless nodes can gather power usage/consumption information from RPDUs, which can be connected to the wireless node via an Ethernet or serial (e.g., wired) data connection.
- RPDUs radio frequency
- the wireless nodes can communicate sensor information, system condition information including power consumption information, or network information with other nodes of the wireless sensor network or with a set of network controllers (e.g., gateways).
- the system and method of a particular embodiment involves deploying wireless sensor devices for collecting system information, including power consumption information, at different locations and levels in a data center or facility, and then using the system information to manage the capacity and consumption of electrical power within the data center. Additionally, wired sensor devices or other sources of system data can be deployed for collecting system information, including power consumption information, which can be communicated along with the data from the wireless sensor devices to an analysis processor for management of capacity and consumption of electrical power within the data center.
- Wireless mesh network technology can be used for deploying sensors as wireless nodes in a variety of different environments for monitoring diverse parameters such as, for example, power consumption or power usage, temperature, pressure, humidity, airflow/fluid flow, the presence of moisture, the presence of smoke or fire, electrical current, power, air quality, air particle count, and the like.
- These types of networks can be denoted wireless sensor networks (WSN).
- WSN wireless sensor networks
- Each sensor in a WSN can be powered by a battery and therefore capable of operating in a wireless configuration.
- the sensors can constantly monitor a system and/or the environment for various system conditions and may communicate with other nodes and/or a network controller or gateway.
- FIG. 1 illustrates a network environment of an example embodiment including a mesh network 110 of wireless sensors 112.
- WSN Wireless sensor network
- the nodes 112 can communicate using established data communication protocols, typically at the Media Access Control (MAC) Layer.
- the MAC Layer is one of two sub-layers that make up the Data Link Layer of the well-known OSI networking model.
- the MAC layer is responsible for moving data packets to and from the network interface of one node to another node across a shared channel.
- a node can be any vertex or intersection in the communication network 110.
- a node may be passive or intelligent.
- a node is assumed to be an intelligent node capable of receiving and analyzing information, taking certain actions as a result of received information, including the storing of received or processed information, modifying at least part of received information, and in some instances originating and retransmitting information.
- the details of a node of a particular embodiment are shown in Figure 2.
- data packets or messages can be directed between any two nodes of the WSN 110 as each node 112 has a unique identifier.
- a data packet or message is a self-contained unit of transmitted information. Typically, a data packet has a header, a payload, and an optional trailer.
- a link is a path which originates at one node and terminates at one other node. A link or path between nodes may include multiple hops between a plurality of intermediate nodes prior to reaching a destination node.
- the transfer of messages between two nodes of WSN 110 in a unicast or broadcast transmission is termed a local communication.
- Each of the nodes 112 of WSN 110 can also communicate with a set of gateways 105 via a gateway interface 106.
- the gateway 105 provides a connection between the WSN 110 and an analysis processor 100.
- Analysis processor 100 can be used to receive sensor data from any of the nodes 112 of WSN 110 via gateway 105 and wide-area network 108 and to analyze the sensor data for aggregated system monitoring and control.
- Gateway 105 and analysis processor 100 can also each provide a connection to a wide-area network 108, such as the Internet. In this manner, the analysis processor 100, the gateway 105, and the WSN 110 can obtain access to the Internet.
- Gateway 105 and analysis processor 100 can use a conventional data storage device 104 for data storage and retrieval.
- an internal data connection 102 can be provided to link Gateway 105 and analysis processor 100 for data communications.
- the WSN 110 can be configured in any of a variety of ways.
- Nodes 112 can be added, removed, or moved within the array of nodes of WSN 110.
- Each of the nodes 112 include functionality to join or reconfigure themselves in the WSN 110 when a node is added or moved.
- each node 112 can discover its neighbor nodes and automatically negotiate and establish communication paths with those neighbors.
- a node can be in direct data communication with neighbors that are within the radio reception range of the node.
- the wireless transceivers e.g., radios
- the distance between neighbor nodes is variable. Given that in some applications the environment in which WSN 110 is being used may be subject to radio interference, it is possible that the wireless data communications between nodes may be disrupted.
- each node can sense the loss of data communications with a neighbor and may reconfigure itself to use alternate data paths through other functioning nodes of WSN 110, As such, the WSN 110 is highly adaptable to changing conditions in the environment and in the configuration of the wireless network.
- Figure 2 shows a diagrammatic representation of a machine in the example form of a network node or sensor unit 200 within which a set of instructions, for causing the node to perform any one or more of the methodologies discussed herein, may be executed.
- the node operates as a standalone device or may be connected (e.g., networked) to other machines.
- the node may operate in the capacity of a server or a client machine in client-server network environment, or as a peer machine in a peer-to-peer (or distributed) network environment, such as a mesh network.
- the node may be a computer, an intelligent sensor, a logic device, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a hard- wired module, a network router, gateway, switch or bridge, or any mac ne capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
- ASIC application specific integrated circuit
- FPGA field programmable gate array
- a network router, gateway, switch or bridge or any mac ne capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
- machine or “node” shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
- the example node 200 includes a processor 202 (e.g., a central processing unit (CPU)), a main memory 204 and optionally a static memory 206, which communicate with each other via a bus 201.
- the node 200 may further include one or more sensor devices 212, 214, and 216.
- These sensor devices can include power consumption or power usage sensors, voltage measurement devices, electrical current measurement devices, wattage measurement devices, inductance measurement devices, electromagnetic field (EMF) measurement devices, temperature sensors, humidity sensors, air pressure sensors, air flow sensors, moisture detectors, carbon monoxide detectors, fire/smoke detectors, motion detectors, seismic detectors, electrical current sensors, power sensors, air quality sensors, air particle count sensors, magnetic anomaly sensors, and/or other types of sensors for detecting and measuring a desired system or environmental condition.
- EMF electromagnetic field
- the node 200 may further include a non-volatile memory 218, a control signal generation device 222, and a network interface device 208 (e.g., a radio transceiver or wireless device capable of connection with a network).
- the non- volatile memory 218 includes a machine-readable medium 219 in which is stored one or more sets of instructions (e.g., software and data 220) embodying any one or more of the methodologies or functions described herein.
- the instructions 220 may also reside, completely or partially, within the main memory 204, the static memory 206, and/or within the processor 202 during execution thereof by the node 200.
- the main memory 204, static memory 206, and the processor 202 also may constitute non-transitory machine-readable media.
- the software, instructions, and/or related data 220 may further be transmitted or received over a network 210 via the network interface device 208.
- the network interface device 208 in a wireless node configuration of one embodiment, may include a radio transceiver for sending and receiving data to/from network 210 using a wireless data transfer protocol, such as the family of 802.11 standards from IEEE. In this manner, node 200 can perform wireless data communications with other nodes of WSN 110.
- the control signal generation device 222 can be used to control the operation of a management system, such as a power management system, electrical control unit, a lieating/ventilating/aii- conditioning (HVAC) system, a fan, a heat pump, or other device or system that can alter the power consumption or environmental conditions being monitored by sensors 212, 214, and 216.
- a management system such as a power management system, electrical control unit, a lieating/ventilating/aii- conditioning (HVAC) system, a fan, a heat pump, or other device or system that can alter the power consumption or environmental conditions being monitored by sensors 212, 214, and 216.
- HVAC lieating/ventilating/aii- conditioning
- Gateway 105 can provide synchronization timing for the nodes
- Gateway 105 can send periodic messages to each of the nodes 112 of WSN 110. These periodic messages can include a timing signal (e.g. a beacon) to which each of the nodes 112 can synchronize their internal timers. Similarly, messages from gateway 105 to each of the nodes 112 can be used to provide system status, configuration, and control settings for the nodes of WSN 110.
- a timing signal e.g. a beacon
- an apparatus and method for managing power capacity in data centers using a wireless sensor network includes using a network of wireless sensors to monitor various system conditions, including power consumption, in specific devices of a data center over time and to generate control signals to manage power capacity and consumption and related conditions.
- wired sensor devices (WSDs) or other sources of system data can be deployed for collecting system information, including power consumption information, which can be communicated along with the data from the wireless sensor devices to an analysis processor for management of capacity and consumption of electrical power within a data center.
- WSDs wired sensor devices
- an analysis processor for management of capacity and consumption of electrical power within a data center.
- various example embodiments of the disclosed subject matter provide an apparatus and method for cost effective and efficient measuring of power usage (includhig current, voltage, power, power factor, energy, etc.) of different kinds of electrical equipment in a facility (e.g., a data center).
- the system includes two sets of devices: (a) RPDUs 320, and (b) Wireless bridge devices (WBD) 310.
- An RPDU 320 (also denoted a power distribution unit (PDU) herein) includes a series of electrical outlets or jacks for distributing electrical power for a plurality of electrical or electronic devices 314 in a rack 312 of electrical equipment.
- the RPDU 320 is connected to an electrical power source via electrical cable 322.
- the RPDU 320 also includes power measurement circuitry for sampling and measuring the electrical power consumed by electrical devices 314 connected to each of the electrical outlets.
- the RPDU 320 includes circuitry for converting the sampled electrical power consumption measurements into power consumption data, which can be transferred to a wireless bridge device (WBD) 310 via a data line 324.
- WBD wireless bridge device
- the data line 324 can be an Ethernet connection or a conductor for transferring serial data to WBD 310.
- Conventional RPDU devices are available.
- Wireless bridge devices (WBD) 310 such as those described herein, are not commercially or otherwise available from third parties.
- the Wireless bridge device (WBD) 310 can include a low cost microprocessor, a wireless radio, interfaces to one or more RPDUs 320, and additional circuitry, as described below in connection with Figure 6.
- each RPDU 320 is connected to a plurality of electrical devices 314 in racks 312.
- Each RPDU 320 is also connected to an electrical power source via power cable or cord 322.
- the RPDU 320 measures the electrical power consumed by each device 314 to which the RPDU 320 is connected.
- RPDU 320 devices measure the power usage of electric or electronic devices (e.g., servers) Al through A6 and Bl through Bn of racks A and B 312.
- Each RPDU 320 measures the electrical power consumed by each device 314 to which the RPDU 320 is connected and reports this power consumption information as system data to a set of wireless bridge devices (WBD) 310.
- the RPDUs 320 can transfer the power consumption data to the WBDs 310 via a wired connection, such as an Ethernet or serial data connection 324.
- the WBD 310 can aggregate this system data and report the system data, including power consumption data, to a gateway 330 in wireless network data transmissions 332 via wireless network 110.
- the gateway 330 can then report the system data to an analysis processor 100 via a wide-area network 108 or via an internal data connection 102 in a particular embodiment.
- FIG 3 illustrates a data center configuration of a particular embodiment that includes a set of racks 312 that support stacked sets of electronic equipment 314.
- wireless sensor devices can be installed at various points proximate to racks 312.
- the wireless sensor devices can be implemented as the devices illustrated in Figure 2 and described above.
- the wireless sensor devices are wirelessly networked together in a wireless network 110 (an example of which is shown in Figure 1) and in data communications with gateway 330, analysis processor 100, and wide-area network 108.
- the WBDs 310 can also be implemented as wireless sensor devices, which include the capability to interface with the RPDUs 320 as described herein.
- the WBDs 310 can be considered wireless sensor devices and nodes in the wireless network 110.
- Each of the wireless sensor devices, including WBDs 310 can be configured to sense various system conditions, such as environmental conditions.
- the WBDs 310 can receive power usage/consumption information (including current, voltage, power, power factor, energy, etc.) and the like from the RPDUs 320.
- wireless sensor devices can measure the system conditions at each sensor location and retain the system data measurements along with a timestamp associated with each system data measurement Using the wireless data network 110, the wireless sensor devices can transmit time-stamped system data along with a sensor identifier to the analysis processor 100 for processing.
- the time-stamped system data can be sent to the analysis processor 100 via a pathway of nodes in wireless network 110, gateway 330, and wide-area network 108. In this manner, the analysis processor 100 can collect the time-stamped system data from each of the wireless sensor devices installed in racks 312. It will be understood by those of ordinary skill in the art upon reading this patent disclosure that an arbitrary number of wireless sensor devices can be installed in the racks 312 in arbitrary positions within each rack of a particular data center. In general, the greater number of wireless sensor devices increases the ability for the system to detect more subtle changes in the system conditions within the data center.
- the analysis processor 100 can use the system data to control operation of the plurality of electronic devices 314 in the facility.
- each WBD 310 can receive power consumption data from one or more RPDUs 320.
- the WBD 310 can then use the multi-hop mesh network (such as wireless network 110) to send the data to the analysis processor 100 via gateway 330 for data processing.
- RPDUs 320 and wireless bridge devices (WBD) 310 cooperate in the following way to measure and communicate power usage information.
- Each RPDU 320 is capable of sampling electrical power usage/consumption data at a plurality of power outlets or jacks to which electrical devices 314 are connected. After sampling the data, the RPDU 320 can convert the sampled measurements to power capacity/usage/consumption data, generally denoted system data, which can be locally stored and/or transferred via a data connection 324 (e.g., a wired data connection). In this manner, the RPDU 320 can perform among the following power measurements and system data generation. In an example embodiment, the RPDU 320 can:
- the RPDU 320 may locally store the measured and/or calculated power capacity/usage/consumption data, generally denoted system data, in long- term data storage on the RPDU 320 device itself. Periodically, the RPDU 320 can send the measured and converted system data to the WBD 310 to which the RPDU 320 is connected. Alternatively, the WBD 310 can poll the RPDU 320 for the power usage/consumption data.
- a primary WBD 310 can be the WBD 310 associated with the rack 312 in which the monitored devices 314 are installed. In other embodiments, the primary WBD 310 can be the WBD 310 associated with a particular one of the plurality of RPDUs 320 at system initialization time.
- the primary WBD 310 can collect system data from a plurality of associated RPDUs 320.
- the primary WBD 310 can also collect system data wirelessly from a plurality of other WBDs 310.
- the primary WBD 310 can aggregate the system data and use a multi-hop mesh network (such as wireless network 110) to send the system data to the analysis processor 100 via gateway 330 for data processing.
- a multi-hop mesh network such as wireless network 110
- a data center configuration of another embodiment includes a set of racks 312 that support stacked sets of electronic equipment 314.
- RPDUs 320 have been installed with power outlets or jacks for each of the electronic devices 314 residing in racks 312.
- the RPDUs 320 are each coupled between an electrical power source via electrical cable 322 and a corresponding set of the electronic devices 314.
- each WBD 310 can receive system data, including power consumption data, from one or more RPDUs 320.
- the WBD 310 can then use the multi-hop mesh network (such as wireless network 110) to send the data to the analysis processor 100 via gateway 330 and wide-area network 108 for data processing.
- a particular embodiment uses a multi- tier communication architecture for collecting and distributing information.
- the local network consists of a set of RPDUs 320 and an associated primary WBD 310.
- the local network is managed by the primary WBD 310.
- the primary WBD 310 is responsible for initiating, synchronizing, scheduling, and managing data communication in the local network.
- data transfer in the local network takes place between an RPDU 320 and the primary WBD 310.
- the RPDUs 320 form a local communication network with the primary WBD 310 to which the RPDUs 320 are connected.
- the primary WBD 3102 manages the local network.
- other collections of RPDUs 320 form local networks with their corresponding primary WBD 310.
- the global network is a multi-hop mesh network that integrates a plurality of wireless bridge devices (WBD) 310 with one or more gateways 330.
- WBD wireless bridge devices
- An example embodiment is shown in Figure 5.
- the global network is used to distribute system data that is collected by the RPDUs 320 or other wireless sensor devices that may be in wireless data communication with the wireless bridge devices (WBD) 310.
- a plurality of wireless bridge devices (WBD) 310 forms a global network with one or more gateways 330.
- the global network is used to transfer system information to the gateways 330 and the analysis processor 100 in a multi-tiered communication architecture.
- data transfer between network nodes takes place in two general phases: a data collection phase and a data aggregation phase.
- the WBDs 310 collect power related information (system data) periodically from the electronic devices 314 via the RPDUs 320 to which the electronic devices 314 are connected.
- the RPDUs 320 may be able to aggregate some of this system data locally.
- the RPDUs 320 can send the aggregated system data to their primary WBD 310.
- the wireless bridge devices (WBD) 310 can collect aggregated system data from a plurality of RPDUs 320.
- the wireless bridge devices (WBD) 310 can aggregate the collected system data.
- the wireless bridge devices (WBD) 310 can send the collected system data to the gateway 330 using the global network described above.
- An example of the routing of the system data is shown in Figure 5 as a routing of a network data message 512 through the local and global networks as described herein.
- FIG. 5 illustrates a layout of an example data center in which an example array of RPDUs 320 has been deployed.
- a typical deployment can include an array of networked devices (including wireless bridge devices (WBD) 310 and gateways 330) in a distributed network architecture.
- the system described herein can mclude several kinds of devices, including wireless sensor devices, RPDUs 320, wireless bridge devices (WBD) 310, gateways 330, routers, controllers, and the like that are distributed in the data center.
- Figure 5 illustrates such an example system.
- Gateways 330 can connect the RPDUs 320 to a wide-area network 108, such as an Internet Protocol ( ⁇ ) network including the Internet, via wireless bridge devices (WBD) 310.
- Gateways 330 typically have communication paths to all sensing and control devices in a particular system.
- Gateways 330 can send commands, status information, or data center relevant information to the other network devices (e.g., WBDs 320).
- an example system can include a centralized software system, called the Analysis Processor 100 (shown in Figure 1), which stores all of the sensing, control, and status information that is forwarded to the gateways 330 by the other system devices (310 and 320).
- the Analysis Processor 100 is primarily a repository of information and system-wide data processing for the system.
- the Analysis Processor 100 can also control the electronic devices 314 in a particular facility in order to affect the overall power consumption of the facility.
- the wireless bridge devices (WBD) 310 and gateways 330 denoted generally herein as the network devices, cooperate to establish a mesh data communications network that provides connectivity among the network devices.
- wired sensor devices (WSDs) 750 or other sources of system data can also be deployed with the RPDUs 320 for collecting system information, including power consumption information, which can be communicated along with the data from the wireless sensor devices via gateways 330 to an analysis processor 100 for management of capacity and consumption of electrical power within a data center.
- FIG. 6 illustrates an example embodiment of a wireless bridge device (WBD) 310 that can operate in a wireless sensor network of various embodiments.
- electronic devices 314 e.g., servers
- racks 312 are typically powered via electrical power cords or cables that attach to the electronic device 314 on one side and to an RPDU or Power Distribution Unit (PDU) 320 on another side.
- PDU Power Distribution Unit
- the RPDU 320 of an example embodiment is connected to an electrical power source via electrical cable 322.
- the RPDU 320 also includes power measurement circuitry for sampling and measuring the electrical power consumed by electrical devices 314 connected to each of the electrical outlets of the RPDU 320.
- the RPDU 320 includes circuitry for converting the sampled electrical power consumption measurements into power consumption data, which can be transferred to the wireless bridge device (WBD) 310 via a data line 324.
- the data line 324 can be an Ethernet connection or a conductor for transferring serial data to WBD 310.
- a WBD 310 of an example embodiment is shown to include one or more RPDU interfaces or Power Distribution Unit (PDU) interfaces 620, one or more low cost microprocessors 622, a wireless radio 624, and additional circuitry 626.
- a WBD 310 can be connected to an RPDU 320 via data line 324 and RPDU interface 620.
- the RPDU 320 uses its power measurement circuitry to measure the electrical power consumed by the electronic devices 314 to which the RPDU 320 is connected.
- the electrical power usage/consumption data can be retained in a memory of the RPDU 320 and ultimately sent from the RPDU 320 to the WBD 310.
- the WBD 310 includes two microprocessors 622: one to run an IP network stack, and another microprocessor 622 to run a 15.4 network stack.
- the WBD 310 includes a wireless radio 624 and one or more RPDU interfaces 620 for connecting with RPDUs 320.
- Additional circuitry 626 can also be provided for storing processed power usage/consumption data or for sensing other environmental conditions in a manner similar to a wireless sensor device as described above. Additional circuitry 626 can also be provided for sensing various system or environmental conditions from the WBD 310.
- the RPDU interfaces 620 of the WBD 310 can also include a number of serial and/or ⁇ ports, which can be used to connect the WBD 310 with a number of RPDUs 320. As shown in the particulai" embodiment of Figure 7, the WBD 310 is connected with two RPDUs 320 via data connections 324, In general, a WBD 310 can be connected with several RPDUs 320, limited primarily by the number of ports available on a particular WBD 310. In another embodiment, WBD 310 can be connected with one or more RPDUs 320 via a wireless data link.
- each WBD 310 has a unique identifier (ED) that is provided during manufacturing that is embedded electronically and is bar-coded on the outside of the device.
- each WBD 310 includes one or more RPDU interfaces or Power Distribution Unit (PDU) interfaces 620, one or more low cost microprocessors 622, a wireless radio 624, and additional circuitry 626.
- the wireless radio 624 of a particular embodiment contains a 2.4GHz ISM band transceiver and an embedded microcontroller 622.
- the network stack and data management firmware is housed in and executed by the microcontroller 622.
- An internal antenna supports the wireless radio 624.
- An on-board battery or a separate power cord and external 24VDC power adapter can provide power for the electronics of the WBD 310.
- the hardware architecture of the WBD 310 includes several serial and IP ports associated with an embedded IP microprocessor.
- the IP microprocessor manages the interconnection with RPDUs 320.
- Each WBD 310 can also contain a microprocessor for wireless network processing and a radio 624 that is used to form a mesh wireless network and to transfer the collected power usage/consumption data from the RPDUs 320.
- RPDUs 320 generally provide two interfaces for transferring power usage/consumption data: Ethernet ports that provide Simple Network Management Protocol (SNMP) or Web access, and RS232 serial ports that provide access to registers that contain the required data.
- SNMP Simple Network Management Protocol
- RS232 serial ports that provide access to registers that contain the required data.
- Each WBD 310 can have one or more RS232 serial ports (provided via interfaces 620); each port can be attached to an RPDU 320 as data center racks often have two power strips for each rack. The data rates are generally around 19200 bps and higher.
- the WBD 310 can auto baud to adapt to the configured data rate of the RPDU 320. In cases where DC power is supplied via the serial port, a WBD 310 can derive power from the RPDU 320.
- Each WBD 310 can also include one or more Ethernet ports (provided via interfaces 620). Each port can be attached to IP ports on the RPDUs 320.
- the firmware on the WBD 310 can use SNMP or Web Services protocols to connect with each RPDU 320, and collect information.
- the WBD 310 can discover the characteristics of the RPDU 320, and can use communication protocols (such as SNMP) to collect data from the RPDU 320.
- Each WBD 310 can also provide an envhOnmental sensing harness interface to allow an optional environmental sensing capability.
- a WBD 310 manages the local communication network that includes a set of RPDUs 320.
- the WBD 310 collects power data from the RPDUs 320 and uses the global network to transmit the information to a centralized location for storage and processing.
- Each WBD 310 can periodically poll the associated RPDUs 320 and collect power and status data (system data) from them.
- the WBD 310 can aggregate the collected information and assemble the system data into network data packets.
- the WBD 310 can then send the data packets using the mesh network 110 to a central server (e.g., analysis processor 100) where the system data can be processed.
- the WBD 310 may also receive a command from a central server (e.g., analysis processor 100).
- the WBD 310 can then use the identity of a particular RPDU 320 to identify the specific RPDU 320 and forward the command to the specific RPDU 320. In this manner, the analysis processor 100 can control a specific RPDU 320 via the WBD 310 and the wireless network 110.
- Wireless bridge devices (WBD) 310 can have a display to show current status and may allow parameters to be selected during the installation process. Push buttons can be provided to set the mode of operation and provide installation functions.
- Configuration involves associating a specific WBD 310 with a set of RPDUs 320, and the outlet/equipment/rack to which a particular RPDU 320 is attached. A configuration tool is used to record and store this information.
- the configuration process involves three distinct steps: (i) Identification, (ii) WBD 310 and RPDU 320 association, and (iii) RPDU 320 discovery. These three phases of the configuration process in an example embodiment are described in more detail below.
- Identification involves collecting the identifier associated with each RPDU 320 and storing the identifier with the configuration tool. This can be achieved in one of the several ways: 1) manually associate a rack number with each RPDU 320. Also, associate a unique RPDU identifier with each RPDU 320. Store the rack number and the unique RPDU identifier in the configuration tool; or 2) the configuration tool can include a bar code scanner, which is used to scan the bar code associated with each RPDU 320 and the corresponding rack.
- the identification phase can also include among the following configuration operations: (i) associate each RPDU 320 with a server or other IT device that the RPDU 320 is monitoring, (ii) associate the RPDU 320 with the power source to which the RPDU 320 is plugged, (iii) associate the RPDU 320 with the particular power circuit by which the RPDU 320 is fed, and (iv) associate the RPDU 320 with the internal electrical distribution panel board or external power panel board (power distribution panel) by which the RPDU 320 is fed.
- Association involves creating a relation between an RPDU 320 and a WBD 310. Every RPDU 320 needs to be associated with a WBD 310. This association is used to determine which RPDU 320 is used to measure power of which rack or collection of electric devices 314. The process involves associating a unique identifier of the RPDU 320 with the unique identifier of the WBD 310.
- a configuration tool e.g., a software application
- This association can take place in one of the several ways in an example embodiment: 1) the configuration tool records the unique identifier of the RPDU 320, the unique identifier of the WBD 310, port type (serial or IP), and port number on which the RPDU 320 is attached; or 2) the configuration tool uses absolute location information or relative location information of the RPDU 320 to associate the RPDU 320 with the corresponding WBD 310.
- the discovery process in an example embodiment involves a
- each WBD 310 learning the meta-information (or Management Information Base (MIB) in SNMP terminology) associated with an RPDU 320.
- MIB Management Information Base
- the meta- iriformation is used to receive data from or send commands to the RPDU 320.
- the discovery can take place in one of the several ways: 1) each WBD 310 is preloaded with meta-information about a wide variety of RPDUs 320. During the association process, the configuration tool specifies the manufacturer of the particular RPDU 320. The manufacturer information is then downloaded into each WBD 310 using the mesh network 110.
- MIB Management Information Base
- the WBD 310 uses this information to select meta-information specific to the particular RPDU 320, and then uses the selected meta-information to interact with the particular RPDU 320; 2) the configuration tool is used to identify the manufacturer information associated with each RPDU 320. The configuration tool then uses the association between a specific RPDU 320 and a corresponding WBD 310 to determine the kind of meta- information that will be needed by the WBD 310. The configuration tool then uses the mesh network 110 to download specific meta-information into the WBD 310; or 3) each WBD 310 stores a pattern of possible meta-information for a variety of RPDUs 320. The WBD 310 periodically probes each RPDU 320 by sending commands, and examining the results. Based on the results, the WBD 310 learns the meta-information about each RPDU 320. The process here can be completely automated.
- a data center can be monitored and controlled using a plurality of wireless smart plug devices instead of RPDUs.
- a particular embodiment includes two sets of devices: (a) Power Monitors 1318, and (b) Communication Hubs 1320.
- a power monitor 1318 (also denoted a Smart Plug (SP) herein) includes power measurement circuitry, a low cost microprocessor, a wireless radio and additional circuitry, as described below in connection with Figure 11.
- SP Smart Plug
- Each power monitor 1318 is connected to a different one of the electrical devices 1314 and to a power strip 1316 or other electrical power source via power cords 1317.
- the power monitor 1318 measures the electrical power consumed by the device 1314 to which the power monitor 1318 is connected.
- power monitor 1318 devices PM1, PM2, PM3, and PMn respectively, measure the power usage of electric devices (e.g., servers) Al, A2, A3, and Bn.
- Each power monitor 1318 measures the electrical power consumed by the device 1314 to which the power monitor 1318 is connected and reports this power information as system data to a set of communication hubs 1320 in wireless network data transmissions 1 19.
- the communication hub 1320 can aggregate this system data and report the system data, including power consumption data, to a gateway 1330 in wireless network data transmissions 1322.
- the gateway 1330 can then report the system data to an analysis processor 100 via a wide-area network 108 or via an internal data connection 102 in a particular embodiment.
- FIG 8 illustrates a data center configuration 1310 of a particular embodiment that includes a set of racks 1312 that support stacked sets of electronic equipment 1314.
- wireless sensor devices 1 18 have been installed at various points proximate to racks 1312.
- the wireless sensor devices 1318 can be implemented as the devices illustrated in Figure 2 and described above.
- the wireless sensor devices 1318 are wirelessly networked together in a network 110 (an example of which is shown in Figure 1) and in data communications with a communication hub 1320, gateway 1330, and an analysis processor 100.
- Each of the sensors 1318 can be configured to sense various system conditions, such as power usage (including current, power, power factor, energy, etc.) and the like.
- sensors 1318 can measure the system conditions at each sensor location and retain the system data measurements along with a timestamp associated with each system data measurement.
- the sensors 1318 can transmit time- stamped system data along with a sensor identifier to the analysis processor 100 for processing.
- the time-stamped system data can be sent to the analysis processor 100 via communication hub 1320, gateway 1330, and network 108.
- the analysis processor 100 can collect the time-stamped system data from each of the sensors 1318 installed in racks 1312. It will be understood by those of ordinary skill in the art upon reading this patent disclosure that an arbitrary number of sensors 1318 can be installed in the racks 1312 in arbitrary positions within each rack of a particular data center. In general, the greater number of sensors 1318 increases the ability for the system to detect more subtle changes in the system conditions within the data center as described in detail herein.
- the analysis processor 100 can use the system data to control operation of the plurality of electronic devices 1314 in the facility.
- each communication hub device 1320 can receive data wirelessly from a number of power monitors 1318.
- the communication hub 1320 can then use a multi-hop mesh network (such as network 110) to send the data to the analysis processor 100 via gateway 1330 for data processing.
- power monitors 1318 and communication hubs 1320 cooperate in the following way to measure and communicate power usage information.
- Each power monitor 1318 is capable of sampling power usage data at a very high rate. After sampling the data, the power monitor 1318 can perform computations to calculate different power related metrics. The power monitor 1318 may also store the measured data and calculated metrics, generally denoted system data, in long-term data storage on the power monitor 1318 device itself. Periodically, the power monitor 1318 can send the calculated and measured system data to its primary communication hub 1320.
- the primary communication hub 1320 can be the communication hub 1320 associated with the rack 1312 in which the monitored device 1314 is installed. In other embodiments, the primary communication hub 1320 can be the communication hub 1320 associated with a particular one of the plurality of power monitors 1318 at system initialization time.
- the primary communication hub 1320 can collect data wirelessly from a plurality of associated power monitors 1318.
- the communication hub 1320 can aggregate the system data and use a multi-hop mesh network (such as network 110) to send the data to the analysis processor 100 via gateway 1330 for data processing.
- a multi-hop mesh network such as network 110
- PM2, and PM3 measure power consumed by servers 1314 (A 1, A2, and A3 in Rack A), respectively.
- Power monitors 1318 (PMl, PM2, and PM3) can then forward the measured power consumption information as system information to a primary communication hub 1320 (e.g., Hub A).
- power monitor 1318 (PMn) can measure power consumed by server 13.14 Bn in Rack B).
- Power monitor 131 (PMn) can then forward the measured power consumption information as system information to a primary communication hub 1320 (e.g., Hub B).
- a data center configuration 410 of another embodiment includes a set of racks 1312 that support stacked sets of electronic equipment 1314.
- power monitors 1318 have been installed with each of the electronic devices 1314 residing in racks 1312.
- the power monitors 1318 are each coupled between a power source (e.g., an electrical power strip) 1316 and a corresponding one of the electronic devices 1314.
- each communication hub device 1320 can receive system data, including power consumption data, wirelessly from a plurality of power monitors 1318.
- the communication hub 1320 can then use a multi-hop mesh network (such as network 110) to send the data to the analysis processor 100 via gateway 1330 and network 108 for data processing.
- a multi-hop mesh network such as network 110
- a particular embodiment uses a multi- tier communication architecture for collecting and distributing information.
- the local network consists of a set of power monitors 1318 and an associated primary communication hub 1320.
- the local network is managed by the primary communication hub 1320.
- the primary communication hub 1320 is responsible for initiating, synchronizing, scheduling, and managing data communication in the local network.
- data transfer in the local network takes place between power monitors 1318 and the primary communication hub 1320.
- power monitors 3182 form a local communication network with primary communication hub 3202.
- the primary communication hub 3202 manages the local network.
- other collections of power monitors 1318 form local networks with their corresponding primary communication hub 1320.
- the global network is a multi-hop mesh network that integrates a plurality of communication hubs 1320 with one or more gateways 1330.
- An example embodiment is shown in Figure 10.
- the global network is used to distribute system data that is collected by the power monitors 1318 or other sensors that may be attached to the communication hubs 1320.
- a plurality of communication hubs 1320 forms a global network with one or more gateways 1330.
- the global network is used to transfer system information to the gateways 1330 in a multi-tiered communication architecture.
- data transfer between network nodes takes place in two general phases: a data collection phase and a data aggregation phase.
- the power monitors 1318 collect power related information (system data) periodically from the electronic devices 1314 to which the power monitors 1318 are connected.
- the power monitors 1318 can aggregate this system data locally.
- the power monitors 1318 can send the aggregated system data to their primary communication hub 1320.
- the communication hubs 1320 can collect aggregated system data from a plurality of power monitors 1318.
- the communication hubs 1320 can aggregate the collected system data. At pre-configured intervals or upon request from another network device, the communication hubs 1320 can send the collected system data to the gateway 1330 using the global network described above.
- An example of the routing of the system data is shown in Figure 10 as a routing of a network data message 512 through the local and global networks as described herein.
- FIG 10 illustrates a layout of an example data center 510 in which an example array of power monitors 1318 has been deployed.
- a typical deployment can include an array of networked devices (mcluding power monitors 1318, communication hubs 1320, and gateways 1330) in a distributed network architecture.
- the system described herein can include several kinds of devices, including wireless sensors, power monitors 1318, communication hubs 1320, gateways 1330, routers, controllers, and the like that are distributed in the data center 510.
- Figure 10 illustrates such an example system.
- Gateways 1330 connect the power monitors 1318 to a wide-area network 108, such as an Internet Protocol (IP) network including the Internet, via communication hubs 1320.
- IP Internet Protocol
- Gateways 1330 typically have communication paths to all sensing and control devices in a particular system. Gateways 1330 can send commands, status information, or data center relevant information to the other network devices (1318 and 1320).
- IP Internet Protocol
- wired sensor devices (WSDs) 750 or other sources of system data can also be deployed with the power monitors 1318 for collecting system information, including power consumption information, which can be communicated along with the data from the wireless sensor devices via gateways 1330 to an analysis processor 100 for management of capacity and consumption of electrical power within a data center.
- a communication hub 1320 manages the local communication network that includes a set of power monitors 1318.
- the communication hub 1320 collects power data from the power monitors 1318 and uses the global network to transmit the information to a centralized location for storage and processing.
- Communication hubs 1320 can have a display to show current per phase and allow outlets to be selected during the installation process. Push buttons can be provided to set the mode of operation and provide installation functions.
- a serial port can be provided to attach a bar-code scanner during the installation process.
- the hardware architecture of a particular embodiment of the communication hub 1320 includes a serial port to support the bar code scanner, an embedded 8-bit, 16-bit, or 32-bit processor, two radio devices, one for the local communication network, and another for the global communication network.
- configuration involves associating a specific power monitor 1318 with a set of communication hubs 1320, and the outlet/equipment to which the power monitor 1318 is attached.
- a configuration tool is used to record and store this information.
- the configuration tool uses a process involving four steps: (i) Identification, (ii) Device and power monitor 1318 association, (iii) Local Network Registration, and (iv) Router configuration. These steps are described in more detail below.
- Identification involves collecting the unique identifier associated with each power monitor 1318 and storing these identifiers with the configuration tool. This identification step can be achieved in one of the several ways:
- the configuration tool can include a bar code scanner, which is used to scan the bar code associated with each power monitor 1318.
- the configuration tool can include a radio and may use the radio to directly communicate with the power monitor 1318. Once the power monitor 1318 is turned on (activated), the power monitor 1318 can send its unique identifier to the configuration tool.
- the power monitor 1318 can send its identifier to the communication hub 1320, which then sends the identifier to the gateway 1330.
- the configuration tool can download the unique identifier from the gateway 1330 either through the network 108 or by connecting directly to the gateway 1330 through a USB or serial port.
- Every power monitor 1318 can be associated with a device 1314 or power outlet to which the power monitor 1318 is attached. This association is used to determine which power monitor 1318 is used to measure the power of which device 1314.
- the process involves associating the identifier of a power monitor 1318 with a unique identifier of the device 1314 to which the power monitor 1318 is attached. This association can take place in one of several ways:
- the configuration tool records the IP address of the device 1314, and associates the device IP address with the identifier of the power monitor 1318 being used to measure the power consumption of the device 1314.
- the configuration tool can use a hardware identification number (such as the MAC ID) of the device 1314 to associate the device 1314 with the identifier of the power monitor 1318 being used to measure the power consumption of the device 1314.
- the configuration tool can use an absolute location (X, Y, Z) of the device 1314 withiii a data center or a relative location (X, Y, Z) of the device 1314 to associate the device 1314 with the identifier of the power monitor 1318 being used to measure the power consumption of the device 1314.
- the configuration tool can use relative placement information corresponding to a placement of the device 1314 within a specific location of a data center. For example, a server can be identified by the rack and the specific slot within the rack in which the server is placed. This relative placement information can be used to associate the device 1314 with the identifier of the power monitor 1318 being used to measure the power consumption of the device 1314.
- the configuration tool uses an identifier (such as host name) assigned to each device 1314, and associates this identifier with the identifier of the power monitor 1318.
- identifier such as host name
- Local network registration in a particular embodiment involves creating a subnet that includes a set of power monitors 1318.
- This subnet creation involves using the configuration tool to assign a unique identifier (subnet address) to each local network.
- the configuration tool may also assign a unique name or location to each subnet.
- each local network is associated with a primary communication hub 1320, which acts as a router and manager for the local network.
- Router e.g., primary communication hub 1320
- the communication hub 1320 is pre-loaded with the identifiers of the associated power monitors 1318 and the corresponding local network identifier.
- the configuration tool uses the global network to download the corresponding local network identifier, and the identification number of each associated power monitor 1318 to a corrrmunication hub 1320.
- the configuration tool uses radio hardware to download the corresponding local network identifier, and associated power monitor 1318 identifiers to a communication hub 1320.
- the communication hub includes displays and user interfacing elements (such as touch interfaces and buttons). An installer uses these elements to key in the local network identifier and the identifiers of power monitors that are part of the specific local network.
- the initialization phase involves the formation of the network in which both local and global networks are initialized.
- the techniques for building the global network are described above in relation to building the WSN 110.
- the method used for initialization of the local network in a particular embodiment is described next.
- a power monitor 1318 Once a power monitor 1318 is turned on (activated), the power monitor 1318 tries to connect with a communication hub 1320 by sending beacons.
- a beacon is a data message sent via the wireless network. If there is no response from a communication hub 1320, possibly because the communication hub 1320 has not been turned on or the global network has not been formed, the power monitor 1318 can: 1) sleep for some pre-configured length of time, 2) try sending the beacon again, or 3) choose a channel (e.g., a particular radio frequency band) on which the power monitor 1318 can periodically request formation of the network.
- a channel e.g., a particular radio frequency band
- the communication hub 1320 can collect infonnation related to the local networks that the communication hub 1320 needs to support. The communication hub 1320 can then monitor all channels on its secondary radio for request beacons from power monitors 1318. Once the corrrrnunication hub 1320 receives a request beacon from a power monitor 1318, the communication hub 1320 can check its list of power monitors 1318 that the communication hub 1320 needs to support. If the requesting power monitor 1318 is on the list of power monitors 1318 that the communication hub 1320 needs to support, the request from the power monitor 1318 is verified. If the request is verified, the communication hub 1320 can send a confirm message to the requesting power monitor 1318. Once the communication hub 1320 receives an acknowledgement from the requesting power monitor 1318, a confirmation message is sent back to a network manager, which records the formation of the local network.
- a power monitor can become part of a local network is by sending request beacons to other power monitors that are already part of the network.
- a power monitor sends beacons on a fixed number of channels.
- the power monitors that are already part of the local network monitor these channels for beacon messages. Once they receive request beacons, they forward the beacons to the associated communication hub.
- the communication hub responds to the requesting power monitor.
- the various embodiments described herein provide a universal power monitoring system that allows for monitoring of power to individual electrical loads. Although various embodiments have application in several markets, a primary application is to measure the power usage of servers, routers, storage equipment, etc. within data centers. Certainly, the ability to accurately monitor power consumption at the server level can significantly reduce the frequency of power problems associated with power needs that exceed budgeted power. The various embodiments also enable data center operators to adequately budget for per-cabinet power usage. [0089] The basic functionality of the various embodiments may be broken down into three primary parts: (a) per plug power usage data acquisition, (b) per cabinet data aggregation, and (c) data transmission.
- the idea for acquiring per- equipment power usage data is to augment the power cord to the load with a power monitoring capability. This is accomplished through the use of a power- sensing device that has compatible male and female power connectors, such as the power monitor 1318 as described above. It is envisioned that each device to be monitored will be equipped with a power monitor 1318.
- the power monitor 1318 and communication hub 1320 provides the ability to aggregate data to provide cabinet level metrics.
- Each power monitor 1318 within a cabinet shall communicate its data to a local communication hub 1320.
- the communication hub 1320 may support power monitors 1318 in multiple cabinets.
- the communication hub 1320 bridges the wireless communications of the per plug power monitor 1318 to the wireless network.
- the communication hub 1320 also reports a power monitor 1318 configuration to the server. This configuration information contains a mapping of power monitors 1318 to outlets on the rack PDU.
- the communication hub 1320 can have a display that provides visualization for total current, total kW, max current, and historical charting.
- the data is provided at phase-level per strip, per rack, in order to facilitate power load balancing.
- Each communication hub 1320 can join the wireless network and report the measured and computed power data captured from each power monitor 1318 via the WSN.
- FIG 11 illustrates another example embodiment of a wireless smart plug (WSP) device 650 that can operate in a wireless sensor network of various embodiments.
- the WSP devices 650 can also be denoted as power monitors (PMs) or Smart Plugs (SPs).
- PMs power monitors
- SPs Smart Plugs
- the details of the WSP 650 in an example embodiment are described below.
- electronic devices 314 e.g., servers
- racks 312 or standalone can be powered via electrical power cords or cables that attach to the electronic device 314 on one side and to a WSP 650 on another side.
- the RPDU 320 of an example embodiment is connected to an electrical power source via electrical cable 322.
- the WSP 650 is connected to an electrical power source via electrical cable or cord 651.
- the electrical power source can be driven by an uriinterruptible power supply (UPS) 680, which provides electrical power to a plurality of power distribution units (PDUs) 681.
- PDUs power distribution units
- Each PDU 681 can include a plurality of panel boards 682, which can each include a plurality of electrical circuits 683.
- Each electrical circuit 683 can provide specific power requirements for any of the WSPs 650 to which the electrical circuits 682 are electrically connected.
- each of the PDUs 681, each of the panel boards 682, and each of the electrical circuits 683 can include a unique identifier, which can be configurably associated the WSP 650 to which the particular PDU 681, panel board 682, and electrical circuit 683 is electrically connected.
- This unique identifier can be implemented as label, barcode, or a series/register of configurable digital bits or configurable jumper leads provided on the PDU 681, panel board 682, or electrical circuit 683. These unique identifiers are used in the configuration phase, described in more detail below, to configurably associate each WSP 650 to the particular PDU 681, panel board 682, and electrical circuit 683 to which the WSP 650 is electrically connected.
- wired sensor devices (WSDs) 750 or other sources of system data can also be deployed with the WSPs 650 for collecting system information, mcluding power consumption information, which can be communicated along with the data from the wireless sensor devices via gateway 330 to an analysis processor 100 for management of capacity and consumption of electrical power within a data center.
- WSPs wired sensor devices
- the components of a WSP 650 of an example embodiment are shown to include a power input connector or electrical circuit 683 interface 652, a power output connector or electrical device 314 interface 656, one or more low cost microprocessors 666, a wireless radio 668, power measurement circuitry 660, power calculation circuitry 662, and additional circuitry 664.
- the WSP 650 includes circuitry and functionahty to operate as a wireless node 112 of a WSN 110 as described above. In this manner, the WSP 650 can transmit and receive data wirelessly from other WSPs 650 and to/from gateway 330.
- a WSP 650 can be connected to an electrical power source provided by an electrical circuit 683 via electrical power cord or cable 651 and power input connector 652.
- a WSP 650 can also be connected to an electrical device 314 via electrical power cord or cable 658 and power output connector 656.
- the WSP 650 includes power measurement circuitry for sampling and measuring the electrical power consumed by electrical devices 314 connected to the WSP 650.
- the WSP 650 also includes power calculation circuitry for converting the sampled and measured electrical power consumption measurements into power consumption data, which can be transferred to the communication gateway 330 and analysis processor 100 via wireless network 110. Upon connection, the WSP 650 uses its power measurement circuitry to measure the electrical power consumed by the electronic devices 314 to which the WSP 650 is connected. The electrical power usage/consumption data can be retained in a memory of the WSP 650 and ultimately sent wirelessly from the WSP 650 to the communication gateway 330 and analysis processor 100 via wireless network 110.
- a wireless communication network includes an array of WSP 650 wireless nodes.
- the wireless communication network is a multi-hop mesh network that integrates a plurality of WSPs 650 with one or more gateways 330.
- An example embodiment is shown in Figure 13.
- the wireless corrrmunication network is used to distribute system data that is collected by the WSPs 650 or other wireless sensor devices that may be in wireless data communication with the WSPs 650.
- a plurality of WSPs 650 forms a wireless communication network with one or more gateways 330.
- the wireless communication network is used to transfer system information, including electrical power usage, consumption, and control information to/from the gateways 330 and the analysis processor 100 in a multi-tiered wireless communication architecture.
- data transfer between network nodes takes place in two general phases: a data collection phase and a data communication phase.
- the WSPs 650 collect power related information (system power data) periodically from the electronic devices 314 and the particular PDU 681, panel board 682, and electrical circuit 683 to which the WSP 650 is electrically connected.
- the WSPs 650 may be able to aggregate some of this system power data locally.
- the WSPs 650 can send the aggregated system power data to a gateway 330 via the wireless communication network in the data communication phase.
- the WSPs 650 can send the collected system power data to the gateway 330 using the wireless communication network described above.
- An example of the routing of the system power data is shown in Figure 13 as a routing of a network data message 512 through the wireless communication network as described herein.
- FIG. 13 illustrates a layout of an example data center in which an example array of WSPs 650 has been deployed.
- a typical deployment can include an array of networked devices (including WSPs 650 and gateways 330) in a distributed network architecture.
- the system described herein can include several kinds of devices, including wireless sensor devices, RPDUs 320, wireless bridge devices (WBD) 310, WSPs 650, gateways 330, routers, controllers, and the like that are distributed in the data center.
- Gateways 330 can connect the WSPs 650 to a wide-area network 108, such as an Internet Protocol (TP) network including the Internet, via WSPs 650 and gateways 330.
- Gateways 330 typically have communication paths to all sensing and control devices in a particular system. Gateways 330 can send commands, status information, or data center relevant information to the other network devices (e.g., WSPs 650).
- TP Internet Protocol
- an example system can include a centralized software system, called the Analysis Processor 100 (shown in Figure 1), which stores all of the sensing, control, and status information that is forwarded to the gateways 330 by the other system devices (e.g., WSPs 650).
- the Analysis Processor 100 is primarily a repository of information and system-wide data processing for the system.
- the Analysis Processor 100 can also control the electrical power needs of the electronic devices 314 in a particular facility in order to affect the overall power consumption of the facility.
- the WSPs 650 and gateways 330 denoted generally herein as the network devices, cooperate to establish a mesh data communications network that provides connectivity among the network devices.
- WSPs 650 can be implemented as wireless sensor devices, which include the capability to interface with the wireless communication network 110 as described herein. As such, the WSPs 650 can be considered wireless sensor devices and nodes in the wireless network 110. Each of the wireless sensor devices, including WSPs 650, can be configured to sense various system conditions, such as electrical power conditions. As such, the WSPs 650 can sense and monitor electrical power usage/consumption information (including electrical current, voltage, power, power factor, energy, etc.) and the like from the particular electrical devices 314, PDU 681, panel board 682, and electrical circuit 683 to which the WSP 650 is electrically connected.
- electrical power usage/consumption information including electrical current, voltage, power, power factor, energy, etc.
- WSPs 650 can measure the system conditions at each sensor location and retain the system power data measurements along with a timestamp associated with each system power data measurement. Using the wireless data network 110, the WSPs 650 can transmit time-stamped system power data along with an identifier of corresponding electrical devices 314, PDU 681, panel board 682, and electrical circuit 683 from which the power data was collected. This system power data can be sent to the analysis processor 100 for processing. The time-stamped system data can be sent to the analysis processor 100 via a pathway of nodes in wireless network 110, gateway 330, and wide-area network 108.
- the analysis processor 100 can collect the time-stamped system power data from each of the WSPs 650 connected to electrical devices 314 in racks 312. It will be understood by those of ordinary skill in the art upon reading this patent disclosure that an arbitrary number of WSPs 650 can be connected to the electrical devices 314 in racks 312 in arbitrary positions in a particular data center. In general, the greater number of wireless sensor devices increases the ability for the system to detect more subtle changes in the system conditions within the data center. The analysis processor 100 can use the system power data to monitor and control operation of the plurality of electronic devices 314 in the facility.
- each WSP 650 can use the multi-hop mesh network (such as wireless network 110) to send the system power data to the analysis processor 100 via gateway 330 for data processing.
- each WSP 650 can operate in the following way to measure and communicate electrical power usage information.
- Each WSP 650 is capable of sampling electrical power usage/consumption data from the corresponding electrical devices 314, PDU 681, panel board 682, and electrical circuit 683 to which the WSP 650 is connected. After sampling the data, the WSP 650 can convert the sampled measurements to power capacity/usage/consumption data, generally denoted system power data, which can be locally stored and/or transferred to the analysis processor 100 via gateway 330 and the wireless communication network 110. In this manner, the WSP 650 can perform among the following power measurements and system power data generation. In an example embodiment, the WSP 650 can:
- the WSP 650 may locally store the measured and/or calculated power capacity/usage/consumption data, generally denoted system power data, in long-term data storage on the WSP 650 device itself.
- the WSP 650 may also locally store the corresponding device identifiers. Periodically, each WSP 650 can send the measured and converted system power data and corresponding device identifiers to the analysis processor 100 via gateway 330 and the wireless communication network 110.
- the analysis processor 100 processes the system power data received from each of the wireles s sensor devices in a wireless network 110 of a particular facility.
- the wireless sensor devices can be a combination of WSPs 650, RPDUs 320, WBDs 310, PMs, SPs, and/or other wireless sensor devices.
- the analysis processor 100 can be implemented as a power capacity management system running on a server computer.
- the analysis processor 100 can collect system power data from the wireless sensor devices, and automatically calculate power usage and available electrical capacity in the system of a particular facility. This computed usage and capacity data can be used to control the operation and placement of electrical devices in the facility.
- the analysis processor 100 can use the following steps to achieve usage, capacity, and placement control of electrical devices in a facility, such as a data center:
- a. Receive minimum, maximum and average electrical current data from each reporting wireless sensor device, the minimum, maximum and average electrical current data corresponding to a particular monitored electrical device 314 associated with the reporting wireless sensor device; b. Compute the Minimum capacity usage.
- the Minimum capacity usage is equal to the sum of the mirrimum electrical current data from each monitored electrical device 314;
- the Maximum capacity usage is equal to the sum of the maximum electrical current data from each monitored electrical device 314;
- the Average capacity usage is equal to the sum of the average electrical current data from each monitored electrical device 314;
- the Left over capacity is equal to the Maximum available capacity less the Maximum capacity usage.
- OS Operating System
- WSP 650 WSP 650
- PDU Left over capacity is the available capacity for a particular PDU 681 less the maximum load required by the electrical device 314 being placed; and d. Determine the best placement for the electrical device 314 in the facility by using any one of several configurable methods:
- Obtain or calculate the rack left over capacity by summing the circuit left over capacities of the electrical circuits 683 that provide electrical power to particular equipment racks 312. Determine where additional electrical power is available in particular equipment racks 312 of the data center based on the rack left over capacities for each of the equipment racks 312 of the facility; Obtain or calculate the maximum electrical load required for each electrical device 314 in each of the equipment racks 312 of the facility.
- the electrical load required for each of the electrical devices 314 can be determined based on the dynamic electrical power usage and consumption information being supplied in real time to the analysis processor 100 by the deployed wireless sensors 112.
- the electrical load required for each of the electrical devices 314 can be used to determine the electrical loading levels of each of the electrical devices 314 and to determine which of the electrical devices 314 are most lightly loaded based on real time information from the WSN 110.
- a lightly loaded electrical device can be an electrical device that is using no more that 50% of the electrical device's maximum available electrical power capacity;
- the electrical loading levels of each of the electrical devices 314 in particular equipment racks 312, and the temperatures and pressures corresponding to each of the equipment racks 312, determine which of the equipment racks 312 are most lightly loaded, and determine which of the electrical devices 314 are the most lightly loaded. Based on the rack 312 and electrical device 314 loading levels, identify the most lightly loaded electrical devices 314, for which their workloads can be consolidated while still satisfying the maximum electrical loading constraints imposed on the PDUs 681, the electrical circuits 683, the electrical devices 314, and the cooling constraints imposed on the equipment racks 312; and
- the analysis processor 100 can be in data communication with each of the electrical devices 314 using conventional means.
- the analysis processor 100 can communicate with each of the electrical devices 314 using, for example, an Internet Protocol ( ⁇ ) data/instruction transfer, hi this manner, the analysis processor 100 can dynamically command any one of the electrical devices 314 to migrate its workload to another electrical device 314.
- ⁇ Internet Protocol
- the analysis processor 100 can also use this method to dynamically command any one of the electrical devices 314 to power down or enter an idle or sleep mode (e.g., deactivate). As such, the analysis processor 100 can dynamically command any one of the electrical devices 314 to deactivate.
- an apparatus and method for managing power capacity in data centers using a wireless sensor network is described herein. As described herein, the various embodiments enable several advantages. These advantages are summarized below:
- the various embodiments provide a mechanism for separating the power measurement infrastructure from the communication infrastructure, and for combining the two infrastructure components in several ways. This enables aggregation of power measurement readings and their communication through a single network infrastructure.
- the various embodiments provide a low cost method for collecting data from standard RPDUs, WSPs, WBDs, PMs, SPs, and/or other wireless sensor devices or power distribution units.
- the various embodiments use a self-discovery mechanism to learn information about the RPDUs, WSPs, WBDs, PMs, SPs, and/or other wireless sensor devices or power distribution units.
- the various embodiments use a low cost multi-hop wireless network infrastructure for data distribution, which makes the power measurement infrastructure easier to deploy and integrate.
- the various embodiments use a multi-level wireless network to collect power information and distribute the information to different nodes.
- the various embodiments provide techniques for configuring the power and cornmunication network so that the apparatus can be used to provide power usage information at multiple levels.
- Figure 14 is a flow diagram illustrating the basic processing flow
- an example embodiment includes: establishing communication with a plurality of wireless sensor devices deployed in a facility, each wireless sensor device of the plurality of wireless sensor devices being configured to monitor electrical power usage of at least one of a plurality of electrical devices in the facility (processing block 810); periodically obtaining system power data from each of the plurality of wireless sensor devices, the system power data including electrical power usage data corresponding to associated electrical devices, the system power data being received from the plurality of wireless sensor devices via a wireless sensor network (processing block 820); using the system power data to determine the electrical loading levels of each of the plurality of electrical devices (processing block 830); identifying at least one lightly loaded electrical device based on the determined electrical loading levels (processing block 840); dynamically commanding the identified lightly loaded electrical device to migrate its workload to another one of the plurality of electrical devices (processing block 850); and dynamically commanding the identified lightly loaded electrical device to deactivate (processing block 860).
- a node configured by an application may constitute a "module” that is configured and operates to perform certain operations as described herein.
- the "module” may be implemented mechanically or electronically.
- a module may comprise dedicated circuitry or logic that is permanently configured (e.g., within a special-purpose processor) to perform certain operations.
- a module may also comprise programmable logic or circuitry (e.g., as encompassed within a general- purpose processor or other programmable processor) that is temporarily configured by software to perform certain operations. It will be appreciated that the decision to implement a module mechanically, in the dedicated and permanently configured circuitry, or in temporarily configured circuitry (e.g., configured by software) may be driven by cost and time considerations.
- module should be understood to encompass a functional entity, be that an entity that is physically constructed, permanently configured (e.g., hardwired) or temporarily configured (e.g., programmed) to operate in a certain manner and/or to perform certain operations described herein.
- machine-readable medium 219 is shown in an example embodiment to be a single medium, the term “machine-readable medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions.
- the term “machine-readable medium” shall also be taken to include any non-transitory medium that is capable of storing, encoding or embodying a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies described herein.
- the term “machine-readable medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical media, and magnetic media.
- the software and/or related data may be transmitted over a network using a transmission medium.
- transmission medium shall be taken to include any medium that is capable of storing, encoding or carrying instructions for transmission to and execution by the machine, and includes digital or analog communication signals or other intangible media to facilitate transmission and communication of such software and/or data.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Medical Informatics (AREA)
- Health & Medical Sciences (AREA)
- Arrangements For Transmission Of Measured Signals (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
La présente invention se rapporte à divers modes de réalisation permettant de gérer la capacité de puissance dans uns installation qui comprennent : une pluralité de dispositifs de capteur sans fil déployés dans une installation ; chaque dispositif de capteur sans fil pour surveiller l'utilisation du courant électrique d'au moins un dispositif électrique parmi une pluralité de dispositifs électriques dans l'installation. Les divers modes de réalisation permettent ; d'obtenir périodiquement de chaque dispositif de capteur sans fil des données d'alimentation électrique du système, les données d'alimentation électrique du système comprenant des données d'utilisation du courant électrique correspondant aux dispositifs électriques associés, les données d'alimentation électrique du système étant reçues des dispositifs de capteur sans fil par l'intermédiaire d'un réseau de capteurs sans fil ; d'utiliser les données d'alimentation électrique du système pour déterminer les niveaux de charge électrique de chaque dispositif électrique ; d'identifier au moins un dispositif électrique chargé légèrement sur la base des niveaux de charge électrique déterminés ; de commander dynamiquement le dispositif électrique identifié comme étant légèrement chargé pour déplacer sa charge de travail vers un autre dispositif électrique parmi les dispositifs électriques ; et de commander dynamiquement le dispositif électrique identifié comme étant légèrement chargé pour le désactiver.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/807,234 US8811377B1 (en) | 2010-08-30 | 2010-08-30 | Apparatus and method for instrumenting devices to measure power usage using a multi-tier wireless network |
| US12/807,234 | 2010-08-30 | ||
| US12/890,506 | 2010-09-24 | ||
| US12/890,506 US8600575B2 (en) | 2010-09-24 | 2010-09-24 | Apparatus and method for collecting and distributing power usage data from rack power distribution units (RPDUs) using a wireless sensor network |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2012030629A2 true WO2012030629A2 (fr) | 2012-03-08 |
| WO2012030629A3 WO2012030629A3 (fr) | 2012-04-26 |
Family
ID=45773448
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2011/049235 Ceased WO2012030629A2 (fr) | 2010-08-30 | 2011-08-25 | Appareil et procédé permettant de gérer la capacité de puissance dans des centres de données à l'aide d'un réseau de capteurs sans fil |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2012030629A2 (fr) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103887850A (zh) * | 2014-02-11 | 2014-06-25 | 成都科创佳思科技有限公司 | 数据采集远传装置 |
| WO2014195531A1 (fr) * | 2013-06-07 | 2014-12-11 | Endesa, S. A. | Système d'optimisation énergétique |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006204024A (ja) * | 2005-01-21 | 2006-08-03 | Hitachi Ltd | 電源供給制御方法、電子装置およびそれを用いたシステム |
| US7715951B2 (en) * | 2007-08-28 | 2010-05-11 | Consert, Inc. | System and method for managing consumption of power supplied by an electric utility |
| TWI404357B (zh) * | 2008-12-10 | 2013-08-01 | Ind Tech Res Inst | 發射功率控制方法與系統 |
-
2011
- 2011-08-25 WO PCT/US2011/049235 patent/WO2012030629A2/fr not_active Ceased
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014195531A1 (fr) * | 2013-06-07 | 2014-12-11 | Endesa, S. A. | Système d'optimisation énergétique |
| CN103887850A (zh) * | 2014-02-11 | 2014-06-25 | 成都科创佳思科技有限公司 | 数据采集远传装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2012030629A3 (fr) | 2012-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9047074B2 (en) | Apparatus and method for managing power capacity in data centers using a wireless sensor network | |
| US8811377B1 (en) | Apparatus and method for instrumenting devices to measure power usage using a multi-tier wireless network | |
| US8600575B2 (en) | Apparatus and method for collecting and distributing power usage data from rack power distribution units (RPDUs) using a wireless sensor network | |
| US11630794B2 (en) | Cabinet level controller with asset management | |
| US9143890B2 (en) | Network, master, hub and method for providing a bluetooth infrastructure | |
| US7881230B2 (en) | Facilitating self configuring link aggregation using link aggregation control protocol | |
| US8538584B2 (en) | Apparatus and method for controlling environmental conditions in a data center using wireless mesh networks | |
| US11985196B2 (en) | Single pair ethernet sensor device and sensor network | |
| US20070135086A1 (en) | Providing detailed information on powered device in system for supplying power over communication link | |
| DK2737381T3 (en) | Systems and methods for wireless transmission of power distribution information | |
| CN108463011A (zh) | 通信方法和通信系统 | |
| US11101689B2 (en) | Systems and methods for providing network connection resiliency in power supply devices | |
| Li et al. | LEMoNet: low energy wireless sensor network design for data center monitoring | |
| WO2012030629A2 (fr) | Appareil et procédé permettant de gérer la capacité de puissance dans des centres de données à l'aide d'un réseau de capteurs sans fil | |
| CN111343700A (zh) | 无线传感网络通信方法 | |
| US10893575B1 (en) | Modular wireless access point | |
| US11234173B2 (en) | Serving internet of things (IoT) devices in a wireless network | |
| CN108228499B (zh) | 一种带外管理设备 | |
| US12206513B2 (en) | Power allotment adjustment in a power sourcing equipment (PSE) of a power over ethernet system based on event detection at another PSE | |
| CN218336454U (zh) | 一种便于安装的机电设备在线检测装置 | |
| CN111953586B (zh) | 一种一拖八物联网网关 | |
| CN111988810B (zh) | 一种基于MIWI的无线服务器监管方法及mesh组网装置 | |
| US20210210966A1 (en) | Monitoring system with low power usage | |
| Jin et al. | Distributed Computing Approach for Wireless Sensor Network Design in a Wire Harness Testing System | |
| US20170176962A1 (en) | Monitoring system with low power data acquisition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11822385 Country of ref document: EP Kind code of ref document: A2 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 18/06/2013) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 11822385 Country of ref document: EP Kind code of ref document: A2 |