US12101683B2 - Proximity detection using wi-fi channel state information - Google Patents
Proximity detection using wi-fi channel state information Download PDFInfo
- Publication number
- US12101683B2 US12101683B2 US17/129,702 US202017129702A US12101683B2 US 12101683 B2 US12101683 B2 US 12101683B2 US 202017129702 A US202017129702 A US 202017129702A US 12101683 B2 US12101683 B2 US 12101683B2
- Authority
- US
- United States
- Prior art keywords
- matrix
- csi
- computing device
- proximity
- circuitry
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000001514 detection method Methods 0.000 title description 10
- 238000013528 artificial neural network Methods 0.000 claims abstract description 59
- 239000011159 matrix material Substances 0.000 claims description 92
- 230000015654 memory Effects 0.000 claims description 78
- 239000013598 vector Substances 0.000 claims description 38
- 230000002596 correlated effect Effects 0.000 claims description 14
- 238000000354 decomposition reaction Methods 0.000 claims description 13
- 238000000034 method Methods 0.000 description 52
- 230000008569 process Effects 0.000 description 27
- 238000013527 convolutional neural network Methods 0.000 description 17
- 238000004891 communication Methods 0.000 description 14
- 238000012545 processing Methods 0.000 description 13
- 238000005259 measurement Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 9
- 230000002093 peripheral effect Effects 0.000 description 9
- 238000012549 training Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000013473 artificial intelligence Methods 0.000 description 7
- 230000008859 change Effects 0.000 description 5
- 230000003068 static effect Effects 0.000 description 5
- 239000004744 fabric Substances 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000033001 locomotion Effects 0.000 description 3
- 238000007781 pre-processing Methods 0.000 description 3
- PGLIUCLTXOYQMV-UHFFFAOYSA-N Cetirizine hydrochloride Chemical compound Cl.Cl.C1CN(CCOCC(=O)O)CCN1C(C=1C=CC(Cl)=CC=1)C1=CC=CC=C1 PGLIUCLTXOYQMV-UHFFFAOYSA-N 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 229910000679 solder Inorganic materials 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- HBBGRARXTFLTSG-UHFFFAOYSA-N Lithium ion Chemical compound [Li+] HBBGRARXTFLTSG-UHFFFAOYSA-N 0.000 description 1
- 239000002253 acid Substances 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- FFBHFFJDDLITSX-UHFFFAOYSA-N benzyl N-[2-hydroxy-4-(3-oxomorpholin-4-yl)phenyl]carbamate Chemical compound OC1=C(NC(=O)OCC2=CC=CC=C2)C=CC(=C1)N1CCOCC1=O FFBHFFJDDLITSX-UHFFFAOYSA-N 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 210000000078 claw Anatomy 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 230000002860 competitive effect Effects 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000011982 device technology Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 229910001416 lithium ion Inorganic materials 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000001012 protector Effects 0.000 description 1
- 239000002096 quantum dot Substances 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/029—Location-based management or tracking services
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S11/00—Systems for determining distance or velocity not using reflection or reradiation
- G01S11/02—Systems for determining distance or velocity not using reflection or reradiation using radio waves
- G01S11/06—Systems for determining distance or velocity not using reflection or reradiation using radio waves using intensity measurements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L25/00—Baseband systems
- H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
- H04L25/0202—Channel estimation
- H04L25/021—Estimation of channel covariance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/023—Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W84/00—Network topologies
- H04W84/02—Hierarchically pre-organised networks, e.g. paging networks, cellular networks, WLAN [Wireless Local Area Network] or WLL [Wireless Local Loop]
- H04W84/10—Small scale networks; Flat hierarchical networks
- H04W84/12—WLAN [Wireless Local Area Networks]
Definitions
- Embodiments of the present invention relate generally to the technical field of wireless communications.
- Wi-Fi-based sensing involves tracking or detecting the movement of people or objects. Wi-Fi based sensing utilizes variations in the measured wireless channel and therefore it is also non-intrusive. The collected measurements are typically used by a digital signal processor (DSP) and/or artificial intelligence (AI)-based algorithm to make predictions and estimations.
- DSP digital signal processor
- AI artificial intelligence
- wireless channels are location-specific, AI-based solutions may suffer from a lack of generalization (e.g., due to limited number of training scenarios). Embodiments of the present disclosure address these and other issues.
- FIG. 1 illustrates an example of a network in accordance with some embodiments.
- FIGS. 2 A and 2 B illustrate examples of channel state information (CSI) time-frequency matrices in accordance with some embodiments.
- CSI channel state information
- FIGS. 3 and 4 illustrate examples of graphs showing normalized distance vs. a singular value in accordance with some embodiments.
- FIG. 5 illustrates an example of a graph showing a normalized distance vs. a first and second singular value in accordance with some embodiments.
- FIGS. 6 A, 6 B, and 6 C illustrate examples of process flows associated processing CSI matrices by neural networks (NNs) in accordance with some embodiments.
- FIGS. 7 , 8 and 9 illustrate examples of operation flow/algorithmic structures in accordance with some embodiments.
- FIG. 10 illustrates an example of an access point (AP) in accordance with various embodiments.
- FIG. 11 illustrates an example of infrastructure equipment 1100 in accordance with various embodiments.
- FIG. 12 is a block diagram illustrating components, according to some embodiments, able to read instructions from a machine-readable or computer-readable medium (for example, a non-transitory machine-readable storage medium) and perform any one or more of the methodologies discussed herein.
- a machine-readable or computer-readable medium for example, a non-transitory machine-readable storage medium
- Wi-Fi-based sensing involves tracking or detecting the movement of people or objects.
- AI-based algorithms for Wi-Fi-based sensing are often prone to generalization problems when the set of input features used for training is different than the ones used for inference. This can be problematic since it is often not possible to cover all possible environments in the training stage.
- feeding directly the raw CSI data to an AI algorithm usually requires many parameters and/or a complex model and may still lack generalization capabilities.
- Known processing methods for removing location specific patterns from the data may still require training a complex AI model, which in turn requires considerable time and resources.
- CNN Convolutional neural network
- embodiments of the present disclosure help to overcome environment-specific dependency issues of conventional systems, thus allowing a NN to make better proximity predictions in an unseen environment.
- Embodiments of this disclosure can also yield a small compact set of features from the raw measurements allowing the usage of a less complex AI model compared to conventional systems.
- Some embodiments of the disclosure are based upon a covariance matrix of raw measurements followed by a singular value decomposition (SVD), which yields a general set of features (singular values) highly correlated with proximity. This set of features is then fed to a feed-forward NN to optimally combine them for proximity detection.
- embodiments of the present disclosure can extract a small meaningful set of features which allows a simple NN to make reliable predictions in an unseen environment without the need to re-calibrate the model parameters, as required in conventional systems.
- FIG. 1 illustrates a network 100 in accordance with some embodiments.
- the network 100 may include an AP 104 communicatively coupled with a plurality of stations (STAs) including, for example, STA A 108 , STA B 112 , STA C 116 , and STA D 120 .
- the network 100 may be a wireless local area network (WLAN) that is compatible with IEEE 802.11 protocols.
- the network 100 may also be referred to as a basic service set (BSS).
- BSS basic service set
- the AP 104 and STAs may communicate based on high-efficiency wireless (HEW) protocols defined in, for example, IEEE 802.11ax.
- HEW high-efficiency wireless
- STAs operating based on high-efficiency (HEW) protocols may also be referred to as HEW or high-efficiency (HE) STAs.
- HEW high-efficiency wireless
- the AP 104 may communicate with one or more STAs (e.g., laptops, personal computers, mobile computing devices, etc.) for Wi-Fi sensing where Wi-Fi CSI data is collected periodically (e.g., every ⁇ 100 ms) by the STA to be used for proximity/range detection to the STA (also referred to herein as a “device”).
- the characteristics and variations in the measured CSI contain information about the distance of an object from the device.
- the CSI absolute value measurements are aggregated in a time window to yield a [time-frequency] matrix where each row corresponds to a single CSI.
- FIG. 2 A illustrates an example of two such matrices, both recorded in the same environment (noted as Point ‘A’).
- the object e.g., a person
- the right matrix the object was located 6 m from the device.
- the obtained matrices are collected and used to train an AI model to classify person's distance to the device. If using the raw matrices directly to feed a NN model for proximity prediction, one would usually require a Convolutional Neural Network (CNN) type model to process the matrix shaped data.
- CNN models are typically expensive due to the usage of many high dimensional filters used to convolve the matrix data.
- FIG. 2 B shows CSI time-frequency matrices with CSI measurements collected from Point ‘B’ at 0.5 m & 6.75 m. In comparison to the matrices in FIG. 2 A , it can be seen that the measurements show no similarity to the data collected from Point ‘A’.
- removing location specific patterns from the CSI time-frequency data is performed by using the SVD on the collected matrices and reconstructing them while nulling the 1 st singular value.
- This method provides matrices suitable for training a CNN model which generalizes well to unseen locations.
- this approach still requires the usage of a complex CNN model which is expensive in terms of timing and computations both for training stage and inference.
- a small compact vector of proximity correlated features is extracted from the CSI matrices.
- the extracted features remove the location specific patterns in the data such that a simpler feedforward NN can be used for reliable predictions in unseen locations.
- SVD decomposition is performed on the covariance matrix of each of the collected CSI time-frequency matrix.
- the singular values vector is then fed to a single hidden layer feedforward NN to optimally combine the singular values for proximity prediction.
- the temporal activity of each time-frequency matrix H is now summarized in the singular values vector cl which entries are generally highly correlated to proximity in any environment.
- embodiments of this disclosure yield a single vector suitable for proximity detection using a simple NN model.
- FIGS. 3 and 4 illustrate the 1 st obtained singular value (d 1 ) plotted across time with the recorded distance (normalized) for Points A and B, respectively.
- the singular value is highly correlated with the proximity.
- FIG. 5 shows an example (shown in areas 510 and 520 ) in which the 1st singular value is active during a none-proximity interval, while the 2nd singular value is more reliable.
- embodiments may combine the complete singular values vector to obtain a stable reliable metric for proximity detection.
- embodiments of this disclosure may utilize a feedforward NN where the singular values vector are provided as an input feature.
- FIGS. 6 A, 6 B, and 6 C illustrate three process flows to determine the proximity of an object for comparison with one another.
- FIG. 6 A illustrates a process whereby raw CSI data is fed to a CNN.
- FIG. 6 B illustrates a process that includes SVD nulling on CSI data fed to a CNN model. In FIG. 6 B , an SVD process is first performed on the raw CSI data matrix. Next, the result of the process is then reconstructed to generate the nullified matrix, which is in turn provided to the CNN.
- FIG. 6 C illustrates a process where a covariance matrix is generated based on the CSI data.
- the system performs a SVD operation on the covariance matrix to obtain a singular values vector.
- the singular values vector of the covariance matrix of the CSI data is then provided to a feedforward neural network (FF-NN) model.
- FF-NN feedforward neural network
- Process A shows the generalization problem a CNN/NN model suffers when no preprocessing method for removing the location specific dependency is used. These results also show that competitive proximity detection performances can be obtained using a much more efficient NN model in Process C.
- process C is shown above as operating in conjunction with an FF-NN, in alternate embodiments, the process may also be used in conjunction with other types of NNs, including a CNN or a recurrent neural network (RNN).
- RNN recurrent neural network
- the NN may be periodically trained with a wide variety of data/measurements from different environments/locations. By so doing, embodiments of the present disclosure are more robust to unseen locations, though still may be unseen environments in which adaptation/calibration is required to fine-tune the algorithm.
- new CSI measurements may be collected when a person is in proximity to a device. This can be done by considering some indication from the system/device (e.g., from the operating system of the device) that the person is currently using the device (e.g., the device may have indicators of when a person is browsing the Internet using the device), hence the system can collect data when it is certain that the person is in proximity to the device.
- the system/device e.g., from the operating system of the device
- the device may have indicators of when a person is browsing the Internet using the device
- the system may perform pre-processing steps on the collected CSI data—(e.g., calculate covariance matrix & SVD and obtain singular values vectors d ). The system may then normalize new collected data according to new statistics of the vectors d . The system may then perform one or more iterations (depending on how much data was collected) of forward pass and backpropagation (of the NN) using new data to update the Neural network (NN) parameters. This process for recalibration may be repeated if/when necessary.
- the system may then normalize new collected data according to new statistics of the vectors d .
- the system may then perform one or more iterations (depending on how much data was collected) of forward pass and backpropagation (of the NN) using new data to update the Neural network (NN) parameters. This process for recalibration may be repeated if/
- FIG. 7 illustrates an operation flow/algorithmic structure 700 in accordance with some embodiments.
- the operation flow/algorithmic structure 700 may be implemented by an access point, for example, access point 104 shown in FIG. 1 , or components thereof, for example, the components of AP 1004 shown in FIG. 10 .
- the operation flow/algorithmic structure 700 may be implemented by a STA device (such as a laptop, personal computer, or mobile computing device) or components thereof.
- the operation flow/algorithmic structure 700 includes retrieving a channel state information (CSI) matrix from memory.
- the CSI matrix may include one or more indicators associated with a proximity of an object (e.g., a human) to a computing device (e.g., a STA device) such as the CSI matrices for point A and point B illustrated in FIGS. 2 A and 2 B , respectively.
- the operation flow/algorithmic structure 700 further includes generating a covariance matrix based on the CSI matrix.
- the CSI matrix may be received from the computing device and stored in the memory of the AP (e.g., in memory circuitry 1020 shown in FIG. 10 ).
- the operation flow/algorithmic structure 700 further includes determining the proximity of the object to the computing device based on the singular values vector.
- the proximity of the object to the computing device is determined based on the singular values vector using a neural network (NN), such as a feedforward NN.
- NN neural network
- FIG. 8 illustrates an operation flow/algorithmic structure 700 in accordance with some embodiments.
- the operation flow/algorithmic structure 700 may be implemented by an access point, for example, access point 104 shown in FIG. 1 , or components thereof, for example, the components of AP 1004 shown in FIG. 10 .
- FIG. 9 illustrates an operation flow/algorithmic structure 900 in accordance with some embodiments.
- the operation flow/algorithmic structure 900 may be implemented by an access point, for example, access point 104 shown in FIG. 1 , or components thereof, for example, the components of AP 1004 shown in FIG. 10 .
- the operation flow/algorithmic structure 900 may be implemented by a STA device (such as a laptop, personal computer, or mobile computing device) or components thereof.
- Operation flow/algorithmic structure 900 includes, at 902 , generating a covariance matrix based on a CSI matrix, wherein the CSI matrix includes one or more indicators associated with a proximity of an object to the computing device.
- Operation flow/algorithmic structure 900 includes, at 904 , performing a singular value decomposition (SVD) operation on the covariance matrix to obtain a singular values vector.
- Operation flow/algorithmic structure 900 includes, at 906 , determining the proximity of the object to the computing device based on the singular values vector using a neural network (NN).
- NN neural network
- FIG. 10 illustrates an example of an AP (e.g., AP 104 in FIG. 1 ) in accordance with various embodiments.
- the AP 1004 may include one or more of application circuitry 1005 , baseband circuitry 1010 , one or more radio front end modules 1015 , memory circuitry 1020 , power management integrated circuitry (PMIC) 1025 , and network controller circuitry 1035 .
- application circuitry 1005 may include one or more of application circuitry 1005 , baseband circuitry 1010 , one or more radio front end modules 1015 , memory circuitry 1020 , power management integrated circuitry (PMIC) 1025 , and network controller circuitry 1035 .
- PMIC power management integrated circuitry
- processor circuitry may refer to, is part of, or includes circuitry capable of sequentially and automatically carrying out a sequence of arithmetic or logical operations, or recording, storing, and/or transferring digital data.
- processor circuitry may refer to one or more application processors, one or more baseband processors, a physical central processing unit (CPU), a single-core processor, a dual-core processor, a triple-core processor, a quad-core processor, and/or any other device capable of executing or otherwise operating computer-executable instructions, such as program code, software modules, and/or functional processes.
- CPU central processing unit
- Application circuitry 1005 may include one or more central processing unit (CPU) cores and one or more of cache memory, low drop-out voltage regulators (LDOs), interrupt controllers, serial interfaces such as SPI, I2C or universal programmable serial interface module, real time clock (RTC), timer-counters including interval and watchdog timers, general purpose input/output (I/O or IO), memory card controllers such as Secure Digital (SD) MultiMediaCard (MMC) or similar, Universal Serial Bus (USB) interfaces, Mobile Industry Processor Interface (MIPI) interfaces and Joint Test Access Group (JTAG) test access ports.
- CPU central processing unit
- LDOs low drop-out voltage regulators
- interrupt controllers serial interfaces such as SPI, I2C or universal programmable serial interface module
- RTC real time clock
- timer-counters including interval and watchdog timers
- I/O or IO general purpose input/output
- memory card controllers such as Secure Digital (SD) MultiMediaCard (MMC
- the application circuitry 1005 may include one or more Intel Pentium®, Core®, or Xeon® processor(s); Advanced Micro Devices (AMD) Ryzen® processor(s), Accelerated Processing Units (APUs), or Epyc® processors; and/or the like.
- the AP 104 may not utilize application circuitry 1005 , and instead may include a special-purpose processor/controller to process IP data received from an EPC or 7GC, for example.
- application circuitry 1005 may include circuitry such as, but not limited to, one or more a field-programmable devices (FPDs) such as field-programmable gate arrays (FPGAs) and the like; programmable logic devices (PLDs) such as complex PLDs (CPLDs), high-capacity PLDs (HCPLDs), and the like; ASICs such as structured ASICs and the like; programmable SoCs (PSoCs); and the like.
- the circuitry of application circuitry 1005 may comprise logic blocks or logic fabric, and other interconnected resources that may be programmed to perform various functions, such as the procedures, methods, functions, etc. of the various embodiments discussed herein.
- the circuitry of application circuitry 1005 may include memory cells (e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, static memory (e.g., static random access memory (SRAM), anti-fuses, etc.)) used to store logic blocks, logic fabric, data, etc. in look-up-tables (LUTs) and the like.
- memory cells e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, static memory (e.g., static random access memory (SRAM), anti-fuses, etc.)
- SRAM static random access memory
- LUTs look-up-tables
- the baseband circuitry 1010 may be implemented, for example, as a solder-down substrate including one or more integrated circuits, a single packaged integrated circuit soldered to a main circuit board or a multi-chip module containing two or more integrated circuits.
- baseband circuitry 1010 may comprise one or more digital baseband systems, which may be coupled via an interconnect subsystem to a CPU subsystem, an audio subsystem, and an interface subsystem.
- the digital baseband subsystems may also be coupled to a digital baseband interface and a mixed-signal baseband subsystem via another interconnect subsystem.
- Each of the interconnect subsystems may include a bus system, point-to-point connections, network-on-chip (NOC) structures, and/or some other suitable bus or interconnect technology, such as those discussed herein.
- the audio subsystem may include digital signal processing circuitry, buffer memory, program memory, speech processing accelerator circuitry, data converter circuitry such as analog-to-digital and digital-to-analog converter circuitry, analog circuitry including one or more of amplifiers and filters, and/or other like components.
- baseband circuitry 1010 may include protocol processing circuitry (for example, signal processing circuitry 600 ) with one or more instances of control circuitry (not shown) to provide control functions for the digital baseband circuitry and/or radio frequency circuitry (e.g., the radio front end modules 1015 ).
- protocol processing circuitry for example, signal processing circuitry 600
- control circuitry not shown
- radio frequency circuitry e.g., the radio front end modules 1015
- the radio front end modules (RFEM) 1015 may include radio frequency integrated circuits (RFICs), amplifiers (for example, power amplifiers and low-noise amplifiers), and antenna elements to effectuate over-the-air transmissions.
- RFEM 1015 may include beamforming circuitry to increase transmission/reception directivity.
- the memory circuitry 1020 may include one or more of volatile memory including dynamic random access memory (DRAM) and/or synchronous dynamic random access memory (SDRAM), and nonvolatile memory (NVM) including high-speed electrically erasable memory (commonly referred to as Flash memory), phase change random access memory (PRAM), magnetoresistive random access memory (MRAM), etc., and may incorporate the three-dimensional (3D) cross-point (XPOINT) memories from Intel® and Micron®.
- Memory circuitry 520 may be implemented as one or more of solder down packaged integrated circuits, socketed memory modules and plug-in memory cards.
- the PMIC 1025 may include voltage regulators, surge protectors, power alarm detection circuitry, and one or more backup power sources such as a battery or capacitor.
- the power alarm detection circuitry may detect one or more of brown out (under-voltage) and surge (over-voltage) conditions.
- the network controller circuitry 1035 may provide connectivity to a network using a standard network interface protocol such as Ethernet, Ethernet over GRE Tunnels, Ethernet over Multiprotocol Label Switching (MPLS), or some other suitable protocol.
- Network connectivity may be provided to/from the access point 104 using a physical connection, which may be electrical (commonly referred to as a “copper interconnect”), optical, or wireless.
- the network controller circuitry 1035 may include one or more dedicated processors and/or FPGAs to communicate using one or more of the aforementioned protocols. In some implementations, the network controller circuitry 1035 may include multiple controllers to provide connectivity to other networks using the same or different protocols.
- interface circuitry may refer to, is part of, or includes circuitry providing for the exchange of information between two or more components or devices.
- the term “interface circuitry” may refer to one or more hardware interfaces, for example, buses, input/output (I/O) interfaces, peripheral component interfaces, network interface cards, and/or the like.
- Any suitable bus technology may be used in various implementations, which may include any number of technologies, including industry standard architecture (ISA), extended ISA (EISA), peripheral component interconnect (PCI), peripheral component interconnect extended (PCIx), PCI express (PCIe), or any number of other technologies.
- the bus may be a proprietary bus, for example, used in a SoC based system.
- Other bus systems may be included, such as an I2C interface, an SPI interface, point to point interfaces, and a power bus, among others.
- FIG. 11 illustrates an example of a platform 1100 (or “device 1100 ”) in accordance with various embodiments.
- the computer platform 1100 may be suitable for use as STAs 108 , 112 , 116 , of 120 , and/or any other element/device discussed herein.
- the platform 1100 may include any combinations of the components shown in the example.
- the components of platform 1100 may be implemented as integrated circuits (ICs), portions thereof, discrete electronic devices, or other modules, logic, hardware, software, firmware, or a combination thereof adapted in the computer platform 1100 , or as components otherwise incorporated within a chassis of a larger system.
- the block diagram of FIG. 11 is intended to show a high level view of components of the computer platform 1100 . However, some of the components shown may be omitted, additional components may be present, and different arrangement of the components shown may occur in other implementations.
- Application circuitry 1105 includes circuitry such as, but not limited to one or more processors (or processor cores), cache memory, and one or more of LDOs, interrupt controllers, serial interfaces such as SPI, I2C or universal programmable serial interface module, RTC, timer-counters including interval and watchdog timers, general purpose I/O, memory card controllers such as SD MMC or similar, USB interfaces, MIPI interfaces, and JTAG test access ports.
- the processors (or cores) of the application circuitry 1105 may be coupled with or may include memory/storage elements and may be configured to execute instructions stored in the memory/storage to enable various applications or operating systems to run on the system 1100 .
- the memory/storage elements may be on-chip memory circuitry, which may include any suitable volatile and/or non-volatile memory, such as DRAM, SRAM, EPROM, EEPROM, Flash memory, solid-state memory, and/or any other type of memory device technology, such as those discussed herein.
- any suitable volatile and/or non-volatile memory such as DRAM, SRAM, EPROM, EEPROM, Flash memory, solid-state memory, and/or any other type of memory device technology, such as those discussed herein.
- the processor(s) of application circuitry 1105 may include, for example, one or more processor cores, one or more application processors, one or more GPUs, one or more RISC processors, one or more ARM processors, one or more CISC processors, one or more DSP, one or more FPGAs, one or more PLDs, one or more ASICs, one or more microprocessors or controllers, a multithreaded processor, an ultra-low voltage processor, an embedded processor, some other known processing element, or any suitable combination thereof.
- the application circuitry 1105 may comprise, or may be, a special-purpose processor/controller to operate according to the various embodiments herein.
- the processor(s) of application circuitry 1105 may include an Intel® Architecture CoreTM based processor, such as a QuarkTM, an AtomTM, an i3, an i5, an i7, or an MCU-class processor, or another such processor available from Intel® Corporation, Santa Clara, CA
- the processors of the application circuitry 1105 may also be one or more of Advanced Micro Devices (AMD) Ryzen® processor(s) or Accelerated Processing Units (APUs); A5-A9 processor(s) from Apple® Inc., QualcommTM processor(s) from Qualcomm® Technologies, Inc., Texas Instruments, Inc.® Open Multimedia Applications Platform (OMAP)TM processor(s); a MIPS-based design from MIPS Technologies, Inc.
- AMD Advanced Micro Devices
- APUs Accelerated Processing Units
- A5-A9 processor(s) from Apple® Inc.
- SnapdragonTM processor(s) from Qualcomm® Technologies, Inc. Texas Instruments, Inc.
- OMAP Open Multimedia Applications Platform
- the application circuitry 1105 may be a part of a system on a chip (SoC) in which the application circuitry 1105 and other components are formed into a single integrated circuit, or a single package, such as the EdisonTM or GalileoTM SoC boards from Intel® Corporation.
- SoC system on a chip
- application circuitry 1105 may include circuitry such as, but not limited to, one or more a field-programmable devices (FPDs) such as FPGAs and the like; programmable logic devices (PLDs) such as complex PLDs (CPLDs), high-capacity PLDs (HCPLDs), and the like; ASICs such as structured ASICs and the like; programmable SoCs (PSoCs); and the like.
- FPDs field-programmable devices
- PLDs programmable logic devices
- CPLDs complex PLDs
- HPLDs high-capacity PLDs
- PSoCs programmable SoCs
- the circuitry of application circuitry 1105 may comprise logic blocks or logic fabric, and other interconnected resources that may be programmed to perform various functions, such as the procedures, methods, functions, etc. of the various embodiments discussed herein.
- the circuitry of application circuitry 1105 may include memory cells (e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, static memory (e.g., static random access memory (SRAM), anti-fuses, etc.)) used to store logic blocks, logic fabric, data, etc. in look-up tables (LUTs) and the like.
- memory cells e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, static memory (e.g., static random access memory (SRAM), anti-fuses, etc.)
- SRAM static random access memory
- LUTs look-up tables
- the baseband circuitry 1110 may be implemented, for example, as a solder-down substrate including one or more integrated circuits, a single packaged integrated circuit soldered to a main circuit board or a multi-chip module containing two or more integrated circuits.
- the RFEMs 1115 may comprise a millimeter wave (mmWave) RFEM and one or more sub-mmWave radio frequency integrated circuits (RFICs).
- the one or more sub-mmWave RFICs may be physically separated from the mmWave RFEM.
- the RFICs may include connections to one or more antennas or antenna arrays, and the RFEM may be connected to multiple antennas.
- both mmWave and sub-mmWave radio functions may be implemented in the same physical RFEM 1115 , which incorporates both mmWave antennas and sub-mmWave.
- the memory circuitry 1120 may include any number and type of memory devices used to provide for a given amount of system memory.
- the memory circuitry 1120 may include one or more of volatile memory including random access memory (RAM), dynamic RAM (DRAM) and/or synchronous dynamic RAM (SDRAM), and nonvolatile memory (NVM) including high-speed electrically erasable memory (commonly referred to as Flash memory), phase change random access memory (PRAM), magnetoresistive random access memory (MRAM), etc.
- RAM random access memory
- DRAM dynamic RAM
- SDRAM synchronous dynamic RAM
- NVM nonvolatile memory
- Flash memory high-speed electrically erasable memory
- PRAM phase change random access memory
- MRAM magnetoresistive random access memory
- the memory circuitry 1120 may be developed in accordance with a Joint Electron Devices Engineering Council (JEDEC) low power double data rate (LPDDR)-based design, such as LPDDR2, LPDDR3, LPDDR4, or the like.
- JEDEC Joint Electron Device
- Memory circuitry 1120 may be implemented as one or more of solder down packaged integrated circuits, single die package (SDP), dual die package (DDP) or quad die package (Q17P), socketed memory modules, dual inline memory modules (DIMMs) including microDIMMs or MiniDIMMs, and/or soldered onto a motherboard via a ball grid array (BGA).
- the memory circuitry 1120 may be on-die memory or registers associated with the application circuitry 1105 .
- memory circuitry 1120 may include one or more mass storage devices, which may include, inter alia, a solid state disk drive (SSDD), hard disk drive (HDD), a micro HDD, resistance change memories, phase change memories, holographic memories, or chemical memories, among others.
- SSDD solid state disk drive
- HDD hard disk drive
- micro HDD micro HDD
- resistance change memories phase change memories
- phase change memories phase change memories
- holographic memories holographic memories
- chemical memories among others.
- the computer platform 1100 may incorporate the three-dimensional (3D) cross-point (XPOINT) memories from Intel® and Micron®.
- Removable memory circuitry 1123 may include devices, circuitry, enclosures/housings, ports or receptacles, etc. used to couple portable data storage devices with the platform 1100 . These portable data storage devices may be used for mass storage purposes, and may include, for example, flash memory cards (e.g., Secure Digital (SD) cards, microSD cards, xD picture cards, and the like), and USB flash drives, optical discs, external HDDs, and the like.
- flash memory cards e.g., Secure Digital (SD) cards, microSD cards, xD picture cards, and the like
- USB flash drives e.g., USB flash drives, optical discs, external HDDs, and the like.
- the platform 1100 may also include interface circuitry (not shown) that is used to connect external devices with the platform 1100 .
- the external devices connected to the platform 1100 via the interface circuitry include sensor circuitry 1121 and electro-mechanical components (EMCs) 1122 , as well as removable memory devices coupled to removable memory circuitry 1123 .
- EMCs electro-mechanical components
- the sensor circuitry 1121 include devices, modules, or subsystems whose purpose is to detect events or changes in its environment and send the information (sensor data) about the detected events to some other a device, module, subsystem, etc.
- sensors include, inter alia, inertia measurement units (IMUs) comprising accelerometers, gyroscopes, and/or magnetometers; microelectromechanical systems (MEMS) or nanoelectromechanical systems (NEMS) comprising 3-axis accelerometers, 3-axis gyroscopes, and/or magnetometers; level sensors; flow sensors; temperature sensors (e.g., thermistors); pressure sensors; barometric pressure sensors; gravimeters; altimeters; image capture devices (e.g., cameras or lensless apertures); light detection and ranging (LiDAR) sensors; proximity sensors (e.g., infrared radiation detector and the like), depth sensors, ambient light sensors, ultrasonic transceivers; microphones or other like audio capture devices; etc
- EMCs 1122 include devices, modules, or subsystems whose purpose is to enable platform 1100 to change its state, position, and/or orientation, or move or control a mechanism or (sub)system. Additionally, EMCs 1122 may be configured to generate and send messages/signaling to other components of the platform 1100 to indicate a current state of the EMCs 1122 .
- EMCs 1122 examples include one or more power switches, relays including electromechanical relays (EMRs) and/or solid state relays (SSRs), actuators (e.g., valve actuators, etc.), an audible sound generator, a visual warning device, motors (e.g., DC motors, stepper motors, etc.), wheels, thrusters, propellers, claws, clamps, hooks, and/or other like electro-mechanical components.
- platform 1100 is configured to operate one or more EMCs 1122 based on one or more captured events and/or instructions or control signals received from a service provider and/or various clients.
- the interface circuitry may connect the platform 1100 with positioning circuitry 1145 .
- the positioning circuitry 1145 includes circuitry to receive and decode signals transmitted/broadcasted by a positioning network of a GNSS.
- GNSS navigation satellite constellations
- Examples of navigation satellite constellations (or GNSS) include United States' GPS, Russia's GLONASS, the European Union's Galileo system, China's BeiDou Navigation Satellite System, a regional navigation system or GNSS augmentation system (e.g., NAVIC), Japan's QZSS, France's DORIS, etc.), or the like.
- the positioning circuitry 1145 comprises various hardware elements (e.g., including hardware devices such as switches, filters, amplifiers, antenna elements, and the like to facilitate OTA communications) to communicate with components of a positioning network, such as navigation satellite constellation nodes.
- the positioning circuitry 1145 may include a Micro-PNT IC that uses a master timing clock to perform position tracking/estimation without GNSS assistance.
- the positioning circuitry 1145 may also be part of, or interact with, the baseband circuitry 1110 and/or RFEMs 1115 to communicate with the nodes and components of the positioning network.
- the positioning circuitry 1145 may also provide position data and/or time data to the application circuitry 1105 , which may use the data to synchronize operations with various infrastructure (e.g., radio base stations), for turn-by-turn navigation applications, or the like
- the interface circuitry may connect the platform 1100 with Near-Field Communication (NFC) circuitry 1140 .
- NFC circuitry 1140 is configured to provide contactless, short-range communications based on radio frequency identification (RFID) standards, wherein magnetic field induction is used to enable communication between NFC circuitry 1140 and NFC-enabled devices external to the platform 1100 (e.g., an “NFC touchpoint”).
- RFID radio frequency identification
- NFC circuitry 1140 comprises an NFC controller coupled with an antenna element and a processor coupled with the NFC controller.
- the NFC controller may be a chip/IC providing NFC functionalities to the NFC circuitry 1140 by executing NFC controller firmware and an NFC stack.
- the NFC stack may be executed by the processor to control the NFC controller, and the NFC controller firmware may be executed by the NFC controller to control the antenna element to emit short-range RF signals.
- the RF signals may power a passive NFC tag (e.g., a microchip embedded in a sticker or wristband) to transmit stored data to the NFC circuitry 1140 , or initiate data transfer between the NFC circuitry 1140 and another active NFC device (e.g., a smartphone or an NFC-enabled POS terminal) that is proximate to the platform 1100 .
- a passive NFC tag e.g., a microchip embedded in a sticker or wristband
- another active NFC device e.g., a smartphone or an NFC-enabled POS terminal
- the driver circuitry 1146 may include software and hardware elements that operate to control particular devices that are embedded in the platform 1100 , attached to the platform 1100 , or otherwise communicatively coupled with the platform 1100 .
- the driver circuitry 1146 may include individual drivers allowing other components of the platform 1100 to interact with or control various input/output (I/O) devices that may be present within, or connected to, the platform 1100 .
- I/O input/output
- driver circuitry 1146 may include a display driver to control and allow access to a display device, a touchscreen driver to control and allow access to a touchscreen interface of the platform 1100 , sensor drivers to obtain sensor readings of sensor circuitry 1121 and control and allow access to sensor circuitry 1121 , EMC drivers to obtain actuator positions of the EMCs 1122 and/or control and allow access to the EMCs 1122 , a camera driver to control and allow access to an embedded image capture device, audio drivers to control and allow access to one or more audio devices.
- a display driver to control and allow access to a display device
- a touchscreen driver to control and allow access to a touchscreen interface of the platform 1100
- sensor drivers to obtain sensor readings of sensor circuitry 1121 and control and allow access to sensor circuitry 1121
- EMC drivers to obtain actuator positions of the EMCs 1122 and/or control and allow access to the EMCs 1122
- a camera driver to control and allow access to an embedded image capture device
- audio drivers to control and allow access to one or more audio devices
- the power management integrated circuitry (PMIC) 1125 may manage power provided to various components of the platform 1100 .
- the PMIC 1125 may control power-source selection, voltage scaling, battery charging, or DC-to-DC conversion.
- the PMIC 1125 may often be included when the platform 1100 is capable of being powered by a battery 1130 , for example, when the device is included in a mobile computing device.
- the PMIC 1125 may control, or otherwise be part of, various power saving mechanisms of the platform 1100 .
- the platform 1100 may enter a state known as Discontinuous Reception Mode (DRX) after a period of inactivity. During this state, the platform 1100 may power down for brief intervals of time and thus save power. If there is no data traffic activity for an extended period of time, then the platform 1100 may transition off to an RRC_Idle state, where it disconnects from the network and does not perform operations such as channel quality feedback, handover, etc.
- DRX Discontinuous Reception Mode
- the platform 1100 goes into a very low power state and it performs paging where again it periodically wakes up to listen to the network and then powers down again.
- the platform 1100 may not receive data in this state; in order to receive data, it must transition back to RRC_Connected state.
- An additional power saving mode may allow a device to be unavailable to the network for periods longer than a paging interval (ranging from seconds to a few hours). During this time, the device is totally unreachable to the network and may power down completely. Any data sent during this time incurs a large delay and it is assumed the delay is acceptable.
- a battery 1130 may power the platform 1100 , although in some examples the platform 1100 may be mounted deployed in a fixed location, and may have a power supply coupled to an electrical grid.
- the battery 1130 may be a lithium ion battery, a metal-air battery, such as a zinc-air battery, an aluminum-air battery, a lithium-air battery, and the like. In some implementations, such as in V2X applications, the battery 1130 may be a typical lead-acid automotive battery.
- the battery 1130 may be a “smart battery,” which includes or is coupled with a Battery Management System (BMS) or battery monitoring integrated circuitry.
- BMS Battery Management System
- the BMS may be included in the platform 1100 to track the state of charge (SoCh) of the battery 1130 .
- the BMS may be used to monitor other parameters of the battery 1130 to provide failure predictions, such as the state of health (SoH) and the state of function (SoF) of the battery 1130 .
- the BMS may communicate the information of the battery 1130 to the application circuitry 1105 or other components of the platform 1100 .
- the BMS may also include an analog-to-digital (ADC) convertor that allows the application circuitry 1105 to directly monitor the voltage of the battery 1130 or the current flow from the battery 1130 .
- the battery parameters may be used to determine actions that the platform 1100 may perform, such as transmission frequency, network operation, sensing frequency, and the like.
- a power block, or other power supply coupled to an electrical grid may be coupled with the BMS to charge the battery 1130 .
- the power block 1130 may be replaced with a wireless power receiver to obtain the power wirelessly, for example, through a loop antenna in the computer platform 1100 .
- a wireless battery charging circuit may be included in the BMS. The specific charging circuits chosen may depend on the size of the battery 1130 , and thus, the current required.
- the charging may be performed using the Airfuel standard promulgated by the Airfuel Alliance, the Qi wireless charging standard promulgated by the Wireless Power Consortium, or the Rezence charging standard promulgated by the Alliance for Wireless Power, among others.
- User interface circuitry 1150 includes various input/output (I/O) devices present within, or connected to, the platform 1100 , and includes one or more user interfaces designed to enable user interaction with the platform 1100 and/or peripheral component interfaces designed to enable peripheral component interaction with the platform 1100 .
- the user interface circuitry 1150 includes input device circuitry and output device circuitry.
- Input device circuitry includes any physical or virtual means for accepting an input including, inter alia, one or more physical or virtual buttons (e.g., a reset button), a physical keyboard, keypad, mouse, touchpad, touchscreen, microphones, scanner, headset, and/or the like.
- the output device circuitry includes any physical or virtual means for showing information or otherwise conveying information, such as sensor readings, actuator position(s), or other like information.
- Output device circuitry may include any number and/or combinations of audio or visual display, including, inter alia, one or more simple visual outputs/indicators (e.g., binary status indicators (e.g., light emitting diodes (LEDs)) and multi-character visual outputs, or more complex outputs such as display devices or touchscreens (e.g., Liquid Chrystal Displays (LCD), LED displays, quantum dot displays, projectors, etc.), with the output of characters, graphics, multimedia objects, and the like being generated or produced from the operation of the platform 1100 .
- the output device circuitry may also include speakers or other audio emitting devices, printer(s), and/or the like.
- the sensor circuitry 1121 may be used as the input device circuitry (e.g., an image capture device, motion capture device, or the like) and one or more EMCs may be used as the output device circuitry (e.g., an actuator to provide haptic feedback or the like).
- EMCs e.g., an actuator to provide haptic feedback or the like.
- NFC circuitry comprising an NFC controller coupled with an antenna element and a processing device may be included to read electronic tags and/or connect with another NFC-enabled device.
- Peripheral component interfaces may include, but are not limited to, a non-volatile memory port, a USB port, an audio jack, a power supply interface, etc.
- bus or interconnect may include any number of technologies, including ISA, EISA, PCI, PCIx, PCIe, a Time-Trigger Protocol (TTP) system, a FlexRay system, or any number of other technologies.
- the bus/IX may be a proprietary bus/IX, for example, used in a SoC based system.
- Other bus/IX systems may be included, such as an I2C interface, an SPI interface, point-to-point interfaces, and a power bus, among others.
- FIG. 12 is a block diagram illustrating components, according to some example embodiments, able to read instructions from a machine-readable or computer-readable medium (e.g., a non-transitory machine-readable storage medium) and perform any one or more of the methodologies discussed herein.
- FIG. 12 shows a diagrammatic representation of hardware resources 1200 including one or more processors (or processor cores) 1210 , one or more memory/storage devices 1220 , and one or more communication resources 1230 , each of which may be communicatively coupled via a bus 1240 .
- computing resource may refer to a physical or virtual device, a physical or virtual component within a computing environment, and/or physical or virtual component within a particular device, such as computer devices, mechanical devices, memory space, processor/CPU time and/or processor/CPU usage, processor and accelerator loads, hardware time or usage, electrical power, input/output operations, ports or network sockets, channel/link allocation, throughput, memory usage, storage, network, database and applications, and/or the like.
- node virtualization e.g., NFV
- a hypervisor 1202 may be executed to provide an execution environment for one or more network slices/sub-slices to utilize the hardware resources 1200 .
- a “virtualized resource” may refer to compute, storage, and/or network resources provided by virtualization infrastructure to an application, device, system, etc.
- the processors 1210 may include, for example, a processor 1012 and a processor 1214 .
- CPU central processing unit
- RISC reduced instruction set computing
- CISC complex instruction set computing
- GPU graphics processing unit
- DSP digital signal processor
- ASIC application specific integrated circuit
- RFIC radio-frequency integrated circuit
- the memory/storage devices 1220 may include main memory, disk storage, or any suitable combination thereof.
- the memory/storage devices 1220 may include, but are not limited to any type of volatile or non-volatile memory such as dynamic random access memory (DRAM), static random-access memory (SRAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), Flash memory, solid-state storage, etc.
- DRAM dynamic random access memory
- SRAM static random-access memory
- EPROM erasable programmable read-only memory
- EEPROM electrically erasable programmable read-only memory
- Flash memory solid-state storage, etc.
- the communication resources 1230 may include interconnection or network interface components or other suitable devices to communicate with one or more peripheral devices 1204 or one or more databases 1206 via a network 1208 .
- the communication resources 1030 may include wired communication components (e.g., for coupling via a Universal Serial Bus (USB)), cellular communication components, NFC components, Bluetooth® components (e.g., Bluetooth® Low Energy), Wi-Fi® components, and other communication components.
- the term “network resource” or “communication resource” may refer to computing resources that are accessible by computer devices via a communications network.
- system resources may refer to any kind of shared entities to provide services, and may include computing and/or network resources. System resources may be considered as a set of coherent functions, network data objects or services, accessible through a server where such system resources reside on a single host or multiple hosts and are clearly identifiable.
- Instructions 1250 may comprise software, a program, an application, an applet, an app, or other executable code for causing at least any of the processors 1210 to perform any one or more of the methodologies discussed herein.
- the instructions 1250 may reside, completely or partially, within at least one of the processors 1210 (e.g., within the processor's cache memory), the memory/storage devices 1220 , or any suitable combination thereof.
- any portion of the instructions 1250 may be transferred to the hardware resources 1200 from any combination of the peripheral devices 1204 or the databases 1206 .
- the memory of processors 1210 , the memory/storage devices 1220 , the peripheral devices 1204 , and the databases 1206 are examples of computer-readable and machine-readable media.
- At least one of the components set forth in one or more of the preceding figures may be configured to perform one or more operations, techniques, processes, and/or methods as set forth in the example section below.
- the baseband circuitry as described above in connection with one or more of the preceding figures may be configured to operate in accordance with one or more of the examples set forth below.
- circuitry associated with a UE, base station, network element, etc. as described above in connection with one or more of the preceding figures may be configured to operate in accordance with one or more of the examples set forth below in the example section.
- Example 1 may include an apparatus comprising: memory to store a channel state information (CSI) matrix; and processor circuitry, coupled with the memory, to: retrieve the CSI matrix from the memory, wherein the CSI matrix includes one or more indicators associated with a proximity of an object to a computing device; generate a covariance matrix based on the CSI matrix; perform a singular value decomposition (SVD) operation on the covariance matrix to obtain a singular values vector; and determine the proximity of the object to the computing device based on the singular values vector.
- CSI channel state information
- Example 2 may include the apparatus of example 1 or some other example herein, wherein the proximity of the object to the computing device is determined based on the singular values vector using a neural network (NN).
- NN neural network
- Example 3 may include the apparatus of example 2 or some other example herein, wherein the NN is a feedforward NN.
- Example 4 may include the apparatus of example 1 or some other example herein, wherein the SVD operation includes decomposing the CSI matrix into a plurality of matrices.
- Example 5 may include the apparatus of example 4 or some other example herein, wherein the plurality of matrices include at least one unitary matrix and at least one diagonal matrix.
- Example 6 may include the apparatus of example 1 or some other example herein, wherein the singular values vector includes entries correlated to environment-independent proximity of the object to the computing device.
- Example 7 may include the apparatus of example 1 or some other example herein, wherein the apparatus is an access point and the CSI matrix is received from the computing device.
- Example 8 may include the apparatus of example 1 or some other example herein, wherein the apparatus is included in the computing device.
- Example 9 includes one or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause an access point to: receive a CSI matrix from a computing device, wherein the CSI matrix includes one or more indicators associated with a proximity of an object to the computing device; generate a covariance matrix based on the CSI matrix; perform a singular value decomposition (SVD) operation on the covariance matrix to obtain a singular values vector; and determine the proximity of the object to the computing device based on the singular values vector using a neural network (NN).
- a CSI matrix from a computing device
- the CSI matrix includes one or more indicators associated with a proximity of an object to the computing device
- generate a covariance matrix based on the CSI matrix perform a singular value decomposition (SVD) operation on the covariance matrix to obtain a singular values vector
- NN neural network
- Example 10 includes the one or more non-transitory computer-readable media of example 9 or some other example herein, wherein the NN is a feedforward NN.
- Example 11 includes the one or more non-transitory computer-readable media of example 9 or some other example herein, wherein the SVD operation includes decomposing the CSI matrix into a plurality of matrices.
- Example 12 includes the one or more non-transitory computer-readable media of example 11 or some other example herein, wherein the plurality of matrices include at least one unitary matrix and at least one diagonal matrix.
- Example 13 includes the one or more non-transitory computer-readable media of example 9 or some other example herein, wherein the singular values vector includes entries correlated to environment-independent proximity of the object to the computing device.
- Example 14 includes one or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, are to cause a device to: generate a covariance matrix based on a CSI matrix, wherein the CSI matrix includes one or more indicators associated with a proximity of an object to a computing device; perform a singular value decomposition (SVD) operation on the covariance matrix to obtain a singular values vector; and determine the proximity of the object to the computing device based on the singular values vector using a neural network (NN).
- CSI matrix includes one or more indicators associated with a proximity of an object to a computing device
- SSD singular value decomposition
- Example 15 includes the one or more non-transitory computer-readable media of example 14 or some other example herein, wherein the NN is a feedforward NN.
- Example 16 includes the one or more non-transitory computer-readable media of example 14 or some other example herein, wherein the SVD operation includes decomposing the CSI matrix into a plurality of matrices.
- Example 17 includes the one or more non-transitory computer-readable media of example 16 or some other example herein, wherein the plurality of matrices include at least one unitary matrix and at least one diagonal matrix.
- Example 18 includes the one or more non-transitory computer-readable media of example 14 or some other example herein, wherein the singular values vector includes entries correlated to environment-independent proximity of the object to the computing device.
- Example 19 includes the one or more non-transitory computer-readable media of example 14 or some other example herein, wherein the device is an access point and the CSI matrix is received from the computing device.
- Example 20 includes the one or more non-transitory computer-readable media of example 14 or some other example herein, wherein the device is included in the computing device.
- Example 21 may include an apparatus comprising means to perform one or more elements of a method described in or related to any of examples 1-20, or any other method or process described herein.
- Example 22 may include one or more non-transitory computer-readable media comprising instructions to cause an electronic device, upon execution of the instructions by one or more processors of the electronic device, to perform one or more elements of a method described in or related to any of examples 1-20, or any other method or process described herein.
- Example 23 may include an apparatus comprising logic, modules, or circuitry to perform one or more elements of a method described in or related to any of examples 1-20, or any other method or process described herein.
- Example 24 may include a method, technique, or process as described in or related to any of examples 1-20, or portions or parts thereof.
- Example 25 may include an apparatus comprising: one or more processors and one or more computer readable media comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform the method, techniques, or process as described in or related to any of examples 1-20, or portions thereof.
- Example 26 may include a signal as described in or related to any of examples 1-20, or portions or parts thereof.
- Example 27 may include a signal in a wireless network as shown and described herein.
- Example 28 may include a method of communicating in a wireless network as shown and described herein.
- Example 29 may include a system for providing wireless communication as shown and described herein.
- Example 30 may include a device for providing wireless communication as shown and described herein.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Power Engineering (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
Description
| TABLE 1 | ||||||
| train data | AP | test data | ||||
| point | # | point | Accuracy | Precision | Recall | Process |
| 1 | 2 | 2 | 0.4997 | 0.499 | 0.9898 | A |
| 1 | 2 | 2 | 0.9471 | 0.9144 | 0.9863 | B |
| 1 | 2 | 2 | 0.9505 | 0.9324 | 0.9713 | C |
| 1 | 1 | 3 | 0.469 | 0.4669 | 1 | A |
| 1 | 1 | 3 | 0.9318 | 0.8884 | 0.9759 | B |
| 1 | 1 | 3 | 0.9048 | 0.8774 | 0.9244 | C |
| 1 | 1 | 4 | 0.4794 | 0.4657 | 0.9998 | A |
| 1 | 1 | 4 | 0.9303 | 0.8762 | 0.9858 | B |
| 1 | 1 | 4 | 0.9508 | 0.9522 | 0.9387 | C |
| 1 | 1 | 5 | 0.4979 | 0.4849 | 0.9932 | A |
| 1 | 1 | 5 | 0.8722 | 0.8002 | 0.9724 | B |
| 1 | 1 | 5 | 0.8659 | 0.8223 | 0.9141 | C |
| 1 | 1 | 6 | 0.5638 | 0.5531 | 0.9981 | A |
| 1 | 1 | 6 | 0.8673 | 0.839 | 0.933 | B |
| 1 | 1 | 6 | 0.9072 | 0.9361 | 0.8887 | C |
| 1 | 2 | 7 | 0.6207 | 0.5481 | 0.9994 | A |
| 1 | 2 | 7 | 0.9746 | 0.9565 | 0.9898 | B |
| 1 | 2 | 7 | 0.9723 | 0.9566 | 0.9845 | C |
| 1 | 1 | 9 | 0.4704 | 0.4704 | 1 | A |
| 1 | 1 | 9 | 0.8825 | 0.8116 | 0.9771 | B |
| 1 | 1 | 9 | 0.9607 | 0.9565 | 0.9601 | |
| 1, 2, 10 | 1 | 11 | 0.3724 | 0.3038 | 0.9927 | |
| 1, 2, 10 | 1 | 11 | 0.9122 | 0.8028 | 0.9025 | |
| 1, 2, 10 | 1 | 11 | 0.8997 | 0.7803 | 0.8847 | C |
Claims (20)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US17/129,702 US12101683B2 (en) | 2020-12-21 | 2020-12-21 | Proximity detection using wi-fi channel state information |
| EP21197378.9A EP4016943B1 (en) | 2020-12-21 | 2021-09-17 | Proximity detection using wi-fi channel state information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US17/129,702 US12101683B2 (en) | 2020-12-21 | 2020-12-21 | Proximity detection using wi-fi channel state information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20210112371A1 US20210112371A1 (en) | 2021-04-15 |
| US12101683B2 true US12101683B2 (en) | 2024-09-24 |
Family
ID=75383605
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US17/129,702 Active 2043-01-08 US12101683B2 (en) | 2020-12-21 | 2020-12-21 | Proximity detection using wi-fi channel state information |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US12101683B2 (en) |
| EP (1) | EP4016943B1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114758364B (en) * | 2022-02-09 | 2022-09-23 | 四川大学 | Industrial Internet of things scene fusion positioning method and system based on deep learning |
| US12501218B2 (en) * | 2022-12-16 | 2025-12-16 | Dell Products L.P. | Audio playback synchrony for information handling systems |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7251637B1 (en) * | 1993-09-20 | 2007-07-31 | Fair Isaac Corporation | Context vector generation and retrieval |
| US8831067B2 (en) * | 2010-04-05 | 2014-09-09 | Zte Corporation | Method and system for channel state information feedback |
| US10763935B2 (en) * | 2018-08-09 | 2020-09-01 | At&T Intellectual Property I, L.P. | Generic feedback to enable reciprocity and over the air calibration for advanced networks |
| US10873370B2 (en) * | 2016-11-03 | 2020-12-22 | Wisig Networks Private Limited | Method and system for enabling explicit channel state information (CSI) feedback in multiple-input-multiple-output (MIMO) |
| US11025310B2 (en) * | 2017-01-09 | 2021-06-01 | Apple Inc. | Codebook design for new radio (NR) systems |
| US11115240B2 (en) * | 2016-05-12 | 2021-09-07 | Alcatel Lucent | Methods, apparatuses, and systems for performing analog CSI feedback |
| US11500058B2 (en) * | 2015-07-17 | 2022-11-15 | Origin Wireless, Inc. | Method, apparatus, and system for wireless proximity sensing |
| US11509363B2 (en) * | 2019-03-06 | 2022-11-22 | Telefonaktiebolaget Lm Ericsson (Publ) | Compression and decompression of downlink channel estimates |
| US20220385343A1 (en) * | 2020-02-07 | 2022-12-01 | Huawei Technologies Co., Ltd. | Information transmission method and apparatus |
| US11588530B2 (en) * | 2018-06-01 | 2023-02-21 | Zte Corporation | Information feedback method, terminal, and base station |
| US20230231605A1 (en) * | 2019-10-22 | 2023-07-20 | Telefonaktiebolaget Lm Ericsson (Publ) | Statistical channel state information reporting |
| US11887007B2 (en) * | 2019-03-15 | 2024-01-30 | Intel Corporation | Machine learning techniques for precise position determination |
-
2020
- 2020-12-21 US US17/129,702 patent/US12101683B2/en active Active
-
2021
- 2021-09-17 EP EP21197378.9A patent/EP4016943B1/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7251637B1 (en) * | 1993-09-20 | 2007-07-31 | Fair Isaac Corporation | Context vector generation and retrieval |
| US8831067B2 (en) * | 2010-04-05 | 2014-09-09 | Zte Corporation | Method and system for channel state information feedback |
| US11500058B2 (en) * | 2015-07-17 | 2022-11-15 | Origin Wireless, Inc. | Method, apparatus, and system for wireless proximity sensing |
| US11115240B2 (en) * | 2016-05-12 | 2021-09-07 | Alcatel Lucent | Methods, apparatuses, and systems for performing analog CSI feedback |
| US10873370B2 (en) * | 2016-11-03 | 2020-12-22 | Wisig Networks Private Limited | Method and system for enabling explicit channel state information (CSI) feedback in multiple-input-multiple-output (MIMO) |
| US11025310B2 (en) * | 2017-01-09 | 2021-06-01 | Apple Inc. | Codebook design for new radio (NR) systems |
| US11588530B2 (en) * | 2018-06-01 | 2023-02-21 | Zte Corporation | Information feedback method, terminal, and base station |
| US10763935B2 (en) * | 2018-08-09 | 2020-09-01 | At&T Intellectual Property I, L.P. | Generic feedback to enable reciprocity and over the air calibration for advanced networks |
| US11509363B2 (en) * | 2019-03-06 | 2022-11-22 | Telefonaktiebolaget Lm Ericsson (Publ) | Compression and decompression of downlink channel estimates |
| US11728851B2 (en) * | 2019-03-06 | 2023-08-15 | Telefonaktiebolaget Lm Ericsson (Publ) | Compression and decompression of downlink channel estimates |
| US11887007B2 (en) * | 2019-03-15 | 2024-01-30 | Intel Corporation | Machine learning techniques for precise position determination |
| US20230231605A1 (en) * | 2019-10-22 | 2023-07-20 | Telefonaktiebolaget Lm Ericsson (Publ) | Statistical channel state information reporting |
| US20220385343A1 (en) * | 2020-02-07 | 2022-12-01 | Huawei Technologies Co., Ltd. | Information transmission method and apparatus |
Non-Patent Citations (5)
| Title |
|---|
| Adege Abebe Belay et al: "Mobility Predictions for IoT Devices Using Gated Recurrent Unit Network", IEEE Internet of Things Journal, IEEE, USA, vol. 7, No. 1, Oct. 17, 2019 (Oct. 17, 2019), pp. 505-517, XP011764971, DOI: 10.1109/JIOT.2019.2948075 [retrieved on Jan. 9, 2020]. |
| EPO Extended European Search Report dated Mar. 28, 2022, pp. 1-9. |
| Feng Chunhai et al: "Wi-Multi: A Three-Phase System for Multiple Human Activity Recognition With Commercial WiFi Devices", IEEE Internet of Things Journal, IEEE, USA, vol. 6, No. 4, Aug. 1, 2019 (Aug. 1, 2019), pp. 7293-7304, XP011737535, DOI: 10.1109/JIOT. 2019.2915989 [retrieved on Jul. 31, 2019]. |
| Ma Yongsen Yma@CS WM EDU et al: "WiFi Sensing with Channel State Information", ACM Computing Surveys, ACM, New York, NY, US, US, vol. 52, No. 3, Jun. 18, 2019 (Jun. 18, 2019), pp. 1-36, XP058666612, ISSN: 0360-0300, DOI: 10.1145/3310194. |
| Mohammed Alloulah et al: "On Tracking the Physicality of Wi-Fi: A Subspace Approach", arxiv.org, Cornell University Library, 201 Olin Library Cornell University Ithaca, NY 14853, Oct. 10, 2018 (Oct. 10, 2018), XP080923359. |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4016943A1 (en) | 2022-06-22 |
| EP4016943B1 (en) | 2024-11-06 |
| US20210112371A1 (en) | 2021-04-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11937116B2 (en) | Techniques for gap-based feedback measurement in new radio wireless cellular network | |
| US11831381B2 (en) | Beam failure recovery for uplink | |
| CN112753271B (en) | Preconfigured shared resources for uplink transmission | |
| KR102604571B1 (en) | Wireless resource management measures and techniques for reducing user equipment power consumption | |
| US12476357B2 (en) | Antenna assembly with isolation network | |
| CN113016156A (en) | Synchronization signal block based beam fault detection | |
| WO2020102146A2 (en) | User equipment power saving in new radio system | |
| US12230866B2 (en) | Techniques for specific absorption rate (SAR) sensing elements in SAR circuits | |
| US12379765B2 (en) | Core status management at power failure | |
| EP4016943B1 (en) | Proximity detection using wi-fi channel state information | |
| KR102723884B1 (en) | New Radio - Cell Reselection for Unlicensed | |
| WO2022082645A1 (en) | Systems and methods for multi-hop configurations in iab networks for reduced latency | |
| US20250142487A1 (en) | Performance and range of indoor client devices by applying regulated eirp limits of subordinate devices | |
| KR20220146343A (en) | Application timeline with unified design for active mode user equipment power saving for apparatuses, systems, and methods | |
| US12082090B2 (en) | Narrowband reference signal transmission for measurement and synchronization | |
| US11985539B2 (en) | Buffer status report (BSR) data reporting based on application processor (AP) assistance | |
| EP3857743A1 (en) | Estimation of signal to noise ratio margin for synchronization signal block radio link monitoring out of sync and in sync | |
| WO2022087969A1 (en) | User plane integrity protection configuration in en-dc |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: INTEL CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SHOLEV, OMER;DEGANI, OFIR;BANIN, ELAN;AND OTHERS;SIGNING DATES FROM 20201213 TO 20201221;REEL/FRAME:054715/0540 |
|
| FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| STCT | Information on status: administrative procedure adjustment |
Free format text: PROSECUTION SUSPENDED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
| ZAAA | Notice of allowance and fees due |
Free format text: ORIGINAL CODE: NOA |
|
| ZAAB | Notice of allowance mailed |
Free format text: ORIGINAL CODE: MN/=. |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: AWAITING TC RESP., ISSUE FEE NOT PAID |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |