WO2021137688A1

WO2021137688A1 - System and method for determining wireless network performance

Info

Publication number: WO2021137688A1
Application number: PCT/MY2020/050144
Authority: WO
Inventors: Zanawiyah BINTI ILYAS; Mahathir BIN SULAIMAN
Original assignee: Mimos Bhd
Current assignee: Mimos Bhd
Priority date: 2019-12-31
Filing date: 2020-11-11
Publication date: 2021-07-08
Anticipated expiration: 2022-06-30

Abstract

The present invention discloses a system for determining wireless network performance at user location (10) comprising of a manifesto agent (12) positioned in the user location (10) and a monitoring system (50) having a database (80) and a manifesto system (60). The database (80) is configured for storing the collected wireless network information by the monitoring system (50) from an access point agent (21) in the wireless access point (20). While the manifesto system (60) is configured for managing the collected information from the manifesto agent (12) and assembled the information from the monitoring system (50). The manifesto system (60) further comprises of an assemble engine (62), a criterion attributes module (68), a scrutinize engine (64) and verdict engine (66). Further, a method (200) of determining wireless network performance at the user location (10) are provided herein to perform the same.

Description

SYSTEM AND METHOD FOR DETERMINING WIRELESS NETWORK PERFORMANCE

FIELD OF THE INVENTION

The present invention generally relates to wireless network performance and more particularly relates to a system and method for determining wireless network performance at end user.

BACKGROUND OF THE INVENTION

Currently, high quality of wireless network environment to satisfy a user is become one of the main purpose for network maintenance and optimization. With a rapid development and increase competition in mobile communication services, user expectations for the quality of wireless communication networks also increase. However, in some cases, some user complaining that they are facing a bad connection of WIFI network but there is no notification shown in a WIFI monitoring system of a detected access point, AP.

Troubleshooting process commonly conducted on-site WIFI AP, not on the user side such as computer device. Moreover, WIFI AP monitoring also provide inaccurate information due to change location of the user while accessing the WIFI AP. An unknown/unregistered user that access the WIFI also provide unnecessary monitoring information. Therefore, the WIFI monitoring system do not provide an accurate information on the wireless strength at the user location.

There are several conventional method for testing network quality such as Key Performance Indicator (KPI) statistics, customer complaint, non-periodic network assessment (driving test), and automatic driving test. However, each of these conventional methods has its own limitations. The KPI statistics for example may be used to generate KPI parameters of a whole network during a given period of time. But this method is limited on problem analysis and determination and unable to reflect users’ real experience of service (EoS). Another conventional method like non-periodic driving test may used to monitor network quality by non-periodically testing network services within a predetermined area and during a predetermined period of time. However, testing results using this method may not reflect quality of a whole network since the test does not cover the whole network. Moreover, performing a non periodic driving test may place a high demand for manpower and resources, and may be limited by various natural conditions. Therefore, this method is costly and insufficient to perform the abovementioned method. An example of patent application that relates to a system and method for automatically monitoring wireless network performance is disclosed in US 2009/0227251 A1. The invention provides a system for automatically monitoring and managing network performance. The system comprises a mobile phone, adapted to have a monitoring function for providing monitoring information and communications regarding monitoring and management of network performance; and a mobile communication network, providing mobile communication services to the mobile phone. The mobile communication network comprises a mobile measurement agent (MMA), adapted to control performing of the monitoring function of the mobile phone and to communicate with the mobile phone. A data server, adapted to store information comprising the monitoring information and a component for processing the information stored in the data server, wherein a processing result of the information used in performance monitoring and management of the mobile communication network. Therefore, there is a need for an improved a system and method for determining wireless network performance at end user. Although there are systems and methods for the same in the prior art, for many practical purposes, there is still considerable room for improvements. SUMMARY OF THE INVENTION

The following presents a simplified summary of the invention in order to provide a basic understanding of some aspects of the invention. This summary is not an extensive overview of the invention. Its sole purpose is to present some concepts of the invention in a simplified form as a prelude to the more detailed description that is presented later.

It is an objective of the present invention to provide a system and method to determine wireless network performance strength at user location or device.

Another objective of the present invention is to provide an assurance on wireless network performance at the end user location or device as well as to provide a better wireless network infrastructure performance.

Accordingly, the present invention provides a system for determining wireless network performance at user location comprising of a manifesto agent positioned in the user location configured to collect information of wireless network strength and bandwidth performance at the user location; a monitoring system having: a database configured to store collected information by the monitoring system from an access point (AP) agent in a wireless access point, AP; and a manifesto system configured to manage collected information from the manifesto agent and assembled information from the monitoring system. The manifesto system further comprises of an assemble engine configured to assemble information received from the manifesto agent; a criterion attributes module having a plurality of attributes embedded with the information from the assemble engine, wherein the attributes is defined by a user or dynamically recommended by the system; and a scrutinize engine configured to scrutinize the information received from the assemble engine embedded with the criterion attributes.

Preferably, the manifesto system further comprising of a verdict engine configured to analyze the information received from the scrutinize engine and generate a report of the wireless network performance. Preferably, the scrutinize engine further configured to match criteria of the criterion attributes.

In accordance with another aspect of the present invention, a method of determining wireless network performance at user location is provided herewith. The method of the present invention comprises the steps of collecting by a manifesto agent, information of the wireless network performance at the user location; assembling, by an assemble engine, the information from the user location embedded with a defined attributes from a criterion attributes module; scrutinizing the information, by a scrutinize engine, received from the assemble engine; and analyzing the information received from the scrutinize engine by a verdict engine.

Preferably, the step of collecting, by a manifesto agent, information of the wireless network performance at the user location further comprises the steps of positioning the manifesto agent to the user location; establishing a connection from the manifesto agent to a wireless access point; selecting a criterion attribute; collecting information of network strength and bandwidth performance based on the selected attribute; sending the collected information to a manifesto system; determining successfulness of the sent information (232); and receiving an error code if the information is not successfully sent.

Preferably, the step of assembling, by an assemble engine, the information from the user location embedded with a defined attributes from a criterion attributes module further comprises the steps of receiving information from the manifesto agent; defining criterion attributes; processing the information received from the manifesto system and embedded with the defining criterion attributes; determining the criteria of the defining attributes and the collected information; sending the information to a scrutinize engine if the criteria is matched; and reiterating step if the criteria is not matched.

Preferably, the step of the scrutinizing the information, by a scrutinize engine, received from the assemble engine further comprises the steps of collecting information from the manifesto system; collecting information from a monitoring system; associating the information received from the manifesto system and the monitoring system; embedding the criterion attributes to the associated information; and sending the information to a verdict engine.

Preferably, the step of the analyzing the information received from the scrutinize engine by a verdict engine further comprises the steps of processing the information embedded with the criterion attributes, wherein a role attribute is defined in the criterion attributes; and generating a report based on the role defined attributes.

Preferably, the collected information from the monitoring system is an information from a wireless agent in a wireless access point, AP.

The foregoing and other objects, features, aspects and advantages of the present invention will become better understood from a careful reading of a detailed description provided herein below with appropriate reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete appreciation of the invention and many of the attendant advantages thereof will be readily as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:

Figure 1 illustrates a block diagram of a system architecture for determining wireless network performance at user location according to one embodiment of the present invention.

Figure 2 is a flowchart illustrating a general method of determining wireless network performance at user location according to one embodiment of the present invention.

Figure 3 is a flowchart illustrating a step of collecting information of wireless network performance according to one embodiment of the present invention.

Figure 4 is a flowchart illustrating a step of assembling information from a manifesto agent embedded with attributes according to one embodiment of the present invention.

Figure 5 is a flowchart illustrating a step of scrutinizing the information received from the assemble engine and the monitoring system according to one embodiment of the present invention. Figure 6 is a flowchart illustrating a step of analyzing the information received from the scrutinize engine according to one embodiment of the present invention. Figure 7 is illustrate an exemplary of a graph report generated based on a role defined according to one embodiment of the present invention.

It is noted that the drawings may not be to scale. The drawings are intended to depict only typical aspects of the invention, and therefore should not be considered as limiting the scope of the invention. In the drawings, like numberings represent like elements between the drawings.

DETAILED DESCRIPTION OF THE INVENTION The above mentioned features and objectives of this invention will become more apparent and better understood by reference to the following detailed description. It should be understood that the detailed description made known below is not intended to be exhaustive or limit the invention to the precise disclosed form, as the invention may assume various alternative forms. On the contrary, the detailed description covers all the relevant modifications and alterations made to the present invention, unless the claims expressly state otherwise.

The present invention provides a system and method to determine wireless network performance at user location or device.

Initial reference is made to figure 1 which illustrates a block diagram of the system (100) to determine the wireless network performance at the user location (10) in a preferred embodiment of the present invention. According to figure 1 , the system (10) having a user location (10), a wireless access point (AP) (20) and a monitoring system (50). The present invention is to determine wireless network strength at the user location (10) by positioning a device (11) that able to collect the wireless network strength and bandwidth performance at the user location/side (10). The device (11) is preferably but not limited to a tiny personal computer (PC) or raspberry Pi. In the present invention, a manifesto agent (12) is positioned in the device (11) configured to collect information of network strength at the user side (10) as well as establish a connection to the monitoring system (50).

The monitoring system (50) having a database (80) and a manifesto system (60), whereby the database (80) is configured for storing wireless network information collected by the monitoring system (50) from an access point agent (21) in the wireless access point (20). While the manifesto system (60) is configured for managing the collected information from the manifesto agent (12) and assembled the information from the monitoring system (50). The manifesto system (60) further comprises of an assemble engine (62), a scrutinize engine (64), a verdict engine (66) and a criterion attributes module (68).

The assemble engine (62) is configured to assemble information received from the manifesto agent (12). The information from the assemble engine (62) will be scrutinized by the scrutinize engine (64), whereby the information is embedded with a criterion attribute. The criterion attributes are from the criterion attributes module (68) that is preferably defined by a user or dynamically recommended by the system (100). The criterion attributes are preferably but not limited to location, IP address, connected WIFI, network strength, time, frequency, and etc. The scrutinize engine (64) further configured to match criteria of the criterion attributes with the collected information.

The information from the scrutinize engine (64) will be further analyzed by the verdict engine (66) to generate a report of the wireless network performance at the user location (10). From the report, the strength of the wireless network performance at the user location (10) can be determined.

Figure 2 illustrate a general method (200) of determining the wireless network performance at the user location (10) in a preferred embodiment of the present invention. The method of determining wireless network performance at user location (10) comprises the steps of collecting (220) the information of the wireless network performance at the user location (10) by the manifesto agent (12). The information will be collected based on the criterion attributes defined by the user or dynamically recommended by the system (100) for a specific device, whereby the specific device refer to specific information collected on the device. Each device may have different attributes defined. Then, the assemble engine (62) will assemble (240) the information from the user location (10) embedded with the defined attributes from the criterion attributes module (68). The defined attributes will be further used in the manifesto agent (12), assemble engine (62), scrutinize engine (64) and the verdict engine (66).

Before scrutinizing the information from the assemble engine (62), information from the monitoring system (50) will be retrieved, whereby the information is retrieved from the AP agent (21). The scrutinize engine (64) will scrutinize (260) the information from the assemble engine (62) and monitoring system (50), whereby the information is embedded with the criterion attributes. The received information from the scrutinize engine (64) is analyzed (280) by the verdict engine (66). The verdict engine (66) will embed the criterion attributes to populate an output. In order to generate a report based on the received information, a dynamic role will be defined by the user in the verdict engine (66) and can be changed according to the defined attributes. The roles is generated for the verdict engine (66) to perform deep analysis on the data.

Figure 3 shows the step of collecting (220) the information of wireless network performance at the user location (10) by the manifesto agent (12). The step of collecting the information further comprises the steps of positioning (222) the manifesto agent (12) in the device (11) at the user location (10). The manifesto agent (12) further establishing (224) a connection to the wireless access point (20) to assign an IP address to the device (11). The criterion attributes will be selected (226) at this stage either defined by the user or dynamically recommended by the system (100), whereby the criterion attributes are defined from the criterion attributes module (68). Table 1 below shows the criterion attributes that defined and selected by the user at a different location of the devices (11). The following criterion attributes listed in table 1 are the examples of attributes that are defined by the user. The attributes are not limited only to these attributes. Table 1 : Criterion attributes defined and selected at different device locations.

Table 2a, 2b and 2c below show the criterion attributes selected at the different device (11) locations. Each device (11) have a different attributes depend on the selected criterion attributes defined by the user.

Table 2a: Criterion attributes selected at Device 1

Table 2b : Criterion attributes selected at Device 2

Table 2c: Criterion attributes selected at Device 3

In another preferred embodiment, the criterion attributes also can be recommended dynamically by the system (100). Once the manifesto agent (12) positioned in the device (11) connected to the network for the first time, the data from the network will be collected. The collected data will be used as a baseline. Each attribute will be categorized with Low, Medium and High. Attributes with Medium and High will be recommended as a selected attributes. Following table 3 shows an example of all attributes that is used to collect data information for a baseline for a first time. In table 3, three attributes are used, i.e. attributel , attribute2, and attributes. Each attribute will populate the data information based on Low, Medium and High for each device. The recommended dynamic attribute will generate the recommended attributes based on Medium and High categories. The example of information collected by each device based on the recommended dynamic attributes is shown as in table 3b. Device 1 recommends attribute2 and attributes due to the collected data shown as Medium category for Attributes and High category for Attribute2. While device 2 that recommends attributel , attribute2, and attributes having High category for all the attributes.

Table 3a: Attributes collected data in different device.

Table 3b: Information collected by devices based on recommended dynamic attributes

Based on the selected attributes as explained in the previous step (226), the information of network strength and bandwidth performance will be collected (228) by the manifesto agent (11). The collected information will be sending (230) to the manifesto system (60) and the assemble engine (62) will determine whether the information is successfully sent to the manifesto system (232) or not. The unsuccessful information will receive an error code (234). The manifesto agent (11) will try to send the information again until it received successful code from the manifesto system (60).

The successful collected information sent to the manifesto system (60) is assembled by the assemble engine (62). The step of assembling (240) the information embedded with the defined attributes from the user location (10) further described in figure 4. The assemble engine (62) received (242) the information from the manifesto agent (12). At a same time, the criterion attributes is defined (224) by the user or dynamically recommended by the system (100) as in previous example. The information embedded with the defined criterion attributes received from the assemble engine (62) will be further processed as in step 246. The assemble engine (62) further determine criteria of the criterion attributes with the collected information (248) to identify matching criteria of the information. If the criteria is matched, the information will be stored in the database (80) and sent to the scrutinize engine (64) (250) for further processing. Otherwise, if the criteria is not matched, step 246 will be repeated accordingly.

The process to identify matching criteria as in step 248 is further explain in following table 4a and 4b. Table 4a shows an example of devices (device 1 , device 2 and device 3) with the attributes defined by the user or recommended dynamically by the system (100). Table 4a: Example devices with attributes defined by users or recommended dynamically by the system.

Following table 4b shows the information processed by the assemble engine (62) that matched the criteria between the criterion attributes and the collected information. The assemble engine (62) contains all possible attributes. Only the attributes that defined for the device (11) is stored in the assemble engine (62). The attributes which is not defined be marked as X which is not match for data collection. Table 4b: Process information by Assemble Engine with matching criteria.

Figure 5 illustrates the flowchart of scrutinizing (260) the information received from the assemble engine (62) by the scrutinize engine (64). The information is collected from the manifesto system (262). In the same time, the information is also collected from the monitoring system (264). The information received from the manifesto system (60) and the monitoring system (50) are associated (266). The association of the information from the manifesto system (60) and the monitoring system (50) is further described as following table 5a, 5b and 5c. Table 5a shows the information collected from the assemble engine (62) in the manifesto system (60). While in table 5b, it shows the information collected from the monitoring system (50). Table 5a: Information collected from assemble engine (Manifesto System)

Table 5b: Information collected from the monitoring system.

From both tables, attributes in the assemble engine (62) in table 5a is defined as equal attribute to the field 1 in the monitoring system in table 5b. The associated information in both tables will be embedded (268) with the criterion attributes by defining equality attribute from both information. The equal attributes are used to map the field for both manifesto agent and monitoring system.

As in table 5c, the information between the manifesto system (60) and the monitoring system (60) are associated using attributes and fieldl . The information will then be stored in the scrutinize engine (64) and subsequently submit (270) to the verdict engine (66).

Table 5c: Information from the assemble engine and monitoring system associated using Attributes and Fieldl .

The final step to determine the wireless network performance is performed by analyzing (280) the information received from the scrutinize engine (64) by the verdict engine (66). The step (280) further comprises the steps of receiving (282) information from the scrutinize engine (64). The received information is processed (284) by embedding the information with the criterion attributes, whereby a role attribute is defined in the verdict engine according to the defined attributes. The example of role attributes defined in the criterion attributes shown as in following table 6a.

In table 6a, the role defined by the user contain a primary mapping and a data mapping. For instance, primary mapping is used as main field for data mapping; i.e. Role1 , contain Attribute6:Field3 which Date-Time referring to table 5c as primary mapping and Attribute8:Field5 which is the network strengths as Data Mapping. The purpose of Role1 is to identify the strengths of the network performance at certain date and time by comparing the network strengths between user location (10); i.e. using Attribute8 and at the Wireless AP (20); i.e. using field5.

From the role defined by the user, the verdict engine (66) will generate (286) a report as shown in table 6b. Table 6b shows the example of output for Role 1. Figure 7 illustrates an exemplary of graph of report generated on the defined of Role 1.

Table 6a: Role defined by the user in the verdict engine

Table 6b : Output of the defined Role 1

The terms “a” and “an,” as used herein, are defined as one or more than one. The term “plurality,” as used herein, is defined as two or more than two. The term “another,” as used herein, is defined as at least a second or more. The terms “including” and/or “having,” as used herein, are defined as comprising (i.e. , open language).

While this invention has been particularly shown and described with reference to the exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention as defined by the appended claims

Claims

1. A system (100) for determining wireless network performance at user location (10) comprising of: a manifesto agent (12) positioned in the user location (10) configured to collect information of wireless network strength and bandwidth performance at the user location (10); a monitoring system (50) having : a database (80) configured to store collected information by the monitoring system (50) from an access point agent (21) in a wireless access point, AP (20); and a manifesto system (60) configured to manage collected information from the manifesto agent (12) and assembled information from the monitoring system (50), characterized in that, the manifesto system (60) further comprises of: an assemble engine (62) configured to assemble information received from the manifesto agent (12); a criterion attributes module (68) having a plurality of attributes embedded with the information from the assemble engine (62), wherein the attributes is defined by a user or dynamically recommended by the system (100); and a scrutinize engine (64) configured to scrutinize the information received from the assemble engine (62), wherein the information is embedded with the criterion attributes.

2. The system (100) according to claim 1 , wherein the manifesto system (60) further comprising of a verdict engine (66) configured to analyze the information received from the scrutinize engine (64) and generate a report of the wireless network performance.

3. The system (100) according to claim 1 , wherein the scrutinize engine (64) further configured to match criteria of the criterion attributes.

4. A method (200) of determining wireless network performance at user location (10) is characterized by the steps of : collecting (220), by a manifesto agent (12), information of the wireless network performance at the user location (10); assembling (240), by an assemble engine (62), the information from the user location (10), wherein the information is embedded with a defined attributes from a criterion attributes module (68); scrutinizing (260) the information, by a scrutinize engine (64), received from the assemble engine (62); and analyzing (280) the information received from the scrutinize engine (64) by a verdict engine (66).

5. The method (200) according to claim 4, wherein the step of collecting (220), by a manifesto agent (12), information of the wireless network performance at the user location (10) further comprises the steps of: positioning (222) the manifesto agent (12) to the user location (10); establishing (224) a connection from the manifesto agent (12) to a wireless access point (20); selecting (226) a criterion attribute; collecting (228) information of network strength and bandwidth performance based on the selected attribute;

(230) the collected information to a manifesto system (60); determining successfulness of the sent information (232); and receiving an error code if the information is not successfully sent.

6. The method (200) according to claim 4, wherein the step of assembling (240), by an assemble engine (62), the information from the user location (10), wherein the information is embedded with a defined attributes from a criterion attributes module (68) further comprises the steps of: receiving (242) information from the manifesto agent (12); defining criterion attributes (244); processing the information received from the manifesto system (60) and embedded with the defining criterion attributes (246); determining if the criteria of the defined attributes and the collected information (248) is matched; sending the information to a scrutinize engine (64) if the criteria is matched (250); and reiterating step (246) if the criteria is not matched.

7. The method (200) according to claim 4, wherein the step of scrutinizing (260) the information, by a scrutinize engine (64), received from the assemble engine (62) further comprises the steps of: collecting (262) information from the manifesto system (60); collecting (264) information from a monitoring system (50); associating (266) the information received from the manifesto system (60) and the monitoring system (50); embedding (268) the criterion attributes to the associated information; and sending (270) the information to a verdict engine (66).

8. The method (200) according to claim 4, wherein the step of analyzing (280) the information received from the scrutinize engine by a verdict engine further comprises the steps of: processing (284) the information embedded with the criterion attributes, wherein a role attribute is defined in the criterion attributes; and generating (286) a report based on the role defined attributes.

9. The method (200) according to claim 7, wherein the collected information from the monitoring system (50) is an information from a wireless agent (21) in a wireless access point, AP (20).