CN106656666A - Method and device for acquiring first screen time of web page - Google Patents

Abstract

The invention discloses a method and device for obtaining the time of the first screen of a webpage, relates to the technical field of the Internet, and can solve the problem that it is difficult to obtain the time of the first screen of a webpage if the user is unwilling to cooperate with the installation of a probe. The method for obtaining the first screen time of the webpage of the present invention includes: obtaining the corresponding traffic record in the DPI system; determining the request time and return time of the webpage file, which is determined as the loading time of the webpage file; obtaining at least one first screen page element corresponding to the webpage identifier Determine the request time and return time of the first screen page element file, and determine it as the loading time of the first screen page element file; determine the difference between the return time of the web page file and the request time of the first screen page element file as the web page analysis time ; Determine the first screen time of the web page according to the loading time of the web page file, the loading time of the element file of the first screen page, and the parsing time of the web page. The present invention is applicable to the process of obtaining the first screen time of the webpage.

Description

A method and device for obtaining the first screen time of a webpage

technical field

The invention relates to the technical field of the Internet, in particular to a method and a device for obtaining the first screen time of a web page.

Background technique

The time to first screen of a web page is a key indicator used to evaluate the quality of web page services. The time to first screen of a web page refers to the time from when a user initiates a web browsing operation to when the content of the web page is fully displayed on the screen of the user device.

At present, the method of obtaining the first screen time of a web page is to use a probe dial test, which requires the deployment of special software or hardware devices on the user side as probes, and hangs on the user's home gateway or installs it in the user's computer. If you want to collect a large amount of user data, you need to deploy a large number of probes, which requires a huge investment; in addition, because the user's web browsing operation is simulated during the dial-up test, the user's traffic needs to be occupied, which will affect the user's normal Internet access , and the costs incurred will be borne by the user, which will cause users to be unwilling to cooperate in the deployment of probes. Therefore, it will encounter great difficulties in the actual operation process to obtain a large number of users' webpage first screen time.

Contents of the invention

Embodiments of the present invention provide a method and device for obtaining the first screen time of a webpage, which can solve the problem that it is difficult to obtain the first screen time of a webpage if the user is unwilling to cooperate with installing a probe.

In order to achieve the above object, the embodiment of the present invention adopts the following technical solutions:

In a first aspect, the present invention provides a method for obtaining the first screen time of a webpage, the webpage includes a webpage file and a page element file, and the method includes:

According to the terminal access identifier and the webpage identifier, obtain the corresponding traffic record in the deep packet detection DPI system, the traffic record includes the data packets and each data packet generated when the terminal corresponding to the terminal access identifier accesses the webpage corresponding to the webpage identifier A sending time or receiving time corresponding to the data packet, the data packet includes a request data packet and a response data packet;

Determine the request time of the webpage file corresponding to the webpage identifier and the return time of the webpage file according to the traffic record, and determine the difference between the return time of the webpage file and the request time of the webpage file as the loading time of the webpage file ;

Obtaining at least one above-the-fold page element corresponding to the webpage identifier, and each of the above-the-fold page elements corresponds to a first-screen page element file;

Determine the request time of the above-the-fold page element file and the return time of the first-screen page element file according to the traffic record, and set the return time of the first-screen page element file and the request time of the first-screen page element file The difference between is determined as the loading time of the above-the-fold page element file;

Determining the difference between the return time of the webpage file and the request time of the above-the-fold page element file as the webpage parsing time;

The above-the-fold time of the webpage is determined according to the loading time of the webpage file, the loading time of the above-the-fold page element file, and the parsing time of the webpage.

In a second aspect, the present invention provides a device for obtaining the first screen time of a web page, the web page includes a web page file and a page element file, and the device includes:

An acquisition module, configured to acquire a corresponding traffic record in the deep message detection DPI system according to the terminal access identifier and the webpage identifier, where the traffic record includes that generated when the terminal corresponding to the terminal access identifier accesses the webpage corresponding to the webpage identifier The data packets and the sending time or receiving time corresponding to each of the data packets, the data packets include request data packets and response data packets;

A determination module, configured to determine the request time of the webpage file corresponding to the webpage identifier and the return time of the webpage file according to the traffic records obtained by the acquisition module, and combine the return time of the webpage file and the request time of the webpage file The time difference is determined as the loading time of the webpage file;

The acquiring module is further configured to acquire at least one first-screen page element corresponding to the webpage identifier, and each of the first-screen page elements corresponds to one first-screen page element file;

The determining module is further configured to determine the request time of the above-the-fold page element file and the return time of the first-screen page element file according to the traffic records obtained by the obtaining module, and store the first-screen page element file The difference between the return time of the first screen page element file and the request time of the first screen page element file is determined as the loading time of the first screen page element file;

The determination module is also used to determine the difference between the return time of the webpage file and the request time of the first screen page element file as the webpage resolution time;

The determining module is further configured to determine the first screen time of the web page according to the loading time of the web page file, the loading time of the first screen page element file, and the webpage parsing time.

The embodiment of the present invention provides a method and device for obtaining the first screen time of a webpage. By extracting the traffic records in the DPI system on the network side, the loading time of the webpage file, the loading time of the element file of the first screen page, and the webpage analysis are respectively obtained. Time, and then determine the first screen time of the web page according to the loading time of the web page file, the loading time of the first screen page element file, and the webpage parsing time. Compared with the prior art that deploys special software or hardware devices on the user side as probes, and hangs them on the user’s home gateway or installs them in the user’s computer, the present invention does not need to deploy probes on the user side, and does not require The traffic occupied by the user can be processed directly according to the traffic records in the DPI system on the network side, and the first screen time of the web page can be obtained conveniently, and then the quality of the Internet service can be evaluated according to the first screen time of the web page, providing operators and Internet companies with the ability to improve user perception basis.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For Those of ordinary skill in the art can also obtain other drawings based on these drawings without making creative efforts.

FIG. 1 is a flow chart of a method for obtaining the first screen time of a webpage provided by an embodiment of the present invention;

FIG. 2 is a flow chart of another method for obtaining the first screen time of a webpage provided by an embodiment of the present invention;

FIG. 3 is a structural diagram of a device for obtaining the first screen time of a web page provided by an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a terminal for obtaining the first screen time of a webpage provided by an embodiment of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

With the development of data services and refined operations, operators usually need to perform DPI (Deep Packet Inspection, deep packet inspection) on data packets flowing through the network. DPI technology is a flow detection and control technology based on the application layer. When IP (Internet Protocol, the protocol for interconnection between networks) packets, TCP (Transmission Control When the data stream passes through the bandwidth management system based on DPI technology, the system reorganizes the application layer information in the OSI (Open System Interconnection, Open System Interconnection) seven-layer protocol by deeply reading the content of the IP packet load. In this way, the content of the entire application is obtained, and then the traffic is shaped according to the management policy defined by the system, so as to form a series of traffic records conforming to the management policy. However, the embodiment of the present invention performs further analysis and processing based on the flow records obtained by the DPI system.

An embodiment of the present invention provides a method for obtaining the first screen time of a webpage, as shown in Figure 1, including:

101. Acquire corresponding traffic records in the DPI system according to the terminal access identifier and the webpage identifier.

Wherein, the flow record includes the data packets generated when the terminal corresponding to the terminal access identifier accesses the webpage corresponding to the webpage identifier and the sending time or receiving time corresponding to each data packet; the terminal access identifier may be The terminal IP address, and the webpage identifier may be an address of a webpage.

As a specific embodiment, the traffic records in the DPI system are monitored, and information such as the source IP address, source port number, destination IP address, and destination port number of each traffic record are identified, and the source IP address and the destination IP address are compared with the The terminal access identifiers in the AAA (Authentication, Authorization, and Accounting) server are associated to identify the traffic records corresponding to the terminal access identifiers. Then obtain the data flow record corresponding to the web page identifier from the flow record corresponding to the terminal access identifier.

In addition, in order to quickly find the data packets needed in the flow records, the data packets can be classified in advance. If the terminal access identifier in the data packets is the source IP, it indicates that these data packets are sent by the terminal, and the data packets are Uplink data packet; if the terminal access identifier in the data packet is the destination IP address, indicating that these data packets are sent to the terminal, the data packet is a downlink data packet.

Then filter out the data packets of HTTP (HyperText Transfer Protocol, hypertext transfer protocol), the filtering method is as follows:

1) Select the TCP data packet, because the HTTP data packet is carried by the TCP protocol.

2) Analyze the load of the TCP message, use the ASCII (American Standard Code for Information Interchange, American Standard Code for Information Interchange) code to parse the load into text, and use the carriage return and line feed ('\r\n') to parse the text Split into rows. For each line of text, use spaces to split the text into fields.

3) For the upstream data packet, the first field matches "GET", or "POST", or "DELETE", or "HEAD", or "OPTIONS", or "PUT", or "TRACE", the third field Match "HTTP/1.1" or "HTTP/1.0". If both fields match successfully, the packet is determined to be an HTTP request packet.

4) For downlink data packets, the first field matches "HTTP/1.1" or "HTTP/1.0", and the second field matches three-digit numbers, such as "200". If both fields match successfully, the data is determined The packet is an HTTP response packet.

102. Determine the webpage file request time and webpage file return time corresponding to the webpage identifier according to the traffic records, and determine the difference between the webpage return time and the webpage request time as the webpage loading time.

Generally, a web page includes a web page file and several page element files. Wherein, the web page file usually also includes a hyperlink address of a page element requiring secondary access, and the hyperlink address corresponds to the page element file. To fully present the above-the-fold content includes loading the webpage file and loading the content of the above-the-fold page elements included in the webpage file, and the loading time of the webpage file in this step only refers to the time from when the webpage file is requested to when the webpage file is loaded Time, excluding the time of loading the element file of the first screen page.

As a specific embodiment, in the traffic record obtained in step 101, the request data packet for requesting to load the webpage file is searched, and the sending time of the request data packet can be determined as the request time of the webpage file. Then search for all the response messages corresponding to the request packet. The time when all these response messages are received is the time when the webpage file is loaded, and this time can be determined as the return time of the webpage file.

Specifically, the method for determining the webpage request time includes: following the first line of the obtained request packet containing the webpage identifier, two consecutive carriage returns and line feeds ('\r\n\r\n') To analyze the text, the steps are as follows:

1) Use carriage return and line feed ('\r\n') to split the text of the request packet into lines, and use spaces to split each line of data into fields.

2) Find the first line with "GET" as the first field, and mark the content of the second field as "part1". Then, look for the line with "Host:" as the first field in the data packet, mark the content of the second field of the line as "part2", and connect the contents of "part2" and "part1" to be the requested The address of the webpage (that is, the identifier of the webpage), and the sending time corresponding to the request data packet is the webpage request time.

The method for determining the time to return the webpage specifically includes: obtaining a response data packet corresponding to the request data packet in the same TCP session as the above request data packet, and the number of the response data packets is at least one. To analyze the text below the first line of the response data packet and above two consecutive carriage returns and line feeds ('\r\n\r\n'), the steps are as follows:

1) Use carriage return and line feed ('\r\n') to split the text of the response packet into lines, and use spaces to split each line of data into fields.

2) Analyze the first response data packet (judged according to the serial number field of TCP), and find the line starting with "Content-Length:", the value behind this field is the size of the web page.

3) count the size of the response packet load corresponding to the request packet in the TCP session, when equal to the size of the requested webpage, it means that the webpage has been loaded, and the corresponding receiving time of the last response packet is the webpage return time.

In addition, if the first response data packet does not have a line starting with "Content-Length:", you can look for the line containing "Connection: close" in the response data packet, and this line of information indicates that the transmission of the web page is completed. Therefore, the receiving time corresponding to the response packet containing "Connection: close" is the webpage return time.

If there is neither a line starting with "Content-Length:" nor a line starting with "Connection: close", then look for the header of the response data packet in the TCP session, according to the URL of the header of the data packet (Uniform ResoureLocator , Uniform Resource Locator) information to judge whether it is a web page response file, when the header information is displayed as not being the web page response file, the last response data packet of the data packet is the last response data packet of the requested web page. The receiving time corresponding to the last response data packet is the return time of the web page file.

Finally, the page return time minus the page request time is the page load time.

103. Acquire at least one above-the-fold page element corresponding to the webpage identifier.

Specifically, web pages usually also contain page elements that require secondary access, such as image elements, external script elements, external cascading style sheet elements, frame elements, etc., and these page elements that require secondary access correspond to page elements The corresponding page element file in the server, and the first screen page element refers to the page element that is displayed on the first screen page of the terminal and needs to be accessed twice.

As a specific embodiment, since the page elements requiring secondary access have a specific format, the page elements requiring secondary access are identified from the request data packet according to the specific format. For example: the html (HyperText Markup Language, Hypertext Markup Language) format corresponding to the image type page element is <img src="image.jpg"/>, where src represents the included image file; the format of the external script element is <script scr="behavior.js"></script>, where src means the script file; the format of the external cascading style sheet element is <linkrel="stylesheet", href="style.css"/>, where href means Cascading style sheet file; the format of the frame element is <iframe src="frame.htm"></iframe>, where src represents the page file within the frame.

Due to the different size of the terminal screen and the user's setting of the page zoom ratio, the page size displayed on the first screen of the terminal will be different for the same web page, and the number of page elements displayed on the first screen will also be different. When the first-screen time of a web page requires high precision, it is necessary to accurately obtain the first-screen page elements for specific situations.

The user can also set the common screen size of a terminal, and the first screen page elements that can be displayed on the page with the usual page scaling ratio as a reference. When the accuracy of obtaining the first screen time of the web page is not high, you can directly use the reference Above the fold page elements.

Finally, the identification of the above-the-fold page element is obtained from the webpage file, and is used to find the above-the-fold page element file corresponding to the above-the-fold page element.

104. Determine the request time of the above-the-fold page element file and the return time of the first-screen page element file according to the traffic record, and set the return time of the first-screen page element file and the first-screen page element file The difference between the request times is determined as the loading time of the above-the-fold page element file.

Wherein, the loading time of the first-screen page element file refers to the time from the request for the first loaded first-screen page element file to the end of the last loaded first-screen page element file.

In the traffic record obtained in step 101, search for the request data packet corresponding to the identifier for requesting to load the first screen element of the first screen page, and the sending time of the request data packet can be determined as the request time of the file of the first screen page element file.

Search for the request packet used to load the last first-screen page element, and then search for all response packets corresponding to the request packet. The time when all these response packets are received can be determined as the return time of the first-screen page element.

For a specific method of determining the request time and return time, reference may be made to step 102, which will not be repeated here.

Finally, the return time of the element file of the first screen page minus the request time of the element file of the first screen page is the loading time of the element file of the first screen page.

105. Determine the difference between the return time of the webpage file and the request time of the above-the-fold page element file as the webpage parsing time.

Specifically, the webpage loading process includes: the terminal requests to load the webpage file, and the webpage server sends the webpage file in response to the request. The terminal receives the webpage file, and after receiving it, the terminal starts to analyze the content of the webpage file, obtains the first-screen page element file that needs to be accessed twice, and then requests to load the first-screen page element file. Wherein, the webpage parsing time refers to the time between the completion of returning the webpage and the start of requesting the first screen page element file, which is the webpage parsing time.

106. Determine the above-the-fold time of the webpage according to the webpage loading time, the loading time of the above-the-fold page elements, and the webpage parsing time.

As a specific embodiment, adding the webpage loading time, the loading time of the page elements on the first screen and the webpage parsing time can obtain the first screen time of the same webpage accessed by the same terminal.

A method for obtaining the first screen time of a webpage provided by an embodiment of the present invention obtains the loading time of the webpage file, the loading time of the first screen page element file, and the webpage parsing time respectively by extracting the traffic records in the DPI system on the network side, The first screen time of the web page is then determined according to the loading time of the web page file, the loading time of the element file of the first screen page, and the parsing time of the web page. Compared with the prior art that deploys special software or hardware devices on the user side as probes, and hangs them on the user’s home gateway or installs them in the user’s computer, the present invention does not need to deploy probes on the user side, and does not require The traffic occupied by the user can be processed directly according to the traffic records in the DPI system on the network side, and the first screen time of the web page can be obtained conveniently, and then the quality of the Internet service can be evaluated according to the first screen time of the web page, providing operators and Internet companies with the ability to improve user perception basis.

Further, as a refinement and extension of the method shown in Figure 1, the embodiment of the present invention also provides a method for obtaining the time of the first screen of a webpage, as shown in Figure 2, after step 106, the method further includes:

107. When the above-the-fold time of the webpage acquired in step 106 is greater than the preset threshold, determine the average loading time of the webpage file, the average loading time of the above-the-fold page element file, and the average parsing time of the webpage when the terminal accesses the webpage.

Wherein, the preset threshold may be determined as an average value of the first screen time of the webpage when the same terminal visits the same website for multiple times. The selection of the preset threshold can also be determined according to the user's requirement on the first screen time of the webpage, and the specific determination standard is not limited here.

As a specific embodiment, when the terminal accesses the webpage multiple times, it first determines the loading time of each webpage file, and then averages the loading times of these webpage files, and the average value is determined as the average loading time of the webpage file.

The average loading time of the element file of the first screen page and the average parsing time of the web page are determined in a similar manner, and details are not repeated here.

108. Comparing the loading time of the webpage file with the loading time of the average webpage file, the loading time of the above-the-fold page element file and the average loading time of the above-the-fold page element file, and the webpage parsing time and the The average parse time for the above pages.

As a specific embodiment, the difference between the loading time of the webpage file determined in step 102 and the loading time of the average webpage file is calculated, and the loading time of the first screen page element file determined in step 104 and the time difference of the first screen page element file are calculated. For the difference of average loading time, calculate the difference between the parsing time of the webpage determined in step 105 and the average parsing time of the webpage, and compare the relative sizes of the three differences.

109. Determine factors that affect the above-the-fold time of the webpage according to the comparison result.

As a specific embodiment, when the time to the first screen of the web page determined in step 106 is greater than the preset threshold, it indicates that the time to the first screen of the web page is too long, and factors affecting the time to the first screen of the web page need to be analyzed and determined. The difference between the three parameters determined in step 108 (the difference between the loading time of the webpage file and the average loading time of the webpage file, the difference between the loading time of the first screen page element file and the average loading time of the first screen page element file, The greater the difference between the web page parsing time and the web page average parsing time), the greater the impact on the first screen time of the web page. According to the relative size of the difference, the bottleneck factor of the first screen time of the web page can be located.

A method for obtaining the first screen time of a webpage provided by an embodiment of the present invention obtains the average loading time of webpage files, the average loading time of the first screen page element files, and the The average resolution time, and then determine the bottleneck factor of the first screen time of the web page. Compared with the prior art, which only obtains the first screen time of a single webpage accessed by a single terminal, the present invention directly calculates the three actual calculated parameters based on the traffic records in the DPI system on the network side. The difference between the average value and the factors that affect the first screen time of the webpage and the degree of influence are located, providing operators and Internet companies with a basis to improve user perception.

In addition, in order to more accurately obtain the bottleneck factors that affect the first screen time of the webpage, and provide a basis for improving the first screen time of the webpage, the embodiment of the present invention also provides another method for obtaining the average value of the three parameters, as follows:

Another specific method for obtaining the loading time of the average web page file is as follows:

It should be noted that when the same terminal requests to access the same web page, the web page files may be stored on multiple URL servers in different locations. The URL servers of different URLs may also be different, and when different URL servers respond, the corresponding webpage loading time is different, so it is necessary to calculate the corresponding webpage loading time for different URL servers.

As a specific embodiment, in the request packet obtained in step 101, at first, search for the line with "Host:" as the first field, and the second field of the line is the IP address of the web server or the corresponding IP address of the web page. The domain name, if it is the domain name corresponding to the webpage, can be determined as the IP address of the webpage server through the destination IP address of the request data packet.

Then, when the same terminal accesses the same website and the same webpage server responds, the webpage request time and webpage return time of each time are determined, and then the webpage loading time of each time is determined. The average loading time of these webpages is then calculated to reflect the corresponding average loading time when the webpage server responds.

Finally, obtain the corresponding average loading time of different webpage servers according to this method, and create a list of IP addresses of webpage servers and their corresponding average webpage loading times. The average loading time of a web page, its numerical value can reflect the different influences of different URL servers on the first screen time of the web page, it can not only accurately determine the bottleneck factors that affect the first screen time of the web page, but also be accurate to the URL server that responds specifically. Provide improvement directions and basis for improving bottleneck factors.

Another specific method for obtaining the average loading time of the first screen page element file is as follows:

It should be noted that when the same terminal requests to access the same first-screen page element of the same web page, the file of the first-screen page element may be stored on the page element server in a different location, due to factors such as the geographical location of the terminal and the transmission network. Influence, each page element server that responds to the request of the terminal may also be different, and when different page element servers respond, the corresponding loading time of the corresponding page element is different, so it is necessary to calculate the loading of the corresponding page element for different page element servers time.

As a specific embodiment, in the request data packet obtained in step 101, first, look for the line with "Host:" as the first field, and the second field of the line is the IP address of the page element server or the page element The corresponding domain name, if it is the domain name corresponding to the page element, can be determined as the IP address of the page element server through the destination IP address of the request data packet.

Then, when the same terminal accesses the same URL and the same page element server responds, the request time and return time of each page element are determined, and then the loading time of each page element is determined. Then, the average loading time of these page element servers is calculated to reflect the average loading time of the corresponding first screen page elements when the first screen page element server responds.

Finally, according to this method, obtain the average loading time of different first-screen page element servers respectively, and establish a list of the IP address of the first-screen page element server and the average loading time of the corresponding first-screen page element files, through the list It can reflect the average loading time of different above-the-fold page element servers responding to the same terminal accessing the same above-the-fold page element. The bottleneck factor of the first screen time of the webpage, and the server of the first screen page element that is accurate to the specific response, can also provide the improvement direction and basis for improving the bottleneck factor.

Another specific method for obtaining the average parsing time of a web page is as follows:

The average parsing time of a web page needs to be explained that when the same terminal requests to access the same web page, due to the difference in user agent information corresponding to the User-Agent field of the terminal, the user agent information includes hardware type, hardware configuration, and software version, etc. The parse time for will also vary.

As a specific embodiment, firstly, in the request data packet obtained in step 101, search for the line with "User-Agent:" as the first field, and the content information of the second field is User-Agent information.

Then, when the same terminal accesses the same URL and the corresponding User-Agent information of the terminal is the same, determine the webpage resolution time for each visit, and then calculate the average of the webpage resolution time, which reflects the average resolution time corresponding to the User-Agent information .

The average parsing time of the webpage The average parsing time of the webpage Finally, according to this method, the average parsing time of webpages corresponding to different User-Agents is respectively obtained, and a list of the average parsing time of webpages corresponding to User-Agent information is established, which can reflect The average time for different User-Agents to parse the same URL file. The size of the value can reflect the impact of different User-Agent fields on the first screen time of the webpage. It can accurately determine the bottleneck factors that affect the first screen time of the webpage, and it is accurate to the specific The User-Agent information of the terminal can also provide improvement directions and basis for improving bottleneck factors.

In addition, based on the method of obtaining the average value of the three parameters, the following method can also be used to obtain the average value of the first screen time of the webpage:

Obtain the minimum value among the average loading time of multiple web pages, the average loading time of multiple above-the-fold page elements, and the average parsing time of multiple web pages above, according to the formula Calculate the optimal first screen time of the webpage. Get the maximum value of the average parsing time of the webpage, according to the formula Calculate the worst web page first screen time.

The situation of the web page quality can be evaluated according to the position of the first screen time of the web page determined in step 106 between the optimal web page first screen time and the worst web page first screen time, or according to the optimal web page first screen time and the worst web page first screen time. The average first screen time of the web page is used to determine the average web page first screen time. The average web page first screen time can be used as the preset threshold. It should be noted that this is only an example of the preset threshold. The specific preset threshold is set here No limit.

The embodiment of the present invention also provides a device 30 for obtaining the first screen time of a web page. As shown in FIG. 3 , the web page includes a web page file and a page element file, and the device includes:

An acquisition module 31, configured to acquire a corresponding traffic record in the deep packet detection DPI system according to the terminal access identifier and the webpage identifier, where the traffic record includes when the terminal corresponding to the terminal access identifier accesses the webpage corresponding to the webpage identifier The generated data packets and the sending time or receiving time corresponding to each of the data packets, the data packets include request data packets and response data packets.

A determining module 32, configured to determine the request time of the webpage file corresponding to the webpage identifier and the return time of the webpage file according to the flow record obtained by the acquisition module 31, and combine the return time of the webpage file and the return time of the webpage file The difference in request time is determined as the loading time of the web page file.

The acquiring module 31 is further configured to acquire at least one first-screen page element corresponding to the webpage identifier, and each of the first-screen page elements corresponds to one first-screen page element file.

The determination module 32 is further configured to determine the request time of the first screen page element file and the return time of the first screen page element file according to the traffic records obtained by the acquisition module 31, and convert the first screen page The difference between the return time of the element file and the request time of the element file of the first screen page is determined as the loading time of the element file of the first screen page.

The determination module 32 is further configured to determine the difference between the return time of the webpage file and the request time of the first screen element file as the webpage parsing time.

The determination module 32 is further configured to determine the time of the first screen of the web page according to the loading time of the web page file, the loading time of the element file of the first screen page, and the parsing time of the web page.

Further, the determining module 32 is also configured to determine the sending time corresponding to the request packet containing the webpage identifier and used to request loading of the webpage file as the request time of the webpage file; Identify and be used to request at least one response data packet corresponding to the request data packet to load the webpage file; determine the receiving time corresponding to the last received response data packet in the at least one response data packet It is the return time of the webpage file.

The determining module 32 is also used to determine that the sending time corresponding to the request data packet for requesting to load the first first screen page element file is the request time of the first screen page element file; Loading at least one of the response data packets corresponding to the request data packet of the last above-the-fold page element file; determining the receiving time corresponding to the last received response data packet in the at least one of the response data packets It is the return time of the above-the-fold page element file.

The determining module 32 is further configured to determine the sum of the loading time of the webpage file, the loading time of the first screen page element file, and the webpage parsing time as the first screen time of the webpage.

The determination module 32 is also used to determine the average loading time of the webpage files of the terminal accessing the webpage, the average loading time of the first screen page element files, and the Average parsing time; comparing the loading time of the webpage file with the average loading time of the webpage file, the loading time of the first-screen page element file and the average loading time of the first-screen page element file, and the webpage parsing time and the average parsing time of the webpage; and determine the factors that affect the above-the-fold time of the webpage according to the comparison result.

A device for obtaining the first screen time of a web page provided by an embodiment of the present invention obtains the loading time of the web page file, the loading time of the first screen page element file, and the webpage parsing time respectively by extracting the traffic records in the DPI system on the network side, The first screen time of the web page is then determined according to the loading time of the web page file, the loading time of the element file of the first screen page, and the parsing time of the web page. Compared with the prior art that deploys special software or hardware devices on the user side as probes, and hangs them on the user’s home gateway or installs them in the user’s computer, the present invention does not need to deploy probes on the user side, and does not require The traffic occupied by the user can be processed directly according to the traffic records in the DPI system on the network side, and the first screen time of the web page can be obtained conveniently, and then the quality of the Internet service can be evaluated according to the first screen time of the web page, providing operators and Internet companies with the ability to improve user perception basis.

As shown in FIG. 4 , an embodiment of the present invention provides a terminal for acquiring the first screen time of a web page, including: a processor 401, a memory 402, a transceiver 403, and a bus 404, and the processor 401, the memory 402, and the transceiver 403 pass The buses 404 communicate with each other. Wherein, the memory 402 is used to store a plurality of instructions to realize the dialing method provided by the present invention, and the processor 401 executes the plurality of instructions to realize the acquisition of the deep message detection DPI system according to the terminal access identifier and the webpage identifier. Corresponding flow records, the flow records include the data packets generated when the terminal corresponding to the terminal access identifier accesses the webpage corresponding to the webpage identifier and the sending time or receiving time corresponding to each data packet, the data The packet includes a request data packet and a response data packet; determine the request time of the webpage file corresponding to the webpage identifier and the return time of the webpage file according to the traffic record, and set the return time of the webpage file and the request time of the webpage file The difference is determined as the loading time of the webpage file; obtain at least one first-screen page element corresponding to the webpage identifier, each of the first-screen page elements corresponds to one first-screen page element file; determine the first-screen page element file according to the traffic record The request time of the screen page element file and the return time of the first screen page element file, the difference between the return time of the first screen page element file and the request time of the first screen page element file is determined as the first screen The loading time of the page element file; the difference between the return time of the web page file and the request time of the first screen page element file is determined as the web page resolution time; according to the loading time of the web page file, the first screen page element The loading time of the file and the parsing time of the webpage determine the above-the-fold time of the webpage.

Further, the processor 401 is further configured to determine the sending time corresponding to the request packet containing the webpage identifier and used to request loading of the webpage file as the request time of the webpage file; and at least one response packet corresponding to the request packet for requesting loading of the webpage file; determining the receiving time corresponding to the last received response packet in the at least one response packet as The return time of the web page file.

Further, the processor 401 is also configured to determine that the sending time corresponding to the request data packet for requesting to load the first first screen page element file is the request time of the first screen page element file; At least one of the response data packets corresponding to the request data packet requesting to load the last first screen page element file; The time is determined as the return time of the above-the-fold page element file.

Further, the processor 401 is further configured to determine the sum of the loading time of the webpage file, the loading time of the above-the-fold page element file, and the webpage parsing time as the first-screen time of the webpage.

Further, the processor 401 is further configured to determine the average loading time of the webpage file of the terminal accessing the webpage, the average loading time of the first screen page element file and The average parsing time of the webpage; comparing the loading time of the webpage file with the average loading time of the webpage file, the loading time of the first screen page element file and the average loading time of the first screen page element file and the webpage Parsing time and the average parsing time of the webpage; determining the factors affecting the above-the-fold time of the webpage according to the comparison result.

Wherein, the processor 401 in this embodiment of the present invention may be one processor, or may be a general term for multiple processing elements. For example, the processor 401 may be a central processing unit (Central Processing Unit, referred to as CPU), or a specific integrated circuit (Application Specific Integrated Circuit, referred to as ASIC), or configured to implement one or more of the embodiments of the present invention. An integrated circuit, for example: one or more microprocessors (digitalsignal processor, DSP for short), or one or more field programmable gate arrays (Field Programmable Gate Array, FPGA for short).

The memory 402 may be a storage device, or a general term for multiple storage elements, and is used to store executable program codes and the like. And the memory 402 may include random access memory (RAM), and may also include non-volatile memory (non-volatile memory), such as disk memory, flash memory (Flash), and the like.

The bus 404 may be an Industry Standard Architecture (Industry Standard Architecture, ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (Extended Industry Standard Architecture, EISA) bus, etc. The bus 404 can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 4 , but it does not mean that there is only one bus or one type of bus.

Each embodiment in this specification is described in a progressive manner, the same and similar parts of each embodiment can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, as for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for relevant parts, please refer to part of the description of the method embodiment.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented through computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. During execution, it may include the processes of the embodiments of the above-mentioned methods. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM) and the like.

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. All should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Claims (10)

1. A method for obtaining the first screen time of a webpage, characterized in that, the webpage comprises a webpage file and a page element file, and the method comprises: According to the terminal access identifier and the webpage identifier, obtain the corresponding traffic record in the deep packet detection DPI system, the traffic record includes the data packets and each data packet generated when the terminal corresponding to the terminal access identifier accesses the webpage corresponding to the webpage identifier A sending time or receiving time corresponding to the data packet, the data packet includes a request data packet and a response data packet; Determine the request time of the webpage file corresponding to the webpage identifier and the return time of the webpage file according to the traffic record, and determine the difference between the return time of the webpage file and the request time of the webpage file as the loading time of the webpage file ; Obtaining at least one above-the-fold page element corresponding to the webpage identifier, and each of the above-the-fold page elements corresponds to a first-screen page element file; Determine the request time of the above-the-fold page element file and the return time of the first-screen page element file according to the traffic record, and set the return time of the first-screen page element file and the request time of the first-screen page element file The difference between is determined as the loading time of the above-the-fold page element file; Determining the difference between the return time of the webpage file and the request time of the above-the-fold page element file as the webpage parsing time; The above-the-fold time of the webpage is determined according to the loading time of the webpage file, the loading time of the above-the-fold page element file, and the parsing time of the webpage. 2. The method according to claim 1, wherein said determining the request time of the webpage file corresponding to the webpage identifier and the return time of the webpage file according to the traffic record comprises: Determining the sending time corresponding to the request packet containing the webpage identifier and used to request loading of the webpage file as the request time of the webpage file; Find at least one response packet corresponding to the request packet containing the webpage identifier and used to request loading of the webpage file; Determining the receiving time corresponding to the last received response data packet in the at least one response data packet as the return time of the webpage file. 3. The method according to claim 2, wherein the determining the request time of the first screen page element file and the return time of the first screen page element file according to the traffic record comprises: Determining that the sending time corresponding to the request data packet for requesting to load the first above-the-fold page element file is the request time of the above-the-fold page element file; Find at least one response packet corresponding to the request packet for requesting to load the last above-the-fold page element file; Determining the receiving time corresponding to the last received response data packet in the at least one response data packet as the return time of the first screen page element file. 4. The method according to claim 1, wherein the first screen of the webpage is determined according to the loading time of the webpage file, the loading time of the element file of the first screen page and the analysis time of the webpage Time includes: The sum of the loading time of the webpage file, the loading time of the first screen page element file and the webpage parsing time is determined as the first screen time of the webpage. 5. The method according to claim 1, further comprising: When the above-the-fold time of the webpage is greater than the preset threshold, determine the average loading time of the webpage file of the terminal accessing the webpage, the average loading time of the first-screen page element file and the average parsing time of the webpage; Comparing the loading time of the webpage file with the average loading time of the webpage file, the loading time of the first screen page element file and the average loading time of the first screen page element file, and the webpage parsing time and the webpage The average resolution time of ; Factors affecting the above-the-fold time of the webpage are determined according to the comparison result. 6. A device for obtaining the first screen time of a webpage, wherein the webpage includes a webpage file and a page element file, and the device includes: An acquisition module, configured to acquire a corresponding traffic record in the deep message detection DPI system according to the terminal access identifier and the webpage identifier, where the traffic record includes that generated when the terminal corresponding to the terminal access identifier accesses the webpage corresponding to the webpage identifier The data packets and the sending time or receiving time corresponding to each of the data packets, the data packets include request data packets and response data packets; A determination module, configured to determine the request time of the webpage file corresponding to the webpage identifier and the return time of the webpage file according to the traffic records obtained by the acquisition module, and combine the return time of the webpage file and the request time of the webpage file The time difference is determined as the loading time of the webpage file; The acquiring module is further configured to acquire at least one first-screen page element corresponding to the webpage identifier, and each of the first-screen page elements corresponds to one first-screen page element file; The determining module is further configured to determine the request time of the above-the-fold page element file and the return time of the first-screen page element file according to the traffic records obtained by the obtaining module, and store the first-screen page element file The difference between the return time of the first screen page element file and the request time of the first screen page element file is determined as the loading time of the first screen page element file; The determination module is also used to determine the difference between the return time of the webpage file and the request time of the first screen page element file as the webpage resolution time; The determining module is further configured to determine the first screen time of the web page according to the loading time of the web page file, the loading time of the first screen page element file, and the webpage parsing time. 7. The device according to claim 6, wherein the determining module is further configured to determine the sending time corresponding to the request packet containing the webpage identifier and used to request loading of the webpage file as the The request time of the web page file; Find at least one response packet corresponding to the request packet containing the webpage identifier and used to request loading of the webpage file; Determining the receiving time corresponding to the last received response data packet in the at least one response data packet as the return time of the webpage file. 8. The device according to claim 7, wherein the determining module is further configured to determine that the sending time corresponding to the request data packet for requesting to load the first first screen page element file is the Describe the request time for the first screen page element file; Find at least one response packet corresponding to the request packet for requesting to load the last above-the-fold page element file; Determining the receiving time corresponding to the last received response data packet in the at least one response data packet as the return time of the first screen page element file. 9. The device according to claim 6, wherein the determining module is further configured to combine the loading time of the webpage file, the loading time of the first screen page element file, and the sum of the webpage parsing time The value is determined as the time above the fold of the web page in question. 10. The device according to claim 6, wherein the determination module is further configured to determine the average loading of the webpage files of the webpage accessed by the terminal when the first screen time of the webpage is greater than a preset threshold time, the average loading time of the above-the-fold page element files, and the average parsing time of the web page; Comparing the loading time of the webpage file with the average loading time of the webpage file, the loading time of the first screen page element file and the average loading time of the first screen page element file, and the webpage parsing time and the webpage The average resolution time of ; Factors affecting the above-the-fold time of the webpage are determined according to the comparison result.