WO2018120397A1 - Reverse file uploading method and system - Google Patents

Abstract

Disclosed are a reverse file uploading method and system. The method comprises the following steps: a sending terminal sends file information of a file to be sent to a target server; the target server performs downloading task allocation according to the file information, generates a downloading task, and sends the downloading task to a cache server; the cache server establishes a connection with the sending terminal after receiving the downloading task, downloads a corresponding file from the sending terminal according to the downloading task, and sends the downloaded file to the target server to complete uploading. The technical solution of the present invention successfully solves a file uploading problem in the cases of poor network, a cache server fault, limitations of an operator and so on, improving the file uploading efficiency.

Description

File reverse uploading method and system Technical field

The present invention relates to the field of computers, and in particular, to a file reverse upload method and system.

Background technique

In recent years, with the development of Internet technology, file transmission has been used more and more in the network, mainly divided into two categories: download files and upload files.

In the application process of uploading files, at present, the main way to upload files is that users use their sending terminals to directly upload files to the target server. However, the defects of this method include:

First, uploading is easily affected by the network environment, and in the case of poor network conditions, uploading often fails;

Second, the current volume of files is getting bigger and bigger. For example, the size of files such as general movies, materials, and game clients are basically on the order of gigabytes (GB), or even larger, which leads to uploading. Slower;

Third, because some operators will restrict uploading in reality, when the target server is inside the carrier, it will not be able to upload quickly or even upload successfully.

These shortcomings lead to the problem of uploading files directly to the target server in the prior art, which has a problem of poor upload quality and low upload speed.

Summary of the invention

In order to solve the problem of the prior art, an embodiment of the present invention provides a file reverse uploading method and system. The technical solution is as follows:

In one aspect, a file reverse upload method includes the following steps:

The sending terminal sends the file information of the file to be sent to the target server;

The target server performs a download task allocation according to the file information, and generates a download task, and sends the download task to a cache server;

After receiving the download task, the cache server establishes a connection with the sending terminal, according to The download task downloads a corresponding file from the sending terminal, and sends the downloaded file to the target server to complete the upload.

Further, the file information includes: a file size of the file to be sent and a uniform resource identifier of the file.

Further, the step that the target server performs the download task allocation according to the file information, and generates a download task, and the step of sending the download task to the cache server includes:

The target server fragments the to-be-sent file according to the number of available cache servers and the file information, and generates the download task according to the fragment.

The target server sends the download task to the cache server.

Further, the number of the cache servers is multiple, and the target server specifies to download different fragments to different cache servers.

Further, the cache server establishes a connection with the sending terminal after receiving the download task, downloads a corresponding file from the sending terminal according to the download task, and sends the downloaded file to the target server. The steps to complete the upload specifically include:

Each cache server establishes a connection with the sending terminal after receiving the respective download task;

Each cache server sends a download request to the sending terminal according to a respective download task;

Each cache server downloads a specified slice from the sending terminal according to a respective download task;

After each cache server download is completed, the specified fragment downloaded to the target server is sent to the target server to complete the upload.

Further, the method further includes the following steps:

If a connection interruption occurs during the downloading of the specified fragmentation by the cache server, the cache server re-establishes a connection with the transmitting terminal and continues to download the undownloaded portion of the specified fragment.

Further, the method further includes the following steps:

The target server receives the specified fragment downloaded from each of the plurality of cache servers;

Compose multiple specified shards into a complete file.

Further, the method further includes the following steps:

The target server monitors an operating status of multiple cache servers;

When any cache server fails, the target server sends the download task of the failed cache server to other available cache servers;

The other available cache servers re-download the specified shards according to the download task.

Another aspect is a file reverse uploading system, the system comprising a sending terminal, a target server, and a cache server, wherein

a sending terminal, configured to send file information of the file to be sent to the target server;

The target server is configured to perform a download task allocation according to the file information, and generate a download task, and send the download task to the cache server;

The cache server is configured to establish a connection with the sending terminal after receiving the download task, download a corresponding file from the sending terminal according to the download task, and send the downloaded file to the target server. To complete the upload.

Further, the file information includes: a file size of the file to be sent and a uniform resource identifier of the file.

Further, the target server includes an allocation module, where

The allocating module is configured to slice the to-be-sent file according to the number of available cache servers and the file information, generate the download task according to the fragment, and send the download task to the The cache server.

Further, the number of the cache servers is multiple, and the allocation module is further configured to download different fragments to different cache servers.

Further, the cache server includes:

a connection module, configured to establish a connection with the sending terminal after receiving a respective download task;

a downloading module, configured to send a download request to the sending terminal according to a respective download task, and download the specified fragment from the sending terminal;

The sending module is configured to send the downloaded specified fragment to the target server to complete the upload after the download is completed.

Further, the connection module is further configured to re-establish a connection with the sending terminal if a connection interruption occurs during downloading the specified fragmentation process by the downloading module;

The downloading module is further configured to continue downloading the undownloaded part of the specified fragment.

Further, the target server further includes a combination module, where

The combination module is configured to form a plurality of specified fragments into a complete file when receiving the specified fragments downloaded from the plurality of cache servers.

Further, the target server further includes a monitoring module, where the monitoring module is configured to monitor an operating status of the multiple cache servers;

The allocation module is further configured to send a download task of the failed cache server to another available cache server when any cache server fails;

The other available cache server is configured to re-download the specified fragment according to the download task.

The technical solution provided by the embodiment of the present invention has the beneficial effects that the reverse is implemented by changing the original uploading terminal to the method of downloading from the sending terminal by the cache server, and sending the downloaded file to the target server, thereby implementing the reverse Uploading, thereby avoiding the defect of directly uploading files to the target server in the prior art, and usually the network downloading speed is much faster than the uploading speed, and the device on the carrier side, such as the cache server, is less affected by downloading files from the sending terminal. The limitation of the quotient, therefore, the present invention greatly improves the speed and quality of file uploading in the network by means of this reverse uploading.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are merely the present invention. Some of the embodiments can be obtained by those of ordinary skill in the art in view of the drawings without any inventive effort.

1 is a flowchart of a method for uploading a file in reverse according to an embodiment of the present invention;

2 is a flowchart of detailed sub-steps of step S2 shown in FIG. 1 according to an embodiment of the present invention;

3 is a flowchart of detailed sub-steps of step S3 shown in FIG. 1 according to an embodiment of the present invention;

4 is a schematic diagram showing the internal structure of a file reverse uploading system 10 according to an embodiment of the present invention;

FIG. 5 is a schematic diagram showing the internal structure of a file reverse uploading system 10 according to another embodiment of the present invention.

detailed description

The embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A file reverse upload method provided by the present invention will be described in detail below.

Please refer to FIG. 1 , which is a flowchart of a method for uploading files in reverse according to an embodiment of the present invention.

In an embodiment, the file reverse uploading method is applied to a file reverse uploading system, where the file reverse uploading system includes a sending terminal, a target server, and a cache server, and each user connects to the network through a respective sending terminal. And the application for downloading files and uploading files, the sending terminal is mainly a device for the user side, for example, a user terminal device such as a mobile phone, a tablet computer, a palmtop computer, and the like. The target server and the cache server are mainly devices on the network operator side, and the file transfer between the target server and the cache server does not restrict uploading.

In step S1, the transmitting terminal transmits the file information of the file to be transmitted to the target server.

In an embodiment, the file to be sent is stored in the sending terminal of the user, and is a file for uploading to the target server, where the file information includes: a file size of the file to be sent and a uniform resource identifier of the file. Uniform Resource Identifier (URI).

In step S2, the target server performs download task allocation according to the file information, and generates a download task, and sends the download task to the cache server.

In an embodiment, the target server performs download task allocation according to the file information, and generates a download task, and the step S2 of sending the download task to the cache server specifically includes two sub-steps of S21-S22, as shown in FIG. 2 Show.

Referring to FIG. 2, a detailed sub-step flow of step S2 shown in FIG. 1 is shown in an embodiment of the present invention. Cheng Tu.

In step S21, the target server performs fragmentation according to the number of available cache servers and file information to be sent, and then generates a download task according to the fragment.

In an embodiment, if there is only one cache server, the target server does not slice the file to be sent, but processes the file as a whole; if the number of cache servers includes multiple, it will be sent according to the number. The file is fragmented. For example, if the number of cache servers includes five, the file to be sent is divided into five fragments. Of course, it can be divided into four fragments or six fragments, which is not limited herein.

In an embodiment, when the target server performs fragmentation on the file to be sent, the factor of the file information is also referred to. If the volume of the file to be sent is larger, the number of fragments is larger, if the volume of the file to be sent is larger. Smaller fragments will also be smaller. For example, a 10GB file to be sent can be divided into 50 fragments or 100 fragments. For a 100MB file to be sent, it can be divided into 2 fragments or 3 points. sheet.

In an embodiment, the specific number of fragments to be sent depends on the number of available cache servers and the file information, and then different download tasks are generated according to the result of the fragmentation. In this embodiment, the target server considers the number of fragments according to the number of available cache servers, so as to avoid the number of fragments to be sent by the sending terminal in the prior art without knowing the number of available cache servers. Too much or how much, causing slow uploads or wasted resources.

In step S22, the target server sends the download task to the cache server.

In an embodiment, if there is only one cache server, the target server sends the download task as a whole to the cache server for processing; if the number of cache servers includes multiple, the generated different download tasks are respectively sent. For different cache servers, one cache server handles at least one download task. Of course, if the network resources are sufficient, for example, the number of cache servers is sufficient, some cache servers are allowed to idle, that is, the download task is not performed.

Referring to FIG. 1 , in step S3, the cache server establishes a connection with the sending terminal after receiving the download task, downloads a corresponding file from the sending terminal according to the download task, and downloads the file to be downloaded. Send to the target server to complete the upload.

In an embodiment, if the number of cache servers is multiple, the target server pairs are different. The cache server specifies to download different shards as download tasks for each cache server. Among them, these cache servers will be placed in different places to form a distributed network. Each cache server can handle download tasks in the area as well as download tasks outside the area and cooperate with each other.

In an embodiment, the cache server establishes a connection with the sending terminal after receiving the download task, downloads a corresponding file from the sending terminal according to the download task, and sends the downloaded file to the server. The step S3 of describing the target server to complete the upload specifically includes four sub-steps of S31-S34, as shown in FIG.

Referring to FIG. 3, a detailed sub-step flow chart of step S3 shown in FIG. 1 is shown in an embodiment of the present invention.

In step S31, each cache server establishes a connection with the transmitting terminal after receiving the respective download task.

In an embodiment, after the target server fragments the file to be sent according to the number of available cache servers and file information, the fragmentation information is distributed to each cache server together with the URI of the file to be sent as a download task. After each cache server receives its own download task, it first establishes a connection with the sending terminal.

In step S32, each cache server sends a download request to the transmitting terminal according to the respective download task.

In an embodiment, after receiving the download request, the transmitting terminal transmits the requested fragment to the corresponding cache server.

In step S33, each cache server downloads the specified slice from the transmitting terminal according to the respective download task.

In an embodiment, each cache server downloads the specified fragment from the transmitting terminal according to the fragmentation information and the URI of the file to be transmitted.

In step S34, after each cache server download is completed, the downloaded specified fragment is sent to the target server to complete the upload.

In an embodiment, the file reverse upload method further includes the following steps:

The target server receives the specified shards downloaded from each of the plurality of cache servers;

Compose multiple specified shards into a complete file.

After the different cache servers finish downloading the specified shards, they will be uniformly sent to the target server for reorganization to form a complete file, which completes the process from the sending terminal to the target server. Upload file action. In this embodiment of the present invention, since the file transfer between the target server and the cache server does not restrict the uploading, the file transfer between the target server and the cache server is very smooth, and the file transfer speed is extremely fast. The quality of file transfer is guaranteed.

In an embodiment, the file reverse upload method further includes the following steps:

If a connection interruption occurs during the downloading of the specified fragmentation by the cache server, the cache server re-establishes a connection with the transmitting terminal and continues to download the undownloaded portion of the specified fragment.

Among them, the invention has the advantage of setting the number of cache servers to multiple, which can ensure the integrity and smoothness of file uploading in the network. After the target server sends different download tasks to each cache server, the current working status of each cache server is monitored in real time. If the connection interruption occurs during the process of downloading the specified fragmentation by the cache server, the cache server is re-transmitted with the sending terminal. Establish a connection and continue to download the undownloaded portion of the specified shard without having to re-download the portion that was previously downloaded.

In an embodiment, the file reverse upload method further includes the following steps:

The target server monitors the running status of multiple cache servers;

When any cache server fails, the target server sends the download task of the failed cache server to other available cache servers;

Other available cache servers re-download the specified shards based on the download task.

Wherein, the present invention has the advantage of setting the number of cache servers to multiple, which can share the pressure of file transfer in the network. For example, when any cache server fails, the target server can download the faulty cache server. Send to other available cache servers, which ensures that the file transfer pressure is not concentrated on a cache server or a few cache servers. This distributed network shares the file transfer pressure of some sites. .

The file reverse uploading method provided by the present invention realizes reverse uploading by changing the original uploading by the sending terminal to the method of downloading from the sending terminal by the cache server, and transmitting the downloaded file to the target server, thereby implementing reverse uploading. The shortcomings of directly uploading files to the target server in the prior art are avoided, and usually the network download speed is much faster than the upload speed, and the device on the carrier side, such as the cache server, is less restricted by the operator to download files from the sending terminal. Therefore, the present invention greatly improves the speed and quality of file uploading in the network by utilizing such a reverse uploading method.

A file reverse upload system provided by the present invention will be described in detail below.

Referring to FIG. 4, an internal structure of a file reverse uploading system 10 according to an embodiment of the present invention is shown. schematic diagram.

In an embodiment, the file reverse uploading system 10 includes a transmitting terminal 11, a target server 12, and a cache server 13, each of which connects to the network through a respective transmitting terminal 11, and performs an application for downloading files and uploading files, and transmitting the terminal. 11 is mainly a device for the user side, for example, a user terminal device such as a mobile phone, a tablet computer, a palmtop computer, and the like. The target server 12 and the cache server 13 are mainly devices facing the network operator side, and there is no limitation in uploading the file transfer between the target server 12 and the cache server 13.

The transmitting terminal 11 is configured to send file information of the file to be sent to the target server 12.

In an embodiment, the file to be sent is stored in the sending terminal 11 of the user, and is a file for uploading to the target server 12, wherein the file information includes: a file size of the file to be sent and a URI of the file. .

The target server 12 is configured to perform a download task allocation according to the file information, and generate a download task, and send the download task to the cache server 13.

The cache server 13 is configured to establish a connection with the sending terminal 11 after receiving the download task, download a corresponding file from the sending terminal 11 according to the download task, and send the downloaded file to the target server 12 to complete the upload.

In an embodiment, the target server 12 includes an allocation module 121, a combination module 122, and a monitoring module 123.

The distribution module 121 is configured to slice the file to be sent according to the number of available cache servers 13 and file information, generate a download task according to the fragment, and send the download task to the cache server 13.

In an embodiment, the number of the cache servers 13 is multiple. As shown in FIG. 5, the cache servers 13 are placed in different places to form a distributed network, and each cache server 13 can handle the same in the area. The download task can also handle download tasks outside the region and work together. The distribution module 121 is further configured to download different shards to different cache servers.

In an embodiment, the cache server 13 includes a connection module 131, a download module 132, and a sending module 133.

The connection module 131 is configured to establish a connection with the sending terminal 11 after receiving the respective download task.

The downloading module 132 is configured to send a download request to the transmitting terminal 11 according to the respective download task, and download the specified fragment from the transmitting terminal 11.

The sending module 133 is configured to send the downloaded specified fragment to the target server after the download is completed. 12 to complete the upload.

In an embodiment, the connection module 131 is further configured to re-establish a connection with the sending terminal 11 if a connection interruption occurs during the downloading of the specified fragmentation by the downloading module 132.

In an embodiment, the downloading module 132 is further configured to continue downloading the undownloaded portion of the specified fragment.

In an embodiment, the combining module 122 is configured to, when receiving the specified shards downloaded from the plurality of cache servers 13, form a plurality of specified shards into a complete file.

In an embodiment, the monitoring module 123 is configured to monitor the running status of one or more cache servers 13.

The distribution module 121 is further configured to send the download task of the failed cache server to another available cache server when any cache server fails. The other available cache server is configured to re-download the specified fragment according to the download task.

The file reverse uploading system 10 provided by the present invention realizes reverse upload by changing the original uploading terminal to the method of downloading from the sending terminal by the cache server, and sending the downloaded file to the target server. Further, the defect of directly uploading files to the target server in the prior art is avoided, and usually the speed of downloading the network is much faster than the uploading speed, and the device on the carrier side, such as the cache server, downloads files from the sending terminal, and is less affected by the operator. Limitation, therefore, the present invention greatly improves the speed and quality of file uploading in the network by utilizing this reverse uploading method.

The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on such understanding, the above-described technical solutions may be embodied in the form of software products in essence or in the form of software products, which may be stored in a computer readable storage medium such as ROM/RAM, magnetic Discs, optical discs, etc., include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.

The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalents, improvements, etc., which are within the spirit and scope of the present invention, should be included in the protection of the present invention. Within the scope.

Claims (16)

A file reverse upload method, characterized in that the method comprises the following steps: The sending terminal sends the file information of the file to be sent to the target server; The target server performs a download task allocation according to the file information, and generates a download task, and sends the download task to a cache server; After receiving the download task, the cache server establishes a connection with the sending terminal, downloads a corresponding file from the sending terminal according to the download task, and sends the downloaded file to the target server to complete the uploading. . The file reverse uploading method according to claim 1, wherein the file information comprises: a file size of the file to be sent and a uniform resource identifier of the file. The file reverse uploading method according to claim 2, wherein the step of the target server to perform a download task assignment according to the file information, and generate a download task, and the sending the download task to the cache server comprises: The target server fragments the to-be-sent file according to the number of available cache servers and the file information, and generates the download task according to the fragment. The target server sends the download task to the cache server. The file reverse uploading method according to claim 3, wherein the number of the cache servers is plural, and the target server specifies to download different shards to different cache servers. The file reverse uploading method according to claim 4, wherein the cache server establishes a connection with the sending terminal after receiving the downloading task, and downloads a corresponding one from the sending terminal according to the downloading task. The steps of sending the downloaded file to the target server to complete the upload include: Each cache server establishes a connection with the sending terminal after receiving the respective download task; Each cache server sends a download request to the sending terminal according to a respective download task; Each cache server downloads a specified slice from the sending terminal according to a respective download task; After each cache server download is completed, the specified fragment downloaded to the target server is sent to the target server to complete the upload. The file reverse upload method according to claim 5, wherein the method further comprises the following steps: If a connection interruption occurs during the downloading of the specified fragmentation by the cache server, the cache server re-establishes a connection with the transmitting terminal and continues to download the undownloaded portion of the specified fragment. The file reverse upload method according to claim 4 or 5, wherein the method further comprises the following steps: The target server receives the specified fragment downloaded from each of the plurality of cache servers; Compose multiple specified shards into a complete file. The file reverse upload method according to claim 4, wherein the method further comprises the following steps: The target server monitors an operating status of multiple cache servers; When any cache server fails, the target server sends the download task of the failed cache server to other available cache servers; The other available cache servers re-download the specified shards according to the download task. A file reverse uploading system, wherein the system includes a sending terminal, a target server, and a cache server, where a sending terminal, configured to send file information of the file to be sent to the target server; The target server is configured to perform a download task allocation according to the file information, and generate a download task, and send the download task to the cache server; The cache server is configured to establish a connection with the sending terminal after receiving the download task, download a corresponding file from the sending terminal according to the download task, and send the downloaded file to the target server. To complete the upload. A file reverse upload system according to claim 9, wherein said file information The file size of the file to be sent and the uniform resource identifier of the file are included. The file reverse uploading system according to claim 10, wherein said target server comprises an allocation module, wherein The allocating module is configured to slice the to-be-sent file according to the number of available cache servers and the file information, generate the download task according to the fragment, and send the download task to the The cache server. The file reverse uploading system of claim 11, wherein the number of the cache servers is plural, and the allocating module is further configured to download different shards to different cache servers. The file reverse uploading system of claim 12, wherein the cache server comprises: a connection module, configured to establish a connection with the sending terminal after receiving a respective download task; a downloading module, configured to send a download request to the sending terminal according to a respective download task, and download the specified fragment from the sending terminal; The sending module is configured to send the downloaded specified fragment to the target server to complete the upload after the download is completed. The file reverse uploading system according to claim 13, wherein the connection module is further configured to re-establish the connection with the transmitting terminal if a connection interruption occurs during the downloading of the specified fragmentation by the downloading module. connection; The downloading module is further configured to continue downloading the undownloaded part of the specified fragment. The file reverse uploading system according to claim 12 or 13, wherein the target server further comprises a combination module, wherein The combination module is configured to form a plurality of specified fragments into a complete file when receiving the specified fragments downloaded from the plurality of cache servers. The file reverse uploading system of claim 12, wherein the target server further comprises a monitoring module, wherein the monitoring module is configured to monitor an operating state of the plurality of cache servers; The allocation module is further configured to send a download task of the failed cache server to another available cache server when any cache server fails; The other available cache server is configured to re-download the specified fragment according to the download task.

Images