[go: up one dir, main page]

WO2018113789A1 - Data processing method and apparatus - Google Patents

Data processing method and apparatus Download PDF

Info

Publication number
WO2018113789A1
WO2018113789A1 PCT/CN2017/118113 CN2017118113W WO2018113789A1 WO 2018113789 A1 WO2018113789 A1 WO 2018113789A1 CN 2017118113 W CN2017118113 W CN 2017118113W WO 2018113789 A1 WO2018113789 A1 WO 2018113789A1
Authority
WO
WIPO (PCT)
Prior art keywords
big data
data
transaction center
center unit
interconnection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/118113
Other languages
French (fr)
Chinese (zh)
Inventor
王东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Publication of WO2018113789A1 publication Critical patent/WO2018113789A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/148File search processing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems

Definitions

  • the present application relates to the field of data processing, such as a data processing method and apparatus.
  • big data has become a hotspot of technology in the industry. Especially with the deployment of cloud computing services, big data is expected to be its most important business application.
  • the main characteristics of big data are the large volume, the variety of Variety, the speed of Velocity and the high value of Value, accompanied by multi-source, heterogeneous and massive data features.
  • the types of data involved in big data include types such as Structured, Semi-Structured, and Un-Structured.
  • the data objects involved in big data include text, voice, video, image, web page, sensor data, etc. Accordingly, this also requires that the big data transaction system can specifically distinguish and process the data bearing format corresponding to different data objects. For example, text files, audio files, adaptation files, image files, web files, sensor data files, and corresponding real-time/quasi-live streaming media data.
  • Embodiments of the present disclosure provide a data processing method and apparatus, thereby implementing openness, interconnectivity, and sharing of a big data transaction center.
  • an embodiment of the present disclosure provides a data processing method, applicable to a first big data transaction center unit, including: receiving a first data request message from a big data demander unit, where the first data request message And a data requesting to deliver the first attribute, where the first big data transaction center unit is a subscription server of the big data demander unit; and in response to the first data request message, locally searching for whether the first Data of the attribute; in response to the absence of the first attribute data, transmitting a second data request message to a second large data transaction center unit interconnected with the first big data transaction center unit, wherein the second data request a message for requesting return of data of the first attribute; receiving data of the first attribute from the second big data transaction center unit, and transmitting data of the first attribute to the big data demander unit.
  • an embodiment of the present disclosure provides a data processing apparatus, which is applied to a first big data transaction center unit, including: an interconnection data transaction module and an interconnection data module, wherein the interconnection data transaction module is configured to receive from a large a first data request message of the data requestor unit, and the data of the first attribute is sent to the big data demander unit, wherein the first data request message is used to request to deliver data of the first attribute,
  • the first big data transaction center unit is a subscription server of the big data demander unit; the interconnection data module is configured to locally search for data of the first attribute in response to the first data request message; And if the data of the first attribute does not exist, sending a second data request message to the second big data transaction center unit interconnected with the first big data transaction center unit through the interconnected data interface, and receiving from the interconnected data interface Data of the first attribute of the second big data transaction center unit; wherein the second data The request message is for requesting to return data of the first attribute.
  • an embodiment of the present disclosure further provides a computer readable storage medium storing computer executable instructions configured to perform the above method.
  • Embodiments of the present disclosure provide a data processing method, apparatus, and computer readable storage medium.
  • the big data demand side unit may not exist locally.
  • the target data is needed, the target data is obtained through other interconnected big data transaction center units, and the target data is received and sent to the big data demander unit.
  • the integration and sharing of the data resources of each big data transaction center unit is realized, and the data utilization rate is improved, so that the big data demand side unit can acquire the target data in time and efficiently without traversing all the data transaction center units.
  • 1-1 is a schematic structural diagram of a big data transaction center interconnection system in an embodiment of the present disclosure.
  • 1-2 is a schematic structural diagram of a big data transaction center interconnection unit in an embodiment of the present disclosure.
  • 1-3 are schematic diagrams showing the connection of a big data transaction center interconnection unit in the embodiment of the present disclosure.
  • 2-1 is a schematic diagram of a first flow of a data processing method in an embodiment of the present disclosure.
  • 2-2 is a second schematic flowchart of a data processing method in an embodiment of the present disclosure.
  • FIG. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present disclosure.
  • the big data transaction center interconnection system 100 may include: a big data provider unit 101, a big data transaction center interconnection unit 102, and a big data demand side unit 103.
  • the big data transaction center interconnection unit is composed of at least two big data transaction center units interconnected.
  • the big data transaction center interconnection unit 102 may include a big data transaction center unit 102a, big data.
  • a big data provider unit configured to collect data from a data source and import the data into a big data transaction center interconnection unit; a big data transaction center interconnection unit configured to import data from a big data provider unit and to trade according to big data
  • each big data transaction center unit in the big data transaction center interconnection unit may include: an interconnection data transaction module, an interconnection data module, an interconnection control module, an interconnection security module, and an interconnection management module.
  • the interconnected data transaction module is configured to implement data transactions between the big data transaction center interconnection unit and the big data demand side unit, and can transmit the required target data to the big data demand side unit; the interconnected data module is configured to implement Data integration, sharing, processing, storage, distribution, etc.
  • the interconnection control module is configured to control the establishment and disconnection of interconnections between the various big data transaction center units
  • the interconnection security module is configured to When each big data transaction center unit is connected, perform security authentication, access control, and data copyright management authentication to ensure the security of interconnection between big data transaction center units to achieve security protection between data sharing; interconnection management The module is configured to realize the management and maintenance of the interconnection between the various big data transaction center units, and also realize the management of data connection, supervisory connection, secure connection, transaction connection and other functions on the basis of the interconnection connection.
  • FIG. 1-2 is a schematic structural diagram of a big data transaction center interconnection unit in an embodiment of the present disclosure.
  • the big data transaction center interconnection unit includes three big data transaction center units, and the big data transaction center unit 102a includes: an interconnection data transaction module 1021a, an interconnection data module 1022a, an interconnection control module 1023a, and an interconnection security module.
  • big data transaction center unit 102b includes: interconnection data transaction module 1021b, interconnection data module 1022b, interconnection control module 1023b, interconnection security module 1024b, interconnection management module 1025b, and interconnection information supervision The module 1026b;
  • the big data transaction center unit 102c includes: an interconnection data transaction module 1021c, an interconnection data module 1022c, an interconnection control module 1023c, an interconnection security module 1024c, an interconnection management module 1025c, and an interconnection information supervision module 1026c.
  • the big data transaction center interconnection unit 102 further includes an interconnection data transaction interface 1041, an interconnection data interface 1042, an interconnection control interface 1043, an interconnection security interface 1044, and interconnection management.
  • the interconnection data transaction interface is configured to connect the respective interconnection data transaction modules to each other and to the big data demand side unit; the interconnection data interface is configured to connect the respective interconnection data modules; the interconnection control interface is configured to connect the respective interconnection control modules; and the interconnection security interface It is configured to connect to each interconnected security module; the interconnect management interface is configured to connect to each interconnected management module.
  • FIG. 2-1 is a schematic diagram of a first flow of a data processing method in an embodiment of the present disclosure. Referring to Figure 2-1, the method includes the steps described below.
  • step S201 the big data demander unit sends a first data request message to the first big data transaction center unit.
  • the first data request message is used to request the data of the first attribute, and the first big data transaction center unit is a contract server of the data demand side.
  • the big data demander unit requests the data service from the contracted big data transaction center unit to obtain the data of the first attribute, for example, a text file with a .doc format, a GIF format image, an MP3 format audio file, and the like.
  • the embodiment of the present disclosure does not specifically limit the actual requirements of the big data demand side unit.
  • step S202 the first big data transaction center unit locally searches for data of the first attribute in response to the first data request message.
  • the first big data transaction center unit searches for the data of the first attribute locally, and if it is determined that the data of the first attribute exists locally, the data request unit can be Sending the data of the first attribute, if it is determined that the data of the first attribute does not exist locally, the data of the first attribute may be requested from other interconnected big data transaction center units.
  • step S203 if the data of the first attribute does not exist, the first big data transaction center unit sends a second data request message to the second big data transaction center unit interconnected with the first big data transaction center unit.
  • the second data request message is used to request to return data of the first attribute.
  • step S203 may include: the first big data transaction center unit determines, according to the pre-stored data service catalog, the second big data transaction center unit corresponding to the data of the first attribute; and the second big data transaction The central unit sends a second data request message.
  • a data service directory of each big data transaction center unit interconnected with it is stored in each big data transaction center unit.
  • the first big data transaction center unit can determine which big data transaction center unit stores the data of the first attribute, and then send the second data request to the big data transaction center unit, that is, the second Big data trading center unit.
  • the data processing method further includes: the first big data transaction center unit is the second The big data transaction center unit transmits the data service directory of the first big data transaction center unit, and receives the data service directory from the second big data transaction center unit; and stores the data service directory of the second largest data transaction center unit.
  • step S204 the second big data transaction center unit transmits the data of the first attribute to the first big data transaction center unit in response to the second data request message.
  • the second big data transaction center unit After receiving the second data request message, acquires the data of the first attribute locally, and sends the data of the first attribute to the first big data transaction center unit.
  • step S205 the first big data transaction center unit transmits the data of the first attribute to the big data demander unit.
  • the first big data transaction center unit may send the data of the first attribute to the big data demander unit.
  • an interconnection connection may be established between the big data transaction center units.
  • the foregoing method may further include According to the preset interconnection strategy, the first big data transaction center unit and the second big data transaction center unit establish an interconnection connection.
  • the first big data transaction center unit can establish an interconnection connection with the second largest data transaction center unit according to the configuration of the administrator.
  • a big data transaction center unit can establish an interconnection with at least one other big data transaction center unit.
  • the first big data transaction center unit can establish an interconnection connection with other big data transaction center units in an active manner, or can establish an interconnection connection with other big data transaction center units in a passive manner.
  • the present disclosure The embodiment is not specifically limited.
  • FIG. 2-2 is a second schematic flowchart of a data processing method in an embodiment of the present disclosure. Referring to Figure 2-2, the following explains in detail how the first big data transaction center unit uses the active mode and the passive mode to establish the interconnection.
  • the first big data transaction center unit can initiate an interconnection with the second largest data transaction center unit. Then, the method may further include: the first big data transaction center unit sends a second interconnection request message to the second big data transaction center unit according to the interconnection policy, where the second interconnection request message carries the first big data transaction center unit An identity identifier for indicating a second big data transaction center unit for identity authentication and access control; then, the first big data transaction center unit receives a second internet response message from the second big data transaction center unit, The second interconnection response message is used to notify that an interconnection relationship has been established with the second big data transaction center unit.
  • the first big data transaction center unit can listen to the first interconnection request message sent by the second largest data transaction center unit according to the preset interconnection policy, and the first interconnection request message carries the identity of the second big data transaction center unit. Identification; then, the first big data transaction center unit can perform identity authentication on the second largest data transaction center unit according to the identity information; if the authentication is passed, access control is performed on the second largest data transaction center unit; if the second largest data The transaction center unit is granted access control, and then sends a first interconnection response message to the second big data transaction center unit, and the first interconnection response message is used to notify that the second big data transaction center unit has established an interconnection relationship.
  • identity authentication can be performed through the agreed identity identification, and identity authentication can also be performed through password verification. Of course, it can also be adopted.
  • Other manners of security authentication the embodiments of the present disclosure are not specifically limited herein.
  • the first big data transaction center unit can also establish a control connection and a secure connection with the second largest data transaction center unit. Manage one or more combinations of connections, supervisory connections, data connections, and transaction connections.
  • the method may further include: the first big data transaction center unit to the second big data transaction center The unit sends an exit message and disconnects the interconnection with the second largest data transaction center unit after confirming that the data transaction is complete.
  • an exit message may be sent to other big data transaction center units. , notifying other big data transaction center units that it has received the required data and is about to disconnect from other big data transaction center units.
  • it is also necessary to confirm whether the current data transaction is completed before disconnecting For example, the normal transaction before the cooperation expires cannot be interrupted, and it is confirmed whether the transaction after the cooperation expires is still initiated. , the clearing of the data cached by the partner, the notification of all the parties involved in the transaction, etc. In this way, it is possible to disconnect from other big data transaction center units after determining that the current data transaction is completed. The connection is not made until the next time a data transaction request or an interconnection request is received.
  • the related system resources can be released, such as clearing the relevant cache data and tearing down the connection link. And the like, which is determined by a person skilled in the art in a specific implementation process.
  • the big data transaction center interconnection system interconnects the big data transaction center units, the data of each big data transaction center unit is integrated, thereby, big data.
  • the demand side unit can obtain the required data from multiple big data transaction center units in the Big Data Exchange Center interconnection system.
  • the openness, interconnectivity, and sharing of the big data transaction center unit can be realized, and the data utilization rate is improved, so that the user can obtain the target data in a timely and effective manner.
  • an embodiment of the present disclosure further provides a data processing apparatus consistent with the big data transaction center unit in one or more of the above embodiments.
  • FIG. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present disclosure.
  • the data processing apparatus 30 includes an interconnection data transaction module 301 and an interconnection data module 302.
  • the interconnected data transaction module 301 is configured to receive the first data request message from the big data demander unit, and send the data of the first attribute to the big data demander unit, wherein the first data request message is used to request the first delivery
  • the data of the attribute, the first big data transaction center unit is the contract server of the big data demand side unit.
  • the interconnect data module 302 is configured to, in response to the first data request message, locally find whether there is data of the first attribute; if not, to connect to the second big data interconnected with the first big data transaction center unit through the interconnected data interface
  • the transaction center unit transmits a second data request message and receives data of the first attribute from the second big data transaction center unit through the interconnection data interface; wherein the second data request message is used to request to return data of the first attribute.
  • the interconnection data module is further configured to: determine, according to the pre-stored data service directory, a second big data transaction center unit corresponding to the data of the first attribute; and send the second to the second big data transaction center unit by using the interconnected data connection interface Data request message.
  • the interconnection data module is further configured to send the data service directory of the first big data transaction center to the second big data transaction center unit through the interconnection data interface, and receive the second big data transaction center unit through the interconnection data interface.
  • Data business directory save the data business directory of the second largest data transaction center unit.
  • the data processing apparatus further includes: an interconnection control module configured to establish an interconnection connection with the second big data transaction center unit through the interconnection control interface according to the preset interconnection policy.
  • the interconnection control module is further configured to listen to the first interconnection request message sent by the second big data transaction center unit according to the interconnection policy, where the first interconnection request message carries the identity of the second big data transaction center unit Logo.
  • the data processing apparatus further includes: an interconnection security module configured to perform identity authentication on the second largest data transaction center unit according to the identity identifier; if the authentication is passed, perform access control on the second largest data transaction center unit; if the second largest The data transaction center unit is granted access control, and then sends a first interconnection response message to the second big data transaction center unit, wherein the first interconnection response message is used to notify that the second big data transaction center unit has established an interconnection relationship.
  • the interconnection control module is further configured to: send, according to the interconnection policy, the second interconnection request message to the second big data transaction center unit by using the interconnection control interface, where the second interconnection request message carries the first big data An identity of the transaction center, the identifier is used to indicate that the second largest data transaction center unit performs identity authentication and access control; and the second interconnection response message from the second big data transaction center unit is received through the interconnection control interface, wherein the second interconnection The response message is used to notify that an interconnection relationship has been established with the second big data transaction center unit.
  • the data processing apparatus further includes: an interconnection management module, configured to establish, by using an interconnection management interface, one of a control connection, a secure connection, a management connection, a supervisory connection, a data connection, and a transaction connection with the second big data transaction center unit.
  • an interconnection management module configured to establish, by using an interconnection management interface, one of a control connection, a secure connection, a management connection, a supervisory connection, a data connection, and a transaction connection with the second big data transaction center unit.
  • an interconnection management module configured to establish, by using an interconnection management interface, one of a control connection, a secure connection, a management connection, a supervisory connection, a data connection, and a transaction connection with the second big data transaction center unit.
  • the interconnection control module is configured to send an exit message to the second big data transaction center unit through the interconnection control interface, and disconnect the interconnection with the second big data transaction center unit after confirming that the data transaction is completed.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner such as: multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed.
  • the coupling, or direct coupling, or communication connection of the components shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may be electrical, mechanical or other forms. of.
  • the units described above as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units; they may be located in one place or distributed on multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; the above integration
  • the unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
  • the foregoing program may be stored in a computer readable storage medium, and when executed, the program includes The foregoing steps of the method embodiment; and the foregoing storage medium includes: a removable storage device, a read only memory (ROM), a magnetic disk, or an optical disk, and the like, which can store program codes.
  • ROM read only memory
  • the above-described integrated unit of the present disclosure may be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a standalone product.
  • the technical solution of the embodiments of the present disclosure may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions.
  • a computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present disclosure.
  • the foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a ROM, a magnetic disk, or an optical disk.
  • Embodiments of the present disclosure provide a data processing method, apparatus, and computer readable storage medium.
  • the big data demand side unit may not exist locally.
  • the target data is needed, the target data is obtained through other interconnected big data transaction center units, and the target data is received and sent to the big data demander unit.
  • the integration and sharing of the data resources of each big data transaction center unit is realized, and the data utilization rate is improved, so that the big data demand side unit can acquire the target data in time and efficiently without traversing all the data transaction center units.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A data processing method, applied to a first big data transaction centre unit, comprising: a big data demand side unit sending a first data request message to a first big data transaction centre unit (S201); the first big data transaction centre unit searching locally, in response to the first data request message, to find whether there is data of a first attribute (S202); if not, the first big data transaction centre unit sending a second data request message to a second big data transaction centre unit interconnected with the first big data transaction centre unit (S203); the second big data transaction centre unit sending, in response to the second data request message, the data of the first attribute to the first big data transaction centre unit (S204); and the first big data transaction centre unit sending the data of the first attribute to the big data demand side unit (S205).

Description

一种数据处理方法及装置Data processing method and device 技术领域Technical field

本申请涉及数据处理领域,例如一种数据处理方法及装置。The present application relates to the field of data processing, such as a data processing method and apparatus.

背景技术Background technique

目前大数据成为当前业界的技术热点,特别是随着云计算业务的部署,大数据作为其最重要的业务应用,被寄予厚望。At present, big data has become a hotspot of technology in the industry. Especially with the deployment of cloud computing services, big data is expected to be its most important business application.

大数据的主要特点是体量(Volume)大、种类(Variety)多、速度(Velocity)快以及价值(Value)高等特点,并同时伴随着多源、异构以及海量的数据特征。大数据所涉及的数据类型包括结构化(Structured)、半结构化(Semi-Structured)以及非结构化(Un-Structured)等类型。大数据所涉及的数据对象包括文字、语音、视频、图像、网页、传感器数据等,相应地,这也就要求大数据交易系统可以有针对性地区分和处理不同数据对象所对应的数据承载格式,比如:文本文件、音频文件、适配文件、图像文件、网页文件、传感器数据文件以及相应的实时/准实时流媒体数据等不同格式。The main characteristics of big data are the large volume, the variety of Variety, the speed of Velocity and the high value of Value, accompanied by multi-source, heterogeneous and massive data features. The types of data involved in big data include types such as Structured, Semi-Structured, and Un-Structured. The data objects involved in big data include text, voice, video, image, web page, sensor data, etc. Accordingly, this also requires that the big data transaction system can specifically distinguish and process the data bearing format corresponding to different data objects. For example, text files, audio files, adaptation files, image files, web files, sensor data files, and corresponding real-time/quasi-live streaming media data.

尽管目前大数据正在逐步应用于各个行业,但是随着数据体量的逐步增加,所涉及数据种类的日益繁杂,所生成速度的迅速提升以及对于交叉领域对于数据融合及其潜在价值利用的巨大需求,对数据开放、数据共享,特别是通过数据交易的手段所实现的数据交换的需求越来越大。而在现阶段,产业内所建设的数据交易中心还都处于各自独立的阶段,彼此间无法互联互通,而如果数据需求方需要获取分属于各个数据交易中心签约的数据提供商所能提供的数据,则需要分别和各个数据交易中心以及各个数据提供商签署商业合同,并需要配置多个不同的数据交易软件,甚至使用不同的数据交易协议,方能从多个数据交易中心获取所需数据提供商的数据,这样,一方面不便于数据需求方及时有 效地获取目标交易数据(需要遍历所有数据交易中心才能查询到满足需求的最佳目标交易数据),另一方面更加浪费了数据需求方的资源(包括人力资源、软件资源、计算资源和存储资源等),更重要的是,各自彼此独立的数据交易中心所拥有的大体量的、种类繁多的、高速变化的大数据无法发挥出通过数据聚合所能体现出的巨大价值,极大地浪费了数据资源。Although big data is gradually being applied to various industries, with the gradual increase of data volume, the variety of data involved is increasing, the speed of generation is rapidly increasing, and the demand for data fusion and its potential value utilization in the cross-domain is huge. There is an increasing demand for data exchange, data sharing, and especially data exchange. At this stage, the data transaction centers built in the industry are still in their own independent stages, and they cannot be interconnected. If the data demanders need to obtain data that can be provided by data providers that are contracted by each data transaction center. , you need to sign commercial contracts with each data transaction center and each data provider separately, and need to configure multiple different data transaction software, even using different data transaction protocols, in order to obtain the required data from multiple data transaction centers. Business data, in this way, on the one hand, it is not convenient for the data demand side to obtain the target transaction data in a timely and effective manner (need to traverse all data transaction centers to query the best target transaction data that meets the demand), on the other hand, it wastes the data demand side. Resources (including human resources, software resources, computing resources, storage resources, etc.), and more importantly, large amounts of large-scale, high-speed changes in big data centers that are independent of each other cannot be used to pass data. The great value that can be reflected by the aggregation, the great waves Data resources.

发明内容Summary of the invention

以下是对本文详细描述的主题的概述。本概述并非是为限制权利要求的保护范围。The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

本公开实施例提供一种数据处理方法及装置,从而实现大数据交易中心的开放性、互联性以及共享性。Embodiments of the present disclosure provide a data processing method and apparatus, thereby implementing openness, interconnectivity, and sharing of a big data transaction center.

第一方面,本公开实施例提供一种数据处理方法,应用于第一大数据交易中心单元,包括:接收来自大数据需求方单元的第一数据请求消息,其中,所述第一数据请求消息用于请求下发第一属性的数据,所述第一大数据交易中心单元为所述大数据需求方单元的签约服务器;响应所述第一数据请求消息,在本地查找是否存在所述第一属性的数据;响应于不存在所述第一属性数据,向与所述第一大数据交易中心单元互联的第二大数据交易中心单元发送第二数据请求消息,其中,所述第二数据请求消息用于请求返回所述第一属性的数据;接收来自所述第二大数据交易中心单元的所述第一属性的数据,并将所述第一属性的数据发送给所述大数据需求方单元。In a first aspect, an embodiment of the present disclosure provides a data processing method, applicable to a first big data transaction center unit, including: receiving a first data request message from a big data demander unit, where the first data request message And a data requesting to deliver the first attribute, where the first big data transaction center unit is a subscription server of the big data demander unit; and in response to the first data request message, locally searching for whether the first Data of the attribute; in response to the absence of the first attribute data, transmitting a second data request message to a second large data transaction center unit interconnected with the first big data transaction center unit, wherein the second data request a message for requesting return of data of the first attribute; receiving data of the first attribute from the second big data transaction center unit, and transmitting data of the first attribute to the big data demander unit.

第二方面,本公开实施例提供一种数据处理装置,应用于第一大数据交易中心单元,包括:互联数据交易模块以及互联数据模块,其中,所述互联数据交易模块,配置为接收来自大数据需求方单元的第一数据请求消息,以及将第一属性的数据发送给所述大数据需求方单元,其中,所述第一数据请求消息用于请求下发第一属性的数据,所述第一大数据交易中心单元为所述大数据需求方单元的签约服务器;所述互联数据模块,配置为响应于所述第一数据请求消息,在本地查找是否存在所述第一属性的数据;如果不存在所述第一属性的数据,则通过互联数据接口向与第一大数据交易中心单元互联的第二大数据交易中心单元发送第二数据请求消息,并通过所述互联数据接口接收来自所述第二 大数据交易中心单元的所述第一属性的数据;其中,所述第二数据请求消息用于请求返回所述第一属性的数据。In a second aspect, an embodiment of the present disclosure provides a data processing apparatus, which is applied to a first big data transaction center unit, including: an interconnection data transaction module and an interconnection data module, wherein the interconnection data transaction module is configured to receive from a large a first data request message of the data requestor unit, and the data of the first attribute is sent to the big data demander unit, wherein the first data request message is used to request to deliver data of the first attribute, The first big data transaction center unit is a subscription server of the big data demander unit; the interconnection data module is configured to locally search for data of the first attribute in response to the first data request message; And if the data of the first attribute does not exist, sending a second data request message to the second big data transaction center unit interconnected with the first big data transaction center unit through the interconnected data interface, and receiving from the interconnected data interface Data of the first attribute of the second big data transaction center unit; wherein the second data The request message is for requesting to return data of the first attribute.

第三方面,本公开实施例还提供了一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令配置成执行上述方法。In a third aspect, an embodiment of the present disclosure further provides a computer readable storage medium storing computer executable instructions configured to perform the above method.

本公开实施例提供了一种数据处理方法、装置以及计算机可读存储介质,在大数据交易中心单元接收到来自大数据需求方单元的数据请求后,可以在本地不存在大数据需求方单元所需的目标数据时,通过互联的其他大数据交易中心单元来获取该目标数据,并将接收该目标数据发送给大数据需求方单元。这样,实现了各个大数据交易中心单元的数据资源的整合共享,提高了数据的利用率,从而,大数据需求方单元能够及时有效地获取目标数据,而不需要遍历所有的数据交易中心单元才能查询到满足需求的目标数据。进而,降低了用户的资源浪费,节省了用户时间,提高了用户体验。Embodiments of the present disclosure provide a data processing method, apparatus, and computer readable storage medium. After a big data transaction center unit receives a data request from a big data demander unit, the big data demand side unit may not exist locally. When the target data is needed, the target data is obtained through other interconnected big data transaction center units, and the target data is received and sent to the big data demander unit. In this way, the integration and sharing of the data resources of each big data transaction center unit is realized, and the data utilization rate is improved, so that the big data demand side unit can acquire the target data in time and efficiently without traversing all the data transaction center units. Query the target data that meets the demand. Further, the user's resource waste is reduced, the user time is saved, and the user experience is improved.

在阅读并理解了附图和详细描述后,可以明白其他方面。Other aspects will be apparent upon reading and understanding the drawings and detailed description.

附图概述BRIEF abstract

图1-1为本公开实施例中的大数据交易中心互联系统的结构示意图。1-1 is a schematic structural diagram of a big data transaction center interconnection system in an embodiment of the present disclosure.

图1-2为本公开实施例中的大数据交易中心互联单元的结构示意图。1-2 is a schematic structural diagram of a big data transaction center interconnection unit in an embodiment of the present disclosure.

图1-3为本公开实施例中的大数据交易中心互联单元的连接示意图。1-3 are schematic diagrams showing the connection of a big data transaction center interconnection unit in the embodiment of the present disclosure.

图2-1为本公开实施例中的数据处理方法的第一种流程示意图。2-1 is a schematic diagram of a first flow of a data processing method in an embodiment of the present disclosure.

图2-2为本公开实施例中的数据处理方法的第二种流程示意图。2-2 is a second schematic flowchart of a data processing method in an embodiment of the present disclosure.

图3为本公开实施例中的数据处理装置的结构示意图。FIG. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present disclosure.

具体实施方式detailed description

下面将结合本公开实施例中的附图,对本公开实施例中的技术方案进行清楚、完整地描述。The technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure.

图1-1为本公开实施例中的大数据交易中心互联系统的结构示意图。参见图 1-1所示,该大数据交易中心互联系统100可以包括:大数据供应方单元101,大数据交易中心互联单元102以及大数据需求方单元103。1-1 is a schematic structural diagram of a big data transaction center interconnection system in an embodiment of the present disclosure. Referring to FIG. 1-1, the big data transaction center interconnection system 100 may include: a big data provider unit 101, a big data transaction center interconnection unit 102, and a big data demand side unit 103.

这里,大数据交易中心互联单元由互联的至少两个大数据交易中心单元组成,例如,仍然参见图1-1所示,大数据交易中心互联单元102可以包含大数据交易中心单元102a、大数据交易中心单元102b和大数据交易中心单元102c。Here, the big data transaction center interconnection unit is composed of at least two big data transaction center units interconnected. For example, still referring to FIG. 1-1, the big data transaction center interconnection unit 102 may include a big data transaction center unit 102a, big data. The transaction center unit 102b and the big data transaction center unit 102c.

大数据供应方单元,配置为采集数据源的数据并将该数据导入给大数据交易中心互联单元;大数据交易中心互联单元,配置为导入来自大数据供方单元的数据,并根据大数据交易中心单元的请求导出相应的数据给大数据需求方单元;大数据需求方单元,配置为接收来自于大数据交易中心互联单元的数据。A big data provider unit configured to collect data from a data source and import the data into a big data transaction center interconnection unit; a big data transaction center interconnection unit configured to import data from a big data provider unit and to trade according to big data The request of the central unit derives the corresponding data to the big data demander unit; the big data demand side unit is configured to receive data from the interconnect unit of the big data transaction center.

在具体实施过程中,大数据交易中心互联单元中的每一个大数据交易中心单元都可以包括:互联数据交易模块、互联数据模块、互联控制模块、互联安全模块以及互联管理模块。在实际应用中,互联数据交易模块配置为实现大数据交易中心互联单元与大数据需求方单元之间的数据交易,可以向大数据需求方单元发送所需要的目标数据;互联数据模块配置为实现各个大数据交易中心单元之间的数据整合、共享、处理、存储、分发等;互联控制模块配置为控制各个大数据交易中心单元之间的互联连接的建立和断开;互联安全模块配置为在各个大数据交易中心单元进行互联连接时,进行安全认证、访问控制、数据版权管理认证等,以保证大数据交易中心单元之间彼此互联的安全,以实现数据共享之间的安全保护;互联管理模块配置为实现各个大数据交易中心单元之间的互联的管理和维护,还可以在互联连接的基础上实现数据连接、监管连接、安全连接、交易连接等功能的管理。In a specific implementation process, each big data transaction center unit in the big data transaction center interconnection unit may include: an interconnection data transaction module, an interconnection data module, an interconnection control module, an interconnection security module, and an interconnection management module. In practical applications, the interconnected data transaction module is configured to implement data transactions between the big data transaction center interconnection unit and the big data demand side unit, and can transmit the required target data to the big data demand side unit; the interconnected data module is configured to implement Data integration, sharing, processing, storage, distribution, etc. between the various big data transaction center units; the interconnection control module is configured to control the establishment and disconnection of interconnections between the various big data transaction center units; the interconnection security module is configured to When each big data transaction center unit is connected, perform security authentication, access control, and data copyright management authentication to ensure the security of interconnection between big data transaction center units to achieve security protection between data sharing; interconnection management The module is configured to realize the management and maintenance of the interconnection between the various big data transaction center units, and also realize the management of data connection, supervisory connection, secure connection, transaction connection and other functions on the basis of the interconnection connection.

示例性地,图1-2为本公开实施例中的大数据交易中心互联单元的结构示意图。参见图1-2所示,大数据交易中心互联单元包含3个大数据交易中心单元,大数据交易中心单元102a包括:互联数据交易模块1021a、互联数据模块1022a、互联控制模块1023a、互联安全模块1024a、互联管理模块1025a以及互联信息监管模块1026a;大数据交易中心单元102b包括:互联数据交易模块1021b、互联数据模块1022b、互联控制模块1023b、互联安全模块1024b、互联管理模块1025b以及互联信息监管模块1026b;大数据交易中心单元102c包括:互联数据交易模块1021c、互联数据模块1022c、互联控制模块1023c、互联安全模 块1024c、互联管理模块1025c以及互联信息监管模块1026c。Illustratively, FIG. 1-2 is a schematic structural diagram of a big data transaction center interconnection unit in an embodiment of the present disclosure. Referring to FIG. 1-2, the big data transaction center interconnection unit includes three big data transaction center units, and the big data transaction center unit 102a includes: an interconnection data transaction module 1021a, an interconnection data module 1022a, an interconnection control module 1023a, and an interconnection security module. 1024a, interconnection management module 1025a and interconnection information supervision module 1026a; big data transaction center unit 102b includes: interconnection data transaction module 1021b, interconnection data module 1022b, interconnection control module 1023b, interconnection security module 1024b, interconnection management module 1025b, and interconnection information supervision The module 1026b; the big data transaction center unit 102c includes: an interconnection data transaction module 1021c, an interconnection data module 1022c, an interconnection control module 1023c, an interconnection security module 1024c, an interconnection management module 1025c, and an interconnection information supervision module 1026c.

在实际应用中,结合图1-2及图1-3所示,大数据交易中心互联单元102还包括互联数据交易接口1041、互联数据接口1042、互联控制接口1043、互联安全接口1044、互联管理接口1045以及互联信息监管接口1046。互联数据交易接口配置为将各个互联数据交易模块彼此之间以及其与大数据需求方单元连接;互联数据接口配置为连接各个互联数据模块;互联控制接口配置为连接各个互联控制模块;互联安全接口配置为连接各个互联安全模块;互联管理接口配置为连接各个互联管理模块。In practical applications, as shown in FIG. 1-2 and FIG. 1-3, the big data transaction center interconnection unit 102 further includes an interconnection data transaction interface 1041, an interconnection data interface 1042, an interconnection control interface 1043, an interconnection security interface 1044, and interconnection management. The interface 1045 and the interconnection information supervision interface 1046. The interconnection data transaction interface is configured to connect the respective interconnection data transaction modules to each other and to the big data demand side unit; the interconnection data interface is configured to connect the respective interconnection data modules; the interconnection control interface is configured to connect the respective interconnection control modules; and the interconnection security interface It is configured to connect to each interconnected security module; the interconnect management interface is configured to connect to each interconnected management module.

下面结合上述系统,对本公开实施例的数据处理方法进行说明。The data processing method of the embodiment of the present disclosure will be described below in conjunction with the above system.

图2-1为本公开实施例中的数据处理方法的第一种流程示意图。参见图2-1所示,该方法包括以下描述的步骤。2-1 is a schematic diagram of a first flow of a data processing method in an embodiment of the present disclosure. Referring to Figure 2-1, the method includes the steps described below.

在步骤S201中:大数据需求方单元向第一大数据交易中心单元发送第一数据请求消息。In step S201: the big data demander unit sends a first data request message to the first big data transaction center unit.

第一数据请求消息用于请求下发第一属性的数据,第一大数据交易中心单元为数据需求方的签约服务器。The first data request message is used to request the data of the first attribute, and the first big data transaction center unit is a contract server of the data demand side.

这里,大数据需求方单元向其签约的大数据交易中心单元请求数据服务,以获得第一属性的数据,比如,后缀为.doc格式的文本文件、GIF格式的图片、MP3格式的音频文件等,以大数据需求方单元的实际需求为准,本公开实施例不做具体限定。Here, the big data demander unit requests the data service from the contracted big data transaction center unit to obtain the data of the first attribute, for example, a text file with a .doc format, a GIF format image, an MP3 format audio file, and the like. The embodiment of the present disclosure does not specifically limit the actual requirements of the big data demand side unit.

在步骤S202中:第一大数据交易中心单元响应于第一数据请求消息,在本地查找是否存在第一属性的数据。In step S202, the first big data transaction center unit locally searches for data of the first attribute in response to the first data request message.

这里,第一大数据交易中心单元在接收到第一数据请求消息后,就会在本地中查找第一属性的数据,如果确定在本地存在第一属性的数据,就可以向大数据需求方单元发送该第一属性的数据,如果确定在本地并不存在该第一属性的数据,就可以向其他互联的大数据交易中心单元请求该第一属性的数据。Here, after receiving the first data request message, the first big data transaction center unit searches for the data of the first attribute locally, and if it is determined that the data of the first attribute exists locally, the data request unit can be Sending the data of the first attribute, if it is determined that the data of the first attribute does not exist locally, the data of the first attribute may be requested from other interconnected big data transaction center units.

在步骤S203中:如果不存在该第一属性的数据,则第一大数据交易中心单元向与所述第一大数据交易中心单元互联的第二大数据交易中心单元发送第二数据请求消息。第二数据请求消息用于请求返回第一属性的数据。In step S203: if the data of the first attribute does not exist, the first big data transaction center unit sends a second data request message to the second big data transaction center unit interconnected with the first big data transaction center unit. The second data request message is used to request to return data of the first attribute.

在本公开其它实施例中,步骤S203可以包括:第一大数据交易中心单元根据预先存储的数据业务目录,确定第一属性的数据对应的第二大数据交易中心单元;向第二大数据交易中心单元发送第二数据请求消息。In other embodiments of the present disclosure, step S203 may include: the first big data transaction center unit determines, according to the pre-stored data service catalog, the second big data transaction center unit corresponding to the data of the first attribute; and the second big data transaction The central unit sends a second data request message.

这里,在每一个大数据交易中心单元中均存储有与其互联的各个大数据交易中心单元的数据业务目录。通过该数据业务目录,第一大数据交易中心单元就能够确定在哪个大数据交易中心单元中存储有第一属性的数据,进而将第二数据请求发送给该大数据交易中心单元,即第二大数据交易中心单元。Here, a data service directory of each big data transaction center unit interconnected with it is stored in each big data transaction center unit. Through the data service directory, the first big data transaction center unit can determine which big data transaction center unit stores the data of the first attribute, and then send the second data request to the big data transaction center unit, that is, the second Big data trading center unit.

可选地,在本公开其它实施例中,在第一大数据交易中心单元接收来自数据需求方的第一数据请求消息之后,该数据处理方法还包括:第一大数据交易中心单元向第二大数据交易中心单元发送所述第一大数据交易中心单元的数据业务目录,并接收来自第二大数据交易中心单元的数据业务目录;保存第二大数据交易中心单元的数据业务目录。Optionally, in another embodiment of the present disclosure, after the first big data transaction center unit receives the first data request message from the data requester, the data processing method further includes: the first big data transaction center unit is the second The big data transaction center unit transmits the data service directory of the first big data transaction center unit, and receives the data service directory from the second big data transaction center unit; and stores the data service directory of the second largest data transaction center unit.

在步骤S204中:第二大数据交易中心单元响应于第二数据请求消息,向第一大数据交易中心单元发送第一属性的数据。In step S204: the second big data transaction center unit transmits the data of the first attribute to the first big data transaction center unit in response to the second data request message.

这里,第二大数据交易中心单元在接收到第二数据请求消息后,就会从本地获取第一属性的数据,并将该第一属性的数据发送给第一大数据交易中心单元。Here, after receiving the second data request message, the second big data transaction center unit acquires the data of the first attribute locally, and sends the data of the first attribute to the first big data transaction center unit.

在步骤S205中:第一大数据交易中心单元将第一属性的数据发送给大数据需求方单元。In step S205, the first big data transaction center unit transmits the data of the first attribute to the big data demander unit.

这里,第一大数据交易中心单元在接收到第一属性的数据后或者在本地查找到第一属性的数据后,就可以将该第一属性的数据发送给大数据需求方单元。Here, after receiving the data of the first attribute or locally finding the data of the first attribute, the first big data transaction center unit may send the data of the first attribute to the big data demander unit.

在本公开其它实施例中,为了实现各个大数据交易中心单元之间的数据资源整合共享,各个大数据交易中心单元之间还可以建立互联连接,那么,在步骤S201之前,上述方法还可以包括:根据预设的互联策略,第一大数据交易中心单元与第二大数据交易中心单元建立互联连接。In other embodiments of the present disclosure, in order to realize the integration and sharing of data resources between the respective big data transaction center units, an interconnection connection may be established between the big data transaction center units. Then, before step S201, the foregoing method may further include According to the preset interconnection strategy, the first big data transaction center unit and the second big data transaction center unit establish an interconnection connection.

这里,第一大数据交易中心单元可以根据管理员的配置与第二大数据交易中心单元建立互联连接。当然,一个大数据交易中心单元可以与至少一个其它大数据交易中心单元建立互联连接。Here, the first big data transaction center unit can establish an interconnection connection with the second largest data transaction center unit according to the configuration of the administrator. Of course, a big data transaction center unit can establish an interconnection with at least one other big data transaction center unit.

在具体实施过程中,第一大数据交易中心单元可以通过主动方式来与其它大数据交易中心单元建立互联连接,也可以通过被动方式来与其它大数据交易中心单元建立互联连接,这里,本公开实施例不做具体限定。In the specific implementation process, the first big data transaction center unit can establish an interconnection connection with other big data transaction center units in an active manner, or can establish an interconnection connection with other big data transaction center units in a passive manner. Here, the present disclosure The embodiment is not specifically limited.

图2-2为本公开实施例中的数据处理方法的第二种流程示意图。参见图2-2所示,下面分别详细说明第一大数据交易中心单元如何采用主动方式和被动方式来建立互联。2-2 is a second schematic flowchart of a data processing method in an embodiment of the present disclosure. Referring to Figure 2-2, the following explains in detail how the first big data transaction center unit uses the active mode and the passive mode to establish the interconnection.

首先,详细说明第一大数据交易中心单元用主动方式建立互联的过程。First, the process of establishing the interconnection by the first big data transaction center unit in an active manner is described in detail.

第一大数据交易中心单元可以主动发起与第二大数据交易中心单元建立互联。那么,上述方法还可以包括:第一大数据交易中心单元根据互联策略向第二大数据交易中心单元发送第二互联请求消息,第二互联请求消息中携带有所述第一大数据交易中心单元的身份标识,该身份标识用于指示第二大数据交易中心单元进行身份认证和访问控制;然后,第一大数据交易中心单元接收来自第二大数据交易中心单元的第二互联响应消息,第二互联响应消息用于通知已与第二大数据交易中心单元建立互联关系。The first big data transaction center unit can initiate an interconnection with the second largest data transaction center unit. Then, the method may further include: the first big data transaction center unit sends a second interconnection request message to the second big data transaction center unit according to the interconnection policy, where the second interconnection request message carries the first big data transaction center unit An identity identifier for indicating a second big data transaction center unit for identity authentication and access control; then, the first big data transaction center unit receives a second internet response message from the second big data transaction center unit, The second interconnection response message is used to notify that an interconnection relationship has been established with the second big data transaction center unit.

其次,详细说明第一大数据交易中心单元用被动方式建立互联的过程。Secondly, the process of establishing the interconnection by the first big data transaction center unit in a passive manner is described in detail.

第一大数据交易中心单元可以侦听由第二大数据交易中心单元根据预设的互联策略发送的第一互联请求消息,第一互联请求消息中会携带有第二大数据交易中心单元的身份标识;然后,第一大数据交易中心单元可以根据身份信息,对第二大数据交易中心单元进行身份认证;如果认证通过,则对第二大数据交易中心单元进行访问控制;如果第二大数据交易中心单元被授予访问控制权,则向第二大数据交易中心单元发送第一互联响应消息,第一互联响应消息用于通知已与第二大数据交易中心单元建立互联关系。The first big data transaction center unit can listen to the first interconnection request message sent by the second largest data transaction center unit according to the preset interconnection policy, and the first interconnection request message carries the identity of the second big data transaction center unit. Identification; then, the first big data transaction center unit can perform identity authentication on the second largest data transaction center unit according to the identity information; if the authentication is passed, access control is performed on the second largest data transaction center unit; if the second largest data The transaction center unit is granted access control, and then sends a first interconnection response message to the second big data transaction center unit, and the first interconnection response message is used to notify that the second big data transaction center unit has established an interconnection relationship.

在实际应用中,为了保证数据共享的安全性,在各个大数据交易中心单元建立互联时,可以通过约定的身份标识来进行身份认证,也可以通过口令校验进行身份认证,当然,还可以采用其他方式的安全认证,这里,本公开实施例不做具体限定。In practical applications, in order to ensure the security of data sharing, when each big data transaction center unit establishes interconnection, identity authentication can be performed through the agreed identity identification, and identity authentication can also be performed through password verification. Of course, it can also be adopted. Other manners of security authentication, the embodiments of the present disclosure are not specifically limited herein.

在具体实施过程中,为了实现大数据的数据聚合、数据交易、互联监管、或互联管理等功能,第一大数据交易中心单元还可以与第二大数据交易中心单元建立控制连接、安全连接、管理连接、监管连接、数据连接以及交易连接中 的一种或多种组合。In the specific implementation process, in order to realize the functions of data aggregation, data transaction, interconnection supervision, or interconnection management of big data, the first big data transaction center unit can also establish a control connection and a secure connection with the second largest data transaction center unit. Manage one or more combinations of connections, supervisory connections, data connections, and transaction connections.

可选地,第一大数据交易中心单元在接收到来自第二大数据交易中心单元的第一属性的数据后,上述方法还可以包括:第一大数据交易中心单元向第二大数据交易中心单元发送退出消息,并在确认数据交易完成之后,断开与第二大数据交易中心单元之间的互联连接。Optionally, after the first big data transaction center unit receives the data of the first attribute from the second big data transaction center unit, the method may further include: the first big data transaction center unit to the second big data transaction center The unit sends an exit message and disconnects the interconnection with the second largest data transaction center unit after confirming that the data transaction is complete.

具体地,在数据请求较少时,为了节省系统资源,在大数据交易中心单元从其他大数据交易中心单元获得了所需的目标数据之后,可以先向其他大数据交易中心单元发送一个退出消息,通知其他大数据交易中心单元它已经接收到所需的数据,并且即将与其他大数据交易中心单元断开互联。当然,为了保证数据交易的完整性,还需要在断开连接之前,先确认当前数据交易是否完成,如在合作到期之前的正常交易不能中断,确认是否有合作到期之后的交易仍被发起,合作方缓存的数据的清除,交易相关所有权益各方用户的通知等。这样,就可以在确定当前数据交易完成后,与其他大数据交易中心单元断开互联。直至下次接收到数据交易请求或者互联请求后,再进行连接。Specifically, when the data request is small, in order to save system resources, after the big data transaction center unit obtains the required target data from other big data transaction center units, an exit message may be sent to other big data transaction center units. , notifying other big data transaction center units that it has received the required data and is about to disconnect from other big data transaction center units. Of course, in order to ensure the integrity of the data transaction, it is also necessary to confirm whether the current data transaction is completed before disconnecting. For example, the normal transaction before the cooperation expires cannot be interrupted, and it is confirmed whether the transaction after the cooperation expires is still initiated. , the clearing of the data cached by the partner, the notification of all the parties involved in the transaction, etc. In this way, it is possible to disconnect from other big data transaction center units after determining that the current data transaction is completed. The connection is not made until the next time a data transaction request or an interconnection request is received.

在实际应用中,在确定大数据交易中心互联系统中的所有大数据交易中心单元的互联连接都断开后,还可以进行相关的释放系统资源的工作,如清除相关缓存数据、拆除连接链路等,由本领域技术人员在具体实施过程中来确定。In practical applications, after determining that all the big data transaction center units in the big data transaction center interconnection system are disconnected, the related system resources can be released, such as clearing the relevant cache data and tearing down the connection link. And the like, which is determined by a person skilled in the art in a specific implementation process.

由上述内容可知,在本公开其它实施例中,由于大数据交易中心互联系统将各个大数据交易中心单元进行了互联连接,实现了对各个大数据交易中心单元的数据进行整合,从而,大数据需求方单元就可以从大数据交易中心互联系统中的多个大数据交易中心单元获取所需数据。这样,通过本公开实施例所提供的数据处理方法,可以实现大数据交易中心单元的开放性、互联性以及共享性,提高了数据的利用率,从而,用户就能够及时有效地获取目标数据,而不需要遍历所有的大数据交易中心单元才能查询到满足需求的目标数据。进而,降低了用户的资源浪费,节省了用户时间,提高了用户体验。It can be seen from the above that in other embodiments of the present disclosure, since the big data transaction center interconnection system interconnects the big data transaction center units, the data of each big data transaction center unit is integrated, thereby, big data. The demand side unit can obtain the required data from multiple big data transaction center units in the Big Data Exchange Center interconnection system. In this way, through the data processing method provided by the embodiment of the present disclosure, the openness, interconnectivity, and sharing of the big data transaction center unit can be realized, and the data utilization rate is improved, so that the user can obtain the target data in a timely and effective manner. Instead of traversing all the big data transaction center units, you can query the target data that meets your needs. Further, the user's resource waste is reduced, the user time is saved, and the user experience is improved.

基于同一发明构思,本公开实施例还提供一种数据处理装置,与上述一个或者多个实施例中的大数据交易中心单元一致。Based on the same inventive concept, an embodiment of the present disclosure further provides a data processing apparatus consistent with the big data transaction center unit in one or more of the above embodiments.

图3为本公开实施例中的数据处理装置的结构示意图。参见图3所示,该数据处理装置30包括:互联数据交易模块301以及互联数据模块302。互联数 据交易模块301配置为接收来自大数据需求方单元的第一数据请求消息,以及将第一属性的数据发送给大数据需求方单元,其中,第一数据请求消息用于请求下发第一属性的数据,第一大数据交易中心单元为大数据需求方单元的签约服务器。互联数据模块302配置为响应第一数据请求消息,在本地查找是否存在第一属性的数据;如果不存在,则通过互联数据接口向与所述第一大数据交易中心单元互联的第二大数据交易中心单元发送第二数据请求消息,并通过互联数据接口接收来自第二大数据交易中心单元的第一属性的数据;其中,第二数据请求消息用于请求返回第一属性的数据。FIG. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present disclosure. Referring to FIG. 3, the data processing apparatus 30 includes an interconnection data transaction module 301 and an interconnection data module 302. The interconnected data transaction module 301 is configured to receive the first data request message from the big data demander unit, and send the data of the first attribute to the big data demander unit, wherein the first data request message is used to request the first delivery The data of the attribute, the first big data transaction center unit is the contract server of the big data demand side unit. The interconnect data module 302 is configured to, in response to the first data request message, locally find whether there is data of the first attribute; if not, to connect to the second big data interconnected with the first big data transaction center unit through the interconnected data interface The transaction center unit transmits a second data request message and receives data of the first attribute from the second big data transaction center unit through the interconnection data interface; wherein the second data request message is used to request to return data of the first attribute.

可选地,互联数据模块还配置为根据预先存储的数据业务目录,确定第一属性的数据对应的第二大数据交易中心单元;通过互联数据连接接口向第二大数据交易中心单元发送第二数据请求消息。Optionally, the interconnection data module is further configured to: determine, according to the pre-stored data service directory, a second big data transaction center unit corresponding to the data of the first attribute; and send the second to the second big data transaction center unit by using the interconnected data connection interface Data request message.

可选地,互联数据模块还配置为通过互联数据接口向第二大数据交易中心单元发送所述第一大数据交易中心的数据业务目录,并通过互联数据接口接收来自第二大数据交易中心单元的数据业务目录;保存第二大数据交易中心单元的数据业务目录。Optionally, the interconnection data module is further configured to send the data service directory of the first big data transaction center to the second big data transaction center unit through the interconnection data interface, and receive the second big data transaction center unit through the interconnection data interface. Data business directory; save the data business directory of the second largest data transaction center unit.

可选地,上述数据处理装置还包括:互联控制模块,配置为根据预设的互联策略,通过互联控制接口与第二大数据交易中心单元建立互联连接。Optionally, the data processing apparatus further includes: an interconnection control module configured to establish an interconnection connection with the second big data transaction center unit through the interconnection control interface according to the preset interconnection policy.

可选地,互联控制模块还配置为侦听由第二大数据交易中心单元根据互联策略发送的第一互联请求消息,其中,第一互联请求消息中携带有第二大数据交易中心单元的身份标识。上述数据处理装置还包括:互联安全模块,配置为根据身份标识,对第二大数据交易中心单元进行身份认证;如果认证通过,则对第二大数据交易中心单元进行访问控制;如果第二大数据交易中心单元被授予访问控制权,则向第二大数据交易中心单元发送第一互联响应消息,其中,第一互联响应消息用于通知已与第二大数据交易中心单元建立互联关系。Optionally, the interconnection control module is further configured to listen to the first interconnection request message sent by the second big data transaction center unit according to the interconnection policy, where the first interconnection request message carries the identity of the second big data transaction center unit Logo. The data processing apparatus further includes: an interconnection security module configured to perform identity authentication on the second largest data transaction center unit according to the identity identifier; if the authentication is passed, perform access control on the second largest data transaction center unit; if the second largest The data transaction center unit is granted access control, and then sends a first interconnection response message to the second big data transaction center unit, wherein the first interconnection response message is used to notify that the second big data transaction center unit has established an interconnection relationship.

可选地,互联控制模块,还配置为根据互联策略,通过互联控制接口向第二大数据交易中心单元发送第二互联请求消息,其中,第二互联请求消息中携带有所述第一大数据交易中心的身份标识,身份标识用于指示第二大数据交易中心单元进行身份认证和访问控制;通过互联控制接口接收来自第二大数据交易中心单元的第二互联响应消息,其中,第二互联响应消息用于通知已与第二 大数据交易中心单元建立互联关系。Optionally, the interconnection control module is further configured to: send, according to the interconnection policy, the second interconnection request message to the second big data transaction center unit by using the interconnection control interface, where the second interconnection request message carries the first big data An identity of the transaction center, the identifier is used to indicate that the second largest data transaction center unit performs identity authentication and access control; and the second interconnection response message from the second big data transaction center unit is received through the interconnection control interface, wherein the second interconnection The response message is used to notify that an interconnection relationship has been established with the second big data transaction center unit.

可选地,上述数据处理装置还包括:互联管理模块,配置为通过互联管理接口与第二大数据交易中心单元建立控制连接、安全连接、管理连接、监管连接、数据连接以及交易连接中的一种或多种组合。Optionally, the data processing apparatus further includes: an interconnection management module, configured to establish, by using an interconnection management interface, one of a control connection, a secure connection, a management connection, a supervisory connection, a data connection, and a transaction connection with the second big data transaction center unit. One or more combinations.

可选地,互联控制模块,配置为通过互联控制接口向第二大数据交易中心单元发送退出消息,并在确认数据交易完成之后,断开与第二大数据交易中心单元之间的互连连接。Optionally, the interconnection control module is configured to send an exit message to the second big data transaction center unit through the interconnection control interface, and disconnect the interconnection with the second big data transaction center unit after confirming that the data transaction is completed. .

需要说明的是:以上装置实施例的描述,与上述方法实施例的描述是类似的,具有同方法实施例相似的有益效果,因此不做赘述。对于本公开的装置实施例中未披露的技术细节,请参照本公开的方法实施例的描述而理解,为节约篇幅,因此不再赘述。It should be noted that the description of the above device embodiments is similar to the description of the foregoing method embodiments, and has similar advantages to the method embodiments, and thus will not be described again. For the technical details that are not disclosed in the device embodiments of the present disclosure, please refer to the description of the method embodiments of the present disclosure, and the details are not described herein.

应理解,说明书通篇中提到的“一个实施例”或“一实施例”意味着与实施例有关的特定特征、结构或特性包括在本公开的至少一个实施例中。因此,在整个说明书各处出现的“在一个实施例中”或“在一实施例中”未必一定指相同的实施例。此外,这些特定的特征、结构或特性可以任意适合的方式结合在一个或多个实施例中。应理解,在本公开的各种实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本公开实施例的实施过程构成任何限定。上述本公开实施例序号仅仅为了描述,不代表实施例的优劣。It is to be understood that the phrase "one embodiment" or "an embodiment" or "an" or "an" Thus, "in one embodiment" or "in an embodiment" or "an" In addition, these particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in various embodiments of the present disclosure, the size of the sequence numbers of the above processes does not mean the order of execution order, and the order of execution of each process should be determined by its function and internal logic, and should not be directed to the embodiments of the present disclosure. The implementation process constitutes any limitation. The above-mentioned serial numbers of the embodiments of the present disclosure are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

需要说明的是,在本文中,术语“包括”、“包含”或者其任何其它变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其它要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,如:多个单元或组件可以结合,或可以集成到另一个系统,或一些特征可以忽 略,或不执行。另外,所显示或讨论的各组成部分相互之间的耦合、或直接耦合、或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性的、机械的或其它形式的。In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, such as: multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, or direct coupling, or communication connection of the components shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may be electrical, mechanical or other forms. of.

上述作为分离部件说明的单元可以是、或也可以不是物理上分开的,作为单元显示的部件可以是、或也可以不是物理单元;既可以位于一个地方,也可以分布到多个网络单元上;可以根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。The units described above as separate components may or may not be physically separated, and the components displayed as the unit may or may not be physical units; they may be located in one place or distributed on multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

另外,在本公开各实施例中的各功能单元可以全部集成在一个处理单元中,也可以是各单元分别单独作为一个单元,也可以两个或两个以上单元集成在一个单元中;上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; the above integration The unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:移动存储设备、只读存储器(Read Only Memory,ROM)、磁碟或者光盘等各种可以存储程序代码的介质。It will be understood by those skilled in the art that all or part of the steps of implementing the foregoing method embodiments may be performed by hardware related to program instructions. The foregoing program may be stored in a computer readable storage medium, and when executed, the program includes The foregoing steps of the method embodiment; and the foregoing storage medium includes: a removable storage device, a read only memory (ROM), a magnetic disk, or an optical disk, and the like, which can store program codes.

或者,本公开上述集成的单元如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。基于这样的理解,本公开实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器、或者网络设备等)执行本公开各个实施例所述方法的全部或部分。而前述的存储介质包括:移动存储设备、ROM、磁碟或者光盘等各种可以存储程序代码的介质。Alternatively, the above-described integrated unit of the present disclosure may be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a standalone product. Based on such understanding, the technical solution of the embodiments of the present disclosure may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions. A computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present disclosure. The foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a ROM, a magnetic disk, or an optical disk.

以上所述,仅为本公开的具体实施方式,但本公开的保护范围并不局限于此,因此,本公开的保护范围应以所附权利要求的保护范围为准。The above is only the specific embodiment of the present disclosure, but the scope of the present disclosure is not limited thereto, therefore, the scope of the present disclosure should be determined by the scope of the appended claims.

工业实用性Industrial applicability

本公开实施例提供了一种数据处理方法、装置以及计算机可读存储介质,在大数据交易中心单元接收到来自大数据需求方单元的数据请求后,可以在本地不存在大数据需求方单元所需的目标数据时,通过互联的其他大数据交易中心单元来获取该目标数据,并将接收该目标数据发送给大数据需求方单元。这样,实现了各个大数据交易中心单元的数据资源的整合共享,提高了数据的利用率,从而,大数据需求方单元能够及时有效地获取目标数据,而不需要遍历所有的数据交易中心单元才能查询到满足需求的目标数据。进而,降低了用户的资源浪费,节省了用户时间,提高了用户体验。Embodiments of the present disclosure provide a data processing method, apparatus, and computer readable storage medium. After a big data transaction center unit receives a data request from a big data demander unit, the big data demand side unit may not exist locally. When the target data is needed, the target data is obtained through other interconnected big data transaction center units, and the target data is received and sent to the big data demander unit. In this way, the integration and sharing of the data resources of each big data transaction center unit is realized, and the data utilization rate is improved, so that the big data demand side unit can acquire the target data in time and efficiently without traversing all the data transaction center units. Query the target data that meets the demand. Further, the user's resource waste is reduced, the user time is saved, and the user experience is improved.

Claims (17)

一种数据处理方法,应用于第一大数据交易中心单元,包括:A data processing method applied to a first big data transaction center unit, including: 接收来自大数据需求方单元的第一数据请求消息,其中,所述第一数据请求消息用于请求下发第一属性的数据,所述第一大数据交易中心单元为所述大数据需求方单元的签约服务器;Receiving a first data request message from a big data demander unit, wherein the first data request message is used to request to deliver data of a first attribute, where the first big data transaction center unit is the big data demand side The contract server of the unit; 响应于所述第一数据请求消息,在本地查找是否存在所述第一属性的数据;Retrieving locally whether data of the first attribute exists locally in response to the first data request message; 响应于不存在所述第一属性数据,向与所述第一大数据交易中心单元互联的第二大数据交易中心单元发送第二数据请求消息,并接收来自所述第二大数据交易中心单元的所述第一属性的数据,其中,所述第二数据请求消息用于请求返回所述第一属性的数据;Transmitting, to the second big data transaction center unit interconnected with the first big data transaction center unit, a second data request message in response to the absence of the first attribute data, and receiving from the second big data transaction center unit The data of the first attribute, wherein the second data request message is used to request to return data of the first attribute; 将所述第一属性的数据发送给所述大数据需求方单元。Transmitting the data of the first attribute to the big data demander unit. 根据权利要求1所述的方法,其中,所述向与所述第一大数据交易中心单元互联的第二大数据交易中心单元发送第二数据请求消息,包括:The method of claim 1, wherein the transmitting the second data request message to the second big data transaction center unit interconnected with the first big data transaction center unit comprises: 根据预先存储的数据业务目录,确定所述第一属性的数据对应的所述第二大数据交易中心单元;Determining, according to the pre-stored data service directory, the second big data transaction center unit corresponding to the data of the first attribute; 向所述第二大数据交易中心单元发送所述第二数据请求消息。Sending the second data request message to the second big data transaction center unit. 根据权利要求1所述的方法,其中,在所述向与所述第一大数据交易中心单元互联的第二大数据交易中心单元发送第二数据请求消息之前,所述方法还包括:The method of claim 1, wherein before the transmitting the second data request message to the second big data transaction center unit interconnected with the first big data transaction center unit, the method further comprises: 向所述第二大数据交易中心单元发送所述第一大数据交易中心单元的数据业务目录,并接收来自所述第二大数据交易中心单元的数据业务目录;Transmitting, to the second big data transaction center unit, a data service catalog of the first big data transaction center unit, and receiving a data service catalog from the second big data transaction center unit; 保存所述第二大数据交易中心单元的数据业务目录。Saving the data service directory of the second big data transaction center unit. 根据权利要求1所述的方法,其中,在所述接收来自大数据需求方单元的第一数据请求之前,所述方法还包括:The method of claim 1, wherein before the receiving the first data request from the big data demander unit, the method further comprises: 根据预设的互联策略,与所述第二大数据交易中心单元建立互联连接。Establishing an interconnection with the second big data transaction center unit according to a preset interconnection strategy. 根据权利要求4所述的方法,其中,所述根据预设的互联策略,与所述第二大数据交易中心单元建立互联连接,包括:The method according to claim 4, wherein the establishing an interconnection connection with the second big data transaction center unit according to a preset interconnection policy comprises: 侦听由所述第二大数据交易中心单元根据所述互联策略发送的第一互联请 求消息,其中,所述第一互联请求消息中携带有所述第二大数据交易中心单元的身份标识;Listening to the first interconnection request message sent by the second big data transaction center unit according to the interconnection policy, wherein the first interconnection request message carries an identity of the second big data transaction center unit; 根据所述身份标识,对所述第二大数据交易中心单元进行身份认证;Performing identity authentication on the second big data transaction center unit according to the identity identifier; 响应于身份认证通过,对所述第二大数据交易中心单元进行访问控制;And performing access control on the second big data transaction center unit in response to the identity authentication passing; 响应于确定所述第二大数据交易中心单元被授予访问控制权,向所述第二大数据交易中心单元发送第一互联响应消息,其中,所述第一互联响应消息用于通知已与所述第二大数据交易中心单元建立互联关系。Responding to determining that the second big data transaction center unit is granted access control, transmitting a first internet response message to the second big data transaction center unit, wherein the first internet response message is used to notify that the The second largest data transaction center unit establishes an interconnection relationship. 根据权利要求4所述的方法,其中,所述根据预设的互联策略,与所述第二大数据交易中心单元建立互联连接,包括:The method according to claim 4, wherein the establishing an interconnection connection with the second big data transaction center unit according to a preset interconnection policy comprises: 根据所述互联策略向所述第二大数据交易中心单元发送第二互联请求消息,其中,所述第二互联请求消息中携带有所述第一大数据交易中心单元的身份标识,所述身份标识用于指示所述第二大数据交易中心单元进行身份认证和访问控制;Transmitting, according to the interconnection policy, a second interconnection request message to the second big data transaction center unit, where the second interconnection request message carries an identity of the first big data transaction center unit, where the identity The identifier is used to indicate that the second big data transaction center unit performs identity authentication and access control; 接收来自所述第二大数据交易中心单元的第二互联响应消息,其中,所述第二互联响应消息用于通知已与所述第二大数据交易中心单元建立互联关系。Receiving a second internetworking response message from the second big data transaction center unit, wherein the second internetworking response message is used to notify that an interconnection relationship has been established with the second big data transaction center unit. 根据权利要求1所述的方法,其中,在所述接收来自大数据需求方单元的第一数据请求消息之后,所述方法还包括:The method of claim 1, wherein after the receiving the first data request message from the big data demander unit, the method further comprises: 与所述第二大数据交易中心单元建立控制连接、安全连接、管理连接、监管连接、数据连接以及交易连接中的一种或多种组合。Establishing one or more combinations of control connections, secure connections, management connections, supervisory connections, data connections, and transaction connections with the second big data transaction center unit. 根据权利要求1所述的方法,其中,所述接收来自所述第二大数据交易中心单元的所述第一属性的数据之后,所述方法还包括:The method of claim 1, wherein after the receiving data from the first attribute of the second big data transaction center unit, the method further comprises: 向所述第二大数据交易中心单元发送退出消息,并在确认数据交易完成之后,断开与所述第二大数据交易中心单元之间的互联连接。Sending an exit message to the second big data transaction center unit and disconnecting the interconnection with the second big data transaction center unit after confirming that the data transaction is completed. 一种数据处理装置,应用于第一大数据交易中心单元,包括:互联数据交易模块以及互联数据模块,其中,A data processing device is applied to a first big data transaction center unit, including: an interconnection data transaction module and an interconnection data module, wherein 所述互联数据交易模块,配置为接收来自大数据需求方单元的第一数据请求消息,以及将第一属性的数据发送给所述大数据需求方单元,其中,所述第 一数据请求消息用于请求下发所述第一属性的数据,所述第一大数据交易中心单元为所述大数据需求方单元的签约服务器;The interconnected data transaction module is configured to receive a first data request message from a big data demander unit, and send data of the first attribute to the big data demander unit, wherein the first data request message is And sending, by the request, the data of the first attribute, where the first big data transaction center unit is a subscription server of the big data demand side unit; 所述互联数据模块,配置为响应于所述第一数据请求消息,在本地查找是否存在所述第一属性的数据;如果不存在所述第一属性的数据,则通过互联数据接口向与所述第一大数据交易中心单元互联的第二大数据交易中心单元发送第二数据请求消息,并通过所述互联数据接口接收来自所述第二大数据交易中心单元的所述第一属性的数据;其中,所述第二数据请求消息用于请求返回所述第一属性的数据。The interconnecting data module is configured to, in response to the first data request message, locally search for whether the data of the first attribute exists; if the data of the first attribute does not exist, access to the device through the interconnected data interface Transmitting, by the second largest data transaction center unit of the first big data transaction center unit, a second data request message, and receiving data of the first attribute from the second big data transaction center unit through the interconnected data interface The second data request message is used to request to return data of the first attribute. 根据权利要求9所述的装置,其中,所述互联数据模块,还配置为根据预先存储的数据业务目录,确定所述第一属性的数据对应的所述第二大数据交易中心单元;通过所述互联数据连接接口向所述第二大数据交易中心单元发送所述第二数据请求消息。The apparatus according to claim 9, wherein the interconnection data module is further configured to determine, according to a pre-stored data service directory, the second big data transaction center unit corresponding to the data of the first attribute; The interconnect data connection interface sends the second data request message to the second big data transaction center unit. 根据权利要求9所述的装置,其中,所述互联数据模块,还配置为通过所述互联数据接口向所述第二大数据交易中心单元发送所述第一大数据交易中心单元的数据业务目录,并通过所述互联数据接口接收来自所述第二大数据交易中心单元的数据业务目录;保存所述第二大数据交易中心单元的数据业务目录。The apparatus of claim 9, wherein the interconnected data module is further configured to transmit, by the interconnected data interface, a data service catalog of the first big data transaction center unit to the second big data transaction center unit And receiving, by the interconnected data interface, a data service directory from the second big data transaction center unit; and storing a data service directory of the second big data transaction center unit. 根据权利要求9所述的装置,其中,所述装置还包括:互联控制模块,配置为根据预设的互联策略,通过互联控制接口与所述第二大数据交易中心单元建立互联连接。The apparatus according to claim 9, wherein the apparatus further comprises: an interconnection control module configured to establish an interconnection connection with the second big data transaction center unit through the interconnection control interface according to a preset interconnection policy. 根据权利要求12所述的装置,其中,所述互联控制模块,还配置为侦听由所述第二大数据交易中心单元根据所述互联策略发送的第一互联请求消息,其中,所述第一互联请求消息中携带有所述第二大数据交易中心单元的身份标识;The apparatus of claim 12, wherein the interconnection control module is further configured to listen to a first interconnection request message sent by the second big data transaction center unit according to the interconnection policy, wherein the An interconnection request message carries an identity of the second big data transaction center unit; 所述装置还包括:互联安全模块,配置为根据所述身份标识,对所述第二大数据交易中心单元进行身份认证;如果身份认证通过,则对所述第二大数据交易中心单元进行访问控制;如果所述第二大数据交易中心单元被授予访问控制权,则向所述第二大数据交易中心单元发送第一互联响应消息,其中,所述第一互联响应消息用于通知已与所述第二大数据交易中心单元建立互联关系。The device further includes: an interconnection security module, configured to perform identity authentication on the second big data transaction center unit according to the identity identifier; and if the identity authentication passes, access the second big data transaction center unit Controlling; if the second big data transaction center unit is granted access control, sending a first internet response message to the second big data transaction center unit, wherein the first internet response message is used to notify that The second big data transaction center unit establishes an interconnection relationship. 根据权利要求12所述的装置,其中,所述互联控制模块,还配置为根据所述互联策略,通过所述互联控制接口向所述第二大数据交易中心单元发送第二互联请求消息,其中,所述第二互联请求消息中携带有所述第一大数据交易中心单元的身份标识,所述身份标识用于指示所述第二大数据交易中心单元进行身份认证和访问控制;且配置为通过所述互联控制接口接收来自所述第二大数据交易中心单元的第二互联响应消息,其中,所述第二互联响应消息用于通知已与所述第二大数据交易中心单元建立互联关系。The apparatus according to claim 12, wherein the interconnection control module is further configured to send a second interconnection request message to the second big data transaction center unit through the interconnection control interface according to the interconnection policy, wherein The second interconnection request message carries an identity of the first big data transaction center unit, where the identity identifier is used to indicate that the second big data transaction center unit performs identity authentication and access control, and is configured to Receiving, by the interconnection control interface, a second interconnection response message from the second big data transaction center unit, wherein the second interconnection response message is used to notify that an interconnection relationship has been established with the second big data transaction center unit . 根据权利要求9所述的装置,其中,所述装置还包括:互联管理模块,配置为通过互联管理接口与所述第二大数据交易中心单元建立控制连接、安全连接、管理连接、监管连接、数据连接以及交易连接中的一种或多种组合。The device according to claim 9, wherein the device further comprises: an interconnection management module configured to establish a control connection, a secure connection, a management connection, a supervisory connection, and the second big data transaction center unit through the interconnection management interface, One or more combinations of data connections and transaction connections. 根据权利要求9所述的装置,其中,所述互联控制模块,还配置为通过所述互联控制接口向所述第二大数据交易中心单元发送退出消息,并在确认数据交易完成之后,断开与所述第二大数据交易中心单元之间的互连连接。The apparatus of claim 9, wherein the interconnection control module is further configured to send an exit message to the second big data transaction center unit through the interconnection control interface, and disconnect after confirming that the data transaction is completed An interconnection connection with the second big data transaction center unit. 一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令配置成执行权利要求1-8中任一项所述的方法。A computer readable storage medium storing computer executable instructions configured to perform the method of any of claims 1-8.
PCT/CN2017/118113 2016-12-23 2017-12-22 Data processing method and apparatus Ceased WO2018113789A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611209044.0A CN108241648A (en) 2016-12-23 2016-12-23 A data processing method and device
CN201611209044.0 2016-12-23

Publications (1)

Publication Number Publication Date
WO2018113789A1 true WO2018113789A1 (en) 2018-06-28

Family

ID=62624678

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/118113 Ceased WO2018113789A1 (en) 2016-12-23 2017-12-22 Data processing method and apparatus

Country Status (2)

Country Link
CN (1) CN108241648A (en)
WO (1) WO2018113789A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12281392B2 (en) 2019-02-06 2025-04-22 Nippon Steel Corporation Hot dip galvanized steel sheet and method for producing same

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110298753A (en) * 2019-06-06 2019-10-01 上海数据交易中心有限公司 Data transacting system and method, readable storage medium storing program for executing

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101222424A (en) * 2007-12-24 2008-07-16 中国电信股份有限公司 Content distribution network and scheduling method based on content in the network
CN101697168A (en) * 2009-10-22 2010-04-21 中国科学技术大学 Method and system for dynamically managing metadata of distributed file system
CN103368966A (en) * 2013-07-18 2013-10-23 北京网鼎芯睿科技有限公司 Server system and transmission method for data flow
CN103503400A (en) * 2011-11-04 2014-01-08 华为技术有限公司 Redirection method, device and system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9270687B2 (en) * 2009-11-24 2016-02-23 Verizon Patent And Licensing Inc. System and method for providing sensor overlay networks
CN101764839B (en) * 2009-12-23 2013-01-23 成都市华为赛门铁克科技有限公司 Data access method and uniform resource locator (URL) server
CN103368617A (en) * 2013-06-28 2013-10-23 东莞宇龙通信科技有限公司 Smart device interaction system and smart device interaction method
CN104092647B (en) * 2013-11-25 2016-04-13 腾讯科技(深圳)有限公司 Network access method, system and client

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101222424A (en) * 2007-12-24 2008-07-16 中国电信股份有限公司 Content distribution network and scheduling method based on content in the network
CN101697168A (en) * 2009-10-22 2010-04-21 中国科学技术大学 Method and system for dynamically managing metadata of distributed file system
CN103503400A (en) * 2011-11-04 2014-01-08 华为技术有限公司 Redirection method, device and system
CN103368966A (en) * 2013-07-18 2013-10-23 北京网鼎芯睿科技有限公司 Server system and transmission method for data flow

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12281392B2 (en) 2019-02-06 2025-04-22 Nippon Steel Corporation Hot dip galvanized steel sheet and method for producing same

Also Published As

Publication number Publication date
CN108241648A (en) 2018-07-03

Similar Documents

Publication Publication Date Title
KR102277186B1 (en) Delivery of application services through application service avatars
CN113452592B (en) Cross-cloud data access method and device under hybrid cloud architecture
CN100542166C (en) Secure and access-controlled peer-to-peer resource sharing method and device
KR20090080051A (en) Sponsor Nodes, and Methods of Hosting Virtual Peers in a P2P Network
CN104811371B (en) A kind of brand-new instantaneous communication system
JP2018524717A (en) Message service providing method for providing a message service using an open chat room corresponding to link information, and a message server and a terminal for performing the message service providing method
CN104936141B (en) LBS method for protecting track privacy based on location tags
CN103024085A (en) System and method for processing P2P (peer-to-peer) node request
CN103547339A (en) File uploading method, client side and server side
WO2015172497A1 (en) Message pushing and acquisition methods and devices, and computer readable storage medium
WO2018113789A1 (en) Data processing method and apparatus
WO2016086659A1 (en) Service message transmission method, device and system
CN101917438A (en) Access control method and system in network communication system
US20170064023A1 (en) Page Push Method, Device, Server and System
WO2018192241A1 (en) Server deployment structure and method for implementing inter-network communication
CN115134075A (en) Invoking methods, apparatus, electronic devices and storage media across subnets
CN111698166B (en) Transaction message routing method, device, routing server and storage medium
CN101686172B (en) Method, system and equipment for selecting gateway node
CN105656769A (en) Service data processing method, apparatus and system
CN115774728B (en) President machine-based alliance chain cross-chain operation method, apparatus, device and medium
WO2014079320A1 (en) Method and system for processing message in social network
CN103647712A (en) Distributed route processing business method and distributed route processing business system
CN103905249B (en) A kind of mobile Internet network method for managing and monitoring based on JXME
Akyol et al. A context aware notification architecture based on distributed focused crawling in the big data era
JP6087343B2 (en) Personal network merge method and apparatus, and personal network division method and apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17883667

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17883667

Country of ref document: EP

Kind code of ref document: A1