[go: up one dir, main page]

CN105162560A - A data processing method and system - Google Patents

A data processing method and system Download PDF

Info

Publication number
CN105162560A
CN105162560A CN201510523989.9A CN201510523989A CN105162560A CN 105162560 A CN105162560 A CN 105162560A CN 201510523989 A CN201510523989 A CN 201510523989A CN 105162560 A CN105162560 A CN 105162560A
Authority
CN
China
Prior art keywords
server
data
master server
slave
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510523989.9A
Other languages
Chinese (zh)
Inventor
曹海华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Beijing Electronic Information Industry Co Ltd
Original Assignee
Inspur Beijing Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Beijing Electronic Information Industry Co Ltd filed Critical Inspur Beijing Electronic Information Industry Co Ltd
Priority to CN201510523989.9A priority Critical patent/CN105162560A/en
Publication of CN105162560A publication Critical patent/CN105162560A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00—Arrangements for detecting or preventing errors in the information received
    • H04L1/22—Arrangements for detecting or preventing errors in the information received using redundant apparatus to increase reliability

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Hardware Redundancy (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data processing method. The method comprises the following steps that: a main server receives data transmitted by a client, transmits the data to a slave server which is positioned a machine room different from a machine room where the main server is positioned to back up the data, and receives confirmation information indicating that the data is already received returned from the slave server; and the main server processes the data received from the client, and returns the processed data to the client. Through the scheme of the invention, the broadband consumption and programs of the client can be kept constant.

Description

A kind of data processing method and system
Technical field
The present invention relates to the double-machine standby technology of server data, particularly relate to a kind of data processing method and system.
Background technology
Along with the Internet (mobile Internet) high speed development, user is the data, services that provides of reliance server more and more, strengthens the usability requirements of data, needs the service (data) that access services device more anywhere or anytime provides; Traditional two-node cluster hot backup, is the hot reserve scheme in same machine room, goes wrong once this machine room, and whole service system can be made to paralyse, and has a strong impact on user's application.And in existing higher level's hot reserve scheme, the distribution normally directly providing data by client and the process returned results, the broadband adding client so to a certain extent consumes and needs to change the program of client.
Summary of the invention
In order to solve the problem, the present invention proposes a kind of data processing method and system, can keep the broadband of client consume and program constant.
In order to achieve the above object, the present invention proposes a kind of data processing method, the method comprises:
Master server receives the data that client sends, and these data is sent to and be positioned at backing up from server of different machine rooms from master server, and receives the confirmation receiving these data returned from server.
Master server processes the data received from client and the data after process is returned client.
Preferably, the method also comprises:
From server the data that master server sends are stored into memory database and back up, when the quantity of the data stored in memory database reaches default storage threshold, the data stored from server process memory database, and by the data conversion storage after process in non-memory database.
Preferably, the method also comprises:
When master server breaks down, be that master server carries out work from Server switching, and before handover by receive from client and untreated data process.
When from server fail, master server continues the data receiving client transmission, processes these data, and the data after process are returned client.
Preferably, the method also comprises:
When master server breaks down, the message informing that master server is broken down is from server, and after master server recovers normally, master server is recovered normal message informing from server, and reception receives and the data processed from server during the master server that server sends breaks down.
When from server fail, from the message informing master server that server is broken down, and recover from server normal after will recover normal message informing master server from server, and receive receiving and the data processed from master server during server fail of master server transmission.
In order to achieve the above object, the invention allows for a kind of data handling system, this system comprises: master server and one or more from server.
Master server receives the data that client sends, and these data is sent to and be positioned at backing up from server of different machine rooms from master server, and receives the confirmation receiving data returned from server.
Master server processes the data received from client and the data after process is returned client.
Preferably, this system also comprises one or more from server.
Be used for from server, the data that master server sends are stored in memory database and back up, when the quantity of the data stored in memory database reaches default storage threshold, also for the treatment of the data stored in memory database, and by the data conversion storage after process in non-memory database.
Preferably,
From server also for, when master server breaks down, switch to master server to carry out work, and before handover by receive from client and untreated data process;
Master server also for, when from server fail, continue receive client send data, these data are processed, and by process after data return client.
Preferably,
Master server also for, when master server breaks down, the message informing broken down is from server, and after master server recovers normally, master server is recovered normal message informing from server, and reception receives and the data processed from server during the master server that server sends breaks down.
From server also for, when from server fail, the message informing master server broken down, and recover from server normal after will recover normal message informing master server from server, and receive receiving and the data processed from master server during server fail of master server transmission.
Compared with prior art, the present invention includes: master server receives the data that client sends, and these data sent to and be positioned at backing up from server of different machine rooms from master server, and receive the confirmation receiving these data returned from server.Master server processes the data received from client and the data after process is returned client.By the solution of the present invention, can keep the broadband of client consume and program constant.
Accompanying drawing explanation
Be described the accompanying drawing in the embodiment of the present invention below, the accompanying drawing in embodiment is for a further understanding of the present invention, is used from explanation the present invention, does not form limiting the scope of the invention with specification one.
Fig. 1 is data processing method flow chart of the present invention;
Fig. 2 is data processing structure figure of the present invention;
Fig. 3 is traditional two-node cluster hot backup scheme topology and two-node cluster hot backup scheme topology comparison diagram of the present invention;
Fig. 4 is data handling system composition frame chart of the present invention.
Embodiment
For the ease of the understanding of those skilled in the art, below in conjunction with accompanying drawing, the invention will be further described, can not be used for limiting the scope of the invention.
In order to achieve the above object, the present invention proposes a kind of data processing method, as shown in Figure 1 and Figure 2, the method comprises:
S101, master server receive the data that client sends, and these data are sent to and be positioned at backing up from server of different machine rooms from master server, and receive the confirmation receiving these data returned from server.
Preferably, the method also comprises:
From server the data that master server sends are stored into memory database and back up, when the quantity of the data stored in memory database reaches default storage threshold, the data stored from server process memory database, and by the data conversion storage after process in non-memory database.
In embodiments of the present invention, master server and being placed in respectively in different machine rooms from server.As shown in Figure 3, wherein, (a) is traditional two-node cluster hot backup scheme topological diagram, and (b) is two-node cluster hot backup scheme topological diagram of the present invention.Further, can be one or more from server, all be positioned in different machine rooms from master server.This offsite active standby hot reserve scheme, when somewhere goes wrong, another place can provide service in time, and user can not be subject to obvious impact.
In addition, in embodiments of the present invention, master server receives the data that client sends, and these data are sent to be positioned at backing up from server of different machine rooms from master server, and receive the confirmation receiving these data returned from server, here master server is in fact the role having served as a control end, and the data that this control end is responsible for client sends are carried out distributing and process the result returned, and the consumption of the broadband of client and program are remained unchanged.
S102, master server process the data received from client and the data after process are returned client.
Preferably, the method also comprises:
When master server breaks down, be that master server carries out work from Server switching, and before handover by receive from client and untreated data process.
When from server fail, master server continues the data receiving client transmission, processes these data, and the data after process are returned client.
Preferably, the method also comprises:
When master server breaks down, the message informing that master server is broken down is from server, and after master server recovers normally, master server is recovered normal message informing from server, and reception receives and the data processed from server during the master server that server sends breaks down.
When from server fail, from the message informing master server that server is broken down, and recover from server normal after will recover normal message informing master server from server, and receive receiving and the data processed from master server during server fail of master server transmission.
In order to achieve the above object, the invention allows for a kind of data handling system 01, as shown in Figure 4, this system comprises: master server 02 and one or more from server 03.
Master server 02 receives the data that client sends, and these data is sent to and be positioned at backing up from server 03 of different machine rooms from master server, and receives the confirmation receiving data returned from server 03.
Master server 02 processes the data received from client and the data after process is returned client.
Preferably, from server 03 for, the data that master server sends are stored in memory database and back up, when the quantity of the data stored in memory database reaches default storage threshold, also for the treatment of the data stored in memory database, and by the data conversion storage after process in non-memory database.
Preferably,
From server 03 also for, when master server 02 breaks down, switch to master server 02 to carry out work, and before handover by receive from client and untreated data process;
Master server 02 also for, when breaking down from server 03, continue receive client send data, these data are processed, and by process after data return client.
Preferably,
Master server 02 also for, when master server 02 breaks down, the message informing broken down is from server 03, and after master server 03 recovers normally, master server 02 is recovered normal message informing from server 03, and reception receives and the data processed from server 03 during the master server 02 that server 03 sends breaks down.
From server 03 also for, when breaking down from server 03, the message informing master server 02 broken down, and recover from server 03 normal after will recover normal message informing master server 02 from server 03, and receive that master server 02 sends break down from server 03 during master server 02 receive and the data processed.
Compared with prior art, the present invention includes: master server receives the data that client sends, and these data sent to and be positioned at backing up from server of different machine rooms from master server, and receive the confirmation receiving these data returned from server.Master server processes the data received from client and the data after process is returned client.By the solution of the present invention, the broadband consumption program of client can be kept constant.
It should be noted that; above-described embodiment is only understand for the ease of those skilled in the art; be not limited to protection scope of the present invention; under the prerequisite not departing from inventive concept of the present invention, any apparent replacement and improvement etc. that those skilled in the art make the present invention are all within protection scope of the present invention.

Claims (8)

1.一种数据处理方法，其特征在于，所述方法包括：1. A data processing method, characterized in that the method comprises: 主服务器接收客户端发送的数据，并将所述数据发送给与所述主服务器位于不同的机房的从服务器进行备份，并接收所述从服务器返回的已经接收到所述数据的确认信息；The master server receives the data sent by the client, and sends the data to a slave server located in a different computer room from the master server for backup, and receives confirmation information returned by the slave server that the data has been received; 所述主服务器对从所述客户端接收到的所述数据进行处理并将处理后的所述数据返回所述客户端。The main server processes the data received from the client and returns the processed data to the client. 2.如权利要求1所述的数据处理方法，其特征在于，所述方法还包括：2. The data processing method according to claim 1, wherein the method further comprises: 所述从服务器将所述主服务器发送的所述数据存储到内存数据库中进行备份，当所述内存数据库中存储的所述数据的数量达到预设的存储阈值时，所述从服务器处理所述内存数据库中存储的所述数据，并将处理后的所述数据转存到非内存数据库中。The slave server stores the data sent by the master server in an in-memory database for backup, and when the amount of the data stored in the in-memory database reaches a preset storage threshold, the slave server processes the The data stored in the memory database, and the processed data are transferred to the non-memory database. 3.如权利要求1所述的大数据传输方法，其特征在于，所述方法还包括：3. big data transmission method as claimed in claim 1, is characterized in that, described method also comprises: 当所述主服务器发生故障时，所述从服务器切换为所述主服务器进行工作，并在切换之前将从所述客户端接收到的并且未处理的所述数据进行处理；When the master server fails, the slave server switches to work for the master server, and processes the unprocessed data received from the client before switching; 当所述从服务器发生故障时，所述主服务器继续接收所述客户端发送的数据，对所述数据进行处理，并将处理后的所述数据返回所述客户端。When the slave server fails, the master server continues to receive the data sent by the client, process the data, and return the processed data to the client. 4.如权利要求3所述的数据处理方法，其特征在于，所述方法还包括：4. the data processing method as claimed in claim 3, is characterized in that, described method also comprises: 当所述主服务器发生故障时，所述主服务器将其出现故障的消息通知所述从服务器，并且在所述主服务器恢复正常之后将所述主服务器恢复正常的消息通知所述从服务器，并接收所述从服务器发送的所述主服务器发生故障期间所述从服务器接收并处理的数据；When the master server fails, the master server notifies the slave server of its failure, and notifies the slave server of the master server recovery after the master server returns to normal, and receiving the data received and processed by the slave server during the failure of the master server sent by the slave server; 当所述从服务器发生故障时，所述从服务器将其出现故障的消息通知所述主服务器，并且在所述从服务器恢复正常之后将所述从服务器恢复正常的消息通知所述主服务器，并接收所述主服务器发送的所述从服务器发生故障期间所述主服务器接收并处理的数据。When the slave server fails, the slave server notifies the master server of the failure message, and notifies the master server of the slave server recovery message after the slave server returns to normal, and The data received and processed by the master server during the failure of the slave server sent by the master server is received. 5.一种数据处理系统，其特征在于，所述系统包括：主服务器和一个或多个从服务器；5. A data processing system, characterized in that the system comprises: a master server and one or more slave servers; 所述主服务器接收客户端发送的数据，并将所述数据发送给与所述主服务器位于不同的机房的从服务器进行备份，并接收所述从服务器返回的已经接收到所述数据的确认信息；The master server receives the data sent by the client, and sends the data to a slave server located in a different computer room from the master server for backup, and receives confirmation information returned by the slave server that the data has been received ; 所述主服务器对从所述客户端接收到的所述数据进行处理并将处理后的所述数据返回所述客户端。The main server processes the data received from the client and returns the processed data to the client. 6.如权利要求5所述的数据处理系统，其特征在于，所述系统还包括一个或多个从服务器；6. The data processing system of claim 5, wherein the system further comprises one or more slave servers; 所述从服务器用于，将所述主服务器发送的所述数据存储到内存数据库中进行备份，当所述内存数据库中存储的所述数据的数量达到预设的存储阈值时，还用于处理所述内存数据库中存储的所述数据，并将处理后的所述数据转存到非内存数据库中。The slave server is used to store the data sent by the master server in an in-memory database for backup, and when the amount of the data stored in the in-memory database reaches a preset storage threshold, it is also used to process storing the data in the memory database, and dumping the processed data into a non-memory database. 7.如权利要求5所述的数据处理系统，其特征在于，7. The data processing system of claim 5, wherein: 所述从服务器还用于，当所述主服务器发生故障时，切换为所述主服务器进行工作，并在切换之前将从所述客户端接收到的并且未处理的所述数据进行处理；The slave server is also used to, when the master server fails, switch to work for the master server, and process the unprocessed data received from the client before switching; 所述主服务器还用于，当所述从服务器发生故障时，继续接收所述客户端发送的数据，对所述数据进行处理，并将处理后的所述数据返回所述客户端。The master server is further configured to, when the slave server fails, continue to receive the data sent by the client, process the data, and return the processed data to the client. 8.如权利要求7所述的数据处理系统，其特征在于，8. The data processing system of claim 7, wherein: 所述主服务器还用于，当所述主服务器发生故障时，将其出现故障的消息通知所述从服务器，并且在所述主服务器恢复正常之后将所述主服务器恢复正常的消息通知所述从服务器，并接收所述从服务器发送的所述主服务器发生故障期间所述从服务器接收并处理的数据；The master server is further configured to, when the master server fails, notify the slave server of a failure message, and notify the slave server of a message of the master server returning to normal after the master server returns to normal. a slave server, and receive the data received and processed by the slave server during the failure of the master server sent by the slave server; 所述从服务器还用于，当所述从服务器发生故障时，将其出现故障的消息通知所述主服务器，并且在所述从服务器恢复正常之后将所述从服务器恢复正常的消息通知所述主服务器，并接收所述主服务器发送的所述从服务器发生故障期间所述主服务器接收并处理的数据。The slave server is also used for notifying the master server of a failure message when the slave server fails, and notifying the master server of a recovery message of the slave server after the slave server returns to normal. The master server, and receives the data sent by the master server and received and processed by the master server during the failure of the slave server.
CN201510523989.9A 2015-08-24 2015-08-24 A data processing method and system Pending CN105162560A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510523989.9A CN105162560A (en) 2015-08-24 2015-08-24 A data processing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510523989.9A CN105162560A (en) 2015-08-24 2015-08-24 A data processing method and system

Publications (1)

Publication Number Publication Date
CN105162560A true CN105162560A (en) 2015-12-16

Family

ID=54803330

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510523989.9A Pending CN105162560A (en) 2015-08-24 2015-08-24 A data processing method and system

Country Status (1)

Country Link
CN (1) CN105162560A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017101731A1 (en) * 2015-12-18 2017-06-22 阿里巴巴集团控股有限公司 Service providing method and system for database
CN107633026A (en) * 2017-08-30 2018-01-26 深圳云天励飞技术有限公司 Data syn-chronization abnormality eliminating method, device and server
CN108100292A (en) * 2016-11-24 2018-06-01 中航贵州飞机有限责任公司 A kind of method that airplane fault is excluded based on big data
CN109213631A (en) * 2018-08-22 2019-01-15 郑州云海信息技术有限公司 A kind of transaction methods, device, equipment and readable storage medium storing program for executing

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040205382A1 (en) * 2003-03-27 2004-10-14 Yusuke Noda Methods and apparatus for recovering work of one computer by another computers
CN101414917A (en) * 2007-10-19 2009-04-22 华为技术有限公司 Method for saving internal memory space, data management network element and network system
CN103067206A (en) * 2012-12-28 2013-04-24 无锡博欧节能科技有限公司 Internet of things across-machine room distributed type full automatic hot standby server switching system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040205382A1 (en) * 2003-03-27 2004-10-14 Yusuke Noda Methods and apparatus for recovering work of one computer by another computers
CN101414917A (en) * 2007-10-19 2009-04-22 华为技术有限公司 Method for saving internal memory space, data management network element and network system
CN103067206A (en) * 2012-12-28 2013-04-24 无锡博欧节能科技有限公司 Internet of things across-machine room distributed type full automatic hot standby server switching system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ZHANG988119: ""XXXX数据库系统双机双柜解决方案"", 《百度文库》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017101731A1 (en) * 2015-12-18 2017-06-22 阿里巴巴集团控股有限公司 Service providing method and system for database
CN108100292A (en) * 2016-11-24 2018-06-01 中航贵州飞机有限责任公司 A kind of method that airplane fault is excluded based on big data
CN107633026A (en) * 2017-08-30 2018-01-26 深圳云天励飞技术有限公司 Data syn-chronization abnormality eliminating method, device and server
CN109213631A (en) * 2018-08-22 2019-01-15 郑州云海信息技术有限公司 A kind of transaction methods, device, equipment and readable storage medium storing program for executing

Similar Documents

Publication Publication Date Title
CN105554106A (en) Memcache distributed caching system
CN106656617B (en) Main/standby switching method and device
CN102984012B (en) Management method and system for service resources
JP6256086B2 (en) Information processing system, movement control method, and movement control program
CN105162560A (en) A data processing method and system
JP5858144B2 (en) Information processing system, failure detection method, and information processing apparatus
US20150358402A1 (en) Efficient and scalable pull-based load distribution
CN107038075B (en) Message queue system and method for realizing message communication
CN105138276A (en) Data storage method and data storage system
CN113905005A (en) Client state updating method and device for instant messaging
CN103607310A (en) Method for arbitration of remote disaster recovery
CN103297502B (en) A kind of SiteServer LBS and method
CN105471995A (en) High-availability implementation method for large-scale Web server cluster based on SOA
EP3076694B1 (en) Multiple connection management for bluetooth low energy devices
EP3280094A1 (en) Disaster recovery method, device, and system
CN105704256B (en) A kind of IP address management methods, devices and systems
CN107203443A (en) A kind of method and apparatus of the virtual machine High Availabitity based on KVM virtualization
CN111314098A (en) Method and device for realizing VIP address drift in HA system
CN104202204B (en) Clock synchronization control method, apparatus and system based on SNTP
CN103441987A (en) Method and device for managing dual-computer firewall system
CN104965793B (en) A kind of cloud storage data node device
CN101827035A (en) Method for ensuring graceful restarting and dual master control network device
CN105049261A (en) Processing method and system for dual-computer hot-standby data
CN105049263A (en) Data processing method and data processing system
CN111064618B (en) Method, device, equipment and storage medium for realizing high availability of server

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20151216

RJ01 Rejection of invention patent application after publication