WO2017162176A1 - Storage system, access method for storage system, and access device for storage system - Google Patents
Storage system, access method for storage system, and access device for storage system Download PDFInfo
- Publication number
- WO2017162176A1 WO2017162176A1 PCT/CN2017/077753 CN2017077753W WO2017162176A1 WO 2017162176 A1 WO2017162176 A1 WO 2017162176A1 CN 2017077753 W CN2017077753 W CN 2017077753W WO 2017162176 A1 WO2017162176 A1 WO 2017162176A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- storage
- sas
- node
- nodes
- network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0635—Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration
Definitions
- the present invention relates to the field of data storage technologies, and in particular, to a storage system, an access control method for a storage system, and an access control device for the storage system.
- Multi-path storage technology can guarantee storage systems. It is widely used for its usability. Based on the multi-path storage technology, when one access path in the storage system fails, the server can continuously access the storage device through another access path.
- FIG. 1 is a schematic structural diagram of a conventional multi-path storage system provided by the prior art.
- the conventional multi-path storage system is composed of a server, a plurality of switches, a plurality of storage device controllers, and a storage device, wherein the storage device is composed of at least one storage medium.
- Different interfaces of the server are connected to different switches, and different switches are connected to different storage device controllers.
- the server wants to access the storage medium in the storage device, the server first connects to a storage device controller through a switch, and then locates the specific storage medium through the storage device controller.
- the server can connect to another storage device controller through another switch, and then locate the storage medium through the other storage device controller, thereby implementing multi-path switching. Since the path in the conventional multi-path storage system is built based on the IP address, the server is actually connected to the IP address of the different storage device controller through a plurality of different paths.
- the multi-path switching can only be implemented to the level of the storage device controller, and the multi-path cannot be implemented between the storage device controller and the specific storage medium. Switch. Therefore, the conventional multi-path storage system can only cope with the network failure between the server and the storage device controller, and cannot cope with a single point failure of the storage device controller itself.
- the embodiments of the present invention provide a storage system, an access control method for the storage system, and an access control device for the storage system, which solves the problem that the traditional multi-path storage system cannot achieve multi-path switching to the storage medium. .
- An embodiment of the invention provides a storage system, including:
- SAS storage network including at least one SAS switch
- At least two storage nodes connected to the SAS storage network At least two storage nodes connected to the SAS storage network
- At least one storage device connected to the SAS storage network
- At least one computing node each storage node corresponding to one or more computing nodes of the at least one computing node;
- Each storage device includes at least one storage medium having a SAS storage network configured to enable each storage node to directly access all of the storage media without resorting to other storage nodes.
- An embodiment of the present invention further provides an access control method for a storage system, where the storage system includes: a SAS storage network, including at least one SAS switch; at least two storage nodes connected to the SAS storage network; at least one storage a device, coupled to the SAS storage network; and at least one compute node, each storage node corresponding to one or more compute nodes of the at least one compute node; wherein each storage device includes at least one storage having a SAS interface Media, the SAS storage network is configured such that each storage node can directly access all storage media without resorting to other storage nodes; the method includes:
- the computing node connected to the failed storage node reads and writes the storage medium through other storage nodes.
- An embodiment of the present invention further provides an access control device for a storage system.
- the storage system includes: a SAS storage network including at least one SAS switch; at least two storage nodes connected to the SAS storage network; at least one storage device connected to the SAS storage network; and at least one computing node, each One storage node corresponds to one or more of the at least one computing node; wherein each storage device includes at least one storage medium having a SAS interface, the SAS storage network being configured such that each storage node can Direct access to all storage media without the need for additional storage nodes; the device includes:
- the access path switching module is configured to: when any one of the storage nodes fails, cause the computing node connected to the failed storage node to read and write the storage medium through the other storage node.
- An embodiment of the present invention also provides a computer program product embodied in a computer readable storage medium having computer readable program code portions stored therein, the computer readable program code portion being Configured to perform an access control method to the storage system as described.
- the storage system, the access control method for the storage system, and the access control device for the storage system are provided by the SAS storage network based on the SAS switch, and the storage medium in the storage device is connected through the SAS interface of the storage device.
- the storage device, the storage node and the storage device also access the SAS storage network through respective SAS interfaces, so that the storage node can directly access the specific storage medium based on the SAS address of the storage medium.
- all storage media in the storage device constitute a global storage pool, and each storage node can pass through the SAS switch. Read any storage medium in the global storage pool. This enables multipath switching between storage nodes connected to storage media.
- FIG. 1 is a schematic structural diagram of a conventional multi-path storage system provided by the prior art.
- FIG. 2 is a schematic structural diagram of a storage system according to an embodiment of the invention.
- FIG. 3 is a schematic structural diagram of a storage system according to another embodiment of the present invention.
- FIG. 4 is a schematic structural diagram of a conventional storage system provided by the prior art.
- FIG. 5 is a schematic structural diagram of a storage system according to another embodiment of the present invention.
- FIG. 2 is a schematic structural diagram of a storage system according to an embodiment of the present invention.
- the storage system includes: a SAS storage network including at least one SAS switch; at least two storage nodes connected to the SAS storage network; at least one storage device connected to the SAS storage network; and at least a computing node, each storage node corresponding to one or more computing nodes of the at least one computing node; wherein each storage device includes at least one storage medium having a SAS interface, the SAS storage network being configured such that each A storage node can directly access all storage media without the need for additional storage nodes.
- the storage node is a software module that provides a storage service, instead of a hardware server including a storage medium in a general sense.
- the storage nodes in the description of the subsequent embodiments also refer to the same concepts, and therefore will not be described again.
- the storage medium in the storage device is connected to the storage device through its SAS interface, and the storage node and the storage device are also accessed through the respective SAS interfaces.
- the SAS storage network enables the storage node to directly access a particular storage medium based on the SAS address of the storage medium.
- all storage media in the storage device constitute a global storage pool, and each storage node can pass through the SAS switch. Read any storage medium in the global storage pool. This enables multipath switching between storage nodes connected to storage media.
- the storage system of the storage system adopts a SAS storage network composed of SAS switches. Compared with the traditional IP-based storage solution, it has the advantages of high performance, large bandwidth, and a large number of disks per device.
- HBA host adapter
- the storage provided by the SAS system can be easily accessed by multiple servers connected simultaneously.
- the SAS switch is connected to the storage device through a SAS line, and the storage device and the storage medium are also connected by a SAS interface.
- the storage device internally connects the SAS channel to each storage medium (can be set inside the storage device)
- a SAS switch chip the SAS storage network can be directly connected to the storage medium, which has unique advantages over existing multi-paths built on FC networks or Ethernet.
- the bandwidth of the SAS storage network can reach 24Gb or 48Gb, which is several times that of Gigabit Ethernet, and several times that of expensive 10 Gigabit Ethernet.
- the link layer SAS has an order of magnitude improvement over the IP network.
- the transport layer because the TCP protocol is closed three times, the overhead is high, and the TCP delay acknowledgement mechanism and slow start sometimes cause a delay of 100 milliseconds, while the delay of the SAS protocol is only a fraction of that of TCP. There is a greater improvement.
- SAS storage networks offer significant advantages in terms of bandwidth and latency over Ethernet-based TCP/IP.
- each computing node can pass any A storage node is coupled to each of the at least one storage device, thereby enabling multi-path access by the same compute node through different storage nodes.
- Each storage node in the formed storage system architecture has a standby node, which can effectively cope with a single point failure of the storage node, and the path switching process can be completed immediately after a single point of failure, and the fault tolerance has no switching takeover time.
- an embodiment of the present invention further provides an access control method for a storage system, including: a computing node connected to a faulty storage node when any one of the storage nodes fails Read and write storage media through other storage nodes.
- a computing node connected to a faulty storage node when any one of the storage nodes fails Read and write storage media through other storage nodes.
- the physical server where each storage node is located has at least one SAS interface, and at least one SAS interface of the physical server where each storage node is located is respectively connected to at least one SAS switch; each storage device has at least one A SAS interface, at least one SAS interface of each storage device is respectively connected to at least one SAS switch.
- each storage node can access the storage medium through at least one SAS path.
- the SAS path is composed of any SAS interface of the physical server where the storage node currently accessing the storage node, a SAS switch corresponding to any SAS interface, a SAS interface of the storage device to be accessed, and a SAS interface of the storage medium to be accessed.
- the same computing node can access the storage medium through at least one SAS path of the same storage node, in addition to multi-path access through different storage nodes.
- the computing node can implement multi-path access through multiple SAS paths of the storage node. Therefore, in summary, each computing node can access the storage medium through at least two access paths; wherein at least two access paths include different SAS paths of the same storage node, or any SAS of different storage nodes. path.
- FIG. 3 is a schematic structural diagram of a storage system according to another embodiment of the present invention.
- the storage system includes at least two SAS switches; each physical node where the storage node is located has at least two SAS interfaces, and the physical server where each storage node is located At least two SAS interfaces are respectively connected to at least two SAS switches; each storage device has at least two SAS interfaces, and at least two SAS interfaces of each storage device are respectively connected to at least two SAS switches.
- each of the at least two storage nodes can access the storage medium through at least two SAS paths, where each SAS path corresponds to a different SAS interface of the physical server where the storage node is located, and the different SAS interfaces correspond to Different SAS switches.
- each storage device has at least two SAS interfaces, and the storage medium in each storage device is fixed, different SAS interfaces of the same storage device are connected to the same storage medium through different lines. .
- an embodiment of the present invention further provides an access control method for a storage system, including: a storage node connected to a faulty SAS path when any one SAS path fails.
- the storage medium is read and written by the other SAS path.
- the SAS path is any SAS interface of the physical server where the storage node currently accessing the SAS interface, the SAS switch corresponding to any SAS interface, the SAS interface of the storage device to be accessed, and the to-be-accessed.
- the SAS interface of the storage medium is constructed.
- the SAS storage network includes multiple SAS switches
- different storage nodes can still perform multi-path access to the storage medium based on the same SAS switch, that is, when any one storage node fails, the computing node connected to the failed storage node
- the storage medium can be read and written by other storage nodes but based on the same SAS switch.
- each storage medium in the SAS storage network has a SAS address
- the SAS address of the storage device to be connected in the SAS storage network is used to locate the location of the storage medium to be connected.
- the SAS address can be a globally unique WWN (World Wide Name) code.
- FIG. 4 shows a schematic diagram of the architecture of a prior art storage system.
- each storage node S is connected to a TCP/IP network (through a core switch) through an access network switch.
- Each storage node is a separate physical server, and each server has its own storage medium.
- Each storage node is connected by a storage network such as an IP network to form a storage pool.
- each compute node C is also connected to the TCP/IP network (through the core network switch) through the access network switch to access the entire storage pool over the TCP/IP network.
- the storage node is located on the storage medium side, or strictly speaking, the storage medium is the physical machine where the storage node is located. Built-in disk.
- the physical machine where the storage node is located is independent of the storage device, and each storage node and one computing node are set in a physical server, and the physical server passes through the SAS storage network and the storage device. connection.
- the storage node can directly access the storage medium through the SAS storage network, so the storage device is more used as a channel connecting the storage medium and the storage network.
- the aggregated storage system in which the computing node and the storage node are located in the same physical machine constructed by using the embodiment of the present invention can reduce the number of physical devices required, thereby reducing the cost.
- the compute node can also access the storage resources it wishes to access locally.
- the data exchange between the two can be as simple as shared memory, and the performance is particularly excellent. In this way, when dynamic balancing is required, physical data does not need to be migrated in different storage media, and only storage media managed by different storage nodes need to be balanced.
- the storage node is independent of the storage device setting, and the storage node and the computing node, and the I/O data path length between the computing node and the storage medium includes: (1) storage medium to storage Nodes; and (2) storage nodes to compute nodes (CPU bus lanes) that are aggregated on the same physical server.
- the I/O data path length between the computing node and the storage medium includes: (1) storage medium to the storage node; (2) storage node to the storage network. Access network switch; (3) storage network access network switch to core network switch; (4) core network switch to computing network access network switch; and (5) computing network access network switch to computing node.
- the total data path of the storage system of the embodiment of the present invention is only close to item (1) of the conventional storage system. That is, the storage system provided by the embodiment of the present invention can greatly improve the I/O channel performance of the storage system by extremely compressing the I/O data path length, and the actual running effect is very close to the I/O of the local hard disk. O channel.
- each computing node has a storage node
- the computing nodes in one physical server can also pass through the existence of a network connection between the physical servers.
- a storage node in another physical server accesses the storage medium so that the same compute node can perform multi-path access to the storage medium through different storage nodes.
- the storage node may be a virtual machine of the physical server, a container, a module running directly on the physical operating system of the server, or a combination thereof (for example, a firmware of a part of the storage node on the expansion card, The other part is a module in the physical operating system, and some are in the virtual machine); the computing node can also be a virtual machine of the same physical machine server, a container, and a module running directly on the physical operating system of the server. Or the combination above.
- each storage node may correspond to one or more compute nodes.
- one physical server may be divided into multiple virtual machines, one of which is used as a storage node, and the other virtual machine is used as a computing node; or a module on the physical OS is used as a storage node, so as to implement Better performance.
- the virtualization technology forming the virtual machine may be KVM or Zen or VMware or Hyper-V virtualization technology
- the container technology forming the container may be Docker or Rocket or Odin or Chef or LXC or Vagrant. Or Ansible or Zone or Jail or Hyper-V container technology.
- each storage node is only responsible for managing a fixed storage medium at the same time, and one storage medium is not simultaneously written by multiple storage nodes to avoid data conflict, thereby enabling each storage node to be able to implement each storage node.
- the storage medium managed by it is accessed without resorting to other storage nodes, and the integrity of the data stored in the storage system can be guaranteed.
- all the storage media in the system may be divided according to storage logic.
- the storage pool of the entire system may be divided into a logical storage hierarchy structure such as a storage area, a storage group, and a storage block.
- the storage block is the smallest storage unit.
- the storage pool may be divided into at least two storage areas.
- each storage area may be divided into at least one storage group. In a preferred embodiment, each storage area is divided into at least two storage groups.
- the storage area and the storage group can be merged such that one level can be omitted in the storage hierarchy.
- each storage area may be composed of at least one storage block, wherein the storage block may be a complete storage medium or a part of a storage medium.
- each storage area may be composed of at least two storage blocks, and when any one of the storage blocks fails, the complete storage block may be calculated from the remaining storage blocks in the group.
- the data is stored.
- the redundant storage mode can be multi-copy mode, independent redundant disk array (RAID) mode, and erasure code mode.
- the redundant storage mode can be established by the ZFS file system.
- the plurality of storage blocks included in each storage area (or storage group) are not located in the same storage medium, or even located in the same storage medium. In the storage device. In an embodiment of the invention, any two storage blocks included in each storage area (or storage group) are not located in the same storage medium/storage device. In another embodiment of the present invention, the number of storage blocks located in the same storage medium/storage device in the same storage area (or storage group) is preferably less than or equal to the redundancy of the redundant storage.
- the redundant storage redundancy is 1, and the number of storage blocks in the same storage group of the same storage device is at most 1; for RAID 6, the redundant storage is With a redundancy of 2, the number of memory blocks in the same storage group on the same storage device is up to 2.
- each storage node can only read and write its own managed storage area. Since the read operations of the same storage block by multiple storage nodes do not conflict with each other, and multiple storage nodes write one storage block at the same time, conflicts are easily generated. Therefore, in another embodiment, each storage node can only Write the storage area managed by yourself, but you can read the storage area managed by yourself and the storage area managed by other storage nodes, that is, the write operation is local, but the read operation can be global.
- the storage system may further include a storage control node coupled to the SAS storage network for determining a storage area managed by each storage node.
- Each storage node may include a storage allocation module for determining a storage area managed by the storage node, which may be implemented by a communication and coordination processing algorithm between each storage allocation module included in each storage node, and the algorithm may For example, in order to load balance between storage nodes as a principle.
- the storage medium may include, but is not limited to, a hard disk, a flash memory, an SRAM, a DRAM, an NVME, or an NVRAM.
- the access interface of the storage medium may include, but is not limited to, a SAS interface, a SATA interface, and a PCI/e interface. DIMM interface, NVMe interface, SCSI interface, AHCI interface.
- FIG. 5 is a schematic structural diagram of a storage system according to another embodiment of the present invention.
- the storage device in the storage system 30 is constructed as a plurality of JBODs 307-310, which are respectively connected to two SAS switches 305 and 306 through SAS data lines, and the two SAS switches constitute a storage system.
- the switching core of the SAS storage network has at least two servers 301 and 302.
- the server 301 has at least two adapters 301a and 301b, at least two adapters 301a and 301b are respectively connected to at least two SAS switches 305 and 306;
- the server 302 has at least two adapters 302a and 302b, and at least two adapters 302a and 302b respectively At least two SAS switches 305 and 306 are connected.
- the access control method provided by an embodiment of the present invention may further include: when any one of the storage nodes fails, the storage node is connected to the corresponding SAS switch through another adapter.
- the server 302a of the server 302 fails, the server 302 cannot be connected to the SAS switch 305 through the adapter 302a, and the server 302 can still be connected to the SAS switch 306 through the adapter 302b.
- Each server has a storage node that manages some or all of the disks in all JBOD disks using information obtained from the SAS links. Specifically, the storage area, the storage group, and the storage block described above in the application file may be used to divide the JBOD disk into different storage groups. Each storage node manages one or more sets of such storage groups. When each storage group adopts redundant storage mode, it can store redundant The stored metadata exists on the disk so that the redundant storage can be directly identified from the disk by other storage nodes.
- the storage node can install a monitoring and management module that is responsible for monitoring the status of local storage and other servers.
- a JBOD is abnormal overall or a disk on the JBOD is abnormal, data reliability is ensured by redundant storage.
- the management module in the storage node on another pre-configured server will locally identify and take over the disk managed by the storage node of the failed server according to the data on the disk.
- the storage node originally provided by the storage node of the faulty server will also be extended on the storage node on the new server. So far, a new highly available global storage pool structure has been implemented.
- the exemplary storage system 30 is constructed to provide a multi-point, controllable, globally accessible storage pool.
- the hardware uses multiple servers to provide external services, and uses JBOD to store disks.
- Multiple JBODs are connected to two SAS switches, and the two switches are respectively connected to the two HBA cards of the server, thereby ensuring that all disks on the JBOD can be accessed by all servers.
- the SAS redundant link also ensures high availability on the link.
- each server uses redundant storage technology to select redundant disks from each JBOD to avoid redundant data loss.
- the module that monitors the overall state will schedule another server to access the disks managed by the storage node of the failed server through the SAS channel, and quickly take over the disks that the other party is responsible for, achieving high-available global storage.
- JBOD storage disk has been described as an example in FIG. 5, it should be understood that the embodiment of the present invention as shown in FIG. 5 also supports a storage device other than JBOD.
- the above is an example in which one storage medium (entire) is used as one storage block, and the same applies to a case where a part of one storage medium is used as one storage block.
- An embodiment of the present invention further provides an access control device for a storage system, where the storage system includes: a SAS storage network, including at least one SAS switch; at least two storage nodes connected to the SAS storage network; at least one a storage device connected to the SAS storage network; And at least one computing node, each storage node corresponding to one or more of the at least one computing node; wherein each storage device includes at least one storage medium having a SAS interface, the SAS storage network configured to Enabling each storage node to directly access all storage media without resorting to other storage nodes; the device includes:
- the access path switching module is configured to: when any one of the storage nodes fails, cause the computing node connected to the failed storage node to read and write the storage medium through the other storage node.
- the SAS storage network includes at least two SAS switches, each of which has a physical server having at least two SAS interfaces, and at least two SAS interfaces of the physical server where each storage node is located and at least The two SAS switches are connected to each other; each storage device has at least two SAS interfaces, and at least two SAS interfaces of each storage device are respectively connected to at least two SAS switches; in this case, the access path switching module can be further configured as When any SAS path fails, the storage node connected to the faulty SAS path reads and writes the storage medium through other SAS paths; wherein the SAS path is any SAS interface of the physical server where the storage node currently accessing is located, It should be composed of a SAS switch of any SAS interface, a SAS interface of the storage device to be accessed, and a SAS interface of the storage medium to be accessed.
- An embodiment of the invention further provides a computer program product of a computer readable storage medium, comprising computer program code, which when executed by a processor, enables the processor to be implemented according to the method of the embodiments of the invention
- the access control method for the storage system described in the embodiment can be any tangible medium such as a floppy disk, CD-ROM, DVD, hard drive, or even network media.
- an implementation form of the embodiments of the present invention described above may be a computer program product
- the method or apparatus of the embodiments of the present invention may be implemented in software, hardware, or a combination of software and hardware.
- the hardware portion can be implemented using dedicated logic; the software portion can be stored in memory and executed by a suitable instruction execution system, such as a microprocessor or dedicated design hardware.
- a suitable instruction execution system such as a microprocessor or dedicated design hardware.
- processor control code such as a carrier medium such as a magnetic disk, CD or DVD-ROM, a programmable memory such as a read only memory (firmware), or an optical or electronic signal.
- Such code is provided on the data carrier of the carrier.
- the method and apparatus of the present invention may be implemented by hardware circuits such as very large scale integrated circuits or gate arrays, semiconductors such as logic chips, transistors, etc., or programmable hardware devices such as field programmable gate arrays, programmable logic devices, etc., also It can be implemented by software executed by various types of processors, or by a combination of the above-described hardware circuits and software such as firmware.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Hardware Redundancy (AREA)
- Debugging And Monitoring (AREA)
Abstract
Description
本发明涉及数据存储技术领域,具体涉及一种存储系统、对存储系统的访问控制方法和对存储系统的访问控制装置。The present invention relates to the field of data storage technologies, and in particular, to a storage system, an access control method for a storage system, and an access control device for the storage system.
随着计算机应用规模越来越大,对存储空间的需求也与日俱增,因此构建高可用性和高性能的存储系统逐渐成为数据存储领域的一个研发热点,多路径存储技术因可很好的保证存储系统的可用性而得到广泛应用。基于多路径存储技术,当存储系统中的一条访问路径出现故障时,服务器可通过另一条访问路径持续访问存储设备。With the increasing scale of computer applications and the increasing demand for storage space, building high-availability and high-performance storage systems has become a research and development hotspot in the field of data storage. Multi-path storage technology can guarantee storage systems. It is widely used for its usability. Based on the multi-path storage technology, when one access path in the storage system fails, the server can continuously access the storage device through another access path.
图1所示为现有技术提供的一种传统多路径存储系统的结构示意图。如图1所示,该传统多路径存储系统由服务器、多个交换机、多个存储设备控制器和存储设备构成,其中的存储设备由至少一个存储介质构成。服务器的不同接口分别与不同的交换机连接,不同的交换机又与不同的存储设备控制器连接。这样当服务器要访问存储设备中的存储介质时,服务器先通过一个交换机连接到一个存储设备控制器,然后再通过该存储设备控制器定位到具体的存储介质。当这条访问路径出现故障时,服务器则可通过另一个交换机连接到另一个存储设备控制器,然后再通过该另一个存储设备控制器定位到该存储介质,由此实现多路径切换。由于该传统多路径存储系统中路径是基于IP地址构建的,因此服务器实际上是通过多个不同路径连接到不同存储设备控制器的IP地址。FIG. 1 is a schematic structural diagram of a conventional multi-path storage system provided by the prior art. As shown in FIG. 1, the conventional multi-path storage system is composed of a server, a plurality of switches, a plurality of storage device controllers, and a storage device, wherein the storage device is composed of at least one storage medium. Different interfaces of the server are connected to different switches, and different switches are connected to different storage device controllers. Thus, when the server wants to access the storage medium in the storage device, the server first connects to a storage device controller through a switch, and then locates the specific storage medium through the storage device controller. When the access path fails, the server can connect to another storage device controller through another switch, and then locate the storage medium through the other storage device controller, thereby implementing multi-path switching. Since the path in the conventional multi-path storage system is built based on the IP address, the server is actually connected to the IP address of the different storage device controller through a plurality of different paths.
由此可见,在传统多路径存储系统中,多路径的切换仅能实现到存储设备控制器的层面,而存储设备控制器与具体的存储介质之间无法实现多路径 切换。因而该传统多路径存储系统仅能应对服务器与存储设备控制器之间的网络故障,无法应对存储设备控制器本身的单点故障。It can be seen that in the traditional multi-path storage system, the multi-path switching can only be implemented to the level of the storage device controller, and the multi-path cannot be implemented between the storage device controller and the specific storage medium. Switch. Therefore, the conventional multi-path storage system can only cope with the network failure between the server and the storage device controller, and cannot cope with a single point failure of the storage device controller itself.
发明内容Summary of the invention
有鉴于此,本发明实施例提供了一种存储系统、对存储系统的访问控制方法和对存储系统的访问控制装置,解决了传统多路径存储系统无法实现连接到存储介质的多路径切换的问题。In view of this, the embodiments of the present invention provide a storage system, an access control method for the storage system, and an access control device for the storage system, which solves the problem that the traditional multi-path storage system cannot achieve multi-path switching to the storage medium. .
本发明一实施例提供一种存储系统,包括:An embodiment of the invention provides a storage system, including:
SAS存储网络,包括至少一个SAS交换机;SAS storage network, including at least one SAS switch;
至少两个存储节点,连接至所述SAS存储网络;At least two storage nodes connected to the SAS storage network;
至少一个存储设备,连接至所述SAS存储网络;以及At least one storage device connected to the SAS storage network;
至少一个计算节点,每个存储节点对应所述至少一个计算节点中的一个或多个计算节点;At least one computing node, each storage node corresponding to one or more computing nodes of the at least one computing node;
其中,每个存储设备包括至少一个具备SAS接口的存储介质,所述SAS存储网络被配置为使得每一个存储节点都能够无需借助其他存储节点而直接访问所有存储介质。Each storage device includes at least one storage medium having a SAS storage network configured to enable each storage node to directly access all of the storage media without resorting to other storage nodes.
本发明一实施例还提供一种对存储系统的访问控制方法,所述存储系统包括:SAS存储网络,包括至少一个SAS交换机;至少两个存储节点,连接至所述SAS存储网络;至少一个存储设备,连接至所述SAS存储网络;以及至少一个计算节点,每个存储节点对应所述至少一个计算节点中的一个或多个计算节点;其中,每个存储设备包括至少一个具备SAS接口的存储介质,所述SAS存储网络被配置为使得每一个存储节点都能够无需借助其他存储节点而直接访问所有存储介质;所述方法包括:An embodiment of the present invention further provides an access control method for a storage system, where the storage system includes: a SAS storage network, including at least one SAS switch; at least two storage nodes connected to the SAS storage network; at least one storage a device, coupled to the SAS storage network; and at least one compute node, each storage node corresponding to one or more compute nodes of the at least one compute node; wherein each storage device includes at least one storage having a SAS interface Media, the SAS storage network is configured such that each storage node can directly access all storage media without resorting to other storage nodes; the method includes:
当任何一个存储节点出现故障时,使与故障存储节点连接的计算节点通过其他存储节点读写存储介质。When any one storage node fails, the computing node connected to the failed storage node reads and writes the storage medium through other storage nodes.
本发明一实施例还提供一种对存储系统的访问控制装置, An embodiment of the present invention further provides an access control device for a storage system.
所述存储系统包括:SAS存储网络,包括至少一个SAS交换机;至少两个存储节点,连接至所述SAS存储网络;至少一个存储设备,连接至所述SAS存储网络;以及至少一个计算节点,每个存储节点对应所述至少一个计算节点中的一个或多个计算节点;其中,每个存储设备包括至少一个具备SAS接口的存储介质,所述SAS存储网络被配置为使得每一个存储节点都能够无需借助其他存储节点而直接访问所有存储介质;所述装置包括:The storage system includes: a SAS storage network including at least one SAS switch; at least two storage nodes connected to the SAS storage network; at least one storage device connected to the SAS storage network; and at least one computing node, each One storage node corresponds to one or more of the at least one computing node; wherein each storage device includes at least one storage medium having a SAS interface, the SAS storage network being configured such that each storage node can Direct access to all storage media without the need for additional storage nodes; the device includes:
访问路径切换模块,配置为:当任何一个存储节点出现故障时,使与故障存储节点连接的计算节点通过其他存储节点读写存储介质。The access path switching module is configured to: when any one of the storage nodes fails, cause the computing node connected to the failed storage node to read and write the storage medium through the other storage node.
本发明一实施例还提供一种在计算机可读存储介质中实现的计算机程序产品,所述计算机可读存储介质具有存储于其中的计算机可读程序代码部分,所述计算机可读程序代码部分被配置为执行如所述的对存储系统的访问控制方法。An embodiment of the present invention also provides a computer program product embodied in a computer readable storage medium having computer readable program code portions stored therein, the computer readable program code portion being Configured to perform an access control method to the storage system as described.
本发明实施例提供的一种存储系统、对存储系统的访问控制方法和对存储系统的访问控制装置,通过采用基于SAS交换机构建的SAS存储网络,存储设备中的存储介质通过自身的SAS接口接入存储设备,存储节点和存储设备也都通过各自的SAS接口接入该SAS存储网络,使得存储节点可基于存储介质的SAS地址直接访问至具体的存储介质。同时由于SAS存储网络被配置为使得每一个存储节点都能够无需借助其他存储节点而直接访问所有存储介质,存储设备中的所有存储介质构成了一个全局存储池,每个存储节点都可通过SAS交换机读取全局存储池中的任一个存储介质。由此便可实现存储节点连接到存储介质之间的多路径切换。The storage system, the access control method for the storage system, and the access control device for the storage system are provided by the SAS storage network based on the SAS switch, and the storage medium in the storage device is connected through the SAS interface of the storage device. The storage device, the storage node and the storage device also access the SAS storage network through respective SAS interfaces, so that the storage node can directly access the specific storage medium based on the SAS address of the storage medium. At the same time, since the SAS storage network is configured such that each storage node can directly access all storage media without using other storage nodes, all storage media in the storage device constitute a global storage pool, and each storage node can pass through the SAS switch. Read any storage medium in the global storage pool. This enables multipath switching between storage nodes connected to storage media.
图1所示为现有技术提供的一种传统多路径存储系统的结构示意图。FIG. 1 is a schematic structural diagram of a conventional multi-path storage system provided by the prior art.
图2所示为根据本发明一实施例所提供的存储系统的架构示意图。FIG. 2 is a schematic structural diagram of a storage system according to an embodiment of the invention.
图3所示为根据本发明另一实施例所提供的存储系统的架构示意图。 FIG. 3 is a schematic structural diagram of a storage system according to another embodiment of the present invention.
图4示出现有技术提供的一种传统存储系统的架构示意图。FIG. 4 is a schematic structural diagram of a conventional storage system provided by the prior art.
图5所示为根据本发明另一实施例所提供的存储系统的架构示意图。FIG. 5 is a schematic structural diagram of a storage system according to another embodiment of the present invention.
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
图2所示为本发明一实施例提供的一种存储系统的结构示意图。如图2所示,该存储系统包括:SAS存储网络,包括至少一个SAS交换机;至少两个存储节点,连接至所述SAS存储网络;至少一个存储设备,连接至所述SAS存储网络;以及至少一个计算节点,每个存储节点对应所述至少一个计算节点中的一个或多个计算节点;其中,每个存储设备包括至少一个具备SAS接口的存储介质,所述SAS存储网络被配置为使得每一个存储节点都能够无需借助其他存储节点而直接访问所有存储介质。在本发明实施例中,存储节点是一种提供存储服务的软件模块,而非通常意义上的包含存储介质在内的硬件服务器。后续的实施例描述中的存储节点也指代相同的概念,因此不再赘述。FIG. 2 is a schematic structural diagram of a storage system according to an embodiment of the present invention. As shown in FIG. 2, the storage system includes: a SAS storage network including at least one SAS switch; at least two storage nodes connected to the SAS storage network; at least one storage device connected to the SAS storage network; and at least a computing node, each storage node corresponding to one or more computing nodes of the at least one computing node; wherein each storage device includes at least one storage medium having a SAS interface, the SAS storage network being configured such that each A storage node can directly access all storage media without the need for additional storage nodes. In the embodiment of the present invention, the storage node is a software module that provides a storage service, instead of a hardware server including a storage medium in a general sense. The storage nodes in the description of the subsequent embodiments also refer to the same concepts, and therefore will not be described again.
从上述的描述可以看出,通过采用基于SAS交换机构建的SAS存储网络,存储设备中的存储介质通过自身的SAS接口接入存储设备,存储节点和存储设备也都通过各自的SAS接口接入该SAS存储网络,使得存储节点可基于存储介质的SAS地址直接访问至具体的存储介质。同时由于SAS存储网络被配置为使得每一个存储节点都能够无需借助其他存储节点而直接访问所有存储介质,存储设备中的所有存储介质构成了一个全局存储池,每个存储节点都可通过SAS交换机读取全局存储池中的任一个存储介质。由此便可实现存储节点连接到存储介质之间的多路径切换。 As shown in the above description, the storage medium in the storage device is connected to the storage device through its SAS interface, and the storage node and the storage device are also accessed through the respective SAS interfaces. The SAS storage network enables the storage node to directly access a particular storage medium based on the SAS address of the storage medium. At the same time, since the SAS storage network is configured such that each storage node can directly access all storage media without using other storage nodes, all storage media in the storage device constitute a global storage pool, and each storage node can pass through the SAS switch. Read any storage medium in the global storage pool. This enables multipath switching between storage nodes connected to storage media.
该存储系统的存储网络采用以SAS交换机构成的SAS存储网络,相比传统的基于IP协议的存储方案,拥有着性能高,带宽大,单台设备磁盘数量多等优点。在与主机适配器(HBA)或者服务器主板上的SAS接口结合使用后,SAS体系所提供的存储能够很容易的被连接的多台服务器同时访问。具体而言,SAS交换机到存储设备之间通过SAS线连接,存储设备与存储介质之间也是由SAS接口连接,比如,存储设备内部将SAS通道连到每个存储介质(可以在存储设备内部设置一个SAS交换芯片),SAS存储网络可以直接连接到存储介质,这相比现有基于FC网络或以太网构建的多路径具有独特的优势。同时,SAS存储网络的带宽可以达到24Gb或48Gb,是千兆以太网的几十倍,以及昂贵的万兆以太网的数倍;在链路层SAS比IP网有大约一个数量级的提升,在传输层,由于TCP协议三次握手四次关闭,开销很高且TCP的延迟确认机制和慢启动有时会导致100毫秒级的延时,而SAS协议的延时只有TCP的几十分之一,性能有更大的提升。总之,SAS存储网络比基于以太网的TCP/IP在带宽、延时性方面具有巨大优势。The storage system of the storage system adopts a SAS storage network composed of SAS switches. Compared with the traditional IP-based storage solution, it has the advantages of high performance, large bandwidth, and a large number of disks per device. When used in conjunction with a host adapter (HBA) or a SAS interface on a server board, the storage provided by the SAS system can be easily accessed by multiple servers connected simultaneously. Specifically, the SAS switch is connected to the storage device through a SAS line, and the storage device and the storage medium are also connected by a SAS interface. For example, the storage device internally connects the SAS channel to each storage medium (can be set inside the storage device) A SAS switch chip), the SAS storage network can be directly connected to the storage medium, which has unique advantages over existing multi-paths built on FC networks or Ethernet. At the same time, the bandwidth of the SAS storage network can reach 24Gb or 48Gb, which is several times that of Gigabit Ethernet, and several times that of expensive 10 Gigabit Ethernet. The link layer SAS has an order of magnitude improvement over the IP network. The transport layer, because the TCP protocol is closed three times, the overhead is high, and the TCP delay acknowledgement mechanism and slow start sometimes cause a delay of 100 milliseconds, while the delay of the SAS protocol is only a fraction of that of TCP. There is a greater improvement. In summary, SAS storage networks offer significant advantages in terms of bandwidth and latency over Ethernet-based TCP/IP.
基于该存储系统结构,由于存储节点独立于存储设备设置,且SAS存储网络被配置为使得每一个存储节点都能够无需借助其他存储节点而直接访问所有存储介质,因此每一个计算节点都可以通过任意一个存储节点连接到所述至少一个存储设备中的每一个存储介质,由此实现了同一计算节点通过不同存储节点进行多路径访问。所形成的存储系统架构中的每个存储节点都有备用的节点,可有效应对存储节点的单点故障,且路径的切换过程可在出现单点故障后立即完成,故障容错无切换接管时间。Based on the storage system structure, since the storage node is independent of the storage device setting, and the SAS storage network is configured such that each storage node can directly access all the storage media without using other storage nodes, each computing node can pass any A storage node is coupled to each of the at least one storage device, thereby enabling multi-path access by the same compute node through different storage nodes. Each storage node in the formed storage system architecture has a standby node, which can effectively cope with a single point failure of the storage node, and the path switching process can be completed immediately after a single point of failure, and the fault tolerance has no switching takeover time.
因此,基于图2所示的存储系统结构,本发明一实施例还提供了一种对存储系统的访问控制方法,包括:当任何一个存储节点出现故障时,使与故障存储节点连接的计算节点通过其他存储节点读写存储介质。这样当出现存储节点的单点故障时,与故障存储节点连接的计算节点可通过其他存储节点实现多路径访问。 Therefore, based on the storage system structure shown in FIG. 2, an embodiment of the present invention further provides an access control method for a storage system, including: a computing node connected to a faulty storage node when any one of the storage nodes fails Read and write storage media through other storage nodes. Thus, when a single point of failure of the storage node occurs, the compute node connected to the failed storage node can implement multipath access through other storage nodes.
在本发明一实施例中,每个存储节点所在的物理服务器具备至少一个SAS接口,每个存储节点所在的物理服务器的至少一个SAS接口分别与至少一个SAS交换机对应连接;每个存储设备具备至少一个SAS接口,每个存储设备的至少一个SAS接口分别与至少一个SAS交换机对应连接。这样每个存储节点都可通过至少一条SAS路径访问存储介质。该SAS路径由当前执行访问的存储节点所在的物理服务器的任意一个SAS接口、对应该任意一个SAS接口的SAS交换机、待访问存储设备的SAS接口和待访问存储介质的SAS接口构成。In an embodiment of the present invention, the physical server where each storage node is located has at least one SAS interface, and at least one SAS interface of the physical server where each storage node is located is respectively connected to at least one SAS switch; each storage device has at least one A SAS interface, at least one SAS interface of each storage device is respectively connected to at least one SAS switch. In this way, each storage node can access the storage medium through at least one SAS path. The SAS path is composed of any SAS interface of the physical server where the storage node currently accessing the storage node, a SAS switch corresponding to any SAS interface, a SAS interface of the storage device to be accessed, and a SAS interface of the storage medium to be accessed.
由此可见,同一计算节点除了可通过不同存储节点进行多路径访问外,还可通过同一个存储节点的至少一个SAS路径访问存储介质。当一个存储节点具备访问存储介质的多个SAS路径时,计算节点便可通过该存储节点的多个SAS路径实现多路径访问。因此,综上所述,每个计算节点其实都可通过至少两个访问路径访问存储介质;其中,至少两个访问路径包括同一个存储节点的不同SAS路径,或不同存储节点各自的任意一条SAS路径。It can be seen that the same computing node can access the storage medium through at least one SAS path of the same storage node, in addition to multi-path access through different storage nodes. When a storage node has multiple SAS paths accessing the storage medium, the computing node can implement multi-path access through multiple SAS paths of the storage node. Therefore, in summary, each computing node can access the storage medium through at least two access paths; wherein at least two access paths include different SAS paths of the same storage node, or any SAS of different storage nodes. path.
图3所示为本发明另一实施例提供的一种存储系统的结构示意图。如图3所示,不同于图2所示的存储系统,该存储系统包括至少两个SAS交换机;每个存储节点所在的物理服务器具备至少两个SAS接口,每个存储节点所在的物理服务器的至少两个SAS接口分别与至少两个SAS交换机对应连接;每个存储设备具备至少两个SAS接口,每个存储设备的至少两个SAS接口分别与至少两个SAS交换机对应连接。这样至少两个存储节点中的每一个存储节点都可通过至少两条SAS路径访问存储介质,其中的每条SAS路径对应所述存储节点所在的物理服务器的不同SAS接口,该不同SAS接口则对应不同的SAS交换机。同时,由于每个存储设备都具备至少两个SAS接口,且每个存储设备中的存储介质是固定不变的,因此同一存储设备的不同SAS接口是通过不同的线路连接到相同的存储介质的。FIG. 3 is a schematic structural diagram of a storage system according to another embodiment of the present invention. As shown in FIG. 3, unlike the storage system shown in FIG. 2, the storage system includes at least two SAS switches; each physical node where the storage node is located has at least two SAS interfaces, and the physical server where each storage node is located At least two SAS interfaces are respectively connected to at least two SAS switches; each storage device has at least two SAS interfaces, and at least two SAS interfaces of each storage device are respectively connected to at least two SAS switches. Thus, each of the at least two storage nodes can access the storage medium through at least two SAS paths, where each SAS path corresponds to a different SAS interface of the physical server where the storage node is located, and the different SAS interfaces correspond to Different SAS switches. At the same time, since each storage device has at least two SAS interfaces, and the storage medium in each storage device is fixed, different SAS interfaces of the same storage device are connected to the same storage medium through different lines. .
由此可见,基于图3所示的存储系统结构,在计算节点访问存储介质的 访问路径上,存储节点和SAS交换机中的任一个出现单点故障都有备用的节点以供切换,可有效应对任何访问路径中任何节点的单点故障。因此,基于如图3所示存储系统结构,本发明一实施例还提供了一种对存储系统的访问控制方法,包括:当任何一条SAS路径出现故障时,使与故障SAS路径连接的存储节点通过其它SAS路径读写存储介质;其中,SAS路径由当前执行访问的存储节点所在的物理服务器的任意一个SAS接口、对应该任意一个SAS接口的SAS交换机、待访问存储设备的SAS接口和待访问存储介质的SAS接口构成。It can be seen that, based on the storage system structure shown in FIG. 3, the storage node accesses the storage medium at the computing node. On the access path, there is a single point of failure for any single point of failure between the storage node and the SAS switch, which can effectively handle any single point failure of any node in any access path. Therefore, based on the storage system structure shown in FIG. 3, an embodiment of the present invention further provides an access control method for a storage system, including: a storage node connected to a faulty SAS path when any one SAS path fails. The storage medium is read and written by the other SAS path. The SAS path is any SAS interface of the physical server where the storage node currently accessing the SAS interface, the SAS switch corresponding to any SAS interface, the SAS interface of the storage device to be accessed, and the to-be-accessed. The SAS interface of the storage medium is constructed.
应当理解,当SAS存储网络包括多个SAS交换机时,不同存储节点仍可基于同一SAS交换机对存储介质进行多路径访问,即,当任何一个存储节点出现故障时,与故障存储节点连接的计算节点可通过其他存储节点但基于同一个SAS交换机读写存储介质。It should be understood that when the SAS storage network includes multiple SAS switches, different storage nodes can still perform multi-path access to the storage medium based on the same SAS switch, that is, when any one storage node fails, the computing node connected to the failed storage node The storage medium can be read and written by other storage nodes but based on the same SAS switch.
在本发明一实施例中,由于SAS存储网络中的每个存储介质都有一个SAS地址,在一个存储节点要通过任意一个SAS交换机连接到一个存储设备中的一个存储介质时,便可通过该待连接存储设备在SAS存储网络中的SAS地址来定位该待连接存储介质的位置。在一进一步实施例中,该SAS地址可为全球唯一的WWN(World Wide Name)编码。In an embodiment of the present invention, since each storage medium in the SAS storage network has a SAS address, when a storage node is connected to a storage medium in a storage device through any one of the SAS switches, The SAS address of the storage device to be connected in the SAS storage network is used to locate the location of the storage medium to be connected. In a further embodiment, the SAS address can be a globally unique WWN (World Wide Name) code.
在传统的存储系统中,该存储系统通常是由TCP/IP网络连接多个分布式存储节点组成的。图4示出现有技术的存储系统的架构示意图。如图4所示,在传统的存储系统中,各存储节点S通过接入网交换机连接到TCP/IP网络(通过核心交换机实现)。每个存储节点都是单独一台物理服务器,每台服务器都有自己的若干存储介质。各存储节点通过如IP网络这样的存储网络连接起来,构成一个存储池。在核心交换机的另一侧,各计算节点C也通过接入网交换机连接到TCP/IP网络(通过核心网交换机实现),以通过TCP/IP网络访问整个存储池。由此可见,在现有的传统存储系统结构中,存储节点位于存储介质侧,或者严格来说,存储介质是存储节点所在物理机 的内置盘。In a conventional storage system, the storage system is usually composed of a plurality of distributed storage nodes connected by a TCP/IP network. FIG. 4 shows a schematic diagram of the architecture of a prior art storage system. As shown in FIG. 4, in a conventional storage system, each storage node S is connected to a TCP/IP network (through a core switch) through an access network switch. Each storage node is a separate physical server, and each server has its own storage medium. Each storage node is connected by a storage network such as an IP network to form a storage pool. On the other side of the core switch, each compute node C is also connected to the TCP/IP network (through the core network switch) through the access network switch to access the entire storage pool over the TCP/IP network. It can be seen that in the existing traditional storage system structure, the storage node is located on the storage medium side, or strictly speaking, the storage medium is the physical machine where the storage node is located. Built-in disk.
而在本发明实施例所提供的存储系统中,存储节点所在的物理机独立于存储设备,每个存储节点和一个计算节点设置在一台物理服务器中,该物理服务器通过SAS存储网络与存储设备连接。存储节点可通过SAS存储网络直接访问至存储介质,因此存储设备更多作为连接存储介质与存储网络的一个通道。In the storage system provided by the embodiment of the present invention, the physical machine where the storage node is located is independent of the storage device, and each storage node and one computing node are set in a physical server, and the physical server passes through the SAS storage network and the storage device. connection. The storage node can directly access the storage medium through the SAS storage network, so the storage device is more used as a channel connecting the storage medium and the storage network.
利用本发明实施方式所构建的将计算节点和存储节点位于同一物理机的聚合式存储系统,从整体结构而言,可以减少所需物理设备的数量,从而降低成本。同时,计算节点也可以在本地访问到其希望访问的存储资源。另外,由于将计算节点和存储节点聚合在同一台物理服务器上,两者之间数据交换可以简单到仅仅是共享内存,性能特别优异。这样的方式,使得在需要进行动态平衡时,无需将物理数据在不同的存储介质中进行迁移,只需要通过配置平衡不同的存储节点所管理的存储介质即可。The aggregated storage system in which the computing node and the storage node are located in the same physical machine constructed by using the embodiment of the present invention can reduce the number of physical devices required, thereby reducing the cost. At the same time, the compute node can also access the storage resources it wishes to access locally. In addition, since the compute nodes and storage nodes are aggregated on the same physical server, the data exchange between the two can be as simple as shared memory, and the performance is particularly excellent. In this way, when dynamic balancing is required, physical data does not need to be migrated in different storage media, and only storage media managed by different storage nodes need to be balanced.
在本发明实施例所提供的存储系统中,存储节点独立于存储设备设置,且存储节点与计算节点,计算节点到存储介质之间的I/O数据路径长度包括:(1)存储介质到存储节点;以及(2)存储节点到聚合在同一物理服务器的计算节点(CPU总线通路)。而在图4所示现有技术所提供的存储系统中,其计算节点到存储介质之间的I/O数据路径长度包括:(1)存储介质到存储节点;(2)存储节点到存储网络接入网交换机;(3)存储网络接入网交换机到核心网交换机;(4)核心网交换机到计算网络接入网交换机;以及(5)计算网络接入网交换机到计算节点。显然,本发明实施方式的存储系统的总数据路径只接近于传统存储系统的第(1)项。即,本发明实施例提供的存储系统,通过对I/O数据路径长度的极致压缩能够极大地提高了存储系统的I/O通道性能,其实际运行效果非常接近于读写本地硬盘的I/O通道。In the storage system provided by the embodiment of the present invention, the storage node is independent of the storage device setting, and the storage node and the computing node, and the I/O data path length between the computing node and the storage medium includes: (1) storage medium to storage Nodes; and (2) storage nodes to compute nodes (CPU bus lanes) that are aggregated on the same physical server. In the storage system provided by the prior art shown in FIG. 4, the I/O data path length between the computing node and the storage medium includes: (1) storage medium to the storage node; (2) storage node to the storage network. Access network switch; (3) storage network access network switch to core network switch; (4) core network switch to computing network access network switch; and (5) computing network access network switch to computing node. Obviously, the total data path of the storage system of the embodiment of the present invention is only close to item (1) of the conventional storage system. That is, the storage system provided by the embodiment of the present invention can greatly improve the I/O channel performance of the storage system by extremely compressing the I/O data path length, and the actual running effect is very close to the I/O of the local hard disk. O channel.
应当理解,虽然每个计算节点所在的物理服务器都有一个存储节点,但由于物理服务器之间存在网络连接,一个物理服务器中的计算节点也可以通 过另一个物理服务器中的存储节点访问存储介质,这样同一计算节点可通过不同存储节点对存储介质进行多路径访问。It should be understood that although the physical server where each computing node is located has a storage node, the computing nodes in one physical server can also pass through the existence of a network connection between the physical servers. A storage node in another physical server accesses the storage medium so that the same compute node can perform multi-path access to the storage medium through different storage nodes.
在本发明一实施例中,存储节点可以是物理服务器的一个虚拟机、一个容器、直接运行在服务器的物理操作系统上的一个模块或者上述组合(例如存储节点的一部分在扩展卡上的firmware,另一部分在物理操作系统的一个模块,还有一部分在虚拟机);计算节点也可以是同一个物理机服务器的一个虚拟机、一个容器、直接运行在所述服务器的物理操作系统上的一个模块或者上述组合。在一个实施例中,每个存储节点可以对应一个或多个计算节点。In an embodiment of the invention, the storage node may be a virtual machine of the physical server, a container, a module running directly on the physical operating system of the server, or a combination thereof (for example, a firmware of a part of the storage node on the expansion card, The other part is a module in the physical operating system, and some are in the virtual machine); the computing node can also be a virtual machine of the same physical machine server, a container, and a module running directly on the physical operating system of the server. Or the combination above. In one embodiment, each storage node may correspond to one or more compute nodes.
具体而言,可以将一台物理服务器分成多个虚拟机,其中一台虚拟机做存储节点用,其它虚拟机做计算节点用;也可是利用物理OS上的一个模块做存储节点用,以便实现更好的性能。Specifically, one physical server may be divided into multiple virtual machines, one of which is used as a storage node, and the other virtual machine is used as a computing node; or a module on the physical OS is used as a storage node, so as to implement Better performance.
在本发明一实施例中,形成虚拟机的虚拟化技术可以是KVM或Zen或VMware或Hyper-V虚拟化技术,形成所述容器的容器技术可以是Docker或Rockett或Odin或Chef或LXC或Vagrant或Ansible或Zone或Jail或Hyper-V容器技术。In an embodiment of the invention, the virtualization technology forming the virtual machine may be KVM or Zen or VMware or Hyper-V virtualization technology, and the container technology forming the container may be Docker or Rocket or Odin or Chef or LXC or Vagrant. Or Ansible or Zone or Jail or Hyper-V container technology.
在本发明一实施例中,各个存储节点同时只负责管理固定的存储介质,并且一个存储介质不会同时被多个存储节点进行写入,以避免数据冲突,从而能够实现每一个存储节点都能够无需借助其他存储节点而访问由其管理的存储介质,并且能够保证存储系统中存储的数据的完整性。In an embodiment of the present invention, each storage node is only responsible for managing a fixed storage medium at the same time, and one storage medium is not simultaneously written by multiple storage nodes to avoid data conflict, thereby enabling each storage node to be able to implement each storage node. The storage medium managed by it is accessed without resorting to other storage nodes, and the integrity of the data stored in the storage system can be guaranteed.
在本发明一实施例中,可以将系统中所有的存储介质按照存储逻辑进行划分,具体而言,可以将整个系统的存储池划分为存储区域、存储组、存储块这样的逻辑存储层级架构,其中,存储块为最小存储单位。在本发明一实施例中,可以将存储池划分成至少两个存储区域。In an embodiment of the present invention, all the storage media in the system may be divided according to storage logic. Specifically, the storage pool of the entire system may be divided into a logical storage hierarchy structure such as a storage area, a storage group, and a storage block. Among them, the storage block is the smallest storage unit. In an embodiment of the invention, the storage pool may be divided into at least two storage areas.
在本发明一实施例中,每一个存储区域可以分为至少一个存储组。在一个较优的实施例中,每个存储区域至少被划分为两个存储组。 In an embodiment of the invention, each storage area may be divided into at least one storage group. In a preferred embodiment, each storage area is divided into at least two storage groups.
在一些实施例中,存储区域和存储组是可以合并的,从而可以在该存储层级架构中省略一个层级。In some embodiments, the storage area and the storage group can be merged such that one level can be omitted in the storage hierarchy.
在本发明一实施例中,每个存储区域(或者存储组)可以由至少一个存储块组成,其中存储块可以是一个完整的存储介质、也可以是一个存储介质的一部分。为了在存储区域内部构建冗余存储,每个存储区域(或者存储组)可以由至少两个存储块组成,当其中任何一个存储块出现故障时,可以从该组中其余存储块中计算出完整的被存储数据。冗余存储方式可以为多副本模式、独立冗余磁盘阵列(RAID)模式、纠删码(erase code)模式。在本发明一实施例中,冗余存储方式可以通过ZFS文件系统建立。在本发明一实施例中,为了对抗存储设备/存储介质的硬件故障,每个存储区域(或者存储组)所包含的多个存储块不会位于同一个存储介质中,甚至也不位于同一个存储设备中。在本发明一实施例中,每个存储区域(或者存储组)所包含的任何两个存储块都不会位于同一个存储介质/存储设备中。在本发明另一实施例中,同一存储区域(或者存储组)中位于同一存储介质/存储设备的存储块数量最好小于或等于冗余存储的冗余度。举例说明,当存储冗余采取的RAID 5方式时,其冗余存储的冗余度为1,那么位于同一存储设备的同一存储组的存储块数量最多为1;对RAID6,其冗余存储的冗余度为2,那么位于同一存储设备的同一存储组的存储块数量最多为2。In an embodiment of the invention, each storage area (or storage group) may be composed of at least one storage block, wherein the storage block may be a complete storage medium or a part of a storage medium. In order to construct redundant storage inside the storage area, each storage area (or storage group) may be composed of at least two storage blocks, and when any one of the storage blocks fails, the complete storage block may be calculated from the remaining storage blocks in the group. The data is stored. The redundant storage mode can be multi-copy mode, independent redundant disk array (RAID) mode, and erasure code mode. In an embodiment of the invention, the redundant storage mode can be established by the ZFS file system. In an embodiment of the present invention, in order to combat the hardware failure of the storage device/storage medium, the plurality of storage blocks included in each storage area (or storage group) are not located in the same storage medium, or even located in the same storage medium. In the storage device. In an embodiment of the invention, any two storage blocks included in each storage area (or storage group) are not located in the same storage medium/storage device. In another embodiment of the present invention, the number of storage blocks located in the same storage medium/storage device in the same storage area (or storage group) is preferably less than or equal to the redundancy of the redundant storage. For example, when the RAID 5 mode of redundancy is used, the redundant storage redundancy is 1, and the number of storage blocks in the same storage group of the same storage device is at most 1; for RAID 6, the redundant storage is With a redundancy of 2, the number of memory blocks in the same storage group on the same storage device is up to 2.
在本发明一实施例中,每个存储节点都只能读和写自己管理的存储区域。由于多个存储节点对同一个存储块的读操作并不会互相冲突,而多个存储节点同时写一个存储块容易发生冲突,因此,在另一个实施例中,可以是每个存储节点只能写自己管理的存储区域,但是可以读自己管理的存储区域以及其它存储节点管理的存储区域,即写操作是局域性的,但读操作可以是全局性。In an embodiment of the invention, each storage node can only read and write its own managed storage area. Since the read operations of the same storage block by multiple storage nodes do not conflict with each other, and multiple storage nodes write one storage block at the same time, conflicts are easily generated. Therefore, in another embodiment, each storage node can only Write the storage area managed by yourself, but you can read the storage area managed by yourself and the storage area managed by other storage nodes, that is, the write operation is local, but the read operation can be global.
在一个实施方式中,存储系统还可以包括存储控制节点,其连接至SAS存储网络,用于确定每个存储节点管理的存储区域。在另一个实施方式中, 每个存储节点可以包括存储分配模块,用于确定该存储节点所管理的存储区域,这可以通过每个存储节点所包括的各个存储分配模块之间的通信和协调处理算法来实现,该算法可以例如以使得各个存储节点之间的负载均衡为原则。In one embodiment, the storage system may further include a storage control node coupled to the SAS storage network for determining a storage area managed by each storage node. In another embodiment, Each storage node may include a storage allocation module for determining a storage area managed by the storage node, which may be implemented by a communication and coordination processing algorithm between each storage allocation module included in each storage node, and the algorithm may For example, in order to load balance between storage nodes as a principle.
在本发明一实施例中,存储介质可以包括但不限于硬盘、闪存、SRAM、DRAM、NVME或NVRAM等其它形式,存储介质的访问接口可以包括但不限于SAS接口、SATA接口、PCI/e接口、DIMM接口、NVMe接口、SCSI接口、AHCI接口。In an embodiment of the present invention, the storage medium may include, but is not limited to, a hard disk, a flash memory, an SRAM, a DRAM, an NVME, or an NVRAM. The access interface of the storage medium may include, but is not limited to, a SAS interface, a SATA interface, and a PCI/e interface. DIMM interface, NVMe interface, SCSI interface, AHCI interface.
图5所示为本发明另一实施例提供的存储系统的结构示意图。如图5所示,该存储系统30中的存储设备被构建成多台JBOD307-310,分别通过SAS数据线连接至两个SAS交换机305和306,这两个SAS交换机构成了存储系统所包括的SAS存储网络的交换核心,前端为至少两个服务器301和302。服务器301有至少两个适配器301a和301b,至少两个适配器301a和301b分别与至少两个SAS交换机305和306连接;服务器302有至少两个适配器302a和302b,至少两个适配器302a和302b分别与至少两个SAS交换机305和306连接。基于图5所示的存储系统结构,本发明一实施例所提供的访问控制方法可进一步包括:当一个存储节点的任何一个适配器出现故障时,该存储节点通过其他适配器与对应的SAS交换机连接。例如,当服务器302的适配器302a出现故障时,服务器302就无法通过适配器302a与SAS交换机305连接了,此时服务器302仍可通过适配器302b与SAS交换机306连接。FIG. 5 is a schematic structural diagram of a storage system according to another embodiment of the present invention. As shown in FIG. 5, the storage device in the
服务器之间存在基本的网络连接用来监控和通信。每台服务器中都有一个存储节点,利用从SAS链路获取的信息,管理所有JBOD磁盘中的部分或全部磁盘。具体而言,可以利用本申请文件以上描述的存储区域、存储组、存储块来将JBOD磁盘划分成不同的存储组。每个存储节点都管理一组或多组这样的存储组。当每个存储组内部采用冗余存储的方式时,可以将冗余存 储的元数据存在于磁盘之上,使得冗余存储能够被其他存储节点直接从磁盘识别。There is a basic network connection between the servers for monitoring and communication. Each server has a storage node that manages some or all of the disks in all JBOD disks using information obtained from the SAS links. Specifically, the storage area, the storage group, and the storage block described above in the application file may be used to divide the JBOD disk into different storage groups. Each storage node manages one or more sets of such storage groups. When each storage group adopts redundant storage mode, it can store redundant The stored metadata exists on the disk so that the redundant storage can be directly identified from the disk by other storage nodes.
在所示的示例性存储系统30中,存储节点可以安装监控和管理模块,负责监控本地存储和其它服务器的状态。当某台JBOD整体异常,或者JBOD上某个磁盘异常时,数据可靠性由冗余存储来确保。当某台服务器故障时,另一台预先设定好的服务器上的存储节点中的管理模块,将按照磁盘上的数据,在本地识别并接管原来由故障服务器的存储节点所管理的磁盘。故障服务器的存储节点原本对外提供的存储服务,也将在新的服务器上的存储节点得到延续。至此,实现了一种全新的高可用的全局存储池结构。In the
由此可见,所构建的示例性存储系统30提供了一种多点可控的、全局访问的存储池。硬件方面使用多台服务器来对外提供服务,使用JBOD来存放磁盘。将多台JBOD各自连接两台SAS交换机,两台交换机再分别连接服务器的两个HBA卡,从而确保JBOD上所有磁盘,能够被所有服务器访问。SAS冗余链路也确保了链路上的高可用性。As can be seen, the
在每台服务器本地,利用冗余存储技术,从每台JBOD上选取磁盘组成冗余存储,避免单台JBOD的损失造成数据不可用。当一台服务器失效时,对整体状态进行监控的模块将调度另一台服务器,通过SAS通道访问失效服务器的存储节点所管理的磁盘,快速接管对方负责的这些磁盘,实现高可用的全局存储。Locally, each server uses redundant storage technology to select redundant disks from each JBOD to avoid redundant data loss. When one server fails, the module that monitors the overall state will schedule another server to access the disks managed by the storage node of the failed server through the SAS channel, and quickly take over the disks that the other party is responsible for, achieving high-available global storage.
虽然在图5中是以JBOD存放磁盘为例进行了说明,但是应当理解,如图5所示的本发明的实施方式还支持JBOD以外的存储设备。另外,以上是以一块存储介质(整个的)作为一个存储块为例,也同样适用于将一个存储介质的一部分作为一个存储块的情形。Although the JBOD storage disk has been described as an example in FIG. 5, it should be understood that the embodiment of the present invention as shown in FIG. 5 also supports a storage device other than JBOD. In addition, the above is an example in which one storage medium (entire) is used as one storage block, and the same applies to a case where a part of one storage medium is used as one storage block.
本发明一实施例还提供一种对存储系统的访问控制装置,所应用的存储系统包括:SAS存储网络,包括至少一个SAS交换机;至少两个存储节点,连接至所述SAS存储网络;至少一个存储设备,连接至所述SAS存储网络; 以及至少一个计算节点,每个存储节点对应所述至少一个计算节点中的一个或多个计算节点;其中,每个存储设备包括至少一个具备SAS接口的存储介质,所述SAS存储网络被配置为使得每一个存储节点都能够无需借助其他存储节点而直接访问所有存储介质;该装置包括:An embodiment of the present invention further provides an access control device for a storage system, where the storage system includes: a SAS storage network, including at least one SAS switch; at least two storage nodes connected to the SAS storage network; at least one a storage device connected to the SAS storage network; And at least one computing node, each storage node corresponding to one or more of the at least one computing node; wherein each storage device includes at least one storage medium having a SAS interface, the SAS storage network configured to Enabling each storage node to directly access all storage media without resorting to other storage nodes; the device includes:
访问路径切换模块,配置为:当任何一个存储节点出现故障时,使与故障存储节点连接的计算节点通过其他存储节点读写存储介质。The access path switching module is configured to: when any one of the storage nodes fails, cause the computing node connected to the failed storage node to read and write the storage medium through the other storage node.
在本发明一实施例中,SAS存储网络包括至少两个SAS交换机,每个存储节点所在的物理服务器具备至少两个SAS接口,每个存储节点所在的物理服务器的至少两个SAS接口分别与至少两个SAS交换机对应连接;每个存储设备具备至少两个SAS接口,每个存储设备的至少两个SAS接口分别与至少两个SAS交换机对应连接;此时该访问路径切换模块还可进一步配置为:当任何一条SAS路径出现故障时,使与故障SAS路径连接的存储节点通过其它SAS路径读写存储介质;其中,SAS路径由当前执行访问的存储节点所在的物理服务器的任意一个SAS接口、对应该任意一个SAS接口的SAS交换机、待访问存储设备的SAS接口和待访问存储介质的SAS接口构成。In an embodiment of the present invention, the SAS storage network includes at least two SAS switches, each of which has a physical server having at least two SAS interfaces, and at least two SAS interfaces of the physical server where each storage node is located and at least The two SAS switches are connected to each other; each storage device has at least two SAS interfaces, and at least two SAS interfaces of each storage device are respectively connected to at least two SAS switches; in this case, the access path switching module can be further configured as When any SAS path fails, the storage node connected to the faulty SAS path reads and writes the storage medium through other SAS paths; wherein the SAS path is any SAS interface of the physical server where the storage node currently accessing is located, It should be composed of a SAS switch of any SAS interface, a SAS interface of the storage device to be accessed, and a SAS interface of the storage medium to be accessed.
本发明一实施例还提供一种计算机可读存储介质的计算机程序产品,包括计算机程序代码,当计算机程序代码由处理器执行时,其使得处理器能够按照本发明实施方式的方法来实现如本文实施方式所述的对存储系统的访问控制方法。计算机存储介质可以为任何有形媒介,例如软盘、CD-ROM、DVD、硬盘驱动器、甚至网络介质等。An embodiment of the invention further provides a computer program product of a computer readable storage medium, comprising computer program code, which when executed by a processor, enables the processor to be implemented according to the method of the embodiments of the invention The access control method for the storage system described in the embodiment. The computer storage medium can be any tangible medium such as a floppy disk, CD-ROM, DVD, hard drive, or even network media.
应当理解,虽然以上描述了本发明实施方式的一种实现形式可以是计算机程序产品,但是本发明的实施方式的方法或装置可以被依软件、硬件、或者软件和硬件的结合来实现。硬件部分可以利用专用逻辑来实现;软件部分可以存储在存储器中,由适当的指令执行系统,例如微处理器或者专用设计硬件来执行。本领域的普通技术人员可以理解上述的方法和设备可以使用计 算机可执行指令和/或包含在处理器控制代码中来实现,例如在诸如磁盘、CD或DVD-ROM的载体介质、诸如只读存储器(固件)的可编程的存储器或者诸如光学或电子信号载体的数据载体上提供了这样的代码。本发明的方法和装置可以由诸如超大规模集成电路或门阵列、诸如逻辑芯片、晶体管等的半导体、或者诸如现场可编程门阵列、可编程逻辑设备等的可编程硬件设备的硬件电路实现,也可以用由各种类型的处理器执行的软件实现,也可以由上述硬件电路和软件的结合例如固件来实现。It should be understood that although an implementation form of the embodiments of the present invention described above may be a computer program product, the method or apparatus of the embodiments of the present invention may be implemented in software, hardware, or a combination of software and hardware. The hardware portion can be implemented using dedicated logic; the software portion can be stored in memory and executed by a suitable instruction execution system, such as a microprocessor or dedicated design hardware. One of ordinary skill in the art will appreciate that the methods and apparatus described above can be used The computer executable instructions are implemented and/or embodied in processor control code, such as a carrier medium such as a magnetic disk, CD or DVD-ROM, a programmable memory such as a read only memory (firmware), or an optical or electronic signal. Such code is provided on the data carrier of the carrier. The method and apparatus of the present invention may be implemented by hardware circuits such as very large scale integrated circuits or gate arrays, semiconductors such as logic chips, transistors, etc., or programmable hardware devices such as field programmable gate arrays, programmable logic devices, etc., also It can be implemented by software executed by various types of processors, or by a combination of the above-described hardware circuits and software such as firmware.
还应当理解,为了不模糊本发明的实施方式,说明书仅对一些关键、未必必要的技术和特征进行了描述,而可能未对一些本领域技术人员能够实现的特征做出说明。It should also be understood that the descriptions of the present invention are merely illustrative of some key, non-essential techniques and features, and may not be described in a manner that can be realized by those skilled in the art.
以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内,所作的任何修改、等同替换等,均应包含在本发明的保护范围之内。 The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, etc., which are within the spirit and principles of the present invention, should be included in the scope of the present invention. within.
Claims (15)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/139,712 US10782898B2 (en) | 2016-02-03 | 2018-09-24 | Data storage system, load rebalancing method thereof and access control method thereof |
| US16/378,076 US20190235777A1 (en) | 2011-10-11 | 2019-04-08 | Redundant storage system |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610173007.2A CN105786414A (en) | 2016-03-24 | 2016-03-24 | Memory system as well as access method and access device thereof |
| CN201610173007.2 | 2016-03-24 |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/077751 Continuation-In-Part WO2017162174A1 (en) | 2011-10-11 | 2017-03-22 | Storage system |
Related Child Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/077758 Continuation-In-Part WO2017162179A1 (en) | 2011-10-11 | 2017-03-22 | Load rebalancing method and apparatus for use in storage system |
| PCT/CN2017/077754 Continuation-In-Part WO2017162177A1 (en) | 2011-10-11 | 2017-03-22 | Redundant storage system, redundant storage method and redundant storage device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2017162176A1 true WO2017162176A1 (en) | 2017-09-28 |
Family
ID=56391693
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/077753 Ceased WO2017162176A1 (en) | 2011-10-11 | 2017-03-22 | Storage system, access method for storage system, and access device for storage system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105786414A (en) |
| WO (1) | WO2017162176A1 (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105786414A (en) * | 2016-03-24 | 2016-07-20 | 天津书生云科技有限公司 | Memory system as well as access method and access device thereof |
| CN106534262B (en) * | 2016-10-14 | 2019-06-07 | 北京博望华科科技有限公司 | A kind of switching method of network information system failure |
| CN108108120B (en) * | 2016-11-25 | 2021-03-09 | 上海川源信息科技有限公司 | Data storage system and data storage method thereof |
| WO2018188089A1 (en) * | 2017-04-14 | 2018-10-18 | 华为技术有限公司 | Data processing method, storage system and exchange device |
| US10809926B2 (en) * | 2018-02-05 | 2020-10-20 | Microsoft Technology Licensing, Llc | Server system |
| US12063273B2 (en) | 2018-02-05 | 2024-08-13 | Microsoft Technology Licensing, Llc. | Server system |
| CN108762672B (en) * | 2018-05-23 | 2022-03-11 | 新华三技术有限公司成都分公司 | Distributed storage device, method and cascade module |
| CN109450681A (en) * | 2018-11-06 | 2019-03-08 | 英业达科技有限公司 | Cabinet-type server system and server |
| CN111399761B (en) * | 2019-11-19 | 2023-06-30 | 杭州海康威视系统技术有限公司 | Storage resource allocation method, device and equipment, and storage medium |
| CN113190183B (en) * | 2021-05-31 | 2023-06-13 | 浙江大华技术股份有限公司 | A storage cluster device and device mounting method |
| CN113392053B (en) * | 2021-06-25 | 2022-08-05 | 苏州浪潮智能科技有限公司 | Storage system, communication method and component |
| CN114553899A (en) * | 2022-01-30 | 2022-05-27 | 阿里巴巴(中国)有限公司 | Storage device |
| CN117234428B (en) * | 2023-11-09 | 2024-02-09 | 苏州元脑智能科技有限公司 | Data management method, device and equipment of distributed storage system and medium |
| CN118672515B (en) * | 2024-08-21 | 2024-10-29 | 浙江大华技术股份有限公司 | Storage system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203982354U (en) * | 2014-06-19 | 2014-12-03 | 天津书生投资有限公司 | A kind of redundant storage system |
| CN104216805A (en) * | 2014-08-26 | 2014-12-17 | 浪潮(北京)电子信息产业有限公司 | System and method for link failure protection of disk cabinet at rear end of high-end disk array |
| CN104657316A (en) * | 2015-03-06 | 2015-05-27 | 北京百度网讯科技有限公司 | Server |
| US9110591B2 (en) * | 2011-04-22 | 2015-08-18 | Hewlett-Packard Development Company, L.P. | Memory resource provisioning using SAS zoning |
| CN105472047A (en) * | 2016-02-03 | 2016-04-06 | 天津书生云科技有限公司 | Storage system |
| CN105786414A (en) * | 2016-03-24 | 2016-07-20 | 天津书生云科技有限公司 | Memory system as well as access method and access device thereof |
| CN105867842A (en) * | 2016-03-23 | 2016-08-17 | 天津书生云科技有限公司 | Access control method and apparatus for storage system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103634350B (en) * | 2012-08-24 | 2017-05-17 | 阿里巴巴集团控股有限公司 | Storage system and implementation method thereof |
-
2016
- 2016-03-24 CN CN201610173007.2A patent/CN105786414A/en active Pending
-
2017
- 2017-03-22 WO PCT/CN2017/077753 patent/WO2017162176A1/en not_active Ceased
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9110591B2 (en) * | 2011-04-22 | 2015-08-18 | Hewlett-Packard Development Company, L.P. | Memory resource provisioning using SAS zoning |
| CN203982354U (en) * | 2014-06-19 | 2014-12-03 | 天津书生投资有限公司 | A kind of redundant storage system |
| CN104216805A (en) * | 2014-08-26 | 2014-12-17 | 浪潮(北京)电子信息产业有限公司 | System and method for link failure protection of disk cabinet at rear end of high-end disk array |
| CN104657316A (en) * | 2015-03-06 | 2015-05-27 | 北京百度网讯科技有限公司 | Server |
| CN105472047A (en) * | 2016-02-03 | 2016-04-06 | 天津书生云科技有限公司 | Storage system |
| CN105867842A (en) * | 2016-03-23 | 2016-08-17 | 天津书生云科技有限公司 | Access control method and apparatus for storage system |
| CN105786414A (en) * | 2016-03-24 | 2016-07-20 | 天津书生云科技有限公司 | Memory system as well as access method and access device thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105786414A (en) | 2016-07-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017162176A1 (en) | Storage system, access method for storage system, and access device for storage system | |
| WO2017133483A1 (en) | Storage system | |
| WO2017162177A1 (en) | Redundant storage system, redundant storage method and redundant storage device | |
| TWI639919B (en) | Multiple intermediary architecture in data storage system | |
| TWI403891B (en) | Active-active failover for a direct-attached storage system | |
| US10031820B2 (en) | Mirroring high performance and high availablity applications across server computers | |
| US8898385B2 (en) | Methods and structure for load balancing of background tasks between storage controllers in a clustered storage environment | |
| WO2017162179A1 (en) | Load rebalancing method and apparatus for use in storage system | |
| US9542320B2 (en) | Multi-node cache coherency with input output virtualization | |
| US10514855B2 (en) | NVRAM path selection | |
| US9933946B2 (en) | Fibre channel storage array methods for port management | |
| JP5959733B2 (en) | Storage system and storage system failure management method | |
| US20090183152A1 (en) | Method to Dynamically Provision Additional Computer Resources to Handle Peak Database Workloads | |
| US9336134B2 (en) | Apparatus and method for accessing a non-volatile memory blade using multiple controllers in a non-volatile memory based storage device | |
| US10782898B2 (en) | Data storage system, load rebalancing method thereof and access control method thereof | |
| WO2017167106A1 (en) | Storage system | |
| WO2017162178A1 (en) | Access control method and device for storage system | |
| US8832489B2 (en) | System and method for providing failover between controllers in a storage array | |
| US8402195B2 (en) | Storage system mounted with plurality of processors | |
| US10782989B2 (en) | Method and device for virtual machine to access storage device in cloud computing management platform | |
| US20140316539A1 (en) | Drivers and controllers | |
| US20190028542A1 (en) | Method and device for transmitting data | |
| CN113342257B (en) | Server and related control method | |
| CN103440177A (en) | Storage control redundancy method based on multiple NUMA physical layer partitions | |
| US11467930B2 (en) | Distributed failover of a back-end storage director |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17769453 Country of ref document: EP Kind code of ref document: A1 |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17769453 Country of ref document: EP Kind code of ref document: A1 |