US20080147958A1

US20080147958A1 - Rapid Search System And Method In High Capacity Hard Disk Drive Cluster

Info

Publication number: US20080147958A1
Application number: US11/612,485
Authority: US
Inventors: Kwok-Yan Leung
Original assignee: Individual
Current assignee: Individual
Priority date: 2006-12-19
Filing date: 2006-12-19
Publication date: 2008-06-19
Also published as: US7644229B2

Abstract

A rapid search system and method in high capacity hard disk drive clusters in accordance with the present invention includes: designating a specific hard disk drive as a destination hard disk drive with a predetermined purpose, and then finding the destination hard disk drive pursuant to the hard disk drive cabinet code, the hard disk drive drawer code and the hard disk drive code, whereby communicating with the destination hard disk drive. It does not use broadcast packets to find the destination hard disk drive, which can avoid broadcast storm and system breakdown.

Description

BACKGROUND OF THE INVENTION

1. Field of the Invention
The present invention relates generally to a rapid search system and method, and in particular to a rapid search system and method in high capacity hard disk drive clusters.
2. The Prior Arts
With the network transmission speed getting more higher and cost lower, which make the digital video transmission over network becoming more popular, meanwhile the files of digital video are huge by nature, thus bring up the development tendency of digital storage medium getting larger.
Since the digital media are getting larger, a single hard disk, even a single hard disk drive cabinet is not capable of meeting the mass storage requirement, two special communication protocols ATA over Ethernet (hereafter, refer to as AoE) and iSCSI are developed therefore.
AoE is a network communication protocol developed by Brantley Coile Company, designed for accessing ATA standard storage devices over ethernet network, therefore to achieve a storage area network through low cost standard technique.
AoE does not rely on network layers such as IP, UDP or TCP, etc. This also means that AoE is not routable and rowt-able through LAN, therefore AoE is intended for storage area network only.
It is noted that both AoE and iSCSI all emphasis they are the storage area network solution far cheaper than the Firbre Channel, however, AoE is more simple and cheaper to implement than iSCSI, in regard to the technical document of the standard specification, the AoE specification is 8 pages compared with iSCSI's 257 pages.
With respect to the hardware support, currently, Coraid EtherDrive® is the hard disk drive cabinet designed for AoE. To the software support, vblade provided by SourceForge® allows the Linux Server installed with vblade to search for a AoE hard disk drive cabinet, and send request of storage service to the hard disk drive cabinet after having found it, whereby to use the storage space and resources thereof. Vblade has two types of status and implementations: a userspace one (part of aoetools package) and another one implemented as a linux kernel module.
Although AoE is a simple network protocol, it still increases the complexity of the storage mechanism, and the detail of AoE will be further described below.
AoE protocol mainly uses block storage transmission. In this case, ATA in AoE is regarded as a wire protocol in AoE. When data need to be read after it is written to the hard disk, it is in one or more chunks of data called blocks, and each block with fixed-size.
Then AoE protocol directly and simply put ATA command into lower-level network packets, which could use ethernet cable as an effective alternative to ribbon cable of ATA interface, and carry out the convey and transmission of data blocks between each nodes of ethernet network.
The ribbon cable of ATA standard doesn't care what the data blocks is it transferring, and neither does the AoE standard. The ethernet cable used by AoE standard doesn't care what data block is it transferring, user could read and write any data block they need, but most of the time, file system is more suitable to organizing and structuring data than block.
Traditionally, the user use hard disk of computer as file system, file systems such as ext3, XFS and NTFS are all designed and applied for such assumption. However, when using AoE, since AoE uses ethernet cable to replace the ribbon cable of ATA, which is possible to demolish this assumption. It's dangerous to run traditional file system over AoE, thus could lead to file system corruption or operating system kernel panic.
AoE uses the cluster file system to avoid these above-mentioned problems, which allows the block storage and transfer devices of AoE hard disk and hard disk drive cabinet be shared for multiple computers accessing and using, without the limitation of prior ATA technique that only permit sole computer to access the hard disk and hard disk cluster. To the actual operation, the server for accessing AoE hard disk drive cabinet is like a cluster computer part of a cluster system, which accesses the storage resources use the share mechanism of the cluster system, and the AoE hard disk drive cabinet is a block storage device operable for sharing. GFS and OCFS2 etc. are commonly used cluster file systems.
With reference to FIG. 1, FIG. 1 is a schematic diagram showing a conventional storage area network. As shown in FIG. 1, in the conventional storage area network, the high capacity hard disk drive clusters mainly comprises a plurality of hard disk drive cabinets 10 a˜10 n, each hard disk drive cabinet comprises a plurality of hard disk drive drawers 11 a, 11 b, . . . , 11 f, 11 g, . . . , and each hard disk drive drawer comprises a plurality of hard disk drives 12 a, 12 b, . . . , 12 f, 12 g, . . . . When the computers 17 a, 17 b, . . . , 17 g˜17 n need to communicate with the hard disk drives 12 a, 12 b, . . . , 12 f, 12 g, . . . , AoE protocol or iSCSI protocol may be used.
In AoE protocol, AoE packets use ethernet MAC address to indicate source and destination. A MAC address only works inside a single ethernet network because the MAC address is sent by broadcast in an ethernet broadcast domain. Current ethernet hardware features include flow control, which helps to minimize the bandwidth need for packet retransmission. Ethernet uses the cyclic redundancy checks (CRC) algorithm to ensure that packets arrive intact.
However, although AoE and iSCSI protocols have flow control mechanism, which help to minimize the bandwidth need for packet retransmission. But it is still unavoidable that when hard disk drives 12 a, 12 b, . . . , 12 f, 12 g, . . . need to transmit data, for example when hard disk drives 12 a and 12 f have data to be transmitted each other, they need to send broadcast packets to all the hard disk drives 12 a, 12 b, . . . , 12 f, 12 g, . . . , thus to find the designated hard disk drives 12 a and 12 f. If the number of the hard disk drives is not very large, these broadcast packets may not cause the breakdown of the whole storage system, but once the number increases to a certain level, it is much possible to cause broadcast storm problem, thus lead to the breakdown of the whole storage system.

SUMMARY OF THE INVENTION

A primary objective of the present invention is to provide a rapid search system and method in high capacity hard disk drive clusters, which mainly utilize the plurality of preset hard disk drive location information (each hard disk drive corresponding to its hard disk drive cabinet code, hard disk drive drawer code and hard disk drive code) to find the destination hard disk drive directly while avoid using the broadcast packets.
According to the above-mentioned objective, the rapid search system and method in high capacity hard disk drive clusters in accordance with the present invention mainly comprises designating a specific hard disk drive as a destination hard disk drive with a predetermined purpose, and then finding the destination hard disk drive pursuant to the hard disk drive cabinet code, the hard disk drive drawer code and the hard disk drive code, whereby communicating with the destination hard disk drive. It does not use broadcast packets to find the destination hard disk drive, which can avoid broadcast storm and system breakdown.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be apparent to those skilled in the art by reading the following detailed description of a preferred embodiment thereof, with reference to the attached drawings, in which:

FIG. 1 is a schematic diagram showing a conventional storage area network; and

FIG. 2 is a schematic diagram showing a rapid search system in high capacity hard disk drive clusters in accordance with the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

With reference to FIG. 2, FIG. 2 is a schematic diagram showing a rapid search system in high capacity hard disk drive clusters in accordance with the present invention. As shown in FIG. 2, the rapid search system in high capacity hard disk drive clusters in accordance with the present invention mainly comprises a hard disk drive code database 15, a designation module 18 and a communication module 20. The hard disk drive code database 15 may be executed and maintained only in a single management device 14, and shared by all computers 17 a˜17 n. A designation module 18 and a communication module 20 are respectively installed in management devices 16 a˜16 n which are contained in the computers 17 a˜17 n.
In the LAN environment of the network storage in accordance with the present invention, the high capacity hard disk drive clusters comprises a plurality of hard disk drive cabinets 10 a˜10 n, each hard disk drive cabinet 10 a˜10 n comprises a plurality of hard disk drive drawers 11 a, 11 b, . . . , 11 f, 11 g, . . . and each hard disk drive drawer comprises a plurality of hard disk drives 12 a, 12 b, . . . , 12 f, 12 g, . . . . These hard disk drive cabinets all have a hard disk drive cabinet code, these hard disk drive drawers all have a hard disk drive drawer code, and these hard disk drives all have a hard disk drives code. When the computers 17 a, 17 b, . . . , 17 g˜17 n need to communicate with the hard disk drives 12 a, 12 b, . . . , 12 f, 12 g, . . . , the protocol defined in the present invention is used. The AoE protocol is used in the present invention. In order to avoid broadcast storm problem, the broadcast method is not used to find the destination hard drive disk in the present invention.
Briefly speaking, the rapid search method of the present invention mainly utilize the plurality of preset hard disk drive location information (provided by the hard disk drive database 15, and each hard disk drive corresponding to its hard disk drive cabinet code, hard disk drive drawer code and hard disk drive code) to find the destination hard disk drive directly while avoid using the broadcast packets.
In one embodiment, if the hard drive disks 12 a and 12 f are assigned to the computer 17 b for its use, and the user wants to designate the hard disk drive 12 a to be installed operation system, and designate the hard disk drive 12 f as the backup hard disk or data hard disk of the hard disk drive 12 a, the designation module 18 of the management device 16 b, which are contained in the computer 17 b, first designates the predetermined purpose of the hard drive disk 12 a as an operating system hard disk drive (such as running Windows® XP) and designates the predetermined purpose of the hard disk drive 12 f as a backup hard disk drive or a data hard disk drive from the plurality of the hard disk drive location information in the hard disk drive code database 15. After the designation is finished, the designation module could get the hard disk drive cabinet code, hard disk drive drawer code and hard disk drive code of the destination hard disk drive (namely the hard disk drives 12 a and 12 f), so as to directly find these two destination disk drives in the later data transmission.
In this case, when the computer 17 b send command that require to transmit data from the hard disk drive 12 a to the hard disk drive 12 f, the communication module 20 which is contained in the computer 17 b directly find the destination hard disk drive pursuant to the hard disk drive cabinet code, the hard disk drive drawer code, and the hard disk drive code, whereby communicating with the destination hard disk drive.
Although the present invention has been described with reference to the preferred embodiment thereof, it is apparent to those skilled in the art that a variety of modifications and changes may be made without departing from the scope of the present invention which is intended to be defined by the appended claims.

Claims

1. A rapid search system in high capacity hard disk drive cluster, used to rapidly find a destination hard disk drive in the high capacity hard disk drive clusters, the high capacity hard disk drive clusters mainly comprising a plurality of hard disk drive cabinets, each hard disk drive cabinet comprising a plurality of hard disk drive drawers, and each hard disk drive drawer comprising a plurality of hard disk drives, the hard disk drive cabinets all having a hard disk drive cabinet code, the hard disk drive drawers all having a hard disk drive drawer code and the hard disk drives all having a hard disk drive code, the rapid search system comprising:

a hard disk drive code database, for storing a plurality of hard disk location information, wherein each hard disk location is corresponding to the hard disk drive cabinet code, the hard disk drive drawer code and the hard disk drive code using each hard disk drive;

a designation module for designating a specific hard disk drive as a destination hard disk drive with a predetermined purpose from the plurality of the hard disk location information of the hard disk drive code database, and getting the hard disk drive cabinet code, the hard disk drive drawer code and the hard disk drive code of the destination hard disk drive; and

a communication module for finding the destination hard disk drive not using broadcast method but pursuant to the hard disk drive cabinet code, the hard disk drive drawer code and the hard disk drive code, whereby communicating with the destination hard disk drive.

2. The rapid search system in high capacity hard disk drive clusters as claimed in claim 1, wherein the predetermined purpose is used as an operating system hard disk drive, a backup hard disk drive, or a data hard disk drive.

3. A rapid search method in high capacity hard disk drive cluster, used to rapidly find a destination hard disk drive in the high capacity hard disk drive clusters, the high capacity hard disk drive clusters mainly comprising a plurality of hard disk drive cabinet, each hard disk drive cabinet comprising a plurality of hard disk drive drawer, and each hard disk drive drawer comprising a plurality of hard disk drives, the hard disk drive cabinets all having a hard disk drive cabinet code, the hard disk drive drawers all having a hard disk drive drawer code and the hard disk drives all having a hard disk drive code, the rapid search method comprising the steps of:

providing a hard disk drive code database, the hard disk drive code database storing a plurality of hard disk location information, wherein each hard disk location is corresponding to the hard disk drive cabinet code, the hard disk drive drawer code and the hard disk drive code using each hard disk drive;

designating a specific hard disk drive as a destination hard disk drive with a predetermined purpose from the plurality of the hard disk location information of the hard disk drive code database;

getting the hard disk drive cabinet code, the hard disk drive drawer code and the hard disk drive code of the destination hard disk drive; and

finding the destination hard disk drive not using broadcast method but pursuant to the hard disk drive cabinet code, the hard disk drive drawer code and the hard disk drive code, whereby communicating with the destination hard disk drive.

4. The method as claimed in claim 3, wherein the predetermined purpose is used as an operating system hard disk drive, a backup hard disk drive, or a data hard disk drive.