<  Back to the Polytechnique Montréal portal

Towards a scalable file system on computer clusters using declustering

Vu Anh Nguyen, Samuel Pierre and Dougoukolo Konare

Article (2005)

[img]
Preview
Published Version
Terms of Use: Creative Commons Attribution.
Download (3MB)
Cite this document: Nguyen, V. A., Pierre, S. & Konare, D. (2005). Towards a scalable file system on computer clusters using declustering. Journal of Computer Science, 1(3), p. 363-368. doi:10.3844/jcssp.2005.363.368
Show abstract Hide abstract

Abstract

This study addresses the scalability issues involving file systems as critical components of computer clusters, especially for commercial applications. Given that wide striping is an effective means of achieving scalability as it warrants good load balancing and allows node cooperation, we choose to implement a new data distribution scheme in order to achieve the scalability of computer clusters. We suggest combining both wide striping and replication techniques using a new data distribution technique based on “chained declustering”. Thus, we suggest a complete architecture, using a cluster of clusters, whose performance is not limited by the network and can be adjusted with one-node precision. In addition, update costs are limited as it is not necessary to redistribute data on the existing nodes every time the system is expanded. The simulations indicate that our data distribution technique and our read algorithm balance the load equally amongst all the nodes of the original cluster and the additional ones. Therefore, the scalability of the system is close to the ideal scenario: once the size of the original cluster is well defined, the total number of nodes in the system is no longer limited, and the performance increases linearly.

Uncontrolled Keywords

Computer cluster; Scalability; File system

Open Access document in PolyPublie
Subjects: 2700 Technologie de l'information > 2706 Génie logiciel
2700 Technologie de l'information > 2719 Architecture d'ordinateur et conception
2700 Technologie de l'information > 2720 Logiciel de systèmes informatiques
Department: Département de génie informatique et génie logiciel
Research Center: Non applicable
Funders: Ericsson Research Canada, CRSNG / NSERC
Date Deposited: 11 Sep 2020 14:32
Last Modified: 08 Apr 2021 10:43
PolyPublie URL: https://publications.polymtl.ca/5057/
Document issued by the official publisher
Journal Title: Journal of Computer Science (vol. 1, no. 3)
Publisher: Science Publications
Official URL: https://doi.org/10.3844/jcssp.2005.363.368

Statistics

Total downloads

Downloads per month in the last year

Origin of downloads

Dimensions

Repository Staff Only