Vu Anh Nguyen, Samuel Pierre et Dougoukolo Konaré
Article de revue (2005)
Document en libre accès dans PolyPublie et chez l'éditeur officiel |
|
Libre accès au plein texte de ce document Version officielle de l'éditeur Conditions d'utilisation: Creative Commons: Attribution (CC BY) Télécharger (3MB) |
Abstract
This study addresses the scalability issues involving file systems as critical components of computer clusters, especially for commercial applications. Given that wide striping is an effective means of achieving scalability as it warrants good load balancing and allows node cooperation, we choose to implement a new data distribution scheme in order to achieve the scalability of computer clusters. We suggest combining both wide striping and replication techniques using a new data distribution technique based on “chained declustering”. Thus, we suggest a complete architecture, using a cluster of clusters, whose performance is not limited by the network and can be adjusted with one-node precision. In addition, update costs are limited as it is not necessary to redistribute data on the existing nodes every time the system is expanded. The simulations indicate that our data distribution technique and our read algorithm balance the load equally amongst all the nodes of the original cluster and the additional ones. Therefore, the scalability of the system is close to the ideal scenario: once the size of the original cluster is well defined, the total number of nodes in the system is no longer limited, and the performance increases linearly.
Mots clés
Computer cluster; Scalability; File system
Sujet(s): |
2700 Technologie de l'information > 2706 Génie logiciel 2700 Technologie de l'information > 2719 Architecture d'ordinateur et conception 2700 Technologie de l'information > 2720 Logiciel de systèmes informatiques |
---|---|
Département: | Département de génie informatique et génie logiciel |
Organismes subventionnaires: | Ericsson Research Canada, CRSNG / NSERC |
URL de PolyPublie: | https://publications.polymtl.ca/5057/ |
Titre de la revue: | Journal of Computer Science (vol. 1, no 3) |
Maison d'édition: | Science Publications |
DOI: | 10.3844/jcssp.2005.363.368 |
URL officielle: | https://doi.org/10.3844/jcssp.2005.363.368 |
Date du dépôt: | 11 sept. 2020 14:32 |
Dernière modification: | 25 sept. 2024 15:38 |
Citer en APA 7: | Nguyen, V. A., Pierre, S., & Konaré, D. (2005). Towards a scalable file system on computer clusters using declustering. Journal of Computer Science, 1(3), 363-368. https://doi.org/10.3844/jcssp.2005.363.368 |
---|---|
Statistiques
Total des téléchargements à partir de PolyPublie
Téléchargements par année
Provenance des téléchargements
Dimensions