<  Back to the Polytechnique Montréal portal

A framework to compute statistics of system parameters from very large trace files

Naser Ezzati-Jivan and Michel R. Dagenais

Article (2013)

Accepted Version
Terms of Use: All rights reserved.
Download (503kB)
Cite this document: Ezzati-Jivan, N. & Dagenais, M. R. (2013). A framework to compute statistics of system parameters from very large trace files. ACM SIGOPS Operating Systems Review, 47(1), p. 43-54. doi:10.1145/2433140.2433151
Show abstract Hide abstract


In this paper, we present a framework to compute, store and retrieve statistics of various system metrics from large traces in an efficient way. The proposed framework allows for rapid interactive queries about system metrics values for any given time interval. In the proposed framework, efficient data structures and algorithms are designed to achieve a reasonable query time while utilizing less disk space. A parameter termed granularity degree (GD) is defined to determine the threshold of how often it is required to store the precomputed statistics on disk. The solution supports the hierarchy of system resources and also different granularities of time ranges. We explain the architecture of the framework and show how it can be used to efficiently compute and extract the CPU usage and other system metrics. The importance of the framework and its different applications are shown and evaluated in this paper.

Open Access document in PolyPublie
Subjects: 2700 Technologie de l'information > 2700 Technologie de l'information
2700 Technologie de l'information > 2706 Génie logiciel
2700 Technologie de l'information > 2715 Optimisation
Department: Département de génie informatique et génie logiciel
Research Center: Non applicable
Grant number: CRDPJ424666-11
Date Deposited: 29 Jan 2018 15:36
Last Modified: 08 Apr 2021 10:43
PolyPublie URL: https://publications.polymtl.ca/2954/
Document issued by the official publisher
Journal Title: ACM SIGOPS Operating Systems Review (vol. 47, no. 1)
Publisher: ACM
Official URL: https://doi.org/10.1145/2433140.2433151


Total downloads

Downloads per month in the last year

Origin of downloads


Repository Staff Only