AN IMPORTANCE-AWARE ARCHITECTURE FOR LARGE-SCALE GRID INFORMATION SERVICES
Abstract
This paper is concerned with the scalability of large-scale grid monitoring and information services, which are mainly used for the discovery of resources of interest. Large-scale grid monitoring systems have to balance between three competing performance metrics: query response time, imposed network overhead, and information freshness. Improving one of the three metrics will affect another; any solution will be based on a trade-off. The paper is motivated by the observation that existing grid monitoring systems can only be manually configured for a trade-off among the three metrics, which applies equally to all monitored resources; this implies that all resources in a grid are considered to be of equal importance. Assuming that in a large-scale grid setting this is unlikely to hold, the paper proposes an importance-based monitoring architecture for large-scale grid information services, based on an adaptation of the web crawling paradigm. The main idea is that, since not all resources are of equal importance, one can vary the trade-off based on the relative importance of the monitored resources. The proposed architecture is described and evaluated based on large-scale deployments of a prototype implementation on PlanetLab.
References
- Future Generation Computer Systems 21(4), 559 (2005). Crossref, ISI, Google Scholar
- S. Andreozzi, S. Burke, L. Field, S. Fisher, B. Konya, M. Mambelli, J. M. Schopf, M. Viljoen, and A. Wilson. GLUE Schema Specification, version 1.2. http://infnforge.enaf.infn.it/glueinfomodel . Google Scholar
- ACM Transactions on Internet Technology 1(1), 2 (2001), DOI: 10.1145/383034.383035. Crossref, Google Scholar
Z. Balaton , From Cluster Monitoring to Grid Monitoring Based on GRM, Proceedings of the 7th International Euro-Par Conference2150, eds.R. Sakellariou (Springer-Verlag, 2001) pp. 874–881. Google Scholar- IEEE Trans. Comput. 51(6), 652 (2002), DOI: 10.1109/TC.2002.1009150. Crossref, ISI, Google Scholar
F. Bonnassieux , R. Harakaly and P. Primet , Automatic Services Discovery, Monitoring and Visualization of Grid Environments: the MapCenter Approach, Proceedings of the 1st European Across Grids conference2970,Lecture Notes in Computer Science , eds.F. F. Rivera (Santiago dc Compostela, 2004) pp. 222–229. Google Scholar- Journal of Grid Computing 2(4), 323 (2004), DOI: 10.1007/s10723-005-0151-6. Crossref, ISI, Google Scholar
K. Czajkowski , Grid Information Services for Distributed Resource Sharing, Proceedings of the 10th IEEE International Symposium on High-Performance Distributed Computing (HPDC-10) (IEEE Computer Society Press, 2001) pp. 181–194. Google ScholarP. Deolasee , Adaptive Push-Pull: Disseminating Dynamic Web Data, Proceedings of the 10th International Conference on World Wide Web (ACM Press, 2001) pp. 265–274. Google ScholarM. Dikaiakos , Y. Ioannidis and R. Sakellariou , Search Engines for the Grid: A Research Agenda, Proceedings of the 1st European Across Grids Conference2970,Lecture Notes in Computer Science , eds.F. F. Rivera (Springer-Verlag, 2004) pp. 49–58. Google Scholar-
M. Dikaiakos , R. Sakellariou and Y. Ioannidis , Engineering the Grid: Status and Perspectivess ( American Scientific Publishers , 2006 ) . Google Scholar - Journal of Grid Computing 3, 131 (2005), DOI: 10.1007/s10723-005-9004-6. Crossref, ISI, Google Scholar
-
Y. S. Kee , H. Casanova and A. A. Chien , Realistic Modeling and Synthesis of Resources for Computational Grids , Supercomputing 2004 ( 2004 ) . Google Scholar -
Y.-S. Kee , Efficient Resource Description and High Quality Selection for Virtual Grids , Proceedings of the 5th IEEE Symposium on Cluster Computing and the Grid (CCGrid'05) ( IEEE , 2005 ) . Google Scholar - IEE Proceedings-Software 150(4), 243 (2003). Crossref, Google Scholar
H. N. L. C. Keung , Predicting the Performance of Globus Monitoring and Discovery Service (MDS-2) Queries, Fourth International Workshop on Grid Computing (IEEE, 2003) pp. 176–183. Google Scholar- Parallel Computing 30(7), (2004), DOI: 10.1016/j.parco.2004.04.001. Google Scholar
- SIGCOMM Comput. Comrnun. Rev. 33(1), 59 (2003), DOI: 10.1145/774763.774772. Crossref, ISI, Google Scholar
B. Plale , Understanding Grid Resource Information Management through a Synthetic Database Benchmark/Workload, 4th IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid2004) (2004) pp. 277–284. Google Scholar- B. Plale, C. Jacobs, Y. Liu, C. Moad, R. Parab, and P. Vaidya. Benchmark Details of Synthetic Database Benchmark/Workload for Grid Resource Information. Technical Report TR583, Indiana University, Computer Science, August 2003 . Google Scholar
W. Smith , An Evaluation of Alternative Designs for a Grid Information Service, Proceedings of the Ninth International Symposium on High-Performance Distributed Computing (IEEE, 2000) pp. 185–192. Google ScholarR. Sundaresanand , A Slacker Coherence Protocol for Pull-based Monitoring of On-line Data Sources, Proceeedings of 3rd International Symposium on IEEE/ACM Cluster Computing and the Grid (CCGrid03) (IEEE Computer Society Press, 2003) pp. 250–257. Google ScholarR. Sundaresanand , Adaptive Polling of Grid Resource Monitors Using a Slacker Coherence Model, 12th IEEE International Symposium on High Performance Distributed Computing (HPDC'03) (IEEE Computer Society Press, 2003) p. 260. Google Scholar- Scientific Programming 12(4), 225 (2004). Crossref, Google Scholar
- Future Generation Computer Systems 15(6), 757 (1999), DOI: 10.1016/S0167-739X(99)00025-4. Crossref, ISI, Google Scholar
- S. Zanikolas. Importance-Aware Monitoring for Large-Scale Grid Information Services. PhD thesis, School of Computer Science, University of Manchester, 2007 . Google Scholar
S. Zanikolas and R. Sakellariou , Towards a Monitoring Framework for Worldwide Grid Information Services, 10th International Euro-Par Conference3149,Lecture Notes in Computer Science (Springer-Verlag, 2004) pp. 417–422. Google ScholarX. Zhang , J. Freschl and J. Sehopf , A Performance Study of Monitoring and Information Services for Distributed Systems, Proceedings of 12th IEEE High Performance Distributed Computing (HPDC-12 2003) (IEEE Computer Society Press, 2003) pp. 270–282. Google Scholar- Journal of Parallel and Distributed Computing 67, 883 (2007), DOI: 10.1016/j.jpdc.2007.03.006. Crossref, ISI, Google Scholar


