World Scientific
  • Search
Skip main navigation

Cookies Notification

We use cookies on this site to enhance your user experience. By continuing to browse the site, you consent to the use of our cookies. Learn More
×
Our website is made possible by displaying certain online content using javascript.
In order to view the full content, please disable your ad blocker or whitelist our website www.worldscientific.com.

System Upgrade on Tue, Oct 25th, 2022 at 2am (EDT)

Existing users will be able to log into the site and access content. However, E-commerce and registration of new users may not be available for up to 12 hours.
For online purchase, please visit us again. Contact us at [email protected] for any enquiries.

EXPERIMENTAL RESULTS ABOUT MPI COLLECTIVE COMMUNICATION OPERATIONS

    Collective communication performance is critical in a number of MPI applications. In this paper we focus on two widely used primitives, broadcast and reduce, and present experimental results obtained on a cluster of PC connected by InfiniBand. We integrated our algorithms in the MPICH library and we used MPICH implementation of broadcast and reduce primitives to compare the performance of our algorithms based on α-trees. Our tests show that the MPICH implementation can be improved.

    References

    • Message Passing Interface ForumThe International Journal of Supercomputer Applications and High Performance Computing 8(3/4), (1994). Google Scholar
    • M. Bernaschi and G. Iannello, Concurrency: Practice and Experience 10(5), 359 (1998). Crossref, ISIGoogle Scholar
    • M. Bernaschi, G. Iannello, M. Lauria, Experimental results about MPI Collective Communication Operations Proceedings of HPCN99, P. Slot, M. Bubak, A. Hoekstra, and B. Hertzberger editors Lecture Notes in Computer Science (Springer) n. 1593 . Google Scholar
    • A. Bar-Noy and S. Knipis, Designing Broadcasting Algorithms in the Postal Model for Message-Passing Systems, Procs. of the 4th Annual ACM Symp. on Parallel Algorithms and Architectures, June 1992 11–22 . Google Scholar
    • R. M. Karp et al., Optimal Broadcast and Summation in the LogP Model, Procs. of the 5th Annual ACM Symp. on Parallel Algorithms and Architectures, June 1993, pp. 142–153 . Google Scholar
    • R. Thakur and W. Gropp, Recent Advances in Parallel Virtual Machine and Message Passing Interface, Lecture Notes in Computer Science 2840, eds. Jack Dongarra, Domenico Laforenza and Salvatore Orlando (Springer Verlag, Venice, Italy, 2003) pp. 257–267. CrossrefGoogle Scholar
    • M. Shroff, R. A. van de Geijn, CollMark: MPI Collective Communication Benchmark, tech. rep., The University of Texas at Austin, Department of Computer Sciences, December 1999 . Google Scholar
    • H. Marcel, On Optimizing collective Communication, tech. rep., The University of Texas at Austin, Department of Computer Sciences, May 2003 . Google Scholar
    • http://www.infinibandta.org/specs . Google Scholar
    • J. Liu, J. Wu and D. K. Panda, Int'l Journal of Parallel Programming 32, 2 (2004). Google Scholar
    • S. S. Vadhiyar, G. E. Fagg, J. Dongarra, Automatically tuned collective communications, Proceedings of the 2000 ACM/IEEE conference on Supercomputing . Google Scholar
    • Lars Paul Huse, Recent Advances in Parallel Virtual Machine and Message Passing Interface, Lecture Notes in Computer Science 1697, eds. J. Dongarraet al. (Springer Verlag, Barcelona, Spain, 1999) pp. 469–476. CrossrefGoogle Scholar
    • R. Rabenseifner, New optimized MPI reduce algorithm, http://www.hlrs.de/organization/par/services/models/mpi/myreduce.html . Google Scholar
    • M. Bernaschi, G. Iannello and M. Lauria, Journal of Systems Architecture 49, 3 (2003). ISIGoogle Scholar
    • T. Kielmannet al., Recent Advances in Parallel Virtual Machine and Message Passing Interface, Lecture Notes in Computer Science 2474, eds. J. Dongarraet al. (Springer Verlag, 2002) pp. 392–400. Google Scholar
    • S. Sistare, R. vandeVaart, and E. Loh, Optimization of MPI collectives on clusters of large-scale SMPs. in Procs. of SC99: High Performance Networking and Computing, November 1999 . Google Scholar
    • E. W. Chan, M. F. Heimlich, A. Purakayastha, and R. A. van de Geijn, On Optimizing Collective Communication, In Proc. of the 2004 IEEE International Conference on Cluster Computing (Cluster 2004), September 2004 . Google Scholar
    • R. Thakur, R. Rabenseifner and William Gropp, International Journal of High Performance Computing Applications 1(19), 49 (2005). Google Scholar