Exploring stream parallel patterns in distributed MPI environments

Javier López-Gómez, Javier Fernández Muñoz, David del Rio Astorga, Manuel F. Dolz, José Daniel García

Abstract: Highlights•We present GrPPI MPI, an execution policy for distributed-hybrid environments for the Pipeline and Farm parallel patterns.•We describe the GrPPI interface and the MPI policy that permit the distributed and hybrid execution of DaSP applications.•We present the two-sided and one-sided distributed multiple-producer/multiple-consumer queues for the GrPPI stream operators.•We evaluate the usability and the performance of distributed Pipeline and Farm stream patterns using two DaSP applications.•We analyze the pattern usability and perform a side-by-side comparison of both GrPPI and MPI programming interfaces.