Intelligent Workflow Management for Fish4Knowledge Using the SWELL System

Gayathri Nadarajan, Cheng-Lin Yang, Yun-Heh Chen-Burger

Abstract: F4K’s workflow component is the chief mediator between the user interface (UI) and the video and image processing (VIP) components that reside in F4K’s high performance computing (HPC) platforms. Not only does it decompose high level user queries into lower video-level command-line invocations, it also makes its own decisions on which VIP modules and the best parameters to select, which hardware platform to perform the video processing executions on and which fault tolerance strategies to take during the executions so as to optimize the overall system’s performance. In this chapter, we describe the workings of F4K’s workflow component, SWELL (Semantic Workflows with Error Handling for Large Video Analyses) which comprises a workflow engine and a workflow monitor. We also describe the F4K domain ontologies that have heavily influenced the development of SWELL and have been used for term matching between partner components.