Ethical Markov Decision Processes with Moral Worth as Rewards

Mihail Stojanovski, Nadjet Bourdache, Grégory Bonnet, Abdel-Illah Mouaddib

Abstract: We propose an expressive framework for specifying ethical behaviours, called Ethical Markov Decision Processes (E-MDPs) that extends classical MDPs with the explicit representation of moral values - positive or negative - that the agent's decisions may promote or demote.