Algorithms are pervasive within our society, being employed for instance for hiring decisions, evaluation of loan applications and the judicial system. As a consequence, automated procedures responsible for life-changing decisions are undergoing close scrutiny through the lens of algorithmic fairness. It is becoming evident that the quality of a decision making process should take into account the desiderata of all stakeholders involved in the process. This includes the agents on whose behalf the decision is taken, as well as the agents subjected to the decision. Thus, algorithmic quality is increasingly understood as a balanced mix of accuracy and fairness, i.e. the utility functions of the parties involved.