Evaluating classifiers in SE research: the ECSER pipeline and two replication studies

Davide Dell'Anna, Fatma Basak Aydemir, Fabiano Dalpiaz

Abstract: Automated classifiers, often based on machine learning (ML), are increasingly used in software engineering (SE) for labelling previously unseen SE data. Researchers have proposed automated classifiers that predict if a code chunk is a clone, if a requirement is functional or non-functional, if the outcome of a test case is non-deterministic, etc.