This document describes how to reproduce the results of the paper.

Install docker

in python directory, run the following command:

bash reproduce.sh

It takes serveral days to run Randoop and EvoSuite to generate unit tests for all projects in eval, to skip this step, you can download the generated tests from exlidata and extract it in exli root directory.

git clone https://pipiyu@bitbucket.org/sedata/exlidata.git

Notes: The inline tests failed mainly for three reasons:

(1)~the object does not override the toString() method, leading the assertion to compare memory references instead of object properties;

(2)~the object cannot be deserialized due to dynamic dispatch, resulting in a type mismatch and ConversionException thrown by XStream;

(3)~the parsed test fails to compile because there are methods in the target statements that are not static and have states.