You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
INFO: cloning https://github.com/tensorflow/serving.git into /home/user/evaluation-workdir/REPOS/tensorflow_serving
137
+
...
138
+
```
139
+
The output shows that the dataset used for verification contains one repository for each project language. The projects are cloned into the `evaluation-workdir`.
140
+
Once a project has been cloned, the patchers are evaluated on the cherry picks (i.e., patches) that have been found for that repository.
111
141
142
+
The verification should complete with the following output:
143
+
```shell
144
+
Latexmk: All targets (metrics-verification.pdf) are up-to-date
145
+
146
+
++++++++++++++++++++++++++++++++++++
147
+
Analysis done
148
+
++++++++++++++++++++++++++++++++++++
149
+
150
+
The result table can be found under evaluation-workdir/metrics-verification.pdf
151
+
```
152
+
153
+
After all repositories have been considered, the result analysis is executed.
154
+
The raw results can be found in the `evaluation-workdir/results` directory.
155
+
156
+
157
+
158
+
In addition, the script generates a PDF file with a result table similar to the one presented in our paper.
159
+
This table can be found under `evaluation-workdir/metrics-verification.pdf`.
160
+
It should look similar to this:
161
+

162
+
163
+
> [!NOTE]
164
+
> The verification results shown are based on only a tiny portion of our dataset and are therefore not representative.
112
165
113
166
# Starting the reproduction
114
167
Once you have verified the correct installation, you can start the reproduction similar to how you started the verification.
@@ -125,7 +178,8 @@ On other machines, you may start a Docker container from the Docker image with t
125
178
docker run --rm -v "./evaluation-workdir/":"/home/user/evaluation-workdir" mpatch-reproduction reproduction
126
179
```
127
180
128
-
181
+
> [!NOTE]
182
+
> The results of the reproduction will be stored in the same manner as the results of the verification.
0 commit comments