Bug in the training data

ImageCLEF 2021 Aware
#1

Hi,

There seems to be a bug in the data. The structure of files predictions_train.json and predictions_val.json should be:

{
userId1 {
userImgId1 [
“VC_a conf_a x_0 y_0 x_1 y_1”,
“VC_b conf_b x_0 y_0 x_1 y_1”,
}

but in the data, there is missing whitespace between x_1 and y_1

1 Like
#2

Hey @lsoukup, sit tight! :cookie:
I’ll let the team know about your issue incase they didn’t see this one. :grinning:

1 Like
#3

Hi,

Additionally, I’ve also found out that y_0 and x_1 are always equal, which seems a little suspicious to me. Are you sure, that the training and validation data are correct?

Thanks
Lukas

#4

Hi,
First of all, sorry for the very late reply but the notifications of the discussion section were deactivated!

We have now updated the dataset and corrected the two issues related to the predictions files.
Note that the issues were problematic only if you try to use the size of the detected objects in your runs.

Kind regards,
Adrian

#5

Hi,

We tried to use the updated data version, unfortunately, the gt users ids do not match anymore with the users ids in the prediction files.

Best regrads

#6

Hi SIP_Team,
Thanks for noticing the problem with user IDs, it is now corrected.
Please download the dataset again.
Kind regards