Labelling errors in the train set

Global Wheat Challenge 2021
#1

Hello,
I tried to visualize the annotated boxes to get a better understanding of the dataset and think that I’ve found some labelling errors.
The relevant images are included below:

6e205222c99deef5979d2292a6a70abf73da2881be1c8da09f581a9cb5c8dfe6
6e205222c99deef5979d2292a6a70abf73da2881be1c8da09f581a9cb5c8dfe61024×1024 333 KB
36ef0fca9d19ac90b6df28905dc81a153fc3e98502ec13e3c3aacc005f5ce7c7
36ef0fca9d19ac90b6df28905dc81a153fc3e98502ec13e3c3aacc005f5ce7c71024×1024 355 KB
d749e91d4c3678352ea2774fa147aa4aca54b5cddb6b12e89ebcba5969d13ee5
d749e91d4c3678352ea2774fa147aa4aca54b5cddb6b12e89ebcba5969d13ee51024×1024 358 KB
8ec1474b9cdc0fd870b443439daa56660c57140c051a8a49052d22d828728f12
8ec1474b9cdc0fd870b443439daa56660c57140c051a8a49052d22d828728f121024×1024 335 KB
73d4c61b8be64a946df940e3e5cdceecb662960363c84a29fb8e99d4b660fa0e
73d4c61b8be64a946df940e3e5cdceecb662960363c84a29fb8e99d4b660fa0e1024×1024 359 KB

1 Like
#2

Hello,

There are two kind of errors:

  • The first two images were old export errors. Despite our vigilance and multiple reviews pass, it is possible to witness few of these mistakes. We will try to address them after the challenge.
  • The last two images are a bug that we will correct. If you look to the train.csv, these images appear on two rows instead of one. The second row contains the right label. We will upload today or tomorrow an amended version of the train dataset !

Thanks again to have spotted the mistakes :slight_smile: !

Best,

Etienne

1 Like
#3

Looking forward to using the amended version on WILDS! :grinning:

#4

Thanks and sorry again for the disconvenience. However, I don’t think it will hurt that much the final score :slight_smile: !

#5

Hi! It seems like data downloaded from the AI Crowd cli still have the labelling errors?

#6

There are 2 repeated image names in train.csv and 1 repeated image name in submission.csv