Error in local evaluation

When I run the file, I get the following error:

Predicting Segmentation Masks: 100%|█████████████████████████████████████████████████████████████████████████████████████████| 1786/1786 [08:53<00:00,  3.35it/s]
Evaluating results:  74%|██████████████████████████████████████████████████████████████████████████▏                         | 1324/1786 [03:07<01:05,  7.06it/s]
Traceback (most recent call last):
  File "/Users/sourish/Projects/suadd-2023-semantic-segmentation-starter-kit/", line 100, in <module>
  File "/Users/sourish/Projects/suadd-2023-semantic-segmentation-starter-kit/", line 76, in evaluate
    all_metrics[fname] = calculate_metrics(semantic_annotation, semantic_prediction)
  File "/Users/sourish/Projects/suadd-2023-semantic-segmentation-starter-kit/", line 38, in calculate_metrics
    mean_iou_score  = mean_iou(semantic_annotation, semantic_prediction)
  File "/Users/sourish/Projects/suadd-2023-semantic-segmentation-starter-kit/", line 28, in mean_iou
    numer = np.sum(class_annotation & class_prediction, axis=(0,1))
ValueError: operands could not be broadcast together with shapes (2250,1550) (2200,1550)

This is using the default random model.

Hi Sourish @sourishg

Happy New Year!

The error is not in local evaluation. Seems one of the files in semantic annotations has a different shape, we’ll work with the AWS team and get that fixed ASAP.

This is the file

is this issue fixed? I am also getting same error during local evaluation

Hi @sagar_rathod

We’ve updated the file in the Resources section -

Let me know if you still get the error with the updated dataset.