Submission is taking really long

eric · May 19, 2020, 6:53pm

My newest submission is really slow. It takes 10 minutes for a validation set with 14000 images on my machine. Could you please give me a hint why it is taking so long?

shivam · May 19, 2020, 7:00pm

Hi @eric,

I am looking into your submission #67390 now and will update you asap.

picekl · May 19, 2020, 7:31pm

Hi Eric,

My guess is that you are not using GPU.

Put - “gpu”: true - into your aicrowd.json file.

Like this -> https://gitlab.aicrowd.com/nikhil_rayaprolu/food-recognition/blob/master/aicrowd.json

Best,
Lukas

eric · May 19, 2020, 7:37pm

Oh yes, i accidentally changed that. Could you stop the container now?

Thank you very much!

picekl · May 19, 2020, 7:50pm

We have to wait for Shivam. I don’t have such rights.

@shivam Can you do that?

Best,
Lukas

shivam · May 19, 2020, 8:09pm

Hi @eric,

Yes, I am stopping the running submission.

eric · May 26, 2020, 8:15am

I still have problems with my submission, could you please provide the logs for the latest?

picekl · May 26, 2020, 8:43am

Hi Eric,

sadly, I can not help you with this error.

@shivam can you please look into it?

Best,
Lukas

picekl · May 27, 2020, 9:45am

@shivam Can you please look into it?

Lukas

shivam · May 27, 2020, 8:08pm

Hi @eric,

I have shared response on Gitlab issue.

It seems like some problem when you are saving your predictions to file and they are filled with Nan, instead of floats.