Different results from debug vs non-debug mode

Novartis DSAI Challenge
#1

Hi,

I ran the same model in debug and non-debug mode and am getting different logLoss/F1 scores. Is debug mode using a different test dataset than non-debug mode? Can you please explain what the differences are?

Thanks,
Karen

#2

Also, is there a way to see the log if your submission was successful?

#3

Yes, as far as I understand the testset for the debug mode is a small subset of the full public leaderboard test set (which is a subset of the full testset).

#4

Yes, the debug mode has small subset as described above.

No, the logs are not visible for successful submissions as of now in our design, but we will be glad to help in fetching logs in case of successful submission (debug mode I assume) if it is blocking you.