Final submission selection

[carlos.cortes]

Hi,

How will our final submission be selected? Will all the submissions we do run for the final leaderboard?

Thanks,
Carlos

[shivam]

Hi, linking the existing unanswered thread for this question.

Is the scoring function F1 or logloss?

cc: @kelleni2, @satyakantipudi Please confirm policy for final scoring i.e. all submissions will be considered or the one having best score on partial dataset?

[kelleni2]

Hi all,

We will use the last submission.

This will allow users to decide which submission they feel is their best.

If this becomes problematic based on feedback, we could also give the option to use the submission with the best score. Email incoming today as well about the challenge end - but please comment below.

Best,
Nick

[sweenke4]

From that previous thread the reply was:

[shivam]
…
We already have scores against full dataset for all of your submissions (hidden), so all submissions will be used.

---

Why has this been changed?

[carlos.cortes]

As some colleague already said if you take all the submissions you are just encouraging to submit like crazy and try your luck. But this is just my point of view.

Best,
Carlos