In order to support my request (Request to have the same baseline for everyone!), I shared my baseline with densenet. You could access the submission at AIcrowd Submission Received #174462 - v0p5 (#4) · Issues · moto / data-purchasing-optimization · GitLab.
If my submission can access the pre-trained weights for efficient net B6 from https://github.com/lukemelas/EfficientNet-PyTorch/releases/download/1.0/, it could score 0.87+.