For accelerating data loading, can we use nvidia dali library?
If it won’t have any effect on the performance, which is to merely speed up data loading, I would recommend sticking to what it is now. Plus, the held-out data for evaluation is way smaller than the public one, so there’s no need to submit the data loading function (in evaluation_setup.py) that will speed up data loading for the held-out data.