Can we use the checkpoint of timestamp 4 as pretrained model for timestamp 5?

As illustrated in the discussion, no pretrained model should be used (e.g., imagenet1k pretrained). However, when I use all images prior to the current timestamp to train my model (i.e., cumulative training), could I initialize the model of current timestamp with the checkpoint of previous timestamp?

Yes, cumulative is allowed.