I also used query expansion with a pagerank inspired thresholding, it gave a .03 boost to the score.
I want to ask how did you fit the ViT-H model in the 10 min inference, I tried using it through timm, and jit compiled, but could never fit it in time.