I’ve been submitting a lot lately and it seems that identical submissions can have very different evaluation throughputs.
I submitted the same model (same architecture with different model weights) 5 times and got throughputs that vary from 0.007 ts/s ~ 0.019 ts/s.
Is this something that can be fixed? I’m pretty sure it wasn’t like this in MDX 2021.