Hi,
The package applies memory_limit_mb as an RLIMIT_AS only on the --runner subprocess path; on the default --runner local the limit is advisory and the package logs that it is not enforced. Could you confirm which runner the official evaluation uses, and which memory_limit_mb value applies? The constant differs between releases (65536 in 0.14.0, 8192 in 0.16.0), so the answer changes which of our local measurements are meaningful.
Thanks.