Under the same assumptions and level of rigour as the previous work of Franz, Mezard, Parisi and Peliti, one can show that the ultrametric solution for the equilibrium measure holds if and only if the system's dynamics spontaneously split into widely separated timescales with only one temperature per timescale for all observables.