Experimental studies of natural convection in yield stress fluids have revealed transient behaviours that contradict predictions from viscoplastic models. For example, at a sufficiently large yield stress, these models predict complete motionlessness; below a critical value, yielding and motion onset can be delayed in viscoplastic models. In both cases, however, experiments observe immediate motion onset. We present numerical simulations of the transient natural convection of elastoviscoplastic (EVP) fluids in a square cavity with differentially heated side walls, exploring the role of elasticity in reconciling theoretical predictions with experimental observations. We consider motion onset in EVP fluids under two initial temperature distributions: (i) a linear distribution characteristic of steady pure conduction, and (ii) a uniform distribution representative of experimental conditions. The Saramito EVP model exhibits an asymptotic behaviour similar to the Kelvin-Voigt model as, where material behaviour is primarily governed by elasticity and solvent viscosity. The distinction between motion onset and yielding, a hallmark of EVP models, is the key feature that bridges theoretical predictions with experimental observations. While motion onset is consistently immediate (as seen in experiments), yielding occurs with a delay (as predicted by viscoplastic models). Scaling analysis suggests that this delay varies logarithmically with the yield stress and is inversely proportional to the elastic modulus. The intensity of the initial pre-yield motion increases with higher yield stress and lower elastic modulus. The observed dynamics resemble those of under- and partially over-damped systems, with a power-law fit providing an excellent match for the variation of oscillation frequency with the elastic modulus.