This study aims to investigate influence of under- and over-treatment on residual stress state induced by HFMI numerically. Finite element simulations were performed using a flat plate model considering S355 where feed rate and the number of hits were varied. To reduce computational time, the mass scaling method was adopted to the simulations. In addition, in order to survey influence of surface removal on residual stress state, electropolishing was conducted after the HFMI simulation. Additional simulations were performed on bead on plate model considering JIS-SM400 in order to investigate applicability of isotropic hardening model for residual stress estimation. From the results, the mass scaling method can result in reducing computational time more than 90% with reasonable good estimation of the residual stresses.The investigations regarding under- and over-treatment reveal that high feed rate mainly influences residual stress state on the treated surface and the number of hits is independent of amount of induced residual stress. Surface removal after the simulation can result in slightly improving the accuracy of the estimated residual stresses. The simulations to bead on plate model give reasonable results in a depth of around 0.2 mm even when the residual stresses due to welding is disregarded.