The transport of particles in elastoviscoplastic (EVP) fluids is of significant interest across various industrial and scientific domains. However, the physical mechanisms underlying the various particle distribution patterns observed in experimental studies remain inadequately understood in the current literature. To bridge this gap, we perform interface-resolved direct numerical simulations to study the collective dynamics of spherical particles suspended in a pressure-driven EVP duct flow. In particular, we investigate the effects of solid volume fraction, yield stress, inertia, elasticity, shear-Thinning viscosity, and secondary flows on particle migration and formation of plug regions in the suspending fluid. Various cross-streamline migration patterns are observed depending on the rheological parameters of the carrier fluid. In EVP fluids with constant plastic viscosity, particles aggregate into a large cluster at the duct centre. Conversely, EVP fluids with shear-Thinning plastic viscosity induce particle migration towards the duct walls, leading to formation of particle trains at the corners. Notably, we observe significant secondary flows (compared to the mean velocity) in shear-Thinning EVP suspensions, arising from the interplay of elasticity, shear-Thinning viscosity and particle presence, which further enhances corner-ward particle migration. We elucidate the physical mechanism by which yield stress augments the first normal stress difference, thereby significantly amplifying elastic effects. Furthermore, through a comprehensive analysis of various EVP suspensions, we identify critical thresholds for elasticity and yield stress necessary to achieve particle focusing at the duct corners.