Thermoelectric materials play a vital role in the pursuit of a sustainable energy system by allowing the conversion of waste heat to electric energy. Low thermal conductivity is essential to achieving high-efficiency conversion. The conductivity depends on an interplay between the phononic and electronic properties of the nonequilibrium state. Therefore, obtaining a comprehensive understanding of nonequilibrium dynamics of the electronic and phononic subsystems as well as their interactions is key for unlocking the microscopic mechanisms that ultimately govern thermal conductivity. A benchmark material that exhibits ultralow thermal conductivity is SnSe. We study the nonequilibrium phonon dynamics induced by an excited electron population using a framework combining ultrafast electron diffuse scattering and nonequilibrium kinetic theory. This in-depth approach provides a fundamental understanding of energy transfer in the spatiotemporal domain. Our analysis explains the dynamics leading to the observed low thermal conductivity, which we attribute to a mode-dependent tendency to nonconservative phonon scattering. The results offer a penetrating perspective on energy transport in condensed matter with far-reaching implications for rational design of advanced materials with tailored thermal properties.