Thermoelectric application of half-Heusler compounds suffers from their fairly high thermal conductivities. Insight into how effective various scattering mechanisms are in reducing the thermal conductivity of fabricated XNiSn compounds (X = Hf, Zr, Ti, and mixtures thereof) is therefore crucial. Here, we show that such insight can be obtained through a concerted theory-experiment comparison of how the lattice thermal conductivity κLat(T) depends on temperature and crystallite size. Comparing theory and experiment for a range of Hf0.5Zr0.5NiSn and ZrNiSn samples reported in the literature and in the present paper revealed that grain boundary scattering plays the most important role in bringing down κLat, in particular so for unmixed compounds. Our concerted analysis approach was corroborated by a good qualitative agreement between the measured and calculated κLat of polycrystalline samples, where the experimental average crystallite size was used as an input parameter for the calculations. The calculations were based on the Boltzmann transport equation and ab initio density functional theory. Our analysis explains the significant variation of reported κLat of nominally identical XNiSn samples, and is expected to provide valuable insights into the dominant scattering mechanisms even for other materials.