Recent years have shown an increasing interest in local factors shaping the happiness or attachment of citizens in regard to their daily living environment, sometimes also coined city love or neighborhood love. This new strand of literature—often framed in the context of the “geography of happiness” or the “economics of happiness”—means an extension of quantitative socio-psychological or socio-economic research on determinants of people’s affection for their living environment, including local quality-of-life, sense of community, place-based social capital, attachment to “urban ambiance,” and so on. The present paper conceptualizes the nature and composition of urban characteristics of place attachment and appreciation (city love) in terms of two constituent factors, viz. city soul (indicators on the perceived intangible attractiveness of the city and its neighborhoods) and city body (indicators reflecting the tangible attractiveness features of the city). This analytical approach will empirically be tested for four Swedish cities. Resident surveys were conducted among a total of 2,573 respondents; the multidimensional relationships between outcome variables and background factors were tested through a Partial Least Squares Structural Equation Model (PLS-SEM), which revealed significant effects of Aesthetics, Amenities, Accessibility, Safety and Health, and City Image on place attachment and appreciation (“city love”). A more detailed city level analysis revealed salient place-specific differences. In general, Aesthetics seemed to be the most universal driver for city love, while City Image was the most important factor to contribute to city soul.