In the light of global climate change and the current energy crisis, it is crucial to target sustainable energy use in all sectors. Buildings still remain one of the most energy-demanding sectors. Campus buildings and higher educational buildings are important to target due to their high and increasing energy demand. This building segment also represents a research gap, as mostly office or domestic buildings have been studied previously. In the quest for thermal comfort, a key stakeholder in building energy demand is the building occupant. It is therefore crucial to promote energy-aware behaviors. The building systems are another key factor to consider. As conventional building systems are replaced with smart building systems, the entire scenario is redrawn for how building occupants interact with the building and its systems. This study argues that behavior is evolving with the smartness of building systems. By means of a semi-systematic literature review, this study presents key findings from peer-reviewed research that deal with building occupant behavior, building systems and energy use in campus buildings. The literature review was an iterative process based on six predefined research questions. Two key results are presented: a graph of reported energy-saving potentials and a conceptual framework to evaluate building occupants impact on building energy use. Furthermore, based on the identified research gaps in the selected literature, areas for future research are proposed.