We present a preliminary evaluation of an interactive, real-time, and co-creative performance system for Irish Traditional Dance music. We focus on how this musical partnership is experienced by a human musician performing withit in four aspects: enjoyability, musicality, humanness and responsiveness. Our preliminary study with seven traditional musicians reveals that they find playing with the system to be enjoyable, and appreciated its musicality; but they scored its humanness and responsiveness less highly. These findings suggest that such real-time performance systems might bring an enjoyable “otherness” to musical performance, even for traditional forms of music. Finally, we discuss experimental considerations for a future study involving more participants.