How can humans and robots perform live music together, in a fluent and synchronized way, and what can we learn from robotic musicianship for other human-robot collaborative tasks? Music is one of the most time-critical kinds of human-robot interactions. We have developed algorithms for Shimon, a robotic marimba player that listens to a human pianist, and plays it part in a a jazz duo.
Related paper: Hoffman & Weinberg 2011.