Forecasting Hand Gestures for Human-Drone Interaction

Abstract: Computer vision techniques that can anticipate people's actions ahead of time could create more responsive and natural humanrobot interaction systems. In this paper, we present a new human gesture forecasting framework for human-drone interaction. Our primary motivation is that despite growing interest in early recognition, little work has tried to understand how people experience these early recognition-based systems, and our human-drone forecasting framework will serve as a basis for conducting this human subjects research in future studies. We also introduce a new dataset with 22 videos of two human-drone interaction scenarios, and use it to test our gesture forecasting approach. Finally, we suggest followup procedures to investigate people's experience in interacting with these early recognition-enabled systems.