Kenji Koide @ AIST | Monocular Person Tracking and Identification with Online Deep Feature Selection for Person Following Robots

Monocular Person Tracking and Identification with Online Deep Feature Selection for Person Following Robots

  • Kenji Koide
  • Jun Miura
  • Emanuele Menegatti

Robotics and Autonomous Systems, Vol. 124, 2020



Abstract

This paper presents a new person tracking and identification framework based on solely a monocular camera. In this framework, we first track persons in the robot coordinate space using Unscented Kalman filter with the ground plane information and human height estimation. Then, we identify the target person to be followed with the combination of Convolutional Channel Features (CCF) and online boosting. It allows us to take advantage of deep neural network-based feature representation while adapting the person classifier to a specific target person depending on the circumstances. The entire system can be run on a recent embedded computation board with a GPU (NVIDIA Jetson TX2), and it can easily be reproduced and reused on a new mobile robot platform. Through evaluations, we validated that the proposed method outperforms existing person identification methods for mobile robots. We applied the proposed method to a real person following robot, and it has been shown that CCF-based person identification realizes robust person following in both indoor and outdoor environments.


Related Work

Identification of a Specific Person using Color, Height, and Gait Features for a Person Following Robot
Kenji Koide and Jun Miura
Robotics and Autonomous Systems, Vol. 84, No. 10, pp. 76-87, 2016
pdf doi

Person Identification Based on the Matching of Foot Strike Timings Obtained by LRFs and Smartphone
Kenji Koide and Jun Miura
Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2016), pp. 4187-4192, Daejeon, Korea, Oct., 2016
pdf doi

Convolutional Channel Features-based Person Identification for Person Following Robots
Kenji Koide and Jun Miura
Proc. 15th International Conference on Intelligent Autonomous Systems (IAS-15), pp. 186-198, Baden-Baden, Germany, June, 2018
pdf doi

Video