An integrated avoiding and approaching human systems for mobile service robots in dynamic social environments

Van Bay Hoang, Dinh Nghia Do, Van Xuan Nguyen, Xuan-Tung Truong
Author affiliations

Authors

  • Van Bay Hoang Le Quy Don Technical University, 236 Hoang Quoc Viet, Bac Tu Liem, Ha Noi, Viet Nam
  • Dinh Nghia Do Le Quy Don Technical University, 236 Hoang Quoc Viet, Bac Tu Liem, Ha Noi, Viet Nam
  • Van Xuan Nguyen Le Quy Don Technical University, 236 Hoang Quoc Viet, Bac Tu Liem, Ha Noi, Viet Nam
  • Xuan-Tung Truong Le Quy Don Technical University, 236 Hoang Quoc Viet, Bac Tu Liem, Ha Noi, Viet Nam https://orcid.org/0000-0003-2353-9909

DOI:

https://doi.org/10.15625/2525-2518/15993

Keywords:

Socially aware navigation framework, mobile service robot, approaching human, timed elastic band technique, motion planning system

Abstract

In this study, we present a socially aware navigation framework for mobile service robots by integrating the systems proposed in our previous studies into a completed mobile robot navigation system, including the human detection and tracking system that is used to detect and track humans; the encoder and laser-based localization and mapping system that is used to determine the position of the robot in the environment; the approaching pose estimation system that is used to estimate the approaching pose of the robot to the human; and the social timed elastic band-based motion planning system that is used to socially navigate the mobile robots to approach the human. In addition, in the paper we describe in detail the motor control system and the design of our mobile robot platform, which is then utilized to conduct experiments in the real-world environments. We verify the feasibility and usefulness of the proposed socially aware robot navigation framework through a series of experiments in a corridor-like environment. The experimental results show that our proposed framework is able to drive the mobile robots to both avoid and approach the humans, providing the safety and comfort for the humans and socially acceptable behaviors for the mobile service robots in the dynamic social environments.

Downloads

Download data is not yet available.

References

Kruse T., Pandey A. K., Alami R., and Kirsch A. - Human-aware robot navigation: A survey, Robotics and Autonomous Systems 61 (2013) 1726-1743.

Rios-Martinez J., Spalanzani A., and Laugier C. - From proxemics theory to socially-aware navigation: A survey, International Journal of Social Robotics, September 2014.

Christoforos M., Francesca B., Allan W., Dapeng Z., Pete T., Aaron S., and Jean O. - Core challenges of social robot navigation: A survey,” arXiv:2103.05668v2, 2021, pp. 1-28.

Shiomi M., Zanlungo F., Hayashi K., and Kanda T. - Towards a socially acceptable collision avoidance for a mobile robot navigating among pedestrians using a pedestrian model, International Journal of Social Robotics 6 (3) (2014) 443-455.

Chen Y. F., Everett M., Liu M., and How J. P. - Socially aware motion planning with deep reinforcement learning, In: IEEE/RSJ International Conference on Intelligent Robots and Systems, September 2017, pp. 1343-1350.

Truong X. T. and Ngo T. D. - Toward socially aware robot navigation in dynamic and crowded environments: A proactive social motion model, IEEE Transactions on Automation Science and Engineering 14 (4) (2017) 1743-1760.

Hoang V. B., Nguyen V. H., Nguyen L. A., Quang T. D., and Truong X. T. - Social constraints-based socially aware navigation framework for mobile service robots, In: Proceedings of the 7th Nafosted Conference on Information and Computer Science (NICS), 2020, pp. 84-89.

Fan T., Long P., Liu W., and Pan J. - Distributed multi-robot collision avoidance via deep reinforcement learning for navigation in complex scenarios, The International Journal of Robotics Research 39 (7) (2020) 856-892.

Trinh T. Q., Wengefeld T., Mueller S., Vorndran A., Volkhardt M., Scheidig A., and Gross H. - Take a seat, please: Approaching and recognition of seated persons by a mobile robot, In: 50th International Symposium on Robotics, June 2018, pp. 1-8.

Mizumaru K., Satake S., Kanda T., and Ono T. - Stop doing it! approaching strategy for a robot to admonish pedestrians, In: 14th ACM/IEEE International Conference on Human-Robot Interaction, March 2019, pp. 449-457.

Truong X. T. and Ngo T. D. - To Approach Humans?: a unified framework for approaching pose prediction and socially aware robot navigation, IEEE Transactions on Cognitive and Developmental Systems 10 (3) (2017) 557-572.

Yang F. and Peters C. - App-lstm: Data-driven generation of socially acceptable trajectories for approaching small groups of agents, In: Proceedings of the 7th International Conference on Human-Agent In- teraction, 2019, pp. 144-152.

Nguyen V. H., Hoang V. B., My C. A., Kien L. M., and Truong X. T. - Toward socially aware trajectory planning system for autonomous mobile robots in complex environments, In: Proceedings of the 7th Nafosted Conference on Information and Computer Science (NICS), 2020, pp. 90-95.

Siegwart R., Nourbakhsh I. R., and Scaramuzza D. - Introduction to Autonomous Mobile Robots. The MIT Press, February 2011.

Arras K. O., Mozos O. M., and Burgard W. - Using boosted features for the detection of people in 2d range data,” in IEEE International Conference on Robotics and Automation, April 2007, pp. 3402-3407.

Welch G. and Bishop G. - An Introduction to the Kalman Filter. Chapel Hill, NC, USA: Tech. Rep. TR-95-041, University of North Carolina at Chapel Hill, 2006.

PrimeSense NITE, http://www.openni.org. Accessed 6 August 2012.

Nguyen L. A., Dung P. T., Ngo T. D., and Truong X. T. - Improving the accuracy of the autonomous mobile robot localization systems based on the multiple sensor fusion methods, In: International Conference on Recent Advances in Signal Processing, Telecommunications Computing, 2019, pp. 33-37.

Giorgio Grisetti, Cyrill Stachniss, and Wolfram Burgard - Improved Techniques for Grid Mapping with Rao-Blackwellized Particle Filters, IEEE Transactions on Robotics 23 (2007) 34-46.

Hart P. E., Nilsson N. J., and Raphael B. - A formal basis for the heuristic determination of minimum cost paths, IEEE Transactions on Systems Science and Cybernetics 4 (2) (1968) 100-107.

Kendon A. - Conducting interaction: Patterns of behavior in focused encounters, Cambridge University Press, 1990.

Hall E. T. - The hidden dimension: man’s use of space in public and private, The Bodley Head Ltd, London, 1996.

Rosmann C., Feiten W., Wosch T., Hoffmann F., and Bertram T. - Trajectory modification considering dynamic constraints of autonomous robots, In: 7th German Conference on Robotics, May 2012, pp. 1-6.

Rosmann C., Hoffmann F., and Bertram T. - Integrated online trajectory planning and optimization in distinctive topologies, Robotics and Autonomous Systems 88 (2017) 142-153.

Rosmann C., Oeljeklaus M., Hoffmann F., and Bertram T. - Online trajectory prediction and planning for social robot navigation, In: IEEE International Conference on Advanced Intelligent Mechatronics (AIM), 2017, pp. 1255-1260.

http://cc-smart.net/vi/san-pham/dcmp500.html

http://cc-smart.net/vi/san-pham/msdah.html

Quigley M., Gerkey B., Conley K., Faust J., Foote T., Leibs J., Berger E., Wheeler R., and A. Ng. - ROS: An open-source Robot Operating System, In: ICRA Workshop on Open Source Software, Vol. 32, 2009, pp. 151-170.

http://wiki.ros.org/teb_local_planner

http:// youtu.be/4RDPuzZglN0

Alahi A., Goel K., Ramanathan V., Robicquet A., Fei-Fei L., and Savarese S. - Social LSTM: Human trajectory prediction in crowded spaces, IEEE Conference on Computer Vision and Pattern Recognition, June 2016, pp. 961-971.

Rudenko A., Palmieri L., Herman M., Kitani K. M., Gavrila D. M., and Arras K. O. - Human motion trajectory prediction: A survey, https://arxiv.org/abs/1905.06113v3, 2019.

Downloads

Published

23-02-2022

How to Cite

[1]
V. B. Hoang, D. N. Do, V. X. Nguyen, and X.-T. Truong, “An integrated avoiding and approaching human systems for mobile service robots in dynamic social environments”, Vietnam J. Sci. Technol., vol. 60, no. 1, pp. 114–126, Feb. 2022.

Issue

Section

Mechanical Engineering - Mechatronics