Access the full text.
Sign up today, get DeepDyve free for 14 days.
A. Merzlyakov, Steve Macenski (2021)
A Comparison of Modern General-Purpose Visual SLAM Approaches2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Delong Zhu, Z. Min, Tong Zhou, Tingguang Li, M. Meng (2021)
An Autonomous Eye-in-Hand Robotic System for Elevator Button Operation Based on Deep Recognition NetworkIEEE Transactions on Instrumentation and Measurement, 70
Daniel Troniak, Junaed Sattar, Ankur Gupta, J. Little, Wesley Chan, Ergun Calisgan, E. Croft, H. Loos (2013)
Charlie Rides the Elevator -- Integrating Vision, Navigation and Manipulation towards Multi-floor Robot Locomotion2013 International Conference on Computer and Robot Vision
A. Abdulla, M. Ali, N. Stoll, K. Thurow (2018)
Integration of Navigation, Vision, and Arm Manipulation Towards Elevator Operation for Laboratory Transportation System Using Mobile RobotsJ. Autom. Mob. Robotics Intell. Syst., 11
Jeong-Gwan Kang, S. An, Se-Young Oh (2007)
Navigation strategy for the service robot in the elevator environment2007 International Conference on Control, Automation and Systems
S. Kohlbrecher, O. Stryk, Johannes Meyer, U. Klingauf (2011)
A flexible and scalable SLAM system with full 3D motion estimation2011 IEEE International Symposium on Safety, Security, and Rescue Robotics
Wolfgang Hess, Damon Kohler, H. Rapp, D. Andor (2016)
Real-time loop closure in 2D LIDAR SLAM2016 IEEE International Conference on Robotics and Automation (ICRA)
Heon-Hui Kim, Dae-Jin Kim, Kwang-Hyun Park (2012)
Robust Elevator Button Recognition in the Presence of Partial Occlusion and Clutter by Specular ReflectionsIEEE Transactions on Industrial Electronics, 59
Wen-June Wang, Cheng-Hao Huang, I-Hsian Lai, Han-Chun Chen (2010)
A robot arm for pushing elevator buttonsProceedings of SICE Annual Conference 2010
N. Saad, N. Noor, A. Abdullah, O. Fong, N. Rahman (2017)
Real-Time LCD Digit Recognition SystemIndonesian Journal of Electrical Engineering and Computer Science, 6
G. Grisetti, C. Stachniss, Wolfram Burgard (2007)
Improved Techniques for Grid Mapping With Rao-Blackwellized Particle FiltersIEEE Transactions on Robotics, 23
A. Abdulla, Hui Liu, N. Stoll, K. Thurow (2016)
A New Robust Method for Mobile Robot Multifloor Navigation in Distributed Life Science LaboratoriesJournal of Control Science and Engineering, 2016
Xinguo Yu, Li Dong, Liyuan Li, Kah Hoe (2009)
Lift-button detection and recognition for service robot in buildings2009 16th IEEE International Conference on Image Processing (ICIP)
Po-Yu Yang, Tzu-Hsuan Chang, Y. Chang, Bing-Fei Wu (2018)
Intelligent Mobile Robot Controller Design for Hotel Room Service with Deep Learning Arm-Based Elevator Manipulator2018 International Conference on System Science and Engineering (ICSSE)
W. Zakaria, M. Daud, S. Razali, M. Abas (2014)
Elevator‘s External Button Recognition and Detection for Vision-based System, 1
Bor‐Sen Chen, Yueh-Yu Tsai, Min-Yen Lee (2021)
Robust Decentralized Formation Tracking Control for Stochastic Large-Scale Biped Robot Team System Under External Disturbance and Communication RequirementsIEEE Transactions on Control of Network Systems, 8
Koji Iwase, J. Miura, Y. Shirai (2007)
Teaching a Mobile Robot to Take Elevators
Steve Macenski, F. Mart'in, Ruffin White, Jonatan Clavero (2020)
The Marathon 2: A Navigation System2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Delong Zhu, Tingguang Li, Danny Ho, Tong Zhou, M. Meng (2018)
A Novel OCR-RCNN for Elevator Button Recognition2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
E. Klingbeil, Blake Carpenter, Olga Russakovsky, A. Ng (2010)
Autonomous operation of novel elevators for robot navigation2010 IEEE International Conference on Robotics and Automation
Jianjie Shi, Q. An, Jinping Li (2018)
Button location and recognition method for elevator based on artificial mark and geometric transformation, 10828
Fan Wang, Gerry Chen, Kris Hauser (2018)
Robot Button Pressing in Human Environments2018 IEEE International Conference on Robotics and Automation (ICRA)
Zijian Dong, Delong Zhu, M. Meng (2017)
An autonomous elevator button recognition system based on convolutional neural networks2017 IEEE International Conference on Robotics and Biomimetics (ROBIO)
Dechao Chen, Shuai Li, Qing Wu (2020)
A Novel Supertwisting Zeroing Neural Network With Application to Mobile Robot ManipulatorsIEEE Transactions on Neural Networks and Learning Systems, 32
K. Thurow, Lei Zhang, Hui Liu, S. Junginger, N. Stoll, Jiahao Huang (2019)
Multi-floor laboratory transportation technologies based on intelligent mobile robotsTransportation Safety and Environment
J. Juang, C. Yu, Chih-Min Lin, Rong-Guan Yeh, I. Rudas (2013)
Real-Time Image Recognition and Path Tracking of a Wheeled Mobile Robot for Taking an ElevatorActa Polytechnica Hungarica, 10
Because mobile manipulators are unable to climb stairs, the elevator operation is a crucial capacity to help those kinds of robot systems work in modern multifloor buildings. Here, the elevator button manipulation is considered as an efficient approach to fulfill that requirement. Previously, some studies presented elevator button recognition algorithms while some others designed schemes for the button manipulation work. However, the mobile robot, the manipulator and the camera in their robot systems are asynchronous. Besides, the time-consuming calibration for the camera is inevitable, especially in changeable environments. This paper aims to present an alternative method for the elevator button manipulation to overcome mentioned shortcomings.Design/methodology/approachIn this paper, the elevator button manipulation is conducted by using the visual-based self-driving mobile manipulator in which the autonomous mobile robot, the manipulator and the camera cooperate more efficiently. Namely, the mobile robot does not need to be located exactly in front of the elevator panel as the manipulator has the ability to adjust the initial frame of the camera based on the system kinematic synchronization. In addition, the proposed method does not require the real world coordinates of elevator buttons, but uniquely using their pixel positions. By doing this, not only is the projection from two-dimensional pixel coordinates to three-dimensional (3D) real world coordinates unnecessary, but also the calibration of the camera is not required.FindingsThe proposed method is experimentally verified by using a visual-based self-driving mobile manipulator. This robotic system is the integration of an autonomous mobile robot, a manipulator and a camera mounted on the end-effector of the manipulator.Research limitations/implicationsBecause the surface of the elevator button panel is usually mirror-like, the elevator button detection is easily affected by the glare and the brightness of the environmental light condition.Practical implicationsThis robot system can be used for the goods delivery or the patrol in modern multifloor buildings.Originality/valueThis paper includes three new features: simultaneously detecting and manipulating elevator buttons without the projection from pixel coordinates to 3D real world coordinates, a kinematic synchronization to help the robot system eliminate accumulated errors and a safe human-like elevator button manipulation.
Industrial Robot: An International Journal – Emerald Publishing
Published: Jan 2, 2023
Keywords: Robotics; Elevator button manipulation; Kinematic synchronization; Robotic system integration; Self-driving mobile manipulator
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.