AUTOMATIC ASSEMBLY OF INTERLOCKING BUILDING CUBES BY USING VISUAL SERVOING APPROACH
DOI:
https://doi.org/10.55766/sujst-2024-01-e0462Keywords:
Robotic Arms, Kinematics Formulas, Automatic Assembly, Visual ServoingAbstract
Most of the robotic arms are set up for operation by the teach-and-repeat (T&R) technique, also known as coordinate-based control, using pre-recorded coordination values to generate robotic arm trajectories. This technique is inefficient because it requires teaching a robotic arm every single coordinate point to complete an operation. It is a manual, tedious and time-consuming task. Moreover, this task needs to be repeated if there are slight changes in the operation. This paper studied the visual servoing approach to replace the T&R technique in assembling different interlocking building cubes (IBC) combinations. The proposed method uses an image-based visual servo (IBVS) with a dynamic look-and-move system, and the eye-to-hand system, which requires computing the incremental joint angles of the robotic arm, a novel kinematic formula with a combination of Trigonometry formulas has been proposed in this paper. The experimental results show the feasibility of using a visual servoing approach to complete the assembly tasks without relying on the T&R technique and achieved an average success rate of 90% and an average of 40.2 seconds for task duration. Thus, this eliminates the tedious and time-consuming tasks of teaching the coordinate points to the robotic arms. Further improvement on the servo motor, camera and computer processor can be done to increase the accuracy, computation time and task duration in future.
References
Chaumette, F. and Hutchinson, S. (2006). Visual servo control. I. Basic approaches. IEEE Robotics & amp;amp; Automation Magazine, 13(4):82-90. https://doi.org/10.1109/MRA.2006.250573
Flandin, G., Chaumette, F., and Marchand, E. (2000). Eye-in-hand/eye-to-hand cooperation for visual servoing. IEEE International Conference on Robotics and Automation (ICRA), 2,741-2,746 https://doi.org/10.1109/ROBOT.2000.846442
Gao, Y., Su, Y., Dong, W., Wang, W., Du, Z., Gao, X., and Mu, Y. (2014). U-Pendant: A universal teach pendant for serial robots based on ROS. IEEE International Conference on Robotics and Biomimetics. 2,529-2,534. https://doi.org/10.1109/ROBIO.2014.7090721
Ghaniwala, A.N., Khan, M.A., Akhtar, M.M., Shaikh, A., Affan, M., and Uddin, R. (2021). Analytical Kinematic analysis of Multi-DOF serial link robot arm. nternational Electrical Engineering Conference (IEEC 2021), 1-6.
Hafez, A.H.A., Cervera, E., and Jawahar, C.V. (2008). Hybrid Visual Servoing by Boosting IBVS and PBVS. 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications. https://doi.org/10.1109/ICTTA.2008.4530116
Hutchinson, S., Hager, G.D., and Corke, P.I. (1996). A tutorial on visual servo control. IEEE Transactions on Robotics and Automation, 12(5):651-670. https://doi.org/10.1109/70.538972
Kazemi, M., Gupta, K. and Mehrandezh, M. (2009). Global path planning for robust Visual Servoing in complex environments. 2009 IEEE International Conference on Robotics and Automation, 326-332. https://doi.org/10.1109/ROBOT.2009.5152453
Kazemi, M., Gupta, K., and Mehrandezh, M. (2010). Path-Planning for Visual Servoing: A Review and Issues. Visual Servoing via Advanced Numerical Methods, 189-207. https://doi.org/10.1007/978-1-84996-089-2_11
Kelly, R., Carelli, R., Nasisi, O., Kuchen, B., and Reyes, F. (2000). Stable visual servoing of camera-in-hand robotic systems. IEEE/ASME Transactions on Mechatronics, 5(1):39-48. https://doi.org/10.1109/3516.828588
Kulpate, C., Mehrandezh, M. and Paranjape, R. (2005). An eye-to-hand visual servoing structure for 3D positioning of a robotic arm using one camera and a flat mirror. 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems. https://doi.org/10.1109/IROS.2005.1545348
Mahanta, G.B., Deepak, B.B.V.L., Dileep, M., Biswal, B.B. and Pattanayak, S.K. (2019). Prediction of Inverse Kinematics for a 6-DOF Industrial Robot Arm Using Soft Computing Techniques. Soft Computing for Problem Solving, 519-530. https://doi.org/10.1007/978-981-13-1595-4_42
Malis, E., Chaumette, F., and Boudet, S. (1998). Positioning a coarse-calibrated camera with respect to an unknown object by 2D 1/2 visual servoing. Proceedings. 1998 IEEE International Conference on Robotics and Automation, 1,352-1,359. https://doi.org/10.1109/ROBOT.1998.677293
Ogawa, T. and Kanada, H. (2010). Solution for Ill-Posed Inverse Kinematics of Robot Arm by Network Inversion. Journal of Robotics, 2010:1-10. https://doi.org/10.1155/2010/870923
Palmieri, G., Palpacelli, M., Battistelli, M., and Callegari, M. (2012). A Comparison between Position-Based and Image-Based Dynamic Visual Servoings in the Control of a Translating Parallel Manipulator. Journal of Robotics, 2012:1-11. https://doi.org/10.1155/2012/103954
Smith, C., Karayiannidis, Y., Nalpantidis, L., Gratal, X., Qi, P., Dimarogonas, D. V., and Kragic, D. (2012). Dual arm manipulation - A survey. Robotics and Autonomous Systems, 60(10):1,340-1,353. https://doi.org/10.1016/j.robot.2012.07.005
Sun, X., Zhu, X., Wang, P., and Chen, H. (2018). A Review of Robot Control with Visual Servoing. Proceedings of 2018 IEEE 8th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems, 116-121. https://doi.org/10.1109/CYBER.2018.8688060
Tee, T.H., Eu, K.S., Yap, K.M., Marshall, A., and Lee, T. (2013). 3D Smart User Interactive System with Real-Time Responding Tele-Robotic Proprioceptive Information. 2013 4th International Conference on Intelligent Systems, Modelling and Simulation, 404-408. https://doi.org/10.1109/ISMS.2013.90
