VISION-BASED ACCIDENT IDENTIFICATION IN TRAFFIC VIDEOS USING DEEP LEARNING
DOI:
https://doi.org/10.55766/sujst-2023-06-e0939Keywords:
Deep learning, road safety, transfer learning, vehicle accident detectionAbstract
Traffic collisions have emerged as a prominent factor contributing to a significant rise in injury-related fatalities and injuries, making them a pressing concern for public safety. Statistics show that an estimated 1.4 million people die in traffic accidents every year and around fifty million are injured. With the increasing population, ensuring road safety has become one of the critical challenges for city administration. In response to this challenge, the field of computer vision has gained prominence, focusing on the development of digital systems capable of processing, analyzing, and interpreting visual data like humans. Recently, a few studies have applied machine learning techniques for accident detection in traffic videos, offering automated solutions for city monitoring. However, these existing models are limited to binary classification, that is, they only determine whether the accident has occurred or not. This research takes a step further by proposing a deep learning-based accident classification model that not only identifies vehicle accidents but also categorizes them based on the type of collision. We employ the transfer learning technique and evaluate five pre-trained models, including DenseNet121, InceptionNetV3, ResNet50, VGG16, and Xception. Our findings demonstrate that VGG16 stands out for the vehicle accident classification task, achieving an impressive accuracy of 96.76%. This research offers a significant contribution to enhance road safety by advancing the capabilities of accident detection and classification systems. The identification of collision types presented in this research empowers safety authorities and organizations to conduct more effective safety analyses serving dual purposes. Firstly, it ensures that emergency response teams and medical personnel are adequately prepared and secondly, it allows insurance companies to make fair determinations of liability and coverage.
References
Adeel, A., Gogate, M., and Hussain, A. (2020). Contextual deep learning-based audio-visual switching for speech enhancement in real-world environments. Information Fusion, 59:163-170. https://doi.org/10.1016/j.inffus.2019. 08.008
Alzubaidi, L., Zhang, J., Humaidi, A.J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría J., Fadhel, M.A., Al-Amidie, M., and Farhan, L. (2021). Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. Journal of Big Data, 8(1):53. https://doi.org/10.1186/s40537-021-00444-8
Basiri, M., Azim, A.Z., and Farrokhi, M. (2017). Smart city solution for sustainable urban development. European Journal of Sustainable Development, 6(1):71-84. https://doi.org/10.14207/ejsd.2017.v6n1p71
Chan, F.H., Chen, Y.T., Xiang, Y., and Sun, M. (2017). Anticipating accidents in dashcam videos. In: Computer Vision - ACCV 2016. Lai, S.H., Lepetit, V., Nishino, K., and Sato, Y. (eds). Springer, Cham, 10114:136-153. https://doi.org/10.1007/978-3-319-54190-7_9
Chand, D., Gupta, S., and Kavati, I. (2020). Computer vision based accident detection for autonomous vehicles. In: 2020 IEEE 17th India Council International Conference (INDICON), New Delhi, India, p. 1-6. https://doi.org/ 10.1109/INDICON49873.2020.9342226
Chollet, F. (2017). Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 2017, p. 1800-1807. https://doi.org/10.1109/CVPR.2017.195
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009). ImageNet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA, 2009, p. 248-255. https://doi.org/10.1109/CVPR.2009.5206848
Dogru, N. and Subasi, A. (2018). Traffic accident detection using random forest classifier. In: 2018 15th Learning and Technology Conference (L&T), Jeddah, Saudi Arabia, 2018, p. 40-45. https://doi.org/10.1109/LT.2018.8368509
Esteva, A., Kuprel, B., Novoa, R.A., Ko, J., Swetter, S.M., Blau, H.M., and Thrun, S. (2017). Dermatologist-level classification of skin cancer with deep neural networks. Nature, 542(7639):115-118. https://doi.org/10.1038/ nature21056
Farman, H., Khan, Z., Jan, B., Boulila, W., Habib, S., and Koubaa, A. (2022). Smart transportation in developing countries: an internet-of-things-based conceptual framework for traffic control. Wireless Communications and Mobile Computing, 2022:Article ID 8219377. https://doi.org/10.1155/2022/8219377
Foggia, P., Petkov, N., Saggese, A., Strisciuglio, N., and Vento, M. (2015). Audio surveillance of roads: A system for detecting anomalous sounds. IEEE Transactions on Intelligent Transportation Systems, 17(1):279-288. https://doi.org/10.1109/TITS.2015.2470216
Ghosh, S., Sunny, S.J., and Roney, R. (2019). Accident detection using convolutional neural networks. In: 2019 International Conference on Data Science and Communication, (IconDSC), Bangalore, India, 2019, p. 1-6. https://doi.org/10.1109/IconDSC.2019.8816881
Gupta, G., Singh, R., Singh Patel, A., Ojha, M. (2021). Accident detection using time-distributed model in videos. In: Yang, XS., Sherratt, S., Dey, N., and Joshi, A. (eds). Proceedings of Fifth International Congress on Information and Communication Technology. Advances in Intelligent Systems and Computing, Springer, Singapore, 1184:214-223. https://doi.org/10.1007/978-981-15-5859-7_21
He, K., Zhang, X., Ren, S., and Sun, J. ( 2016). Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016, p. 770-778. https://doi.org/10.1109/CVPR.2016.90
Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017). Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 2017, p. 2261-2269. https://doi.org/10.1109/ CVPR.2017.243
Kelley, M.E., Talton, J.W., Weaver, A.A., Usoro, A.O., Barnard, E.R., and Miller, A.N. (2019). Associations between upper extremity injury patterns in side impact motor vehicle collisions with occupant and crash characteristics. Accident Analysis & Prevention, 122:1-7. https://doi.org/ 10.1016/j.aap.2018.09.029
Kim, K., Nitz, L., Richardson, J., and Li, L. (1994). Analyzing the relationship between crash types and injuries in motor vehicle collisions in Hawaii. Transportation Research Record, 1467:9-13.
Koppe, G., Meyer-Lindenberg, A., and Durstewitz, D. (2021). Deep learning for small and big data in psychiatry. Neuropsychopharmacology, 46(1):176-190. https://doi.org/ 10.1038/s41386-020-0767-z
Maaloul, B., Taleb-Ahmed, A., Niar, S., Harb, N., and Valderrama, C. (2017). Adaptive video-based algorithm for accident detection on highways. In: 2017 12th IEEE International Symposium on Industrial Embedded Systems (SIES), Toulouse, France, 2017, p. 1-6. https://doi.org/10.1109/SIES.2017.7993382
Nagpal, K., Foote, D., Liu, Y., Chen, P.-H.C., Wulczyn, E., Tan, F., Olson, N., Smith, J.L., Mohtashamian, A., Wren, J.H., Corrado, G.S., MacDonald, R., Peng, L.H., Amin, M.B., Evans, A.J., Sangoi, A.R., Mermel, C.H., Hipp, J.D., and Stumpe, M.C. (2019). Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer. NPJ Digital Medicine, 2(1):48. https://doi.org/10.1038/s41746-019-0112-2
O'Shea, K. and Nash, R. (2015). An introduction to convolutional neural networks. arXiv:1511.08458. https://doi.org/ 10.48550/arXiv.1511.08458
Papa, R., Gargiulo, C., and Galderisi, A. (2013). Towards an urban planners’ perspective on Smart City. TeMA Journal of Land Use, Mobility and Environment, 6(1):5-17. https://doi.org/10.6092/1970-9870/1536
Rajesh, G., Benny, A.R., Harikrishnan, A., Jacob Abraham, J., and John, N.P. (2020). A deep learning based accident detection system. In: 2020 International Conference on Communication and Signal Processing (ICCSP), Chennai, India, July 2020, p. 1322-1325. https://doi.org/10.1109/ ICCSP48568.2020.9182224
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A.C., and Fei-Fei, L. (2015). ImageNet large scale visual recognition challenge. International Journal of Computer Vision, 115(3):211-252. https://doi.org/ 10.1007/s11263-015-0816-y
Saravanarajan, V.S., Chen, R.-C., Dewi, C., Chen, L.-S., and Ganesan, L. (2023). Car crash detection using ensemble deep learning. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-023-15906-9
Shah, A.P., Lamare, J.B., Nguyen-Anh, T., and Hauptmann, A. (2018). CADP: A novel dataset for cctv traffic camera based accident analysis. In: 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Auckland, New Zealand, 2018, p. 1-9. https://doi.org/10.1109/AVSS.2018.8639160
Simonyan, K. and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv: 1409.1556. https://doi.org/10.48550/arXiv.1409.1556
Singh, D. and Mohan, C.K. (2022). Deep spatio-temporal representation for detection of road accidents using stacked autoencoder. IEEE Transactions on Intelligent Transportation Systems, 20(3):879-887. https://doi.org/ 10.1109/TITS.2018.2835308
Sun, L.-L., Liu, D., Chen, T., and He, M.-T., (2019). Road traffic safety: An analysis of the cross-effects of economic, road and population factors. Chinese Journal of Traumatology, 22(5):290-295. https://doi.org/10.1016/j.cjtee.2019.07.004
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015). Going deeper with convolutions. In: Proceedings of the EEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, 2015, p. 1-9. https://doi.org/10.1109/CVPR.2015.7298594
Torrey, L. and Shavlik, J. (2010). Transfer learning. In: Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, IGI Global, p. 242-264. https://doi.org/ 10.4018/978-1-60566-766-9.ch011
WHO. (2022). Road Traffic Injuries. [Online]. Available from: https://www.who.int/news-room/fact-sheets/detail/road-traffic-injuries. Accessed date: Aug. 29, 2022.
Yao, Y., Wang, X., Xu, M., Pu, Z., Atkins, E., and Crandall, D. (2020). When, Where, and What? A New Dataset for Anomaly Detection in Driving Videos. [Online]. Available: http://arxiv.org/abs/2004.03044 Accessed: Aug 02, 2022.
Young, T., Hazarika, D., Poria, S., and Cambria, E. (2018). Recent trends in deep learning based natural language processing. IEEE Computational Intelligence Magazine, 13(3):55-75. https://doi.org/10.1109/MCI.2018.2840738
