Oil Palm Fresh Fruit Bunch Ripeness Classification by Deep Learning
Keywords:
Artificial Intelligence, Computer Vision, Deep Learning, Image Classification, Grad-CAMAbstract
Currently, palm-oil mills in Thailand employ staff to visually assess the ripeness of fresh palm bunches at point of purchase. This practice suffers from some limitations; the staff sometimes misjudges the ripeness of fresh palm bunches. As a result, palm-oil mills have a higher than usual cost of purchasing palm bunches. The present research therefore aimed to develop a deep-learning model that can be used to analyze photographs of oil palm fresh fruit bunches and accurately classify their ripeness. The results showed that the ResNet50(C) model provided the best adjusted accuracy at 90%, where the F1 score of each category was noted to be higher than 80% ripeness. However, it is a large model and requires a longer average testing time (405 MB, 2.48 seconds (GPU), 3.27 seconds (CPU)). If a smaller model size is desired and a faster average testing time is needed, DenseNet121 (Train from Scratch) model can instead be considered. Although the model provided the adjusted accuracy at 86%, slightly less than that of the ResNet50(C) model, its F1 score for each class was as well above 80%; the model is smaller and requires a shorter average testing time (100 MB, 1.76 seconds (GPU), 2.56 seconds (CPU)). The model is also highly robust to changes in the brightness of the photographs (range -70 to +70 from normal sunlight).
References
U.S. Department of Agriculture, 2020, World Production of Palm Oil 2020 [Online], Available: https://ipad.fas.usda.gov/cropexplorer/cropview/commodityView.aspx?cropid=4243000&sel_year=2020&startrow=1. [29 July 2021]
Krungsri Research, 2020, Industry Outlook 2020-2022: Palm Oil Industry [Online], Available: https://www.krungsri.com/en/research/industry/industry-outlook/agriculture/sugar-(1)/IO/io-oil-palm-20-th.
The Department of Internal Trade, 2020, Public Information: Palm oil [Online], Available: https://agri.dit.go.th/index.php/department_sub/3/ปาล์มน้ำมัน/28. [29 July 2021]
The Department of Internal Trade, 2018, Announcement of the Office of the Central Committee on Prices of Goods and Services No. 13 (2018) Regarding the Purchase Price of Crude Palm Oil (2nd time) [Online], Available: https://www.dit.go.th/Content.aspx?m=12&c=14486. [29 July 2021]
National Bureau of Agricultural Commodity and Food Standards, 2019, Thai Agriculture Standard: Oil Palm Bunch [Online], Available: https://www.opsmoac.go.th/krabi-dwl-files-421591791812. [29 July 2021]
Malaysian Palm Oil Board (MPOB), 2003, MPOB Grading Manual [Online], Available: https://dokumen.tips/download/link/mpob -grading-manualnew2.html#google_vignette. [29 July 2021]
Alfatni, M.S.M., Shariff, A.R.M., Shafri, H.Z.M., Saaed, O.M.B. and Eshanta, O.M., 2008, “Oil Palm Fruit Bunch Grading System using Red, Green and Blue Digital Number,” Journal of Applied Sciences, 8 (8), pp. 1444-1452.
Jamil, N., Mohamed, A. and Abdullah, S., 2009, “Automated Grading of Palm Oil Fresh Fruit Bunches (FFB) using Neuro-fuzzy Technique,” 2009 International Conference of Soft Computing and Pattern Recognition, pp. 245-249.
Fadilah, N., Mohamad-Saleh, J., Halim, Z.A., Ibrahim, H. and Ali, S.S.S., 2012, “Intelligent Color Vision System for Ripeness Classification of Oil Palm Fresh Fruit Bunch,” Sensors (Basel, Switzerland), 12 (10), pp. 14179–14195.
Fadilah, N. and Mohamad-Saleh, J., 2014, “Color Feature Extraction of Oil Palm Fresh Fruit Bunch Image for Ripeness Classification,” International Conference on Applied Computer and Applied Computational Science (ACACOS), 23-25 April 2014, Kuala Lumpur, Malaysia, pp. 51-55.
Bensaeed, O.M., Shariff, A.M., Mahmud, A.B., Shafri, H. and Alfatni, M., 2014, “Oil Palm Fruit Grading using a Hyperspectral Device and Machine Learning Algorithm,” IOP Conference Series: Earth and Environmental Science, 7th IGRSM International Remote Sensing & GIS Conference and Exhibition, 22-23 April 2014, Kuala Lumpur, Malaysia.
Ibrahim, Z., Sabri, N. and Isa, D., 2018, “Palm Oil Fresh Fruit Bunch Ripeness Grading Recognition using Convolutional Neural Network,” Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 10 (3-2), pp. 109–113.
Saleh, A. and Liansitim, E., 2020, “Palm Oil Classification using Deep Learning,” Science in Information Technology Letters, 1 (1), pp. 1-8.
Herman, H., Susanto, A., Cenggoro, T.W., Suharjito, S. and Pardamean, B., 2020, “Oil Palm Fruit Image Ripeness Classification with Computer Vision using Deep Learning and Visual Attention,” Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 12 (2), pp. 21–27.
Herman, H., Cenggoro, T.W., Susanto, A. and Pardamean, B., 2021, “Deep Learning for Oil Palm Fruit Ripeness Classification with DenseNet,” IEEE International Conference on Information Management and Technology (ICIMTech), 19-20 August 2021, Jakarta, Indonesia.
Simonyan, K. and Zisserman, A., 2015, “Very Deep Convolutional Networks for Large-Scale Image Recognition,” International Conference on Learning Representations (ICLR), 7-9 May 2015, San Diego, CA, USA, pp. 1-14.
He, K., Zhang, X., Ren, S. and Sun, J., 2016, “Deep Residual Learning for Image Recognition,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 27-30 June 2016, Las Vegas, NV, USA.
Tan, M. and Le, Q.V., 2019, “EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks,” International Conference on Machine Learning (ICML), 9-15 June 2019, Long Beach, CA, USA, pp. 6105-6114.
Huang, G., Liu, Z., Maaten, L. and Weinberger, K.Q., 2017, “Densely Connected Convolutional Networks,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 21-26 July 2017, Honolulu, HI, USA.
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. and Wojna, Z., 2016, “Rethinking the Inception Architecture for Computer Vision,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 27-30 June 2016, Las Vegas, NV, USA.
Chollet, F., 2017, “Xception: Deep Learning with Depthwise Separable Convolutions,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 21-26 July 2017, Honolulu, HI, USA.
Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., Adam, H. and Le, Q., 2019, “Searching for MobileNetV3,” IEEE/CVF International Conference on Computer Vision (ICCV), 27 October-2 November 2019, Seoul, South Korea.
Lin, T., Goyal, P., Girshick, R., He, K. and Dollár, P., 2017, “Focal Loss for Dense Object Detection,” IEEE International Conference on Computer Vision (ICCV), 22-29 October 2017, Venice, Italy.
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D. and Batra, D., 2017, “Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization,” IEEE International Conference on Computer Vision (ICCV), 22-29 October 2017, Venice, Italy.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 King Mongkut's University of Technology Thonburi
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Any form of contents contained in an article published in Science and Engineering Connect, including text, equations, formula, tables, figures and other forms of illustrations are copyrights of King Mongkut's University of Technology Thonburi. Reproduction of these contents in any format for commercial purpose requires a prior written consent of the Editor of the Journal.
