About this article
- Submitted: Jun 05, 2023
- Final Revised: Oct 05, 2023
- Accepted: Oct 31, 2023
- Published: Dec 30, 2023
- Abstract view: 14
- PDF Download: 1
- Volumes: Vol. 1 No. 2 (2023) Pages 113-126
- DOI: 10.63208/21018-99
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Copyright (c) 2023 Computing and Algorithm Insight
Cite this article
Abstract
Accurate weather classification is essential for the safety and adaptability of autonomous vehicles (AVs). This paper proposes a deep learning (DL) detection framework leveraging transfer learning to categorize outdoor weather conditions in both normal and adverse scenarios. We evaluated the performance of three specific CNN architectures SqueezeNet, ResNet-50, and EfficientNet utilizing Nvidia GPU hardware. The study employed a combined dataset from DAWN2020 and MCWRD2018 to train the models on six weather classes: cloudy, rainy, snowy, sandy, shine, and sunrise. Experimental results identified ResNet-50 as the superior model, achieving detection accuracy, precision, and sensitivity of 98.48%, 98.51%, and 98.41%, respectively. Additionally, the model exhibited a low inference time of 5 ms. When compared to current state-of-the-art methods, our approach improved classification accuracy by a factor of 0.5–21%. Consequently, this framework is well-suited for real-time implementation, providing AVs with on-demand, high-precision decision support.
References
Wang, H.; Yu, Y.; Cai, Y.; Chen, X.; Chen, L.; Liu, Q. A Comparative Study of State-of-the-Art Deep Learning Algorithms for Vehicle Detection. IEEE Intell. Transp. Syst. Mag. 2019, 11, 82–95.
Hossain, S.; Lee, D.-J. Deep Learning-Based Real-Time Multiple-Object Detection and Tracking from Aerial Imagery via a Flying Robot with GPU-Based Embedded Devices. Sensors 2019, 19, 3371.
Abu Al-Haija, Q.; Samad, M.D. Efficient LuxMeter Design Using TM4C123 Microcontroller with Motion Detection Application. In Proceedings of the 11th International Conference on Information and Communication Systems (ICICS), Irbid, Jordan, 7–9 April 2020; pp. 331–336.
Hassaballah, M.; Kenk, M.A.; Muhammad, K.; Minaee, S. Vehicle Detection and Tracking in Adverse Weather Using a Deep Learning Framework. IEEE Trans. Intell. Transp. Syst. 2020, 22, 4230–4242.
Kenk, M.A.; Hassaballah, M. DAWN: Vehicle Detection in Adverse Weather Nature Dataset. arXiv 2020, arXiv:2008.05402.
McVeigh, J.; Bates, G.; Chandler, M. Steroids and Image Enhancing Drugs; Centre for Public Health, Liverpool John Moores University: Liverpool, UK, 2015.
Atkinson, A.M.; van de Ven, K.; Cunningham, M.; de Zeeuw, T.; Hibbert, E.; Forlini, C.; Barkoukis, V.; Sumnall, H. Performance and image enhancing drug interventions aimed at increasing knowledge among healthcare professionals (HCP): Reflections on the implementation of the Dopinglinkki e-module in Europe and Australia in the HCP workforce. Int. J. Drug Policy 2021, 95, 103141.
Sindhu, V.S. Vehicle Identification from Traffic Video Surveillance Using YOLOv4. In Proceeding of the 5th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India, 6–8 May 2021.
Wang, D.; Wang, J.-G.; Xu, K. Deep Learning for Object Detection, Classification and Tracking in Industry Applications. Sensors 2021, 21, 7349.
Blettery, E.; Fernandes, N.; Gouet-Brunet, V. How to Spatialize Geographical Iconographic Heritage. In Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, Online, 17 October 2021.
Lou, G.; Deng, Y.; Zheng, X.; Zhang, T.; Zhang, M. An investigation into the state-of-the-practice autonomous driving testing. arXiv 2021, arXiv:2106.12233.
Fan, R.; Djuric, N.; Yu, F.; McAllister, R.; Pitas, I. Autonomous Vehicle Vision 2021: ICCV Workshop Summary. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada, 10–17 October 2021.
Lei, D.; Kim, S.-H. Application of Wireless Virtual Reality Perception and Simulation Technology in Film and Television Animation. J. Sensors 2021, 2021, 1–12.
Lee, L.-H.; Braud, T.; Zhou, P.; Wang, L.; Xu, D.; Lin, Z.; Kumar, A.; Bermejo, C.; Hui, P. All one needs to know about metaverse: A complete survey on technological singularity, virtual ecosystem, and research agenda. arXiv 2021, arXiv:2110.05352.
Cohen, S.; Lin, Z.; Ling, M. Utilizing Object Attribute Detection Models to Automatically Select Instances of Detected Objects in Images. U.S. Patent No. 11,107,219, 31 August 2021.
Chang, W.W.T.; Cohen, S.; Lin, Z.; Ling, M. Utilizing Natural Language Processing and Multiple Object Detection Models to Automatically Select Objects in Images. U.S. Patent Application No. 16/800,415, 26 August 2021.
Villa, F.; Severini, F.; Madonini, F.; Zappa, F. SPADs and SiPMs Arrays for Long-Range High-Speed Light Detection and Ranging (LiDAR). Sensors 2021, 21, 3839.
Abu Al-Haija, Q.; Al-Saraireh, J. Asymmetric Identification Model for Human-Robot Contacts via Supervised Learning. Symmetry 2022, 14, 591.
Bayoudh, K.; Knani, R.; Hamdaoui, F.; Mtibaa, A. A survey on deep multimodal learning for computer vision: Advances, trends, applications, and datasets. Vis. Comput. 2021, 1–32.
Jiang, H.; Hu, J.; Liu, D.; Xiong, J.; Cai, M. DriverSonar: Fine-Grained Dangerous Driving Detection Using Active Sonar. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Online, 14 September 2021; Volume 5, pp. 1–22.
Gupta, A.; Anpalagan, A.; Guan, L.; Khwaja, A.S. Deep learning for object detection and scene perception in self-driving cars: Survey, challenges, and open issues. Array 2021, 10, 100057.
Sharma, T.; Debaque, B.; Duclos, N.; Chehri, A.; Kinder, B.; Fortier, P. Deep Learning-Based Object Detection and Scene Perception under Bad Weather Conditions. Electronics 2022, 11, 563.
Abu Al-Haija, Q.; Krichen, M.; Abu Elhaija, W. Machine-Learning-Based Darknet Traffic Detection System for IoT Applications. Electronics 2022, 11, 556.
Garg, M.; Ubhi, J.S.; Aggarwal, A.K. Deep Learning for Obstacle Avoidance in Autonomous Driving. In Autonomous Driving and Advanced Driver-Assistance Systems (ADAS); CRC Press: Boca Raton, FL, USA, 2021; pp. 233–246.
Abu Al-Haija, Q.; Al-Dala’ien, M. ELBA-IoT: An Ensemble Learning Model for Botnet Attack Detection in IoT Networks. J. Sens. Actuator Netw. 2022, 11, 18.
Elhoseiny, M.; Huang, S.; Elgammal, A. Weather classification with deep convolutional neural networks. In Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada, 27–30 September 2015; pp. 3349–3353.
Chu, W.-T.; Zheng, X.-Y.; Ding, D.-S. Camera as weather sensor: Estimating weather information from single images. J. Vis. Commun. Image Represent. 2017, 46, 233–249.
Xia, J.; Xuan, D.; Tan, L.; Xing, L. ResNet15: Weather Recognition on Traffic Road with Deep Convolutional Neural Network. Adv. Meteorol. 2020, 2020, 1–11.
Ibrahim, M.R.; Haworth, J.; Cheng, T. WeatherNet: Recognising Weather and Visual Conditions from Street-Level Images Using Deep Residual Learning. ISPRS Int. J. Geo-Inform. 2019, 8, 549.
Xiao, H.; Zhang, F.; Shen, Z.; Wu, K.; Zhang, J. Classification of Weather Phenomenon from Images by Using Deep Convolutional Neural Network. Earth Space Sci. 2021, 8, e2020EA001604.
Roser, M.; Moosmann, F. Classification of weather situations on single color images. In Proceedings of the IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands, 4–6 June 2008; pp. 798–803.
Kang, L.-W.; Chou, K.-L.; Fu, R.-H. Deep Learning-Based Weather Image Recognition. In Proceedings of the 2018 International Symposium on Computer, Consumer and Control (IS3C), Taichung, Taiwan, 6–8 December 2018; pp. 384–387.
Guerra, J.C.V.; Khanam, Z.; Ehsan, S.; Stolkin, R.; McDonald-Maier, K. Weather Classification: A new multi-class dataset, data augmentation approach and comprehensive evaluations of Convolutional Neural Networks. In Proceedings of the NASA/ESA Conference on Adaptive Hardware and Systems (AHS), Edinburgh, UK, 6–9 August 2018; pp. 305–310.
Gbeminiyi, A. MCWCD: Multi-Class Weather Conditions Dataset for Image Classification. Mendeley Data. 2018. Available online: https://data.mendeley.com/datasets/4drtyfjtfy/1 (accessed on 17 January 2022).
Kenk, M. DAWN: Detection in Adverse Weather Nature. Mendeley Data. 2020. Available online: https://data.mendeley.com/datasets/766ygrbt8y/3 (accessed on 17 January 2022).
Takimoglu, A. What is Data Augmentation? Techniques & Examples in 2022, AI Multiple: Data-driven, Transparent, Practical New Tech Industry Analysis. 2022. Available online: https://research.aimultiple.com/data-augmentation/ (accessed on 17 January 2022).
Abu Al-Haija, Q.; Smadi, A.A.; Allehyani, M.F. Meticulously Intelligent Identification System for Smart Grid Network Stability to Optimize Risk Management. Energies 2021, 14, 6935.
Al-Haija, Q.A.; Smadi, M.; Al-Bataineh, O.M. Identifying Phasic dopamine releases using DarkNet-19 Convolutional Neural Network. In Proceedings of the 2021 IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS), Toronto, ON, Canada, 21–24 April 2021; pp. 1–5.
Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K.; Fei-Fei, L. ImageNet: A large-scale hierarchical image database. In Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA, 20–25 June 2009; pp. 248–255.
Iandola, N.F.; Han, S.; Moskewicz, M.W.; Ashraf, K.; Dally, W.J.; Keutzer, K. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv 2016, arXiv:1602.07360.
He, K.; Zhang, X.; Ren, S.; Sun, J. Deep residual learning for image recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; pp. 770–778.
Tan, M.; Quoc, L. Efficientnet: Rethinking model scaling for convolutional neural networks. In Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA, 9–15 June 2019; pp. 6105–6114.
Abu Al-Haija, Q.; Adebanjo, A. Breast Cancer Diagnosis in Histopathological Images Using ResNet-50 Convolutional Neural Network. In Proceedings of the IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS), Vancouver, BC, Canada, 9–12 September 2020; pp. 1–7.
Zheng, C.; Zhang, F.; Hou, H.; Bi, C.; Zhang, M.; Zhang, B. Active Discriminative Dictionary Learning for Weather Recognition. Math. Probl. Eng. 2016, 2016, 1–12.
Zhu, Z.; Li, J.; Zhuo, L.; Zhang, J. Extreme Weather Recognition Using a Novel Fine-Tuning Strategy and Optimized GoogLeNet. In Proceedings of the 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA), Sydney, NSW, Australia, 29 November–1 December 2017; pp. 1–7.
Shi, Y.; Li, Y.; Liu, J.; Liu, X.; Murphey, Y.L. Weather Recognition Based on Edge Deterioration and Convolutional Neural Networks. In Proceedings of the 24th International Conference on Pattern Recognition (ICPR), Beijing, China, 20–24 August 2018; pp. 2438–2443.
Oluwafemi, A.G.; Zenghui, W. Multi-Class Weather Classification from Still Image Using Said Ensemble Method. In Proceedings of the Southern African Universities Power Engineering Conference/Robotics and Mechatronics/Pattern Recognition Association of South Africa (SAUPEC/RobMech/PRASA), Bloemfontein, South Africa, 28–30 January 2019; pp. 135–140.
Wang, Y.; Li, Y. Research on Multi-class Weather Classification Algorithm Based on Multi-model Fusion. In Proceedings of the IEEE 4th Information Technology Networking Electronic and Automation Control Conference (ITNEC), Chongqing, China, 12–14 June 2020; pp. 2251–2255.
Abu Al-Haija, Q.; Smadi, M.A.; Zein-Sabatto, S. Multi-Class Weather Classification Using ResNet-18 CNN for Autonomous IoT and CPS Applications. In Proceedings of the International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA, 16–18 December 2020; pp. 1586–1591.