- Zeineb Daoud ORCID:orcid.org/0000-0001-8189-30981,
- Amal Ben Hamida ORCID:orcid.org/0000-0002-3164-54561,
- Chokri Ben Amar ORCID:orcid.org/0000-0002-0129-75772 &
- …
- Serge Miguet ORCID:orcid.org/0000-0001-7722-98993
245Accesses
1Citation
Abstract
Fires are among the most frequent disasters, causing serious injuries and extensive property destruction. In order to prevent the uncontrolled spread of fires, recognizing fires accurately and at an early stage is crucial, especially in video surveillance applications. The majority of the available deep fire detection models currently operate on single images, limiting their analysis to spatial features only. The temporal context and motion information, present in consecutive frames of a scene, are not involved leading to incorrect predictions throughout the video. To address this shortcoming, it is proposed in this work to explore the temporal information using deep learning networks to directly recognize fire. Indeed, a novel three-dimensional convolutional neural network, named 3D Fire Classification Network, is introduced. This approach exploits spatio-temporal features to analyze and recognize a video sequence as either fire or non-fire. Initially, the input data is processed to enlarge and diversify the constructed dataset. Then, it is passed through the designed network for training. The derived model comprises a relatively smaller number of layers, with a reduced number of parameters. The conducted experiments demonstrate the efficiency of the resulting model on the created dataset, achieving an improved accuracy of 99.23%. Furthermore, the findings show that the developed model consistently outperforms the related methods in recognizing fire videos.
This is a preview of subscription content,log in via an institution to check access.
Access this article
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
Price includes VAT (Japan)
Instant access to the full article PDF.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The codes and data generated and analyzed during the current study are available from the corresponding author on reasonable request.
References
Abhilash S (2023) Real time fire detection using deep convolutional neural networks and long-short term memory in video surveillance. Int J Res Appl Sci Eng Technol 11:1685–1693.https://doi.org/10.22214/ijraset.2023.53888
Agirman AK, Tasdemir K (2022) BLSTM based night-time wildfire detection from video. PLoS ONE 17(6):0269161
Avazov K, Mukhiddinov M, Makhmudov F, Cho YI (2022) Fire detection method in smart city environments using a deep-learning-based approach. Electronics.https://doi.org/10.3390/electronics11010073
Barmpoutis P, Dimitropoulos K, Grammalidis N (2013) Real time video fire detection using spatio-temporal consistency energy. In: 2013 10th IEEE international conference on advanced video and signal based surveillance, pp 365–370.https://doi.org/10.1109/AVSS.2013.6636667
Bhat O, Khan DA (2022) Evaluation of deep learning model for human activity recognition. Evol Syst 13(1):159–168
Cazzolato MT, Avalhais L, Chino D, Ramos JS, Souza JA, Rodrigues JF Jr, Traina A (2017) Fismo: a compilation of datasets from emergency situations for fire and smoke analysis. In: Brazilian symposium on databases-SBBD, pp 213–223. Available athttp://sbbd.org.br/2017/wp-content/uploads/sites/3/2017/10/proceedings-satellite-events-sbbd-2017.pdf
Celik T (2010) Fast and efficient method for fire detection using image processing. ETRI J 32(6):881–890.https://doi.org/10.4218/etrij.10.0109.0695
Center Philanthropy (2022) International wildfires. Available athttps://disasterphilanthropy.org/disasters/2022-international-wildfires/
Cetin E (2007) Computer vision based fire detection software. Available athttp://signal.ee.bilkent.edu.tr/VisiFire/
Çetin AE, Dimitropoulos K, Gouverneur B, Grammalidis N, Günay O, Habiboǧlu YH, Töreyin BU, Verstockt S (2013) Video fire detection-review. Digit Signal Process 23(6):1827–1843.https://doi.org/10.1016/j.dsp.2013.07.003
Chandra P, Das R (2023a) A hybrid RSA-IPA optimizer for designing an artificial neural network to study the Jeffery–Hamel blood flow with copper nanoparticles: application to stenotic tapering artery. Results Eng 20:101542
Chandra P, Das R (2023b) Finite-element-based machine-learning algorithm for studying gyrotactic-nanofluid flow via stretching surface. Int J Numer Methods Fluids 95(12):1888–1912
Chandra P, Das R (2024) A hybrid machine learning algorithm for studying magnetized nanofluid flow containing gyrotactic microorganisms via a vertically inclined stretching surface. Int J Numer Methods Biomed Eng 40(1):3780
Chen T-H, Wu P-H, Chiou Y-C (2004) An early fire-detection method based on image processing. In: 2004 international conference on image processing, 2004. ICIP’04, vol 3. IEEE, pp 1707–1710.https://doi.org/10.1109/ICIP.2004.1421401
Daoud Z, Ben Hamida A, Ben Amar C (2023) FireClassNet: a deep convolutional neural network approach for PJF fire images classification. Neural Comput Appl.https://doi.org/10.1007/s00521-023-08750-3
Dimitropoulos K, Tsalakanidou F, Grammalidis N (2012) Flame detection for video-based early fire warning systems and 3D visualization of fire propagation. In: 13th IASTED international conference on computer graphics and imaging (CGIM 2012), Crete, Greece
Dimitropoulos K, Barmpoutis P, Grammalidis N (2015) Spatio-temporal flame modeling and dynamic texture analysis for automatic video-based fire detection. IEEE Trans Circ Syst Video Technol 25(2):339–351.https://doi.org/10.1109/TCSVT.2014.2339592
Eberle C, Higuera Roa O (2022) Technical report: Mediterranean wildfires
Foggia P, Saggese A, Vento M (2015) Real-time fire detection for video-surveillance applications using a combination of experts based on color, shape, and motion. IEEE Trans Circ Syst Video Technol 25(9):1545–1556.https://doi.org/10.1109/TCSVT.2015.2392531
Gayathiri B, Brindha P, Karthika I, Saranya E, Rajeshkumar G, Rajesh Kanna P (2023) Machine learning based crop suitability prediction and fertiliser recommendation system. In: 2023 4th international conference on electronics and sustainable communication systems (ICESC), pp 1023–1028.https://doi.org/10.1109/ICESC57686.2023.10193542
Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the thirteenth international conference on artificial intelligence and statistics. JMLR workshop and conference proceedings, pp 249–256
Grammalidis N, Dimitropoulos K, Cetin E (2017) FIRESENSE database of videos for flame and smoke detection. Zenodo. Available athttps://zenodo.org/record/836749/files/fire_videos.1406.zip?download.https://doi.org/10.5281/zenodo.836749
Harsha R, Karthika S, Mohana PD, Rajesh KP, Rajeshkumar G, Mythili E (2023) Folla disease detection using in-depth learning. In: 2023 2nd international conference on applied artificial intelligence and computing (ICAAIC). IEEE, pp 547–552
He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: Proceedings of the IEEE international conference on computer vision, pp 1026–1034
He Z, Fan G, Li Z, Li S, Gao L, Li X, Zeng Z-C (2024) Deep learning modeling of human activity affected wildfire risk by incorporating structural features: a case study in eastern China. Ecol Indic 160:111946.https://doi.org/10.1016/j.ecolind.2024.111946
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780.https://doi.org/10.1162/neco.1997.9.8.1735
Kanna PR, Santhi P (2021) Unified deep learning approach for efficient intrusion detection system using integrated spatial–temporal features. Knowl Based Syst 226:107132
Kanna PR, Santhi P (2022) Hybrid intrusion detection using MapReduce based black widow optimized convolutional long short-term memory neural networks. Expert Syst Appl 194:116545
Karthika S, Priyanka T, Indirapriyadharshini J, Sadesh S et al (2023) Prediction of weather forecasting with long short-term memory using deep learning. In: 2023 4th international conference on smart electronics and communication (ICOSEC), pp 1161–1168.https://doi.org/10.1109/ICOSEC58147.2023.10276273
Khalil A, Rahman SU, Alam F, Ahmad I, Khalil I (2021) Fire detection using multi color space and background modeling. Fire Technol 57:1221–1239.https://doi.org/10.1007/s10694-020-01030-9
Kim B, Lee J (2019) A video-based fire detection using deep learning models. Appl Sci 9:2862
Lakshmi M, Das R, Manohar B (2024) A new Covid-19 classification approach based on Bayesian optimization SVM kernel using chest X-ray datasets. Evol Syst.https://doi.org/10.1007/s12530-024-09575-8
Manohar B, Das R (2022a) Artificial neural networks for the prediction of monkeypox outbreak. Trop Med Infect Dis 7(12):424.https://doi.org/10.3390/tropicalmed7120424
Manohar B, Das R (2023b) Artificial neural networks for prediction of Covid-19 in India by using backpropagation. Expert Syst 40(5):13105.https://doi.org/10.1111/exsy.13105
Manohar B, Das R (2023) Comparison of hybrid artificial neural networks with GA, PSO, and RSA in predicting Covid-19 cases: a case study of India. In: Multi-disciplinary applications of fog computing: responsiveness in real-time. IGI Global, New York, pp 207–244.https://doi.org/10.4018/978-1-6684-4466-5.ch011
Masrur A, Yu M, Yu M (2024). Deciphering wildfire spread dynamics: attention-based spatiotemporal models using CONV-LSTM networks.https://doi.org/10.2139/ssrn.4695951
Mehta R, Singh KK (2023) An efficient ear recognition technique based on deep ensemble learning approach. Evol Syst 2023:1–17
Muhammad K, Khan S, Elhoseny M, Hassan Ahmed S, Wook Baik S (2019) Efficient fire detection for uncertain surveillance environment. IEEE Trans Ind Inform 15(5):3113–3122.https://doi.org/10.1109/TII.2019.2897594
Nguyen MD, Vu HN, Pham DC, Choi B, Ro S (2021) Multistage real-time fire detection using convolutional neural networks and long short-term memory networks. IEEE Access 9:146667–146679.https://doi.org/10.1109/ACCESS.2021.3122346
Nithya T, Dhivya P, Sangeethaa S, Kanna PR (2024) TB-MFCC multifuse feature for emergency vehicle sound classification using multistacked CNN-attention BILSTM. Biomed Signal Process Control 88:105688
Phillips Iii W, Shah M, Vitoria Lobo N (2002) Flame recognition in video. Pattern Recogn Lett 23(1–3):319–327.https://doi.org/10.1016/S0167-8655(01)00135-0. Available athttps://www.crcv.ucf.edu/data/fire.php
Rasool Abdali AM, Ghani RF (2019) Robust real-time fire detector using CNN and LSTM. In: 2019 IEEE student conference on research and development (SCOReD), pp 204–207.https://doi.org/10.1109/SCORED.2019.8896246
Shi X, Chen Z, Wang H, Yeung D-Y, Wong W-K, Woo W-C (2015) Convolutional LSTM network: a machine learning approach for precipitation nowcasting. Adv Neural Inform Process Syst 28:1
Shin J, Park H, Paik J (2018) Fire recognition using spatio-temporal two-stream convolutional neural network with fully connected layer-fusion. In: 2018 IEEE 8th international conference on consumer electronics-Berlin (ICCE-Berlin), pp 1–3.https://doi.org/10.1109/ICCE-Berlin.2018.8576218
Simonyan K, Zisserman A (2014) Two-stream convolutional networks for action recognition in videos. Adv Neural Inform Process Syst 27:1
Statista (2022) Area burned by wildfires in Tunisia from 2009 to 2022. Available athttps://www.statista.com/statistics/1322257/area-burned-by-wildfire-in-tunisia/#statisticContainer
Steffens CR, Rodrigues RN, Costa Botelho S (2015) An unconstrained dataset for non-stationary video based fire detection. In: 2015 12th Latin American robotics symposium and 2015 3rd Brazilian symposium on robotics (LARS-SBR), pp 25–30.https://doi.org/10.1109/LARS-SBR.2015.10. Available athttps://github.com/steffensbola/furg-fire-dataset
Torabian M, Pourghassem H, Mahdavi-Nasab H (2021) Fire detection based on fractal analysis and spatio-temporal features. Fire Technol 57(5):2583–2614
Tran D, Bourdev L, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3D convolutional networks. In: Proceedings of the IEEE international conference on computer vision, pp 4489–4497
Verlekar TT, Bernardino A (2020) Video based fire detection using Xception and CONV-LSTM. In: Advances in visual computing: 15th international symposium, ISVC 2020, San Diego, CA, USA, October 5–7, 2020, proceedings, part II, vol 15. Springer, London, pp 277–285.https://doi.org/10.1007/978-3-030-64559-5_21
Vrskova R, Hudec R, Kamencay P, Sykora P (2022) A new approach for abnormal human activities recognition based on CONV-LSTM architecture. Sensors 22(8):2946.https://doi.org/10.3390/s22082946
Vu HN, Tran AD, Nguyen MD, Choi B, Ro S (2021) Investigation of deep learning method for fire detection from videos. In: 2021 international conference on information and communication technology convergence (ICTC), pp 593–595.https://doi.org/10.1109/ICTC52510.2021.9621042
Wahyono Harjoko A, Dharmawan A, Adhinata FD, Kosala G, Jo K-H (2022) Real-time forest fire detection framework based on artificial intelligence using color probability model and motion feature analysis. Fire 5(1):23.https://doi.org/10.3390/fire5010023
Yang Z, Bu L, Wang T, Yuan P, Jineng O (2020) Indoor video flame detection based on lightweight convolutional neural network. Pattern Recogn Image Anal 30:551–564.https://doi.org/10.1134/S1054661820030293
Acknowledgements
The authors would like to acknowledge Deanship of Graduate Studies and Scientific Research, Taif University for funding this work.
Author information
Authors and Affiliations
REGIM-Lab.: REsearch Groups in Intelligent Machines, University of Sfax, National Engineering School of Sfax (ENIS), BP 1173, 3038, Sfax, Tunisia
Zeineb Daoud & Amal Ben Hamida
Department of Computer Engineering, College of Computers and Information Technology, Taif University, P.O. Box 11099, 21944, Taif, Saudi Arabia
Chokri Ben Amar
Univ Lyon, Univ Lyon 2, CNRS, INSA Lyon, UCBL, Centrale Lyon, LIRIS, UMR5205, 69676, Bron, France
Serge Miguet
- Zeineb Daoud
You can also search for this author inPubMed Google Scholar
- Amal Ben Hamida
You can also search for this author inPubMed Google Scholar
- Chokri Ben Amar
You can also search for this author inPubMed Google Scholar
- Serge Miguet
You can also search for this author inPubMed Google Scholar
Contributions
We confirm that the manuscript has been read and approved by all named authors and that there are no other persons who satisfied the criteria for authorship. All authors contributed equally to this work.
Corresponding author
Correspondence toZeineb Daoud.
Ethics declarations
Conflict of interest
All authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Daoud, Z., Ben Hamida, A., Ben Amar, C.et al. A one stream three-dimensional convolutional neural network for fire recognition based on spatio-temporal fire analysis.Evolving Systems15, 2355–2381 (2024). https://doi.org/10.1007/s12530-024-09623-3
Received:
Accepted:
Published:
Issue Date:
Share this article
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative