Document Type : Reseach Article

10.57647/j.mjee.2025.1901.20

Abstract

In diagnostic imaging, image fusion remains a significant difficulty, particularly in medical applications like guided image operations and radiation therapy. By maintaining the pertinent details and characteristics of the original images, medical image fusion aims to increase the precision of disease diagnosis. This study suggests a novel methodology for MRI and CT image fusion that uses the proposed tri-scale decomposition with Gaussian and guided filters to decompose the source images into base and detail layers. Each source image is guided through guided filtering using Gaussian curvature as guidance. While the detail layers are fused based on maximum energy assessed using the Krisch compass operator, the base layers are fused based on the whale optimization method, for which the objective function is maximization of entropy, edge strength and pixel intensity. Thirty different kinds of slices of five medical datasets from diverse sources were used to assess the effectiveness of the proposed algorithm both visually and statistically compared to existing approaches. Based on both objective evaluation and qualitative image analysis, the experimental results demonstrated that the suggested strategy performed better than other widely used techniques. In comparison to the existing methods
under consideration, the quantitative results show that the proposed algorithm improves the standard deviation by 16%, mutual information by 41%, spatial frequency by 12%, image entropy by 6.5%, edge strength of the fused image by 37%, and structural similarity index by 31%.

Keywords

  1. Liu, W. Mei, H. Du, Multi-modality medical image fusion based on image decomposition framework and nonsubsampled shearlet transform, Biomed. Signal Process. Control 40 (2018) 343–350, https://doi.org/10.1016/j.bspc.2017.10.001.
  2. Ding, D. Zhou, R. Nie, R. Hou, Y. Liu, Brain medical image fusion based on dual branch CNNs in NSST domain, BioMed Res. Int. 2020 (2020) 1–15, https://doi. org/10.1155/2020/6265708.
  3. Zhu, M. Zheng, G. Qi, D. Wang, Y. Xiang, A phase congruency and local Laplacian energy based multi-modality medical image fusion method in NSCT domain, IEEE Access 7 (2019) 20811–20824, https://doi.org/10.1109/access.2019.2898111.
  4. Wang, Y. Shen, Multi-modal image fusion based on saliency guided in NSCT domain, IET Image Process. (2020), https://doi.org/10.1049/iet-ipr.2019.1319.
  5. Yang, A novel DWT based multi-focus image fusion method, Proc. Eng. 24 (2011) 177–181, https://doi.org/10.1016/j.proeng.2011.11.2622.
  6. Yu, B. Jia, L. Ding, Z. Cai, Q. Wu, R. Law, J. Huang, L. Song, S. Fu, Hybrid dual tree complex wavelet transform and support vector machine for digital multi-focus image fusion, Neurocomputing 182 (2016) 1–9, https://doi.org/10.1016/j. neucom.2015.10.084.
  7. Du, W. Li, B. Xiao, Q. Nawaz, Union Laplacian pyramid with multiple features for medical image fusion, Neurocomputing 194 (2016) 326–339, https://doi.org/ 10.1016/j.neucom.2016.02.047.
  8. Fu, W. Li, J. Du, B. Xiao, Multimodal medical image fusion via Laplacian pyramid and convolutional neural network reconstruction with local gradient energy strategy, Comput. Biol. Med. 126 (2020) 104048, https://doi.org/ 10.1016/j.compbiomed.2020.104048.
  9. Liu, X. Chen, R.K. Ward, Z.J. Wang, Image fusion with convolutional sparse representation, IEEE Signal Process. Lett. 23 (12) (2016) 1882–1886, https://doi. org/10.1109/lsp.2016.2618776.
  10. Li, X. Kang and J. Hu, "Image Fusion With Guided Filtering," IEEE Transactions on Image Processing, vol. 22, no. 7, pp. 2864-2875, July 2013, doi: 10.1109/TIP.2013.2244222.
  11. Zhang, Q., Shen, X., Xu, L., Jia, J. (2014), Rolling Guidance Filter, In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8691. Springer, Cham. https://doi.org/10.1007/978-3-319-10578-9_53
  12. Tan, J. Zhang, P. Xiang, H. Zhou, W. Thitøn, Infrared and visible image fusion via NSST and PCNN in multiscale morphological gradient domain, Optics, Photonics and Digital Technologies for Imaging Applications VI, SPIE, 2020, https://doi.org/10.1117/12.2551830.
  13. Yin, X. Liu, Y. Liu and X. Chen, "Medical Image Fusion With Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain," IEEE Transactions on Instrumentation and Measurement, vol. 68, no. 1, pp. 49-64, Jan. 2019, doi: 10.1109/TIM.2018.2838778. 
  14. Xinzheng Xu, Dong Shan, Guanying Wang, Xiangying Jiang, Multimodal medical image fusion using PCNN optimized by the QPSO algorithm, Applied Soft Computing, Volume 46, 2016, Pages 588-595, ISSN 1568-4946, https://doi.org/10.1016/j.asoc.2016.03.028.
  15. Heba M. El-Hoseny, Wael Abd El-Rahman, El-Sayed M. El-Rabaie, Fathi E Abd El-Samie, Osama S. Faragallah,An efficient DT-CWT medical image fusion system based on modified central force optimization and histogram matching, Infrared Physics & Technology, Volume 94,2018,Pages 223-231,ISSN 1350-4495,https://doi.org/10.1016/j.infrared.2018.09.003.
  16. Ebenezer Daniel, J. Anitha, K.K Kamaleshwaran, Indu Rani, Optimum spectrum mask based medical image fusion using Gray Wolf Optimization, Biomedical Signal Processing and Control, Volume 34, 2017, Pages 36-43, ISSN 1746-8094, https://doi.org/10.1016/j.bspc.2017.01.003.
  17. S. Asha, S. Lal, V. P. Gurupur and P. U. P. Saxena, "Multi-Modal Medical Image Fusion With Adaptive Weighted Combination of NSST Bands Using Chaotic Grey Wolf Optimization," IEEE Access, vol. 7, pp. 40782-40796, 2019, doi: 10.1109/ACCESS.2019.2908076.
  18. Daniel, "Optimum Wavelet-Based Homomorphic Medical Image Fusion Using Hybrid Genetic–Grey Wolf Optimization Algorithm," IEEE Sensors Journal, vol. 18, no. 16, pp. 6804-6811, 15 Aug.15, 2018, doi: 10.1109/JSEN.2018.2822712.
  19. Parvathy, V.S., Pothiraj, S. Multi-modality medical image fusion using hybridization of binary crow search optimization, Health Care Manag Sci 23, 661–669 (2020). https://doi.org/10.1007/s10729-019-09492-2
  20. Padmavathi, C.S. Asha, V. Karki Maya, A novel medical image fusion by combining TV-L1 decomposed textures based on adaptive weighting scheme, Engineering Science and Technology, an International Journal, Volume 23, Issue 1,2020,Pages 225-239,ISSN 2215-0986,https://doi.org/10.1016/j.jestch.2019.03.00
  21. Tannaz, A., Mousa, S., Sabalan, D. et al. Fusion of multimodal medical images using nonsubsampled shearlet transform and particle swarm optimization, Multidim Syst Sign Process 31, 269–287 (2020). https://doi.org/10.1007/s11045-019-00662-7
  22. Mirjalili, A. Lewis, The whale optimization algorithm, Adv. Eng. Softw. 95 (2016) 51–67. https://doi.org/10.1016/j.advengsoft.2016.01.008
  23. Zhiqin Zhu, Mengwei Sun, Guanqiu Qi, Yuanyuan Li, Xinbo Gao, Yu Liu, Sparse Dynamic Volume TransUNet with multi-level edge fusion for brain tumor segmentation”, Computers in Biology and Medicine,Volume 172,2024,108284,https://doi.org/10.1016/j.compbiomed.2024.108284.
  24. Zhiqin Zhu, Kun Yu, Guanqiu Qi, Baisen Cong, Yuanyuan Li, Zexin Li, Xinbo Gao, “Lightweight medical image segmentation network with multi-scale feature-guided fusion” ,Computers in Biology and Medicine,Volume 182,2024,109204,https://doi.org/10.1016/j.compbiomed.2024.109204.
  25. Zhiqin Zhu, Ziyu Wang, Guanqiu Qi, Neal Mazur, Pan Yang, Yu Liu, “Brain tumor segmentation in MRI with multi-modality spatial information enhancement and boundary shape correction” ,Pattern Recognition,Volume 153,2024,110553,https://doi.org/10.1016/j.patcog.2024.110553.
  26. Shen, X., Wang, J., Zhao, Y., Zhou, R., Gao, H., Zhang, J., & Shen, H. (2024). MRS‐Net: Brain tumour segmentation network based on feature fusion and attention mechanism, IET Image Processing, 18(14), 4542-4550.https://doi.org/10.1049/ipr2.13266
  27. Zhiqin Zhu, Xianyu He, Guanqiu Qi, Yuanyuan Li, Baisen Cong, Yu Liu, “Brain tumor segmentation based on the fusion of deep semantics and edge information in multimodal MRI”, Information Fusion, Volume 91,2023,Pages 376-387,https://doi.org/10.1016/j.inffus.2022.10.022.
  28. Venkata Srikanth, A.Suneel Kumar, B.Nagasirisha, and T. Lakshmi, “Brain MRI and CT Image Fusion Using Multiscale Local Extrema and Image Statistics”, ECTI-EEC, vol. 22, no. 1, Feb. 2024. https://doi.org/10.37936/ecti-eec.2024221.249146
  29. A. Johnson and J. Alex Becker, The whole brain atlas,” [Online]. Available: https://www.med.harvard.edu/aanlib/.
  30. M.V., S. Kethavath, S. Yerram, S. Kalli, Nagasirisha.B, and J. Brahmaiah Naik, “Brain Tumor Detection through Image Fusion Using Cross Guided Filter and Convolutional Neural Network”, ECTI-CIT Transactions, vol. 18, no. 4, pp. 579–590, Oct. 2024. https://doi.org/10.37936/ecti-cit.2024184.256650
  31. Guo, P., Xie, G., Li, R. et al. Multimodal medical image fusion with convolution sparse representation and mutual information correlation in NSST domain, Complex Intell. Syst. 9, 317–328 (2023). https://doi.org/10.1007/s40747-022-00792-9
  32. Kumar, K. Joshi, P. Kanti, J. S. Reshi, G. Rawat and A. Kumar, "Brain Tumor Diagnosis using Image Fusion and Deep Learning", 2023 International Conference on Sustainable Computing and Data Communication Systems (ICSCDS), Erode, India, 2023, pp. 1658-1662, doi: 10.1109/ICSCDS56580.2023.10104937.