Repository files navigation

This repository contains the original implementation of "MultiResUNet : Rethinking the U-Net architecture for multimodal biomedical image segmentation" in Keras (Tensorflow as backend).

MultiResUNet has been published in Neural Networks

Ibtehaz, Nabil, and M. Sohel Rahman. "MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation." Neural Networks 121 (2020): 74-87.

• Read the Paper
• View the Preprint

In this project we take motivations from the phenomenal U-Net architecture for biomedical image segmentation and take an attempt to improve the already outstanding network.

In order to incorporate multiresolution analysis, taking inspiration from Inception family networks, we propose the followingMultiRes block, and replace the pair of convolutional layer pairs in the original U-Net with it. This configuration basically is derived from factorizing 5x5 and 7x7 convolution operations to 3x3 ones, and reusing them to obtain results from 3x3, 5x5 and 7x7 convolution operations simultaneously. Moreover, a residual path is also added.

Consequnetly, to elleviate the likely semantic distance between Encoder and Decoder networks, we introduceRes Paths. We include additional convolutions along the shortcut path, in proportionate to the expected gap between the two corresponding layers.

Therefore, with the fusion ofMultiRes blocks andRes paths, we obtain the proposed architectureMultiResUNet.

The model architecture codes can be found in

• 2D Model

• 3D Model

• 2D Model

• 3D Model

A demo can be found inhere (tensorflow)

MIT license

If you useMultiResUNet in your project, please cite the following paper

@article{ibtehaz2020multiresunet,  title={MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation},  author={Ibtehaz, Nabil and Rahman, M Sohel},  journal={Neural Networks},  volume={121},  pages={74--87},  year={2020},  publisher={Elsevier}}