Multimodal deep learning for image inputs

I need a multimodel deep learning algorithm in Pytorch for binary image classification. I have two kinds of Image inputs which need to be passed on to the multimodal algorithm for training. While testing, we have to use any one of the two image inputs. The labels 0 and 1 are already given to all images.