In this paper, we investigate the literature around deep learning to identify its usefulness in different application domains. Our paper identifies that the effectiveness of deep learning is highly visible in the medical imaging area. Other application domains are yet to make any significant progress using deep learning. Therefore, we conclude that deep learning is a good solution for medical imaging analysis. However, its benefits are yet to be realized in other domains and researchers are pursuing to explore its effectiveness to solve problems in these domains. Our initial critical evaluation suggests that deep learning may be a hype in most domains. In order to probe this further, we call for a deeper engagement with prior literature in different application domains of deep learning.