Deep CNN with Residual Connections and Range Normalization for Clinical Text Classification

Abstract

Deep learning has achieved remarkable performance in many classification tasks such as image processing and computer vision. Due to its impressive performance, deep learning techniques have found their way into natural language processing tasks as well. Deep learning methods are based on neural network architectures such as CNN (Convolutional Neural Networks) with many layers. Deep learning methods have shown state of-the-art performance on many classification tasks through several research works. It has shown great promise in many NLP (Natural language processing) tasks such as learning text representations. In this paper, we study the possibility of using deep learning methods and techniques in clinical documents classification. We review various deep learning-based techniques and their applications in classifying clinical documents. Further, we identify research challenges and describe our proposed convolutional neural network with residual connections and range normalization. Our proposed model automatically learns and classifies clinical sentences into multi-faceted clinical classes, which can help physicians to navigate patients' medical histories easily. Our propose technique uses sentence embedding and Convolutional Neural Network with residual connections and range normalization. To the best of our knowledge, this is the first time that sentence embedding and deep convolutional neural networks with residual connections and range normalization have been simultaneously applied to text processing. Lastly, this work follows a generalized conclusion on clinical documents classification and references.