Question Classification for Efficient QA System

Abstract

Natural Language Processing (NLP), a subfield of Artificial Intelligence (AI), supports the machine to understand and manipulate the human languages in different sectors.  Subsequently, the Question and answering scheme using Machine learning is a challengeable task. For an efficient QA system, understanding the category of a question plays a pivot role in extracting suitable answer. Computers can answer questions requiring single, verifiable answers but fail to answer subjective question demanding deeper understanding of question. Subjective questions can take different forms entailing deeper, multidimensional understanding of context. Identifying the intent of the question helps to extract expected answer from a given passage. Pretrained language models (LMs) have demonstrated excellent results on many language tasks. The paper proposes model of deep learning architecture in hierarchical pattern to learn the semantic of question and extracting appropriate answer. The proposed method converts the given context to fine grained embedding to capture semantic and positional representation, identifies user intent and employs a encoder model to concentrate on answer span. The proposed methods show a remarkable improvement over existing system