Aspect category and sentiment polarity detection using a permutation language-based transformer model

Aspect-based sentiment analysis (ABSA) performs fine-grained analysis on text to determine a specific aspect category and a sentiment polarity. Recently, machine learning models have played a key role in ABSA tasks. In particular, transformer-based pre-trained models have achieved promising results in natural language processing tasks. Therefore, we propose a permutation based XLNet fine-tuning model for aspect category detection and sentiment polarity detection. Our model learns bidirectional contexts via positional encoding and factorization order. We evaluate the proposed permutation language model on three ABSA datasets, namely, SentiHood, SemEval 2015, and SemEval 2016. Specifically, we studied the ABSA tasks in a constrained system with a multi-class environment. Our result indicates that the proposed permutation language model achieves a better result.