DialogNTM: Context Reconstruction in Multi-Turn Dialogue Generation using Neural Turing Machines

In actual conversational scenarios, we can often determine which parts of the previous dialogue are more critical based on the current inquiry. However, the existing contextual modeling methods often encode the query sentence and the dialogue history in a unified manner, which fails to effectively highlight the inference effect of the query sentence. Moreover, these methods typically process the dialogue history only at the information extraction level, neglecting the treatment of the context itself. In this paper, we propose a novel conversational context modeling technique called DialogNTM. Based on the guidance of the query sentence, the technology can effectively eliminate redundant information by reconstructing the representation of the context. Specifically, we have tweaked the memory and input flow of the Neural Turing Machine (NTM) to encode contextual information in memory and guide the read, write, and erase operations of memory through query sentence. This design simulates the human brain's dynamic retrieval and renewal mechanism of previous memories when dealing with current problems. We have conducted extensive experiments on three publicly available datasets to verify the effectiveness of the DialogNTM model. Compared to the benchmark model, DialogNTM showed significant performance improvements ranging from 11% to 73% across multiple automated evaluation metrics (3.52% to 8.68% in absolute terms).