Study of computer multi-instrumented reflexive conversation activity in preliminary architectural design

The establishment of BIM raises issues at the transition between sketches, still mostly used in ideation, and project digital models. With the latest AI evolution, one way of supporting this transition is to provide sketch interpretation software generating digital representations. However, the question arises as to whether these two modes of representation can co-exist, and whether digital representations can provide a resource for designers in the preliminary phase. In this paper, we investigate the impact of auto-generated representations on the preliminary design activity of architects. We implement a Wizard of Oz protocol with nine participants sketching their design and being provided with CAD plans, 3D models and inspirational images. We study reflexive conversations by analyzing and categorizing behavior patterns preceding and following the reception of self-generated representations. We identify 23 patterns, and show the flexible role of the digital representations, having a strong impact on the process.