Symmetrical choices and biased confidence during uncertain personality trait judgments

While great methodological strides have been made in the area of decision making research, decisions that rely on subjective stimuli, such as personality traits, still pose a challenge for researchers, partly because it is difficult to define a standard of accuracy for such choices-they lack a "ground truth". In studies on value-based decisions, this same problem has been circumvented by comparing uncertain subjective decisions against a separately assessed judgment of value-a "standard". Here we apply this method in a task of verbal personality trait judgment, and show how a separately assessed standard judgment can be used to precisely control stimulus presentation and analyze subjective personality choices via the method of reverse correlation. Per trial, a series of quasi-randomly sampled adjectives was shown, which participants categorized as more descriptive of either themselves of another person well known to them. Participants also indicated their confidence in the response. Each trial's difficulty was controlled based on the previously assessed standard judgment. Analysis of the behavioral data shows several decision-general properties during these personality judgments, such as symmetrical choices, steeper choice functions for confident trials, and a positive evidence bias during confidence judgment. We discuss how these findings can shed light on the cognitive processes involved in personality perception. The task and results together may help bridge the gap between research on complex, social forms of judgment and findings on more basic decision processes.