StepLogger and EvaalScore: The software suite of the IPIN onsite indoor localization competition

This paper illustrates the software suite developed for Track 1 of the IPIN competition, which evaluates smartphone apps for indoor localization. Competitors have one day before the trial day to survey the competition area. On the trial day, an independent “actor” carries the competing system on smartphone and walks a predefined path. Competing systems provide continuous location estimates, which are later compared to a ground truth. We describe the software suite used to gather and present the results: the StepLogger Android application for real-time logging of position estimates and the EvaalScore tool for performance evaluation. StepLogger collects location estimating data from competitors with a timestamp, while EvaalScore calculates the accuracy of the competing systems. The competition ranking is based on the third quartile of point localization error. The presented software suite ensures a standardized and fair assessment of competing systems, thus promoting reproducibility and transparency in indoor localization research.