DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación
Artículo científico (JournalArticle)
Evaluating Indoor Positioning Systems in a Shopping Mall: The Lessons Learned From the IPIN 2018 Competition
The Indoor Positioning and Indoor Navigation (IPIN) conference holds an annual competition in which indoor localization systems from different research groups worldwide are evaluated empirically. The objective of this competition is to establish a systematic evaluation methodology with rigorous metrics both for real-time (on-site) and post-processing (off-site) situations, in a realistic environment unfamiliar to the prototype developers. For the IPIN 2018 conference, this competition was held on September 22nd, 2018, in Atlantis, a large shopping mall in Nantes (France). Four competition tracks (two on-site and two off-site) were designed. They consisted of several 1 km routes traversing several floors of the mall. Along these paths, 180 points were topographically surveyed with a 10 cm accuracy, to serve as ground truth landmarks, combining theodolite measurements, differential global navigation satellite system (GNSS) and 3D scanner systems. 34 teams effectively competed. The accuracy score corresponds to the third quartile (75 th percentile) of an error metric that combines the horizontal positioning error and the floor detection. The best results for the on-site tracks showed an accuracy score of 11.70 m (Track 1) and 5.50 m (Track 2), while the best results for the off-site tracks showed an accuracy score of 0.90 m (Track 3) and 1.30 m (Track 4). These results showed that it is possible to obtain high accuracy indoor positioning solutions in large, realistic environments using wearable light-weight sensors without deploying any beacon. This paper describes the organization work of the tracks, analyzes the methodology used to quantify the results, reviews the lessons learned from the competition and discusses its future., This work was supported in part by the French Pays de la Loire Regional Council through Etoiles Montantes under the organization of IPIN2018 international competition under Grant 2017-10671, in part by the Atlantis Shopping Mall, in part by the Project REPNIN Plus under Grant TEC2017-
90808-REDT, in part by the ICT Research and Development Program of MSIT/IITP, South Korea, (Development of Precise Positioning Technology
for the Enhancement of Pedestrian Position, Spatial Cognition and Sports Competition Analysis), through the ETRI Team under Grant 2017-0-00543,
in part by the JSPS KAKENHI through the Kyushu Team under Grant JP18H04125, in part by the Slovak Grant Agency, Ministry of Education and
Academy of Science, Slovak, through UPJS Team, under Grant 1/0056/18, in part by the Slovak Research and Development Agency through UPJS
Team under Contract APVV-15-0091, in part by the German federal Ministry of Education and Research Programme ‘‘FH-Impuls 2016’’through
HFTS Team under Contract 13FH9I01IA, in part by the Ministry of Science and Technology (MOST), Taiwan, through the YAI Team under Grant
MOST 108-2634-F-155-001, and in part by the Strategic Priority Research Program of the Chinese Academy Sciences under Grant XDA17040202., Peer reviewed