IEEE Access (Jan 2019)
Evaluating Indoor Positioning Systems in a Shopping Mall: The Lessons Learned From the IPIN 2018 Competition
- Valerie Renaudin,
- Miguel Ortiz,
- Johan Perul,
- Joaquin Torres-Sospedra,
- Antonio Ramon Jimenez,
- Antoni Perez-Navarro,
- German Martin Mendoza-Silva,
- Fernando Seco,
- Yael Landau,
- Revital Marbel,
- Boaz Ben-Moshe,
- Xingyu Zheng,
- Feng Ye,
- Jian Kuang,
- Yu Li,
- Xiaoji Niu,
- Vlad Landa,
- Shlomi Hacohen,
- Nir Shvalb,
- Chuanhua Lu,
- Hideaki Uchiyama,
- Diego Thomas,
- Atsushi Shimada,
- Rin-Ichiro Taniguchi,
- Zhenxing Ding,
- Feng Xu,
- Nikolai Kronenwett,
- Blagovest Vladimirov,
- Soyeon Lee,
- Eunyoung Cho,
- Sungwoo Jun,
- Changeun Lee,
- Sangjoon Park,
- Yonghyun Lee,
- Jehyeok Rew,
- Changjun Park,
- Hyeongyo Jeong,
- Jaeseung Han,
- Keumryeol Lee,
- Wenchao Zhang,
- Xianghong Li,
- Dongyan Wei,
- Ying Zhang,
- So Young Park,
- Chan Gook Park,
- Stefan Knauth,
- Georgios Pipelidis,
- Nikolaos Tsiamitros,
- Tomas Lungenstrass,
- Juan Pablo Morales,
- Jens Trogh,
- David Plets,
- Miroslav Opiela,
- Shih-Hau Fang,
- Yu Tsao,
- Ying-Ren Chien,
- Shi-Shen Yang,
- Shih-Jyun Ye,
- Muhammad Usman Ali,
- Soojung Hur,
- Yongwan Park
Affiliations
- Valerie Renaudin
- AME Department, GEOLOC Laboratory, The French Institute of Science and Technology for Transport, Development and Networks, Nantes, France
- Miguel Ortiz
- AME Department, GEOLOC Laboratory, The French Institute of Science and Technology for Transport, Development and Networks, Nantes, France
- Johan Perul
- AME Department, GEOLOC Laboratory, The French Institute of Science and Technology for Transport, Development and Networks, Nantes, France
- Joaquin Torres-Sospedra
- ORCiD
- Institute of New Imaging Technologies, Universitat Jaume I de Castello, Castellón de la Plana, Spain
- Antonio Ramon Jimenez
- Centre for Automation and Robotics (CAR), Consejo Superior de Investigaciones Científicas (CSIC)-Universidad Politécnica de Madrid (UPM), Madrid, Spain
- Antoni Perez-Navarro
- Faculty of Computer Sciences, Multimedia and Telecommunication, Internet Interdisciplinary Institute, Universitat Oberta de Catalunya, Barcelona, Spain
- German Martin Mendoza-Silva
- Institute of New Imaging Technologies, Universitat Jaume I de Castello, Castellón de la Plana, Spain
- Fernando Seco
- Centre for Automation and Robotics (CAR), Consejo Superior de Investigaciones Científicas (CSIC)-Universidad Politécnica de Madrid (UPM), Madrid, Spain
- Yael Landau
- Department of Computer Science, Ariel University, Ariel, Israel
- Revital Marbel
- Department of Computer Science, Ariel University, Ariel, Israel
- Boaz Ben-Moshe
- Department of Computer Science, Ariel University, Ariel, Israel
- Xingyu Zheng
- State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan, China
- Feng Ye
- ORCiD
- State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan University, Wuhan, China
- Jian Kuang
- GNSS Research Center, Wuhan University, Wuhan, China
- Yu Li
- GNSS Research Center, Wuhan University, Wuhan, China
- Xiaoji Niu
- GNSS Research Center, Wuhan University, Wuhan, China
- Vlad Landa
- Department of Computer Science, Ariel University, Ariel, Israel
- Shlomi Hacohen
- Department of Mechanical Engineering, Ariel University, Ariel, Israel
- Nir Shvalb
- ORCiD
- Department of Industrial Engineering and Management, Ariel University, Ariel, Israel
- Chuanhua Lu
- ORCiD
- Graduate School of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan
- Hideaki Uchiyama
- Library Department, Kyushu University, Fukuoka, Japan
- Diego Thomas
- Faculty of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan
- Atsushi Shimada
- Faculty of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan
- Rin-Ichiro Taniguchi
- Faculty of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan
- Zhenxing Ding
- State Information Center, Beijing, China
- Feng Xu
- State Information Center, Beijing, China
- Nikolai Kronenwett
- Institute of Systems Optimization, Karlsruhe Institute of Technology, Karlsruhe, Germany
- Blagovest Vladimirov
- Electronics and Telecommunications Research Institute, Daejeon, South Korea
- Soyeon Lee
- Electronics and Telecommunications Research Institute, Daejeon, South Korea
- Eunyoung Cho
- Electronics and Telecommunications Research Institute, Daejeon, South Korea
- Sungwoo Jun
- Electronics and Telecommunications Research Institute, Daejeon, South Korea
- Changeun Lee
- Electronics and Telecommunications Research Institute, Daejeon, South Korea
- Sangjoon Park
- Electronics and Telecommunications Research Institute, Daejeon, South Korea
- Yonghyun Lee
- HANA MICRON, Asan, South Korea
- Jehyeok Rew
- HANA MICRON, Asan, South Korea
- Changjun Park
- HANA MICRON, Asan, South Korea
- Hyeongyo Jeong
- HANA MICRON, Asan, South Korea
- Jaeseung Han
- HANA MICRON, Asan, South Korea
- Keumryeol Lee
- HANA MICRON, Asan, South Korea
- Wenchao Zhang
- Aerospace Information Research Institute (AIR), Chinese Academy of Sciences (CAS), University of Chinese Academy of Sciences (UCAS), Beijing, China
- Xianghong Li
- Aerospace Information Research Institute (AIR), Chinese Academy of Sciences (CAS), University of Chinese Academy of Sciences (UCAS), Beijing, China
- Dongyan Wei
- Aerospace Information Research Institute (AIR), Chinese Academy of Sciences (CAS), University of Chinese Academy of Sciences (UCAS), Beijing, China
- Ying Zhang
- Google Inc., Mountain View, CA, USA
- So Young Park
- Mechanical and Aerospace Engineering Department, Seoul National University, Seoul, South Korea
- Chan Gook Park
- ORCiD
- Mechanical and Aerospace Engineering Department, Seoul National University, Seoul, South Korea
- Stefan Knauth
- Faculty for Geomatics, Computer Science and Mathematics, Hochschule für Technik Stuttgart, Stuttgart, Germany
- Georgios Pipelidis
- Software and Systems Engineering Research Group, Institut für informatik, Technische Universität München, Munich, Germany
- Nikolaos Tsiamitros
- Software and Systems Engineering Research Group, Institut für informatik, Technische Universität München, Munich, Germany
- Tomas Lungenstrass
- AraraDS, Arara, Santiago, Chile
- Juan Pablo Morales
- AraraDS, Arara, Santiago, Chile
- Jens Trogh
- Department of Information Technology, imec-WAVES, Ghent University, Gent, Belgium
- David Plets
- Department of Information Technology, imec-WAVES, Ghent University, Gent, Belgium
- Miroslav Opiela
- ORCiD
- Institute of Computer Science, Faculty of Science, P. J. Šafárik University (UPJS), Košice, Slovakia
- Shih-Hau Fang
- Department of Electrical Engineering, Yuan Ze University, Zhongli, Taiwan
- Yu Tsao
- Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan
- Ying-Ren Chien
- ORCiD
- Department of Electrical Engineering, National Ilan University, Yilan, Taiwan
- Shi-Shen Yang
- Department of Electrical Engineering, National Ilan University, Yilan, Taiwan
- Shih-Jyun Ye
- Department of Electrical Engineering, Yuan Ze University, Zhongli, Taiwan
- Muhammad Usman Ali
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan, South Korea
- Soojung Hur
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan, South Korea
- Yongwan Park
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan, South Korea
- DOI
- https://doi.org/10.1109/ACCESS.2019.2944389
- Journal volume & issue
-
Vol. 7
pp. 148594 – 148628
Abstract
The Indoor Positioning and Indoor Navigation (IPIN) conference holds an annual competition in which indoor localization systems from different research groups worldwide are evaluated empirically. The objective of this competition is to establish a systematic evaluation methodology with rigorous metrics both for real-time (on-site) and post-processing (off-site) situations, in a realistic environment unfamiliar to the prototype developers. For the IPIN 2018 conference, this competition was held on September 22nd, 2018, in Atlantis, a large shopping mall in Nantes (France). Four competition tracks (two on-site and two off-site) were designed. They consisted of several 1 km routes traversing several floors of the mall. Along these paths, 180 points were topographically surveyed with a 10 cm accuracy, to serve as ground truth landmarks, combining theodolite measurements, differential global navigation satellite system (GNSS) and 3D scanner systems. 34 teams effectively competed. The accuracy score corresponds to the third quartile (75th percentile) of an error metric that combines the horizontal positioning error and the floor detection. The best results for the on-site tracks showed an accuracy score of 11.70 m (Track 1) and 5.50 m (Track 2), while the best results for the off-site tracks showed an accuracy score of 0.90 m (Track 3) and 1.30 m (Track 4). These results showed that it is possible to obtain high accuracy indoor positioning solutions in large, realistic environments using wearable light-weight sensors without deploying any beacon. This paper describes the organization work of the tracks, analyzes the methodology used to quantify the results, reviews the lessons learned from the competition and discusses its future.
Keywords
