IEEE Journal of Indoor and Seamless Positioning and Navigation (Jan 2024)
Offsite Evaluation of Localization Systems: Criteria, Systems, and Results From IPIN 2021 and 2022 Competitions
- Francesco Potorti,
- Antonino Crivello,
- Soyeon Lee,
- Blagovest Vladimirov,
- Sangjoon Park,
- Yushi Chen,
- Long Wang,
- Runze Chen,
- Fang Zhao,
- Yue Zhuge,
- Haiyong Luo,
- Antoni Perez-Navarro,
- Antonio R. Jimenez,
- Han Wang,
- Hengyi Liang,
- Cedric De Cock,
- David Plets,
- Yan Cui,
- Zhi Xiong,
- Xiaodong Li,
- Yiming Ding,
- Fernando Javier Alvarez Franco,
- Fernando Jesus Aranda Polo,
- Felipe Parralejo Rodriguez,
- Adriano Moreira,
- Cristiano Pendao,
- Ivo Silva,
- Miguel Ortiz,
- Ni Zhu,
- Ziyou Li,
- Valerie Renaudin,
- Dongyan Wei,
- Xinchun Ji,
- Wenchao Zhang,
- Yan Wang,
- Longyang Ding,
- Jian Kuang,
- Xiaobing Zhang,
- Zhi Dou,
- Chaoqun Yang,
- Sebastian Kram,
- Maximilian Stahlke,
- Christopher Mutschler,
- Sander Coene,
- Chenglong Li,
- Alexander Venus,
- Erik Leitinger,
- Stefan Tertinek,
- Klaus Witrisal,
- Yi Wang,
- Shaobo Wang,
- Beihong Jin,
- Fusang Zhang,
- Chang Su,
- Zhi Wang,
- Siheng Li,
- Xiaodong Li,
- Shitao Li,
- Mengguan Pan,
- Wang Zheng,
- Kai Luo,
- Ziyao Ma,
- Yanbiao Gao,
- Jiaxing Chang,
- Hailong Ren,
- Wenfang Guo,
- Joaquin Torres-Sospedra
Affiliations
- Francesco Potorti
- ORCiD
- Institute of Information Science and Technologies (ISTI) National Research Council of Italy (CNR), Pisa, Italy
- Antonino Crivello
- ORCiD
- Institute of Information Science and Technologies (ISTI) National Research Council of Italy (CNR), Pisa, Italy
- Soyeon Lee
- ORCiD
- Electronics and Telecommunications Research Institute, Daejeon, South Korea
- Blagovest Vladimirov
- ORCiD
- Electronics and Telecommunications Research Institute, Daejeon, South Korea
- Sangjoon Park
- ORCiD
- Electronics and Telecommunications Research Institute, Daejeon, South Korea
- Yushi Chen
- ORCiD
- School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing, China
- Long Wang
- ORCiD
- School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing, China
- Runze Chen
- ORCiD
- School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing, China
- Fang Zhao
- ORCiD
- School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing, China
- Yue Zhuge
- ORCiD
- Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
- Haiyong Luo
- ORCiD
- Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
- Antoni Perez-Navarro
- ORCiD
- Faculty of Computer Sciences, Multimedia and Telecommunication, Universitat Oberta de Catalunya, Barcelona, Spain
- Antonio R. Jimenez
- ORCiD
- Centre for Automation and Robotics (CSIC-UPM), Arganda del Rey, Spain
- Han Wang
- ORCiD
- Huawei Technologies Company Ltd., Shenzhen, China
- Hengyi Liang
- ORCiD
- Huawei Technologies Company Ltd., Shenzhen, China
- Cedric De Cock
- ORCiD
- Department of Information Technology, IMEC-WAVES/Ghent University, Gent, Belgium
- David Plets
- ORCiD
- Department of Information Technology, IMEC-WAVES/Ghent University, Gent, Belgium
- Yan Cui
- ORCiD
- College of Automation, Nanjing University of Aeronautics and Astronautics, Nanjing, China
- Zhi Xiong
- ORCiD
- College of Automation, Nanjing University of Aeronautics and Astronautics, Nanjing, China
- Xiaodong Li
- ORCiD
- College of Automation, Nanjing University of Aeronautics and Astronautics, Nanjing, China
- Yiming Ding
- ORCiD
- College of Automation, Nanjing University of Aeronautics and Astronautics, Nanjing, China
- Fernando Javier Alvarez Franco
- ORCiD
- Sensory System Research Group (GISS), University of Extremadura, Badajoz, Spain
- Fernando Jesus Aranda Polo
- ORCiD
- Sensory System Research Group (GISS), University of Extremadura, Badajoz, Spain
- Felipe Parralejo Rodriguez
- ORCiD
- Sensory System Research Group (GISS), University of Extremadura, Badajoz, Spain
- Adriano Moreira
- ORCiD
- Centro ALGORITMI, Universidade do Minho, Guimarães, Portugal
- Cristiano Pendao
- ORCiD
- Department of Engineering, School of Sciences and Technology, University of Trás-os-Montes and Alto Douro, Vila Real, Portugal
- Ivo Silva
- ORCiD
- Centro ALGORITMI, Universidade do Minho, Guimarães, Portugal
- Miguel Ortiz
- ORCiD
- GEOLOC Laboratory, AME Department of the University Gustave Eiffel, Bouguenais, France
- Ni Zhu
- ORCiD
- GEOLOC Laboratory, AME Department of the University Gustave Eiffel, Bouguenais, France
- Ziyou Li
- ORCiD
- GEOLOC Laboratory, AME Department of the University Gustave Eiffel, Bouguenais, France
- Valerie Renaudin
- ORCiD
- GEOLOC Laboratory, AME Department of the University Gustave Eiffel, Bouguenais, France
- Dongyan Wei
- ORCiD
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, China
- Xinchun Ji
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, China
- Wenchao Zhang
- ORCiD
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, China
- Yan Wang
- ORCiD
- GNSS Research Center, Wuhan University, Wuhan, China
- Longyang Ding
- ORCiD
- GNSS Research Center, Wuhan University, Wuhan, China
- Jian Kuang
- ORCiD
- GNSS Research Center, Wuhan University, Wuhan, China
- Xiaobing Zhang
- ORCiD
- AutoNavi Software Company Ltd., China
- Zhi Dou
- ORCiD
- AutoNavi Software Company Ltd., China
- Chaoqun Yang
- ORCiD
- AutoNavi Software Company Ltd., China
- Sebastian Kram
- ORCiD
- Fraunhofer IIS, Fraunhofer Institute for Integrated Circuits IIS, Nuremberg, Germany
- Maximilian Stahlke
- ORCiD
- Fraunhofer IIS, Fraunhofer Institute for Integrated Circuits IIS, Nuremberg, Germany
- Christopher Mutschler
- ORCiD
- Fraunhofer IIS, Fraunhofer Institute for Integrated Circuits IIS, Nuremberg, Germany
- Sander Coene
- ORCiD
- Department of Information Technology, IMEC-WAVES/Ghent University, Gent, Belgium
- Chenglong Li
- ORCiD
- Department of Information Technology, IMEC-WAVES/Ghent University, Gent, Belgium
- Alexander Venus
- ORCiD
- Christian Doppler Laboratory for Location-Aware Electronic Systems, Graz University of Technology, Graz, Austria
- Erik Leitinger
- ORCiD
- Christian Doppler Laboratory for Location-Aware Electronic Systems, Graz University of Technology, Graz, Austria
- Stefan Tertinek
- ORCiD
- Christian Doppler Laboratory for Location-Aware Electronic Systems, Graz University of Technology, Graz, Austria
- Klaus Witrisal
- ORCiD
- Christian Doppler Laboratory for Location-Aware Electronic Systems, Graz University of Technology, Graz, Austria
- Yi Wang
- ORCiD
- Huawei Technologies Company Ltd., Shenzhen, China
- Shaobo Wang
- ORCiD
- Huawei Technologies Company Ltd., Shenzhen, China
- Beihong Jin
- ORCiD
- Institute of Software Chinese Academy of Sciences, Beijing, China
- Fusang Zhang
- ORCiD
- Institute of Software Chinese Academy of Sciences, Beijing, China
- Chang Su
- ORCiD
- Institute of Software Chinese Academy of Sciences, Beijing, China
- Zhi Wang
- ORCiD
- Institute of Software Chinese Academy of Sciences, Beijing, China
- Siheng Li
- ORCiD
- Institute of Software Chinese Academy of Sciences, Beijing, China
- Xiaodong Li
- ORCiD
- Pervasive Communication Research Center, Purple Mountain Laboratories, Nanjing, China
- Shitao Li
- ORCiD
- Pervasive Communication Research Center, Purple Mountain Laboratories, Nanjing, China
- Mengguan Pan
- ORCiD
- Pervasive Communication Research Center, Purple Mountain Laboratories, Nanjing, China
- Wang Zheng
- ORCiD
- Pervasive Communication Research Center, Purple Mountain Laboratories, Nanjing, China
- Kai Luo
- ORCiD
- Beijing University of Posts and Telecommunications, Beijing, China
- Ziyao Ma
- ORCiD
- Beijing University of Posts and Telecommunications, Beijing, China
- Yanbiao Gao
- ORCiD
- Beijing University of Posts and Telecommunications, Beijing, China
- Jiaxing Chang
- ORCiD
- Beijing University of Posts and Telecommunications, Beijing, China
- Hailong Ren
- ORCiD
- Beijing University of Posts and Telecommunications, Beijing, China
- Wenfang Guo
- ORCiD
- Beijing University of Posts and Telecommunications, Beijing, China
- Joaquin Torres-Sospedra
- ORCiD
- Centro ALGORITMI, Universidade do Minho, Guimarães, Portugal
- DOI
- https://doi.org/10.1109/jispin.2024.3355840
- Journal volume & issue
-
Vol. 2
pp. 92 – 129
Abstract
Indoor positioning is a thriving research area, which is slowly gaining market momentum. Its applications are mostly customized, ad hoc installations; ubiquitous applications analogous to Global Navigation Satellite System for outdoors are not available because of the lack of generic platforms, widely accepted standards and interoperability protocols. In this context, the indoor positioning and indoor navigation (IPIN) competition is the only long-term, technically sound initiative to monitor the state of the art of real systems by measuring their performance in a realistic environment. Most competing systems are pedestrian-oriented and based on the use of smartphones, but several competing tracks were set up, enabling comparison of an array of technologies. The two IPIN competitions described here include only off-site tracks. In contrast with on-site tracks where competitors bring their systems on-site—which were impossible to organize during 2021 and 2022—in off-site tracks competitors download prerecorded data from multiple sensors and process them using the EvaalAPI, a real-time, web-based emulation interface. As usual with IPIN competitions, tracks were compliant with the EvAAL framework, ensuring consistency of the measurement procedure and reliability of results. The main contribution of this work is to show a compilation of possible indoor positioning scenarios and different indoor positioning solutions to the same problem.
Keywords
- Channel impulse response (CIR) positioning
- evaluation
- fifth-generation (5G) positioning
- foot-mounted inertial measurement unit (IMU)
- indoor navigation
- indoor positioning
