T-Assess: An Efficient Data Quality Assessment System Tailored for Trajectory Data
With the widespread use of GPS-enabled devices and services, trajectory data fuels services in a variety of fields, such as transportation and smart cities. However, trajectory data often contains errors stemming from inaccurate GPS measurements, low sampling rates, and transmission interruptions, yielding low-quality trajectory data with negative effects on downstream services. Therefore, a crucial yet tedious endeavor is to assess the quality of trajectory data, serving as a guide for subsequent data cleaning and analyses. Despite some studies addressing general-purpose data quality assessment, no studies exist that are tailored specifically for trajectory data. To more effectively diagnose the quality of trajectory data, we propose T-Assess, an automated trajectory data quality assessment system. T-Assess is built on three fundamental principles: i) extensive coverage, ii) versatility, and iii) efficiency. To achieve comprehensive coverage, we propose assessment criteria spanning validity, completeness, consistency, and fairness. To provide high versatility, T-Assess supports both offline and online evaluations for full-batch trajectory datasets as well as real-time trajectory streams. In addition, we incorporate an evaluation optimization strategy to achieve assessment efficiency. Extensive experiments on four real-life benchmark datasets offer insight into the effectiveness of T-Assess at quantifying trajectory data quality beyond the capabilities of state-of-the-art data quality systems.
Authors
- Danlei Hu (ORCID: https://orcid.org/0009-0006-1695-3289)
- Yunjun Gao (ORCID: https://orcid.org/0000-0003-3816-8450)
- Christian S. Jensen (ORCID: https://orcid.org/0000-0002-9530-1919)
- Ziquan Fang (ORCID: https://orcid.org/0009-0009-2034-5501)
- Tianyi Li (ORCID: https://orcid.org/0000-0001-5424-6442)
- Tao Wang (ORCID: https://orcid.org/0000-0002-2480-878X)
- Junhao Zhu (ORCID: https://orcid.org/0009-0009-0768-6870)
- Lu Chen (ORCID: https://orcid.org/0000-0002-2628-3876)
Institutions
- Zhejiang Lab (CN)
- Zhejiang University (CN)
- Aalborg University (DK)
Publication Details
- Journal
- Proceedings of the VLDB Endowment
- Published
- 2024-11-01
- DOI
- https://doi.org/10.14778/3712221.3712233
- Citations
- 1
- Primary Topic
- Data Management and Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.35
Funders
- National Natural Science Foundation of China