Efficient Data Processing Pipelines for Mobility Data Using MongoDB

The increasing availability of mobility data presents new opportunities and challenges for urban studies and related fields. This paper introduces a data processing pipeline developed to handle large-scale Network Signaling Data (NSD) using MongoDB. Our method addresses key challenges in data preprocessing, such as timestamp compression and noise filtering, to enhance the accuracy and efficiency of mobility pattern analysis. We applied this pipeline to a NSD dataset from Orange Romania, focusing on Cluj County for October 2023. By leveraging MongoDB’s aggregation framework, our approach significantly reduced data size and improved computational efficiency, enabling the extraction of meaningful mobility insights. Our findings highlight the importance of advanced data processing techniques in deriving reliable Origin-Destination matrices and demonstrate the potential for further applications in urban planning and smart city initiatives.

Authors

Institutions

Publication Details

Published
2024-09-26
DOI
https://doi.org/10.23919/softcom62040.2024.10721901
Primary Topic
Data Management and Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Efficient Data Processing Pipelines for Mobility Data Using MongoDB

Norbert Petrovici, Camelia-Florina Andor, Vlad Alexe
Data Management and Algorithms
article

Efficient Data Processing Pipelines for Mobility Data Using MongoDB

Norbert Petrovici, Camelia-Florina Andor, Vlad Alexe
article en

Abstract

The increasing availability of mobility data presents new opportunities and challenges for urban studies and related fields. This paper introduces a data processing pipeline developed to handle large-scale Network Signaling Data (NSD) using MongoDB. Our method addresses key challenges in data preprocessing, such as timestamp compression and noise filtering, to enhance the accuracy and efficiency of mobility pattern analysis. We applied this pipeline to a NSD dataset from Orange Romania, focusing on Cluj County for October 2023. By leveraging MongoDB’s aggregation framework, our approach significantly reduced data size and improved computational efficiency, enabling the extraction of meaningful mobility insights. Our findings highlight the importance of advanced data processing techniques in deriving reliable Origin-Destination matrices and demonstrate the potential for further applications in urban planning and smart city initiatives.

Babeș-Bolyai University (RO)
Affordable and clean energy
Openalex Percentile: Top 80%
Data Management and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Efficient Data Processing Pipelines for Mobility Data Using MongoDB — Norbert Petrovici, Camelia-Florina Andor, et al. · (2024) | TGRS Research Map | TGRS