Challenges in managing and archiving Big Data in Oman's private sector

The rapid development of technologies such as artificial intelligence, the Internet of Things, and social media has resulted in exponential growth in data production and brought about new challenges for management and archiving big data. Organizations face challenges related to digital infrastructure, a lack of clearly defined policies and strategies, and human resources with relevant qualifications that impede the use of big data in an optimal way. This research focuses on an in-depth analysis of the most relevant technical, organizational, and environmental big data management and archiving challenges in the private sector in Oman. It was carried out through semi-structured interviews with 14 experts from different companies to ensure comprehensive representation. The results present various challenges, including inadequate advanced technical tools, a lack of clear regulatory policies, and a shortage of trained personnel. It also found differential impacts across organizations according to the expertise and specializations of employees: those that rely more on traditional infrastructures are less able to rise to the challenges posed by big data. The study epitomizes that improvement in digital infrastructure, professional training, and integrated regulatory policies is the pathway to effective management of big data. These results call on organizations to revise their strategies and align with the demands of the digital age to ensure data sustainability and improve organizational efficiency.