Research on the Design of Core Data Management System for Large-scale Scientific Research Projects in Enterprises Based on Cloud Computing

Aiming at the problem that traditional data management is difficult to be efficient, safe and scalable in large-scale scientific research projects, this paper puts forward a design scheme of data management system based on cloud computing, aiming at improving scientific research efficiency and optimizing costs. Based on AWS platform, the system covers four modules: data acquisition, storage, processing and analysis, and sharing. Apache Spark is used for efficient data processing, and AES encryption algorithm and role-based access control (RBAC) model are used to ensure data security. The system designed a clear data flow direction, from data collection to processing and analysis to sharing, and realized the automatic flow. After performance and security tests, the system is stable under high concurrency, with reasonable resource utilization and no obvious security loopholes. The successful design of this study provides an efficient, safe and extensible data management scheme for large-scale scientific research projects of enterprises.