Data Orchestration: Modernizing Legacy Data Orchestration with Cloud Composer
This paper discusses the migration of data orchestration workflows from a legacy tool like Autosys to a modern, cloud -based solution, Google Cloud Composer.It explores the transition from traditional job scheduling to Directed Acyclic Graph (DAG) -based workflows using Apache Airflow, culminating in the deployment and management of these workflows in Cloud Composer.The benefits and challenges of this migration are examined, highlighting the advantages of scalability, flexibility, and cloud integration offered by Cloud Composer.
Authors
- Gautami Nadkarni
Institutions
- University at Buffalo, State University of New York (US)
Publication Details
- Journal
- International Journal of Science and Research (IJSR)
- Published
- 2025-04-05
- DOI
- https://doi.org/10.21275/sr25401101851
- Primary Topic
- Advanced Database Systems and Queries
- Type
- article
- Field-Weighted Citation Impact
- 0.00