Data Orchestration: Modernizing Legacy Data Orchestration with Cloud Composer

This paper discusses the migration of data orchestration workflows from a legacy tool like Autosys to a modern, cloud -based solution, Google Cloud Composer.It explores the transition from traditional job scheduling to Directed Acyclic Graph (DAG) -based workflows using Apache Airflow, culminating in the deployment and management of these workflows in Cloud Composer.The benefits and challenges of this migration are examined, highlighting the advantages of scalability, flexibility, and cloud integration offered by Cloud Composer.

Authors

Institutions

Publication Details

Journal
International Journal of Science and Research (IJSR)
Published
2025-04-05
DOI
https://doi.org/10.21275/sr25401101851
Primary Topic
Advanced Database Systems and Queries
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Data Orchestration: Modernizing Legacy Data Orchestration with Cloud Composer

Gautami Nadkarni
International Journal of Science and Research (IJSR)
Advanced Database Systems and Queries
article

Data Orchestration: Modernizing Legacy Data Orchestration with Cloud Composer

Gautami Nadkarni
article en

Abstract

This paper discusses the migration of data orchestration workflows from a legacy tool like Autosys to a modern, cloud -based solution, Google Cloud Composer.It explores the transition from traditional job scheduling to Directed Acyclic Graph (DAG) -based workflows using Apache Airflow, culminating in the deployment and management of these workflows in Cloud Composer.The benefits and challenges of this migration are examined, highlighting the advantages of scalability, flexibility, and cloud integration offered by Cloud Composer.

International Journal of Science and Research (IJSR)Vol. 14(4)
University at Buffalo, State University of New York (US)
Openalex Percentile: Top 94%
Advanced Database Systems and Queries
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.