← Work

Enterprise data platform operations

I examined failures and automated releases on enterprise data platforms handling multi-terabyte workloads and hundreds of pipelines.

System context

The data platform supplied reports and analytical models through hundreds of automated pipelines.

My responsibilities

I supported platform operations and data engineering, including releases and production incidents.

I automated deployments, examined pipeline failures and improved monitoring for data processing. I also supported the teams using the data.

PythonSQLGoogle CloudAWSAirflowDatabricksCI/CD