Data Engineer, Specialist at Vanguard

Build and operate production data pipelines on AWS — Glue (PySpark), Step Functions, Lambda, Athena, SNS, and S3

Own operational support for production data pipelines, including monitoring, incident management, PagerDuty response, and root cause analysis

Develop and refactor transformation logic in PySpark, including migrating legacy Pandas/SQL logic and performance-tuning large-scale Spark jobs

Implement data reconciliation and sign-off, design recon checks, and investigate discrepancies

Translate complex business and financial logic into correct, testable, well-documented code

Contribute to cloud lakehouse migration — modelling refined tables, building repeatable ETL, and lifting reporting workloads onto a modern Delta/Databricks platform

Vanguard

Data Engineer, Specialist

Role Overview

About Vanguard

Key Responsibilities

Requirements & Eligibility

Required Skills & Tech