Lead Data Engineer

Lead Data Engineer – Dublin, Ireland (Hybrid)

We are looking for a Lead Data Engineer to join a dynamic team building advanced data platforms for financial crime detection. You will design and implement scalable Databricks + AWS data solutions, lead a team of engineers, and deliver high-quality, governed pipelines.

Key Responsibilities:

Build and optimise Spark / PySpark pipelines (Batch + Streaming) on DatabricksDefine lakehouse architecture (Bronze/Silver/Gold), schema governance, and data quality standardsDesign secure AWS data infrastructure (S3, Glue, Lake Formation, Lambda, Step Functions)Orchestrate workflows using Airflow, Databricks Workflows, Step FunctionsMentor engineers, lead code reviews, and drive CI/CD best practices

What We’re Looking For:

10+ years in data engineering with Databricks, Spark, Python, SQLStrong AWS experience and knowledge of data governance/lineage toolsHands-on with data orchestration and cloud data platformsExcellent leadership and stakeholder collaboration skills