Lead the Databricks architecture, development and delivery for enterprise-scale data platforms.
Drive Synapse-to-Databricks migration and modernization of legacy ETL workloads.
Design and implement scalable Lakehouse Architecture using Databricks and Delta Lake.
Develop robust data pipelines using PySpark, Spark SQL and Python.
Establish engineering standards, reusable frameworks and best practices.
Lead technical design discussions and conduct code/design reviews.
Mentor data engineers and provide technical guidance across projects.
Own technical delivery across major data engineering workstreams.
Perform performance tuning and optimization of data pipelines and Spark workloads.
Ensure scalability, reliability, security and maintainability of data solutions.
Work with Azure services including ADF, ADLS Gen2 and Azure SQL.
Design and implement secure Azure data platform solutions.
Work with Synapse Pipelines, Synapse Spark, Synapse SQL Pools, Synapse Notebooks and Data Flows.
Implement CI/CD practices using GitLab CI/CD.
Contribute to data modeling, advanced SQL development and enterprise data architecture.
Collaborate with architects, engineering teams and business stakeholders to deliver high-quality solutions.