Designing, developing, and managing large-scale data pipelines using Databricks platform, leveraging ETL methodologies, and proficiently coding in Scala and Python to extract, transform, and load data from various sources, while leading and guiding a team of data engineers to ensure efficient data processing and analytics capabilities within the organization.