The Senior Data Engineer will implement complex data transformations and migration logic, converting heterogeneous baseline data into a standardized canonical format and loading it into MongoDB.
Key Responsibilities
• Develop Python/Spark transformations for baseline normalization and enrichment
• Implement mapping rules from source baselines to canonical entities
• Handle complex structural and semantic transformations
• Build reusable ingestion components for Excel, Word, and JSON
• Support pipeline optimization and fault tolerance
• Collaborate with the Lead Data Modeler on schema alignment
• Support technical lineage and audit metadata capture
