Senior Data Architect for Scalable ETL Pipelines

Overview

Data Engineer Role Overview

As a Senior Data Architect, you will be responsible for designing and implementing scalable data pipelines that ensure high-quality, accessible data for analytics and machine learning.

Responsibilities

• Develop and optimize complex ETL / ELT pipelines to extract, transform, and load data from various sources.
• Manage and maintain big data platforms (Spark, Hadoop, Databricks) to support real-time and batch data processing.
• Collaborate with cross-functional teams, including Data Scientists and Analysts, to provide clean, structured data for informed business decisions.
• Ensure compliance with GDPR and data governance best practices to protect sensitive information.

Qualifications

You need hands-on experience with Python, SQL, Spark, and strong knowledge of cloud-based data platforms (AWS Glue, Azure Data Factory, GCP Dataflow). You should have a proven track record building real-time and batch data pipelines and problem-solving skills to drive data-driven innovation.

#J-18808-Ljbffr