Data Engineer

Overview Senior Talent Acquisition | Client Management | UK & Europe Recruitment | 10+ years experience

Description Participation in Markets Data Hub tasks as a Data Engineer in the definition and automation of processes developed using Big Data technologies (Spark Scala, Databricks, Airflow) in Market Risk. The key responsibilities will not be those of a Spark Scala developer, but rather process definition, data preparation, request creation following the department's procedures for process automation and configuration, and execution and validation of integrated tests. Process automation will be achieved through software deployments via Job as a Code.

Responsibilities Participation in Markets Data Hub tasks as a Data Engineer focused on process definition, data preparation, request creation following department procedures for process automation and configuration, and execution and validation of integrated tests.

Support automation of processes using Spark Scala, Databricks, Airflow as part of Market Risk projects.

Ensure deployments via Job as Code are executed according to governance and procedures.

Qualifications Experience in technology-related projects

High knowledge of SQL statements

Experience in ETL design and data models

Knowledge of Control-M and Job as Code

Experience in testing and data validation

English – professional competence

Seniority level Not Applicable

Employment type Full-time

Job function Information Technology, Engineering, and Other

Industries IT Services and IT Consulting, Software Development, and IT System Custom Software Development

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr