Overview
Senior Data Engineer - Trading Experience Essential - Long Term Contract
Location : Remote - UK / Europe / India
Day Rate Contract - Rate up to £400 p / d
Paritas is partnered with a leading IT Consultancy who are looking for a Data Engineer with experience in Trading to join their team on a contract basis.
This role will play a critical role in designing, building, and maintaining scalable data pipelines and analytics solutions using Azure and Databricks ecosystem. Collaborate closely with business stakeholders to ensure data is accessible, reliable, and optimized for performance.
Responsibilities
- Design and implement robust data pipelines using Azure Data Factory (ADF) and Databricks.
- Develop scalable ETL / ELT processes to ingest, transform, and load data from various sources.
- Write clean, efficient, and reusable Python code for data processing and automation.
- Optimize and manage SQL queries for data extraction, transformation, and reporting.
- Collaborate with business stakeholders to understand data requirements and deliver solutions aligned with business goals.
- Ensure data quality, integrity, and security across all data platforms.
- Monitor and troubleshoot data pipelines to ensure high availability and performance.
- Implement logging, alerting, and error-handling mechanisms for proactive issue resolution.
- Apply domain knowledge of trading and financial markets to enhance data models and analytics capabilities.
Required Skills & Qualifications
5+ years of experience in data engineering or related roles.Proven expertise in Azure Data Factory and Azure Databricks.Strong proficiency in Python for data engineering tasks.Solid understanding of SQL and relational databases.Exposure to real-time data processing frameworks (e.g., Spark Streaming, Kafka).Experience in maintaining and supporting production-grade data pipelines.Familiarity with trading business domain, including market data, trade lifecycle, and financial instruments.Experience with version control systems (e.g., Git) and CI / CD pipelines.Seniority level
Mid-Senior levelEmployment type
ContractJob function
Finance, Engineering, and Information TechnologyIndustries
Engineering ServicesData Infrastructure and AnalyticsFinancial Services#J-18808-Ljbffr