Senior Data Engineer

We are looking for an experienced Senior Data Engineer to join our AI team. You will be responsible for designing and optimizing complex data storage solutions, developing and maintaining efficient data pipelines, and ensuring data quality and integrity. Working closely with data analysts, machine learning engineers, and software engineers, you will deliver relevant datasets or data APIs for downstream applications.

This role requires strong proficiency in data modelling, database management, and programming skills in Python and SQL. You should have experience with big data technologies, ETL processes, data warehousing, and cloud platforms. Additionally, expertise in implementing data security measures and maintaining data systems in regulated environments is essential.

Primary Job Responsibilities

• Design and optimize complex data storage solutions, including data warehouses and data lakes.
• Develop, automate, and maintain data pipelines for efficient and scalable ETL processes.
• Ensure data quality and integrity through data validation, cleansing, and error handling.
• Collaborate with data analysts, machine learning engineers, and software engineers to deliver relevant datasets or data APIs for downstream applications.
• Implement data security measures and access controls to protect sensitive information.
• Monitor data infrastructure for performance and reliability, addressing issues promptly.
• Stay abreast of industry trends and emerging technologies in data engineering.
• Document data pipelines, processes, and best practices for knowledge sharing.
• Lead data governance and compliance efforts to meet regulatory requirements.
• Collaborate with cross-functional teams to drive data-driven decision-making within the organization.

Experience

Skills / Abilities / Knowledge

Education

Bachelors in Computer Science or Engineering

Languages

Tools and Applications

Our Offer