Data Engineering Lead

Data Engineering Lead

We are seeking a Principal Data Engineer to lead the development of scalable, reliable data systems that support real-time analytics and high-throughput data processing. As a Data Engineering Lead, you will architect and guide the implementation of hybrid data solutions that bridge on-premise infrastructure and cloud platforms (preferably AWS).

You will lead a team of skilled data engineers, drive the adoption of best practices in stream processing, and work closely with architecture, product, and software engineering teams to align technical solutions with business needs.

Key Responsibilities

• Design and lead the implementation of scalable data pipelines with a strong focus on stream processing (Kafka) .
• Guide the migration between cloud and on-premise infrastructure , optimizing for cost and performance.
• Lead and mentor a team of engineers; define roadmap, ensure quality, and promote collaboration.
• Implement and maintain high-performance data storage and processing solutions using tools such as ClickHouse , Redis , and Kafka .
• Ensure system reliability , data consistency , and "at least once" delivery guarantees in streaming architecture.
• Evaluate emerging tools like Flink, Superset, Cube.js , and Grafana for integration and optimization.
• Collaborate with cross-functional teams to gather data requirements and align on architecture and goals.
• Stay informed about trends in data engineering and apply innovation to continually improve infrastructure.