Senior Data Platform Engineer (Databricks)

Join to apply for the Senior Data Platform Engineer (Databricks) role at EPAM Systems

3 days ago Be among the first 25 applicants

Join to apply for the Senior Data Platform Engineer (Databricks) role at EPAM Systems

Get AI-powered advice on this job and more exclusive features.

We are seeking an experienced Senior Data Platform Engineer with a profound expertise in Databricks and multi-cloud environments to join EPAM.

In this role, you'll engineer scalable, high-performance data solutions that unlock the full potential of data for our Fortune 1000 clients. If you thrive in building data platforms from scratch and driving innovations across cloud platforms, this opportunity at EPAM could be perfect for you.

Responsibilities

• Architect and deploy robust, scalable, and secure data platforms using Databricks, ensuring optimal performance and security
• Create cloud-agnostic solutions across AWS, Azure, and GCP to ensure flexibility and system resilience
• Design and implement end-to-end data pipelines integrating data lakes, warehouses, and streaming frameworks
• Leverage Databricks SQL, Delta Lake, MLflow, and advanced Spark optimization techniques for data interaction and performance enhancements
• Collaborate with cross-functional teams to implement and maintain workflows based on Databricks following best practices
• Develop and maintain CI / CD pipelines specifically tailored for seamless data platform deployment and testing
• Set up and manage monitoring, logging, and alerting frameworks to ensure infrastructure health and operational excellence
• Optimize compute and storage resources to achieve cost-efficiency without compromising on performance
• Troubleshoot and resolve issues related to Databricks and Spark performance
• Mentor team members on cluster management, job optimization, and resource allocation within Databricks environments
• Ensure adherence to compliance standards and maintain platform security
• Drive adoption of advanced capabilities in Databricks like Photon and Graviton instances for improved efficiency
• Regularly update and refine existing architectures to meet changing business and technology needs

Requirements

Nice to have

We offer

EPAM is a leading digital transformation services and product engineering company with 61,700+ EPAMers in 55+ countries and regions. Since 1993, our multidisciplinary teams have been helping make the future real for our clients and communities around the world. In 2018, we opened an office in Spain that quickly grew to over 1,450 EPAMers distributed between the offices in Málaga, Madrid and Cáceres as well as remotely across the country. Here you will collaborate with multinational teams, contribute to numerous innovative projects, and have an opportunity to learn and grow continuously.

Seniority level

Seniority level

Mid-Senior level

Employment type

Employment type

Full-time

Job function

Job function

Business Development, Information Technology, and Engineering

Industries

Software Development and IT Services and IT Consulting

Referrals increase your chances of interviewing at EPAM Systems by 2x

Sign in to set job alerts for “Platform Engineer” roles.

Madrid, Community of Madrid, Spain 1 week ago

Las Palmas, Canary Islands, Spain 1 year ago

Madrid, Community of Madrid, Spain 1 day ago

Madrid, Community of Madrid, Spain 2 weeks ago

Madrid, Community of Madrid, Spain 1 week ago

Madrid, Community of Madrid, Spain 2 weeks ago

AI Platform Engineer (100% remote-friendly within Spain)

Madrid, Community of Madrid, Spain 6 months ago

Software Engineer (Python) - AI Platform

Madrid, Community of Madrid, Spain 1 day ago

Madrid, Community of Madrid, Spain 7 months ago

Junior Software Engineer (AWS Lambda & Python) (100% remote Spain)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr