Senior Data Engineer/ Databricks, PySpark, Python

Senior Data Engineer/ Databricks, PySpark, Python 🏢 EPAM Systems 📍 Remote · Armenia 🕐 Full Time About the role We are looking for an experienced Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at a significant scale, processing tens of terabytes of telemetry data in Azure Databricks and running approximately 200 Databricks jobs. What you’ll do 🗂 • Monitor the health, stability, and performance of the production data platform • Investigate and resolve performance issues and production incidents • Analyze Databricks workloads and identify performance bottlenecks • Optimize PySpark workloads and Databricks jobs for performance, reliability, and cost efficiency • Support and improve approximately 200 existing Databricks jobs and associated data pipelines • Prepare the platform for increasing data volumes and workloads as additional vehicle platforms are onboarded What we’re looking for 🔎 • Expertise in Azure Databricks • Advanced skills in Python development • Understanding of performance optimization for large-scale Spark workloads • Background in operating and troubleshooting production data platforms • Knowledge of monitoring, observability, and capacity planning combined with cloud cost optimization • English proficiency at an Upper-Intermediate level (B2) or higher How to apply 🙋 Open on ITA Jobs and apply → More IT vacancies in Armenia, matched to your CV — jobs.ita.am/vacancies #Data #Senior #BigData