1 day ago Be among the first 25 applicants EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are seeking a highly skilled Lead Data DevOps Engineer to oversee the migration of Ad Tech workloads from Spark on EKS and Apache Flink to Databricks on AWS. This position will focus on delivering a strategic MVP to support 217 client workflows while ensuring integration with Unity Catalog and maintaining strong DevOps standards. Responsibilities Design CI/CD pipelines for Databricks and Spark workflows, ensuring compatibility with both batch and streaming operations Manage infrastructure provisioning and deployment using client DevOps tools and infrastructure-as-code frameworks Facilitate collaboration with data engineers, architects, and QA teams to ensure testing, validation, and release management best practices Monitor and optimize data infrastructure, ensuring consistent performance and reliability across environments Enable the deployment and configuration of Databricks Unity Catalog with a focus on secure access strategies Troubleshoot deployment issues and address inconsistencies in development, staging, and production environments Document DevOps practices, environment specifications, and deployment frameworks for the migrated workloads Engage in incident response activities, root cause analysis, and improvements to infrastructure and workflow processes Requirements 5+ years of experience in DevOps with expertise in cloud-based data platforms, especially AWS Knowledge of Databricks, Apache Spark, and CI/CD frameworks in data environments Skills in infrastructure-as-code solutions such as Terraform, CloudFormation, or Pulumi Familiarity with automation/orchestration platforms, including Apache Airflow or Jenkins Expertise in scripting languages like Python or Bash for automation and monitoring tasks Understanding of IAM, secrets management, and data platform security in cloud environments Competency in facilitating distributed Agile/Scrum operations across time zones Flexibility to pair with USA West Coast time zones Nice to have Background in Spark on EKS and Kubernetes deployments Familiarity with Apache Flink and processing of real-time streaming data Understanding of Unity Catalog configuration and access control in Databricks Knowledge of observability platforms like Prometheus, Grafana, Datadog, or CloudWatch Proficiency in Python-based data engineering for advanced automation tasks We offer International projects with top brands Work with global teams of highly skilled, diverse peers Healthcare benefits Employee financial programs Paid time off and sick leave Upskilling, reskilling and certification courses Unlimited access to the LinkedIn Learning library and 22,000+ courses Global career opportunities Volunteer and community involvement opportunities EPAM Employee Groups Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Engineering, Information Technology, and Business Development Industries Software Development, IT Services and IT Consulting, and Venture Capital and Private Equity Principals Referrals increase your chances of interviewing at EPAM Systems by 2x Get notified about new DevOps Engineer jobs in Colombia . Bogota, D.C., Capital District, Colombia 2 days ago Bogota, D.C., Capital District, Colombia 2 days ago Bogota, D.C., Capital District, Colombia 6 months ago Bogota, D.C., Capital District, Colombia 2 weeks ago Bogota, D.C., Capital District, Colombia 4 days ago Bogota, D.C., Capital District, Colombia 3 days ago Bogota, D.C., Capital District, Colombia 1 week ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr