1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are looking for a highly experienced Lead Data Engineering Developer to join our team. This role involves building, optimizing, and maintaining complex data pipelines, leveraging your expertise in Python, Spark, Hive, and cloud environments. You'll play a critical role in delivering high-quality data solutions for dynamic projects. Responsibilities Design, develop, and maintain complex data pipelines to support large-scale data processing Write clean, efficient, and test-driven code using Python and SQL Implement unit testing with mock frameworks as part of the development process Work extensively with Spark and Hive for data processing and transformation Collaborate with teams to optimize data structures and algorithms for performance Utilize AWS components (EC2, S3, Lambda, DynamoDB, SQS, RDS) for cloud-based data processing and storage Ensure the scalability and reliability of data workflows and pipelines Requirements At least 7 years of hands-on experience in data engineering or related fields Strong coding skills in Python with deep expertise in SQL Experience with test-driven development and writing unit tests using mock frameworks Proven ability to design and manage complex data pipelines Extensive knowledge of Spark and Hive data processing frameworks Solid understanding of data structures and algorithms Hands-on experience with AWS cloud services including EC2, S3, Lambda, DynamoDB, SQS, and RDS English language proficiency at B2+ level Nice to have Experience with data orchestration tools like Airflow Familiarity with other cloud platforms or additional AWS services Background in optimizing data pipelines for machine learning or analytics use cases We offer International projects with top brands Work with global teams of highly skilled, diverse peers Healthcare benefits Employee financial programs Paid time off and sick leave Upskilling, reskilling and certification courses Unlimited access to the LinkedIn Learning library and 22,000+ courses Global career opportunities Volunteer and community involvement opportunities EPAM Employee Groups Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Information Technology, Engineering, and Business Development Industries Software Development, IT Services and IT Consulting, and Technology, Information and Internet Referrals increase your chances of interviewing at EPAM Systems by 2x Get notified about new Data Engineer jobs in Colombia . Bogota, D.C., Capital District, Colombia 2 weeks ago Bogota, D.C., Capital District, Colombia $24,000.00-$36,000.00 4 days ago Bogota, D.C., Capital District, Colombia 4 days ago Bogota, D.C., Capital District, Colombia 5 days ago Bogota, D.C., Capital District, Colombia 6 days ago Software Engineer (Python) Career Opportunities at Dev.Pro - 01 Bogota, D.C., Capital District, Colombia 3 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr