1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are seeking a talented Senior Data Software Engineer to join our remote team, working with a leading agriculture company that helps to improve global food security by enabling millions of farmers to make better use of available resources. As a Senior Data Software Engineer, you will be responsible for designing and implementing data processing pipelines, ensuring data quality, and optimizing data delivery. You will work with an AWS platform for running data pipelines, which is a serverless AWS-based data lake that loads data from numerous DBs. If you are passionate about data engineering and have a strong background in AWS, Apache Spark, and Python, we invite you to join our team. Responsibilities Design and implement data processing pipelines, ensuring data quality and optimizing data delivery Develop and maintain data processing infrastructure using AWS services Optimize data processing pipelines for performance and scalability Troubleshoot and resolve issues with data processing pipelines Ensure data security and compliance with data protection regulations Document data processing pipelines and related processes Collaborate with cross-functional teams to understand business requirements and develop data solutions that meet those requirements Requirements A minimum of 3 years of experience in Data Software Engineering, demonstrating your expertise in designing and implementing data processing pipelines Strong experience with Amazon Web Services, including AWS Lambda, S3, EC2, Athena and Redshift Proficiency in Apache Spark, Python, and SQL, enabling you to develop robust and scalable data processing solutions Excellent communication skills and strong critical thinking capabilities, enabling you to collaborate effectively with cross-functional teams Ability to work independently and manage stress effectively, maintaining a high level of performance even under pressure Fluent spoken and written English at an Upper-Intermediate level or higher, enabling effective communication Nice to have Experience with other AWS services, such as AWS Glue, AWS EMR, and AWS Kinesis Familiarity with machine learning and data science concepts We offer International projects with top brands Work with global teams of highly skilled, diverse peers Healthcare benefits Employee financial programs Paid time off and sick leave Upskilling, reskilling and certification courses Unlimited access to the LinkedIn Learning library and 22,000+ courses Global career opportunities Volunteer and community involvement opportunities EPAM Employee Groups Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Information Technology, Engineering, and Business Development Industries Software Development, IT Services and IT Consulting, and Transportation, Logistics, Supply Chain and Storage Referrals increase your chances of interviewing at EPAM Systems by 2x Get notified about new Senior Data Engineer jobs in Colombia . Bogota, D.C., Capital District, Colombia 2 weeks ago Bogota, D.C., Capital District, Colombia 2 days ago Senior Data Analytics and Visualization Engineer We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr