SENIOR DATA INTEGRATION ENGINEER | KDT824

Epam Systems


We are seeking a Senior Data Integration Engineer to join our team and play a key role in developing and managing data integration solutions. In this role, you will design and implement efficient ETL pipelines, analyze complex datasets, and collaborate directly with customers to understand and address their data needs. The ideal candidate has a strong technical background, excellent problem-solving skills, and a passion for working with large-scale data systems. Responsibilities Build and maintain ETL pipelines, leveraging tools like Spark for efficient data processing Perform ad-hoc data analysis by writing and optimizing complex SQL queries Collaborate with customers to gather requirements, analyze needs, and propose effective solutions Ensure data integrity and performance by optimizing data workflows and pipelines Work closely with cross-functional teams to ensure seamless integration of data systems Monitor, troubleshoot, and resolve issues in data integration processes Document processes, workflows, and best practices to ensure knowledge sharing and consistency Stay updated on emerging data integration tools and technologies to enhance system performance Provide technical guidance and mentorship to junior team members Ensure compliance with data governance and security standards Requirements Bachelor's degree in Computer Science, Computer Engineering, or a related field At least 3 years of experience in data integration roles Proficiency with Apache Hive for querying and analyzing large datasets Advanced expertise in SQL for writing and optimizing complex queries Strong understanding of data modeling and ETL processes, with hands-on experience using any ETL tools in a production environment Proficiency in Python for scripting and data transformation Fluent English communication skills (written and spoken) at a B2 level or higher Nice to have Practical experience with the Software Development Life Cycle (SDLC) Hands-on experience with Spark for large-scale data processing Production experience with the Presto query engine We offer/Benefits - International projects with top brands - Work with global teams of highly skilled, diverse peers - Healthcare benefits - Employee financial programs - Paid time off and sick leave - Upskilling, reskilling and certification courses - Unlimited access to the LinkedIn Learning library and 22,000+ courses - Global career opportunities - Volunteer and community involvement opportunities - EPAM Employee Groups - Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn

trabajosonline.net © 2017–2021
Más información