VUM649 - DATA INTEGRATION ENGINEER

Epam Systems


We are looking for a skilled Data Integration Engineer to join our team and contribute to the design and implementation of data integration solutions. In this role, you will create effective ETL pipelines, work with complex datasets, and collaborate directly with clients to meet their data requirements. The ideal candidate is technically proficient, enjoys solving challenging problems, and is dedicated to working with large-scale data systems. Responsibilities Develop and manage ETL pipelines using tools like Spark to process data efficiently Perform detailed analysis of datasets by creating and refining complex SQL queries Work closely with clients to identify requirements, analyze challenges, and deliver tailored solutions Optimize data pipelines and workflows to ensure accuracy and high performance Collaborate with internal teams to ensure smooth integration of data across systems Troubleshoot and resolve technical issues in data integration workflows Create and maintain documentation for processes, workflows, and best practices Stay informed about new tools and technologies to improve data integration processes Guide and mentor junior team members on technical and best practice approaches Ensure adherence to data governance policies and security guidelines Requirements Degree in Computer Science, Computer Engineering, or a related discipline At least 2 years of experience in data integration or similar roles Expertise in using Apache Hive for querying and analyzing large datasets Advanced skills in SQL for creating and optimizing complex data queries Strong knowledge of data modeling concepts and ETL processes, with hands-on experience using ETL tools in production environments Proficiency in Python for automation and data transformation tasks Strong English communication skills (written and spoken) at a B2 level or higher Nice to have Experience working with the Software Development Life Cycle (SDLC) Practical knowledge of Spark for processing large-scale datasets Production experience with Presto as a query engine We offer/Benefits - International projects with top brands - Work with global teams of highly skilled, diverse peers - Healthcare benefits - Employee financial programs - Paid time off and sick leave - Upskilling, reskilling and certification courses - Unlimited access to the LinkedIn Learning library and 22,000+ courses - Global career opportunities - Volunteer and community involvement opportunities - EPAM Employee Groups - Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn

trabajosonline.net © 2017–2021
Más información