(LFU-211) SENIOR BIG DATA ENGINEER

Epam Systems


We are looking for a Senior Big Data Engineer to join our team and help us create and adjust analytics data pipelines. The ideal candidate should have hands-on experience in Cloud computing on AWS, developing scripts using Python and developing ETL processes whilst displaying a strong understanding of query execution plans and query optimization. Responsibilities Develop analytics data pipelines Develop ETL processes and scripts in Python for data integration, from multiple sources Optimize and tune both SQL and NoSQL queries to ensure efficient and seamless data processing and delivery across our data pipelines Develop and maintain data architecture standards, principles, and models for efficient data integration and management Effectively communicate with stakeholders to understand business needs and translate them into technical requirements Requirements 2+ years of experience in Cloud computing on AWS Experience with Spark Knowledge of Databricks 2+ years of experience in developing scripts using Python Strong knowledge and expertise with SQL and NoSQL Databases Experience with Data architecture We offer/Benefits - International projects with top brands - Work with global teams of highly skilled, diverse peers - Healthcare benefits - Employee financial programs - Paid time off and sick leave - Upskilling, reskilling and certification courses - Unlimited access to the LinkedIn Learning library and 22,000+ courses - Global career opportunities - Volunteer and community involvement opportunities - EPAM Employee Groups - Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn

trabajosonline.net © 2017–2021
Más información