(OPF-737) - SENIOR DATA ARCHITECT

Bebeedata


Job Title: Senior Data Engineer We are seeking a highly skilled and experienced Senior Data Engineer to join our VIX Streaming team. The ideal candidate will have a strong background in building next-generation data solutions using Google Cloud Platform. About the Role: - This role involves designing, developing, and maintaining high-volume, high-velocity streaming analytical data pipelines on Google Cloud Platform. - The successful candidate will work closely with our team to build efficient data ingestion processes landing data into Google Storage and Big Query. - Familiarity with cloud data environments, especially Google Cloud Platform, is essential for this position. Your Day-to-Day Responsibilities: 1. Design and develop big data ETL pipelines using Google Cloud Composer, Python, Infrastructure-as-code (IaC), and SQL. 2. Build, manage, and maintain data ingestion processes landing data into Google Storage and Big Query. 3. Enhance and maintain STAR schema analytics data warehouse on Big Query. Requirements: - A minimum of 10 years of experience in data engineering. - Demonstrated knowledge of building and owning reliable end-to-end data pipelines. - Expert-level experience with GCP, including Airflow, Google Composer, Big Query, Google Storage, Data Flow, Pub/Sub, Datawarehouse best practices, Relational and Dimensional Modeling, SQL, Python, Java, and IaC tools like Pulumi. Eligibility Requirements: - Employment/education will be verified. - Applicants must be currently authorized to work on a full-time basis. We offer a competitive salary and benefits package, as well as opportunities for professional growth and development in a dynamic and innovative environment. If you are passionate about data engineering and have the skills and experience we are looking for, please submit your application today!

trabajosonline.net © 2017–2021
Más información