Data Engineer - Real-Time Search Engine We are seeking a highly skilled Data Engineer to join our team in developing and maintaining real-time search engines for sales teams. The ideal candidate will have extensive experience with data acquisition, transformation, and integration using Python, Spark, and AWS Glue. They will also possess strong organizational skills and be able to work autonomously while delivering high-quality solutions. Responsibilities: - Design and develop scalable ETL pipelines for acquiring, transforming, and loading data from various sources into the data ecosystem. - Collaborate with stakeholders to understand data requirements and propose effective data acquisition and integration strategies. - Implement data transformation logic using Python and relevant frameworks, ensuring efficiency and reliability. - Utilize AWS Glue or similar tools to create and manage ETL jobs, workflows, and data catalogs. - Optimize ETL processes to improve performance and scalability, particularly for large datasets. - Apply data matching, deduplication, and aggregation techniques to enhance data accuracy and quality. - Ensure compliance with data governance, security, and privacy best practices within the scope of project deliverables. Requirements: - 7+ years of experience as a Data Engineer, with a focus on ETL processes and data integration. - Professional experience with Spark and AWS pipeline development required. - Fluency in English is required, as this role involves regular communication with international clients and team members.