**The opportunity**: At Kin + Carta, we’ve got opportunities to offer you — for growth, for leadership, for big, world-changing impact and for, dare we say it, fun. We are a global workforce that is committed to building a world that works better for everyone. And that starts with our Kin. That’s why we’re proud of: - The life we create within our virtual walls, every day - Being B Corp certified - Our honor as a “Best Company to Work For” by Women's Choice Award **The role**: **Kin + Carta** is looking to hire **Senior Spark **Data Engineer **to join our growing capabilities team. If you are innovative, passionate about data and AI technologies, and look to continually learn and enjoy sharing expertise, read on! **Role responsibilities**: - Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline, and technology capabilities - Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines - Provide consultation and lead the implementation of complex programs - Develop and maintain documentation relating to all assigned systems and projects - Tune queries running over billions of rows of data running in a distributed query engine - Perform root cause analysis to identify permanent resolutions to software or business process issues **Minimum qualifications**: **We want all new hires to succeed in their roles at Kin + Carta. That's why we've outlined the job requirements below. To be considered for this role, it's important that you meet all Minimum Qualifications. If you do not meet all of the Preferred Qualifications, we still encourage you to apply.** - Proven industry experience executing data engineering, analytics and/or data science projects or Bachelors/Masters degree in quantitative studies including Engineering, Mathematics, Statistics, Computer Science or computation-intensive Sciences and Humanities. - More than 7 years of experience working with: 1. Strong/expert Spark (PySpark) Using Jupyter Notebooks, Colab or DataBricks 2. Hands-on data pipeline development, ingest patterns in Azure 3. Orchestration tools, ADF or Airflow 4. SQL 5. Denormalized Data modeling for big data systems - Collaborative, able to work remotely, and still be an engaging team member. - Strong analytical and design skills. **Preferred qualifications**: - Proficiency in visualization/reporting tools such as Tableau and PowerBI or programmatic visualization library such as R ggplot2, Python matplotlib/seaborn/bokeh, Javascript D3. - Proficiency scripting in UNIX environment - Proficiency in big data environments and tools such as Spark, Hive, Impala, Pig, etc. - Proficiency with cloud architecture components (AWS, Azure, Google) - Proficiency with data pipeline software such as Airflow, Luigi, or Prefect - Ability to turn raw data and ambiguous business questions into distilled findings and recommendations for action - Experience leading and managing technical data/analytics/machine learning projects **About Kin + Carta**: Kin + Carta is a global digital transformation consultancy committed to working alongside our clients to build a world that works better #ForEveryone. Our 2,000 curious minds make creative connections between people, data and technology to create connected outcomes across the full lifecycle of the product and platform ecosystems. We’re makers, builders and creators by nature, and we come to work every day to build experiences for some of the world’s most influential companies. We help businesses accelerate their digital roadmap, rapidly innovate, modernize their systems, enable their teams and optimize for continued growth. We are a technology business with trust and human connection at its heart. As a Certified B Corp, our triple bottom line focus on people, the planet and profit is at the core of everything we do. We welcome our Kin to show up as their authentic selves every day. Because this is so important to us, Kin + Carta is proud to be an equal opportunity employer. To read further about our commitment to Inclusion, Diversity, Equity and Awareness, check out the IDEA page on our website. Whoever you are, wherever you’re from and whoever you love, you’ll find an open door at Kin + Carta. It’s yours to walk through if you’re passionate about building a better world for everyone, and you’re keen to be part of a diverse and inclusive culture that plays to people’s strengths and thrives on togetherness.