• Develop new BE functionalities in our data ingestion and validation engine

• Lead a team of big data engineers to migrate functions from legacy systems to a modern framework

• Lead your team in the design and development of highly available, low latency, cloud-native big data applications

• Implement data pipelines ingesting large volumes of data and optimize the data processing engine

• Identify opportunities to optimize the existing solution, suggesting performance improvements with a focus on cost reduction

• Conduct code reviews, troubleshoot, and ensure your team s adherence to the highest level of quality in writing complex, maintainable code to develop scalable and flexible applications

• Lead cross-functional team members and stakeholders throughout projects of varying scope and complexity

Qualifications

We re looking for people who have

• 5+ Experience developing big data applications using PySpark / Spark-Scala, Databricks

• Great foundational leadership skills, including experience managing a small team of technologists

• Minimum 10+ years of experience in big data and cloud technologies

• Good understanding of distributed computing principles

• Ability to efficiently process a huge volume of data, including skills in ETL, SQL and database optimization techniques

• Excellent English communication skills, with the ability to effectively interface across cross-functional technology teams and business stakeholders

• Minimum graduate engineering degree in Computer Science or related field