To be successful in this role you ll bring the following technical skills and experience:

• Knowledge of Big data technologies including Spark, HDFS and Hive

• 5+ years of experience working in Hadoop Ecosystem and big data technologies with 12+ years of software development experience

• Experience reading and writing Spark transformation jobs using Java, Scala (Preferably in Java)

• Experience with Hadoop, Spark

• Knowledge of the core AWS services (S3, IAM, EC2, ELB, CloudFormation)

• Understanding of Linux and networking concepts

• Understanding of data architecture principles, including data access patterns and data modelling

• Extensive data modelling experience

• Experience working in an Agile environment

• Experience with CI/CD tools.