Job Description

• 3+ years of experience in AWS Data Engineering.
• Design and build ETL pipelines & Data lakes to automate ingestion of structured and unstructured data
• Experience working with AWS big data technologies (Redshift, S3, AWS Glue, Kinesis, Athena ,DMS, EMR and Lambda for Serverless ETL)
• Should have knowledge in SQL and NoSQL programming languages.
• Have worked on batch and real time pipelines.
• Excellent programming and debugging skills in Scala or Python & Spark.
• Good Experience in Data Lake formation, Apache spark, python, hands on experience in deploying the models.
• Must have experience in Production migration Process
• Nice to have experience with Power BI visualization tools and connectivity

Roles & Responsibilities:

• Design, build and operationalize large scale enterprise data solutions and applications
• Analyze, re-architect and re-platform on premise data warehouses to data platforms on AWS cloud.
• Design and build production data pipelines from ingestion to consumption within AWS big data architecture, using Python, or Scala.
• Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.